2026-02-12T17:58:55.755 INFO:root:teuthology version: 1.2.4.dev5+g8bec0da71 2026-02-12T17:58:55.772 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T17:58:55.855 INFO:teuthology.run:Config: archive_path: /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46480 branch: wip-yuri4-testing-2026-02-11-2126 description: rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-2} onode-segment$/{none} write$/{random/{compr$/{no$/{no}} random}}}} rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/pool-create-delete} email: yweinste@redhat.com first_in_suite: false flavor: default job_id: '46480' kernel: branch: distro kdb: true sha1: distro last_in_suite: false machine_type: trial name: yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuri4-testing-2026-02-11-2126 ceph: conf: client: debug monc: 20 debug ms: 1 global: mon client directed command retry: 5 mon election default strategy: 1 ms bind msgr1: false ms bind msgr2: true ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: mon ms inject internal delays: 0.002 ms inject socket failures: 2500 ms type: async mgr: debug mgr: 20 debug monc: 10 debug ms: 1 mon: debug mon: 30 debug ms: 20 debug paxos: 20 mon min osdmap epochs: 25 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub inject crc mismatch: 0.01 mon scrub inject missing keys: 0.05 mon scrub interval: 300 paxos service trim min: 5 osd: bdev async discard: true bdev enable discard: true bluestore allocator: btree bluestore block size: 96636764160 bluestore fsck on mount: true bluestore onode segment size: 0 bluestore write v2 random: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd mclock skip benchmark: true osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - ScrubResult - scrub mismatch - overall HEALTH_ - \(MGR_DOWN\) - \(PG_AVAILABILITY\) - \(SLOW_OPS\) - slow request - \(OSD_SLOW_PING_TIME - \(MON_NETSPLIT) - overall HEALTH_ - \(MON_DOWN\) - \(TOO_FEW_PGS\) - \(POOL_APP_NOT_ENABLED\) - slow request - overall HEALTH_ sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri4-testing-2026-02-11-2126 sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 owner: scheduled_yuriw@soko04.front.sepia.ceph.com priority: 69 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mon.d - mon.e - osd.0 - osd.1 - osd.2 - - mon.f - mon.g - mon.h - mon.i - mgr.x - osd.3 - osd.4 - osd.5 - client.0 seed: 7172 sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri4-testing-2026-02-11-2126 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 targets: trial048.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHA1ur+CG4dYiTh1spKZKqqy6kHAiuLyqofyS0PLgbwRy+5fyF1Ew/oHe7ryoqS1M4/sjNiOu1JwOMLoEVp54Ug= trial111.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHLMj3uW895BU8xAMMCUg9cYl1I8UY9QRJ7Hjphx0qHaV/EvtZfcnEarw6IKaMCYZK8y06MFZJX2QGdIJ3q/+z8= tasks: - install: null - ceph: null - mon_thrash: revive_delay: 90 store_thrash: true thrash_delay: 1 thrash_many: true - exec: client.0: - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 8bec0da71becad44414c54979f64c9ef0e7099c6 timestamp: 2026-02-12_15:38:14 tube: trial user: yuriw verbose: true worker_log: /home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482 2026-02-12T17:58:55.855 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa; will attempt to use it 2026-02-12T17:58:55.856 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa/tasks 2026-02-12T17:58:55.856 INFO:teuthology.run_tasks:Running task internal.check_packages... 2026-02-12T17:58:55.857 INFO:teuthology.task.internal:Checking packages... 2026-02-12T17:58:55.857 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'afefaa40503a4bf024e96f97dd7f852b75f00ad6' 2026-02-12T17:58:55.857 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2026-02-12T17:58:55.857 INFO:teuthology.packaging:ref: None 2026-02-12T17:58:55.857 INFO:teuthology.packaging:tag: None 2026-02-12T17:58:55.858 INFO:teuthology.packaging:branch: wip-yuri4-testing-2026-02-11-2126 2026-02-12T17:58:55.858 INFO:teuthology.packaging:sha1: afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-12T17:58:55.858 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuri4-testing-2026-02-11-2126 2026-02-12T17:58:55.978 INFO:teuthology.task.internal:Found packages for ceph version 20.3.0-5230.gafefaa40 2026-02-12T17:58:55.980 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2026-02-12T17:58:55.992 INFO:teuthology.task.internal:no buildpackages task found 2026-02-12T17:58:55.992 INFO:teuthology.run_tasks:Running task internal.save_config... 2026-02-12T17:58:56.005 INFO:teuthology.task.internal:Saving configuration 2026-02-12T17:58:56.018 INFO:teuthology.run_tasks:Running task internal.check_lock... 2026-02-12T17:58:56.031 INFO:teuthology.task.internal.check_lock:Checking locks... 2026-02-12T17:58:56.109 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial048.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46480', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 17:55:37.948237', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHA1ur+CG4dYiTh1spKZKqqy6kHAiuLyqofyS0PLgbwRy+5fyF1Ew/oHe7ryoqS1M4/sjNiOu1JwOMLoEVp54Ug='} 2026-02-12T17:58:56.170 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'trial111.front.sepia.ceph.com', 'description': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46480', 'up': True, 'machine_type': 'trial', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2026-02-12 17:55:37.948868', 'locked_by': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHLMj3uW895BU8xAMMCUg9cYl1I8UY9QRJ7Hjphx0qHaV/EvtZfcnEarw6IKaMCYZK8y06MFZJX2QGdIJ3q/+z8='} 2026-02-12T17:58:56.170 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2026-02-12T17:58:56.182 INFO:teuthology.task.internal:roles: ubuntu@trial048.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mon.d', 'mon.e', 'osd.0', 'osd.1', 'osd.2'] 2026-02-12T17:58:56.182 INFO:teuthology.task.internal:roles: ubuntu@trial111.front.sepia.ceph.com - ['mon.f', 'mon.g', 'mon.h', 'mon.i', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0'] 2026-02-12T17:58:56.182 INFO:teuthology.run_tasks:Running task console_log... 2026-02-12T17:58:56.323 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x79f38a1c8860>, signals=[15]) 2026-02-12T17:58:56.323 INFO:teuthology.run_tasks:Running task internal.connect... 2026-02-12T17:58:56.334 INFO:teuthology.task.internal:Opening connections... 2026-02-12T17:58:56.334 DEBUG:teuthology.task.internal:connecting to ubuntu@trial048.front.sepia.ceph.com 2026-02-12T17:58:56.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T17:58:56.397 DEBUG:teuthology.task.internal:connecting to ubuntu@trial111.front.sepia.ceph.com 2026-02-12T17:58:56.398 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T17:58:56.459 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2026-02-12T17:58:56.471 DEBUG:teuthology.orchestra.run.trial048:> uname -m 2026-02-12T17:58:56.486 INFO:teuthology.orchestra.run.trial048.stdout:x86_64 2026-02-12T17:58:56.487 DEBUG:teuthology.orchestra.run.trial048:> cat /etc/os-release 2026-02-12T17:58:56.542 INFO:teuthology.orchestra.run.trial048.stdout:NAME="CentOS Stream" 2026-02-12T17:58:56.542 INFO:teuthology.orchestra.run.trial048.stdout:VERSION="9" 2026-02-12T17:58:56.542 INFO:teuthology.orchestra.run.trial048.stdout:ID="centos" 2026-02-12T17:58:56.542 INFO:teuthology.orchestra.run.trial048.stdout:ID_LIKE="rhel fedora" 2026-02-12T17:58:56.542 INFO:teuthology.orchestra.run.trial048.stdout:VERSION_ID="9" 2026-02-12T17:58:56.542 INFO:teuthology.orchestra.run.trial048.stdout:PLATFORM_ID="platform:el9" 2026-02-12T17:58:56.542 INFO:teuthology.orchestra.run.trial048.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T17:58:56.542 INFO:teuthology.orchestra.run.trial048.stdout:ANSI_COLOR="0;31" 2026-02-12T17:58:56.542 INFO:teuthology.orchestra.run.trial048.stdout:LOGO="fedora-logo-icon" 2026-02-12T17:58:56.542 INFO:teuthology.orchestra.run.trial048.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T17:58:56.542 INFO:teuthology.orchestra.run.trial048.stdout:HOME_URL="https://centos.org/" 2026-02-12T17:58:56.542 INFO:teuthology.orchestra.run.trial048.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T17:58:56.542 INFO:teuthology.orchestra.run.trial048.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T17:58:56.542 INFO:teuthology.orchestra.run.trial048.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T17:58:56.543 INFO:teuthology.lock.ops:Updating trial048.front.sepia.ceph.com on lock server 2026-02-12T17:58:56.612 DEBUG:teuthology.orchestra.run.trial111:> uname -m 2026-02-12T17:58:56.628 INFO:teuthology.orchestra.run.trial111.stdout:x86_64 2026-02-12T17:58:56.628 DEBUG:teuthology.orchestra.run.trial111:> cat /etc/os-release 2026-02-12T17:58:56.683 INFO:teuthology.orchestra.run.trial111.stdout:NAME="CentOS Stream" 2026-02-12T17:58:56.683 INFO:teuthology.orchestra.run.trial111.stdout:VERSION="9" 2026-02-12T17:58:56.683 INFO:teuthology.orchestra.run.trial111.stdout:ID="centos" 2026-02-12T17:58:56.683 INFO:teuthology.orchestra.run.trial111.stdout:ID_LIKE="rhel fedora" 2026-02-12T17:58:56.683 INFO:teuthology.orchestra.run.trial111.stdout:VERSION_ID="9" 2026-02-12T17:58:56.683 INFO:teuthology.orchestra.run.trial111.stdout:PLATFORM_ID="platform:el9" 2026-02-12T17:58:56.683 INFO:teuthology.orchestra.run.trial111.stdout:PRETTY_NAME="CentOS Stream 9" 2026-02-12T17:58:56.684 INFO:teuthology.orchestra.run.trial111.stdout:ANSI_COLOR="0;31" 2026-02-12T17:58:56.684 INFO:teuthology.orchestra.run.trial111.stdout:LOGO="fedora-logo-icon" 2026-02-12T17:58:56.684 INFO:teuthology.orchestra.run.trial111.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2026-02-12T17:58:56.684 INFO:teuthology.orchestra.run.trial111.stdout:HOME_URL="https://centos.org/" 2026-02-12T17:58:56.684 INFO:teuthology.orchestra.run.trial111.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2026-02-12T17:58:56.684 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2026-02-12T17:58:56.684 INFO:teuthology.orchestra.run.trial111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2026-02-12T17:58:56.684 INFO:teuthology.lock.ops:Updating trial111.front.sepia.ceph.com on lock server 2026-02-12T17:58:56.755 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2026-02-12T17:58:56.768 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2026-02-12T17:58:56.780 INFO:teuthology.task.internal:Checking for old test directory... 2026-02-12T17:58:56.780 DEBUG:teuthology.orchestra.run.trial048:> test '!' -e /home/ubuntu/cephtest 2026-02-12T17:58:56.781 DEBUG:teuthology.orchestra.run.trial111:> test '!' -e /home/ubuntu/cephtest 2026-02-12T17:58:56.796 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2026-02-12T17:58:56.811 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2026-02-12T17:58:56.811 DEBUG:teuthology.orchestra.run.trial048:> test -z $(ls -A /var/lib/ceph) 2026-02-12T17:58:56.837 DEBUG:teuthology.orchestra.run.trial111:> test -z $(ls -A /var/lib/ceph) 2026-02-12T17:58:56.853 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2026-02-12T17:58:57.007 INFO:teuthology.run_tasks:Running task kernel... 2026-02-12T17:58:57.027 INFO:teuthology.task.kernel:normalize config orig: {'branch': 'distro', 'kdb': True, 'sha1': 'distro'} 2026-02-12T17:58:57.027 INFO:teuthology.task.kernel:config {'mon.a': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'mon.f': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, timeout 300 2026-02-12T17:58:57.027 DEBUG:teuthology.orchestra.run.trial048:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T17:58:57.028 DEBUG:teuthology.orchestra.run.trial111:> test -f /run/.containerenv -o -f /.dockerenv 2026-02-12T17:58:57.042 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T17:58:57.042 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T17:58:57.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T17:58:57.043 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T17:58:57.098 INFO:teuthology.orchestra.run.trial048.stdout:5.14.0-645.el9.x86_64 2026-02-12T17:58:57.098 INFO:teuthology.task.kernel:Running kernel on trial048: 5.14.0-645.el9.x86_64 2026-02-12T17:58:57.098 DEBUG:teuthology.orchestra.run.trial048:> sudo yum install -y kernel 2026-02-12T17:58:57.098 INFO:teuthology.orchestra.run.trial111.stdout:5.14.0-645.el9.x86_64 2026-02-12T17:58:57.099 INFO:teuthology.task.kernel:Running kernel on trial111: 5.14.0-645.el9.x86_64 2026-02-12T17:58:57.099 DEBUG:teuthology.orchestra.run.trial111:> sudo yum install -y kernel 2026-02-12T17:58:59.058 INFO:teuthology.orchestra.run.trial111.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 8.9 MB 00:01 2026-02-12T17:59:02.241 INFO:teuthology.orchestra.run.trial111.stdout:CentOS Stream 9 - AppStream 10 MB/s | 27 MB 00:02 2026-02-12T17:59:05.785 INFO:teuthology.orchestra.run.trial048.stdout:CentOS Stream 9 - BaseOS 1.1 MB/s | 8.9 MB 00:08 2026-02-12T17:59:06.006 INFO:teuthology.orchestra.run.trial111.stdout:CentOS Stream 9 - CRB 5.6 MB/s | 7.8 MB 00:01 2026-02-12T17:59:08.267 INFO:teuthology.orchestra.run.trial111.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 20 kB 00:01 2026-02-12T17:59:09.563 INFO:teuthology.orchestra.run.trial048.stdout:CentOS Stream 9 - AppStream 8.3 MB/s | 27 MB 00:03 2026-02-12T17:59:09.979 INFO:teuthology.orchestra.run.trial111.stdout:Extra Packages for Enterprise Linux 12 MB/s | 20 MB 00:01 2026-02-12T17:59:13.189 INFO:teuthology.orchestra.run.trial048.stdout:CentOS Stream 9 - CRB 6.2 MB/s | 7.8 MB 00:01 2026-02-12T17:59:13.201 INFO:teuthology.orchestra.run.trial111.stdout:lab-extras 1.2 MB/s | 50 kB 00:00 2026-02-12T17:59:14.217 INFO:teuthology.orchestra.run.trial048.stdout:CentOS Stream 9 - Extras packages 69 kB/s | 20 kB 00:00 2026-02-12T17:59:14.268 INFO:teuthology.orchestra.run.trial111.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T17:59:14.288 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T17:59:14.289 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T17:59:14.289 INFO:teuthology.orchestra.run.trial111.stdout: Package Architecture Version Repository Size 2026-02-12T17:59:14.289 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T17:59:14.290 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T17:59:14.290 INFO:teuthology.orchestra.run.trial111.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T17:59:14.290 INFO:teuthology.orchestra.run.trial111.stdout:Installing dependencies: 2026-02-12T17:59:14.290 INFO:teuthology.orchestra.run.trial111.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T17:59:14.290 INFO:teuthology.orchestra.run.trial111.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T17:59:14.290 INFO:teuthology.orchestra.run.trial111.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T17:59:14.290 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T17:59:14.290 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T17:59:14.290 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T17:59:14.290 INFO:teuthology.orchestra.run.trial111.stdout:Install 4 Packages 2026-02-12T17:59:14.291 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T17:59:14.291 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 88 M 2026-02-12T17:59:14.291 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 135 M 2026-02-12T17:59:14.291 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T17:59:15.365 INFO:teuthology.orchestra.run.trial048.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2026-02-12T17:59:15.703 INFO:teuthology.orchestra.run.trial111.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 578 kB/s | 768 kB 00:01 2026-02-12T17:59:18.628 INFO:teuthology.orchestra.run.trial048.stdout:lab-extras 2.7 MB/s | 50 kB 00:00 2026-02-12T17:59:19.701 INFO:teuthology.orchestra.run.trial048.stdout:Package kernel-5.14.0-645.el9.x86_64 is already installed. 2026-02-12T17:59:19.721 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T17:59:19.722 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T17:59:19.723 INFO:teuthology.orchestra.run.trial048.stdout: Package Architecture Version Repository Size 2026-02-12T17:59:19.723 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T17:59:19.723 INFO:teuthology.orchestra.run.trial048.stdout:Installing: 2026-02-12T17:59:19.723 INFO:teuthology.orchestra.run.trial048.stdout: kernel x86_64 5.14.0-677.el9 baseos 768 k 2026-02-12T17:59:19.723 INFO:teuthology.orchestra.run.trial048.stdout:Installing dependencies: 2026-02-12T17:59:19.723 INFO:teuthology.orchestra.run.trial048.stdout: kernel-core x86_64 5.14.0-677.el9 baseos 17 M 2026-02-12T17:59:19.723 INFO:teuthology.orchestra.run.trial048.stdout: kernel-modules x86_64 5.14.0-677.el9 baseos 40 M 2026-02-12T17:59:19.723 INFO:teuthology.orchestra.run.trial048.stdout: kernel-modules-core x86_64 5.14.0-677.el9 baseos 31 M 2026-02-12T17:59:19.723 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T17:59:19.724 INFO:teuthology.orchestra.run.trial048.stdout:Transaction Summary 2026-02-12T17:59:19.724 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T17:59:19.724 INFO:teuthology.orchestra.run.trial048.stdout:Install 4 Packages 2026-02-12T17:59:19.724 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T17:59:19.724 INFO:teuthology.orchestra.run.trial048.stdout:Total download size: 88 M 2026-02-12T17:59:19.724 INFO:teuthology.orchestra.run.trial048.stdout:Installed size: 135 M 2026-02-12T17:59:19.724 INFO:teuthology.orchestra.run.trial048.stdout:Downloading Packages: 2026-02-12T17:59:19.813 INFO:teuthology.orchestra.run.trial048.stdout:(1/4): kernel-5.14.0-677.el9.x86_64.rpm 22 MB/s | 768 kB 00:00 2026-02-12T17:59:19.888 INFO:teuthology.orchestra.run.trial048.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 156 MB/s | 17 MB 00:00 2026-02-12T17:59:19.976 INFO:teuthology.orchestra.run.trial048.stdout:(3/4): kernel-modules-core-5.14.0-677.el9.x86_6 189 MB/s | 31 MB 00:00 2026-02-12T17:59:20.052 INFO:teuthology.orchestra.run.trial048.stdout:(4/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 145 MB/s | 40 MB 00:00 2026-02-12T17:59:20.052 INFO:teuthology.orchestra.run.trial048.stdout:-------------------------------------------------------------------------------- 2026-02-12T17:59:20.052 INFO:teuthology.orchestra.run.trial048.stdout:Total 268 MB/s | 88 MB 00:00 2026-02-12T17:59:20.243 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction check 2026-02-12T17:59:20.444 INFO:teuthology.orchestra.run.trial048.stdout:Transaction check succeeded. 2026-02-12T17:59:20.444 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction test 2026-02-12T17:59:20.790 INFO:teuthology.orchestra.run.trial048.stdout:Transaction test succeeded. 2026-02-12T17:59:20.790 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction 2026-02-12T17:59:21.887 INFO:teuthology.orchestra.run.trial048.stdout: Preparing : 1/1 2026-02-12T17:59:22.174 INFO:teuthology.orchestra.run.trial048.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T17:59:22.193 INFO:teuthology.orchestra.run.trial048.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T17:59:23.959 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T17:59:23.987 INFO:teuthology.orchestra.run.trial048.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T17:59:27.011 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T17:59:27.017 INFO:teuthology.orchestra.run.trial048.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T17:59:30.048 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T17:59:34.422 INFO:teuthology.orchestra.run.trial111.stdout:(2/4): kernel-core-5.14.0-677.el9.x86_64.rpm 871 kB/s | 17 MB 00:20 2026-02-12T17:59:50.964 INFO:teuthology.orchestra.run.trial111.stdout:(3/4): kernel-modules-core-5.14.0-677.el9.x86_6 894 kB/s | 31 MB 00:35 2026-02-12T18:00:00.199 INFO:teuthology.orchestra.run.trial111.stdout:(4/4): kernel-modules-5.14.0-677.el9.x86_64.rpm 885 kB/s | 40 MB 00:45 2026-02-12T18:00:00.201 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:00:00.201 INFO:teuthology.orchestra.run.trial111.stdout:Total 1.9 MB/s | 88 MB 00:45 2026-02-12T18:00:00.388 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T18:00:00.558 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T18:00:00.579 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T18:00:00.595 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T18:00:00.595 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T18:00:00.643 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T18:00:00.643 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T18:00:00.643 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T18:00:00.643 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T18:00:00.696 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T18:00:00.696 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:00:00.696 INFO:teuthology.orchestra.run.trial048.stdout:Installed: 2026-02-12T18:00:00.696 INFO:teuthology.orchestra.run.trial048.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T18:00:00.696 INFO:teuthology.orchestra.run.trial048.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T18:00:00.696 INFO:teuthology.orchestra.run.trial048.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T18:00:00.696 INFO:teuthology.orchestra.run.trial048.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T18:00:00.696 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:00:00.696 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:00:00.753 DEBUG:teuthology.orchestra.run.trial048:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T18:00:00.778 INFO:teuthology.orchestra.run.trial048.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T18:00:00.778 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T18:00:00.778 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T18:00:00.779 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T18:00:00.779 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T18:00:00.779 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2026-02-12T18:00:00.779 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial048.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T18:00:00.779 DEBUG:teuthology.orchestra.run.trial048:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T18:00:00.840 INFO:teuthology.orchestra.run.trial048.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T18:00:00.841 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T18:00:00.841 DEBUG:teuthology.orchestra.run.trial048:> sudo rpm -qi grub2-tools 2026-02-12T18:00:00.910 INFO:teuthology.orchestra.run.trial048.stdout:Name : grub2-tools 2026-02-12T18:00:00.910 INFO:teuthology.orchestra.run.trial048.stdout:Epoch : 1 2026-02-12T18:00:00.910 INFO:teuthology.orchestra.run.trial048.stdout:Version : 2.06 2026-02-12T18:00:00.910 INFO:teuthology.orchestra.run.trial048.stdout:Release : 118.el9 2026-02-12T18:00:00.910 INFO:teuthology.orchestra.run.trial048.stdout:Architecture: x86_64 2026-02-12T18:00:00.910 INFO:teuthology.orchestra.run.trial048.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T18:00:00.910 INFO:teuthology.orchestra.run.trial048.stdout:Group : Unspecified 2026-02-12T18:00:00.910 INFO:teuthology.orchestra.run.trial048.stdout:Size : 8393909 2026-02-12T18:00:00.910 INFO:teuthology.orchestra.run.trial048.stdout:License : GPLv3+ 2026-02-12T18:00:00.910 INFO:teuthology.orchestra.run.trial048.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T18:00:00.910 INFO:teuthology.orchestra.run.trial048.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T18:00:00.910 INFO:teuthology.orchestra.run.trial048.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T18:00:00.910 INFO:teuthology.orchestra.run.trial048.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T18:00:00.910 INFO:teuthology.orchestra.run.trial048.stdout:Packager : builder@centos.org 2026-02-12T18:00:00.910 INFO:teuthology.orchestra.run.trial048.stdout:Vendor : CentOS 2026-02-12T18:00:00.910 INFO:teuthology.orchestra.run.trial048.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T18:00:00.910 INFO:teuthology.orchestra.run.trial048.stdout:Summary : Support tools for GRUB. 2026-02-12T18:00:00.910 INFO:teuthology.orchestra.run.trial048.stdout:Description : 2026-02-12T18:00:00.910 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:00:00.910 INFO:teuthology.orchestra.run.trial048.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T18:00:00.910 INFO:teuthology.orchestra.run.trial048.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T18:00:00.910 INFO:teuthology.orchestra.run.trial048.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T18:00:00.910 INFO:teuthology.orchestra.run.trial048.stdout:hardware devices. 2026-02-12T18:00:00.910 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:00:00.910 INFO:teuthology.orchestra.run.trial048.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T18:00:00.911 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T18:00:00.911 INFO:teuthology.task.kernel:Updating grub on trial048 to boot 5.14.0-677.el9.x86_64 2026-02-12T18:00:00.911 DEBUG:teuthology.orchestra.run.trial048:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T18:00:00.941 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T18:00:00.941 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T18:00:00.974 INFO:teuthology.orchestra.run.trial048.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T18:00:00.975 DEBUG:teuthology.orchestra.run.trial048:> sudo command -v grubby && echo yes || echo no 2026-02-12T18:00:01.038 INFO:teuthology.orchestra.run.trial048.stdout:/sbin/grubby 2026-02-12T18:00:01.039 INFO:teuthology.orchestra.run.trial048.stdout:yes 2026-02-12T18:00:01.039 DEBUG:teuthology.orchestra.run.trial048:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T18:00:01.102 INFO:teuthology.orchestra.run.trial048.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T18:00:01.102 DEBUG:teuthology.orchestra.run.trial048:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T18:00:01.175 DEBUG:teuthology.orchestra.run.trial048:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T18:00:01.383 INFO:teuthology.orchestra.run.trial048.stderr:Generating grub configuration file ... 2026-02-12T18:00:01.445 INFO:teuthology.orchestra.run.trial048.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T18:00:01.451 INFO:teuthology.orchestra.run.trial048.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T18:00:01.703 INFO:teuthology.orchestra.run.trial048.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T18:00:01.710 INFO:teuthology.orchestra.run.trial048.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T18:00:01.742 INFO:teuthology.orchestra.run.trial048.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T18:00:01.749 INFO:teuthology.orchestra.run.trial048.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T18:00:01.771 INFO:teuthology.orchestra.run.trial048.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T18:00:01.778 INFO:teuthology.orchestra.run.trial048.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T18:00:01.861 INFO:teuthology.orchestra.run.trial048.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T18:00:01.868 INFO:teuthology.orchestra.run.trial048.stderr:done 2026-02-12T18:00:01.870 DEBUG:teuthology.orchestra.run.trial048:> test -d /sys/firmware/efi 2026-02-12T18:00:01.884 DEBUG:teuthology.orchestra.run.trial048:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T18:00:01.949 INFO:teuthology.orchestra.run.trial048.stdout:/boot/efi/EFI/BOOT 2026-02-12T18:00:01.949 INFO:teuthology.orchestra.run.trial048.stdout:/boot/efi/EFI/centos 2026-02-12T18:00:01.950 DEBUG:teuthology.orchestra.run.trial048:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T18:00:02.016 INFO:teuthology.orchestra.run.trial048.stdout:no 2026-02-12T18:00:02.016 DEBUG:teuthology.orchestra.run.trial048:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T18:00:02.031 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T18:00:02.082 INFO:teuthology.orchestra.run.trial048.stdout:yes 2026-02-12T18:00:02.082 DEBUG:teuthology.orchestra.run.trial048:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T18:00:02.145 DEBUG:teuthology.orchestra.run.trial048:> sudo shutdown -r now 2026-02-12T18:00:02.219 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-12T18:00:02.314 INFO:teuthology.orchestra.run.trial111.stdout: Installing : kernel-modules-core-5.14.0-677.el9.x86_64 1/4 2026-02-12T18:00:02.333 INFO:teuthology.orchestra.run.trial111.stdout: Installing : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T18:00:04.096 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T18:00:04.124 INFO:teuthology.orchestra.run.trial111.stdout: Installing : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T18:00:07.147 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T18:00:07.153 INFO:teuthology.orchestra.run.trial111.stdout: Installing : kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T18:00:10.257 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T18:00:32.187 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2026-02-12T18:00:32.188 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T18:00:32.189 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T18:00:40.673 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: kernel-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T18:00:40.693 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: kernel-modules-5.14.0-677.el9.x86_64 4/4 2026-02-12T18:00:40.862 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: kernel-5.14.0-677.el9.x86_64 4/4 2026-02-12T18:00:40.862 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : kernel-5.14.0-677.el9.x86_64 1/4 2026-02-12T18:00:40.863 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : kernel-core-5.14.0-677.el9.x86_64 2/4 2026-02-12T18:00:40.863 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : kernel-modules-5.14.0-677.el9.x86_64 3/4 2026-02-12T18:00:40.915 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : kernel-modules-core-5.14.0-677.el9.x86_64 4/4 2026-02-12T18:00:40.915 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:00:40.915 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T18:00:40.915 INFO:teuthology.orchestra.run.trial111.stdout: kernel-5.14.0-677.el9.x86_64 2026-02-12T18:00:40.915 INFO:teuthology.orchestra.run.trial111.stdout: kernel-core-5.14.0-677.el9.x86_64 2026-02-12T18:00:40.915 INFO:teuthology.orchestra.run.trial111.stdout: kernel-modules-5.14.0-677.el9.x86_64 2026-02-12T18:00:40.915 INFO:teuthology.orchestra.run.trial111.stdout: kernel-modules-core-5.14.0-677.el9.x86_64 2026-02-12T18:00:40.915 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:00:40.915 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:00:40.971 DEBUG:teuthology.orchestra.run.trial111:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T18:00:40.996 INFO:teuthology.orchestra.run.trial111.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T18:00:40.997 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T18:00:40.998 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-645.el9.x86_64 Expected: 5.14.0-677.el9.x86_64 2026-02-12T18:00:40.998 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2026-02-12T18:00:40.998 DEBUG:teuthology.task.kernel:src is distro, skipping download 2026-02-12T18:00:40.998 INFO:teuthology.task.kernel:Installing distro kernel on mon.f... 2026-02-12T18:00:40.998 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@trial111.front.sepia.ceph.com, path=None, version=distro) 2026-02-12T18:00:40.998 DEBUG:teuthology.orchestra.run.trial111:> rpm -q kernel | sort -rV | head -n 1 2026-02-12T18:00:41.060 INFO:teuthology.orchestra.run.trial111.stdout:kernel-5.14.0-677.el9.x86_64 2026-02-12T18:00:41.061 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-677.el9.x86_64 2026-02-12T18:00:41.061 DEBUG:teuthology.orchestra.run.trial111:> sudo rpm -qi grub2-tools 2026-02-12T18:00:41.129 INFO:teuthology.orchestra.run.trial111.stdout:Name : grub2-tools 2026-02-12T18:00:41.129 INFO:teuthology.orchestra.run.trial111.stdout:Epoch : 1 2026-02-12T18:00:41.129 INFO:teuthology.orchestra.run.trial111.stdout:Version : 2.06 2026-02-12T18:00:41.129 INFO:teuthology.orchestra.run.trial111.stdout:Release : 118.el9 2026-02-12T18:00:41.129 INFO:teuthology.orchestra.run.trial111.stdout:Architecture: x86_64 2026-02-12T18:00:41.129 INFO:teuthology.orchestra.run.trial111.stdout:Install Date: Thu 04 Dec 2025 11:54:21 PM UTC 2026-02-12T18:00:41.130 INFO:teuthology.orchestra.run.trial111.stdout:Group : Unspecified 2026-02-12T18:00:41.130 INFO:teuthology.orchestra.run.trial111.stdout:Size : 8393909 2026-02-12T18:00:41.130 INFO:teuthology.orchestra.run.trial111.stdout:License : GPLv3+ 2026-02-12T18:00:41.130 INFO:teuthology.orchestra.run.trial111.stdout:Signature : RSA/SHA256, Wed 05 Nov 2025 09:13:15 AM UTC, Key ID 05b555b38483c65d 2026-02-12T18:00:41.130 INFO:teuthology.orchestra.run.trial111.stdout:Source RPM : grub2-2.06-118.el9.src.rpm 2026-02-12T18:00:41.130 INFO:teuthology.orchestra.run.trial111.stdout:Build Date : Tue 04 Nov 2025 03:44:14 PM UTC 2026-02-12T18:00:41.130 INFO:teuthology.orchestra.run.trial111.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2026-02-12T18:00:41.130 INFO:teuthology.orchestra.run.trial111.stdout:Packager : builder@centos.org 2026-02-12T18:00:41.130 INFO:teuthology.orchestra.run.trial111.stdout:Vendor : CentOS 2026-02-12T18:00:41.130 INFO:teuthology.orchestra.run.trial111.stdout:URL : http://www.gnu.org/software/grub/ 2026-02-12T18:00:41.130 INFO:teuthology.orchestra.run.trial111.stdout:Summary : Support tools for GRUB. 2026-02-12T18:00:41.130 INFO:teuthology.orchestra.run.trial111.stdout:Description : 2026-02-12T18:00:41.131 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:00:41.131 INFO:teuthology.orchestra.run.trial111.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2026-02-12T18:00:41.131 INFO:teuthology.orchestra.run.trial111.stdout:customizable bootloader with modular architecture. It supports a rich 2026-02-12T18:00:41.131 INFO:teuthology.orchestra.run.trial111.stdout:variety of kernel formats, file systems, computer architectures and 2026-02-12T18:00:41.131 INFO:teuthology.orchestra.run.trial111.stdout:hardware devices. 2026-02-12T18:00:41.131 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:00:41.131 INFO:teuthology.orchestra.run.trial111.stdout:This subpackage provides tools for support of all platforms. 2026-02-12T18:00:41.132 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2026-02-12T18:00:41.132 INFO:teuthology.task.kernel:Updating grub on trial111 to boot 5.14.0-677.el9.x86_64 2026-02-12T18:00:41.132 DEBUG:teuthology.orchestra.run.trial111:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f -print -quit 2026-02-12T18:00:41.194 INFO:teuthology.orchestra.run.trial111.stdout:/boot/loader/entries/2734456005d743dca7f3dc77c35a2d0d-0-rescue.conf 2026-02-12T18:00:41.196 DEBUG:teuthology.orchestra.run.trial111:> sudo command -v grubby && echo yes || echo no 2026-02-12T18:00:41.259 INFO:teuthology.orchestra.run.trial111.stdout:/sbin/grubby 2026-02-12T18:00:41.260 INFO:teuthology.orchestra.run.trial111.stdout:yes 2026-02-12T18:00:41.260 DEBUG:teuthology.orchestra.run.trial111:> sudo find /boot/loader/entries -maxdepth 1 -name "*.conf" -type f | grep -F "5.14.0-677.el9.x86_64" | head -n 1 2026-02-12T18:00:41.323 INFO:teuthology.orchestra.run.trial111.stdout:/boot/loader/entries/b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64.conf 2026-02-12T18:00:41.324 DEBUG:teuthology.orchestra.run.trial111:> sudo grub2-set-default b0373be789df49cdafedf423703d2566-5.14.0-677.el9.x86_64 2026-02-12T18:00:41.396 DEBUG:teuthology.orchestra.run.trial111:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2026-02-12T18:00:41.610 INFO:teuthology.orchestra.run.trial111.stderr:Generating grub configuration file ... 2026-02-12T18:00:41.673 INFO:teuthology.orchestra.run.trial111.stderr:Found linux image: /boot/vmlinuz-5.14.0-677.el9.x86_64 2026-02-12T18:00:41.679 INFO:teuthology.orchestra.run.trial111.stderr:Found initrd image: /boot/initramfs-5.14.0-677.el9.x86_64.img 2026-02-12T18:00:41.929 INFO:teuthology.orchestra.run.trial111.stderr:Found linux image: /boot/vmlinuz-5.14.0-645.el9.x86_64 2026-02-12T18:00:41.935 INFO:teuthology.orchestra.run.trial111.stderr:Found initrd image: /boot/initramfs-5.14.0-645.el9.x86_64.img 2026-02-12T18:00:41.967 INFO:teuthology.orchestra.run.trial111.stderr:Found linux image: /boot/vmlinuz-0-rescue-b0373be789df49cdafedf423703d2566 2026-02-12T18:00:41.973 INFO:teuthology.orchestra.run.trial111.stderr:Found initrd image: /boot/initramfs-0-rescue-b0373be789df49cdafedf423703d2566.img 2026-02-12T18:00:41.996 INFO:teuthology.orchestra.run.trial111.stderr:Found linux image: /boot/vmlinuz-0-rescue-2734456005d743dca7f3dc77c35a2d0d 2026-02-12T18:00:42.002 INFO:teuthology.orchestra.run.trial111.stderr:Found initrd image: /boot/initramfs-0-rescue-2734456005d743dca7f3dc77c35a2d0d.img 2026-02-12T18:00:42.087 INFO:teuthology.orchestra.run.trial111.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2026-02-12T18:00:42.095 INFO:teuthology.orchestra.run.trial111.stderr:done 2026-02-12T18:00:42.098 DEBUG:teuthology.orchestra.run.trial111:> test -d /sys/firmware/efi 2026-02-12T18:00:42.114 DEBUG:teuthology.orchestra.run.trial111:> sudo find /boot/efi/EFI -mindepth 1 -maxdepth 1 -type d || true 2026-02-12T18:00:42.179 INFO:teuthology.orchestra.run.trial111.stdout:/boot/efi/EFI/BOOT 2026-02-12T18:00:42.179 INFO:teuthology.orchestra.run.trial111.stdout:/boot/efi/EFI/centos 2026-02-12T18:00:42.181 DEBUG:teuthology.orchestra.run.trial111:> sudo test -f /boot/efi/EFI/BOOT/grub.cfg && echo yes || echo no 2026-02-12T18:00:42.246 INFO:teuthology.orchestra.run.trial111.stdout:no 2026-02-12T18:00:42.246 DEBUG:teuthology.orchestra.run.trial111:> sudo test -f /boot/efi/EFI/centos/grub.cfg && echo yes || echo no 2026-02-12T18:00:42.310 INFO:teuthology.orchestra.run.trial111.stdout:yes 2026-02-12T18:00:42.311 DEBUG:teuthology.orchestra.run.trial111:> sudo cp -f /boot/grub2/grub.cfg /boot/efi/EFI/centos/grub.cfg 2026-02-12T18:00:42.375 DEBUG:teuthology.orchestra.run.trial111:> sudo shutdown -r now 2026-02-12T18:00:42.448 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2026-02-12T18:01:12.447 INFO:teuthology.task.kernel:Checking client mon.f for new kernel version... 2026-02-12T18:01:12.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T18:01:12.448 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T18:01:32.210 DEBUG:teuthology.orchestra.remote:timed out 2026-02-12T18:01:41.219 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T18:01:41.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T18:01:41.347 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T18:01:41.506 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T18:01:41.506 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-677.el9.x86_64"... 2026-02-12T18:01:41.506 DEBUG:teuthology.orchestra.run.trial048:> uname -r 2026-02-12T18:01:41.562 INFO:teuthology.orchestra.run.trial048.stdout:5.14.0-677.el9.x86_64 2026-02-12T18:01:41.562 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T18:01:41.562 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-12T18:01:41.562 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T18:01:42.563 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2026-02-12T18:01:42.564 DEBUG:teuthology.orchestra.run.trial048:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-12T18:01:42.593 INFO:teuthology.orchestra.run.trial048.stdout:ttyS1 2026-02-12T18:01:42.618 DEBUG:teuthology.parallel:result is None 2026-02-12T18:02:12.450 DEBUG:teuthology.orchestra.remote:timed out 2026-02-12T18:02:21.452 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T18:02:21.453 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T18:02:21.586 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T18:02:21.738 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T18:02:21.738 INFO:teuthology.task.kernel:Checking kernel version of mon.f, want "5.14.0-677.el9.x86_64"... 2026-02-12T18:02:21.739 DEBUG:teuthology.orchestra.run.trial111:> uname -r 2026-02-12T18:02:21.794 INFO:teuthology.orchestra.run.trial111.stdout:5.14.0-677.el9.x86_64 2026-02-12T18:02:21.794 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-677.el9.x86_64 vs 5.14.0-677.el9.x86_64 2026-02-12T18:02:21.794 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2026-02-12T18:02:21.795 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2026-02-12T18:02:22.796 INFO:teuthology.task.kernel:Enabling kdb on mon.f... 2026-02-12T18:02:22.796 DEBUG:teuthology.orchestra.run.trial111:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2026-02-12T18:02:22.826 INFO:teuthology.orchestra.run.trial111.stdout:ttyS1 2026-02-12T18:02:22.846 DEBUG:teuthology.parallel:result is None 2026-02-12T18:02:22.846 INFO:teuthology.run_tasks:Running task internal.base... 2026-02-12T18:02:22.862 INFO:teuthology.task.internal:Creating test directory... 2026-02-12T18:02:22.863 DEBUG:teuthology.orchestra.run.trial048:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-12T18:02:22.866 DEBUG:teuthology.orchestra.run.trial111:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2026-02-12T18:02:22.904 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2026-02-12T18:02:22.914 INFO:teuthology.run_tasks:Running task internal.archive... 2026-02-12T18:02:22.925 INFO:teuthology.task.internal:Creating archive directory... 2026-02-12T18:02:22.925 DEBUG:teuthology.orchestra.run.trial048:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-12T18:02:22.928 DEBUG:teuthology.orchestra.run.trial111:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2026-02-12T18:02:22.970 INFO:teuthology.run_tasks:Running task internal.coredump... 2026-02-12T18:02:22.981 INFO:teuthology.task.internal:Enabling coredump saving... 2026-02-12T18:02:22.982 DEBUG:teuthology.orchestra.run.trial048:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-12T18:02:22.986 DEBUG:teuthology.orchestra.run.trial111:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2026-02-12T18:02:23.009 INFO:teuthology.orchestra.run.trial048.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T18:02:23.017 INFO:teuthology.orchestra.run.trial048.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T18:02:23.026 INFO:teuthology.orchestra.run.trial111.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T18:02:23.034 INFO:teuthology.orchestra.run.trial111.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2026-02-12T18:02:23.036 INFO:teuthology.run_tasks:Running task internal.sudo... 2026-02-12T18:02:23.050 INFO:teuthology.task.internal:Configuring sudo... 2026-02-12T18:02:23.050 DEBUG:teuthology.orchestra.run.trial048:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-12T18:02:23.061 DEBUG:teuthology.orchestra.run.trial111:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2026-02-12T18:02:23.100 INFO:teuthology.run_tasks:Running task internal.syslog... 2026-02-12T18:02:23.118 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2026-02-12T18:02:23.118 DEBUG:teuthology.orchestra.run.trial048:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-12T18:02:23.128 DEBUG:teuthology.orchestra.run.trial111:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2026-02-12T18:02:23.156 DEBUG:teuthology.orchestra.run.trial048:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T18:02:23.272 DEBUG:teuthology.orchestra.run.trial048:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T18:02:23.297 DEBUG:teuthology.orchestra.run.trial048:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T18:02:23.433 DEBUG:teuthology.orchestra.run.trial048:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T18:02:23.459 DEBUG:teuthology.orchestra.run.trial048:> set -ex 2026-02-12T18:02:23.459 DEBUG:teuthology.orchestra.run.trial048:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-12T18:02:23.524 DEBUG:teuthology.orchestra.run.trial111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T18:02:23.639 DEBUG:teuthology.orchestra.run.trial111:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T18:02:23.665 DEBUG:teuthology.orchestra.run.trial111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T18:02:23.810 DEBUG:teuthology.orchestra.run.trial111:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T18:02:23.834 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T18:02:23.834 DEBUG:teuthology.orchestra.run.trial111:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2026-02-12T18:02:23.900 DEBUG:teuthology.orchestra.run.trial048:> sudo service rsyslog restart 2026-02-12T18:02:23.902 DEBUG:teuthology.orchestra.run.trial111:> sudo service rsyslog restart 2026-02-12T18:02:23.929 INFO:teuthology.orchestra.run.trial048.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T18:02:23.968 INFO:teuthology.orchestra.run.trial111.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T18:02:24.398 INFO:teuthology.run_tasks:Running task internal.timer... 2026-02-12T18:02:24.411 INFO:teuthology.task.internal:Starting timer... 2026-02-12T18:02:24.412 INFO:teuthology.run_tasks:Running task pcp... 2026-02-12T18:02:24.434 INFO:teuthology.run_tasks:Running task selinux... 2026-02-12T18:02:24.453 DEBUG:teuthology.orchestra.run.trial048:> sudo service auditd rotate 2026-02-12T18:02:24.482 INFO:teuthology.orchestra.run.trial048.stdout:Rotating logs: 2026-02-12T18:02:24.484 DEBUG:teuthology.orchestra.run.trial111:> sudo service auditd rotate 2026-02-12T18:02:24.514 INFO:teuthology.orchestra.run.trial111.stdout:Rotating logs: 2026-02-12T18:02:24.517 DEBUG:teuthology.task.selinux:Getting current SELinux state 2026-02-12T18:02:24.517 DEBUG:teuthology.orchestra.run.trial048:> /usr/sbin/getenforce 2026-02-12T18:02:24.542 INFO:teuthology.orchestra.run.trial048.stdout:Permissive 2026-02-12T18:02:24.542 DEBUG:teuthology.orchestra.run.trial111:> /usr/sbin/getenforce 2026-02-12T18:02:24.575 INFO:teuthology.orchestra.run.trial111.stdout:Permissive 2026-02-12T18:02:24.576 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@trial048.front.sepia.ceph.com': 'permissive', 'ubuntu@trial111.front.sepia.ceph.com': 'permissive'} 2026-02-12T18:02:24.576 DEBUG:teuthology.orchestra.run.trial048:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T18:02:24.606 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T18:02:24.607 DEBUG:teuthology.orchestra.run.trial111:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T18:02:24.640 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T18:02:24.640 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2026-02-12T18:02:24.640 DEBUG:teuthology.orchestra.run.trial048:> sudo /usr/sbin/setenforce permissive 2026-02-12T18:02:24.672 DEBUG:teuthology.orchestra.run.trial111:> sudo /usr/sbin/setenforce permissive 2026-02-12T18:02:24.705 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2026-02-12T18:02:24.720 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2026-02-12T18:02:24.730 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2026-02-12T18:02:24.732 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit trial048.front.sepia.ceph.com,trial111.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2026-02-12T18:03:50.962 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@trial048.front.sepia.ceph.com'), Remote(name='ubuntu@trial111.front.sepia.ceph.com')] 2026-02-12T18:03:50.963 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T18:03:50.964 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial048.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T18:03:51.115 DEBUG:teuthology.orchestra.run.trial048:> true 2026-02-12T18:03:51.199 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial048.front.sepia.ceph.com' 2026-02-12T18:03:51.199 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T18:03:51.200 DEBUG:teuthology.orchestra.connection:{'hostname': 'trial111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2026-02-12T18:03:51.286 DEBUG:teuthology.orchestra.run.trial111:> true 2026-02-12T18:03:51.359 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@trial111.front.sepia.ceph.com' 2026-02-12T18:03:51.360 INFO:teuthology.run_tasks:Running task clock... 2026-02-12T18:03:51.369 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2026-02-12T18:03:51.369 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-12T18:03:51.370 DEBUG:teuthology.orchestra.run.trial048:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T18:03:51.372 INFO:teuthology.orchestra.run:Running command with timeout 360 2026-02-12T18:03:51.373 DEBUG:teuthology.orchestra.run.trial111:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T18:03:51.399 INFO:teuthology.orchestra.run.trial048.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-12T18:03:51.412 INFO:teuthology.orchestra.run.trial048.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-12T18:03:51.425 INFO:teuthology.orchestra.run.trial111.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2026-02-12T18:03:51.433 INFO:teuthology.orchestra.run.trial048.stderr:sudo: ntpd: command not found 2026-02-12T18:03:51.437 INFO:teuthology.orchestra.run.trial111.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2026-02-12T18:03:51.442 INFO:teuthology.orchestra.run.trial048.stdout:506 Cannot talk to daemon 2026-02-12T18:03:51.454 INFO:teuthology.orchestra.run.trial048.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-12T18:03:51.457 INFO:teuthology.orchestra.run.trial111.stderr:sudo: ntpd: command not found 2026-02-12T18:03:51.466 INFO:teuthology.orchestra.run.trial048.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-12T18:03:51.467 INFO:teuthology.orchestra.run.trial111.stdout:506 Cannot talk to daemon 2026-02-12T18:03:51.479 INFO:teuthology.orchestra.run.trial111.stderr:Failed to start ntp.service: Unit ntp.service not found. 2026-02-12T18:03:51.491 INFO:teuthology.orchestra.run.trial111.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2026-02-12T18:03:51.512 INFO:teuthology.orchestra.run.trial048.stderr:bash: line 1: ntpq: command not found 2026-02-12T18:03:51.539 INFO:teuthology.orchestra.run.trial048.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T18:03:51.539 INFO:teuthology.orchestra.run.trial048.stdout:=============================================================================== 2026-02-12T18:03:51.539 INFO:teuthology.orchestra.run.trial048.stdout:^? 144.202.66.214.vultruser> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T18:03:51.539 INFO:teuthology.orchestra.run.trial048.stdout:^? 38.45.64.130 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T18:03:51.540 INFO:teuthology.orchestra.run.trial048.stdout:^? 172-234-25-10.ip.linodeu> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T18:03:51.540 INFO:teuthology.orchestra.run.trial048.stdout:^? ntp2.zeus.frumentum.media 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T18:03:51.540 INFO:teuthology.orchestra.run.trial111.stderr:bash: line 1: ntpq: command not found 2026-02-12T18:03:51.554 INFO:teuthology.orchestra.run.trial111.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T18:03:51.554 INFO:teuthology.orchestra.run.trial111.stdout:=============================================================================== 2026-02-12T18:03:51.554 INFO:teuthology.orchestra.run.trial111.stdout:^? time.cloudflare.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T18:03:51.554 INFO:teuthology.orchestra.run.trial111.stdout:^? ip229.ip-51-81-226.us 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T18:03:51.554 INFO:teuthology.orchestra.run.trial111.stdout:^? ip216-250-115-174.pbiaas> 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T18:03:51.554 INFO:teuthology.orchestra.run.trial111.stdout:^? ntp11.kernfusion.at 0 6 0 - +0ns[ +0ns] +/- 0ns 2026-02-12T18:03:51.556 INFO:teuthology.run_tasks:Running task install... 2026-02-12T18:03:51.569 DEBUG:teuthology.task.install:project ceph 2026-02-12T18:03:51.569 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}} 2026-02-12T18:03:51.569 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'} 2026-02-12T18:03:51.569 INFO:teuthology.task.install:Using flavor: default 2026-02-12T18:03:51.578 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-osd', 'ceph-osd-classic', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-osd', 'ceph-osd-classic', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2026-02-12T18:03:51.579 INFO:teuthology.task.install:extra packages: [] 2026-02-12T18:03:51.579 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6', 'tag': None, 'wait_for_package': False} 2026-02-12T18:03:51.580 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-12T18:03:51.582 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6', 'tag': None, 'wait_for_package': False} 2026-02-12T18:03:51.583 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-12T18:03:51.776 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/ 2026-02-12T18:03:51.776 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5230.gafefaa40 2026-02-12T18:03:51.791 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/ 2026-02-12T18:03:51.792 INFO:teuthology.task.install.rpm:Package version is 20.3.0-5230.gafefaa40 2026-02-12T18:03:51.940 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T18:03:51.940 DEBUG:teuthology.orchestra.run.trial048:> set -ex 2026-02-12T18:03:51.941 DEBUG:teuthology.orchestra.run.trial048:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T18:03:51.945 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2026-02-11-2126/afefaa40503a4bf024e96f97dd7f852b75f00ad6/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2026-02-12T18:03:51.945 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T18:03:51.945 DEBUG:teuthology.orchestra.run.trial111:> sudo dd of=/etc/yum.repos.d/ceph.repo 2026-02-12T18:03:51.966 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-12T18:03:51.967 DEBUG:teuthology.orchestra.run.trial048:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/afefaa40503a4bf024e96f97dd7f852b75f00ad6/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T18:03:51.971 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-osd, ceph-osd-classic, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2026-02-12T18:03:51.971 DEBUG:teuthology.orchestra.run.trial111:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/afefaa40503a4bf024e96f97dd7f852b75f00ad6/;g' /etc/yum.repos.d/ceph.repo ; fi 2026-02-12T18:03:52.031 DEBUG:teuthology.orchestra.run.trial048:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T18:03:52.035 DEBUG:teuthology.orchestra.run.trial111:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2026-02-12T18:03:52.105 DEBUG:teuthology.orchestra.run.trial048:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T18:03:52.107 DEBUG:teuthology.orchestra.run.trial111:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2026-02-12T18:03:52.170 INFO:teuthology.orchestra.run.trial048.stdout:check_obsoletes = 1 2026-02-12T18:03:52.172 INFO:teuthology.orchestra.run.trial111.stdout:check_obsoletes = 1 2026-02-12T18:03:52.173 DEBUG:teuthology.orchestra.run.trial048:> sudo yum clean all 2026-02-12T18:03:52.174 DEBUG:teuthology.orchestra.run.trial111:> sudo yum clean all 2026-02-12T18:03:52.323 INFO:teuthology.orchestra.run.trial111.stdout:41 files removed 2026-02-12T18:03:52.326 INFO:teuthology.orchestra.run.trial048.stdout:41 files removed 2026-02-12T18:03:52.337 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-radosgw 2026-02-12T18:03:52.342 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install ceph-radosgw 2026-02-12T18:03:52.606 INFO:teuthology.orchestra.run.trial111.stdout:ceph packages for x86_64 734 kB/s | 91 kB 00:00 2026-02-12T18:03:52.616 INFO:teuthology.orchestra.run.trial048.stdout:ceph packages for x86_64 715 kB/s | 91 kB 00:00 2026-02-12T18:03:52.744 INFO:teuthology.orchestra.run.trial111.stdout:ceph noarch packages 212 kB/s | 24 kB 00:00 2026-02-12T18:03:52.755 INFO:teuthology.orchestra.run.trial048.stdout:ceph noarch packages 208 kB/s | 24 kB 00:00 2026-02-12T18:03:52.870 INFO:teuthology.orchestra.run.trial111.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-12T18:03:52.881 INFO:teuthology.orchestra.run.trial048.stdout:ceph source packages 20 kB/s | 2.1 kB 00:00 2026-02-12T18:03:53.559 INFO:teuthology.orchestra.run.trial048.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-12T18:03:53.561 INFO:teuthology.orchestra.run.trial111.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 8.9 MB 00:00 2026-02-12T18:03:56.796 INFO:teuthology.orchestra.run.trial111.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 27 MB 00:02 2026-02-12T18:03:57.292 INFO:teuthology.orchestra.run.trial048.stdout:CentOS Stream 9 - AppStream 8.4 MB/s | 27 MB 00:03 2026-02-12T18:04:00.467 INFO:teuthology.orchestra.run.trial111.stdout:CentOS Stream 9 - CRB 6.1 MB/s | 7.8 MB 00:01 2026-02-12T18:04:01.003 INFO:teuthology.orchestra.run.trial048.stdout:CentOS Stream 9 - CRB 5.8 MB/s | 7.8 MB 00:01 2026-02-12T18:04:02.062 INFO:teuthology.orchestra.run.trial111.stdout:CentOS Stream 9 - Extras packages 23 kB/s | 20 kB 00:00 2026-02-12T18:04:02.113 INFO:teuthology.orchestra.run.trial048.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 20 kB 00:00 2026-02-12T18:04:03.636 INFO:teuthology.orchestra.run.trial048.stdout:Extra Packages for Enterprise Linux 14 MB/s | 20 MB 00:01 2026-02-12T18:04:05.391 INFO:teuthology.orchestra.run.trial111.stdout:Extra Packages for Enterprise Linux 6.2 MB/s | 20 MB 00:03 2026-02-12T18:04:06.873 INFO:teuthology.orchestra.run.trial048.stdout:lab-extras 1.8 MB/s | 50 kB 00:00 2026-02-12T18:04:08.167 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:04:08.169 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:04:08.169 INFO:teuthology.orchestra.run.trial048.stdout: Package Arch Version Repository Size 2026-02-12T18:04:08.169 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:04:08.169 INFO:teuthology.orchestra.run.trial048.stdout:Installing: 2026-02-12T18:04:08.169 INFO:teuthology.orchestra.run.trial048.stdout: ceph-radosgw x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 13 M 2026-02-12T18:04:08.170 INFO:teuthology.orchestra.run.trial048.stdout:Upgrading: 2026-02-12T18:04:08.170 INFO:teuthology.orchestra.run.trial048.stdout: librados2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 3.5 M 2026-02-12T18:04:08.170 INFO:teuthology.orchestra.run.trial048.stdout: librbd1 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 2.8 M 2026-02-12T18:04:08.170 INFO:teuthology.orchestra.run.trial048.stdout:Installing dependencies: 2026-02-12T18:04:08.170 INFO:teuthology.orchestra.run.trial048.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-12T18:04:08.170 INFO:teuthology.orchestra.run.trial048.stdout: ceph-base x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 5.2 M 2026-02-12T18:04:08.170 INFO:teuthology.orchestra.run.trial048.stdout: ceph-common x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 24 M 2026-02-12T18:04:08.170 INFO:teuthology.orchestra.run.trial048.stdout: ceph-selinux x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 25 k 2026-02-12T18:04:08.170 INFO:teuthology.orchestra.run.trial048.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-12T18:04:08.170 INFO:teuthology.orchestra.run.trial048.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-12T18:04:08.170 INFO:teuthology.orchestra.run.trial048.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-12T18:04:08.171 INFO:teuthology.orchestra.run.trial048.stdout: libcephfs2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 909 k 2026-02-12T18:04:08.171 INFO:teuthology.orchestra.run.trial048.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-12T18:04:08.171 INFO:teuthology.orchestra.run.trial048.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-12T18:04:08.171 INFO:teuthology.orchestra.run.trial048.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-12T18:04:08.171 INFO:teuthology.orchestra.run.trial048.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-12T18:04:08.171 INFO:teuthology.orchestra.run.trial048.stdout: libradosstriper1 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 248 k 2026-02-12T18:04:08.171 INFO:teuthology.orchestra.run.trial048.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-12T18:04:08.171 INFO:teuthology.orchestra.run.trial048.stdout: librgw2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 6.5 M 2026-02-12T18:04:08.171 INFO:teuthology.orchestra.run.trial048.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-12T18:04:08.171 INFO:teuthology.orchestra.run.trial048.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-12T18:04:08.171 INFO:teuthology.orchestra.run.trial048.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-12T18:04:08.171 INFO:teuthology.orchestra.run.trial048.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-12T18:04:08.171 INFO:teuthology.orchestra.run.trial048.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-12T18:04:08.172 INFO:teuthology.orchestra.run.trial048.stdout: python3-ceph-argparse x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 45 k 2026-02-12T18:04:08.172 INFO:teuthology.orchestra.run.trial048.stdout: python3-ceph-common x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 185 k 2026-02-12T18:04:08.172 INFO:teuthology.orchestra.run.trial048.stdout: python3-cephfs x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 203 k 2026-02-12T18:04:08.172 INFO:teuthology.orchestra.run.trial048.stdout: python3-rados x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 324 k 2026-02-12T18:04:08.172 INFO:teuthology.orchestra.run.trial048.stdout: python3-rbd x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 305 k 2026-02-12T18:04:08.172 INFO:teuthology.orchestra.run.trial048.stdout: python3-rgw x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 100 k 2026-02-12T18:04:08.172 INFO:teuthology.orchestra.run.trial048.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-12T18:04:08.172 INFO:teuthology.orchestra.run.trial048.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-12T18:04:08.172 INFO:teuthology.orchestra.run.trial048.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-12T18:04:08.172 INFO:teuthology.orchestra.run.trial048.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-12T18:04:08.172 INFO:teuthology.orchestra.run.trial048.stdout:Installing weak dependencies: 2026-02-12T18:04:08.172 INFO:teuthology.orchestra.run.trial048.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-12T18:04:08.173 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:08.173 INFO:teuthology.orchestra.run.trial048.stdout:Transaction Summary 2026-02-12T18:04:08.173 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:04:08.173 INFO:teuthology.orchestra.run.trial048.stdout:Install 32 Packages 2026-02-12T18:04:08.173 INFO:teuthology.orchestra.run.trial048.stdout:Upgrade 2 Packages 2026-02-12T18:04:08.173 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:08.174 INFO:teuthology.orchestra.run.trial048.stdout:Total download size: 67 M 2026-02-12T18:04:08.174 INFO:teuthology.orchestra.run.trial048.stdout:Downloading Packages: 2026-02-12T18:04:08.638 INFO:teuthology.orchestra.run.trial111.stdout:lab-extras 1.1 MB/s | 50 kB 00:00 2026-02-12T18:04:09.313 INFO:teuthology.orchestra.run.trial048.stdout:(1/34): ceph-base-20.3.0-5230.gafefaa40.el9.x86 13 MB/s | 5.2 MB 00:00 2026-02-12T18:04:09.333 INFO:teuthology.orchestra.run.trial048.stdout:(2/34): ceph-selinux-20.3.0-5230.gafefaa40.el9. 1.2 MB/s | 25 kB 00:00 2026-02-12T18:04:09.393 INFO:teuthology.orchestra.run.trial048.stdout:(3/34): libcephfs2-20.3.0-5230.gafefaa40.el9.x8 15 MB/s | 909 kB 00:00 2026-02-12T18:04:09.421 INFO:teuthology.orchestra.run.trial048.stdout:(4/34): libradosstriper1-20.3.0-5230.gafefaa40. 8.6 MB/s | 248 kB 00:00 2026-02-12T18:04:09.637 INFO:teuthology.orchestra.run.trial048.stdout:(5/34): ceph-radosgw-20.3.0-5230.gafefaa40.el9. 18 MB/s | 13 MB 00:00 2026-02-12T18:04:09.666 INFO:teuthology.orchestra.run.trial048.stdout:(6/34): python3-ceph-argparse-20.3.0-5230.gafef 1.5 MB/s | 45 kB 00:00 2026-02-12T18:04:09.700 INFO:teuthology.orchestra.run.trial048.stdout:(7/34): python3-ceph-common-20.3.0-5230.gafefaa 5.3 MB/s | 185 kB 00:00 2026-02-12T18:04:09.737 INFO:teuthology.orchestra.run.trial048.stdout:(8/34): python3-cephfs-20.3.0-5230.gafefaa40.el 5.5 MB/s | 203 kB 00:00 2026-02-12T18:04:09.759 INFO:teuthology.orchestra.run.trial048.stdout:(9/34): librgw2-20.3.0-5230.gafefaa40.el9.x86_6 19 MB/s | 6.5 MB 00:00 2026-02-12T18:04:09.770 INFO:teuthology.orchestra.run.trial048.stdout:(10/34): python3-rados-20.3.0-5230.gafefaa40.el 9.5 MB/s | 324 kB 00:00 2026-02-12T18:04:09.790 INFO:teuthology.orchestra.run.trial048.stdout:(11/34): python3-rbd-20.3.0-5230.gafefaa40.el9. 9.7 MB/s | 305 kB 00:00 2026-02-12T18:04:09.797 INFO:teuthology.orchestra.run.trial048.stdout:(12/34): python3-rgw-20.3.0-5230.gafefaa40.el9. 3.7 MB/s | 100 kB 00:00 2026-02-12T18:04:09.922 INFO:teuthology.orchestra.run.trial048.stdout:(13/34): ceph-common-20.3.0-5230.gafefaa40.el9. 24 MB/s | 24 MB 00:01 2026-02-12T18:04:09.930 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:04:09.932 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:04:09.932 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repository Size 2026-02-12T18:04:09.932 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:04:09.932 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T18:04:09.932 INFO:teuthology.orchestra.run.trial111.stdout: ceph-radosgw x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 13 M 2026-02-12T18:04:09.932 INFO:teuthology.orchestra.run.trial111.stdout:Upgrading: 2026-02-12T18:04:09.932 INFO:teuthology.orchestra.run.trial111.stdout: librados2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 3.5 M 2026-02-12T18:04:09.933 INFO:teuthology.orchestra.run.trial111.stdout: librbd1 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 2.8 M 2026-02-12T18:04:09.933 INFO:teuthology.orchestra.run.trial111.stdout:Installing dependencies: 2026-02-12T18:04:09.933 INFO:teuthology.orchestra.run.trial111.stdout: boost-program-options x86_64 1.75.0-13.el9 appstream 104 k 2026-02-12T18:04:09.933 INFO:teuthology.orchestra.run.trial111.stdout: ceph-base x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 5.2 M 2026-02-12T18:04:09.933 INFO:teuthology.orchestra.run.trial111.stdout: ceph-common x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 24 M 2026-02-12T18:04:09.933 INFO:teuthology.orchestra.run.trial111.stdout: ceph-selinux x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 25 k 2026-02-12T18:04:09.933 INFO:teuthology.orchestra.run.trial111.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2026-02-12T18:04:09.933 INFO:teuthology.orchestra.run.trial111.stdout: libarrow x86_64 9.0.0-15.el9 epel 4.4 M 2026-02-12T18:04:09.933 INFO:teuthology.orchestra.run.trial111.stdout: libarrow-doc noarch 9.0.0-15.el9 epel 25 k 2026-02-12T18:04:09.933 INFO:teuthology.orchestra.run.trial111.stdout: libcephfs2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 909 k 2026-02-12T18:04:09.933 INFO:teuthology.orchestra.run.trial111.stdout: libnbd x86_64 1.20.3-4.el9 appstream 164 k 2026-02-12T18:04:09.933 INFO:teuthology.orchestra.run.trial111.stdout: liboath x86_64 2.6.12-1.el9 epel 49 k 2026-02-12T18:04:09.934 INFO:teuthology.orchestra.run.trial111.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2026-02-12T18:04:09.934 INFO:teuthology.orchestra.run.trial111.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2026-02-12T18:04:09.934 INFO:teuthology.orchestra.run.trial111.stdout: libradosstriper1 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 248 k 2026-02-12T18:04:09.934 INFO:teuthology.orchestra.run.trial111.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2026-02-12T18:04:09.934 INFO:teuthology.orchestra.run.trial111.stdout: librgw2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 6.5 M 2026-02-12T18:04:09.934 INFO:teuthology.orchestra.run.trial111.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2026-02-12T18:04:09.934 INFO:teuthology.orchestra.run.trial111.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2026-02-12T18:04:09.934 INFO:teuthology.orchestra.run.trial111.stdout: mailcap noarch 2.1.49-5.el9 baseos 33 k 2026-02-12T18:04:09.934 INFO:teuthology.orchestra.run.trial111.stdout: parquet-libs x86_64 9.0.0-15.el9 epel 838 k 2026-02-12T18:04:09.934 INFO:teuthology.orchestra.run.trial111.stdout: pciutils x86_64 3.7.0-7.el9 baseos 93 k 2026-02-12T18:04:09.934 INFO:teuthology.orchestra.run.trial111.stdout: python3-ceph-argparse x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 45 k 2026-02-12T18:04:09.934 INFO:teuthology.orchestra.run.trial111.stdout: python3-ceph-common x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 185 k 2026-02-12T18:04:09.934 INFO:teuthology.orchestra.run.trial111.stdout: python3-cephfs x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 203 k 2026-02-12T18:04:09.935 INFO:teuthology.orchestra.run.trial111.stdout: python3-rados x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 324 k 2026-02-12T18:04:09.935 INFO:teuthology.orchestra.run.trial111.stdout: python3-rbd x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 305 k 2026-02-12T18:04:09.935 INFO:teuthology.orchestra.run.trial111.stdout: python3-rgw x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 100 k 2026-02-12T18:04:09.935 INFO:teuthology.orchestra.run.trial111.stdout: qatlib x86_64 25.08.0-2.el9 appstream 240 k 2026-02-12T18:04:09.935 INFO:teuthology.orchestra.run.trial111.stdout: qatzip-libs x86_64 1.3.1-1.el9 appstream 66 k 2026-02-12T18:04:09.935 INFO:teuthology.orchestra.run.trial111.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2026-02-12T18:04:09.935 INFO:teuthology.orchestra.run.trial111.stdout: thrift x86_64 0.15.0-4.el9 epel 1.6 M 2026-02-12T18:04:09.935 INFO:teuthology.orchestra.run.trial111.stdout:Installing weak dependencies: 2026-02-12T18:04:09.935 INFO:teuthology.orchestra.run.trial111.stdout: qatlib-service x86_64 25.08.0-2.el9 appstream 37 k 2026-02-12T18:04:09.935 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:09.935 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T18:04:09.935 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:04:09.936 INFO:teuthology.orchestra.run.trial111.stdout:Install 32 Packages 2026-02-12T18:04:09.936 INFO:teuthology.orchestra.run.trial111.stdout:Upgrade 2 Packages 2026-02-12T18:04:09.936 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:09.936 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 67 M 2026-02-12T18:04:09.936 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T18:04:10.051 INFO:teuthology.orchestra.run.trial048.stdout:(14/34): mailcap-2.1.49-5.el9.noarch.rpm 127 kB/s | 33 kB 00:00 2026-02-12T18:04:10.054 INFO:teuthology.orchestra.run.trial048.stdout:(15/34): boost-program-options-1.75.0-13.el9.x8 784 kB/s | 104 kB 00:00 2026-02-12T18:04:10.114 INFO:teuthology.orchestra.run.trial048.stdout:(16/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.6 MB/s | 160 kB 00:00 2026-02-12T18:04:10.139 INFO:teuthology.orchestra.run.trial048.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.8 MB/s | 45 kB 00:00 2026-02-12T18:04:10.145 INFO:teuthology.orchestra.run.trial048.stdout:(18/34): libnbd-1.20.3-4.el9.x86_64.rpm 1.7 MB/s | 164 kB 00:00 2026-02-12T18:04:10.188 INFO:teuthology.orchestra.run.trial048.stdout:(19/34): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 662 kB 00:00 2026-02-12T18:04:10.189 INFO:teuthology.orchestra.run.trial048.stdout:(20/34): pciutils-3.7.0-7.el9.x86_64.rpm 238 kB/s | 93 kB 00:00 2026-02-12T18:04:10.213 INFO:teuthology.orchestra.run.trial048.stdout:(21/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.2 MB/s | 292 kB 00:00 2026-02-12T18:04:10.216 INFO:teuthology.orchestra.run.trial048.stdout:(22/34): qatlib-25.08.0-2.el9.x86_64.rpm 8.3 MB/s | 240 kB 00:00 2026-02-12T18:04:10.234 INFO:teuthology.orchestra.run.trial048.stdout:(23/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 3.2 MB/s | 66 kB 00:00 2026-02-12T18:04:10.246 INFO:teuthology.orchestra.run.trial048.stdout:(24/34): qatlib-service-25.08.0-2.el9.x86_64.rp 651 kB/s | 37 kB 00:00 2026-02-12T18:04:10.299 INFO:teuthology.orchestra.run.trial048.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 472 kB/s | 25 kB 00:00 2026-02-12T18:04:10.327 INFO:teuthology.orchestra.run.trial048.stdout:(26/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.7 MB/s | 308 kB 00:00 2026-02-12T18:04:10.334 INFO:teuthology.orchestra.run.trial048.stdout:(27/34): liboath-2.6.12-1.el9.x86_64.rpm 1.3 MB/s | 49 kB 00:00 2026-02-12T18:04:10.346 INFO:teuthology.orchestra.run.trial048.stdout:(28/34): libunwind-1.6.2-1.el9.x86_64.rpm 3.6 MB/s | 67 kB 00:00 2026-02-12T18:04:10.370 INFO:teuthology.orchestra.run.trial048.stdout:(29/34): re2-20211101-20.el9.x86_64.rpm 7.6 MB/s | 191 kB 00:00 2026-02-12T18:04:10.402 INFO:teuthology.orchestra.run.trial048.stdout:(30/34): libarrow-9.0.0-15.el9.x86_64.rpm 26 MB/s | 4.4 MB 00:00 2026-02-12T18:04:10.428 INFO:teuthology.orchestra.run.trial048.stdout:(31/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 8.7 MB/s | 838 kB 00:00 2026-02-12T18:04:10.441 INFO:teuthology.orchestra.run.trial048.stdout:(32/34): thrift-0.15.0-4.el9.x86_64.rpm 22 MB/s | 1.6 MB 00:00 2026-02-12T18:04:10.516 INFO:teuthology.orchestra.run.trial048.stdout:(33/34): librados2-20.3.0-5230.gafefaa40.el9.x8 31 MB/s | 3.5 MB 00:00 2026-02-12T18:04:10.525 INFO:teuthology.orchestra.run.trial048.stdout:(34/34): librbd1-20.3.0-5230.gafefaa40.el9.x86_ 29 MB/s | 2.8 MB 00:00 2026-02-12T18:04:10.527 INFO:teuthology.orchestra.run.trial048.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:04:10.527 INFO:teuthology.orchestra.run.trial048.stdout:Total 28 MB/s | 67 MB 00:02 2026-02-12T18:04:10.618 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction check 2026-02-12T18:04:10.636 INFO:teuthology.orchestra.run.trial048.stdout:Transaction check succeeded. 2026-02-12T18:04:10.636 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction test 2026-02-12T18:04:10.897 INFO:teuthology.orchestra.run.trial048.stdout:Transaction test succeeded. 2026-02-12T18:04:10.898 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction 2026-02-12T18:04:10.918 INFO:teuthology.orchestra.run.trial111.stdout:(1/34): ceph-base-20.3.0-5230.gafefaa40.el9.x86 18 MB/s | 5.2 MB 00:00 2026-02-12T18:04:10.948 INFO:teuthology.orchestra.run.trial111.stdout:(2/34): ceph-selinux-20.3.0-5230.gafefaa40.el9. 836 kB/s | 25 kB 00:00 2026-02-12T18:04:10.999 INFO:teuthology.orchestra.run.trial111.stdout:(3/34): libcephfs2-20.3.0-5230.gafefaa40.el9.x8 18 MB/s | 909 kB 00:00 2026-02-12T18:04:11.037 INFO:teuthology.orchestra.run.trial111.stdout:(4/34): libradosstriper1-20.3.0-5230.gafefaa40. 6.4 MB/s | 248 kB 00:00 2026-02-12T18:04:11.170 INFO:teuthology.orchestra.run.trial111.stdout:(5/34): ceph-radosgw-20.3.0-5230.gafefaa40.el9. 24 MB/s | 13 MB 00:00 2026-02-12T18:04:11.198 INFO:teuthology.orchestra.run.trial048.stdout: Preparing : 1/1 2026-02-12T18:04:11.211 INFO:teuthology.orchestra.run.trial111.stdout:(6/34): python3-ceph-argparse-20.3.0-5230.gafef 1.1 MB/s | 45 kB 00:00 2026-02-12T18:04:11.251 INFO:teuthology.orchestra.run.trial111.stdout:(7/34): python3-ceph-common-20.3.0-5230.gafefaa 4.5 MB/s | 185 kB 00:00 2026-02-12T18:04:11.261 INFO:teuthology.orchestra.run.trial111.stdout:(8/34): librgw2-20.3.0-5230.gafefaa40.el9.x86_6 29 MB/s | 6.5 MB 00:00 2026-02-12T18:04:11.268 INFO:teuthology.orchestra.run.trial111.stdout:(9/34): python3-cephfs-20.3.0-5230.gafefaa40.el 12 MB/s | 203 kB 00:00 2026-02-12T18:04:11.282 INFO:teuthology.orchestra.run.trial111.stdout:(10/34): python3-rados-20.3.0-5230.gafefaa40.el 15 MB/s | 324 kB 00:00 2026-02-12T18:04:11.289 INFO:teuthology.orchestra.run.trial111.stdout:(11/34): python3-rbd-20.3.0-5230.gafefaa40.el9. 14 MB/s | 305 kB 00:00 2026-02-12T18:04:11.300 INFO:teuthology.orchestra.run.trial111.stdout:(12/34): python3-rgw-20.3.0-5230.gafefaa40.el9. 5.5 MB/s | 100 kB 00:00 2026-02-12T18:04:11.351 INFO:teuthology.orchestra.run.trial048.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/36 2026-02-12T18:04:11.355 INFO:teuthology.orchestra.run.trial048.stdout: Upgrading : librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 2/36 2026-02-12T18:04:11.384 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 2/36 2026-02-12T18:04:11.423 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 3/36 2026-02-12T18:04:11.424 INFO:teuthology.orchestra.run.trial048.stdout: Installing : libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 4/36 2026-02-12T18:04:11.436 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 4/36 2026-02-12T18:04:11.445 INFO:teuthology.orchestra.run.trial048.stdout: Installing : liboath-2.6.12-1.el9.x86_64 5/36 2026-02-12T18:04:11.447 INFO:teuthology.orchestra.run.trial048.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/36 2026-02-12T18:04:11.450 INFO:teuthology.orchestra.run.trial048.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/36 2026-02-12T18:04:11.455 INFO:teuthology.orchestra.run.trial048.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 8/36 2026-02-12T18:04:11.467 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-ceph-argparse-2:20.3.0-5230.gafefaa40.el9. 9/36 2026-02-12T18:04:11.479 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 10/36 2026-02-12T18:04:11.480 INFO:teuthology.orchestra.run.trial048.stdout: Installing : libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_6 11/36 2026-02-12T18:04:11.502 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_6 11/36 2026-02-12T18:04:11.505 INFO:teuthology.orchestra.run.trial048.stdout: Installing : thrift-0.15.0-4.el9.x86_64 12/36 2026-02-12T18:04:11.536 INFO:teuthology.orchestra.run.trial048.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-12T18:04:11.540 INFO:teuthology.orchestra.run.trial048.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-12T18:04:11.548 INFO:teuthology.orchestra.run.trial048.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-12T18:04:11.550 INFO:teuthology.orchestra.run.trial048.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-12T18:04:11.554 INFO:teuthology.orchestra.run.trial048.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-12T18:04:11.621 INFO:teuthology.orchestra.run.trial111.stdout:(13/34): ceph-common-20.3.0-5230.gafefaa40.el9. 24 MB/s | 24 MB 00:00 2026-02-12T18:04:11.678 INFO:teuthology.orchestra.run.trial048.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-12T18:04:11.679 INFO:teuthology.orchestra.run.trial048.stdout: Upgrading : librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 19/36 2026-02-12T18:04:11.700 INFO:teuthology.orchestra.run.trial111.stdout:(14/34): mailcap-2.1.49-5.el9.noarch.rpm 81 kB/s | 33 kB 00:00 2026-02-12T18:04:11.704 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 19/36 2026-02-12T18:04:11.707 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 20/36 2026-02-12T18:04:11.713 INFO:teuthology.orchestra.run.trial048.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-12T18:04:11.862 INFO:teuthology.orchestra.run.trial111.stdout:(15/34): pciutils-3.7.0-7.el9.x86_64.rpm 166 kB/s | 93 kB 00:00 2026-02-12T18:04:11.996 INFO:teuthology.orchestra.run.trial048.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-12T18:04:11.997 INFO:teuthology.orchestra.run.trial048.stdout: Installing : librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 23/36 2026-02-12T18:04:12.013 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 23/36 2026-02-12T18:04:12.017 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 24/36 2026-02-12T18:04:12.019 INFO:teuthology.orchestra.run.trial111.stdout:(16/34): boost-program-options-1.75.0-13.el9.x8 262 kB/s | 104 kB 00:00 2026-02-12T18:04:12.022 INFO:teuthology.orchestra.run.trial048.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-12T18:04:12.024 INFO:teuthology.orchestra.run.trial048.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-12T18:04:12.025 INFO:teuthology.orchestra.run.trial048.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-12T18:04:12.043 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-12T18:04:12.046 INFO:teuthology.orchestra.run.trial048.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-12T18:04:12.080 INFO:teuthology.orchestra.run.trial048.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-12T18:04:12.082 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-ceph-common-2:20.3.0-5230.gafefaa40.el9.x8 30/36 2026-02-12T18:04:12.120 INFO:teuthology.orchestra.run.trial111.stdout:(17/34): librabbitmq-0.11.0-7.el9.x86_64.rpm 449 kB/s | 45 kB 00:00 2026-02-12T18:04:12.154 INFO:teuthology.orchestra.run.trial111.stdout:(18/34): libnbd-1.20.3-4.el9.x86_64.rpm 361 kB/s | 164 kB 00:00 2026-02-12T18:04:12.327 INFO:teuthology.orchestra.run.trial111.stdout:(19/34): libpmemobj-1.12.1-1.el9.x86_64.rpm 345 kB/s | 160 kB 00:00 2026-02-12T18:04:12.348 INFO:teuthology.orchestra.run.trial111.stdout:(20/34): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.5 MB/s | 292 kB 00:00 2026-02-12T18:04:12.422 INFO:teuthology.orchestra.run.trial111.stdout:(21/34): librdkafka-1.6.1-102.el9.x86_64.rpm 2.1 MB/s | 662 kB 00:00 2026-02-12T18:04:12.431 INFO:teuthology.orchestra.run.trial111.stdout:(22/34): qatlib-service-25.08.0-2.el9.x86_64.rp 448 kB/s | 37 kB 00:00 2026-02-12T18:04:12.504 INFO:teuthology.orchestra.run.trial111.stdout:(23/34): qatzip-libs-1.3.1-1.el9.x86_64.rpm 811 kB/s | 66 kB 00:00 2026-02-12T18:04:12.507 INFO:teuthology.orchestra.run.trial111.stdout:(24/34): qatlib-25.08.0-2.el9.x86_64.rpm 1.3 MB/s | 240 kB 00:00 2026-02-12T18:04:12.566 INFO:teuthology.orchestra.run.trial111.stdout:(25/34): libarrow-doc-9.0.0-15.el9.noarch.rpm 422 kB/s | 25 kB 00:00 2026-02-12T18:04:12.582 INFO:teuthology.orchestra.run.trial111.stdout:(26/34): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.0 MB/s | 308 kB 00:00 2026-02-12T18:04:12.603 INFO:teuthology.orchestra.run.trial111.stdout:(27/34): libunwind-1.6.2-1.el9.x86_64.rpm 3.1 MB/s | 67 kB 00:00 2026-02-12T18:04:12.606 INFO:teuthology.orchestra.run.trial111.stdout:(28/34): liboath-2.6.12-1.el9.x86_64.rpm 1.2 MB/s | 49 kB 00:00 2026-02-12T18:04:12.646 INFO:teuthology.orchestra.run.trial111.stdout:(29/34): parquet-libs-9.0.0-15.el9.x86_64.rpm 19 MB/s | 838 kB 00:00 2026-02-12T18:04:12.647 INFO:teuthology.orchestra.run.trial111.stdout:(30/34): re2-20211101-20.el9.x86_64.rpm 4.6 MB/s | 191 kB 00:00 2026-02-12T18:04:12.705 INFO:teuthology.orchestra.run.trial111.stdout:(31/34): libarrow-9.0.0-15.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2026-02-12T18:04:12.716 INFO:teuthology.orchestra.run.trial111.stdout:(32/34): thrift-0.15.0-4.el9.x86_64.rpm 23 MB/s | 1.6 MB 00:00 2026-02-12T18:04:12.760 INFO:teuthology.orchestra.run.trial111.stdout:(33/34): librados2-20.3.0-5230.gafefaa40.el9.x8 31 MB/s | 3.5 MB 00:00 2026-02-12T18:04:12.802 INFO:teuthology.orchestra.run.trial111.stdout:(34/34): librbd1-20.3.0-5230.gafefaa40.el9.x86_ 29 MB/s | 2.8 MB 00:00 2026-02-12T18:04:12.805 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:04:12.806 INFO:teuthology.orchestra.run.trial111.stdout:Total 23 MB/s | 67 MB 00:02 2026-02-12T18:04:12.895 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T18:04:12.912 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T18:04:12.912 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T18:04:13.172 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T18:04:13.172 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T18:04:13.179 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 31/36 2026-02-12T18:04:13.182 INFO:teuthology.orchestra.run.trial048.stdout: Installing : ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 31/36 2026-02-12T18:04:13.445 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 31/36 2026-02-12T18:04:13.449 INFO:teuthology.orchestra.run.trial048.stdout: Installing : ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 32/36 2026-02-12T18:04:13.472 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T18:04:13.487 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 32/36 2026-02-12T18:04:13.487 INFO:teuthology.orchestra.run.trial048.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-12T18:04:13.487 INFO:teuthology.orchestra.run.trial048.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-12T18:04:13.487 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:13.490 INFO:teuthology.orchestra.run.trial048.stdout: Installing : ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 33/36 2026-02-12T18:04:13.626 INFO:teuthology.orchestra.run.trial111.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/36 2026-02-12T18:04:13.629 INFO:teuthology.orchestra.run.trial111.stdout: Upgrading : librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 2/36 2026-02-12T18:04:13.659 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 2/36 2026-02-12T18:04:13.698 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 3/36 2026-02-12T18:04:13.699 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 4/36 2026-02-12T18:04:13.711 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 4/36 2026-02-12T18:04:13.720 INFO:teuthology.orchestra.run.trial111.stdout: Installing : liboath-2.6.12-1.el9.x86_64 5/36 2026-02-12T18:04:13.722 INFO:teuthology.orchestra.run.trial111.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/36 2026-02-12T18:04:13.725 INFO:teuthology.orchestra.run.trial111.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/36 2026-02-12T18:04:13.729 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 8/36 2026-02-12T18:04:13.740 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-ceph-argparse-2:20.3.0-5230.gafefaa40.el9. 9/36 2026-02-12T18:04:13.752 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 10/36 2026-02-12T18:04:13.752 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_6 11/36 2026-02-12T18:04:13.774 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_6 11/36 2026-02-12T18:04:13.777 INFO:teuthology.orchestra.run.trial111.stdout: Installing : thrift-0.15.0-4.el9.x86_64 12/36 2026-02-12T18:04:13.808 INFO:teuthology.orchestra.run.trial111.stdout: Installing : re2-1:20211101-20.el9.x86_64 13/36 2026-02-12T18:04:13.813 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libarrow-9.0.0-15.el9.x86_64 14/36 2026-02-12T18:04:13.819 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 15/36 2026-02-12T18:04:13.822 INFO:teuthology.orchestra.run.trial111.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 16/36 2026-02-12T18:04:13.826 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libarrow-doc-9.0.0-15.el9.noarch 17/36 2026-02-12T18:04:13.947 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libnbd-1.20.3-4.el9.x86_64 18/36 2026-02-12T18:04:13.948 INFO:teuthology.orchestra.run.trial111.stdout: Upgrading : librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 19/36 2026-02-12T18:04:13.976 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 19/36 2026-02-12T18:04:13.980 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 20/36 2026-02-12T18:04:13.986 INFO:teuthology.orchestra.run.trial111.stdout: Installing : boost-program-options-1.75.0-13.el9.x86_64 21/36 2026-02-12T18:04:14.267 INFO:teuthology.orchestra.run.trial111.stdout: Installing : parquet-libs-9.0.0-15.el9.x86_64 22/36 2026-02-12T18:04:14.268 INFO:teuthology.orchestra.run.trial111.stdout: Installing : librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 23/36 2026-02-12T18:04:14.285 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 23/36 2026-02-12T18:04:14.288 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 24/36 2026-02-12T18:04:14.293 INFO:teuthology.orchestra.run.trial111.stdout: Installing : pciutils-3.7.0-7.el9.x86_64 25/36 2026-02-12T18:04:14.295 INFO:teuthology.orchestra.run.trial111.stdout: Installing : qatlib-25.08.0-2.el9.x86_64 26/36 2026-02-12T18:04:14.296 INFO:teuthology.orchestra.run.trial111.stdout: Installing : qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-12T18:04:14.313 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: qatlib-service-25.08.0-2.el9.x86_64 27/36 2026-02-12T18:04:14.316 INFO:teuthology.orchestra.run.trial111.stdout: Installing : qatzip-libs-1.3.1-1.el9.x86_64 28/36 2026-02-12T18:04:14.348 INFO:teuthology.orchestra.run.trial111.stdout: Installing : mailcap-2.1.49-5.el9.noarch 29/36 2026-02-12T18:04:14.350 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-ceph-common-2:20.3.0-5230.gafefaa40.el9.x8 30/36 2026-02-12T18:04:15.436 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 31/36 2026-02-12T18:04:15.438 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 31/36 2026-02-12T18:04:15.700 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 31/36 2026-02-12T18:04:15.703 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 32/36 2026-02-12T18:04:15.745 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 32/36 2026-02-12T18:04:15.745 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2026-02-12T18:04:15.745 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2026-02-12T18:04:15.745 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:15.749 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 33/36 2026-02-12T18:04:18.034 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 33/36 2026-02-12T18:04:18.034 INFO:teuthology.orchestra.run.trial048.stdout:skipping the directory /sys 2026-02-12T18:04:18.035 INFO:teuthology.orchestra.run.trial048.stdout:skipping the directory /proc 2026-02-12T18:04:18.035 INFO:teuthology.orchestra.run.trial048.stdout:skipping the directory /mnt 2026-02-12T18:04:18.035 INFO:teuthology.orchestra.run.trial048.stdout:skipping the directory /var/tmp 2026-02-12T18:04:18.035 INFO:teuthology.orchestra.run.trial048.stdout:skipping the directory /home 2026-02-12T18:04:18.035 INFO:teuthology.orchestra.run.trial048.stdout:skipping the directory /root 2026-02-12T18:04:18.035 INFO:teuthology.orchestra.run.trial048.stdout:skipping the directory /tmp 2026-02-12T18:04:18.035 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:18.616 INFO:teuthology.orchestra.run.trial048.stdout: Installing : ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 34/36 2026-02-12T18:04:18.640 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 34/36 2026-02-12T18:04:18.640 INFO:teuthology.orchestra.run.trial048.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T18:04:18.640 INFO:teuthology.orchestra.run.trial048.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-12T18:04:18.640 INFO:teuthology.orchestra.run.trial048.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T18:04:18.640 INFO:teuthology.orchestra.run.trial048.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T18:04:18.640 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:18.641 INFO:teuthology.orchestra.run.trial048.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-12T18:04:18.654 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-12T18:04:18.655 INFO:teuthology.orchestra.run.trial048.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-12T18:04:18.712 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-12T18:04:18.712 INFO:teuthology.orchestra.run.trial048.stdout:Creating group 'qat' with GID 992. 2026-02-12T18:04:18.712 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:18.999 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 1/36 2026-02-12T18:04:18.999 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 2/36 2026-02-12T18:04:18.999 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 3/36 2026-02-12T18:04:18.999 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 4/36 2026-02-12T18:04:18.999 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 5/36 2026-02-12T18:04:19.000 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_6 6/36 2026-02-12T18:04:19.000 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 7/36 2026-02-12T18:04:19.000 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5230.gafefaa40.el9. 8/36 2026-02-12T18:04:19.000 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-ceph-common-2:20.3.0-5230.gafefaa40.el9.x8 9/36 2026-02-12T18:04:19.000 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 10/36 2026-02-12T18:04:19.000 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 11/36 2026-02-12T18:04:19.000 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 12/36 2026-02-12T18:04:19.000 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 13/36 2026-02-12T18:04:19.000 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-12T18:04:19.000 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-12T18:04:19.000 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-12T18:04:19.000 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-12T18:04:19.001 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-12T18:04:19.001 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-12T18:04:19.001 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-12T18:04:19.001 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-12T18:04:19.001 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-12T18:04:19.001 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-12T18:04:19.001 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-12T18:04:19.001 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-12T18:04:19.001 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-12T18:04:19.001 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-12T18:04:19.001 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-12T18:04:19.001 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-12T18:04:19.002 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-12T18:04:19.002 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-12T18:04:19.002 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-12T18:04:19.002 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 33/36 2026-02-12T18:04:19.002 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-12T18:04:19.002 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 35/36 2026-02-12T18:04:19.059 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-12T18:04:19.059 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:19.059 INFO:teuthology.orchestra.run.trial048.stdout:Upgraded: 2026-02-12T18:04:19.059 INFO:teuthology.orchestra.run.trial048.stdout: librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:19.059 INFO:teuthology.orchestra.run.trial048.stdout: librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:19.059 INFO:teuthology.orchestra.run.trial048.stdout:Installed: 2026-02-12T18:04:19.059 INFO:teuthology.orchestra.run.trial048.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-12T18:04:19.060 INFO:teuthology.orchestra.run.trial048.stdout: ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:19.060 INFO:teuthology.orchestra.run.trial048.stdout: ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:19.060 INFO:teuthology.orchestra.run.trial048.stdout: ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:19.060 INFO:teuthology.orchestra.run.trial048.stdout: ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:19.060 INFO:teuthology.orchestra.run.trial048.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-12T18:04:19.060 INFO:teuthology.orchestra.run.trial048.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-12T18:04:19.060 INFO:teuthology.orchestra.run.trial048.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-12T18:04:19.060 INFO:teuthology.orchestra.run.trial048.stdout: libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:19.060 INFO:teuthology.orchestra.run.trial048.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-12T18:04:19.060 INFO:teuthology.orchestra.run.trial048.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-12T18:04:19.060 INFO:teuthology.orchestra.run.trial048.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-12T18:04:19.060 INFO:teuthology.orchestra.run.trial048.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-12T18:04:19.061 INFO:teuthology.orchestra.run.trial048.stdout: libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:19.061 INFO:teuthology.orchestra.run.trial048.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-12T18:04:19.061 INFO:teuthology.orchestra.run.trial048.stdout: librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:19.061 INFO:teuthology.orchestra.run.trial048.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-12T18:04:19.061 INFO:teuthology.orchestra.run.trial048.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-12T18:04:19.061 INFO:teuthology.orchestra.run.trial048.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-12T18:04:19.061 INFO:teuthology.orchestra.run.trial048.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-12T18:04:19.061 INFO:teuthology.orchestra.run.trial048.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-12T18:04:19.061 INFO:teuthology.orchestra.run.trial048.stdout: python3-ceph-argparse-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:19.061 INFO:teuthology.orchestra.run.trial048.stdout: python3-ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:19.061 INFO:teuthology.orchestra.run.trial048.stdout: python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:19.061 INFO:teuthology.orchestra.run.trial048.stdout: python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:19.061 INFO:teuthology.orchestra.run.trial048.stdout: python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:19.062 INFO:teuthology.orchestra.run.trial048.stdout: python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:19.062 INFO:teuthology.orchestra.run.trial048.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-12T18:04:19.062 INFO:teuthology.orchestra.run.trial048.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-12T18:04:19.062 INFO:teuthology.orchestra.run.trial048.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-12T18:04:19.062 INFO:teuthology.orchestra.run.trial048.stdout: re2-1:20211101-20.el9.x86_64 2026-02-12T18:04:19.062 INFO:teuthology.orchestra.run.trial048.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-12T18:04:19.062 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:19.062 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:04:19.101 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install ceph-test 2026-02-12T18:04:19.398 INFO:teuthology.orchestra.run.trial048.stdout:Last metadata expiration check: 0:00:13 ago on Thu 12 Feb 2026 06:04:06 PM UTC. 2026-02-12T18:04:19.480 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:04:19.481 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:04:19.481 INFO:teuthology.orchestra.run.trial048.stdout: Package Arch Version Repository Size 2026-02-12T18:04:19.481 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:04:19.481 INFO:teuthology.orchestra.run.trial048.stdout:Installing: 2026-02-12T18:04:19.481 INFO:teuthology.orchestra.run.trial048.stdout: ceph-test x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 78 M 2026-02-12T18:04:19.481 INFO:teuthology.orchestra.run.trial048.stdout:Installing dependencies: 2026-02-12T18:04:19.481 INFO:teuthology.orchestra.run.trial048.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-12T18:04:19.481 INFO:teuthology.orchestra.run.trial048.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-12T18:04:19.481 INFO:teuthology.orchestra.run.trial048.stdout: libcephsqlite x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 159 k 2026-02-12T18:04:19.481 INFO:teuthology.orchestra.run.trial048.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-12T18:04:19.482 INFO:teuthology.orchestra.run.trial048.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-12T18:04:19.482 INFO:teuthology.orchestra.run.trial048.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-12T18:04:19.482 INFO:teuthology.orchestra.run.trial048.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-12T18:04:19.482 INFO:teuthology.orchestra.run.trial048.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-12T18:04:19.482 INFO:teuthology.orchestra.run.trial048.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-12T18:04:19.482 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:19.482 INFO:teuthology.orchestra.run.trial048.stdout:Transaction Summary 2026-02-12T18:04:19.482 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:04:19.482 INFO:teuthology.orchestra.run.trial048.stdout:Install 10 Packages 2026-02-12T18:04:19.482 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:19.483 INFO:teuthology.orchestra.run.trial048.stdout:Total download size: 82 M 2026-02-12T18:04:19.483 INFO:teuthology.orchestra.run.trial048.stdout:Installed size: 339 M 2026-02-12T18:04:19.483 INFO:teuthology.orchestra.run.trial048.stdout:Downloading Packages: 2026-02-12T18:04:19.852 INFO:teuthology.orchestra.run.trial048.stdout:(1/10): libcephsqlite-20.3.0-5230.gafefaa40.el9 1.6 MB/s | 159 kB 00:00 2026-02-12T18:04:20.257 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 33/36 2026-02-12T18:04:20.257 INFO:teuthology.orchestra.run.trial111.stdout:skipping the directory /sys 2026-02-12T18:04:20.257 INFO:teuthology.orchestra.run.trial111.stdout:skipping the directory /proc 2026-02-12T18:04:20.257 INFO:teuthology.orchestra.run.trial111.stdout:skipping the directory /mnt 2026-02-12T18:04:20.257 INFO:teuthology.orchestra.run.trial111.stdout:skipping the directory /var/tmp 2026-02-12T18:04:20.257 INFO:teuthology.orchestra.run.trial111.stdout:skipping the directory /home 2026-02-12T18:04:20.257 INFO:teuthology.orchestra.run.trial111.stdout:skipping the directory /root 2026-02-12T18:04:20.257 INFO:teuthology.orchestra.run.trial111.stdout:skipping the directory /tmp 2026-02-12T18:04:20.258 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:20.271 INFO:teuthology.orchestra.run.trial048.stdout:(2/10): libatomic-11.5.0-14.el9.x86_64.rpm 54 kB/s | 23 kB 00:00 2026-02-12T18:04:20.527 INFO:teuthology.orchestra.run.trial048.stdout:(3/10): lksctp-tools-1.0.19-2.el9.x86_64.rpm 367 kB/s | 94 kB 00:00 2026-02-12T18:04:20.577 INFO:teuthology.orchestra.run.trial048.stdout:(4/10): libxslt-1.1.34-12.el9.x86_64.rpm 4.6 MB/s | 233 kB 00:00 2026-02-12T18:04:20.609 INFO:teuthology.orchestra.run.trial048.stdout:(5/10): protobuf-3.14.0-17.el9.x86_64.rpm 32 MB/s | 1.0 MB 00:00 2026-02-12T18:04:20.619 INFO:teuthology.orchestra.run.trial048.stdout:(6/10): socat-1.7.4.1-8.el9.x86_64.rpm 28 MB/s | 303 kB 00:00 2026-02-12T18:04:20.628 INFO:teuthology.orchestra.run.trial048.stdout:(7/10): xmlstarlet-1.6.1-20.el9.x86_64.rpm 7.1 MB/s | 64 kB 00:00 2026-02-12T18:04:20.832 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 34/36 2026-02-12T18:04:20.856 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 34/36 2026-02-12T18:04:20.856 INFO:teuthology.orchestra.run.trial111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T18:04:20.856 INFO:teuthology.orchestra.run.trial111.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2026-02-12T18:04:20.856 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T18:04:20.856 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2026-02-12T18:04:20.856 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:20.857 INFO:teuthology.orchestra.run.trial111.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-12T18:04:20.870 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 35/36 2026-02-12T18:04:20.870 INFO:teuthology.orchestra.run.trial111.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-12T18:04:20.925 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 36/36 2026-02-12T18:04:20.925 INFO:teuthology.orchestra.run.trial111.stdout:Creating group 'qat' with GID 992. 2026-02-12T18:04:20.925 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:21.115 INFO:teuthology.orchestra.run.trial048.stdout:(8/10): yaml-cpp-0.6.3-5.el9.x86_64.rpm 250 kB/s | 122 kB 00:00 2026-02-12T18:04:21.216 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 1/36 2026-02-12T18:04:21.216 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 2/36 2026-02-12T18:04:21.216 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 3/36 2026-02-12T18:04:21.217 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 4/36 2026-02-12T18:04:21.217 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 5/36 2026-02-12T18:04:21.217 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_6 6/36 2026-02-12T18:04:21.217 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 7/36 2026-02-12T18:04:21.217 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-ceph-argparse-2:20.3.0-5230.gafefaa40.el9. 8/36 2026-02-12T18:04:21.217 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-ceph-common-2:20.3.0-5230.gafefaa40.el9.x8 9/36 2026-02-12T18:04:21.217 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 10/36 2026-02-12T18:04:21.217 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 11/36 2026-02-12T18:04:21.217 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 12/36 2026-02-12T18:04:21.217 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 13/36 2026-02-12T18:04:21.217 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : mailcap-2.1.49-5.el9.noarch 14/36 2026-02-12T18:04:21.217 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : pciutils-3.7.0-7.el9.x86_64 15/36 2026-02-12T18:04:21.218 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : boost-program-options-1.75.0-13.el9.x86_64 16/36 2026-02-12T18:04:21.218 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libnbd-1.20.3-4.el9.x86_64 17/36 2026-02-12T18:04:21.218 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 18/36 2026-02-12T18:04:21.218 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 19/36 2026-02-12T18:04:21.218 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 20/36 2026-02-12T18:04:21.218 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 21/36 2026-02-12T18:04:21.218 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : qatlib-25.08.0-2.el9.x86_64 22/36 2026-02-12T18:04:21.218 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : qatlib-service-25.08.0-2.el9.x86_64 23/36 2026-02-12T18:04:21.218 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : qatzip-libs-1.3.1-1.el9.x86_64 24/36 2026-02-12T18:04:21.218 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 25/36 2026-02-12T18:04:21.218 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libarrow-9.0.0-15.el9.x86_64 26/36 2026-02-12T18:04:21.218 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libarrow-doc-9.0.0-15.el9.noarch 27/36 2026-02-12T18:04:21.219 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : liboath-2.6.12-1.el9.x86_64 28/36 2026-02-12T18:04:21.219 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 29/36 2026-02-12T18:04:21.219 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : parquet-libs-9.0.0-15.el9.x86_64 30/36 2026-02-12T18:04:21.219 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : re2-1:20211101-20.el9.x86_64 31/36 2026-02-12T18:04:21.219 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : thrift-0.15.0-4.el9.x86_64 32/36 2026-02-12T18:04:21.219 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 33/36 2026-02-12T18:04:21.219 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 34/36 2026-02-12T18:04:21.219 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 35/36 2026-02-12T18:04:21.275 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 36/36 2026-02-12T18:04:21.275 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:21.275 INFO:teuthology.orchestra.run.trial111.stdout:Upgraded: 2026-02-12T18:04:21.276 INFO:teuthology.orchestra.run.trial111.stdout: librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:21.276 INFO:teuthology.orchestra.run.trial111.stdout: librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:21.276 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T18:04:21.276 INFO:teuthology.orchestra.run.trial111.stdout: boost-program-options-1.75.0-13.el9.x86_64 2026-02-12T18:04:21.276 INFO:teuthology.orchestra.run.trial111.stdout: ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:21.276 INFO:teuthology.orchestra.run.trial111.stdout: ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:21.276 INFO:teuthology.orchestra.run.trial111.stdout: ceph-radosgw-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:21.276 INFO:teuthology.orchestra.run.trial111.stdout: ceph-selinux-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:21.276 INFO:teuthology.orchestra.run.trial111.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2026-02-12T18:04:21.276 INFO:teuthology.orchestra.run.trial111.stdout: libarrow-9.0.0-15.el9.x86_64 2026-02-12T18:04:21.276 INFO:teuthology.orchestra.run.trial111.stdout: libarrow-doc-9.0.0-15.el9.noarch 2026-02-12T18:04:21.276 INFO:teuthology.orchestra.run.trial111.stdout: libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:21.277 INFO:teuthology.orchestra.run.trial111.stdout: libnbd-1.20.3-4.el9.x86_64 2026-02-12T18:04:21.277 INFO:teuthology.orchestra.run.trial111.stdout: liboath-2.6.12-1.el9.x86_64 2026-02-12T18:04:21.277 INFO:teuthology.orchestra.run.trial111.stdout: libpmemobj-1.12.1-1.el9.x86_64 2026-02-12T18:04:21.277 INFO:teuthology.orchestra.run.trial111.stdout: librabbitmq-0.11.0-7.el9.x86_64 2026-02-12T18:04:21.277 INFO:teuthology.orchestra.run.trial111.stdout: libradosstriper1-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:21.277 INFO:teuthology.orchestra.run.trial111.stdout: librdkafka-1.6.1-102.el9.x86_64 2026-02-12T18:04:21.277 INFO:teuthology.orchestra.run.trial111.stdout: librgw2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:21.277 INFO:teuthology.orchestra.run.trial111.stdout: libunwind-1.6.2-1.el9.x86_64 2026-02-12T18:04:21.277 INFO:teuthology.orchestra.run.trial111.stdout: lttng-ust-2.12.0-6.el9.x86_64 2026-02-12T18:04:21.277 INFO:teuthology.orchestra.run.trial111.stdout: mailcap-2.1.49-5.el9.noarch 2026-02-12T18:04:21.277 INFO:teuthology.orchestra.run.trial111.stdout: parquet-libs-9.0.0-15.el9.x86_64 2026-02-12T18:04:21.277 INFO:teuthology.orchestra.run.trial111.stdout: pciutils-3.7.0-7.el9.x86_64 2026-02-12T18:04:21.277 INFO:teuthology.orchestra.run.trial111.stdout: python3-ceph-argparse-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:21.278 INFO:teuthology.orchestra.run.trial111.stdout: python3-ceph-common-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:21.278 INFO:teuthology.orchestra.run.trial111.stdout: python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:21.278 INFO:teuthology.orchestra.run.trial111.stdout: python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:21.278 INFO:teuthology.orchestra.run.trial111.stdout: python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:21.278 INFO:teuthology.orchestra.run.trial111.stdout: python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:21.278 INFO:teuthology.orchestra.run.trial111.stdout: qatlib-25.08.0-2.el9.x86_64 2026-02-12T18:04:21.278 INFO:teuthology.orchestra.run.trial111.stdout: qatlib-service-25.08.0-2.el9.x86_64 2026-02-12T18:04:21.278 INFO:teuthology.orchestra.run.trial111.stdout: qatzip-libs-1.3.1-1.el9.x86_64 2026-02-12T18:04:21.278 INFO:teuthology.orchestra.run.trial111.stdout: re2-1:20211101-20.el9.x86_64 2026-02-12T18:04:21.278 INFO:teuthology.orchestra.run.trial111.stdout: thrift-0.15.0-4.el9.x86_64 2026-02-12T18:04:21.278 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:21.278 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:04:21.307 INFO:teuthology.orchestra.run.trial048.stdout:(9/10): ceph-test-20.3.0-5230.gafefaa40.el9.x86 50 MB/s | 78 MB 00:01 2026-02-12T18:04:21.318 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-test 2026-02-12T18:04:21.627 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:13 ago on Thu 12 Feb 2026 06:04:08 PM UTC. 2026-02-12T18:04:21.709 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:04:21.709 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:04:21.709 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repository Size 2026-02-12T18:04:21.710 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:04:21.710 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T18:04:21.710 INFO:teuthology.orchestra.run.trial111.stdout: ceph-test x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 78 M 2026-02-12T18:04:21.710 INFO:teuthology.orchestra.run.trial111.stdout:Installing dependencies: 2026-02-12T18:04:21.710 INFO:teuthology.orchestra.run.trial111.stdout: hwloc-libs x86_64 2.4.1-6.el9 baseos 2.1 M 2026-02-12T18:04:21.710 INFO:teuthology.orchestra.run.trial111.stdout: libatomic x86_64 11.5.0-14.el9 baseos 23 k 2026-02-12T18:04:21.710 INFO:teuthology.orchestra.run.trial111.stdout: libcephsqlite x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 159 k 2026-02-12T18:04:21.710 INFO:teuthology.orchestra.run.trial111.stdout: libxslt x86_64 1.1.34-12.el9 appstream 233 k 2026-02-12T18:04:21.710 INFO:teuthology.orchestra.run.trial111.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2026-02-12T18:04:21.710 INFO:teuthology.orchestra.run.trial111.stdout: protobuf x86_64 3.14.0-17.el9 appstream 1.0 M 2026-02-12T18:04:21.710 INFO:teuthology.orchestra.run.trial111.stdout: socat x86_64 1.7.4.1-8.el9 appstream 303 k 2026-02-12T18:04:21.711 INFO:teuthology.orchestra.run.trial111.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2026-02-12T18:04:21.711 INFO:teuthology.orchestra.run.trial111.stdout: yaml-cpp x86_64 0.6.3-5.el9 epel 122 k 2026-02-12T18:04:21.711 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:21.711 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T18:04:21.711 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:04:21.711 INFO:teuthology.orchestra.run.trial111.stdout:Install 10 Packages 2026-02-12T18:04:21.711 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:21.712 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 82 M 2026-02-12T18:04:21.712 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 339 M 2026-02-12T18:04:21.712 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T18:04:22.218 INFO:teuthology.orchestra.run.trial111.stdout:(1/10): hwloc-libs-2.4.1-6.el9.x86_64.rpm 58 MB/s | 2.1 MB 00:00 2026-02-12T18:04:22.222 INFO:teuthology.orchestra.run.trial111.stdout:(2/10): libatomic-11.5.0-14.el9.x86_64.rpm 5.3 MB/s | 23 kB 00:00 2026-02-12T18:04:22.227 INFO:teuthology.orchestra.run.trial111.stdout:(3/10): lksctp-tools-1.0.19-2.el9.x86_64.rpm 19 MB/s | 94 kB 00:00 2026-02-12T18:04:22.270 INFO:teuthology.orchestra.run.trial111.stdout:(4/10): libcephsqlite-20.3.0-5230.gafefaa40.el9 1.8 MB/s | 159 kB 00:00 2026-02-12T18:04:22.390 INFO:teuthology.orchestra.run.trial111.stdout:(5/10): libxslt-1.1.34-12.el9.x86_64.rpm 1.4 MB/s | 233 kB 00:00 2026-02-12T18:04:22.443 INFO:teuthology.orchestra.run.trial111.stdout:(6/10): socat-1.7.4.1-8.el9.x86_64.rpm 5.7 MB/s | 303 kB 00:00 2026-02-12T18:04:22.469 INFO:teuthology.orchestra.run.trial111.stdout:(7/10): xmlstarlet-1.6.1-20.el9.x86_64.rpm 2.4 MB/s | 64 kB 00:00 2026-02-12T18:04:22.475 INFO:teuthology.orchestra.run.trial111.stdout:(8/10): protobuf-3.14.0-17.el9.x86_64.rpm 4.9 MB/s | 1.0 MB 00:00 2026-02-12T18:04:22.578 INFO:teuthology.orchestra.run.trial111.stdout:(9/10): yaml-cpp-0.6.3-5.el9.x86_64.rpm 1.1 MB/s | 122 kB 00:00 2026-02-12T18:04:22.697 INFO:teuthology.orchestra.run.trial048.stdout:(10/10): hwloc-libs-2.4.1-6.el9.x86_64.rpm 729 kB/s | 2.1 MB 00:02 2026-02-12T18:04:22.701 INFO:teuthology.orchestra.run.trial048.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:04:22.702 INFO:teuthology.orchestra.run.trial048.stdout:Total 26 MB/s | 82 MB 00:03 2026-02-12T18:04:22.766 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction check 2026-02-12T18:04:22.776 INFO:teuthology.orchestra.run.trial048.stdout:Transaction check succeeded. 2026-02-12T18:04:22.776 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction test 2026-02-12T18:04:23.058 INFO:teuthology.orchestra.run.trial048.stdout:Transaction test succeeded. 2026-02-12T18:04:23.058 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction 2026-02-12T18:04:23.366 INFO:teuthology.orchestra.run.trial048.stdout: Preparing : 1/1 2026-02-12T18:04:23.375 INFO:teuthology.orchestra.run.trial048.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/10 2026-02-12T18:04:23.383 INFO:teuthology.orchestra.run.trial048.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/10 2026-02-12T18:04:23.388 INFO:teuthology.orchestra.run.trial048.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/10 2026-02-12T18:04:23.392 INFO:teuthology.orchestra.run.trial048.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/10 2026-02-12T18:04:23.397 INFO:teuthology.orchestra.run.trial048.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/10 2026-02-12T18:04:23.399 INFO:teuthology.orchestra.run.trial048.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 6/10 2026-02-12T18:04:23.409 INFO:teuthology.orchestra.run.trial048.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 7/10 2026-02-12T18:04:23.416 INFO:teuthology.orchestra.run.trial048.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 8/10 2026-02-12T18:04:23.417 INFO:teuthology.orchestra.run.trial048.stdout: Installing : libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 9/10 2026-02-12T18:04:23.770 INFO:teuthology.orchestra.run.trial111.stdout:(10/10): ceph-test-20.3.0-5230.gafefaa40.el9.x8 49 MB/s | 78 MB 00:01 2026-02-12T18:04:23.772 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:04:23.772 INFO:teuthology.orchestra.run.trial111.stdout:Total 40 MB/s | 82 MB 00:02 2026-02-12T18:04:23.834 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T18:04:23.845 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T18:04:23.846 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T18:04:24.125 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T18:04:24.125 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T18:04:24.432 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T18:04:24.441 INFO:teuthology.orchestra.run.trial111.stdout: Installing : yaml-cpp-0.6.3-5.el9.x86_64 1/10 2026-02-12T18:04:24.450 INFO:teuthology.orchestra.run.trial111.stdout: Installing : socat-1.7.4.1-8.el9.x86_64 2/10 2026-02-12T18:04:24.455 INFO:teuthology.orchestra.run.trial111.stdout: Installing : protobuf-3.14.0-17.el9.x86_64 3/10 2026-02-12T18:04:24.459 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libxslt-1.1.34-12.el9.x86_64 4/10 2026-02-12T18:04:24.464 INFO:teuthology.orchestra.run.trial111.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 5/10 2026-02-12T18:04:24.466 INFO:teuthology.orchestra.run.trial111.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 6/10 2026-02-12T18:04:24.476 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libatomic-11.5.0-14.el9.x86_64 7/10 2026-02-12T18:04:24.484 INFO:teuthology.orchestra.run.trial111.stdout: Installing : hwloc-libs-2.4.1-6.el9.x86_64 8/10 2026-02-12T18:04:24.484 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 9/10 2026-02-12T18:04:26.857 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 9/10 2026-02-12T18:04:26.875 INFO:teuthology.orchestra.run.trial048.stdout: Installing : ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 10/10 2026-02-12T18:04:27.199 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 10/10 2026-02-12T18:04:27.199 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 1/10 2026-02-12T18:04:27.199 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 2/10 2026-02-12T18:04:27.199 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/10 2026-02-12T18:04:27.199 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/10 2026-02-12T18:04:27.199 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/10 2026-02-12T18:04:27.199 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 6/10 2026-02-12T18:04:27.200 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 7/10 2026-02-12T18:04:27.200 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 8/10 2026-02-12T18:04:27.200 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 9/10 2026-02-12T18:04:27.251 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 10/10 2026-02-12T18:04:27.251 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:27.251 INFO:teuthology.orchestra.run.trial048.stdout:Installed: 2026-02-12T18:04:27.252 INFO:teuthology.orchestra.run.trial048.stdout: ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:27.252 INFO:teuthology.orchestra.run.trial048.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-12T18:04:27.252 INFO:teuthology.orchestra.run.trial048.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-12T18:04:27.252 INFO:teuthology.orchestra.run.trial048.stdout: libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:27.252 INFO:teuthology.orchestra.run.trial048.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-12T18:04:27.252 INFO:teuthology.orchestra.run.trial048.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-12T18:04:27.252 INFO:teuthology.orchestra.run.trial048.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-12T18:04:27.252 INFO:teuthology.orchestra.run.trial048.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-12T18:04:27.252 INFO:teuthology.orchestra.run.trial048.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-12T18:04:27.252 INFO:teuthology.orchestra.run.trial048.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-12T18:04:27.252 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:27.252 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:04:27.290 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install ceph 2026-02-12T18:04:27.589 INFO:teuthology.orchestra.run.trial048.stdout:Last metadata expiration check: 0:00:21 ago on Thu 12 Feb 2026 06:04:06 PM UTC. 2026-02-12T18:04:27.673 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:04:27.675 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:04:27.675 INFO:teuthology.orchestra.run.trial048.stdout: Package Arch Version Repository Size 2026-02-12T18:04:27.675 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:04:27.675 INFO:teuthology.orchestra.run.trial048.stdout:Installing: 2026-02-12T18:04:27.675 INFO:teuthology.orchestra.run.trial048.stdout: ceph x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 6.5 k 2026-02-12T18:04:27.675 INFO:teuthology.orchestra.run.trial048.stdout:Installing dependencies: 2026-02-12T18:04:27.675 INFO:teuthology.orchestra.run.trial048.stdout: ceph-mds x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 2.4 M 2026-02-12T18:04:27.675 INFO:teuthology.orchestra.run.trial048.stdout: ceph-mgr x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 936 k 2026-02-12T18:04:27.675 INFO:teuthology.orchestra.run.trial048.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 297 k 2026-02-12T18:04:27.675 INFO:teuthology.orchestra.run.trial048.stdout: ceph-mon x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 5.0 M 2026-02-12T18:04:27.675 INFO:teuthology.orchestra.run.trial048.stdout: ceph-osd x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 166 k 2026-02-12T18:04:27.675 INFO:teuthology.orchestra.run.trial048.stdout: ceph-osd-classic x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 16 M 2026-02-12T18:04:27.675 INFO:teuthology.orchestra.run.trial048.stdout: ceph-osd-crimson x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 19 M 2026-02-12T18:04:27.675 INFO:teuthology.orchestra.run.trial048.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-12T18:04:27.675 INFO:teuthology.orchestra.run.trial048.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-12T18:04:27.675 INFO:teuthology.orchestra.run.trial048.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-12T18:04:27.675 INFO:teuthology.orchestra.run.trial048.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-12T18:04:27.675 INFO:teuthology.orchestra.run.trial048.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-12T18:04:27.675 INFO:teuthology.orchestra.run.trial048.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-12T18:04:27.675 INFO:teuthology.orchestra.run.trial048.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-12T18:04:27.675 INFO:teuthology.orchestra.run.trial048.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-12T18:04:27.675 INFO:teuthology.orchestra.run.trial048.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-12T18:04:27.675 INFO:teuthology.orchestra.run.trial048.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-12T18:04:27.675 INFO:teuthology.orchestra.run.trial048.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-12T18:04:27.675 INFO:teuthology.orchestra.run.trial048.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout: python3-jaraco-collections 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout: noarch 3.0.0-8.el9 epel 23 k 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout:Transaction Summary 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout:Install 42 Packages 2026-02-12T18:04:27.676 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:27.677 INFO:teuthology.orchestra.run.trial048.stdout:Total download size: 48 M 2026-02-12T18:04:27.677 INFO:teuthology.orchestra.run.trial048.stdout:Installed size: 167 M 2026-02-12T18:04:27.677 INFO:teuthology.orchestra.run.trial048.stdout:Downloading Packages: 2026-02-12T18:04:27.934 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 9/10 2026-02-12T18:04:27.952 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 10/10 2026-02-12T18:04:28.192 INFO:teuthology.orchestra.run.trial048.stdout:(1/42): ceph-20.3.0-5230.gafefaa40.el9.x86_64.r 128 kB/s | 6.5 kB 00:00 2026-02-12T18:04:28.262 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 10/10 2026-02-12T18:04:28.262 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 1/10 2026-02-12T18:04:28.262 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 2/10 2026-02-12T18:04:28.262 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : hwloc-libs-2.4.1-6.el9.x86_64 3/10 2026-02-12T18:04:28.262 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libatomic-11.5.0-14.el9.x86_64 4/10 2026-02-12T18:04:28.262 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 5/10 2026-02-12T18:04:28.262 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libxslt-1.1.34-12.el9.x86_64 6/10 2026-02-12T18:04:28.262 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : protobuf-3.14.0-17.el9.x86_64 7/10 2026-02-12T18:04:28.263 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : socat-1.7.4.1-8.el9.x86_64 8/10 2026-02-12T18:04:28.263 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 9/10 2026-02-12T18:04:28.279 INFO:teuthology.orchestra.run.trial048.stdout:(2/42): ceph-mgr-20.3.0-5230.gafefaa40.el9.x86_ 6.7 MB/s | 936 kB 00:00 2026-02-12T18:04:28.306 INFO:teuthology.orchestra.run.trial048.stdout:(3/42): ceph-mds-20.3.0-5230.gafefaa40.el9.x86_ 14 MB/s | 2.4 MB 00:00 2026-02-12T18:04:28.309 INFO:teuthology.orchestra.run.trial048.stdout:(4/42): ceph-osd-20.3.0-5230.gafefaa40.el9.x86_ 5.4 MB/s | 166 kB 00:00 2026-02-12T18:04:28.314 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : yaml-cpp-0.6.3-5.el9.x86_64 10/10 2026-02-12T18:04:28.314 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:28.314 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T18:04:28.314 INFO:teuthology.orchestra.run.trial111.stdout: ceph-test-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:28.314 INFO:teuthology.orchestra.run.trial111.stdout: hwloc-libs-2.4.1-6.el9.x86_64 2026-02-12T18:04:28.314 INFO:teuthology.orchestra.run.trial111.stdout: libatomic-11.5.0-14.el9.x86_64 2026-02-12T18:04:28.315 INFO:teuthology.orchestra.run.trial111.stdout: libcephsqlite-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:28.315 INFO:teuthology.orchestra.run.trial111.stdout: libxslt-1.1.34-12.el9.x86_64 2026-02-12T18:04:28.315 INFO:teuthology.orchestra.run.trial111.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2026-02-12T18:04:28.315 INFO:teuthology.orchestra.run.trial111.stdout: protobuf-3.14.0-17.el9.x86_64 2026-02-12T18:04:28.315 INFO:teuthology.orchestra.run.trial111.stdout: socat-1.7.4.1-8.el9.x86_64 2026-02-12T18:04:28.315 INFO:teuthology.orchestra.run.trial111.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2026-02-12T18:04:28.315 INFO:teuthology.orchestra.run.trial111.stdout: yaml-cpp-0.6.3-5.el9.x86_64 2026-02-12T18:04:28.315 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:28.315 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:04:28.353 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph 2026-02-12T18:04:28.448 INFO:teuthology.orchestra.run.trial048.stdout:(5/42): ceph-mon-20.3.0-5230.gafefaa40.el9.x86_ 19 MB/s | 5.0 MB 00:00 2026-02-12T18:04:28.497 INFO:teuthology.orchestra.run.trial048.stdout:(6/42): ceph-mgr-modules-core-20.3.0-5230.gafef 5.9 MB/s | 297 kB 00:00 2026-02-12T18:04:28.650 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:20 ago on Thu 12 Feb 2026 06:04:08 PM UTC. 2026-02-12T18:04:28.733 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:04:28.735 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:04:28.735 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repository Size 2026-02-12T18:04:28.735 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:04:28.735 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T18:04:28.735 INFO:teuthology.orchestra.run.trial111.stdout: ceph x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 6.5 k 2026-02-12T18:04:28.735 INFO:teuthology.orchestra.run.trial111.stdout:Installing dependencies: 2026-02-12T18:04:28.735 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mds x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 2.4 M 2026-02-12T18:04:28.735 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 936 k 2026-02-12T18:04:28.736 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-modules-core noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 297 k 2026-02-12T18:04:28.736 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mon x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 5.0 M 2026-02-12T18:04:28.736 INFO:teuthology.orchestra.run.trial111.stdout: ceph-osd x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 166 k 2026-02-12T18:04:28.736 INFO:teuthology.orchestra.run.trial111.stdout: ceph-osd-classic x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 16 M 2026-02-12T18:04:28.736 INFO:teuthology.orchestra.run.trial111.stdout: ceph-osd-crimson x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 19 M 2026-02-12T18:04:28.736 INFO:teuthology.orchestra.run.trial111.stdout: ledmon-libs x86_64 1.1.0-3.el9 baseos 40 k 2026-02-12T18:04:28.736 INFO:teuthology.orchestra.run.trial111.stdout: libconfig x86_64 1.7.2-9.el9 baseos 72 k 2026-02-12T18:04:28.736 INFO:teuthology.orchestra.run.trial111.stdout: libstoragemgmt x86_64 1.10.1-1.el9 appstream 246 k 2026-02-12T18:04:28.736 INFO:teuthology.orchestra.run.trial111.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2026-02-12T18:04:28.736 INFO:teuthology.orchestra.run.trial111.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2026-02-12T18:04:28.736 INFO:teuthology.orchestra.run.trial111.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2026-02-12T18:04:28.736 INFO:teuthology.orchestra.run.trial111.stdout: python3-autocommand noarch 2.2.2-8.el9 epel 29 k 2026-02-12T18:04:28.737 INFO:teuthology.orchestra.run.trial111.stdout: python3-backports-tarfile noarch 1.2.0-1.el9 epel 60 k 2026-02-12T18:04:28.737 INFO:teuthology.orchestra.run.trial111.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2026-02-12T18:04:28.737 INFO:teuthology.orchestra.run.trial111.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2026-02-12T18:04:28.737 INFO:teuthology.orchestra.run.trial111.stdout: python3-cheroot noarch 10.0.1-4.el9 epel 173 k 2026-02-12T18:04:28.737 INFO:teuthology.orchestra.run.trial111.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2026-02-12T18:04:28.737 INFO:teuthology.orchestra.run.trial111.stdout: python3-cryptography x86_64 36.0.1-5.el9 baseos 1.2 M 2026-02-12T18:04:28.737 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2026-02-12T18:04:28.737 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2026-02-12T18:04:28.737 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-collections 2026-02-12T18:04:28.737 INFO:teuthology.orchestra.run.trial111.stdout: noarch 3.0.0-8.el9 epel 23 k 2026-02-12T18:04:28.737 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-context noarch 6.0.1-3.el9 epel 20 k 2026-02-12T18:04:28.737 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2026-02-12T18:04:28.738 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-text noarch 4.0.0-2.el9 epel 26 k 2026-02-12T18:04:28.738 INFO:teuthology.orchestra.run.trial111.stdout: python3-libstoragemgmt x86_64 1.10.1-1.el9 appstream 177 k 2026-02-12T18:04:28.738 INFO:teuthology.orchestra.run.trial111.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2026-02-12T18:04:28.738 INFO:teuthology.orchestra.run.trial111.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2026-02-12T18:04:28.738 INFO:teuthology.orchestra.run.trial111.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2026-02-12T18:04:28.738 INFO:teuthology.orchestra.run.trial111.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2026-02-12T18:04:28.738 INFO:teuthology.orchestra.run.trial111.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2026-02-12T18:04:28.738 INFO:teuthology.orchestra.run.trial111.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2026-02-12T18:04:28.738 INFO:teuthology.orchestra.run.trial111.stdout: python3-pyparsing noarch 2.4.7-9.el9 baseos 150 k 2026-02-12T18:04:28.738 INFO:teuthology.orchestra.run.trial111.stdout: python3-requests noarch 2.25.1-10.el9 baseos 126 k 2026-02-12T18:04:28.738 INFO:teuthology.orchestra.run.trial111.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2026-02-12T18:04:28.738 INFO:teuthology.orchestra.run.trial111.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2026-02-12T18:04:28.738 INFO:teuthology.orchestra.run.trial111.stdout: python3-urllib3 noarch 1.26.5-7.el9 baseos 218 k 2026-02-12T18:04:28.739 INFO:teuthology.orchestra.run.trial111.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2026-02-12T18:04:28.739 INFO:teuthology.orchestra.run.trial111.stdout: unzip x86_64 6.0-59.el9 baseos 182 k 2026-02-12T18:04:28.739 INFO:teuthology.orchestra.run.trial111.stdout: zip x86_64 3.0-35.el9 baseos 266 k 2026-02-12T18:04:28.739 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:28.739 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T18:04:28.739 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:04:28.739 INFO:teuthology.orchestra.run.trial111.stdout:Install 42 Packages 2026-02-12T18:04:28.739 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:28.740 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 48 M 2026-02-12T18:04:28.740 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 167 M 2026-02-12T18:04:28.740 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T18:04:28.833 INFO:teuthology.orchestra.run.trial048.stdout:(7/42): ceph-osd-classic-20.3.0-5230.gafefaa40. 30 MB/s | 16 MB 00:00 2026-02-12T18:04:28.989 INFO:teuthology.orchestra.run.trial048.stdout:(8/42): ceph-osd-crimson-20.3.0-5230.gafefaa40. 28 MB/s | 19 MB 00:00 2026-02-12T18:04:29.073 INFO:teuthology.orchestra.run.trial048.stdout:(9/42): ledmon-libs-1.1.0-3.el9.x86_64.rpm 70 kB/s | 40 kB 00:00 2026-02-12T18:04:29.331 INFO:teuthology.orchestra.run.trial111.stdout:(1/42): ceph-20.3.0-5230.gafefaa40.el9.x86_64.r 131 kB/s | 6.5 kB 00:00 2026-02-12T18:04:29.390 INFO:teuthology.orchestra.run.trial048.stdout:(10/42): libconfig-1.7.2-9.el9.x86_64.rpm 129 kB/s | 72 kB 00:00 2026-02-12T18:04:29.416 INFO:teuthology.orchestra.run.trial111.stdout:(2/42): ceph-mgr-20.3.0-5230.gafefaa40.el9.x86_ 6.8 MB/s | 936 kB 00:00 2026-02-12T18:04:29.443 INFO:teuthology.orchestra.run.trial111.stdout:(3/42): ceph-mds-20.3.0-5230.gafefaa40.el9.x86_ 15 MB/s | 2.4 MB 00:00 2026-02-12T18:04:29.446 INFO:teuthology.orchestra.run.trial111.stdout:(4/42): ceph-osd-20.3.0-5230.gafefaa40.el9.x86_ 5.5 MB/s | 166 kB 00:00 2026-02-12T18:04:29.627 INFO:teuthology.orchestra.run.trial048.stdout:(11/42): python3-ply-3.11-14.el9.noarch.rpm 449 kB/s | 106 kB 00:00 2026-02-12T18:04:29.636 INFO:teuthology.orchestra.run.trial111.stdout:(5/42): ceph-mon-20.3.0-5230.gafefaa40.el9.x86_ 16 MB/s | 5.0 MB 00:00 2026-02-12T18:04:29.695 INFO:teuthology.orchestra.run.trial111.stdout:(6/42): ceph-mgr-modules-core-20.3.0-5230.gafef 4.9 MB/s | 297 kB 00:00 2026-02-12T18:04:29.807 INFO:teuthology.orchestra.run.trial111.stdout:(7/42): ledmon-libs-1.1.0-3.el9.x86_64.rpm 364 kB/s | 40 kB 00:00 2026-02-12T18:04:29.863 INFO:teuthology.orchestra.run.trial048.stdout:(12/42): python3-cffi-1.14.5-5.el9.x86_64.rpm 290 kB/s | 253 kB 00:00 2026-02-12T18:04:29.864 INFO:teuthology.orchestra.run.trial048.stdout:(13/42): python3-pycparser-2.20-6.el9.noarch.rp 569 kB/s | 135 kB 00:00 2026-02-12T18:04:29.926 INFO:teuthology.orchestra.run.trial111.stdout:(8/42): ceph-osd-classic-20.3.0-5230.gafefaa40. 32 MB/s | 16 MB 00:00 2026-02-12T18:04:29.936 INFO:teuthology.orchestra.run.trial111.stdout:(9/42): libconfig-1.7.2-9.el9.x86_64.rpm 559 kB/s | 72 kB 00:00 2026-02-12T18:04:30.088 INFO:teuthology.orchestra.run.trial111.stdout:(10/42): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2026-02-12T18:04:30.128 INFO:teuthology.orchestra.run.trial111.stdout:(11/42): ceph-osd-crimson-20.3.0-5230.gafefaa40 28 MB/s | 19 MB 00:00 2026-02-12T18:04:30.178 INFO:teuthology.orchestra.run.trial048.stdout:(14/42): python3-pyparsing-2.4.7-9.el9.noarch.r 477 kB/s | 150 kB 00:00 2026-02-12T18:04:30.180 INFO:teuthology.orchestra.run.trial048.stdout:(15/42): python3-requests-2.25.1-10.el9.noarch. 401 kB/s | 126 kB 00:00 2026-02-12T18:04:30.235 INFO:teuthology.orchestra.run.trial111.stdout:(12/42): python3-cryptography-36.0.1-5.el9.x86_ 4.2 MB/s | 1.2 MB 00:00 2026-02-12T18:04:30.238 INFO:teuthology.orchestra.run.trial111.stdout:(13/42): python3-ply-3.11-14.el9.noarch.rpm 712 kB/s | 106 kB 00:00 2026-02-12T18:04:30.284 INFO:teuthology.orchestra.run.trial111.stdout:(14/42): python3-pycparser-2.20-6.el9.noarch.rp 870 kB/s | 135 kB 00:00 2026-02-12T18:04:30.343 INFO:teuthology.orchestra.run.trial111.stdout:(15/42): python3-pyparsing-2.4.7-9.el9.noarch.r 1.4 MB/s | 150 kB 00:00 2026-02-12T18:04:30.391 INFO:teuthology.orchestra.run.trial111.stdout:(16/42): python3-requests-2.25.1-10.el9.noarch. 830 kB/s | 126 kB 00:00 2026-02-12T18:04:30.420 INFO:teuthology.orchestra.run.trial111.stdout:(17/42): python3-urllib3-1.26.5-7.el9.noarch.rp 1.6 MB/s | 218 kB 00:00 2026-02-12T18:04:30.459 INFO:teuthology.orchestra.run.trial111.stdout:(18/42): unzip-6.0-59.el9.x86_64.rpm 1.5 MB/s | 182 kB 00:00 2026-02-12T18:04:30.495 INFO:teuthology.orchestra.run.trial048.stdout:(16/42): unzip-6.0-59.el9.x86_64.rpm 577 kB/s | 182 kB 00:00 2026-02-12T18:04:30.571 INFO:teuthology.orchestra.run.trial048.stdout:(17/42): python3-urllib3-1.26.5-7.el9.noarch.rp 554 kB/s | 218 kB 00:00 2026-02-12T18:04:30.572 INFO:teuthology.orchestra.run.trial111.stdout:(19/42): zip-3.0-35.el9.x86_64.rpm 1.4 MB/s | 266 kB 00:00 2026-02-12T18:04:30.682 INFO:teuthology.orchestra.run.trial048.stdout:(18/42): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 2.2 MB/s | 246 kB 00:00 2026-02-12T18:04:30.709 INFO:teuthology.orchestra.run.trial048.stdout:(19/42): lua-5.4.4-4.el9.x86_64.rpm 6.7 MB/s | 188 kB 00:00 2026-02-12T18:04:30.753 INFO:teuthology.orchestra.run.trial048.stdout:(20/42): python3-libstoragemgmt-1.10.1-1.el9.x8 4.0 MB/s | 177 kB 00:00 2026-02-12T18:04:30.786 INFO:teuthology.orchestra.run.trial048.stdout:(21/42): python3-packaging-20.9-5.el9.noarch.rp 2.3 MB/s | 77 kB 00:00 2026-02-12T18:04:30.826 INFO:teuthology.orchestra.run.trial048.stdout:(22/42): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2026-02-12T18:04:30.888 INFO:teuthology.orchestra.run.trial048.stdout:(23/42): zip-3.0-35.el9.x86_64.rpm 676 kB/s | 266 kB 00:00 2026-02-12T18:04:31.053 INFO:teuthology.orchestra.run.trial048.stdout:(24/42): luarocks-3.9.2-5.el9.noarch.rpm 918 kB/s | 151 kB 00:00 2026-02-12T18:04:31.072 INFO:teuthology.orchestra.run.trial048.stdout:(25/42): python3-autocommand-2.2.2-8.el9.noarch 1.5 MB/s | 29 kB 00:00 2026-02-12T18:04:31.077 INFO:teuthology.orchestra.run.trial048.stdout:(26/42): lua-devel-5.4.4-4.el9.x86_64.rpm 89 kB/s | 22 kB 00:00 2026-02-12T18:04:31.093 INFO:teuthology.orchestra.run.trial048.stdout:(27/42): python3-backports-tarfile-1.2.0-1.el9. 2.9 MB/s | 60 kB 00:00 2026-02-12T18:04:31.116 INFO:teuthology.orchestra.run.trial111.stdout:(20/42): lua-5.4.4-4.el9.x86_64.rpm 287 kB/s | 188 kB 00:00 2026-02-12T18:04:31.122 INFO:teuthology.orchestra.run.trial048.stdout:(28/42): python3-cheroot-10.0.1-4.el9.noarch.rp 5.9 MB/s | 173 kB 00:00 2026-02-12T18:04:31.147 INFO:teuthology.orchestra.run.trial048.stdout:(29/42): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 621 kB/s | 43 kB 00:00 2026-02-12T18:04:31.159 INFO:teuthology.orchestra.run.trial048.stdout:(30/42): python3-cherrypy-18.6.1-2.el9.noarch.r 9.6 MB/s | 358 kB 00:00 2026-02-12T18:04:31.169 INFO:teuthology.orchestra.run.trial111.stdout:(21/42): libstoragemgmt-1.10.1-1.el9.x86_64.rpm 329 kB/s | 246 kB 00:00 2026-02-12T18:04:31.169 INFO:teuthology.orchestra.run.trial048.stdout:(31/42): python3-jaraco-8.2.1-3.el9.noarch.rpm 495 kB/s | 11 kB 00:00 2026-02-12T18:04:31.176 INFO:teuthology.orchestra.run.trial048.stdout:(32/42): python3-jaraco-classes-3.2.1-5.el9.noa 1.0 MB/s | 18 kB 00:00 2026-02-12T18:04:31.193 INFO:teuthology.orchestra.run.trial048.stdout:(33/42): python3-jaraco-context-6.0.1-3.el9.noa 1.1 MB/s | 20 kB 00:00 2026-02-12T18:04:31.194 INFO:teuthology.orchestra.run.trial048.stdout:(34/42): python3-jaraco-collections-3.0.0-8.el9 932 kB/s | 23 kB 00:00 2026-02-12T18:04:31.211 INFO:teuthology.orchestra.run.trial048.stdout:(35/42): python3-jaraco-functools-3.5.0-2.el9.n 1.1 MB/s | 19 kB 00:00 2026-02-12T18:04:31.216 INFO:teuthology.orchestra.run.trial048.stdout:(36/42): python3-jaraco-text-4.0.0-2.el9.noarch 1.1 MB/s | 26 kB 00:00 2026-02-12T18:04:31.223 INFO:teuthology.orchestra.run.trial111.stdout:(22/42): python3-libstoragemgmt-1.10.1-1.el9.x8 271 kB/s | 177 kB 00:00 2026-02-12T18:04:31.229 INFO:teuthology.orchestra.run.trial048.stdout:(37/42): python3-more-itertools-8.12.0-2.el9.no 4.2 MB/s | 79 kB 00:00 2026-02-12T18:04:31.237 INFO:teuthology.orchestra.run.trial048.stdout:(38/42): python3-portend-3.1.0-2.el9.noarch.rpm 786 kB/s | 16 kB 00:00 2026-02-12T18:04:31.248 INFO:teuthology.orchestra.run.trial048.stdout:(39/42): python3-pyOpenSSL-21.0.0-1.el9.noarch. 4.7 MB/s | 90 kB 00:00 2026-02-12T18:04:31.253 INFO:teuthology.orchestra.run.trial111.stdout:(23/42): lua-devel-5.4.4-4.el9.x86_64.rpm 773 kB/s | 22 kB 00:00 2026-02-12T18:04:31.265 INFO:teuthology.orchestra.run.trial048.stdout:(40/42): python3-zc-lockfile-2.0-10.el9.noarch. 1.1 MB/s | 20 kB 00:00 2026-02-12T18:04:31.266 INFO:teuthology.orchestra.run.trial048.stdout:(41/42): python3-tempora-5.0.0-2.el9.noarch.rpm 1.2 MB/s | 36 kB 00:00 2026-02-12T18:04:31.268 INFO:teuthology.orchestra.run.trial111.stdout:(24/42): python3-toml-0.10.2-6.el9.noarch.rpm 420 kB/s | 42 kB 00:00 2026-02-12T18:04:31.295 INFO:teuthology.orchestra.run.trial111.stdout:(25/42): python3-packaging-20.9-5.el9.noarch.rp 432 kB/s | 77 kB 00:00 2026-02-12T18:04:31.333 INFO:teuthology.orchestra.run.trial111.stdout:(26/42): python3-autocommand-2.2.2-8.el9.noarch 453 kB/s | 29 kB 00:00 2026-02-12T18:04:31.337 INFO:teuthology.orchestra.run.trial111.stdout:(27/42): luarocks-3.9.2-5.el9.noarch.rpm 1.7 MB/s | 151 kB 00:00 2026-02-12T18:04:31.344 INFO:teuthology.orchestra.run.trial111.stdout:(28/42): python3-backports-tarfile-1.2.0-1.el9. 1.2 MB/s | 60 kB 00:00 2026-02-12T18:04:31.373 INFO:teuthology.orchestra.run.trial111.stdout:(29/42): python3-cheroot-10.0.1-4.el9.noarch.rp 4.8 MB/s | 173 kB 00:00 2026-02-12T18:04:31.377 INFO:teuthology.orchestra.run.trial111.stdout:(30/42): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 997 kB/s | 43 kB 00:00 2026-02-12T18:04:31.400 INFO:teuthology.orchestra.run.trial111.stdout:(31/42): python3-jaraco-8.2.1-3.el9.noarch.rpm 390 kB/s | 11 kB 00:00 2026-02-12T18:04:31.400 INFO:teuthology.orchestra.run.trial111.stdout:(32/42): python3-jaraco-classes-3.2.1-5.el9.noa 746 kB/s | 18 kB 00:00 2026-02-12T18:04:31.411 INFO:teuthology.orchestra.run.trial111.stdout:(33/42): python3-jaraco-collections-3.0.0-8.el9 2.1 MB/s | 23 kB 00:00 2026-02-12T18:04:31.415 INFO:teuthology.orchestra.run.trial111.stdout:(34/42): python3-cherrypy-18.6.1-2.el9.noarch.r 5.0 MB/s | 358 kB 00:00 2026-02-12T18:04:31.422 INFO:teuthology.orchestra.run.trial111.stdout:(35/42): python3-jaraco-functools-3.5.0-2.el9.n 1.7 MB/s | 19 kB 00:00 2026-02-12T18:04:31.422 INFO:teuthology.orchestra.run.trial111.stdout:(36/42): python3-jaraco-context-6.0.1-3.el9.noa 892 kB/s | 20 kB 00:00 2026-02-12T18:04:31.427 INFO:teuthology.orchestra.run.trial111.stdout:(37/42): python3-jaraco-text-4.0.0-2.el9.noarch 2.0 MB/s | 26 kB 00:00 2026-02-12T18:04:31.451 INFO:teuthology.orchestra.run.trial111.stdout:(38/42): python3-more-itertools-8.12.0-2.el9.no 2.7 MB/s | 79 kB 00:00 2026-02-12T18:04:31.466 INFO:teuthology.orchestra.run.trial111.stdout:(39/42): python3-portend-3.1.0-2.el9.noarch.rpm 377 kB/s | 16 kB 00:00 2026-02-12T18:04:31.476 INFO:teuthology.orchestra.run.trial111.stdout:(40/42): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2026-02-12T18:04:31.481 INFO:teuthology.orchestra.run.trial111.stdout:(41/42): python3-zc-lockfile-2.0-10.el9.noarch. 1.3 MB/s | 20 kB 00:00 2026-02-12T18:04:31.485 INFO:teuthology.orchestra.run.trial111.stdout:(42/42): python3-tempora-5.0.0-2.el9.noarch.rpm 1.0 MB/s | 36 kB 00:00 2026-02-12T18:04:31.488 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:04:31.489 INFO:teuthology.orchestra.run.trial111.stdout:Total 17 MB/s | 48 MB 00:02 2026-02-12T18:04:31.635 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T18:04:31.653 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T18:04:31.653 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T18:04:31.669 INFO:teuthology.orchestra.run.trial048.stdout:(42/42): python3-cryptography-36.0.1-5.el9.x86_ 491 kB/s | 1.2 MB 00:02 2026-02-12T18:04:31.674 INFO:teuthology.orchestra.run.trial048.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:04:31.674 INFO:teuthology.orchestra.run.trial048.stdout:Total 12 MB/s | 48 MB 00:03 2026-02-12T18:04:31.824 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction check 2026-02-12T18:04:31.844 INFO:teuthology.orchestra.run.trial048.stdout:Transaction check succeeded. 2026-02-12T18:04:31.844 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction test 2026-02-12T18:04:31.850 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T18:04:31.850 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T18:04:32.041 INFO:teuthology.orchestra.run.trial048.stdout:Transaction test succeeded. 2026-02-12T18:04:32.041 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction 2026-02-12T18:04:32.078 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T18:04:32.080 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/42 2026-02-12T18:04:32.085 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/42 2026-02-12T18:04:32.089 INFO:teuthology.orchestra.run.trial111.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/42 2026-02-12T18:04:32.091 INFO:teuthology.orchestra.run.trial111.stdout: Installing : unzip-6.0-59.el9.x86_64 4/42 2026-02-12T18:04:32.097 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/42 2026-02-12T18:04:32.120 INFO:teuthology.orchestra.run.trial111.stdout: Installing : zip-3.0-35.el9.x86_64 6/42 2026-02-12T18:04:32.124 INFO:teuthology.orchestra.run.trial111.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/42 2026-02-12T18:04:32.129 INFO:teuthology.orchestra.run.trial111.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/42 2026-02-12T18:04:32.133 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/42 2026-02-12T18:04:32.139 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/42 2026-02-12T18:04:32.143 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/42 2026-02-12T18:04:32.149 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/42 2026-02-12T18:04:32.154 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/42 2026-02-12T18:04:32.158 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/42 2026-02-12T18:04:32.163 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/42 2026-02-12T18:04:32.167 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/42 2026-02-12T18:04:32.174 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/42 2026-02-12T18:04:32.177 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/42 2026-02-12T18:04:32.200 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/42 2026-02-12T18:04:32.212 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/42 2026-02-12T18:04:32.217 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/42 2026-02-12T18:04:32.227 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/42 2026-02-12T18:04:32.234 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/42 2026-02-12T18:04:32.247 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/42 2026-02-12T18:04:32.263 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/42 2026-02-12T18:04:32.270 INFO:teuthology.orchestra.run.trial048.stdout: Preparing : 1/1 2026-02-12T18:04:32.272 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/42 2026-02-12T18:04:32.277 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/42 2026-02-12T18:04:32.282 INFO:teuthology.orchestra.run.trial048.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/42 2026-02-12T18:04:32.283 INFO:teuthology.orchestra.run.trial048.stdout: Installing : unzip-6.0-59.el9.x86_64 4/42 2026-02-12T18:04:32.289 INFO:teuthology.orchestra.run.trial048.stdout: Installing : ledmon-libs-1.1.0-3.el9.x86_64 5/42 2026-02-12T18:04:32.313 INFO:teuthology.orchestra.run.trial048.stdout: Installing : zip-3.0-35.el9.x86_64 6/42 2026-02-12T18:04:32.316 INFO:teuthology.orchestra.run.trial048.stdout: Installing : luarocks-3.9.2-5.el9.noarch 7/42 2026-02-12T18:04:32.321 INFO:teuthology.orchestra.run.trial048.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 8/42 2026-02-12T18:04:32.325 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 9/42 2026-02-12T18:04:32.331 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 10/42 2026-02-12T18:04:32.335 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-backports-tarfile-1.2.0-1.el9.noarch 11/42 2026-02-12T18:04:32.339 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/42 2026-02-12T18:04:32.341 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-jaraco-context-6.0.1-3.el9.noarch 12/42 2026-02-12T18:04:32.346 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-autocommand-2.2.2-8.el9.noarch 13/42 2026-02-12T18:04:32.348 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/42 2026-02-12T18:04:32.349 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 14/42 2026-02-12T18:04:32.355 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 15/42 2026-02-12T18:04:32.359 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-jaraco-text-4.0.0-2.el9.noarch 16/42 2026-02-12T18:04:32.366 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 17/42 2026-02-12T18:04:32.369 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 18/42 2026-02-12T18:04:32.371 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/42 2026-02-12T18:04:32.391 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 19/42 2026-02-12T18:04:32.400 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/42 2026-02-12T18:04:32.404 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-urllib3-1.26.5-7.el9.noarch 20/42 2026-02-12T18:04:32.406 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/42 2026-02-12T18:04:32.409 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-requests-2.25.1-10.el9.noarch 21/42 2026-02-12T18:04:32.418 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-pyparsing-2.4.7-9.el9.noarch 22/42 2026-02-12T18:04:32.425 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-packaging-20.9-5.el9.noarch 23/42 2026-02-12T18:04:32.438 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/42 2026-02-12T18:04:32.453 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/42 2026-02-12T18:04:32.457 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/42 2026-02-12T18:04:32.499 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5230.gafefaa40.el9. 32/42 2026-02-12T18:04:32.500 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 33/42 2026-02-12T18:04:32.523 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 33/42 2026-02-12T18:04:32.524 INFO:teuthology.orchestra.run.trial111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T18:04:32.524 INFO:teuthology.orchestra.run.trial111.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-12T18:04:32.524 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T18:04:32.524 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T18:04:32.524 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:32.527 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/42 2026-02-12T18:04:32.528 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/42 2026-02-12T18:04:32.536 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-cryptography-36.0.1-5.el9.x86_64 27/42 2026-02-12T18:04:32.545 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-12T18:04:32.545 INFO:teuthology.orchestra.run.trial111.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-12T18:04:32.546 INFO:teuthology.orchestra.run.trial111.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-12T18:04:32.546 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:32.555 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-12T18:04:32.558 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/42 2026-02-12T18:04:32.578 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-12T18:04:32.579 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-12T18:04:32.579 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:32.587 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-cheroot-10.0.1-4.el9.noarch 29/42 2026-02-12T18:04:32.593 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/42 2026-02-12T18:04:32.644 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/42 2026-02-12T18:04:32.688 INFO:teuthology.orchestra.run.trial048.stdout: Installing : ceph-mgr-modules-core-2:20.3.0-5230.gafefaa40.el9. 32/42 2026-02-12T18:04:32.689 INFO:teuthology.orchestra.run.trial048.stdout: Installing : ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 33/42 2026-02-12T18:04:32.713 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 33/42 2026-02-12T18:04:32.713 INFO:teuthology.orchestra.run.trial048.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T18:04:32.713 INFO:teuthology.orchestra.run.trial048.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2026-02-12T18:04:32.713 INFO:teuthology.orchestra.run.trial048.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T18:04:32.713 INFO:teuthology.orchestra.run.trial048.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2026-02-12T18:04:32.713 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:32.717 INFO:teuthology.orchestra.run.trial048.stdout: Installing : libconfig-1.7.2-9.el9.x86_64 34/42 2026-02-12T18:04:32.734 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-12T18:04:32.735 INFO:teuthology.orchestra.run.trial048.stdout:Creating group 'libstoragemgmt' with GID 991. 2026-02-12T18:04:32.735 INFO:teuthology.orchestra.run.trial048.stdout:Creating user 'libstoragemgmt' (daemon account for libstoragemgmt) with UID 991 and GID 991. 2026-02-12T18:04:32.735 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:32.744 INFO:teuthology.orchestra.run.trial048.stdout: Installing : libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-12T18:04:32.767 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: libstoragemgmt-1.10.1-1.el9.x86_64 35/42 2026-02-12T18:04:32.767 INFO:teuthology.orchestra.run.trial048.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/libstoragemgmt.service → /usr/lib/systemd/system/libstoragemgmt.service. 2026-02-12T18:04:32.767 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:33.212 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/42 2026-02-12T18:04:33.420 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-libstoragemgmt-1.10.1-1.el9.x86_64 36/42 2026-02-12T18:04:33.969 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_6 37/42 2026-02-12T18:04:33.979 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_6 38/42 2026-02-12T18:04:33.980 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 39/42 2026-02-12T18:04:34.006 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 39/42 2026-02-12T18:04:34.006 INFO:teuthology.orchestra.run.trial111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T18:04:34.006 INFO:teuthology.orchestra.run.trial111.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-12T18:04:34.006 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T18:04:34.007 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T18:04:34.007 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:34.209 INFO:teuthology.orchestra.run.trial048.stdout: Installing : ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_6 37/42 2026-02-12T18:04:34.219 INFO:teuthology.orchestra.run.trial048.stdout: Installing : ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_6 38/42 2026-02-12T18:04:34.219 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 40/42 2026-02-12T18:04:34.220 INFO:teuthology.orchestra.run.trial048.stdout: Installing : ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 39/42 2026-02-12T18:04:34.242 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 40/42 2026-02-12T18:04:34.242 INFO:teuthology.orchestra.run.trial111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T18:04:34.242 INFO:teuthology.orchestra.run.trial111.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-12T18:04:34.242 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T18:04:34.242 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T18:04:34.242 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:34.246 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 39/42 2026-02-12T18:04:34.246 INFO:teuthology.orchestra.run.trial048.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T18:04:34.246 INFO:teuthology.orchestra.run.trial048.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2026-02-12T18:04:34.246 INFO:teuthology.orchestra.run.trial048.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T18:04:34.247 INFO:teuthology.orchestra.run.trial048.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2026-02-12T18:04:34.247 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:34.337 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 41/42 2026-02-12T18:04:34.357 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 41/42 2026-02-12T18:04:34.358 INFO:teuthology.orchestra.run.trial111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T18:04:34.358 INFO:teuthology.orchestra.run.trial111.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-12T18:04:34.358 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T18:04:34.358 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T18:04:34.358 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:34.359 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 42/42 2026-02-12T18:04:34.366 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_6 42/42 2026-02-12T18:04:34.389 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_6 42/42 2026-02-12T18:04:34.469 INFO:teuthology.orchestra.run.trial048.stdout: Installing : ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 40/42 2026-02-12T18:04:34.490 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 40/42 2026-02-12T18:04:34.490 INFO:teuthology.orchestra.run.trial048.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T18:04:34.490 INFO:teuthology.orchestra.run.trial048.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2026-02-12T18:04:34.490 INFO:teuthology.orchestra.run.trial048.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T18:04:34.491 INFO:teuthology.orchestra.run.trial048.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2026-02-12T18:04:34.491 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:34.588 INFO:teuthology.orchestra.run.trial048.stdout: Installing : ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 41/42 2026-02-12T18:04:34.608 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 41/42 2026-02-12T18:04:34.608 INFO:teuthology.orchestra.run.trial048.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T18:04:34.609 INFO:teuthology.orchestra.run.trial048.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2026-02-12T18:04:34.609 INFO:teuthology.orchestra.run.trial048.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T18:04:34.609 INFO:teuthology.orchestra.run.trial048.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2026-02-12T18:04:34.609 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:34.610 INFO:teuthology.orchestra.run.trial048.stdout: Installing : ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 42/42 2026-02-12T18:04:34.616 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_6 42/42 2026-02-12T18:04:34.642 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_6 42/42 2026-02-12T18:04:34.777 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 42/42 2026-02-12T18:04:34.777 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 1/42 2026-02-12T18:04:34.778 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 2/42 2026-02-12T18:04:34.778 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 3/42 2026-02-12T18:04:34.778 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 4/42 2026-02-12T18:04:34.778 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 5/42 2026-02-12T18:04:34.778 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_6 6/42 2026-02-12T18:04:34.778 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_6 7/42 2026-02-12T18:04:34.778 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5230.gafefaa40.el9. 8/42 2026-02-12T18:04:34.778 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 9/42 2026-02-12T18:04:34.778 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 10/42 2026-02-12T18:04:34.778 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/42 2026-02-12T18:04:34.778 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 12/42 2026-02-12T18:04:34.779 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/42 2026-02-12T18:04:34.779 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/42 2026-02-12T18:04:34.779 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 15/42 2026-02-12T18:04:34.779 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 16/42 2026-02-12T18:04:34.779 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 17/42 2026-02-12T18:04:34.779 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : unzip-6.0-59.el9.x86_64 18/42 2026-02-12T18:04:34.779 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : zip-3.0-35.el9.x86_64 19/42 2026-02-12T18:04:34.779 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 20/42 2026-02-12T18:04:34.779 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : lua-5.4.4-4.el9.x86_64 21/42 2026-02-12T18:04:34.779 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 22/42 2026-02-12T18:04:34.779 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 23/42 2026-02-12T18:04:34.779 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 24/42 2026-02-12T18:04:34.779 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 25/42 2026-02-12T18:04:34.780 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 26/42 2026-02-12T18:04:34.780 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 27/42 2026-02-12T18:04:34.780 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 28/42 2026-02-12T18:04:34.780 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 29/42 2026-02-12T18:04:34.780 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 30/42 2026-02-12T18:04:34.780 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 31/42 2026-02-12T18:04:34.780 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 32/42 2026-02-12T18:04:34.780 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 33/42 2026-02-12T18:04:34.780 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 34/42 2026-02-12T18:04:34.780 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 35/42 2026-02-12T18:04:34.780 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 36/42 2026-02-12T18:04:34.780 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 37/42 2026-02-12T18:04:34.781 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 38/42 2026-02-12T18:04:34.781 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 39/42 2026-02-12T18:04:34.781 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 40/42 2026-02-12T18:04:34.781 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 41/42 2026-02-12T18:04:34.832 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 42/42 2026-02-12T18:04:34.833 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:34.833 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T18:04:34.833 INFO:teuthology.orchestra.run.trial111.stdout: ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:34.833 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:34.833 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:34.833 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-modules-core-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T18:04:34.833 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:34.833 INFO:teuthology.orchestra.run.trial111.stdout: ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:34.833 INFO:teuthology.orchestra.run.trial111.stdout: ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:34.834 INFO:teuthology.orchestra.run.trial111.stdout: ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:34.834 INFO:teuthology.orchestra.run.trial111.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-12T18:04:34.834 INFO:teuthology.orchestra.run.trial111.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-12T18:04:34.834 INFO:teuthology.orchestra.run.trial111.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T18:04:34.834 INFO:teuthology.orchestra.run.trial111.stdout: lua-5.4.4-4.el9.x86_64 2026-02-12T18:04:34.834 INFO:teuthology.orchestra.run.trial111.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-12T18:04:34.834 INFO:teuthology.orchestra.run.trial111.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-12T18:04:34.834 INFO:teuthology.orchestra.run.trial111.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-12T18:04:34.834 INFO:teuthology.orchestra.run.trial111.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-12T18:04:34.834 INFO:teuthology.orchestra.run.trial111.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-12T18:04:34.834 INFO:teuthology.orchestra.run.trial111.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-12T18:04:34.834 INFO:teuthology.orchestra.run.trial111.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-12T18:04:34.835 INFO:teuthology.orchestra.run.trial111.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-12T18:04:34.835 INFO:teuthology.orchestra.run.trial111.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-12T18:04:34.835 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-12T18:04:34.835 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-12T18:04:34.835 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-12T18:04:34.835 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-12T18:04:34.835 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-12T18:04:34.835 INFO:teuthology.orchestra.run.trial111.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-12T18:04:34.835 INFO:teuthology.orchestra.run.trial111.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T18:04:34.835 INFO:teuthology.orchestra.run.trial111.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-12T18:04:34.835 INFO:teuthology.orchestra.run.trial111.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-12T18:04:34.835 INFO:teuthology.orchestra.run.trial111.stdout: python3-ply-3.11-14.el9.noarch 2026-02-12T18:04:34.835 INFO:teuthology.orchestra.run.trial111.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-12T18:04:34.836 INFO:teuthology.orchestra.run.trial111.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-12T18:04:34.836 INFO:teuthology.orchestra.run.trial111.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-12T18:04:34.836 INFO:teuthology.orchestra.run.trial111.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-12T18:04:34.836 INFO:teuthology.orchestra.run.trial111.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-12T18:04:34.836 INFO:teuthology.orchestra.run.trial111.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-12T18:04:34.836 INFO:teuthology.orchestra.run.trial111.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-12T18:04:34.836 INFO:teuthology.orchestra.run.trial111.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-12T18:04:34.836 INFO:teuthology.orchestra.run.trial111.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-12T18:04:34.836 INFO:teuthology.orchestra.run.trial111.stdout: unzip-6.0-59.el9.x86_64 2026-02-12T18:04:34.836 INFO:teuthology.orchestra.run.trial111.stdout: zip-3.0-35.el9.x86_64 2026-02-12T18:04:34.836 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:34.836 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:04:34.872 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-base 2026-02-12T18:04:35.013 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 42/42 2026-02-12T18:04:35.014 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 1/42 2026-02-12T18:04:35.014 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 2/42 2026-02-12T18:04:35.014 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 3/42 2026-02-12T18:04:35.014 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 4/42 2026-02-12T18:04:35.014 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 5/42 2026-02-12T18:04:35.014 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_6 6/42 2026-02-12T18:04:35.014 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_6 7/42 2026-02-12T18:04:35.014 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : ceph-mgr-modules-core-2:20.3.0-5230.gafefaa40.el9. 8/42 2026-02-12T18:04:35.014 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : ledmon-libs-1.1.0-3.el9.x86_64 9/42 2026-02-12T18:04:35.015 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : libconfig-1.7.2-9.el9.x86_64 10/42 2026-02-12T18:04:35.015 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 11/42 2026-02-12T18:04:35.015 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-cryptography-36.0.1-5.el9.x86_64 12/42 2026-02-12T18:04:35.015 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-ply-3.11-14.el9.noarch 13/42 2026-02-12T18:04:35.015 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 14/42 2026-02-12T18:04:35.015 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-pyparsing-2.4.7-9.el9.noarch 15/42 2026-02-12T18:04:35.015 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-requests-2.25.1-10.el9.noarch 16/42 2026-02-12T18:04:35.015 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-urllib3-1.26.5-7.el9.noarch 17/42 2026-02-12T18:04:35.015 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : unzip-6.0-59.el9.x86_64 18/42 2026-02-12T18:04:35.015 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : zip-3.0-35.el9.x86_64 19/42 2026-02-12T18:04:35.015 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : libstoragemgmt-1.10.1-1.el9.x86_64 20/42 2026-02-12T18:04:35.015 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : lua-5.4.4-4.el9.x86_64 21/42 2026-02-12T18:04:35.016 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-libstoragemgmt-1.10.1-1.el9.x86_64 22/42 2026-02-12T18:04:35.016 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 23/42 2026-02-12T18:04:35.016 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 24/42 2026-02-12T18:04:35.016 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 25/42 2026-02-12T18:04:35.016 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 26/42 2026-02-12T18:04:35.016 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-autocommand-2.2.2-8.el9.noarch 27/42 2026-02-12T18:04:35.016 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-backports-tarfile-1.2.0-1.el9.noarch 28/42 2026-02-12T18:04:35.016 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 29/42 2026-02-12T18:04:35.016 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-cheroot-10.0.1-4.el9.noarch 30/42 2026-02-12T18:04:35.016 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 31/42 2026-02-12T18:04:35.016 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 32/42 2026-02-12T18:04:35.016 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 33/42 2026-02-12T18:04:35.016 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 34/42 2026-02-12T18:04:35.017 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-jaraco-context-6.0.1-3.el9.noarch 35/42 2026-02-12T18:04:35.017 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 36/42 2026-02-12T18:04:35.017 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-jaraco-text-4.0.0-2.el9.noarch 37/42 2026-02-12T18:04:35.017 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 38/42 2026-02-12T18:04:35.017 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 39/42 2026-02-12T18:04:35.017 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 40/42 2026-02-12T18:04:35.017 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 41/42 2026-02-12T18:04:35.069 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 42/42 2026-02-12T18:04:35.069 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:35.069 INFO:teuthology.orchestra.run.trial048.stdout:Installed: 2026-02-12T18:04:35.069 INFO:teuthology.orchestra.run.trial048.stdout: ceph-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:35.069 INFO:teuthology.orchestra.run.trial048.stdout: ceph-mds-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:35.069 INFO:teuthology.orchestra.run.trial048.stdout: ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:35.069 INFO:teuthology.orchestra.run.trial048.stdout: ceph-mgr-modules-core-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T18:04:35.069 INFO:teuthology.orchestra.run.trial048.stdout: ceph-mon-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:35.069 INFO:teuthology.orchestra.run.trial048.stdout: ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:35.069 INFO:teuthology.orchestra.run.trial048.stdout: ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:35.070 INFO:teuthology.orchestra.run.trial048.stdout: ceph-osd-crimson-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:35.070 INFO:teuthology.orchestra.run.trial048.stdout: ledmon-libs-1.1.0-3.el9.x86_64 2026-02-12T18:04:35.070 INFO:teuthology.orchestra.run.trial048.stdout: libconfig-1.7.2-9.el9.x86_64 2026-02-12T18:04:35.070 INFO:teuthology.orchestra.run.trial048.stdout: libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T18:04:35.070 INFO:teuthology.orchestra.run.trial048.stdout: lua-5.4.4-4.el9.x86_64 2026-02-12T18:04:35.070 INFO:teuthology.orchestra.run.trial048.stdout: lua-devel-5.4.4-4.el9.x86_64 2026-02-12T18:04:35.070 INFO:teuthology.orchestra.run.trial048.stdout: luarocks-3.9.2-5.el9.noarch 2026-02-12T18:04:35.070 INFO:teuthology.orchestra.run.trial048.stdout: python3-autocommand-2.2.2-8.el9.noarch 2026-02-12T18:04:35.070 INFO:teuthology.orchestra.run.trial048.stdout: python3-backports-tarfile-1.2.0-1.el9.noarch 2026-02-12T18:04:35.070 INFO:teuthology.orchestra.run.trial048.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2026-02-12T18:04:35.070 INFO:teuthology.orchestra.run.trial048.stdout: python3-cffi-1.14.5-5.el9.x86_64 2026-02-12T18:04:35.070 INFO:teuthology.orchestra.run.trial048.stdout: python3-cheroot-10.0.1-4.el9.noarch 2026-02-12T18:04:35.071 INFO:teuthology.orchestra.run.trial048.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2026-02-12T18:04:35.071 INFO:teuthology.orchestra.run.trial048.stdout: python3-cryptography-36.0.1-5.el9.x86_64 2026-02-12T18:04:35.071 INFO:teuthology.orchestra.run.trial048.stdout: python3-jaraco-8.2.1-3.el9.noarch 2026-02-12T18:04:35.071 INFO:teuthology.orchestra.run.trial048.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2026-02-12T18:04:35.071 INFO:teuthology.orchestra.run.trial048.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2026-02-12T18:04:35.071 INFO:teuthology.orchestra.run.trial048.stdout: python3-jaraco-context-6.0.1-3.el9.noarch 2026-02-12T18:04:35.071 INFO:teuthology.orchestra.run.trial048.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2026-02-12T18:04:35.071 INFO:teuthology.orchestra.run.trial048.stdout: python3-jaraco-text-4.0.0-2.el9.noarch 2026-02-12T18:04:35.071 INFO:teuthology.orchestra.run.trial048.stdout: python3-libstoragemgmt-1.10.1-1.el9.x86_64 2026-02-12T18:04:35.071 INFO:teuthology.orchestra.run.trial048.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2026-02-12T18:04:35.071 INFO:teuthology.orchestra.run.trial048.stdout: python3-packaging-20.9-5.el9.noarch 2026-02-12T18:04:35.071 INFO:teuthology.orchestra.run.trial048.stdout: python3-ply-3.11-14.el9.noarch 2026-02-12T18:04:35.071 INFO:teuthology.orchestra.run.trial048.stdout: python3-portend-3.1.0-2.el9.noarch 2026-02-12T18:04:35.072 INFO:teuthology.orchestra.run.trial048.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2026-02-12T18:04:35.072 INFO:teuthology.orchestra.run.trial048.stdout: python3-pycparser-2.20-6.el9.noarch 2026-02-12T18:04:35.072 INFO:teuthology.orchestra.run.trial048.stdout: python3-pyparsing-2.4.7-9.el9.noarch 2026-02-12T18:04:35.072 INFO:teuthology.orchestra.run.trial048.stdout: python3-requests-2.25.1-10.el9.noarch 2026-02-12T18:04:35.072 INFO:teuthology.orchestra.run.trial048.stdout: python3-tempora-5.0.0-2.el9.noarch 2026-02-12T18:04:35.072 INFO:teuthology.orchestra.run.trial048.stdout: python3-toml-0.10.2-6.el9.noarch 2026-02-12T18:04:35.072 INFO:teuthology.orchestra.run.trial048.stdout: python3-urllib3-1.26.5-7.el9.noarch 2026-02-12T18:04:35.072 INFO:teuthology.orchestra.run.trial048.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2026-02-12T18:04:35.072 INFO:teuthology.orchestra.run.trial048.stdout: unzip-6.0-59.el9.x86_64 2026-02-12T18:04:35.072 INFO:teuthology.orchestra.run.trial048.stdout: zip-3.0-35.el9.x86_64 2026-02-12T18:04:35.072 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:35.072 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:04:35.109 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install ceph-base 2026-02-12T18:04:35.176 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:27 ago on Thu 12 Feb 2026 06:04:08 PM UTC. 2026-02-12T18:04:35.241 INFO:teuthology.orchestra.run.trial111.stdout:Package ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T18:04:35.258 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:04:35.259 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T18:04:35.259 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:04:35.281 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install cephadm 2026-02-12T18:04:35.414 INFO:teuthology.orchestra.run.trial048.stdout:Last metadata expiration check: 0:00:29 ago on Thu 12 Feb 2026 06:04:06 PM UTC. 2026-02-12T18:04:35.480 INFO:teuthology.orchestra.run.trial048.stdout:Package ceph-base-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T18:04:35.498 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:04:35.499 INFO:teuthology.orchestra.run.trial048.stdout:Nothing to do. 2026-02-12T18:04:35.499 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:04:35.520 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install cephadm 2026-02-12T18:04:35.568 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:27 ago on Thu 12 Feb 2026 06:04:08 PM UTC. 2026-02-12T18:04:35.650 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:04:35.651 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:04:35.651 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repository Size 2026-02-12T18:04:35.651 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:04:35.651 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T18:04:35.651 INFO:teuthology.orchestra.run.trial111.stdout: cephadm noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 1.0 M 2026-02-12T18:04:35.651 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:35.652 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T18:04:35.652 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:04:35.652 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T18:04:35.652 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:35.652 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 1.0 M 2026-02-12T18:04:35.652 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 1.0 M 2026-02-12T18:04:35.652 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T18:04:35.772 INFO:teuthology.orchestra.run.trial111.stdout:cephadm-20.3.0-5230.gafefaa40.el9.noarch.rpm 8.4 MB/s | 1.0 MB 00:00 2026-02-12T18:04:35.772 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:04:35.772 INFO:teuthology.orchestra.run.trial111.stdout:Total 8.4 MB/s | 1.0 MB 00:00 2026-02-12T18:04:35.773 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T18:04:35.775 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T18:04:35.775 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T18:04:35.779 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T18:04:35.779 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T18:04:35.797 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T18:04:35.814 INFO:teuthology.orchestra.run.trial048.stdout:Last metadata expiration check: 0:00:29 ago on Thu 12 Feb 2026 06:04:06 PM UTC. 2026-02-12T18:04:35.857 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-12T18:04:35.871 INFO:teuthology.orchestra.run.trial111.stdout: Installing : cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-12T18:04:35.897 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:04:35.898 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:04:35.898 INFO:teuthology.orchestra.run.trial048.stdout: Package Arch Version Repository Size 2026-02-12T18:04:35.898 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:04:35.898 INFO:teuthology.orchestra.run.trial048.stdout:Installing: 2026-02-12T18:04:35.898 INFO:teuthology.orchestra.run.trial048.stdout: cephadm noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 1.0 M 2026-02-12T18:04:35.898 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:35.898 INFO:teuthology.orchestra.run.trial048.stdout:Transaction Summary 2026-02-12T18:04:35.898 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:04:35.898 INFO:teuthology.orchestra.run.trial048.stdout:Install 1 Package 2026-02-12T18:04:35.898 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:35.899 INFO:teuthology.orchestra.run.trial048.stdout:Total download size: 1.0 M 2026-02-12T18:04:35.899 INFO:teuthology.orchestra.run.trial048.stdout:Installed size: 1.0 M 2026-02-12T18:04:35.899 INFO:teuthology.orchestra.run.trial048.stdout:Downloading Packages: 2026-02-12T18:04:35.930 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-12T18:04:35.983 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-12T18:04:35.983 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:35.983 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T18:04:35.983 INFO:teuthology.orchestra.run.trial111.stdout: cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T18:04:35.984 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:35.984 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:04:36.010 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-immutable-object-cache 2026-02-12T18:04:36.018 INFO:teuthology.orchestra.run.trial048.stdout:cephadm-20.3.0-5230.gafefaa40.el9.noarch.rpm 8.4 MB/s | 1.0 MB 00:00 2026-02-12T18:04:36.019 INFO:teuthology.orchestra.run.trial048.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:04:36.019 INFO:teuthology.orchestra.run.trial048.stdout:Total 8.4 MB/s | 1.0 MB 00:00 2026-02-12T18:04:36.019 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction check 2026-02-12T18:04:36.021 INFO:teuthology.orchestra.run.trial048.stdout:Transaction check succeeded. 2026-02-12T18:04:36.021 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction test 2026-02-12T18:04:36.026 INFO:teuthology.orchestra.run.trial048.stdout:Transaction test succeeded. 2026-02-12T18:04:36.026 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction 2026-02-12T18:04:36.044 INFO:teuthology.orchestra.run.trial048.stdout: Preparing : 1/1 2026-02-12T18:04:36.107 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-12T18:04:36.121 INFO:teuthology.orchestra.run.trial048.stdout: Installing : cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-12T18:04:36.183 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-12T18:04:36.237 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/1 2026-02-12T18:04:36.237 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:36.237 INFO:teuthology.orchestra.run.trial048.stdout:Installed: 2026-02-12T18:04:36.237 INFO:teuthology.orchestra.run.trial048.stdout: cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T18:04:36.237 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:36.237 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:04:36.264 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install ceph-immutable-object-cache 2026-02-12T18:04:36.313 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:28 ago on Thu 12 Feb 2026 06:04:08 PM UTC. 2026-02-12T18:04:36.395 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:04:36.396 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:04:36.396 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T18:04:36.397 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:04:36.397 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T18:04:36.397 INFO:teuthology.orchestra.run.trial111.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 147 k 2026-02-12T18:04:36.397 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:36.397 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T18:04:36.397 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:04:36.397 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T18:04:36.397 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:36.397 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 147 k 2026-02-12T18:04:36.397 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 419 k 2026-02-12T18:04:36.397 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T18:04:36.481 INFO:teuthology.orchestra.run.trial111.stdout:ceph-immutable-object-cache-20.3.0-5230.gafefaa 1.7 MB/s | 147 kB 00:00 2026-02-12T18:04:36.482 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:04:36.482 INFO:teuthology.orchestra.run.trial111.stdout:Total 1.7 MB/s | 147 kB 00:00 2026-02-12T18:04:36.482 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T18:04:36.486 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T18:04:36.486 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T18:04:36.513 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T18:04:36.513 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T18:04:36.561 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T18:04:36.563 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40. 1/1 2026-02-12T18:04:36.578 INFO:teuthology.orchestra.run.trial048.stdout:Last metadata expiration check: 0:00:30 ago on Thu 12 Feb 2026 06:04:06 PM UTC. 2026-02-12T18:04:36.587 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40. 1/1 2026-02-12T18:04:36.587 INFO:teuthology.orchestra.run.trial111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T18:04:36.587 INFO:teuthology.orchestra.run.trial111.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-12T18:04:36.587 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:36.662 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:04:36.662 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:04:36.662 INFO:teuthology.orchestra.run.trial048.stdout: Package Arch Version Repo Size 2026-02-12T18:04:36.663 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:04:36.663 INFO:teuthology.orchestra.run.trial048.stdout:Installing: 2026-02-12T18:04:36.663 INFO:teuthology.orchestra.run.trial048.stdout: ceph-immutable-object-cache x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 147 k 2026-02-12T18:04:36.663 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:36.663 INFO:teuthology.orchestra.run.trial048.stdout:Transaction Summary 2026-02-12T18:04:36.663 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:04:36.663 INFO:teuthology.orchestra.run.trial048.stdout:Install 1 Package 2026-02-12T18:04:36.663 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:36.663 INFO:teuthology.orchestra.run.trial048.stdout:Total download size: 147 k 2026-02-12T18:04:36.663 INFO:teuthology.orchestra.run.trial048.stdout:Installed size: 419 k 2026-02-12T18:04:36.664 INFO:teuthology.orchestra.run.trial048.stdout:Downloading Packages: 2026-02-12T18:04:36.749 INFO:teuthology.orchestra.run.trial048.stdout:ceph-immutable-object-cache-20.3.0-5230.gafefaa 1.7 MB/s | 147 kB 00:00 2026-02-12T18:04:36.749 INFO:teuthology.orchestra.run.trial048.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:04:36.749 INFO:teuthology.orchestra.run.trial048.stdout:Total 1.7 MB/s | 147 kB 00:00 2026-02-12T18:04:36.750 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction check 2026-02-12T18:04:36.753 INFO:teuthology.orchestra.run.trial048.stdout:Transaction check succeeded. 2026-02-12T18:04:36.754 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction test 2026-02-12T18:04:36.780 INFO:teuthology.orchestra.run.trial048.stdout:Transaction test succeeded. 2026-02-12T18:04:36.780 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction 2026-02-12T18:04:36.828 INFO:teuthology.orchestra.run.trial048.stdout: Preparing : 1/1 2026-02-12T18:04:36.830 INFO:teuthology.orchestra.run.trial048.stdout: Installing : ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40. 1/1 2026-02-12T18:04:36.853 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40. 1/1 2026-02-12T18:04:36.853 INFO:teuthology.orchestra.run.trial048.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T18:04:36.853 INFO:teuthology.orchestra.run.trial048.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2026-02-12T18:04:36.853 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:36.893 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40. 1/1 2026-02-12T18:04:36.893 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:36.894 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T18:04:36.894 INFO:teuthology.orchestra.run.trial111.stdout: ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:36.894 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:36.894 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:04:36.925 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-mgr 2026-02-12T18:04:37.134 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40. 1/1 2026-02-12T18:04:37.135 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:37.135 INFO:teuthology.orchestra.run.trial048.stdout:Installed: 2026-02-12T18:04:37.135 INFO:teuthology.orchestra.run.trial048.stdout: ceph-immutable-object-cache-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:04:37.135 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:37.135 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:04:37.164 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install ceph-mgr 2026-02-12T18:04:37.229 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:29 ago on Thu 12 Feb 2026 06:04:08 PM UTC. 2026-02-12T18:04:37.293 INFO:teuthology.orchestra.run.trial111.stdout:Package ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T18:04:37.310 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:04:37.311 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T18:04:37.311 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:04:37.333 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-mgr-dashboard 2026-02-12T18:04:37.467 INFO:teuthology.orchestra.run.trial048.stdout:Last metadata expiration check: 0:00:31 ago on Thu 12 Feb 2026 06:04:06 PM UTC. 2026-02-12T18:04:37.530 INFO:teuthology.orchestra.run.trial048.stdout:Package ceph-mgr-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T18:04:37.548 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:04:37.549 INFO:teuthology.orchestra.run.trial048.stdout:Nothing to do. 2026-02-12T18:04:37.549 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:04:37.570 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install ceph-mgr-dashboard 2026-02-12T18:04:37.625 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:29 ago on Thu 12 Feb 2026 06:04:08 PM UTC. 2026-02-12T18:04:37.708 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:04:37.708 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:04:37.709 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repository Size 2026-02-12T18:04:37.709 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:04:37.709 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T18:04:37.709 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 51 M 2026-02-12T18:04:37.709 INFO:teuthology.orchestra.run.trial111.stdout:Installing dependencies: 2026-02-12T18:04:37.709 INFO:teuthology.orchestra.run.trial111.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-12T18:04:37.709 INFO:teuthology.orchestra.run.trial111.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 57 k 2026-02-12T18:04:37.709 INFO:teuthology.orchestra.run.trial111.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 17 k 2026-02-12T18:04:37.709 INFO:teuthology.orchestra.run.trial111.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-12T18:04:37.709 INFO:teuthology.orchestra.run.trial111.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-12T18:04:37.710 INFO:teuthology.orchestra.run.trial111.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-12T18:04:37.710 INFO:teuthology.orchestra.run.trial111.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-12T18:04:37.710 INFO:teuthology.orchestra.run.trial111.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-12T18:04:37.710 INFO:teuthology.orchestra.run.trial111.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-12T18:04:37.710 INFO:teuthology.orchestra.run.trial111.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-12T18:04:37.710 INFO:teuthology.orchestra.run.trial111.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-12T18:04:37.710 INFO:teuthology.orchestra.run.trial111.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-12T18:04:37.710 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:37.710 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T18:04:37.710 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:04:37.710 INFO:teuthology.orchestra.run.trial111.stdout:Install 13 Packages 2026-02-12T18:04:37.710 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:37.711 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 55 M 2026-02-12T18:04:37.711 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 262 M 2026-02-12T18:04:37.711 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T18:04:37.867 INFO:teuthology.orchestra.run.trial048.stdout:Last metadata expiration check: 0:00:31 ago on Thu 12 Feb 2026 06:04:06 PM UTC. 2026-02-12T18:04:37.949 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:04:37.950 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:04:37.950 INFO:teuthology.orchestra.run.trial048.stdout: Package Arch Version Repository Size 2026-02-12T18:04:37.950 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:04:37.950 INFO:teuthology.orchestra.run.trial048.stdout:Installing: 2026-02-12T18:04:37.950 INFO:teuthology.orchestra.run.trial048.stdout: ceph-mgr-dashboard noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 51 M 2026-02-12T18:04:37.950 INFO:teuthology.orchestra.run.trial048.stdout:Installing dependencies: 2026-02-12T18:04:37.950 INFO:teuthology.orchestra.run.trial048.stdout: abseil-cpp x86_64 20211102.0-4.el9 epel 551 k 2026-02-12T18:04:37.951 INFO:teuthology.orchestra.run.trial048.stdout: ceph-grafana-dashboards noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 57 k 2026-02-12T18:04:37.951 INFO:teuthology.orchestra.run.trial048.stdout: ceph-prometheus-alerts noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 17 k 2026-02-12T18:04:37.951 INFO:teuthology.orchestra.run.trial048.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2026-02-12T18:04:37.951 INFO:teuthology.orchestra.run.trial048.stdout: protobuf-compiler x86_64 3.14.0-17.el9 crb 862 k 2026-02-12T18:04:37.951 INFO:teuthology.orchestra.run.trial048.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2026-02-12T18:04:37.951 INFO:teuthology.orchestra.run.trial048.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2026-02-12T18:04:37.951 INFO:teuthology.orchestra.run.trial048.stdout: python3-jmespath noarch 1.0.1-1.el9 appstream 48 k 2026-02-12T18:04:37.951 INFO:teuthology.orchestra.run.trial048.stdout: python3-protobuf noarch 3.14.0-17.el9 appstream 267 k 2026-02-12T18:04:37.951 INFO:teuthology.orchestra.run.trial048.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2026-02-12T18:04:37.951 INFO:teuthology.orchestra.run.trial048.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2026-02-12T18:04:37.951 INFO:teuthology.orchestra.run.trial048.stdout: python3-xmltodict noarch 0.12.0-15.el9 epel 22 k 2026-02-12T18:04:37.951 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:37.951 INFO:teuthology.orchestra.run.trial048.stdout:Transaction Summary 2026-02-12T18:04:37.952 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:04:37.952 INFO:teuthology.orchestra.run.trial048.stdout:Install 13 Packages 2026-02-12T18:04:37.952 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:37.952 INFO:teuthology.orchestra.run.trial048.stdout:Total download size: 55 M 2026-02-12T18:04:37.953 INFO:teuthology.orchestra.run.trial048.stdout:Installed size: 262 M 2026-02-12T18:04:37.953 INFO:teuthology.orchestra.run.trial048.stdout:Downloading Packages: 2026-02-12T18:04:38.266 INFO:teuthology.orchestra.run.trial111.stdout:(1/13): ceph-prometheus-alerts-20.3.0-5230.gafe 283 kB/s | 17 kB 00:00 2026-02-12T18:04:38.280 INFO:teuthology.orchestra.run.trial111.stdout:(2/13): ceph-grafana-dashboards-20.3.0-5230.gaf 762 kB/s | 57 kB 00:00 2026-02-12T18:04:38.678 INFO:teuthology.orchestra.run.trial048.stdout:(1/13): ceph-prometheus-alerts-20.3.0-5230.gafe 69 kB/s | 17 kB 00:00 2026-02-12T18:04:38.724 INFO:teuthology.orchestra.run.trial048.stdout:(2/13): ceph-grafana-dashboards-20.3.0-5230.gaf 192 kB/s | 57 kB 00:00 2026-02-12T18:04:38.776 INFO:teuthology.orchestra.run.trial048.stdout:(3/13): python3-jmespath-1.0.1-1.el9.noarch.rpm 487 kB/s | 48 kB 00:00 2026-02-12T18:04:38.838 INFO:teuthology.orchestra.run.trial048.stdout:(4/13): python3-protobuf-3.14.0-17.el9.noarch.r 2.3 MB/s | 267 kB 00:00 2026-02-12T18:04:38.868 INFO:teuthology.orchestra.run.trial111.stdout:(3/13): python3-jmespath-1.0.1-1.el9.noarch.rpm 79 kB/s | 48 kB 00:00 2026-02-12T18:04:38.942 INFO:teuthology.orchestra.run.trial111.stdout:(4/13): protobuf-compiler-3.14.0-17.el9.x86_64. 12 MB/s | 862 kB 00:00 2026-02-12T18:04:39.116 INFO:teuthology.orchestra.run.trial111.stdout:(5/13): python3-protobuf-3.14.0-17.el9.noarch.r 320 kB/s | 267 kB 00:00 2026-02-12T18:04:39.254 INFO:teuthology.orchestra.run.trial111.stdout:(6/13): ceph-mgr-dashboard-20.3.0-5230.gafefaa4 48 MB/s | 51 MB 00:01 2026-02-12T18:04:39.371 INFO:teuthology.orchestra.run.trial048.stdout:(5/13): protobuf-compiler-3.14.0-17.el9.x86_64. 1.4 MB/s | 862 kB 00:00 2026-02-12T18:04:39.487 INFO:teuthology.orchestra.run.trial048.stdout:(6/13): abseil-cpp-20211102.0-4.el9.x86_64.rpm 849 kB/s | 551 kB 00:00 2026-02-12T18:04:39.490 INFO:teuthology.orchestra.run.trial048.stdout:(7/13): grpc-data-1.46.7-10.el9.noarch.rpm 162 kB/s | 19 kB 00:00 2026-02-12T18:04:39.611 INFO:teuthology.orchestra.run.trial111.stdout:(7/13): grpc-data-1.46.7-10.el9.noarch.rpm 39 kB/s | 19 kB 00:00 2026-02-12T18:04:39.774 INFO:teuthology.orchestra.run.trial048.stdout:(8/13): python3-grpcio-1.46.7-10.el9.x86_64.rpm 7.1 MB/s | 2.0 MB 00:00 2026-02-12T18:04:39.777 INFO:teuthology.orchestra.run.trial048.stdout:(9/13): python3-grpcio-tools-1.46.7-10.el9.x86_ 504 kB/s | 144 kB 00:00 2026-02-12T18:04:39.851 INFO:teuthology.orchestra.run.trial048.stdout:(10/13): python3-repoze-lru-0.7-16.el9.noarch.r 397 kB/s | 31 kB 00:00 2026-02-12T18:04:39.859 INFO:teuthology.orchestra.run.trial048.stdout:(11/13): python3-routes-2.5.1-5.el9.noarch.rpm 2.3 MB/s | 188 kB 00:00 2026-02-12T18:04:39.937 INFO:teuthology.orchestra.run.trial111.stdout:(8/13): python3-grpcio-tools-1.46.7-10.el9.x86_ 443 kB/s | 144 kB 00:00 2026-02-12T18:04:39.939 INFO:teuthology.orchestra.run.trial048.stdout:(12/13): python3-xmltodict-0.12.0-15.el9.noarch 251 kB/s | 22 kB 00:00 2026-02-12T18:04:39.975 INFO:teuthology.orchestra.run.trial111.stdout:(9/13): abseil-cpp-20211102.0-4.el9.x86_64.rpm 534 kB/s | 551 kB 00:01 2026-02-12T18:04:40.023 INFO:teuthology.orchestra.run.trial111.stdout:(10/13): python3-repoze-lru-0.7-16.el9.noarch.r 357 kB/s | 31 kB 00:00 2026-02-12T18:04:40.106 INFO:teuthology.orchestra.run.trial111.stdout:(11/13): python3-xmltodict-0.12.0-15.el9.noarch 268 kB/s | 22 kB 00:00 2026-02-12T18:04:40.217 INFO:teuthology.orchestra.run.trial111.stdout:(12/13): python3-routes-2.5.1-5.el9.noarch.rpm 779 kB/s | 188 kB 00:00 2026-02-12T18:04:40.337 INFO:teuthology.orchestra.run.trial048.stdout:(13/13): ceph-mgr-dashboard-20.3.0-5230.gafefaa 26 MB/s | 51 MB 00:01 2026-02-12T18:04:40.340 INFO:teuthology.orchestra.run.trial048.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:04:40.340 INFO:teuthology.orchestra.run.trial048.stdout:Total 23 MB/s | 55 MB 00:02 2026-02-12T18:04:40.367 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction check 2026-02-12T18:04:40.377 INFO:teuthology.orchestra.run.trial048.stdout:Transaction check succeeded. 2026-02-12T18:04:40.377 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction test 2026-02-12T18:04:40.590 INFO:teuthology.orchestra.run.trial048.stdout:Transaction test succeeded. 2026-02-12T18:04:40.590 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction 2026-02-12T18:04:40.817 INFO:teuthology.orchestra.run.trial048.stdout: Preparing : 1/1 2026-02-12T18:04:40.822 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 1/13 2026-02-12T18:04:40.834 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 2/13 2026-02-12T18:04:40.836 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 3/13 2026-02-12T18:04:40.863 INFO:teuthology.orchestra.run.trial048.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 4/13 2026-02-12T18:04:40.905 INFO:teuthology.orchestra.run.trial048.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 5/13 2026-02-12T18:04:40.915 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 6/13 2026-02-12T18:04:40.942 INFO:teuthology.orchestra.run.trial048.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 7/13 2026-02-12T18:04:40.952 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 8/13 2026-02-12T18:04:40.959 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/13 2026-02-12T18:04:40.961 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 10/13 2026-02-12T18:04:40.971 INFO:teuthology.orchestra.run.trial048.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5230.gafefaa40.el9 11/13 2026-02-12T18:04:43.070 INFO:teuthology.orchestra.run.trial111.stdout:(13/13): python3-grpcio-1.46.7-10.el9.x86_64.rp 547 kB/s | 2.0 MB 00:03 2026-02-12T18:04:43.074 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:04:43.074 INFO:teuthology.orchestra.run.trial111.stdout:Total 10 MB/s | 55 MB 00:05 2026-02-12T18:04:43.103 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T18:04:43.112 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T18:04:43.112 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T18:04:43.324 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T18:04:43.324 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T18:04:43.551 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T18:04:43.556 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-xmltodict-0.12.0-15.el9.noarch 1/13 2026-02-12T18:04:43.567 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 2/13 2026-02-12T18:04:43.569 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 3/13 2026-02-12T18:04:43.597 INFO:teuthology.orchestra.run.trial111.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 4/13 2026-02-12T18:04:43.639 INFO:teuthology.orchestra.run.trial111.stdout: Installing : abseil-cpp-20211102.0-4.el9.x86_64 5/13 2026-02-12T18:04:43.649 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 6/13 2026-02-12T18:04:43.677 INFO:teuthology.orchestra.run.trial111.stdout: Installing : protobuf-compiler-3.14.0-17.el9.x86_64 7/13 2026-02-12T18:04:43.686 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-protobuf-3.14.0-17.el9.noarch 8/13 2026-02-12T18:04:43.693 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/13 2026-02-12T18:04:43.696 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-jmespath-1.0.1-1.el9.noarch 10/13 2026-02-12T18:04:43.705 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-prometheus-alerts-2:20.3.0-5230.gafefaa40.el9 11/13 2026-02-12T18:04:43.832 INFO:teuthology.orchestra.run.trial048.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5230.gafefaa40.el 12/13 2026-02-12T18:04:43.839 INFO:teuthology.orchestra.run.trial048.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noa 13/13 2026-02-12T18:04:44.101 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noa 13/13 2026-02-12T18:04:44.101 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5230.gafefaa40.el 1/13 2026-02-12T18:04:44.101 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noa 2/13 2026-02-12T18:04:44.101 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5230.gafefaa40.el9 3/13 2026-02-12T18:04:44.101 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 4/13 2026-02-12T18:04:44.101 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 5/13 2026-02-12T18:04:44.101 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 6/13 2026-02-12T18:04:44.102 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 7/13 2026-02-12T18:04:44.102 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/13 2026-02-12T18:04:44.102 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/13 2026-02-12T18:04:44.102 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/13 2026-02-12T18:04:44.102 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/13 2026-02-12T18:04:44.102 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/13 2026-02-12T18:04:44.154 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 13/13 2026-02-12T18:04:44.155 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:44.155 INFO:teuthology.orchestra.run.trial048.stdout:Installed: 2026-02-12T18:04:44.155 INFO:teuthology.orchestra.run.trial048.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-12T18:04:44.155 INFO:teuthology.orchestra.run.trial048.stdout: ceph-grafana-dashboards-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T18:04:44.155 INFO:teuthology.orchestra.run.trial048.stdout: ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T18:04:44.155 INFO:teuthology.orchestra.run.trial048.stdout: ceph-prometheus-alerts-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T18:04:44.155 INFO:teuthology.orchestra.run.trial048.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-12T18:04:44.155 INFO:teuthology.orchestra.run.trial048.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-12T18:04:44.155 INFO:teuthology.orchestra.run.trial048.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-12T18:04:44.155 INFO:teuthology.orchestra.run.trial048.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-12T18:04:44.156 INFO:teuthology.orchestra.run.trial048.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-12T18:04:44.156 INFO:teuthology.orchestra.run.trial048.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-12T18:04:44.156 INFO:teuthology.orchestra.run.trial048.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-12T18:04:44.156 INFO:teuthology.orchestra.run.trial048.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-12T18:04:44.156 INFO:teuthology.orchestra.run.trial048.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-12T18:04:44.156 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:44.156 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:04:44.192 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-12T18:04:44.498 INFO:teuthology.orchestra.run.trial048.stdout:Last metadata expiration check: 0:00:38 ago on Thu 12 Feb 2026 06:04:06 PM UTC. 2026-02-12T18:04:44.582 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:04:44.584 INFO:teuthology.orchestra.run.trial048.stdout:======================================================================================= 2026-02-12T18:04:44.584 INFO:teuthology.orchestra.run.trial048.stdout: Package Arch Version Repository Size 2026-02-12T18:04:44.584 INFO:teuthology.orchestra.run.trial048.stdout:======================================================================================= 2026-02-12T18:04:44.584 INFO:teuthology.orchestra.run.trial048.stdout:Installing: 2026-02-12T18:04:44.584 INFO:teuthology.orchestra.run.trial048.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 7.4 M 2026-02-12T18:04:44.584 INFO:teuthology.orchestra.run.trial048.stdout:Installing dependencies: 2026-02-12T18:04:44.585 INFO:teuthology.orchestra.run.trial048.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-12T18:04:44.585 INFO:teuthology.orchestra.run.trial048.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-12T18:04:44.585 INFO:teuthology.orchestra.run.trial048.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-12T18:04:44.585 INFO:teuthology.orchestra.run.trial048.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-12T18:04:44.585 INFO:teuthology.orchestra.run.trial048.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-12T18:04:44.585 INFO:teuthology.orchestra.run.trial048.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-12T18:04:44.585 INFO:teuthology.orchestra.run.trial048.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-12T18:04:44.585 INFO:teuthology.orchestra.run.trial048.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-12T18:04:44.585 INFO:teuthology.orchestra.run.trial048.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-12T18:04:44.585 INFO:teuthology.orchestra.run.trial048.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-12T18:04:44.585 INFO:teuthology.orchestra.run.trial048.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-12T18:04:44.585 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:44.585 INFO:teuthology.orchestra.run.trial048.stdout:Transaction Summary 2026-02-12T18:04:44.586 INFO:teuthology.orchestra.run.trial048.stdout:======================================================================================= 2026-02-12T18:04:44.586 INFO:teuthology.orchestra.run.trial048.stdout:Install 12 Packages 2026-02-12T18:04:44.586 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:04:44.586 INFO:teuthology.orchestra.run.trial048.stdout:Total download size: 43 M 2026-02-12T18:04:44.586 INFO:teuthology.orchestra.run.trial048.stdout:Installed size: 234 M 2026-02-12T18:04:44.586 INFO:teuthology.orchestra.run.trial048.stdout:Downloading Packages: 2026-02-12T18:04:44.819 INFO:teuthology.orchestra.run.trial048.stdout:(1/12): libquadmath-11.5.0-14.el9.x86_64.rpm 2.0 MB/s | 184 kB 00:00 2026-02-12T18:04:44.859 INFO:teuthology.orchestra.run.trial048.stdout:(2/12): libgfortran-11.5.0-14.el9.x86_64.rpm 6.0 MB/s | 794 kB 00:00 2026-02-12T18:04:44.968 INFO:teuthology.orchestra.run.trial048.stdout:(3/12): ceph-mgr-diskprediction-local-20.3.0-52 31 MB/s | 7.4 MB 00:00 2026-02-12T18:04:45.300 INFO:teuthology.orchestra.run.trial048.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 68 kB/s | 33 kB 00:00 2026-02-12T18:04:45.384 INFO:teuthology.orchestra.run.trial048.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 44 kB/s | 18 kB 00:00 2026-02-12T18:04:45.399 INFO:teuthology.orchestra.run.trial048.stdout:(6/12): openblas-0.3.29-1.el9.x86_64.rpm 423 kB/s | 42 kB 00:00 2026-02-12T18:04:45.732 INFO:teuthology.orchestra.run.trial048.stdout:(7/12): python3-devel-3.9.25-2.el9.x86_64.rpm 735 kB/s | 244 kB 00:00 2026-02-12T18:04:46.610 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-grafana-dashboards-2:20.3.0-5230.gafefaa40.el 12/13 2026-02-12T18:04:46.616 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noa 13/13 2026-02-12T18:04:46.883 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noa 13/13 2026-02-12T18:04:46.883 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-grafana-dashboards-2:20.3.0-5230.gafefaa40.el 1/13 2026-02-12T18:04:46.883 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noa 2/13 2026-02-12T18:04:46.883 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-prometheus-alerts-2:20.3.0-5230.gafefaa40.el9 3/13 2026-02-12T18:04:46.883 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-jmespath-1.0.1-1.el9.noarch 4/13 2026-02-12T18:04:46.884 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-protobuf-3.14.0-17.el9.noarch 5/13 2026-02-12T18:04:46.884 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : protobuf-compiler-3.14.0-17.el9.x86_64 6/13 2026-02-12T18:04:46.884 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : abseil-cpp-20211102.0-4.el9.x86_64 7/13 2026-02-12T18:04:46.884 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/13 2026-02-12T18:04:46.884 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/13 2026-02-12T18:04:46.884 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/13 2026-02-12T18:04:46.884 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/13 2026-02-12T18:04:46.884 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/13 2026-02-12T18:04:46.936 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-xmltodict-0.12.0-15.el9.noarch 13/13 2026-02-12T18:04:46.937 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:46.937 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T18:04:46.937 INFO:teuthology.orchestra.run.trial111.stdout: abseil-cpp-20211102.0-4.el9.x86_64 2026-02-12T18:04:46.937 INFO:teuthology.orchestra.run.trial111.stdout: ceph-grafana-dashboards-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T18:04:46.937 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-dashboard-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T18:04:46.937 INFO:teuthology.orchestra.run.trial111.stdout: ceph-prometheus-alerts-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T18:04:46.937 INFO:teuthology.orchestra.run.trial111.stdout: grpc-data-1.46.7-10.el9.noarch 2026-02-12T18:04:46.937 INFO:teuthology.orchestra.run.trial111.stdout: protobuf-compiler-3.14.0-17.el9.x86_64 2026-02-12T18:04:46.937 INFO:teuthology.orchestra.run.trial111.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2026-02-12T18:04:46.937 INFO:teuthology.orchestra.run.trial111.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2026-02-12T18:04:46.937 INFO:teuthology.orchestra.run.trial111.stdout: python3-jmespath-1.0.1-1.el9.noarch 2026-02-12T18:04:46.938 INFO:teuthology.orchestra.run.trial111.stdout: python3-protobuf-3.14.0-17.el9.noarch 2026-02-12T18:04:46.938 INFO:teuthology.orchestra.run.trial111.stdout: python3-repoze-lru-0.7-16.el9.noarch 2026-02-12T18:04:46.938 INFO:teuthology.orchestra.run.trial111.stdout: python3-routes-2.5.1-5.el9.noarch 2026-02-12T18:04:46.938 INFO:teuthology.orchestra.run.trial111.stdout: python3-xmltodict-0.12.0-15.el9.noarch 2026-02-12T18:04:46.938 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:46.938 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:04:46.973 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-mgr-diskprediction-local 2026-02-12T18:04:47.261 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:39 ago on Thu 12 Feb 2026 06:04:08 PM UTC. 2026-02-12T18:04:47.344 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:04:47.344 INFO:teuthology.orchestra.run.trial111.stdout:======================================================================================= 2026-02-12T18:04:47.345 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repository Size 2026-02-12T18:04:47.345 INFO:teuthology.orchestra.run.trial111.stdout:======================================================================================= 2026-02-12T18:04:47.345 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T18:04:47.345 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-diskprediction-local noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 7.4 M 2026-02-12T18:04:47.345 INFO:teuthology.orchestra.run.trial111.stdout:Installing dependencies: 2026-02-12T18:04:47.345 INFO:teuthology.orchestra.run.trial111.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2026-02-12T18:04:47.345 INFO:teuthology.orchestra.run.trial111.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2026-02-12T18:04:47.345 INFO:teuthology.orchestra.run.trial111.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2026-02-12T18:04:47.345 INFO:teuthology.orchestra.run.trial111.stdout: libgfortran x86_64 11.5.0-14.el9 baseos 794 k 2026-02-12T18:04:47.345 INFO:teuthology.orchestra.run.trial111.stdout: libquadmath x86_64 11.5.0-14.el9 baseos 184 k 2026-02-12T18:04:47.345 INFO:teuthology.orchestra.run.trial111.stdout: openblas x86_64 0.3.29-1.el9 appstream 42 k 2026-02-12T18:04:47.346 INFO:teuthology.orchestra.run.trial111.stdout: openblas-openmp x86_64 0.3.29-1.el9 appstream 5.3 M 2026-02-12T18:04:47.346 INFO:teuthology.orchestra.run.trial111.stdout: python3-devel x86_64 3.9.25-2.el9 appstream 244 k 2026-02-12T18:04:47.346 INFO:teuthology.orchestra.run.trial111.stdout: python3-numpy x86_64 1:1.23.5-2.el9 appstream 6.1 M 2026-02-12T18:04:47.346 INFO:teuthology.orchestra.run.trial111.stdout: python3-numpy-f2py x86_64 1:1.23.5-2.el9 appstream 442 k 2026-02-12T18:04:47.346 INFO:teuthology.orchestra.run.trial111.stdout: python3-scipy x86_64 1.9.3-2.el9 appstream 19 M 2026-02-12T18:04:47.346 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:47.346 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T18:04:47.346 INFO:teuthology.orchestra.run.trial111.stdout:======================================================================================= 2026-02-12T18:04:47.346 INFO:teuthology.orchestra.run.trial111.stdout:Install 12 Packages 2026-02-12T18:04:47.346 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:47.347 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 43 M 2026-02-12T18:04:47.347 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 234 M 2026-02-12T18:04:47.347 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T18:04:47.691 INFO:teuthology.orchestra.run.trial111.stdout:(1/12): ceph-mgr-diskprediction-local-20.3.0-52 33 MB/s | 7.4 MB 00:00 2026-02-12T18:04:47.782 INFO:teuthology.orchestra.run.trial111.stdout:(2/12): flexiblas-3.0.4-8.el9.x86_64.rpm 358 kB/s | 33 kB 00:00 2026-02-12T18:04:47.971 INFO:teuthology.orchestra.run.trial111.stdout:(3/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 16 MB/s | 3.0 MB 00:00 2026-02-12T18:04:47.996 INFO:teuthology.orchestra.run.trial111.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 719 kB/s | 18 kB 00:00 2026-02-12T18:04:48.022 INFO:teuthology.orchestra.run.trial111.stdout:(5/12): openblas-0.3.29-1.el9.x86_64.rpm 1.6 MB/s | 42 kB 00:00 2026-02-12T18:04:48.089 INFO:teuthology.orchestra.run.trial111.stdout:(6/12): openblas-openmp-0.3.29-1.el9.x86_64.rpm 78 MB/s | 5.3 MB 00:00 2026-02-12T18:04:48.117 INFO:teuthology.orchestra.run.trial111.stdout:(7/12): python3-devel-3.9.25-2.el9.x86_64.rpm 8.5 MB/s | 244 kB 00:00 2026-02-12T18:04:48.147 INFO:teuthology.orchestra.run.trial111.stdout:(8/12): libquadmath-11.5.0-14.el9.x86_64.rpm 270 kB/s | 184 kB 00:00 2026-02-12T18:04:48.183 INFO:teuthology.orchestra.run.trial111.stdout:(9/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 93 MB/s | 6.1 MB 00:00 2026-02-12T18:04:48.323 INFO:teuthology.orchestra.run.trial111.stdout:(10/12): python3-numpy-f2py-1.23.5-2.el9.x86_64 2.5 MB/s | 442 kB 00:00 2026-02-12T18:04:48.366 INFO:teuthology.orchestra.run.trial111.stdout:(11/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 106 MB/s | 19 MB 00:00 2026-02-12T18:04:48.765 INFO:teuthology.orchestra.run.trial048.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 784 kB/s | 3.0 MB 00:03 2026-02-12T18:04:48.851 INFO:teuthology.orchestra.run.trial111.stdout:(12/12): libgfortran-11.5.0-14.el9.x86_64.rpm 572 kB/s | 794 kB 00:01 2026-02-12T18:04:48.854 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:04:48.855 INFO:teuthology.orchestra.run.trial111.stdout:Total 28 MB/s | 43 MB 00:01 2026-02-12T18:04:49.008 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T18:04:49.022 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T18:04:49.022 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T18:04:49.223 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T18:04:49.224 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T18:04:49.336 INFO:teuthology.orchestra.run.trial048.stdout:(9/12): python3-numpy-f2py-1.23.5-2.el9.x86_64. 773 kB/s | 442 kB 00:00 2026-02-12T18:04:49.439 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T18:04:49.442 INFO:teuthology.orchestra.run.trial111.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2026-02-12T18:04:49.448 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-12T18:04:49.481 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-12T18:04:49.486 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 4/12 2026-02-12T18:04:49.544 INFO:teuthology.orchestra.run.trial111.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-12T18:04:49.547 INFO:teuthology.orchestra.run.trial111.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-12T18:04:49.568 INFO:teuthology.orchestra.run.trial111.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2026-02-12T18:04:49.888 INFO:teuthology.orchestra.run.trial111.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2026-02-12T18:04:49.959 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-12T18:04:50.619 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-12T18:04:51.080 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-12T18:04:51.080 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefa 12/12 2026-02-12T18:04:51.367 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefa 12/12 2026-02-12T18:04:51.368 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefa 1/12 2026-02-12T18:04:51.368 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-12T18:04:51.368 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-12T18:04:51.368 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2026-02-12T18:04:51.368 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2026-02-12T18:04:51.368 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2026-02-12T18:04:51.368 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-12T18:04:51.368 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-12T18:04:51.368 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 9/12 2026-02-12T18:04:51.369 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-12T18:04:51.369 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-12T18:04:51.423 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-12T18:04:51.423 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:51.424 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T18:04:51.424 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T18:04:51.424 INFO:teuthology.orchestra.run.trial111.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-12T18:04:51.424 INFO:teuthology.orchestra.run.trial111.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-12T18:04:51.424 INFO:teuthology.orchestra.run.trial111.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-12T18:04:51.424 INFO:teuthology.orchestra.run.trial111.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-12T18:04:51.424 INFO:teuthology.orchestra.run.trial111.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-12T18:04:51.424 INFO:teuthology.orchestra.run.trial111.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-12T18:04:51.424 INFO:teuthology.orchestra.run.trial111.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-12T18:04:51.425 INFO:teuthology.orchestra.run.trial111.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-12T18:04:51.425 INFO:teuthology.orchestra.run.trial111.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-12T18:04:51.425 INFO:teuthology.orchestra.run.trial111.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-12T18:04:51.425 INFO:teuthology.orchestra.run.trial111.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-12T18:04:51.425 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:51.425 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:04:51.462 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-mgr-rook 2026-02-12T18:04:51.529 INFO:teuthology.orchestra.run.trial048.stdout:(10/12): openblas-openmp-0.3.29-1.el9.x86_64.rp 880 kB/s | 5.3 MB 00:06 2026-02-12T18:04:51.759 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:43 ago on Thu 12 Feb 2026 06:04:08 PM UTC. 2026-02-12T18:04:51.843 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:04:51.844 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:04:51.844 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repository Size 2026-02-12T18:04:51.844 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:04:51.844 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T18:04:51.845 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-rook noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 50 k 2026-02-12T18:04:51.845 INFO:teuthology.orchestra.run.trial111.stdout:Installing dependencies: 2026-02-12T18:04:51.845 INFO:teuthology.orchestra.run.trial111.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-12T18:04:51.845 INFO:teuthology.orchestra.run.trial111.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-12T18:04:51.845 INFO:teuthology.orchestra.run.trial111.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-12T18:04:51.845 INFO:teuthology.orchestra.run.trial111.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-12T18:04:51.845 INFO:teuthology.orchestra.run.trial111.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-12T18:04:51.845 INFO:teuthology.orchestra.run.trial111.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-12T18:04:51.845 INFO:teuthology.orchestra.run.trial111.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-12T18:04:51.845 INFO:teuthology.orchestra.run.trial111.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-12T18:04:51.845 INFO:teuthology.orchestra.run.trial111.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-12T18:04:51.845 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:51.846 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T18:04:51.846 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:04:51.846 INFO:teuthology.orchestra.run.trial111.stdout:Install 10 Packages 2026-02-12T18:04:51.846 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:51.846 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 2.0 M 2026-02-12T18:04:51.846 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 25 M 2026-02-12T18:04:51.846 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T18:04:52.145 INFO:teuthology.orchestra.run.trial111.stdout:(1/10): ceph-mgr-rook-20.3.0-5230.gafefaa40.el9 696 kB/s | 50 kB 00:00 2026-02-12T18:04:52.474 INFO:teuthology.orchestra.run.trial111.stdout:(2/10): python3-requests-oauthlib-1.3.0-12.el9. 163 kB/s | 54 kB 00:00 2026-02-12T18:04:52.502 INFO:teuthology.orchestra.run.trial111.stdout:(3/10): python3-cachetools-4.2.4-1.el9.noarch.r 1.1 MB/s | 32 kB 00:00 2026-02-12T18:04:52.506 INFO:teuthology.orchestra.run.trial111.stdout:(4/10): python3-certifi-2023.05.07-4.el9.noarch 4.2 MB/s | 14 kB 00:00 2026-02-12T18:04:52.515 INFO:teuthology.orchestra.run.trial111.stdout:(5/10): python3-google-auth-2.45.0-1.el9.noarch 26 MB/s | 254 kB 00:00 2026-02-12T18:04:52.526 INFO:teuthology.orchestra.run.trial111.stdout:(6/10): python3-kubernetes-26.1.0-3.el9.noarch. 99 MB/s | 1.0 MB 00:00 2026-02-12T18:04:52.528 INFO:teuthology.orchestra.run.trial111.stdout:(7/10): python3-pyasn1-0.4.8-6.el9.noarch.rpm 348 kB/s | 159 kB 00:00 2026-02-12T18:04:52.529 INFO:teuthology.orchestra.run.trial111.stdout:(8/10): python3-rsa-4.9-2.el9.noarch.rpm 17 MB/s | 59 kB 00:00 2026-02-12T18:04:52.532 INFO:teuthology.orchestra.run.trial111.stdout:(9/10): python3-websocket-client-1.2.3-2.el9.no 26 MB/s | 90 kB 00:00 2026-02-12T18:04:52.594 INFO:teuthology.orchestra.run.trial111.stdout:(10/10): python3-pyasn1-modules-0.4.8-6.el9.noa 535 kB/s | 279 kB 00:00 2026-02-12T18:04:52.595 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:04:52.595 INFO:teuthology.orchestra.run.trial111.stdout:Total 2.6 MB/s | 2.0 MB 00:00 2026-02-12T18:04:52.619 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T18:04:52.627 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T18:04:52.627 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T18:04:52.666 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T18:04:52.666 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T18:04:52.741 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T18:04:52.753 INFO:teuthology.orchestra.run.trial048.stdout:(11/12): python3-numpy-1.23.5-2.el9.x86_64.rpm 894 kB/s | 6.1 MB 00:07 2026-02-12T18:04:52.791 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/10 2026-02-12T18:04:52.804 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/10 2026-02-12T18:04:52.818 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-12T18:04:52.823 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-12T18:04:52.831 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-12T18:04:52.870 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-12T18:04:52.882 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-12T18:04:53.200 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-12T18:04:53.214 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-12T18:04:53.215 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 10/10 2026-02-12T18:04:53.322 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 10/10 2026-02-12T18:04:53.322 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 1/10 2026-02-12T18:04:53.322 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 2/10 2026-02-12T18:04:53.322 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 3/10 2026-02-12T18:04:53.322 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-12T18:04:53.322 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-12T18:04:53.322 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-12T18:04:53.323 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-12T18:04:53.323 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-12T18:04:53.323 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-12T18:04:53.377 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-12T18:04:53.377 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:53.378 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T18:04:53.378 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T18:04:53.378 INFO:teuthology.orchestra.run.trial111.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-12T18:04:53.378 INFO:teuthology.orchestra.run.trial111.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-12T18:04:53.378 INFO:teuthology.orchestra.run.trial111.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-12T18:04:53.379 INFO:teuthology.orchestra.run.trial111.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-12T18:04:53.379 INFO:teuthology.orchestra.run.trial111.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-12T18:04:53.379 INFO:teuthology.orchestra.run.trial111.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-12T18:04:53.379 INFO:teuthology.orchestra.run.trial111.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-12T18:04:53.379 INFO:teuthology.orchestra.run.trial111.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-12T18:04:53.380 INFO:teuthology.orchestra.run.trial111.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-12T18:04:53.380 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:53.380 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:04:53.408 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-mgr-cephadm 2026-02-12T18:04:53.707 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:45 ago on Thu 12 Feb 2026 06:04:08 PM UTC. 2026-02-12T18:04:53.789 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:04:53.789 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:04:53.789 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repository Size 2026-02-12T18:04:53.789 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:04:53.789 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T18:04:53.790 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 184 k 2026-02-12T18:04:53.790 INFO:teuthology.orchestra.run.trial111.stdout:Installing dependencies: 2026-02-12T18:04:53.790 INFO:teuthology.orchestra.run.trial111.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-12T18:04:53.790 INFO:teuthology.orchestra.run.trial111.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-12T18:04:53.790 INFO:teuthology.orchestra.run.trial111.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-12T18:04:53.790 INFO:teuthology.orchestra.run.trial111.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-12T18:04:53.790 INFO:teuthology.orchestra.run.trial111.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-12T18:04:53.790 INFO:teuthology.orchestra.run.trial111.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-12T18:04:53.790 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:53.790 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T18:04:53.790 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:04:53.790 INFO:teuthology.orchestra.run.trial111.stdout:Install 7 Packages 2026-02-12T18:04:53.790 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:04:53.790 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 7.1 M 2026-02-12T18:04:53.790 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 34 M 2026-02-12T18:04:53.790 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T18:04:54.512 INFO:teuthology.orchestra.run.trial111.stdout:(1/7): ceph-mgr-cephadm-20.3.0-5230.gafefaa40.e 2.1 MB/s | 184 kB 00:00 2026-02-12T18:04:55.022 INFO:teuthology.orchestra.run.trial111.stdout:(2/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 68 kB/s | 35 kB 00:00 2026-02-12T18:04:55.079 INFO:teuthology.orchestra.run.trial111.stdout:(3/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 9.5 MB/s | 548 kB 00:00 2026-02-12T18:04:55.088 INFO:teuthology.orchestra.run.trial111.stdout:(4/7): python3-natsort-7.1.1-5.el9.noarch.rpm 6.3 MB/s | 58 kB 00:00 2026-02-12T18:04:55.097 INFO:teuthology.orchestra.run.trial111.stdout:(5/7): python3-typing-extensions-4.15.0-1.el9.n 9.1 MB/s | 86 kB 00:00 2026-02-12T18:04:55.260 INFO:teuthology.orchestra.run.trial111.stdout:(6/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 298 kB/s | 249 kB 00:00 2026-02-12T18:05:02.886 INFO:teuthology.orchestra.run.trial111.stdout:(7/7): python3-babel-2.9.1-2.el9.noarch.rpm 722 kB/s | 6.0 MB 00:08 2026-02-12T18:05:02.888 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:05:02.888 INFO:teuthology.orchestra.run.trial111.stdout:Total 799 kB/s | 7.1 MB 00:09 2026-02-12T18:05:02.928 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T18:05:02.934 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T18:05:02.934 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T18:05:03.005 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T18:05:03.005 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T18:05:03.095 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T18:05:03.144 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-12T18:05:03.154 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-12T18:05:03.160 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-12T18:05:03.379 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-12T18:05:03.402 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-12T18:05:03.426 INFO:teuthology.orchestra.run.trial111.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-12T18:05:03.428 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 7/7 2026-02-12T18:05:03.540 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 7/7 2026-02-12T18:05:03.540 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/7 2026-02-12T18:05:03.540 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-12T18:05:03.540 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-12T18:05:03.540 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-12T18:05:03.540 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-12T18:05:03.540 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-12T18:05:03.595 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-12T18:05:03.595 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:03.595 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T18:05:03.595 INFO:teuthology.orchestra.run.trial111.stdout: ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T18:05:03.595 INFO:teuthology.orchestra.run.trial111.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-12T18:05:03.596 INFO:teuthology.orchestra.run.trial111.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-12T18:05:03.596 INFO:teuthology.orchestra.run.trial111.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-12T18:05:03.596 INFO:teuthology.orchestra.run.trial111.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-12T18:05:03.596 INFO:teuthology.orchestra.run.trial111.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-12T18:05:03.596 INFO:teuthology.orchestra.run.trial111.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-12T18:05:03.596 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:03.596 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:05:03.627 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-osd 2026-02-12T18:05:03.923 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:55 ago on Thu 12 Feb 2026 06:04:08 PM UTC. 2026-02-12T18:05:03.988 INFO:teuthology.orchestra.run.trial111.stdout:Package ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T18:05:04.006 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:05:04.007 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T18:05:04.007 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:05:04.028 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-osd-classic 2026-02-12T18:05:04.331 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:56 ago on Thu 12 Feb 2026 06:04:08 PM UTC. 2026-02-12T18:05:04.396 INFO:teuthology.orchestra.run.trial111.stdout:Package ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T18:05:04.414 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:05:04.415 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T18:05:04.415 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:05:04.437 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-fuse 2026-02-12T18:05:04.731 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:56 ago on Thu 12 Feb 2026 06:04:08 PM UTC. 2026-02-12T18:05:04.816 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:05:04.816 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:05:04.816 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T18:05:04.817 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:05:04.817 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T18:05:04.817 INFO:teuthology.orchestra.run.trial111.stdout: ceph-fuse x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 987 k 2026-02-12T18:05:04.817 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:04.817 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T18:05:04.817 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:05:04.817 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T18:05:04.817 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:04.817 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 987 k 2026-02-12T18:05:04.817 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 2.9 M 2026-02-12T18:05:04.817 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T18:05:04.945 INFO:teuthology.orchestra.run.trial111.stdout:ceph-fuse-20.3.0-5230.gafefaa40.el9.x86_64.rpm 7.5 MB/s | 987 kB 00:00 2026-02-12T18:05:04.945 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:05:04.945 INFO:teuthology.orchestra.run.trial111.stdout:Total 7.5 MB/s | 987 kB 00:00 2026-02-12T18:05:04.945 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T18:05:04.949 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T18:05:04.950 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T18:05:04.985 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T18:05:04.985 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T18:05:05.077 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T18:05:05.093 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:05.311 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:05.367 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:05.367 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:05.367 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T18:05:05.367 INFO:teuthology.orchestra.run.trial111.stdout: ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:05:05.367 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:05.367 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:05:05.396 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install ceph-volume 2026-02-12T18:05:05.699 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:57 ago on Thu 12 Feb 2026 06:04:08 PM UTC. 2026-02-12T18:05:05.782 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:05:05.782 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:05:05.783 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repository Size 2026-02-12T18:05:05.783 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:05:05.783 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T18:05:05.783 INFO:teuthology.orchestra.run.trial111.stdout: ceph-volume noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 299 k 2026-02-12T18:05:05.783 INFO:teuthology.orchestra.run.trial111.stdout:Installing dependencies: 2026-02-12T18:05:05.783 INFO:teuthology.orchestra.run.trial111.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-12T18:05:05.783 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:05.783 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T18:05:05.783 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:05:05.783 INFO:teuthology.orchestra.run.trial111.stdout:Install 2 Packages 2026-02-12T18:05:05.783 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:05.784 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 649 k 2026-02-12T18:05:05.784 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 2.2 M 2026-02-12T18:05:05.784 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T18:05:05.963 INFO:teuthology.orchestra.run.trial111.stdout:(1/2): ceph-volume-20.3.0-5230.gafefaa40.el9.no 3.1 MB/s | 299 kB 00:00 2026-02-12T18:05:06.041 INFO:teuthology.orchestra.run.trial111.stdout:(2/2): cryptsetup-2.8.1-2.el9.x86_64.rpm 2.0 MB/s | 350 kB 00:00 2026-02-12T18:05:06.042 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:05:06.042 INFO:teuthology.orchestra.run.trial111.stdout:Total 2.5 MB/s | 649 kB 00:00 2026-02-12T18:05:06.050 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T18:05:06.056 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T18:05:06.056 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T18:05:06.099 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T18:05:06.100 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T18:05:06.178 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T18:05:06.241 INFO:teuthology.orchestra.run.trial111.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 1/2 2026-02-12T18:05:06.243 INFO:teuthology.orchestra.run.trial111.stdout: Installing : ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch 2/2 2026-02-12T18:05:06.258 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch 2/2 2026-02-12T18:05:06.258 INFO:teuthology.orchestra.run.trial111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T18:05:06.259 INFO:teuthology.orchestra.run.trial111.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-12T18:05:06.259 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:06.472 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch 1/2 2026-02-12T18:05:06.528 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 2/2 2026-02-12T18:05:06.528 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:06.528 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T18:05:06.528 INFO:teuthology.orchestra.run.trial111.stdout: ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch cryptsetup-2.8.1-2.el9.x86_64 2026-02-12T18:05:06.528 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:06.528 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:05:06.558 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install librados-devel 2026-02-12T18:05:06.864 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:58 ago on Thu 12 Feb 2026 06:04:08 PM UTC. 2026-02-12T18:05:06.947 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:05:06.948 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:05:06.948 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T18:05:06.948 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:05:06.948 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T18:05:06.948 INFO:teuthology.orchestra.run.trial111.stdout: librados-devel x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 123 k 2026-02-12T18:05:06.949 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:06.949 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T18:05:06.949 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:05:06.949 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T18:05:06.949 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:06.949 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 123 k 2026-02-12T18:05:06.949 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 437 k 2026-02-12T18:05:06.949 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T18:05:07.033 INFO:teuthology.orchestra.run.trial111.stdout:librados-devel-20.3.0-5230.gafefaa40.el9.x86_64 1.4 MB/s | 123 kB 00:00 2026-02-12T18:05:07.034 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:05:07.034 INFO:teuthology.orchestra.run.trial111.stdout:Total 1.4 MB/s | 123 kB 00:00 2026-02-12T18:05:07.034 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T18:05:07.036 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T18:05:07.036 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T18:05:07.068 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T18:05:07.068 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T18:05:07.121 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T18:05:07.137 INFO:teuthology.orchestra.run.trial111.stdout: Installing : librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:07.217 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:07.274 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:07.274 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:07.274 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T18:05:07.274 INFO:teuthology.orchestra.run.trial111.stdout: librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:05:07.274 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:07.274 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:05:07.302 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install libcephfs2 2026-02-12T18:05:07.600 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:00:59 ago on Thu 12 Feb 2026 06:04:08 PM UTC. 2026-02-12T18:05:07.665 INFO:teuthology.orchestra.run.trial111.stdout:Package libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T18:05:07.683 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:05:07.683 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T18:05:07.684 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:05:07.705 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install libcephfs-devel 2026-02-12T18:05:08.001 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:01:00 ago on Thu 12 Feb 2026 06:04:08 PM UTC. 2026-02-12T18:05:08.083 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:05:08.084 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:05:08.085 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T18:05:08.085 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:05:08.085 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T18:05:08.085 INFO:teuthology.orchestra.run.trial111.stdout: libcephfs-devel x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 37 k 2026-02-12T18:05:08.085 INFO:teuthology.orchestra.run.trial111.stdout:Installing dependencies: 2026-02-12T18:05:08.085 INFO:teuthology.orchestra.run.trial111.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 25 k 2026-02-12T18:05:08.085 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:08.085 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T18:05:08.085 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:05:08.086 INFO:teuthology.orchestra.run.trial111.stdout:Install 2 Packages 2026-02-12T18:05:08.086 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:08.086 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 62 k 2026-02-12T18:05:08.086 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 223 k 2026-02-12T18:05:08.086 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T18:05:08.147 INFO:teuthology.orchestra.run.trial111.stdout:(1/2): libcephfs-devel-20.3.0-5230.gafefaa40.el 596 kB/s | 37 kB 00:00 2026-02-12T18:05:08.149 INFO:teuthology.orchestra.run.trial111.stdout:(2/2): libcephfs-proxy2-20.3.0-5230.gafefaa40.e 384 kB/s | 25 kB 00:00 2026-02-12T18:05:08.150 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:05:08.150 INFO:teuthology.orchestra.run.trial111.stdout:Total 943 kB/s | 62 kB 00:00 2026-02-12T18:05:08.150 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T18:05:08.153 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T18:05:08.153 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T18:05:08.185 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T18:05:08.185 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T18:05:08.233 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T18:05:08.234 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 1/2 2026-02-12T18:05:08.250 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 1/2 2026-02-12T18:05:08.267 INFO:teuthology.orchestra.run.trial111.stdout: Installing : libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2/2 2026-02-12T18:05:08.319 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2/2 2026-02-12T18:05:08.320 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/2 2026-02-12T18:05:08.375 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 2/2 2026-02-12T18:05:08.375 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:08.375 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T18:05:08.375 INFO:teuthology.orchestra.run.trial111.stdout: libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:05:08.375 INFO:teuthology.orchestra.run.trial111.stdout: libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:05:08.375 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:08.376 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:05:08.401 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install librados2 2026-02-12T18:05:08.698 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:01:00 ago on Thu 12 Feb 2026 06:04:08 PM UTC. 2026-02-12T18:05:08.763 INFO:teuthology.orchestra.run.trial111.stdout:Package librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T18:05:08.781 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:05:08.782 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T18:05:08.782 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:05:08.803 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install librbd1 2026-02-12T18:05:09.098 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:01:01 ago on Thu 12 Feb 2026 06:04:08 PM UTC. 2026-02-12T18:05:09.163 INFO:teuthology.orchestra.run.trial111.stdout:Package librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T18:05:09.182 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:05:09.182 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T18:05:09.182 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:05:09.203 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install python3-rados 2026-02-12T18:05:09.501 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:01:01 ago on Thu 12 Feb 2026 06:04:08 PM UTC. 2026-02-12T18:05:09.565 INFO:teuthology.orchestra.run.trial111.stdout:Package python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T18:05:09.584 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:05:09.584 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T18:05:09.584 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:05:09.606 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install python3-rgw 2026-02-12T18:05:09.903 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:01:01 ago on Thu 12 Feb 2026 06:04:08 PM UTC. 2026-02-12T18:05:09.967 INFO:teuthology.orchestra.run.trial111.stdout:Package python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T18:05:09.985 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:05:09.986 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T18:05:09.986 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:05:10.007 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install python3-cephfs 2026-02-12T18:05:10.311 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:01:02 ago on Thu 12 Feb 2026 06:04:08 PM UTC. 2026-02-12T18:05:10.376 INFO:teuthology.orchestra.run.trial111.stdout:Package python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T18:05:10.395 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:05:10.395 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T18:05:10.396 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:05:10.418 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install python3-rbd 2026-02-12T18:05:10.718 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:01:02 ago on Thu 12 Feb 2026 06:04:08 PM UTC. 2026-02-12T18:05:10.783 INFO:teuthology.orchestra.run.trial111.stdout:Package python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T18:05:10.802 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:05:10.802 INFO:teuthology.orchestra.run.trial111.stdout:Nothing to do. 2026-02-12T18:05:10.802 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:05:10.824 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install rbd-fuse 2026-02-12T18:05:11.124 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:01:03 ago on Thu 12 Feb 2026 06:04:08 PM UTC. 2026-02-12T18:05:11.206 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:05:11.207 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:05:11.207 INFO:teuthology.orchestra.run.trial111.stdout: Package Architecture Version Repository Size 2026-02-12T18:05:11.208 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:05:11.208 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T18:05:11.208 INFO:teuthology.orchestra.run.trial111.stdout: rbd-fuse x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 84 k 2026-02-12T18:05:11.208 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:11.208 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T18:05:11.208 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:05:11.208 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T18:05:11.208 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:11.208 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 84 k 2026-02-12T18:05:11.208 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 209 k 2026-02-12T18:05:11.209 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T18:05:11.291 INFO:teuthology.orchestra.run.trial111.stdout:rbd-fuse-20.3.0-5230.gafefaa40.el9.x86_64.rpm 1.0 MB/s | 84 kB 00:00 2026-02-12T18:05:11.292 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:05:11.292 INFO:teuthology.orchestra.run.trial111.stdout:Total 998 kB/s | 84 kB 00:00 2026-02-12T18:05:11.292 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T18:05:11.295 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T18:05:11.296 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T18:05:11.327 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T18:05:11.327 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T18:05:11.377 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T18:05:11.394 INFO:teuthology.orchestra.run.trial111.stdout: Installing : rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:11.465 INFO:teuthology.orchestra.run.trial048.stdout:(12/12): python3-scipy-1.9.3-2.el9.x86_64.rpm 891 kB/s | 19 MB 00:22 2026-02-12T18:05:11.468 INFO:teuthology.orchestra.run.trial048.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:05:11.468 INFO:teuthology.orchestra.run.trial048.stdout:Total 1.6 MB/s | 43 MB 00:26 2026-02-12T18:05:11.469 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:11.525 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:11.525 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:11.525 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T18:05:11.525 INFO:teuthology.orchestra.run.trial111.stdout: rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:05:11.525 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:11.526 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:05:11.552 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install rbd-mirror 2026-02-12T18:05:11.629 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction check 2026-02-12T18:05:11.643 INFO:teuthology.orchestra.run.trial048.stdout:Transaction check succeeded. 2026-02-12T18:05:11.644 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction test 2026-02-12T18:05:11.846 INFO:teuthology.orchestra.run.trial048.stdout:Transaction test succeeded. 2026-02-12T18:05:11.846 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction 2026-02-12T18:05:11.854 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:01:03 ago on Thu 12 Feb 2026 06:04:08 PM UTC. 2026-02-12T18:05:11.937 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:05:11.938 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:05:11.938 INFO:teuthology.orchestra.run.trial111.stdout: Package Arch Version Repo Size 2026-02-12T18:05:11.938 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:05:11.938 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T18:05:11.938 INFO:teuthology.orchestra.run.trial111.stdout: rbd-mirror x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 2.9 M 2026-02-12T18:05:11.938 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:11.938 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T18:05:11.939 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:05:11.939 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T18:05:11.939 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:11.939 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 2.9 M 2026-02-12T18:05:11.939 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 11 M 2026-02-12T18:05:11.939 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T18:05:12.064 INFO:teuthology.orchestra.run.trial048.stdout: Preparing : 1/1 2026-02-12T18:05:12.067 INFO:teuthology.orchestra.run.trial048.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2026-02-12T18:05:12.073 INFO:teuthology.orchestra.run.trial048.stdout: Installing : libquadmath-11.5.0-14.el9.x86_64 2/12 2026-02-12T18:05:12.082 INFO:teuthology.orchestra.run.trial111.stdout:rbd-mirror-20.3.0-5230.gafefaa40.el9.x86_64.rpm 20 MB/s | 2.9 MB 00:00 2026-02-12T18:05:12.083 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:05:12.083 INFO:teuthology.orchestra.run.trial111.stdout:Total 20 MB/s | 2.9 MB 00:00 2026-02-12T18:05:12.083 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T18:05:12.088 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T18:05:12.088 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T18:05:12.106 INFO:teuthology.orchestra.run.trial048.stdout: Installing : libgfortran-11.5.0-14.el9.x86_64 3/12 2026-02-12T18:05:12.110 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-devel-3.9.25-2.el9.x86_64 4/12 2026-02-12T18:05:12.128 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T18:05:12.128 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T18:05:12.169 INFO:teuthology.orchestra.run.trial048.stdout: Installing : openblas-0.3.29-1.el9.x86_64 5/12 2026-02-12T18:05:12.171 INFO:teuthology.orchestra.run.trial048.stdout: Installing : openblas-openmp-0.3.29-1.el9.x86_64 6/12 2026-02-12T18:05:12.192 INFO:teuthology.orchestra.run.trial048.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2026-02-12T18:05:12.312 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T18:05:12.314 INFO:teuthology.orchestra.run.trial111.stdout: Installing : rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:12.337 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:12.337 INFO:teuthology.orchestra.run.trial111.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T18:05:12.337 INFO:teuthology.orchestra.run.trial111.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-12T18:05:12.337 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T18:05:12.337 INFO:teuthology.orchestra.run.trial111.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T18:05:12.337 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:12.509 INFO:teuthology.orchestra.run.trial048.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2026-02-12T18:05:12.579 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-numpy-1:1.23.5-2.el9.x86_64 9/12 2026-02-12T18:05:12.628 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:12.628 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:12.628 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T18:05:12.629 INFO:teuthology.orchestra.run.trial111.stdout: rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:05:12.629 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:12.629 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:05:12.657 DEBUG:teuthology.orchestra.run.trial111:> sudo yum -y install rbd-nbd 2026-02-12T18:05:12.959 INFO:teuthology.orchestra.run.trial111.stdout:Last metadata expiration check: 0:01:04 ago on Thu 12 Feb 2026 06:04:08 PM UTC. 2026-02-12T18:05:13.043 INFO:teuthology.orchestra.run.trial111.stdout:Dependencies resolved. 2026-02-12T18:05:13.043 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:05:13.043 INFO:teuthology.orchestra.run.trial111.stdout: Package Architecture Version Repository Size 2026-02-12T18:05:13.043 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:05:13.043 INFO:teuthology.orchestra.run.trial111.stdout:Installing: 2026-02-12T18:05:13.043 INFO:teuthology.orchestra.run.trial111.stdout: rbd-nbd x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 172 k 2026-02-12T18:05:13.043 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:13.043 INFO:teuthology.orchestra.run.trial111.stdout:Transaction Summary 2026-02-12T18:05:13.043 INFO:teuthology.orchestra.run.trial111.stdout:================================================================================ 2026-02-12T18:05:13.043 INFO:teuthology.orchestra.run.trial111.stdout:Install 1 Package 2026-02-12T18:05:13.043 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:13.044 INFO:teuthology.orchestra.run.trial111.stdout:Total download size: 172 k 2026-02-12T18:05:13.044 INFO:teuthology.orchestra.run.trial111.stdout:Installed size: 462 k 2026-02-12T18:05:13.044 INFO:teuthology.orchestra.run.trial111.stdout:Downloading Packages: 2026-02-12T18:05:13.131 INFO:teuthology.orchestra.run.trial111.stdout:rbd-nbd-20.3.0-5230.gafefaa40.el9.x86_64.rpm 1.9 MB/s | 172 kB 00:00 2026-02-12T18:05:13.131 INFO:teuthology.orchestra.run.trial111.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:05:13.131 INFO:teuthology.orchestra.run.trial111.stdout:Total 1.9 MB/s | 172 kB 00:00 2026-02-12T18:05:13.131 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction check 2026-02-12T18:05:13.135 INFO:teuthology.orchestra.run.trial111.stdout:Transaction check succeeded. 2026-02-12T18:05:13.135 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction test 2026-02-12T18:05:13.167 INFO:teuthology.orchestra.run.trial111.stdout:Transaction test succeeded. 2026-02-12T18:05:13.167 INFO:teuthology.orchestra.run.trial111.stdout:Running transaction 2026-02-12T18:05:13.222 INFO:teuthology.orchestra.run.trial111.stdout: Preparing : 1/1 2026-02-12T18:05:13.235 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 10/12 2026-02-12T18:05:13.238 INFO:teuthology.orchestra.run.trial111.stdout: Installing : rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:13.315 INFO:teuthology.orchestra.run.trial111.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:13.372 INFO:teuthology.orchestra.run.trial111.stdout: Verifying : rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:13.372 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:13.372 INFO:teuthology.orchestra.run.trial111.stdout:Installed: 2026-02-12T18:05:13.372 INFO:teuthology.orchestra.run.trial111.stdout: rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:05:13.372 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:13.372 INFO:teuthology.orchestra.run.trial111.stdout:Complete! 2026-02-12T18:05:13.407 DEBUG:teuthology.parallel:result is None 2026-02-12T18:05:13.690 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-scipy-1.9.3-2.el9.x86_64 11/12 2026-02-12T18:05:13.691 INFO:teuthology.orchestra.run.trial048.stdout: Installing : ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefa 12/12 2026-02-12T18:05:13.981 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefa 12/12 2026-02-12T18:05:13.981 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefa 1/12 2026-02-12T18:05:13.981 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : libgfortran-11.5.0-14.el9.x86_64 2/12 2026-02-12T18:05:13.981 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : libquadmath-11.5.0-14.el9.x86_64 3/12 2026-02-12T18:05:13.981 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2026-02-12T18:05:13.981 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2026-02-12T18:05:13.981 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2026-02-12T18:05:13.981 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : openblas-0.3.29-1.el9.x86_64 7/12 2026-02-12T18:05:13.982 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : openblas-openmp-0.3.29-1.el9.x86_64 8/12 2026-02-12T18:05:13.982 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-devel-3.9.25-2.el9.x86_64 9/12 2026-02-12T18:05:13.982 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-numpy-1:1.23.5-2.el9.x86_64 10/12 2026-02-12T18:05:13.982 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-numpy-f2py-1:1.23.5-2.el9.x86_64 11/12 2026-02-12T18:05:14.038 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-scipy-1.9.3-2.el9.x86_64 12/12 2026-02-12T18:05:14.039 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:14.039 INFO:teuthology.orchestra.run.trial048.stdout:Installed: 2026-02-12T18:05:14.039 INFO:teuthology.orchestra.run.trial048.stdout: ceph-mgr-diskprediction-local-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T18:05:14.039 INFO:teuthology.orchestra.run.trial048.stdout: flexiblas-3.0.4-8.el9.x86_64 2026-02-12T18:05:14.039 INFO:teuthology.orchestra.run.trial048.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2026-02-12T18:05:14.039 INFO:teuthology.orchestra.run.trial048.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2026-02-12T18:05:14.039 INFO:teuthology.orchestra.run.trial048.stdout: libgfortran-11.5.0-14.el9.x86_64 2026-02-12T18:05:14.040 INFO:teuthology.orchestra.run.trial048.stdout: libquadmath-11.5.0-14.el9.x86_64 2026-02-12T18:05:14.040 INFO:teuthology.orchestra.run.trial048.stdout: openblas-0.3.29-1.el9.x86_64 2026-02-12T18:05:14.040 INFO:teuthology.orchestra.run.trial048.stdout: openblas-openmp-0.3.29-1.el9.x86_64 2026-02-12T18:05:14.040 INFO:teuthology.orchestra.run.trial048.stdout: python3-devel-3.9.25-2.el9.x86_64 2026-02-12T18:05:14.040 INFO:teuthology.orchestra.run.trial048.stdout: python3-numpy-1:1.23.5-2.el9.x86_64 2026-02-12T18:05:14.040 INFO:teuthology.orchestra.run.trial048.stdout: python3-numpy-f2py-1:1.23.5-2.el9.x86_64 2026-02-12T18:05:14.040 INFO:teuthology.orchestra.run.trial048.stdout: python3-scipy-1.9.3-2.el9.x86_64 2026-02-12T18:05:14.040 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:14.040 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:05:14.079 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install ceph-mgr-rook 2026-02-12T18:05:14.382 INFO:teuthology.orchestra.run.trial048.stdout:Last metadata expiration check: 0:01:08 ago on Thu 12 Feb 2026 06:04:06 PM UTC. 2026-02-12T18:05:14.466 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:05:14.467 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:14.467 INFO:teuthology.orchestra.run.trial048.stdout: Package Arch Version Repository Size 2026-02-12T18:05:14.467 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:14.467 INFO:teuthology.orchestra.run.trial048.stdout:Installing: 2026-02-12T18:05:14.467 INFO:teuthology.orchestra.run.trial048.stdout: ceph-mgr-rook noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 50 k 2026-02-12T18:05:14.467 INFO:teuthology.orchestra.run.trial048.stdout:Installing dependencies: 2026-02-12T18:05:14.467 INFO:teuthology.orchestra.run.trial048.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2026-02-12T18:05:14.467 INFO:teuthology.orchestra.run.trial048.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2026-02-12T18:05:14.467 INFO:teuthology.orchestra.run.trial048.stdout: python3-google-auth noarch 1:2.45.0-1.el9 epel 254 k 2026-02-12T18:05:14.467 INFO:teuthology.orchestra.run.trial048.stdout: python3-kubernetes noarch 1:26.1.0-3.el9 epel 1.0 M 2026-02-12T18:05:14.467 INFO:teuthology.orchestra.run.trial048.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2026-02-12T18:05:14.467 INFO:teuthology.orchestra.run.trial048.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2026-02-12T18:05:14.467 INFO:teuthology.orchestra.run.trial048.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2026-02-12T18:05:14.467 INFO:teuthology.orchestra.run.trial048.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2026-02-12T18:05:14.467 INFO:teuthology.orchestra.run.trial048.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2026-02-12T18:05:14.467 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:14.467 INFO:teuthology.orchestra.run.trial048.stdout:Transaction Summary 2026-02-12T18:05:14.467 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:14.467 INFO:teuthology.orchestra.run.trial048.stdout:Install 10 Packages 2026-02-12T18:05:14.467 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:14.468 INFO:teuthology.orchestra.run.trial048.stdout:Total download size: 2.0 M 2026-02-12T18:05:14.468 INFO:teuthology.orchestra.run.trial048.stdout:Installed size: 25 M 2026-02-12T18:05:14.468 INFO:teuthology.orchestra.run.trial048.stdout:Downloading Packages: 2026-02-12T18:05:14.785 INFO:teuthology.orchestra.run.trial048.stdout:(1/10): ceph-mgr-rook-20.3.0-5230.gafefaa40.el9 703 kB/s | 50 kB 00:00 2026-02-12T18:05:15.552 INFO:teuthology.orchestra.run.trial048.stdout:(2/10): python3-requests-oauthlib-1.3.0-12.el9. 70 kB/s | 54 kB 00:00 2026-02-12T18:05:15.644 INFO:teuthology.orchestra.run.trial048.stdout:(3/10): python3-pyasn1-0.4.8-6.el9.noarch.rpm 170 kB/s | 159 kB 00:00 2026-02-12T18:05:15.682 INFO:teuthology.orchestra.run.trial048.stdout:(4/10): python3-pyasn1-modules-0.4.8-6.el9.noar 288 kB/s | 279 kB 00:00 2026-02-12T18:05:15.774 INFO:teuthology.orchestra.run.trial048.stdout:(5/10): python3-cachetools-4.2.4-1.el9.noarch.r 145 kB/s | 32 kB 00:00 2026-02-12T18:05:15.793 INFO:teuthology.orchestra.run.trial048.stdout:(6/10): python3-certifi-2023.05.07-4.el9.noarch 95 kB/s | 14 kB 00:00 2026-02-12T18:05:16.071 INFO:teuthology.orchestra.run.trial048.stdout:(7/10): python3-rsa-4.9-2.el9.noarch.rpm 213 kB/s | 59 kB 00:00 2026-02-12T18:05:16.111 INFO:teuthology.orchestra.run.trial048.stdout:(8/10): python3-google-auth-2.45.0-1.el9.noarch 592 kB/s | 254 kB 00:00 2026-02-12T18:05:16.351 INFO:teuthology.orchestra.run.trial048.stdout:(9/10): python3-kubernetes-26.1.0-3.el9.noarch. 1.8 MB/s | 1.0 MB 00:00 2026-02-12T18:05:16.358 INFO:teuthology.orchestra.run.trial048.stdout:(10/10): python3-websocket-client-1.2.3-2.el9.n 312 kB/s | 90 kB 00:00 2026-02-12T18:05:16.358 INFO:teuthology.orchestra.run.trial048.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:05:16.358 INFO:teuthology.orchestra.run.trial048.stdout:Total 1.1 MB/s | 2.0 MB 00:01 2026-02-12T18:05:16.386 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction check 2026-02-12T18:05:16.393 INFO:teuthology.orchestra.run.trial048.stdout:Transaction check succeeded. 2026-02-12T18:05:16.393 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction test 2026-02-12T18:05:16.432 INFO:teuthology.orchestra.run.trial048.stdout:Transaction test succeeded. 2026-02-12T18:05:16.432 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction 2026-02-12T18:05:16.507 INFO:teuthology.orchestra.run.trial048.stdout: Preparing : 1/1 2026-02-12T18:05:16.556 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/10 2026-02-12T18:05:16.569 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/10 2026-02-12T18:05:16.583 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/10 2026-02-12T18:05:16.587 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/10 2026-02-12T18:05:16.595 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/10 2026-02-12T18:05:16.633 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/10 2026-02-12T18:05:16.645 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-12T18:05:16.958 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 8/10 2026-02-12T18:05:16.972 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-kubernetes-1:26.1.0-3.el9.noarch 9/10 2026-02-12T18:05:16.973 INFO:teuthology.orchestra.run.trial048.stdout: Installing : ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 10/10 2026-02-12T18:05:17.082 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 10/10 2026-02-12T18:05:17.083 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 1/10 2026-02-12T18:05:17.083 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 2/10 2026-02-12T18:05:17.083 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 3/10 2026-02-12T18:05:17.083 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 4/10 2026-02-12T18:05:17.083 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 5/10 2026-02-12T18:05:17.083 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 6/10 2026-02-12T18:05:17.083 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-google-auth-1:2.45.0-1.el9.noarch 7/10 2026-02-12T18:05:17.083 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-kubernetes-1:26.1.0-3.el9.noarch 8/10 2026-02-12T18:05:17.083 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 9/10 2026-02-12T18:05:17.138 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 10/10 2026-02-12T18:05:17.139 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:17.139 INFO:teuthology.orchestra.run.trial048.stdout:Installed: 2026-02-12T18:05:17.139 INFO:teuthology.orchestra.run.trial048.stdout: ceph-mgr-rook-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T18:05:17.139 INFO:teuthology.orchestra.run.trial048.stdout: python3-cachetools-4.2.4-1.el9.noarch 2026-02-12T18:05:17.139 INFO:teuthology.orchestra.run.trial048.stdout: python3-certifi-2023.05.07-4.el9.noarch 2026-02-12T18:05:17.139 INFO:teuthology.orchestra.run.trial048.stdout: python3-google-auth-1:2.45.0-1.el9.noarch 2026-02-12T18:05:17.139 INFO:teuthology.orchestra.run.trial048.stdout: python3-kubernetes-1:26.1.0-3.el9.noarch 2026-02-12T18:05:17.139 INFO:teuthology.orchestra.run.trial048.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2026-02-12T18:05:17.139 INFO:teuthology.orchestra.run.trial048.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2026-02-12T18:05:17.140 INFO:teuthology.orchestra.run.trial048.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2026-02-12T18:05:17.140 INFO:teuthology.orchestra.run.trial048.stdout: python3-rsa-4.9-2.el9.noarch 2026-02-12T18:05:17.140 INFO:teuthology.orchestra.run.trial048.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2026-02-12T18:05:17.140 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:17.140 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:05:17.170 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install ceph-mgr-cephadm 2026-02-12T18:05:17.473 INFO:teuthology.orchestra.run.trial048.stdout:Last metadata expiration check: 0:01:11 ago on Thu 12 Feb 2026 06:04:06 PM UTC. 2026-02-12T18:05:17.557 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:05:17.557 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:17.557 INFO:teuthology.orchestra.run.trial048.stdout: Package Arch Version Repository Size 2026-02-12T18:05:17.557 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:17.557 INFO:teuthology.orchestra.run.trial048.stdout:Installing: 2026-02-12T18:05:17.557 INFO:teuthology.orchestra.run.trial048.stdout: ceph-mgr-cephadm noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 184 k 2026-02-12T18:05:17.557 INFO:teuthology.orchestra.run.trial048.stdout:Installing dependencies: 2026-02-12T18:05:17.557 INFO:teuthology.orchestra.run.trial048.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2026-02-12T18:05:17.557 INFO:teuthology.orchestra.run.trial048.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2026-02-12T18:05:17.557 INFO:teuthology.orchestra.run.trial048.stdout: python3-jinja2 noarch 2.11.3-8.el9 appstream 249 k 2026-02-12T18:05:17.557 INFO:teuthology.orchestra.run.trial048.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2026-02-12T18:05:17.557 INFO:teuthology.orchestra.run.trial048.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2026-02-12T18:05:17.557 INFO:teuthology.orchestra.run.trial048.stdout: python3-typing-extensions noarch 4.15.0-1.el9 epel 86 k 2026-02-12T18:05:17.557 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:17.557 INFO:teuthology.orchestra.run.trial048.stdout:Transaction Summary 2026-02-12T18:05:17.557 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:17.557 INFO:teuthology.orchestra.run.trial048.stdout:Install 7 Packages 2026-02-12T18:05:17.558 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:17.558 INFO:teuthology.orchestra.run.trial048.stdout:Total download size: 7.1 M 2026-02-12T18:05:17.558 INFO:teuthology.orchestra.run.trial048.stdout:Installed size: 34 M 2026-02-12T18:05:17.558 INFO:teuthology.orchestra.run.trial048.stdout:Downloading Packages: 2026-02-12T18:05:17.757 INFO:teuthology.orchestra.run.trial048.stdout:(1/7): python3-jinja2-2.11.3-8.el9.noarch.rpm 7.2 MB/s | 249 kB 00:00 2026-02-12T18:05:17.761 INFO:teuthology.orchestra.run.trial048.stdout:(2/7): python3-markupsafe-1.1.1-12.el9.x86_64.r 7.1 MB/s | 35 kB 00:00 2026-02-12T18:05:17.808 INFO:teuthology.orchestra.run.trial048.stdout:(3/7): ceph-mgr-cephadm-20.3.0-5230.gafefaa40.e 2.1 MB/s | 184 kB 00:00 2026-02-12T18:05:17.814 INFO:teuthology.orchestra.run.trial048.stdout:(4/7): python3-babel-2.9.1-2.el9.noarch.rpm 65 MB/s | 6.0 MB 00:00 2026-02-12T18:05:18.057 INFO:teuthology.orchestra.run.trial048.stdout:(5/7): python3-natsort-7.1.1-5.el9.noarch.rpm 232 kB/s | 58 kB 00:00 2026-02-12T18:05:18.108 INFO:teuthology.orchestra.run.trial048.stdout:(6/7): python3-typing-extensions-4.15.0-1.el9.n 298 kB/s | 86 kB 00:00 2026-02-12T18:05:18.216 INFO:teuthology.orchestra.run.trial048.stdout:(7/7): python3-asyncssh-2.13.2-5.el9.noarch.rpm 1.2 MB/s | 548 kB 00:00 2026-02-12T18:05:18.217 INFO:teuthology.orchestra.run.trial048.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:05:18.217 INFO:teuthology.orchestra.run.trial048.stdout:Total 11 MB/s | 7.1 MB 00:00 2026-02-12T18:05:18.257 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction check 2026-02-12T18:05:18.264 INFO:teuthology.orchestra.run.trial048.stdout:Transaction check succeeded. 2026-02-12T18:05:18.264 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction test 2026-02-12T18:05:18.337 INFO:teuthology.orchestra.run.trial048.stdout:Transaction test succeeded. 2026-02-12T18:05:18.337 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction 2026-02-12T18:05:18.425 INFO:teuthology.orchestra.run.trial048.stdout: Preparing : 1/1 2026-02-12T18:05:18.474 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-typing-extensions-4.15.0-1.el9.noarch 1/7 2026-02-12T18:05:18.483 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/7 2026-02-12T18:05:18.489 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/7 2026-02-12T18:05:18.707 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-12T18:05:18.729 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 5/7 2026-02-12T18:05:18.754 INFO:teuthology.orchestra.run.trial048.stdout: Installing : python3-jinja2-2.11.3-8.el9.noarch 6/7 2026-02-12T18:05:18.755 INFO:teuthology.orchestra.run.trial048.stdout: Installing : ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 7/7 2026-02-12T18:05:18.866 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 7/7 2026-02-12T18:05:18.866 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 1/7 2026-02-12T18:05:18.866 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/7 2026-02-12T18:05:18.866 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-jinja2-2.11.3-8.el9.noarch 3/7 2026-02-12T18:05:18.866 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 4/7 2026-02-12T18:05:18.866 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 5/7 2026-02-12T18:05:18.867 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 6/7 2026-02-12T18:05:18.922 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : python3-typing-extensions-4.15.0-1.el9.noarch 7/7 2026-02-12T18:05:18.922 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:18.922 INFO:teuthology.orchestra.run.trial048.stdout:Installed: 2026-02-12T18:05:18.922 INFO:teuthology.orchestra.run.trial048.stdout: ceph-mgr-cephadm-2:20.3.0-5230.gafefaa40.el9.noarch 2026-02-12T18:05:18.922 INFO:teuthology.orchestra.run.trial048.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2026-02-12T18:05:18.922 INFO:teuthology.orchestra.run.trial048.stdout: python3-babel-2.9.1-2.el9.noarch 2026-02-12T18:05:18.922 INFO:teuthology.orchestra.run.trial048.stdout: python3-jinja2-2.11.3-8.el9.noarch 2026-02-12T18:05:18.922 INFO:teuthology.orchestra.run.trial048.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2026-02-12T18:05:18.922 INFO:teuthology.orchestra.run.trial048.stdout: python3-natsort-7.1.1-5.el9.noarch 2026-02-12T18:05:18.923 INFO:teuthology.orchestra.run.trial048.stdout: python3-typing-extensions-4.15.0-1.el9.noarch 2026-02-12T18:05:18.923 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:18.923 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:05:18.953 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install ceph-osd 2026-02-12T18:05:19.258 INFO:teuthology.orchestra.run.trial048.stdout:Last metadata expiration check: 0:01:13 ago on Thu 12 Feb 2026 06:04:06 PM UTC. 2026-02-12T18:05:19.322 INFO:teuthology.orchestra.run.trial048.stdout:Package ceph-osd-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T18:05:19.340 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:05:19.341 INFO:teuthology.orchestra.run.trial048.stdout:Nothing to do. 2026-02-12T18:05:19.341 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:05:19.362 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install ceph-osd-classic 2026-02-12T18:05:19.669 INFO:teuthology.orchestra.run.trial048.stdout:Last metadata expiration check: 0:01:13 ago on Thu 12 Feb 2026 06:04:06 PM UTC. 2026-02-12T18:05:19.734 INFO:teuthology.orchestra.run.trial048.stdout:Package ceph-osd-classic-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T18:05:19.752 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:05:19.753 INFO:teuthology.orchestra.run.trial048.stdout:Nothing to do. 2026-02-12T18:05:19.753 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:05:19.774 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install ceph-fuse 2026-02-12T18:05:20.070 INFO:teuthology.orchestra.run.trial048.stdout:Last metadata expiration check: 0:01:14 ago on Thu 12 Feb 2026 06:04:06 PM UTC. 2026-02-12T18:05:20.154 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:05:20.154 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:20.154 INFO:teuthology.orchestra.run.trial048.stdout: Package Arch Version Repo Size 2026-02-12T18:05:20.154 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:20.154 INFO:teuthology.orchestra.run.trial048.stdout:Installing: 2026-02-12T18:05:20.155 INFO:teuthology.orchestra.run.trial048.stdout: ceph-fuse x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 987 k 2026-02-12T18:05:20.155 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:20.155 INFO:teuthology.orchestra.run.trial048.stdout:Transaction Summary 2026-02-12T18:05:20.155 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:20.155 INFO:teuthology.orchestra.run.trial048.stdout:Install 1 Package 2026-02-12T18:05:20.155 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:20.155 INFO:teuthology.orchestra.run.trial048.stdout:Total download size: 987 k 2026-02-12T18:05:20.155 INFO:teuthology.orchestra.run.trial048.stdout:Installed size: 2.9 M 2026-02-12T18:05:20.155 INFO:teuthology.orchestra.run.trial048.stdout:Downloading Packages: 2026-02-12T18:05:20.274 INFO:teuthology.orchestra.run.trial048.stdout:ceph-fuse-20.3.0-5230.gafefaa40.el9.x86_64.rpm 8.1 MB/s | 987 kB 00:00 2026-02-12T18:05:20.274 INFO:teuthology.orchestra.run.trial048.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:05:20.274 INFO:teuthology.orchestra.run.trial048.stdout:Total 8.1 MB/s | 987 kB 00:00 2026-02-12T18:05:20.274 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction check 2026-02-12T18:05:20.278 INFO:teuthology.orchestra.run.trial048.stdout:Transaction check succeeded. 2026-02-12T18:05:20.278 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction test 2026-02-12T18:05:20.314 INFO:teuthology.orchestra.run.trial048.stdout:Transaction test succeeded. 2026-02-12T18:05:20.314 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction 2026-02-12T18:05:20.405 INFO:teuthology.orchestra.run.trial048.stdout: Preparing : 1/1 2026-02-12T18:05:20.422 INFO:teuthology.orchestra.run.trial048.stdout: Installing : ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:20.628 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:20.684 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:20.684 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:20.684 INFO:teuthology.orchestra.run.trial048.stdout:Installed: 2026-02-12T18:05:20.684 INFO:teuthology.orchestra.run.trial048.stdout: ceph-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:05:20.685 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:20.685 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:05:20.711 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install ceph-volume 2026-02-12T18:05:21.008 INFO:teuthology.orchestra.run.trial048.stdout:Last metadata expiration check: 0:01:15 ago on Thu 12 Feb 2026 06:04:06 PM UTC. 2026-02-12T18:05:21.092 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:05:21.093 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:21.093 INFO:teuthology.orchestra.run.trial048.stdout: Package Arch Version Repository Size 2026-02-12T18:05:21.093 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:21.093 INFO:teuthology.orchestra.run.trial048.stdout:Installing: 2026-02-12T18:05:21.093 INFO:teuthology.orchestra.run.trial048.stdout: ceph-volume noarch 2:20.3.0-5230.gafefaa40.el9 ceph-noarch 299 k 2026-02-12T18:05:21.093 INFO:teuthology.orchestra.run.trial048.stdout:Installing dependencies: 2026-02-12T18:05:21.093 INFO:teuthology.orchestra.run.trial048.stdout: cryptsetup x86_64 2.8.1-2.el9 baseos 350 k 2026-02-12T18:05:21.094 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:21.094 INFO:teuthology.orchestra.run.trial048.stdout:Transaction Summary 2026-02-12T18:05:21.094 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:21.094 INFO:teuthology.orchestra.run.trial048.stdout:Install 2 Packages 2026-02-12T18:05:21.094 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:21.094 INFO:teuthology.orchestra.run.trial048.stdout:Total download size: 649 k 2026-02-12T18:05:21.094 INFO:teuthology.orchestra.run.trial048.stdout:Installed size: 2.2 M 2026-02-12T18:05:21.094 INFO:teuthology.orchestra.run.trial048.stdout:Downloading Packages: 2026-02-12T18:05:21.248 INFO:teuthology.orchestra.run.trial048.stdout:(1/2): ceph-volume-20.3.0-5230.gafefaa40.el9.no 3.1 MB/s | 299 kB 00:00 2026-02-12T18:05:22.080 INFO:teuthology.orchestra.run.trial048.stdout:(2/2): cryptsetup-2.8.1-2.el9.x86_64.rpm 379 kB/s | 350 kB 00:00 2026-02-12T18:05:22.083 INFO:teuthology.orchestra.run.trial048.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:05:22.083 INFO:teuthology.orchestra.run.trial048.stdout:Total 656 kB/s | 649 kB 00:00 2026-02-12T18:05:22.093 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction check 2026-02-12T18:05:22.099 INFO:teuthology.orchestra.run.trial048.stdout:Transaction check succeeded. 2026-02-12T18:05:22.099 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction test 2026-02-12T18:05:22.144 INFO:teuthology.orchestra.run.trial048.stdout:Transaction test succeeded. 2026-02-12T18:05:22.144 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction 2026-02-12T18:05:22.222 INFO:teuthology.orchestra.run.trial048.stdout: Preparing : 1/1 2026-02-12T18:05:22.284 INFO:teuthology.orchestra.run.trial048.stdout: Installing : cryptsetup-2.8.1-2.el9.x86_64 1/2 2026-02-12T18:05:22.286 INFO:teuthology.orchestra.run.trial048.stdout: Installing : ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch 2/2 2026-02-12T18:05:22.300 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch 2/2 2026-02-12T18:05:22.300 INFO:teuthology.orchestra.run.trial048.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T18:05:22.300 INFO:teuthology.orchestra.run.trial048.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2026-02-12T18:05:22.300 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:22.526 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch 1/2 2026-02-12T18:05:22.583 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : cryptsetup-2.8.1-2.el9.x86_64 2/2 2026-02-12T18:05:22.584 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:22.584 INFO:teuthology.orchestra.run.trial048.stdout:Installed: 2026-02-12T18:05:22.584 INFO:teuthology.orchestra.run.trial048.stdout: ceph-volume-2:20.3.0-5230.gafefaa40.el9.noarch cryptsetup-2.8.1-2.el9.x86_64 2026-02-12T18:05:22.584 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:22.584 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:05:22.614 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install librados-devel 2026-02-12T18:05:22.920 INFO:teuthology.orchestra.run.trial048.stdout:Last metadata expiration check: 0:01:16 ago on Thu 12 Feb 2026 06:04:06 PM UTC. 2026-02-12T18:05:23.005 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:05:23.005 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:23.005 INFO:teuthology.orchestra.run.trial048.stdout: Package Arch Version Repo Size 2026-02-12T18:05:23.005 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:23.005 INFO:teuthology.orchestra.run.trial048.stdout:Installing: 2026-02-12T18:05:23.005 INFO:teuthology.orchestra.run.trial048.stdout: librados-devel x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 123 k 2026-02-12T18:05:23.005 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:23.006 INFO:teuthology.orchestra.run.trial048.stdout:Transaction Summary 2026-02-12T18:05:23.006 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:23.006 INFO:teuthology.orchestra.run.trial048.stdout:Install 1 Package 2026-02-12T18:05:23.006 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:23.006 INFO:teuthology.orchestra.run.trial048.stdout:Total download size: 123 k 2026-02-12T18:05:23.006 INFO:teuthology.orchestra.run.trial048.stdout:Installed size: 437 k 2026-02-12T18:05:23.006 INFO:teuthology.orchestra.run.trial048.stdout:Downloading Packages: 2026-02-12T18:05:23.089 INFO:teuthology.orchestra.run.trial048.stdout:librados-devel-20.3.0-5230.gafefaa40.el9.x86_64 1.4 MB/s | 123 kB 00:00 2026-02-12T18:05:23.089 INFO:teuthology.orchestra.run.trial048.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:05:23.089 INFO:teuthology.orchestra.run.trial048.stdout:Total 1.4 MB/s | 123 kB 00:00 2026-02-12T18:05:23.089 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction check 2026-02-12T18:05:23.092 INFO:teuthology.orchestra.run.trial048.stdout:Transaction check succeeded. 2026-02-12T18:05:23.092 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction test 2026-02-12T18:05:23.123 INFO:teuthology.orchestra.run.trial048.stdout:Transaction test succeeded. 2026-02-12T18:05:23.123 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction 2026-02-12T18:05:23.176 INFO:teuthology.orchestra.run.trial048.stdout: Preparing : 1/1 2026-02-12T18:05:23.192 INFO:teuthology.orchestra.run.trial048.stdout: Installing : librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:23.279 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:23.335 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:23.335 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:23.335 INFO:teuthology.orchestra.run.trial048.stdout:Installed: 2026-02-12T18:05:23.335 INFO:teuthology.orchestra.run.trial048.stdout: librados-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:05:23.336 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:23.336 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:05:23.364 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install libcephfs2 2026-02-12T18:05:23.669 INFO:teuthology.orchestra.run.trial048.stdout:Last metadata expiration check: 0:01:17 ago on Thu 12 Feb 2026 06:04:06 PM UTC. 2026-02-12T18:05:23.735 INFO:teuthology.orchestra.run.trial048.stdout:Package libcephfs2-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T18:05:23.754 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:05:23.754 INFO:teuthology.orchestra.run.trial048.stdout:Nothing to do. 2026-02-12T18:05:23.754 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:05:23.775 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install libcephfs-devel 2026-02-12T18:05:24.078 INFO:teuthology.orchestra.run.trial048.stdout:Last metadata expiration check: 0:01:18 ago on Thu 12 Feb 2026 06:04:06 PM UTC. 2026-02-12T18:05:24.163 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:05:24.163 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:24.163 INFO:teuthology.orchestra.run.trial048.stdout: Package Arch Version Repo Size 2026-02-12T18:05:24.163 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:24.163 INFO:teuthology.orchestra.run.trial048.stdout:Installing: 2026-02-12T18:05:24.163 INFO:teuthology.orchestra.run.trial048.stdout: libcephfs-devel x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 37 k 2026-02-12T18:05:24.164 INFO:teuthology.orchestra.run.trial048.stdout:Installing dependencies: 2026-02-12T18:05:24.164 INFO:teuthology.orchestra.run.trial048.stdout: libcephfs-proxy2 x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 25 k 2026-02-12T18:05:24.164 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:24.164 INFO:teuthology.orchestra.run.trial048.stdout:Transaction Summary 2026-02-12T18:05:24.164 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:24.164 INFO:teuthology.orchestra.run.trial048.stdout:Install 2 Packages 2026-02-12T18:05:24.164 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:24.164 INFO:teuthology.orchestra.run.trial048.stdout:Total download size: 62 k 2026-02-12T18:05:24.164 INFO:teuthology.orchestra.run.trial048.stdout:Installed size: 223 k 2026-02-12T18:05:24.164 INFO:teuthology.orchestra.run.trial048.stdout:Downloading Packages: 2026-02-12T18:05:24.448 INFO:teuthology.orchestra.run.trial048.stdout:(1/2): libcephfs-devel-20.3.0-5230.gafefaa40.el 131 kB/s | 37 kB 00:00 2026-02-12T18:05:24.448 INFO:teuthology.orchestra.run.trial048.stdout:(2/2): libcephfs-proxy2-20.3.0-5230.gafefaa40.e 87 kB/s | 25 kB 00:00 2026-02-12T18:05:24.449 INFO:teuthology.orchestra.run.trial048.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:05:24.449 INFO:teuthology.orchestra.run.trial048.stdout:Total 218 kB/s | 62 kB 00:00 2026-02-12T18:05:24.449 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction check 2026-02-12T18:05:24.452 INFO:teuthology.orchestra.run.trial048.stdout:Transaction check succeeded. 2026-02-12T18:05:24.452 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction test 2026-02-12T18:05:24.485 INFO:teuthology.orchestra.run.trial048.stdout:Transaction test succeeded. 2026-02-12T18:05:24.485 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction 2026-02-12T18:05:24.533 INFO:teuthology.orchestra.run.trial048.stdout: Preparing : 1/1 2026-02-12T18:05:24.534 INFO:teuthology.orchestra.run.trial048.stdout: Installing : libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 1/2 2026-02-12T18:05:24.549 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 1/2 2026-02-12T18:05:24.565 INFO:teuthology.orchestra.run.trial048.stdout: Installing : libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2/2 2026-02-12T18:05:24.617 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2/2 2026-02-12T18:05:24.617 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 1/2 2026-02-12T18:05:24.673 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 2/2 2026-02-12T18:05:24.673 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:24.673 INFO:teuthology.orchestra.run.trial048.stdout:Installed: 2026-02-12T18:05:24.673 INFO:teuthology.orchestra.run.trial048.stdout: libcephfs-devel-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:05:24.673 INFO:teuthology.orchestra.run.trial048.stdout: libcephfs-proxy2-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:05:24.673 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:24.673 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:05:24.699 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install librados2 2026-02-12T18:05:24.997 INFO:teuthology.orchestra.run.trial048.stdout:Last metadata expiration check: 0:01:18 ago on Thu 12 Feb 2026 06:04:06 PM UTC. 2026-02-12T18:05:25.062 INFO:teuthology.orchestra.run.trial048.stdout:Package librados2-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T18:05:25.081 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:05:25.081 INFO:teuthology.orchestra.run.trial048.stdout:Nothing to do. 2026-02-12T18:05:25.081 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:05:25.102 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install librbd1 2026-02-12T18:05:25.402 INFO:teuthology.orchestra.run.trial048.stdout:Last metadata expiration check: 0:01:19 ago on Thu 12 Feb 2026 06:04:06 PM UTC. 2026-02-12T18:05:25.468 INFO:teuthology.orchestra.run.trial048.stdout:Package librbd1-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T18:05:25.486 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:05:25.486 INFO:teuthology.orchestra.run.trial048.stdout:Nothing to do. 2026-02-12T18:05:25.486 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:05:25.507 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install python3-rados 2026-02-12T18:05:25.811 INFO:teuthology.orchestra.run.trial048.stdout:Last metadata expiration check: 0:01:19 ago on Thu 12 Feb 2026 06:04:06 PM UTC. 2026-02-12T18:05:25.877 INFO:teuthology.orchestra.run.trial048.stdout:Package python3-rados-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T18:05:25.896 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:05:25.896 INFO:teuthology.orchestra.run.trial048.stdout:Nothing to do. 2026-02-12T18:05:25.896 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:05:25.918 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install python3-rgw 2026-02-12T18:05:26.217 INFO:teuthology.orchestra.run.trial048.stdout:Last metadata expiration check: 0:01:20 ago on Thu 12 Feb 2026 06:04:06 PM UTC. 2026-02-12T18:05:26.282 INFO:teuthology.orchestra.run.trial048.stdout:Package python3-rgw-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T18:05:26.300 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:05:26.301 INFO:teuthology.orchestra.run.trial048.stdout:Nothing to do. 2026-02-12T18:05:26.301 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:05:26.323 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install python3-cephfs 2026-02-12T18:05:26.624 INFO:teuthology.orchestra.run.trial048.stdout:Last metadata expiration check: 0:01:20 ago on Thu 12 Feb 2026 06:04:06 PM UTC. 2026-02-12T18:05:26.689 INFO:teuthology.orchestra.run.trial048.stdout:Package python3-cephfs-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T18:05:26.707 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:05:26.707 INFO:teuthology.orchestra.run.trial048.stdout:Nothing to do. 2026-02-12T18:05:26.707 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:05:26.729 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install python3-rbd 2026-02-12T18:05:27.036 INFO:teuthology.orchestra.run.trial048.stdout:Last metadata expiration check: 0:01:21 ago on Thu 12 Feb 2026 06:04:06 PM UTC. 2026-02-12T18:05:27.102 INFO:teuthology.orchestra.run.trial048.stdout:Package python3-rbd-2:20.3.0-5230.gafefaa40.el9.x86_64 is already installed. 2026-02-12T18:05:27.120 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:05:27.120 INFO:teuthology.orchestra.run.trial048.stdout:Nothing to do. 2026-02-12T18:05:27.120 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:05:27.141 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install rbd-fuse 2026-02-12T18:05:27.437 INFO:teuthology.orchestra.run.trial048.stdout:Last metadata expiration check: 0:01:21 ago on Thu 12 Feb 2026 06:04:06 PM UTC. 2026-02-12T18:05:27.521 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:05:27.521 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:27.521 INFO:teuthology.orchestra.run.trial048.stdout: Package Architecture Version Repository Size 2026-02-12T18:05:27.522 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:27.522 INFO:teuthology.orchestra.run.trial048.stdout:Installing: 2026-02-12T18:05:27.522 INFO:teuthology.orchestra.run.trial048.stdout: rbd-fuse x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 84 k 2026-02-12T18:05:27.522 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:27.522 INFO:teuthology.orchestra.run.trial048.stdout:Transaction Summary 2026-02-12T18:05:27.522 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:27.522 INFO:teuthology.orchestra.run.trial048.stdout:Install 1 Package 2026-02-12T18:05:27.522 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:27.522 INFO:teuthology.orchestra.run.trial048.stdout:Total download size: 84 k 2026-02-12T18:05:27.522 INFO:teuthology.orchestra.run.trial048.stdout:Installed size: 209 k 2026-02-12T18:05:27.522 INFO:teuthology.orchestra.run.trial048.stdout:Downloading Packages: 2026-02-12T18:05:27.606 INFO:teuthology.orchestra.run.trial048.stdout:rbd-fuse-20.3.0-5230.gafefaa40.el9.x86_64.rpm 1.0 MB/s | 84 kB 00:00 2026-02-12T18:05:27.607 INFO:teuthology.orchestra.run.trial048.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:05:27.608 INFO:teuthology.orchestra.run.trial048.stdout:Total 982 kB/s | 84 kB 00:00 2026-02-12T18:05:27.608 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction check 2026-02-12T18:05:27.612 INFO:teuthology.orchestra.run.trial048.stdout:Transaction check succeeded. 2026-02-12T18:05:27.612 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction test 2026-02-12T18:05:27.644 INFO:teuthology.orchestra.run.trial048.stdout:Transaction test succeeded. 2026-02-12T18:05:27.645 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction 2026-02-12T18:05:27.694 INFO:teuthology.orchestra.run.trial048.stdout: Preparing : 1/1 2026-02-12T18:05:27.711 INFO:teuthology.orchestra.run.trial048.stdout: Installing : rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:27.788 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:27.844 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:27.844 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:27.844 INFO:teuthology.orchestra.run.trial048.stdout:Installed: 2026-02-12T18:05:27.844 INFO:teuthology.orchestra.run.trial048.stdout: rbd-fuse-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:05:27.844 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:27.844 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:05:27.871 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install rbd-mirror 2026-02-12T18:05:28.169 INFO:teuthology.orchestra.run.trial048.stdout:Last metadata expiration check: 0:01:22 ago on Thu 12 Feb 2026 06:04:06 PM UTC. 2026-02-12T18:05:28.253 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:05:28.254 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:28.254 INFO:teuthology.orchestra.run.trial048.stdout: Package Arch Version Repo Size 2026-02-12T18:05:28.254 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:28.254 INFO:teuthology.orchestra.run.trial048.stdout:Installing: 2026-02-12T18:05:28.255 INFO:teuthology.orchestra.run.trial048.stdout: rbd-mirror x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 2.9 M 2026-02-12T18:05:28.255 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:28.255 INFO:teuthology.orchestra.run.trial048.stdout:Transaction Summary 2026-02-12T18:05:28.255 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:28.255 INFO:teuthology.orchestra.run.trial048.stdout:Install 1 Package 2026-02-12T18:05:28.255 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:28.255 INFO:teuthology.orchestra.run.trial048.stdout:Total download size: 2.9 M 2026-02-12T18:05:28.255 INFO:teuthology.orchestra.run.trial048.stdout:Installed size: 11 M 2026-02-12T18:05:28.255 INFO:teuthology.orchestra.run.trial048.stdout:Downloading Packages: 2026-02-12T18:05:28.401 INFO:teuthology.orchestra.run.trial048.stdout:rbd-mirror-20.3.0-5230.gafefaa40.el9.x86_64.rpm 20 MB/s | 2.9 MB 00:00 2026-02-12T18:05:28.401 INFO:teuthology.orchestra.run.trial048.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:05:28.401 INFO:teuthology.orchestra.run.trial048.stdout:Total 19 MB/s | 2.9 MB 00:00 2026-02-12T18:05:28.401 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction check 2026-02-12T18:05:28.406 INFO:teuthology.orchestra.run.trial048.stdout:Transaction check succeeded. 2026-02-12T18:05:28.406 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction test 2026-02-12T18:05:28.446 INFO:teuthology.orchestra.run.trial048.stdout:Transaction test succeeded. 2026-02-12T18:05:28.446 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction 2026-02-12T18:05:28.621 INFO:teuthology.orchestra.run.trial048.stdout: Preparing : 1/1 2026-02-12T18:05:28.623 INFO:teuthology.orchestra.run.trial048.stdout: Installing : rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:28.645 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:28.645 INFO:teuthology.orchestra.run.trial048.stdout:Glob pattern passed to enable, but globs are not supported for this. 2026-02-12T18:05:28.645 INFO:teuthology.orchestra.run.trial048.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2026-02-12T18:05:28.645 INFO:teuthology.orchestra.run.trial048.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T18:05:28.645 INFO:teuthology.orchestra.run.trial048.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2026-02-12T18:05:28.645 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:28.934 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:28.934 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:28.934 INFO:teuthology.orchestra.run.trial048.stdout:Installed: 2026-02-12T18:05:28.934 INFO:teuthology.orchestra.run.trial048.stdout: rbd-mirror-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:05:28.934 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:28.934 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:05:28.961 DEBUG:teuthology.orchestra.run.trial048:> sudo yum -y install rbd-nbd 2026-02-12T18:05:29.259 INFO:teuthology.orchestra.run.trial048.stdout:Last metadata expiration check: 0:01:23 ago on Thu 12 Feb 2026 06:04:06 PM UTC. 2026-02-12T18:05:29.342 INFO:teuthology.orchestra.run.trial048.stdout:Dependencies resolved. 2026-02-12T18:05:29.343 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:29.343 INFO:teuthology.orchestra.run.trial048.stdout: Package Architecture Version Repository Size 2026-02-12T18:05:29.343 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:29.343 INFO:teuthology.orchestra.run.trial048.stdout:Installing: 2026-02-12T18:05:29.344 INFO:teuthology.orchestra.run.trial048.stdout: rbd-nbd x86_64 2:20.3.0-5230.gafefaa40.el9 ceph 172 k 2026-02-12T18:05:29.344 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:29.344 INFO:teuthology.orchestra.run.trial048.stdout:Transaction Summary 2026-02-12T18:05:29.344 INFO:teuthology.orchestra.run.trial048.stdout:================================================================================ 2026-02-12T18:05:29.344 INFO:teuthology.orchestra.run.trial048.stdout:Install 1 Package 2026-02-12T18:05:29.344 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:29.344 INFO:teuthology.orchestra.run.trial048.stdout:Total download size: 172 k 2026-02-12T18:05:29.344 INFO:teuthology.orchestra.run.trial048.stdout:Installed size: 462 k 2026-02-12T18:05:29.344 INFO:teuthology.orchestra.run.trial048.stdout:Downloading Packages: 2026-02-12T18:05:29.428 INFO:teuthology.orchestra.run.trial048.stdout:rbd-nbd-20.3.0-5230.gafefaa40.el9.x86_64.rpm 2.0 MB/s | 172 kB 00:00 2026-02-12T18:05:29.429 INFO:teuthology.orchestra.run.trial048.stdout:-------------------------------------------------------------------------------- 2026-02-12T18:05:29.429 INFO:teuthology.orchestra.run.trial048.stdout:Total 2.0 MB/s | 172 kB 00:00 2026-02-12T18:05:29.429 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction check 2026-02-12T18:05:29.433 INFO:teuthology.orchestra.run.trial048.stdout:Transaction check succeeded. 2026-02-12T18:05:29.433 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction test 2026-02-12T18:05:29.465 INFO:teuthology.orchestra.run.trial048.stdout:Transaction test succeeded. 2026-02-12T18:05:29.465 INFO:teuthology.orchestra.run.trial048.stdout:Running transaction 2026-02-12T18:05:29.520 INFO:teuthology.orchestra.run.trial048.stdout: Preparing : 1/1 2026-02-12T18:05:29.537 INFO:teuthology.orchestra.run.trial048.stdout: Installing : rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:29.616 INFO:teuthology.orchestra.run.trial048.stdout: Running scriptlet: rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:29.675 INFO:teuthology.orchestra.run.trial048.stdout: Verifying : rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 1/1 2026-02-12T18:05:29.675 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:29.675 INFO:teuthology.orchestra.run.trial048.stdout:Installed: 2026-02-12T18:05:29.675 INFO:teuthology.orchestra.run.trial048.stdout: rbd-nbd-2:20.3.0-5230.gafefaa40.el9.x86_64 2026-02-12T18:05:29.675 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:29.675 INFO:teuthology.orchestra.run.trial048.stdout:Complete! 2026-02-12T18:05:29.706 DEBUG:teuthology.parallel:result is None 2026-02-12T18:05:29.707 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-12T18:05:29.871 DEBUG:teuthology.orchestra.run.trial048:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T18:05:29.892 INFO:teuthology.orchestra.run.trial048.stdout:20.3.0-5230.gafefaa40.el9 2026-02-12T18:05:29.893 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5230.gafefaa40.el9 2026-02-12T18:05:29.893 INFO:teuthology.task.install:The correct ceph version 20.3.0-5230.gafefaa40 is installed. 2026-02-12T18:05:29.895 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=afefaa40503a4bf024e96f97dd7f852b75f00ad6 2026-02-12T18:05:30.051 DEBUG:teuthology.orchestra.run.trial111:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2026-02-12T18:05:30.072 INFO:teuthology.orchestra.run.trial111.stdout:20.3.0-5230.gafefaa40.el9 2026-02-12T18:05:30.072 INFO:teuthology.packaging:The installed version of ceph is 20.3.0-5230.gafefaa40.el9 2026-02-12T18:05:30.073 INFO:teuthology.task.install:The correct ceph version 20.3.0-5230.gafefaa40 is installed. 2026-02-12T18:05:30.074 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2026-02-12T18:05:30.075 DEBUG:teuthology.orchestra.run.trial048:> set -ex 2026-02-12T18:05:30.075 DEBUG:teuthology.orchestra.run.trial048:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-12T18:05:30.100 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T18:05:30.101 DEBUG:teuthology.orchestra.run.trial111:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2026-02-12T18:05:30.137 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2026-02-12T18:05:30.137 DEBUG:teuthology.orchestra.run.trial048:> set -ex 2026-02-12T18:05:30.137 DEBUG:teuthology.orchestra.run.trial048:> sudo dd of=/usr/bin/daemon-helper 2026-02-12T18:05:30.166 DEBUG:teuthology.orchestra.run.trial048:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-12T18:05:30.230 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T18:05:30.230 DEBUG:teuthology.orchestra.run.trial111:> sudo dd of=/usr/bin/daemon-helper 2026-02-12T18:05:30.255 DEBUG:teuthology.orchestra.run.trial111:> sudo chmod a=rx -- /usr/bin/daemon-helper 2026-02-12T18:05:30.321 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2026-02-12T18:05:30.321 DEBUG:teuthology.orchestra.run.trial048:> set -ex 2026-02-12T18:05:30.321 DEBUG:teuthology.orchestra.run.trial048:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-12T18:05:30.347 DEBUG:teuthology.orchestra.run.trial048:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-12T18:05:30.411 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T18:05:30.411 DEBUG:teuthology.orchestra.run.trial111:> sudo dd of=/usr/bin/adjust-ulimits 2026-02-12T18:05:30.437 DEBUG:teuthology.orchestra.run.trial111:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2026-02-12T18:05:30.499 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2026-02-12T18:05:30.500 DEBUG:teuthology.orchestra.run.trial048:> set -ex 2026-02-12T18:05:30.500 DEBUG:teuthology.orchestra.run.trial048:> sudo dd of=/usr/bin/stdin-killer 2026-02-12T18:05:30.526 DEBUG:teuthology.orchestra.run.trial048:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-12T18:05:30.592 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T18:05:30.592 DEBUG:teuthology.orchestra.run.trial111:> sudo dd of=/usr/bin/stdin-killer 2026-02-12T18:05:30.617 DEBUG:teuthology.orchestra.run.trial111:> sudo chmod a=rx -- /usr/bin/stdin-killer 2026-02-12T18:05:30.682 INFO:teuthology.run_tasks:Running task ceph... 2026-02-12T18:05:30.753 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2026-02-12T18:05:30.753 DEBUG:teuthology.orchestra.run.trial048:> sudo chmod 777 /var/log/ceph 2026-02-12T18:05:30.755 DEBUG:teuthology.orchestra.run.trial111:> sudo chmod 777 /var/log/ceph 2026-02-12T18:05:30.779 INFO:tasks.ceph:Disabling ceph logrotate... 2026-02-12T18:05:30.780 DEBUG:teuthology.orchestra.run.trial048:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-12T18:05:30.820 DEBUG:teuthology.orchestra.run.trial111:> sudo rm -f -- /etc/logrotate.d/ceph 2026-02-12T18:05:30.843 INFO:tasks.ceph:Creating extra log directories... 2026-02-12T18:05:30.843 DEBUG:teuthology.orchestra.run.trial048:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-12T18:05:30.883 DEBUG:teuthology.orchestra.run.trial111:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2026-02-12T18:05:30.924 INFO:tasks.ceph:Creating ceph cluster ceph... 2026-02-12T18:05:30.924 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 30, 'debug ms': 20, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'btree', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', '\\(MON_NETSPLIT)', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(TOO_FEW_PGS\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'slow request', 'overall HEALTH_'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2026-02-12T18:05:30.925 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46480', 'branch': 'wip-yuri4-testing-2026-02-11-2126', 'description': 'rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-2} onode-segment$/{none} write$/{random/{compr$/{no$/{no}} random}}}} rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/pool-create-delete}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'flavor': 'default', 'job_id': '46480', 'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'trial', 'name': 'yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuri4-testing-2026-02-11-2126'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug monc': 10, 'debug ms': 1}, 'mon': {'debug mon': 30, 'debug ms': 20, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'btree', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', '\\(MON_NETSPLIT)', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(TOO_FEW_PGS\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'slow request', 'overall HEALTH_'], 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri4-testing-2026-02-11-2126', 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6'}}, 'owner': 'scheduled_yuriw@soko04.front.sepia.ceph.com', 'priority': 69, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mon.d', 'mon.e', 'osd.0', 'osd.1', 'osd.2'], ['mon.f', 'mon.g', 'mon.h', 'mon.i', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0']], 'seed': 7172, 'sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri4-testing-2026-02-11-2126', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_afefaa40503a4bf024e96f97dd7f852b75f00ad6/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'afefaa40503a4bf024e96f97dd7f852b75f00ad6', 'targets': {'trial048.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHA1ur+CG4dYiTh1spKZKqqy6kHAiuLyqofyS0PLgbwRy+5fyF1Ew/oHe7ryoqS1M4/sjNiOu1JwOMLoEVp54Ug=', 'trial111.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHLMj3uW895BU8xAMMCUg9cYl1I8UY9QRJ7Hjphx0qHaV/EvtZfcnEarw6IKaMCYZK8y06MFZJX2QGdIJ3q/+z8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'branch': 'distro', 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'mon_thrash': {'revive_delay': 90, 'store_thrash': True, 'thrash_delay': 1, 'thrash_many': True}}, {'exec': {'client.0': ['ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '8bec0da71becad44414c54979f64c9ef0e7099c6', 'timestamp': '2026-02-12_15:38:14', 'tube': 'trial', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/mnt/teuthology/worker_logs/dispatcher.trial.3932482'} 2026-02-12T18:05:30.925 DEBUG:teuthology.orchestra.run.trial048:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-12T18:05:30.947 DEBUG:teuthology.orchestra.run.trial111:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2026-02-12T18:05:30.964 DEBUG:teuthology.orchestra.run.trial048:> sudo install -d -m0777 -- /var/run/ceph 2026-02-12T18:05:31.003 DEBUG:teuthology.orchestra.run.trial111:> sudo install -d -m0777 -- /var/run/ceph 2026-02-12T18:05:31.030 DEBUG:teuthology.orchestra.run.trial048:> set -ex 2026-02-12T18:05:31.030 DEBUG:teuthology.orchestra.run.trial048:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T18:05:31.081 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-12T18:05:31.081 DEBUG:teuthology.orchestra.run.trial048:> stat /dev/vg_nvme/lv_1 2026-02-12T18:05:31.137 INFO:teuthology.orchestra.run.trial048.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-12T18:05:31.138 INFO:teuthology.orchestra.run.trial048.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T18:05:31.138 INFO:teuthology.orchestra.run.trial048.stdout:Device: 6h/6d Inode: 914 Links: 1 2026-02-12T18:05:31.138 INFO:teuthology.orchestra.run.trial048.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T18:05:31.138 INFO:teuthology.orchestra.run.trial048.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T18:05:31.138 INFO:teuthology.orchestra.run.trial048.stdout:Access: 2026-02-12 18:05:28.777091491 +0000 2026-02-12T18:05:31.138 INFO:teuthology.orchestra.run.trial048.stdout:Modify: 2026-02-12 18:03:21.618865324 +0000 2026-02-12T18:05:31.138 INFO:teuthology.orchestra.run.trial048.stdout:Change: 2026-02-12 18:03:21.618865324 +0000 2026-02-12T18:05:31.138 INFO:teuthology.orchestra.run.trial048.stdout: Birth: 2026-02-12 18:03:21.618865324 +0000 2026-02-12T18:05:31.138 DEBUG:teuthology.orchestra.run.trial048:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-12T18:05:31.200 INFO:teuthology.orchestra.run.trial048.stderr:1+0 records in 2026-02-12T18:05:31.200 INFO:teuthology.orchestra.run.trial048.stderr:1+0 records out 2026-02-12T18:05:31.200 INFO:teuthology.orchestra.run.trial048.stderr:512 bytes copied, 0.000172087 s, 3.0 MB/s 2026-02-12T18:05:31.201 DEBUG:teuthology.orchestra.run.trial048:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-12T18:05:31.258 DEBUG:teuthology.orchestra.run.trial048:> stat /dev/vg_nvme/lv_2 2026-02-12T18:05:31.315 INFO:teuthology.orchestra.run.trial048.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-12T18:05:31.315 INFO:teuthology.orchestra.run.trial048.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T18:05:31.315 INFO:teuthology.orchestra.run.trial048.stdout:Device: 6h/6d Inode: 938 Links: 1 2026-02-12T18:05:31.315 INFO:teuthology.orchestra.run.trial048.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T18:05:31.315 INFO:teuthology.orchestra.run.trial048.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T18:05:31.315 INFO:teuthology.orchestra.run.trial048.stdout:Access: 2026-02-12 18:05:28.777091491 +0000 2026-02-12T18:05:31.315 INFO:teuthology.orchestra.run.trial048.stdout:Modify: 2026-02-12 18:03:21.866861317 +0000 2026-02-12T18:05:31.315 INFO:teuthology.orchestra.run.trial048.stdout:Change: 2026-02-12 18:03:21.866861317 +0000 2026-02-12T18:05:31.315 INFO:teuthology.orchestra.run.trial048.stdout: Birth: 2026-02-12 18:03:21.866861317 +0000 2026-02-12T18:05:31.316 DEBUG:teuthology.orchestra.run.trial048:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-12T18:05:31.379 INFO:teuthology.orchestra.run.trial048.stderr:1+0 records in 2026-02-12T18:05:31.379 INFO:teuthology.orchestra.run.trial048.stderr:1+0 records out 2026-02-12T18:05:31.379 INFO:teuthology.orchestra.run.trial048.stderr:512 bytes copied, 0.000131333 s, 3.9 MB/s 2026-02-12T18:05:31.380 DEBUG:teuthology.orchestra.run.trial048:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-12T18:05:31.437 DEBUG:teuthology.orchestra.run.trial048:> stat /dev/vg_nvme/lv_3 2026-02-12T18:05:31.495 INFO:teuthology.orchestra.run.trial048.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-12T18:05:31.495 INFO:teuthology.orchestra.run.trial048.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T18:05:31.495 INFO:teuthology.orchestra.run.trial048.stdout:Device: 6h/6d Inode: 967 Links: 1 2026-02-12T18:05:31.496 INFO:teuthology.orchestra.run.trial048.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T18:05:31.496 INFO:teuthology.orchestra.run.trial048.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T18:05:31.496 INFO:teuthology.orchestra.run.trial048.stdout:Access: 2026-02-12 18:05:28.777091491 +0000 2026-02-12T18:05:31.496 INFO:teuthology.orchestra.run.trial048.stdout:Modify: 2026-02-12 18:03:22.098857568 +0000 2026-02-12T18:05:31.496 INFO:teuthology.orchestra.run.trial048.stdout:Change: 2026-02-12 18:03:22.098857568 +0000 2026-02-12T18:05:31.496 INFO:teuthology.orchestra.run.trial048.stdout: Birth: 2026-02-12 18:03:22.098857568 +0000 2026-02-12T18:05:31.496 DEBUG:teuthology.orchestra.run.trial048:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-12T18:05:31.557 INFO:teuthology.orchestra.run.trial048.stderr:1+0 records in 2026-02-12T18:05:31.558 INFO:teuthology.orchestra.run.trial048.stderr:1+0 records out 2026-02-12T18:05:31.558 INFO:teuthology.orchestra.run.trial048.stderr:512 bytes copied, 0.000154194 s, 3.3 MB/s 2026-02-12T18:05:31.559 DEBUG:teuthology.orchestra.run.trial048:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-12T18:05:31.616 DEBUG:teuthology.orchestra.run.trial048:> stat /dev/vg_nvme/lv_4 2026-02-12T18:05:31.672 INFO:teuthology.orchestra.run.trial048.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-12T18:05:31.672 INFO:teuthology.orchestra.run.trial048.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T18:05:31.672 INFO:teuthology.orchestra.run.trial048.stdout:Device: 6h/6d Inode: 997 Links: 1 2026-02-12T18:05:31.673 INFO:teuthology.orchestra.run.trial048.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T18:05:31.673 INFO:teuthology.orchestra.run.trial048.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T18:05:31.673 INFO:teuthology.orchestra.run.trial048.stdout:Access: 2026-02-12 18:05:28.777091491 +0000 2026-02-12T18:05:31.673 INFO:teuthology.orchestra.run.trial048.stdout:Modify: 2026-02-12 18:03:22.331853803 +0000 2026-02-12T18:05:31.673 INFO:teuthology.orchestra.run.trial048.stdout:Change: 2026-02-12 18:03:22.331853803 +0000 2026-02-12T18:05:31.673 INFO:teuthology.orchestra.run.trial048.stdout: Birth: 2026-02-12 18:03:22.331853803 +0000 2026-02-12T18:05:31.673 DEBUG:teuthology.orchestra.run.trial048:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-12T18:05:31.736 INFO:teuthology.orchestra.run.trial048.stderr:1+0 records in 2026-02-12T18:05:31.737 INFO:teuthology.orchestra.run.trial048.stderr:1+0 records out 2026-02-12T18:05:31.737 INFO:teuthology.orchestra.run.trial048.stderr:512 bytes copied, 0.000140299 s, 3.6 MB/s 2026-02-12T18:05:31.738 DEBUG:teuthology.orchestra.run.trial048:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-12T18:05:31.796 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-12T18:05:31.796 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T18:05:31.797 DEBUG:teuthology.orchestra.run.trial111:> dd if=/scratch_devs of=/dev/stdout 2026-02-12T18:05:31.815 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2026-02-12T18:05:31.815 DEBUG:teuthology.orchestra.run.trial111:> stat /dev/vg_nvme/lv_1 2026-02-12T18:05:31.871 INFO:teuthology.orchestra.run.trial111.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2026-02-12T18:05:31.871 INFO:teuthology.orchestra.run.trial111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T18:05:31.871 INFO:teuthology.orchestra.run.trial111.stdout:Device: 6h/6d Inode: 910 Links: 1 2026-02-12T18:05:31.871 INFO:teuthology.orchestra.run.trial111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T18:05:31.871 INFO:teuthology.orchestra.run.trial111.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T18:05:31.871 INFO:teuthology.orchestra.run.trial111.stdout:Access: 2026-02-12 18:05:12.478049464 +0000 2026-02-12T18:05:31.871 INFO:teuthology.orchestra.run.trial111.stdout:Modify: 2026-02-12 18:03:20.278692281 +0000 2026-02-12T18:05:31.871 INFO:teuthology.orchestra.run.trial111.stdout:Change: 2026-02-12 18:03:20.278692281 +0000 2026-02-12T18:05:31.871 INFO:teuthology.orchestra.run.trial111.stdout: Birth: 2026-02-12 18:03:20.278692281 +0000 2026-02-12T18:05:31.872 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2026-02-12T18:05:31.935 INFO:teuthology.orchestra.run.trial111.stderr:1+0 records in 2026-02-12T18:05:31.935 INFO:teuthology.orchestra.run.trial111.stderr:1+0 records out 2026-02-12T18:05:31.935 INFO:teuthology.orchestra.run.trial111.stderr:512 bytes copied, 0.000205213 s, 2.5 MB/s 2026-02-12T18:05:31.936 DEBUG:teuthology.orchestra.run.trial111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2026-02-12T18:05:31.993 DEBUG:teuthology.orchestra.run.trial111:> stat /dev/vg_nvme/lv_2 2026-02-12T18:05:32.051 INFO:teuthology.orchestra.run.trial111.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2026-02-12T18:05:32.051 INFO:teuthology.orchestra.run.trial111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T18:05:32.052 INFO:teuthology.orchestra.run.trial111.stdout:Device: 6h/6d Inode: 939 Links: 1 2026-02-12T18:05:32.052 INFO:teuthology.orchestra.run.trial111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T18:05:32.052 INFO:teuthology.orchestra.run.trial111.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T18:05:32.052 INFO:teuthology.orchestra.run.trial111.stdout:Access: 2026-02-12 18:05:12.478049464 +0000 2026-02-12T18:05:32.052 INFO:teuthology.orchestra.run.trial111.stdout:Modify: 2026-02-12 18:03:20.519678569 +0000 2026-02-12T18:05:32.052 INFO:teuthology.orchestra.run.trial111.stdout:Change: 2026-02-12 18:03:20.519678569 +0000 2026-02-12T18:05:32.052 INFO:teuthology.orchestra.run.trial111.stdout: Birth: 2026-02-12 18:03:20.519678569 +0000 2026-02-12T18:05:32.052 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2026-02-12T18:05:32.114 INFO:teuthology.orchestra.run.trial111.stderr:1+0 records in 2026-02-12T18:05:32.114 INFO:teuthology.orchestra.run.trial111.stderr:1+0 records out 2026-02-12T18:05:32.114 INFO:teuthology.orchestra.run.trial111.stderr:512 bytes copied, 0.000186508 s, 2.7 MB/s 2026-02-12T18:05:32.115 DEBUG:teuthology.orchestra.run.trial111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2026-02-12T18:05:32.173 DEBUG:teuthology.orchestra.run.trial111:> stat /dev/vg_nvme/lv_3 2026-02-12T18:05:32.229 INFO:teuthology.orchestra.run.trial111.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2026-02-12T18:05:32.229 INFO:teuthology.orchestra.run.trial111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T18:05:32.229 INFO:teuthology.orchestra.run.trial111.stdout:Device: 6h/6d Inode: 970 Links: 1 2026-02-12T18:05:32.229 INFO:teuthology.orchestra.run.trial111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T18:05:32.229 INFO:teuthology.orchestra.run.trial111.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T18:05:32.230 INFO:teuthology.orchestra.run.trial111.stdout:Access: 2026-02-12 18:05:12.478049464 +0000 2026-02-12T18:05:32.230 INFO:teuthology.orchestra.run.trial111.stdout:Modify: 2026-02-12 18:03:20.759664913 +0000 2026-02-12T18:05:32.230 INFO:teuthology.orchestra.run.trial111.stdout:Change: 2026-02-12 18:03:20.759664913 +0000 2026-02-12T18:05:32.230 INFO:teuthology.orchestra.run.trial111.stdout: Birth: 2026-02-12 18:03:20.759664913 +0000 2026-02-12T18:05:32.230 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2026-02-12T18:05:32.293 INFO:teuthology.orchestra.run.trial111.stderr:1+0 records in 2026-02-12T18:05:32.293 INFO:teuthology.orchestra.run.trial111.stderr:1+0 records out 2026-02-12T18:05:32.293 INFO:teuthology.orchestra.run.trial111.stderr:512 bytes copied, 0.000146343 s, 3.5 MB/s 2026-02-12T18:05:32.294 DEBUG:teuthology.orchestra.run.trial111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2026-02-12T18:05:32.352 DEBUG:teuthology.orchestra.run.trial111:> stat /dev/vg_nvme/lv_4 2026-02-12T18:05:32.409 INFO:teuthology.orchestra.run.trial111.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2026-02-12T18:05:32.410 INFO:teuthology.orchestra.run.trial111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2026-02-12T18:05:32.410 INFO:teuthology.orchestra.run.trial111.stdout:Device: 6h/6d Inode: 996 Links: 1 2026-02-12T18:05:32.410 INFO:teuthology.orchestra.run.trial111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2026-02-12T18:05:32.410 INFO:teuthology.orchestra.run.trial111.stdout:Context: system_u:object_r:device_t:s0 2026-02-12T18:05:32.410 INFO:teuthology.orchestra.run.trial111.stdout:Access: 2026-02-12 18:05:12.479049447 +0000 2026-02-12T18:05:32.410 INFO:teuthology.orchestra.run.trial111.stdout:Modify: 2026-02-12 18:03:21.011650575 +0000 2026-02-12T18:05:32.410 INFO:teuthology.orchestra.run.trial111.stdout:Change: 2026-02-12 18:03:21.011650575 +0000 2026-02-12T18:05:32.410 INFO:teuthology.orchestra.run.trial111.stdout: Birth: 2026-02-12 18:03:21.011650575 +0000 2026-02-12T18:05:32.411 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2026-02-12T18:05:32.473 INFO:teuthology.orchestra.run.trial111.stderr:1+0 records in 2026-02-12T18:05:32.473 INFO:teuthology.orchestra.run.trial111.stderr:1+0 records out 2026-02-12T18:05:32.473 INFO:teuthology.orchestra.run.trial111.stderr:512 bytes copied, 0.000124723 s, 4.1 MB/s 2026-02-12T18:05:32.474 DEBUG:teuthology.orchestra.run.trial111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2026-02-12T18:05:32.531 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-12T18:05:32.532 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@trial048.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@trial111.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2026-02-12T18:05:32.532 INFO:tasks.ceph:Generating config... 2026-02-12T18:05:32.533 INFO:tasks.ceph:[client] debug monc = 20 2026-02-12T18:05:32.533 INFO:tasks.ceph:[client] debug ms = 1 2026-02-12T18:05:32.533 INFO:tasks.ceph:[global] mon client directed command retry = 5 2026-02-12T18:05:32.534 INFO:tasks.ceph:[global] mon election default strategy = 1 2026-02-12T18:05:32.534 INFO:tasks.ceph:[global] ms bind msgr1 = False 2026-02-12T18:05:32.534 INFO:tasks.ceph:[global] ms bind msgr2 = True 2026-02-12T18:05:32.534 INFO:tasks.ceph:[global] ms inject delay max = 1 2026-02-12T18:05:32.534 INFO:tasks.ceph:[global] ms inject delay probability = 0.005 2026-02-12T18:05:32.534 INFO:tasks.ceph:[global] ms inject delay type = mon 2026-02-12T18:05:32.534 INFO:tasks.ceph:[global] ms inject internal delays = 0.002 2026-02-12T18:05:32.534 INFO:tasks.ceph:[global] ms inject socket failures = 2500 2026-02-12T18:05:32.534 INFO:tasks.ceph:[global] ms type = async 2026-02-12T18:05:32.534 INFO:tasks.ceph:[mgr] debug mgr = 20 2026-02-12T18:05:32.534 INFO:tasks.ceph:[mgr] debug monc = 10 2026-02-12T18:05:32.534 INFO:tasks.ceph:[mgr] debug ms = 1 2026-02-12T18:05:32.534 INFO:tasks.ceph:[mon] debug mon = 30 2026-02-12T18:05:32.534 INFO:tasks.ceph:[mon] debug ms = 20 2026-02-12T18:05:32.534 INFO:tasks.ceph:[mon] debug paxos = 20 2026-02-12T18:05:32.534 INFO:tasks.ceph:[mon] mon min osdmap epochs = 25 2026-02-12T18:05:32.534 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2026-02-12T18:05:32.534 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2026-02-12T18:05:32.534 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2026-02-12T18:05:32.534 INFO:tasks.ceph:[mon] mon scrub inject crc mismatch = 0.01 2026-02-12T18:05:32.534 INFO:tasks.ceph:[mon] mon scrub inject missing keys = 0.05 2026-02-12T18:05:32.534 INFO:tasks.ceph:[mon] mon scrub interval = 300 2026-02-12T18:05:32.534 INFO:tasks.ceph:[mon] paxos service trim min = 5 2026-02-12T18:05:32.534 INFO:tasks.ceph:[osd] bdev async discard = True 2026-02-12T18:05:32.534 INFO:tasks.ceph:[osd] bdev enable discard = True 2026-02-12T18:05:32.535 INFO:tasks.ceph:[osd] bluestore allocator = btree 2026-02-12T18:05:32.535 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2026-02-12T18:05:32.535 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2026-02-12T18:05:32.535 INFO:tasks.ceph:[osd] bluestore onode segment size = 0 2026-02-12T18:05:32.535 INFO:tasks.ceph:[osd] bluestore write v2 random = True 2026-02-12T18:05:32.535 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2026-02-12T18:05:32.535 INFO:tasks.ceph:[osd] debug bluefs = 20 2026-02-12T18:05:32.535 INFO:tasks.ceph:[osd] debug bluestore = 20 2026-02-12T18:05:32.535 INFO:tasks.ceph:[osd] debug ms = 1 2026-02-12T18:05:32.535 INFO:tasks.ceph:[osd] debug osd = 20 2026-02-12T18:05:32.535 INFO:tasks.ceph:[osd] debug rocksdb = 10 2026-02-12T18:05:32.535 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2026-02-12T18:05:32.535 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2026-02-12T18:05:32.535 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2026-02-12T18:05:32.535 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2026-02-12T18:05:32.535 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2026-02-12T18:05:32.535 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2026-02-12T18:05:32.535 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2026-02-12T18:05:32.535 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2026-02-12T18:05:32.535 INFO:tasks.ceph:[osd] osd mclock skip benchmark = True 2026-02-12T18:05:32.535 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2026-02-12T18:05:32.535 INFO:tasks.ceph:[osd] osd op queue = debug_random 2026-02-12T18:05:32.535 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2026-02-12T18:05:32.536 INFO:tasks.ceph:Setting up mon.a... 2026-02-12T18:05:32.536 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2026-02-12T18:05:32.570 INFO:teuthology.orchestra.run.trial048.stdout:creating /etc/ceph/ceph.keyring 2026-02-12T18:05:32.572 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2026-02-12T18:05:32.648 DEBUG:teuthology.orchestra.run.trial048:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T18:05:32.710 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '10.20.193.48'), ('mon.b', '[v2:10.20.193.48:3301,v1:10.20.193.48:6790]'), ('mon.c', '[v2:10.20.193.48:3302,v1:10.20.193.48:6791]'), ('mon.d', '[v2:10.20.193.48:3303,v1:10.20.193.48:6792]'), ('mon.e', '[v2:10.20.193.48:3304,v1:10.20.193.48:6793]'), ('mon.f', '10.20.193.111'), ('mon.g', '[v2:10.20.193.111:3301,v1:10.20.193.111:6790]'), ('mon.h', '[v2:10.20.193.111:3302,v1:10.20.193.111:6791]'), ('mon.i', '[v2:10.20.193.111:3303,v1:10.20.193.111:6792]')] 2026-02-12T18:05:32.711 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '10.20.193.48,[v2:10.20.193.48:3301,v1:10.20.193.48:6790],[v2:10.20.193.48:3302,v1:10.20.193.48:6791],[v2:10.20.193.48:3303,v1:10.20.193.48:6792],[v2:10.20.193.48:3304,v1:10.20.193.48:6793],10.20.193.111,[v2:10.20.193.111:3301,v1:10.20.193.111:6790],[v2:10.20.193.111:3302,v1:10.20.193.111:6791],[v2:10.20.193.111:3303,v1:10.20.193.111:6792]', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr1': False, 'ms bind msgr2': True, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'mon', 'ms inject internal delays': 0.002, 'ms inject socket failures': 2500, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd mclock skip benchmark': True, 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'btree', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'bluestore onode segment size': 0, 'bluestore write v2 random': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug monc': 10}, 'mon': {'debug ms': 20, 'debug mon': 30, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mon.d': {}, 'mon.e': {}, 'mon.f': {}, 'mon.g': {}, 'mon.h': {}, 'mon.i': {}} 2026-02-12T18:05:32.713 DEBUG:teuthology.orchestra.run.trial048:> set -ex 2026-02-12T18:05:32.713 DEBUG:teuthology.orchestra.run.trial048:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2026-02-12T18:05:32.769 DEBUG:teuthology.orchestra.run.trial048:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 10.20.193.48 --addv b '[v2:10.20.193.48:3301,v1:10.20.193.48:6790]' --addv c '[v2:10.20.193.48:3302,v1:10.20.193.48:6791]' --addv d '[v2:10.20.193.48:3303,v1:10.20.193.48:6792]' --addv e '[v2:10.20.193.48:3304,v1:10.20.193.48:6793]' --add f 10.20.193.111 --addv g '[v2:10.20.193.111:3301,v1:10.20.193.111:6790]' --addv h '[v2:10.20.193.111:3302,v1:10.20.193.111:6791]' --addv i '[v2:10.20.193.111:3303,v1:10.20.193.111:6792]' --print /home/ubuntu/cephtest/ceph.monmap 2026-02-12T18:05:32.850 INFO:teuthology.orchestra.run.trial048.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2026-02-12T18:05:32.850 INFO:teuthology.orchestra.run.trial048.stdout:monmaptool: generated fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:32.850 INFO:teuthology.orchestra.run.trial048.stdout:setting min_mon_release = tentacle 2026-02-12T18:05:32.850 INFO:teuthology.orchestra.run.trial048.stdout:epoch 0 2026-02-12T18:05:32.851 INFO:teuthology.orchestra.run.trial048.stdout:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:32.851 INFO:teuthology.orchestra.run.trial048.stdout:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:32.851 INFO:teuthology.orchestra.run.trial048.stdout:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:32.851 INFO:teuthology.orchestra.run.trial048.stdout:min_mon_release 20 (tentacle) 2026-02-12T18:05:32.851 INFO:teuthology.orchestra.run.trial048.stdout:election_strategy: 1 2026-02-12T18:05:32.851 INFO:teuthology.orchestra.run.trial048.stdout:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:32.851 INFO:teuthology.orchestra.run.trial048.stdout:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:32.851 INFO:teuthology.orchestra.run.trial048.stdout:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:32.851 INFO:teuthology.orchestra.run.trial048.stdout:3: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:32.851 INFO:teuthology.orchestra.run.trial048.stdout:4: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:32.851 INFO:teuthology.orchestra.run.trial048.stdout:5: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:32.852 INFO:teuthology.orchestra.run.trial048.stdout:6: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:32.852 INFO:teuthology.orchestra.run.trial048.stdout:7: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:32.852 INFO:teuthology.orchestra.run.trial048.stdout:8: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:32.852 INFO:teuthology.orchestra.run.trial048.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (9 monitors) 2026-02-12T18:05:32.853 DEBUG:teuthology.orchestra.run.trial048:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2026-02-12T18:05:32.911 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ff8a9ee7-9c95-4c71-86fa-da746f82dc18... 2026-02-12T18:05:32.911 DEBUG:teuthology.orchestra.run.trial048:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-12T18:05:32.953 DEBUG:teuthology.orchestra.run.trial111:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2026-02-12T18:05:32.990 INFO:teuthology.orchestra.run.trial048.stdout:[global] 2026-02-12T18:05:32.990 INFO:teuthology.orchestra.run.trial048.stdout: chdir = "" 2026-02-12T18:05:32.990 INFO:teuthology.orchestra.run.trial048.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-12T18:05:32.990 INFO:teuthology.orchestra.run.trial048.stdout: auth supported = cephx 2026-02-12T18:05:32.990 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.990 INFO:teuthology.orchestra.run.trial048.stdout: filestore xattr use omap = true 2026-02-12T18:05:32.990 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.990 INFO:teuthology.orchestra.run.trial048.stdout: mon clock drift allowed = 1.000 2026-02-12T18:05:32.990 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.990 INFO:teuthology.orchestra.run.trial048.stdout: osd crush chooseleaf type = 0 2026-02-12T18:05:32.990 INFO:teuthology.orchestra.run.trial048.stdout: auth debug = true 2026-02-12T18:05:32.990 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.990 INFO:teuthology.orchestra.run.trial048.stdout: ms die on old message = true 2026-02-12T18:05:32.990 INFO:teuthology.orchestra.run.trial048.stdout: ms die on bug = true 2026-02-12T18:05:32.990 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.990 INFO:teuthology.orchestra.run.trial048.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-12T18:05:32.990 INFO:teuthology.orchestra.run.trial048.stdout: mon pg warn max object skew = 0 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: # disable pg_autoscaler by default for new pools 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: osd pool default size = 2 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: mon osd allow primary affinity = true 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: mon osd allow pg remap = true 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: mon warn on legacy crush tunables = false 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: mon warn on crush straw calc version zero = false 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: mon warn on no sortbitwise = false 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: mon warn on osd down out interval zero = false 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: mon warn on too few osds = false 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: mon_allow_pool_size_one = true 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: osd default data pool replay window = 5 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: mon allow pool delete = true 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: mon cluster log file level = debug 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: debug asserts on shutdown = true 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: mon health detail to clog = false 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: mon host = "10.20.193.48,[v2:10.20.193.48:3301,v1:10.20.193.48:6790],[v2:10.20.193.48:3302,v1:10.20.193.48:6791],[v2:10.20.193.48:3303,v1:10.20.193.48:6792],[v2:10.20.193.48:3304,v1:10.20.193.48:6793],10.20.193.111,[v2:10.20.193.111:3301,v1:10.20.193.111:6790],[v2:10.20.193.111:3302,v1:10.20.193.111:6791],[v2:10.20.193.111:3303,v1:10.20.193.111:6792]" 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: mon client directed command retry = 5 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: mon election default strategy = 1 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: ms bind msgr1 = False 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: ms bind msgr2 = True 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: ms inject delay max = 1 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: ms inject delay probability = 0.005 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: ms inject delay type = mon 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: ms inject internal delays = 0.002 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: ms inject socket failures = 2500 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: ms type = async 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: fsid = ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout:[osd] 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: osd journal size = 100 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.991 INFO:teuthology.orchestra.run.trial048.stdout: osd scrub load threshold = 5.0 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: osd scrub max interval = 600 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: osd mclock profile = high_recovery_ops 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: osd mclock skip benchmark = True 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: osd recover clone overlap = true 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: osd recovery max chunk = 1048576 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: osd debug shutdown = true 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: osd debug op order = true 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: osd debug verify stray on activate = true 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: osd debug trim objects = true 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: osd open classes on start = true 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: osd debug pg log writeout = true 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: osd deep scrub update digest min age = 30 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: osd map max advance = 10 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: journal zero on create = true 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: filestore ondisk finisher threads = 3 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: filestore apply finisher threads = 3 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: bdev debug aio = true 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: osd debug misdirected ops = true 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: bdev async discard = True 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: bdev enable discard = True 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: bluestore allocator = btree 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: bluestore block size = 96636764160 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: bluestore fsck on mount = True 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: bluestore onode segment size = 0 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: bluestore write v2 random = True 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: bluestore zero block detection = True 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: debug bluefs = 20 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: debug bluestore = 20 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: debug ms = 1 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: debug osd = 20 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: debug rocksdb = 10 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: mon osd backfillfull_ratio = 0.85 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: mon osd full ratio = 0.9 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: mon osd nearfull ratio = 0.8 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: osd debug verify cached snaps = True 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: osd debug verify missing on start = True 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: osd failsafe full ratio = 0.95 2026-02-12T18:05:32.992 INFO:teuthology.orchestra.run.trial048.stdout: osd mclock override recovery settings = True 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: osd objectstore = bluestore 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: osd op queue = debug_random 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: osd op queue cut off = debug_random 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout:[mgr] 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: debug ms = 1 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: debug mgr = 20 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: debug mon = 20 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: debug auth = 20 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: mon reweight min pgs per osd = 4 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: mon reweight min bytes per osd = 10 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: mgr/telemetry/nag = false 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: debug monc = 10 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout:[mon] 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: debug ms = 20 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: debug mon = 30 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: debug paxos = 20 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: debug auth = 20 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: mon data avail warn = 5 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: mon mgr mkfs grace = 240 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: mon reweight min pgs per osd = 4 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: mon osd reporter subtree level = osd 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: mon osd prime pg temp = true 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: mon reweight min bytes per osd = 10 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: auth mon ticket ttl = 660 # 11m 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: auth service ticket ttl = 240 # 4m 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: # don't complain about insecure global_id in the test suite 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: # 1m isn't quite enough 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: mon_down_mkfs_grace = 2m 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: mon_warn_on_filestore_osds = false 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: mon min osdmap epochs = 25 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: mon osdmap full prune interval = 2 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: mon osdmap full prune min = 15 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: mon osdmap full prune txsize = 2 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: mon scrub inject crc mismatch = 0.01 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: mon scrub inject missing keys = 0.05 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: mon scrub interval = 300 2026-02-12T18:05:32.993 INFO:teuthology.orchestra.run.trial048.stdout: paxos service trim min = 5 2026-02-12T18:05:32.994 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:32.994 INFO:teuthology.orchestra.run.trial048.stdout:[client] 2026-02-12T18:05:32.994 INFO:teuthology.orchestra.run.trial048.stdout: rgw cache enabled = true 2026-02-12T18:05:32.994 INFO:teuthology.orchestra.run.trial048.stdout: rgw enable ops log = true 2026-02-12T18:05:32.994 INFO:teuthology.orchestra.run.trial048.stdout: rgw enable usage log = true 2026-02-12T18:05:32.994 INFO:teuthology.orchestra.run.trial048.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-12T18:05:32.994 INFO:teuthology.orchestra.run.trial048.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-12T18:05:32.994 INFO:teuthology.orchestra.run.trial048.stdout: debug monc = 20 2026-02-12T18:05:32.994 INFO:teuthology.orchestra.run.trial048.stdout: debug ms = 1 2026-02-12T18:05:32.994 INFO:teuthology.orchestra.run.trial048.stdout:[mon.a] 2026-02-12T18:05:32.994 INFO:teuthology.orchestra.run.trial048.stdout:[mon.b] 2026-02-12T18:05:32.994 INFO:teuthology.orchestra.run.trial048.stdout:[mon.c] 2026-02-12T18:05:32.994 INFO:teuthology.orchestra.run.trial048.stdout:[mon.d] 2026-02-12T18:05:32.994 INFO:teuthology.orchestra.run.trial048.stdout:[mon.e] 2026-02-12T18:05:32.994 INFO:teuthology.orchestra.run.trial048.stdout:[mon.f] 2026-02-12T18:05:32.994 INFO:teuthology.orchestra.run.trial048.stdout:[mon.g] 2026-02-12T18:05:32.994 INFO:teuthology.orchestra.run.trial048.stdout:[mon.h] 2026-02-12T18:05:32.994 INFO:teuthology.orchestra.run.trial048.stdout:[mon.i] 2026-02-12T18:05:32.994 INFO:teuthology.orchestra.run.trial111.stdout:[global] 2026-02-12T18:05:32.994 INFO:teuthology.orchestra.run.trial111.stdout: chdir = "" 2026-02-12T18:05:32.994 INFO:teuthology.orchestra.run.trial111.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2026-02-12T18:05:32.994 INFO:teuthology.orchestra.run.trial111.stdout: auth supported = cephx 2026-02-12T18:05:32.994 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.994 INFO:teuthology.orchestra.run.trial111.stdout: filestore xattr use omap = true 2026-02-12T18:05:32.994 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: mon clock drift allowed = 1.000 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: osd crush chooseleaf type = 0 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: auth debug = true 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: ms die on old message = true 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: ms die on bug = true 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: mon max pg per osd = 10000 # >= luminous 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: mon pg warn max object skew = 0 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: # disable pg_autoscaler by default for new pools 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: osd_pool_default_pg_autoscale_mode = off 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: osd pool default size = 2 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: mon osd allow primary affinity = true 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: mon osd allow pg remap = true 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: mon warn on legacy crush tunables = false 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: mon warn on crush straw calc version zero = false 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: mon warn on no sortbitwise = false 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: mon warn on osd down out interval zero = false 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: mon warn on too few osds = false 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: mon_warn_on_pool_no_redundancy = false 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: mon_allow_pool_size_one = true 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: osd pool default erasure code profile = plugin=isa technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: osd default data pool replay window = 5 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: mon allow pool delete = true 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: mon cluster log file level = debug 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: debug asserts on shutdown = true 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: mon health detail to clog = false 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: mon host = "10.20.193.48,[v2:10.20.193.48:3301,v1:10.20.193.48:6790],[v2:10.20.193.48:3302,v1:10.20.193.48:6791],[v2:10.20.193.48:3303,v1:10.20.193.48:6792],[v2:10.20.193.48:3304,v1:10.20.193.48:6793],10.20.193.111,[v2:10.20.193.111:3301,v1:10.20.193.111:6790],[v2:10.20.193.111:3302,v1:10.20.193.111:6791],[v2:10.20.193.111:3303,v1:10.20.193.111:6792]" 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: mon client directed command retry = 5 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: mon election default strategy = 1 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: ms bind msgr1 = False 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: ms bind msgr2 = True 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: ms inject delay max = 1 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: ms inject delay probability = 0.005 2026-02-12T18:05:32.995 INFO:teuthology.orchestra.run.trial111.stdout: ms inject delay type = mon 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: ms inject internal delays = 0.002 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: ms inject socket failures = 2500 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: ms type = async 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: fsid = ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout:[osd] 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: osd journal size = 100 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: osd scrub load threshold = 5.0 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: osd scrub max interval = 600 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: osd mclock profile = high_recovery_ops 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: osd mclock skip benchmark = True 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: osd recover clone overlap = true 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: osd recovery max chunk = 1048576 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: osd debug shutdown = true 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: osd debug op order = true 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: osd debug verify stray on activate = true 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: osd debug trim objects = true 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: osd open classes on start = true 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: osd debug pg log writeout = true 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: osd deep scrub update digest min age = 30 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: osd map max advance = 10 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: journal zero on create = true 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: filestore ondisk finisher threads = 3 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: filestore apply finisher threads = 3 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: bdev debug aio = true 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: osd debug misdirected ops = true 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: bdev async discard = True 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: bdev enable discard = True 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: bluestore allocator = btree 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: bluestore block size = 96636764160 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: bluestore fsck on mount = True 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: bluestore onode segment size = 0 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: bluestore write v2 random = True 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: bluestore zero block detection = True 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: debug bluefs = 20 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: debug bluestore = 20 2026-02-12T18:05:32.996 INFO:teuthology.orchestra.run.trial111.stdout: debug ms = 1 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: debug osd = 20 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: debug rocksdb = 10 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: mon osd backfillfull_ratio = 0.85 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: mon osd full ratio = 0.9 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: mon osd nearfull ratio = 0.8 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: osd debug verify cached snaps = True 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: osd debug verify missing on start = True 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: osd failsafe full ratio = 0.95 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: osd mclock override recovery settings = True 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: osd objectstore = bluestore 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: osd op queue = debug_random 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: osd op queue cut off = debug_random 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout:[mgr] 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: debug ms = 1 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: debug mgr = 20 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: debug mon = 20 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: debug auth = 20 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: mon reweight min pgs per osd = 4 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: mon reweight min bytes per osd = 10 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: mgr/telemetry/nag = false 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: debug monc = 10 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout:[mon] 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: debug ms = 20 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: debug mon = 30 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: debug paxos = 20 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: debug auth = 20 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: mon data avail warn = 5 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: mon mgr mkfs grace = 240 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: mon reweight min pgs per osd = 4 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: mon osd reporter subtree level = osd 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: mon osd prime pg temp = true 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: mon reweight min bytes per osd = 10 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: # rotate auth tickets quickly to exercise renewal paths 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: auth mon ticket ttl = 660 # 11m 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: auth service ticket ttl = 240 # 4m 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: # don't complain about insecure global_id in the test suite 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: mon_warn_on_insecure_global_id_reclaim = false 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: # 1m isn't quite enough 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: mon_down_mkfs_grace = 2m 2026-02-12T18:05:32.997 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout: mon_warn_on_filestore_osds = false 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout: mon min osdmap epochs = 25 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout: mon osdmap full prune interval = 2 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout: mon osdmap full prune min = 15 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout: mon osdmap full prune txsize = 2 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout: mon scrub inject crc mismatch = 0.01 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout: mon scrub inject missing keys = 0.05 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout: mon scrub interval = 300 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout: paxos service trim min = 5 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout: 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout:[client] 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout: rgw cache enabled = true 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout: rgw enable ops log = true 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout: rgw enable usage log = true 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout: debug monc = 20 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout: debug ms = 1 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout:[mon.a] 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout:[mon.b] 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout:[mon.c] 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout:[mon.d] 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout:[mon.e] 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout:[mon.f] 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout:[mon.g] 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout:[mon.h] 2026-02-12T18:05:32.998 INFO:teuthology.orchestra.run.trial111.stdout:[mon.i] 2026-02-12T18:05:33.004 INFO:tasks.ceph:Creating admin key on mon.a... 2026-02-12T18:05:33.004 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2026-02-12T18:05:33.079 INFO:tasks.ceph:Copying monmap to all nodes... 2026-02-12T18:05:33.079 DEBUG:teuthology.orchestra.run.trial048:> set -ex 2026-02-12T18:05:33.079 DEBUG:teuthology.orchestra.run.trial048:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2026-02-12T18:05:33.137 DEBUG:teuthology.orchestra.run.trial048:> set -ex 2026-02-12T18:05:33.137 DEBUG:teuthology.orchestra.run.trial048:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2026-02-12T18:05:33.194 INFO:tasks.ceph:Sending monmap to node ubuntu@trial048.front.sepia.ceph.com 2026-02-12T18:05:33.194 DEBUG:teuthology.orchestra.run.trial048:> set -ex 2026-02-12T18:05:33.194 DEBUG:teuthology.orchestra.run.trial048:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-12T18:05:33.195 DEBUG:teuthology.orchestra.run.trial048:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T18:05:33.268 DEBUG:teuthology.orchestra.run.trial048:> set -ex 2026-02-12T18:05:33.268 DEBUG:teuthology.orchestra.run.trial048:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-12T18:05:33.324 INFO:tasks.ceph:Sending monmap to node ubuntu@trial111.front.sepia.ceph.com 2026-02-12T18:05:33.324 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T18:05:33.324 DEBUG:teuthology.orchestra.run.trial111:> sudo dd of=/etc/ceph/ceph.keyring 2026-02-12T18:05:33.324 DEBUG:teuthology.orchestra.run.trial111:> sudo chmod 0644 /etc/ceph/ceph.keyring 2026-02-12T18:05:33.358 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T18:05:33.358 DEBUG:teuthology.orchestra.run.trial111:> dd of=/home/ubuntu/cephtest/ceph.monmap 2026-02-12T18:05:33.414 INFO:tasks.ceph:Setting up mon nodes... 2026-02-12T18:05:33.415 INFO:tasks.ceph:Setting up mgr nodes... 2026-02-12T18:05:33.415 DEBUG:teuthology.orchestra.run.trial111:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2026-02-12T18:05:33.496 INFO:teuthology.orchestra.run.trial111.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2026-02-12T18:05:33.499 INFO:tasks.ceph:Setting up mds nodes... 2026-02-12T18:05:33.499 INFO:tasks.ceph_client:Setting up client nodes... 2026-02-12T18:05:33.499 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2026-02-12T18:05:33.571 INFO:teuthology.orchestra.run.trial111.stdout:creating /etc/ceph/ceph.client.0.keyring 2026-02-12T18:05:33.582 INFO:tasks.ceph:Running mkfs on osd nodes... 2026-02-12T18:05:33.583 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@trial048.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@trial111.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2026-02-12T18:05:33.583 DEBUG:teuthology.orchestra.run.trial048:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2026-02-12T18:05:33.609 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-12T18:05:33.610 INFO:tasks.ceph:role: osd.0 2026-02-12T18:05:33.610 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial048.front.sepia.ceph.com 2026-02-12T18:05:33.610 DEBUG:teuthology.orchestra.run.trial048:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-12T18:05:33.676 INFO:teuthology.orchestra.run.trial048.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T18:05:33.676 INFO:teuthology.orchestra.run.trial048.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T18:05:33.676 INFO:teuthology.orchestra.run.trial048.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T18:05:33.676 INFO:teuthology.orchestra.run.trial048.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T18:05:33.676 INFO:teuthology.orchestra.run.trial048.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T18:05:33.676 INFO:teuthology.orchestra.run.trial048.stdout: = sunit=0 swidth=0 blks 2026-02-12T18:05:33.676 INFO:teuthology.orchestra.run.trial048.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T18:05:33.677 INFO:teuthology.orchestra.run.trial048.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T18:05:33.677 INFO:teuthology.orchestra.run.trial048.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T18:05:33.677 INFO:teuthology.orchestra.run.trial048.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T18:05:34.246 INFO:teuthology.orchestra.run.trial048.stdout:Discarding blocks...Done. 2026-02-12T18:05:34.248 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial048.front.sepia.ceph.com -o noatime 2026-02-12T18:05:34.249 DEBUG:teuthology.orchestra.run.trial048:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2026-02-12T18:05:34.316 DEBUG:teuthology.orchestra.run.trial048:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2026-02-12T18:05:34.384 DEBUG:teuthology.orchestra.run.trial048:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2026-02-12T18:05:34.448 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-12T18:05:34.448 INFO:tasks.ceph:role: osd.1 2026-02-12T18:05:34.448 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial048.front.sepia.ceph.com 2026-02-12T18:05:34.448 DEBUG:teuthology.orchestra.run.trial048:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-12T18:05:34.514 INFO:teuthology.orchestra.run.trial048.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T18:05:34.514 INFO:teuthology.orchestra.run.trial048.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T18:05:34.515 INFO:teuthology.orchestra.run.trial048.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T18:05:34.515 INFO:teuthology.orchestra.run.trial048.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T18:05:34.515 INFO:teuthology.orchestra.run.trial048.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T18:05:34.515 INFO:teuthology.orchestra.run.trial048.stdout: = sunit=0 swidth=0 blks 2026-02-12T18:05:34.515 INFO:teuthology.orchestra.run.trial048.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T18:05:34.515 INFO:teuthology.orchestra.run.trial048.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T18:05:34.515 INFO:teuthology.orchestra.run.trial048.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T18:05:34.515 INFO:teuthology.orchestra.run.trial048.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T18:05:35.072 INFO:teuthology.orchestra.run.trial048.stdout:Discarding blocks...Done. 2026-02-12T18:05:35.073 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial048.front.sepia.ceph.com -o noatime 2026-02-12T18:05:35.074 DEBUG:teuthology.orchestra.run.trial048:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2026-02-12T18:05:35.142 DEBUG:teuthology.orchestra.run.trial048:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2026-02-12T18:05:35.211 DEBUG:teuthology.orchestra.run.trial048:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2026-02-12T18:05:35.275 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2026-02-12T18:05:35.275 INFO:tasks.ceph:role: osd.2 2026-02-12T18:05:35.275 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial048.front.sepia.ceph.com 2026-02-12T18:05:35.275 DEBUG:teuthology.orchestra.run.trial048:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-12T18:05:35.341 INFO:teuthology.orchestra.run.trial048.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T18:05:35.341 INFO:teuthology.orchestra.run.trial048.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T18:05:35.341 INFO:teuthology.orchestra.run.trial048.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T18:05:35.341 INFO:teuthology.orchestra.run.trial048.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T18:05:35.341 INFO:teuthology.orchestra.run.trial048.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T18:05:35.341 INFO:teuthology.orchestra.run.trial048.stdout: = sunit=0 swidth=0 blks 2026-02-12T18:05:35.341 INFO:teuthology.orchestra.run.trial048.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T18:05:35.341 INFO:teuthology.orchestra.run.trial048.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T18:05:35.341 INFO:teuthology.orchestra.run.trial048.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T18:05:35.341 INFO:teuthology.orchestra.run.trial048.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T18:05:35.898 INFO:teuthology.orchestra.run.trial048.stdout:Discarding blocks...Done. 2026-02-12T18:05:35.900 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial048.front.sepia.ceph.com -o noatime 2026-02-12T18:05:35.900 DEBUG:teuthology.orchestra.run.trial048:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2026-02-12T18:05:35.968 DEBUG:teuthology.orchestra.run.trial048:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2026-02-12T18:05:36.035 DEBUG:teuthology.orchestra.run.trial048:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T18:05:36.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:36.111+0000 7f779e7fd780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2026-02-12T18:05:36.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:36.111+0000 7f779e7fd780 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2026-02-12T18:05:36.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:36.111+0000 7f779e7fd780 -1 bdev(0x43bf400 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2026-02-12T18:05:36.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:36.111+0000 7f779e7fd780 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2026-02-12T18:05:36.586 DEBUG:teuthology.orchestra.run.trial048:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2026-02-12T18:05:36.652 DEBUG:teuthology.orchestra.run.trial048:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T18:05:36.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:36.728+0000 7f7b2bc29780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2026-02-12T18:05:36.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:36.728+0000 7f7b2bc29780 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2026-02-12T18:05:36.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:36.728+0000 7f7b2bc29780 -1 bdev(0x312d400 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2026-02-12T18:05:36.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:36.728+0000 7f7b2bc29780 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2026-02-12T18:05:37.173 DEBUG:teuthology.orchestra.run.trial048:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2026-02-12T18:05:37.237 DEBUG:teuthology.orchestra.run.trial048:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T18:05:37.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:37.313+0000 7f03359e3780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2026-02-12T18:05:37.314 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:37.313+0000 7f03359e3780 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2026-02-12T18:05:37.314 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:37.313+0000 7f03359e3780 -1 bdev(0x24d5400 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2026-02-12T18:05:37.314 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:37.313+0000 7f03359e3780 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2026-02-12T18:05:37.772 DEBUG:teuthology.orchestra.run.trial048:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2026-02-12T18:05:37.836 DEBUG:teuthology.orchestra.run.trial111:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2026-02-12T18:05:37.862 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-12T18:05:37.863 INFO:tasks.ceph:role: osd.3 2026-02-12T18:05:37.863 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@trial111.front.sepia.ceph.com 2026-02-12T18:05:37.863 DEBUG:teuthology.orchestra.run.trial111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2026-02-12T18:05:37.929 INFO:teuthology.orchestra.run.trial111.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T18:05:37.930 INFO:teuthology.orchestra.run.trial111.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T18:05:37.930 INFO:teuthology.orchestra.run.trial111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T18:05:37.930 INFO:teuthology.orchestra.run.trial111.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T18:05:37.930 INFO:teuthology.orchestra.run.trial111.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T18:05:37.930 INFO:teuthology.orchestra.run.trial111.stdout: = sunit=0 swidth=0 blks 2026-02-12T18:05:37.930 INFO:teuthology.orchestra.run.trial111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T18:05:37.930 INFO:teuthology.orchestra.run.trial111.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T18:05:37.930 INFO:teuthology.orchestra.run.trial111.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T18:05:37.930 INFO:teuthology.orchestra.run.trial111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T18:05:38.506 INFO:teuthology.orchestra.run.trial111.stdout:Discarding blocks...Done. 2026-02-12T18:05:38.508 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@trial111.front.sepia.ceph.com -o noatime 2026-02-12T18:05:38.509 DEBUG:teuthology.orchestra.run.trial111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2026-02-12T18:05:38.577 DEBUG:teuthology.orchestra.run.trial111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2026-02-12T18:05:38.646 DEBUG:teuthology.orchestra.run.trial111:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2026-02-12T18:05:38.712 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-12T18:05:38.712 INFO:tasks.ceph:role: osd.4 2026-02-12T18:05:38.712 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@trial111.front.sepia.ceph.com 2026-02-12T18:05:38.712 DEBUG:teuthology.orchestra.run.trial111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2026-02-12T18:05:38.776 INFO:teuthology.orchestra.run.trial111.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T18:05:38.776 INFO:teuthology.orchestra.run.trial111.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T18:05:38.777 INFO:teuthology.orchestra.run.trial111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T18:05:38.777 INFO:teuthology.orchestra.run.trial111.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T18:05:38.777 INFO:teuthology.orchestra.run.trial111.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T18:05:38.777 INFO:teuthology.orchestra.run.trial111.stdout: = sunit=0 swidth=0 blks 2026-02-12T18:05:38.777 INFO:teuthology.orchestra.run.trial111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T18:05:38.777 INFO:teuthology.orchestra.run.trial111.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T18:05:38.777 INFO:teuthology.orchestra.run.trial111.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T18:05:38.777 INFO:teuthology.orchestra.run.trial111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T18:05:39.340 INFO:teuthology.orchestra.run.trial111.stdout:Discarding blocks...Done. 2026-02-12T18:05:39.343 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@trial111.front.sepia.ceph.com -o noatime 2026-02-12T18:05:39.343 DEBUG:teuthology.orchestra.run.trial111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2026-02-12T18:05:39.412 DEBUG:teuthology.orchestra.run.trial111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2026-02-12T18:05:39.478 DEBUG:teuthology.orchestra.run.trial111:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2026-02-12T18:05:39.542 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2026-02-12T18:05:39.542 INFO:tasks.ceph:role: osd.5 2026-02-12T18:05:39.542 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@trial111.front.sepia.ceph.com 2026-02-12T18:05:39.542 DEBUG:teuthology.orchestra.run.trial111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2026-02-12T18:05:39.606 INFO:teuthology.orchestra.run.trial111.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=45875200 blks 2026-02-12T18:05:39.606 INFO:teuthology.orchestra.run.trial111.stdout: = sectsz=4096 attr=2, projid32bit=1 2026-02-12T18:05:39.606 INFO:teuthology.orchestra.run.trial111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2026-02-12T18:05:39.606 INFO:teuthology.orchestra.run.trial111.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2026-02-12T18:05:39.606 INFO:teuthology.orchestra.run.trial111.stdout:data = bsize=4096 blocks=183500800, imaxpct=25 2026-02-12T18:05:39.607 INFO:teuthology.orchestra.run.trial111.stdout: = sunit=0 swidth=0 blks 2026-02-12T18:05:39.607 INFO:teuthology.orchestra.run.trial111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2026-02-12T18:05:39.607 INFO:teuthology.orchestra.run.trial111.stdout:log =internal log bsize=4096 blocks=89600, version=2 2026-02-12T18:05:39.607 INFO:teuthology.orchestra.run.trial111.stdout: = sectsz=4096 sunit=1 blks, lazy-count=1 2026-02-12T18:05:39.607 INFO:teuthology.orchestra.run.trial111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2026-02-12T18:05:40.163 INFO:teuthology.orchestra.run.trial111.stdout:Discarding blocks...Done. 2026-02-12T18:05:40.165 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@trial111.front.sepia.ceph.com -o noatime 2026-02-12T18:05:40.165 DEBUG:teuthology.orchestra.run.trial111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2026-02-12T18:05:40.232 DEBUG:teuthology.orchestra.run.trial111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2026-02-12T18:05:40.298 DEBUG:teuthology.orchestra.run.trial111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T18:05:40.375 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:40.374+0000 7fcba4854780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2026-02-12T18:05:40.375 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:40.375+0000 7fcba4854780 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2026-02-12T18:05:40.375 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:40.375+0000 7fcba4854780 -1 bdev(0x2e5b400 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2026-02-12T18:05:40.375 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:40.375+0000 7fcba4854780 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2026-02-12T18:05:40.809 DEBUG:teuthology.orchestra.run.trial111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2026-02-12T18:05:40.873 DEBUG:teuthology.orchestra.run.trial111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T18:05:40.948 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:40.947+0000 7fbd0a461780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2026-02-12T18:05:40.948 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:40.948+0000 7fbd0a461780 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2026-02-12T18:05:40.948 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:40.948+0000 7fbd0a461780 -1 bdev(0x401f400 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2026-02-12T18:05:40.948 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:40.948+0000 7fbd0a461780 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2026-02-12T18:05:41.426 DEBUG:teuthology.orchestra.run.trial111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2026-02-12T18:05:41.492 DEBUG:teuthology.orchestra.run.trial111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2026-02-12T18:05:41.569 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:41.568+0000 7f5b8d856780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2026-02-12T18:05:41.569 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:41.568+0000 7f5b8d856780 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2026-02-12T18:05:41.570 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:41.569+0000 7f5b8d856780 -1 bdev(0x242b400 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2026-02-12T18:05:41.570 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:41.569+0000 7f5b8d856780 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2026-02-12T18:05:42.027 DEBUG:teuthology.orchestra.run.trial111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2026-02-12T18:05:42.092 INFO:tasks.ceph:Reading keys from all nodes... 2026-02-12T18:05:42.093 DEBUG:teuthology.orchestra.run.trial048:> set -ex 2026-02-12T18:05:42.093 DEBUG:teuthology.orchestra.run.trial048:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2026-02-12T18:05:42.116 DEBUG:teuthology.orchestra.run.trial048:> set -ex 2026-02-12T18:05:42.116 DEBUG:teuthology.orchestra.run.trial048:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2026-02-12T18:05:42.181 DEBUG:teuthology.orchestra.run.trial048:> set -ex 2026-02-12T18:05:42.182 DEBUG:teuthology.orchestra.run.trial048:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2026-02-12T18:05:42.245 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T18:05:42.245 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2026-02-12T18:05:42.269 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T18:05:42.269 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2026-02-12T18:05:42.334 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T18:05:42.334 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2026-02-12T18:05:42.397 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T18:05:42.397 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2026-02-12T18:05:42.461 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T18:05:42.461 DEBUG:teuthology.orchestra.run.trial111:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2026-02-12T18:05:42.517 INFO:tasks.ceph:Adding keys to all mons... 2026-02-12T18:05:42.517 DEBUG:teuthology.orchestra.run.trial048:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-12T18:05:42.520 DEBUG:teuthology.orchestra.run.trial111:> sudo tee -a /etc/ceph/ceph.keyring 2026-02-12T18:05:42.562 INFO:teuthology.orchestra.run.trial048.stdout:[osd.0] 2026-02-12T18:05:42.563 INFO:teuthology.orchestra.run.trial048.stdout: key = AQBwFo5ppvayBhAAEhTx6Qn+6eFGN7zgHzR0Fw== 2026-02-12T18:05:42.563 INFO:teuthology.orchestra.run.trial048.stdout:[osd.1] 2026-02-12T18:05:42.563 INFO:teuthology.orchestra.run.trial048.stdout: key = AQBwFo5phKt5KxAA01i91bGxEu5ZitrBfG6/Mw== 2026-02-12T18:05:42.563 INFO:teuthology.orchestra.run.trial048.stdout:[osd.2] 2026-02-12T18:05:42.563 INFO:teuthology.orchestra.run.trial048.stdout: key = AQBxFo5pQuy/EhAAFy484fXG1FDqkGqEd2/tJQ== 2026-02-12T18:05:42.563 INFO:teuthology.orchestra.run.trial048.stdout:[mgr.x] 2026-02-12T18:05:42.563 INFO:teuthology.orchestra.run.trial048.stdout: key = AQBtFo5pDX2cHRAAmEYoWIlvwGaL4E0EmBys3Q== 2026-02-12T18:05:42.563 INFO:teuthology.orchestra.run.trial048.stdout:[osd.3] 2026-02-12T18:05:42.564 INFO:teuthology.orchestra.run.trial048.stdout: key = AQB0Fo5pJGRiFhAAWlX6X7wvXlKAtjeaW7hASw== 2026-02-12T18:05:42.564 INFO:teuthology.orchestra.run.trial048.stdout:[osd.4] 2026-02-12T18:05:42.564 INFO:teuthology.orchestra.run.trial048.stdout: key = AQB0Fo5pV3uIOBAAo0w+lYdszNzGqbpSrVGECw== 2026-02-12T18:05:42.564 INFO:teuthology.orchestra.run.trial048.stdout:[osd.5] 2026-02-12T18:05:42.564 INFO:teuthology.orchestra.run.trial048.stdout: key = AQB1Fo5phyDvIRAAvBfVOjMxfQ7JHIo4Tcb4/g== 2026-02-12T18:05:42.564 INFO:teuthology.orchestra.run.trial048.stdout:[client.0] 2026-02-12T18:05:42.564 INFO:teuthology.orchestra.run.trial048.stdout: key = AQBtFo5p9+QPIhAAt8NNdwEFF/J3iOMlYIP9aA== 2026-02-12T18:05:42.582 INFO:teuthology.orchestra.run.trial111.stdout:[osd.0] 2026-02-12T18:05:42.582 INFO:teuthology.orchestra.run.trial111.stdout: key = AQBwFo5ppvayBhAAEhTx6Qn+6eFGN7zgHzR0Fw== 2026-02-12T18:05:42.582 INFO:teuthology.orchestra.run.trial111.stdout:[osd.1] 2026-02-12T18:05:42.582 INFO:teuthology.orchestra.run.trial111.stdout: key = AQBwFo5phKt5KxAA01i91bGxEu5ZitrBfG6/Mw== 2026-02-12T18:05:42.583 INFO:teuthology.orchestra.run.trial111.stdout:[osd.2] 2026-02-12T18:05:42.583 INFO:teuthology.orchestra.run.trial111.stdout: key = AQBxFo5pQuy/EhAAFy484fXG1FDqkGqEd2/tJQ== 2026-02-12T18:05:42.583 INFO:teuthology.orchestra.run.trial111.stdout:[mgr.x] 2026-02-12T18:05:42.583 INFO:teuthology.orchestra.run.trial111.stdout: key = AQBtFo5pDX2cHRAAmEYoWIlvwGaL4E0EmBys3Q== 2026-02-12T18:05:42.583 INFO:teuthology.orchestra.run.trial111.stdout:[osd.3] 2026-02-12T18:05:42.583 INFO:teuthology.orchestra.run.trial111.stdout: key = AQB0Fo5pJGRiFhAAWlX6X7wvXlKAtjeaW7hASw== 2026-02-12T18:05:42.583 INFO:teuthology.orchestra.run.trial111.stdout:[osd.4] 2026-02-12T18:05:42.583 INFO:teuthology.orchestra.run.trial111.stdout: key = AQB0Fo5pV3uIOBAAo0w+lYdszNzGqbpSrVGECw== 2026-02-12T18:05:42.583 INFO:teuthology.orchestra.run.trial111.stdout:[osd.5] 2026-02-12T18:05:42.583 INFO:teuthology.orchestra.run.trial111.stdout: key = AQB1Fo5phyDvIRAAvBfVOjMxfQ7JHIo4Tcb4/g== 2026-02-12T18:05:42.583 INFO:teuthology.orchestra.run.trial111.stdout:[client.0] 2026-02-12T18:05:42.583 INFO:teuthology.orchestra.run.trial111.stdout: key = AQBtFo5p9+QPIhAAt8NNdwEFF/J3iOMlYIP9aA== 2026-02-12T18:05:42.585 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T18:05:42.608 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T18:05:42.664 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T18:05:42.687 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T18:05:42.741 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T18:05:42.764 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T18:05:42.819 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-12T18:05:42.842 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2026-02-12T18:05:42.896 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T18:05:42.922 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T18:05:42.974 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T18:05:43.001 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T18:05:43.052 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T18:05:43.079 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2026-02-12T18:05:43.129 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-12T18:05:43.156 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2026-02-12T18:05:43.210 INFO:tasks.ceph:Running mkfs on mon nodes... 2026-02-12T18:05:43.211 DEBUG:teuthology.orchestra.run.trial048:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2026-02-12T18:05:43.259 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-12T18:05:43.344 DEBUG:teuthology.orchestra.run.trial048:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2026-02-12T18:05:43.409 DEBUG:teuthology.orchestra.run.trial048:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2026-02-12T18:05:43.475 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-12T18:05:43.556 DEBUG:teuthology.orchestra.run.trial048:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2026-02-12T18:05:43.620 DEBUG:teuthology.orchestra.run.trial048:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2026-02-12T18:05:43.686 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-12T18:05:43.765 DEBUG:teuthology.orchestra.run.trial048:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2026-02-12T18:05:43.829 DEBUG:teuthology.orchestra.run.trial048:> sudo mkdir -p /var/lib/ceph/mon/ceph-d 2026-02-12T18:05:43.895 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i d --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-12T18:05:43.976 DEBUG:teuthology.orchestra.run.trial048:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-d 2026-02-12T18:05:44.041 DEBUG:teuthology.orchestra.run.trial048:> sudo mkdir -p /var/lib/ceph/mon/ceph-e 2026-02-12T18:05:44.106 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i e --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-12T18:05:44.188 DEBUG:teuthology.orchestra.run.trial048:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-e 2026-02-12T18:05:44.252 DEBUG:teuthology.orchestra.run.trial111:> sudo mkdir -p /var/lib/ceph/mon/ceph-f 2026-02-12T18:05:44.278 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i f --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-12T18:05:44.358 DEBUG:teuthology.orchestra.run.trial111:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-f 2026-02-12T18:05:44.423 DEBUG:teuthology.orchestra.run.trial111:> sudo mkdir -p /var/lib/ceph/mon/ceph-g 2026-02-12T18:05:44.487 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i g --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-12T18:05:44.569 DEBUG:teuthology.orchestra.run.trial111:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-g 2026-02-12T18:05:44.632 DEBUG:teuthology.orchestra.run.trial111:> sudo mkdir -p /var/lib/ceph/mon/ceph-h 2026-02-12T18:05:44.697 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i h --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-12T18:05:44.777 DEBUG:teuthology.orchestra.run.trial111:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-h 2026-02-12T18:05:44.841 DEBUG:teuthology.orchestra.run.trial111:> sudo mkdir -p /var/lib/ceph/mon/ceph-i 2026-02-12T18:05:44.905 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i i --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2026-02-12T18:05:44.985 DEBUG:teuthology.orchestra.run.trial111:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-i 2026-02-12T18:05:45.048 DEBUG:teuthology.orchestra.run.trial048:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-12T18:05:45.051 DEBUG:teuthology.orchestra.run.trial111:> rm -- /home/ubuntu/cephtest/ceph.monmap 2026-02-12T18:05:45.104 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2026-02-12T18:05:45.105 INFO:tasks.ceph.mon.a:Restarting daemon 2026-02-12T18:05:45.105 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2026-02-12T18:05:45.108 INFO:tasks.ceph.mon.a:Started 2026-02-12T18:05:45.109 INFO:tasks.ceph.mon.b:Restarting daemon 2026-02-12T18:05:45.109 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2026-02-12T18:05:45.111 INFO:tasks.ceph.mon.b:Started 2026-02-12T18:05:45.111 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-12T18:05:45.111 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-12T18:05:45.113 INFO:tasks.ceph.mon.c:Started 2026-02-12T18:05:45.114 INFO:tasks.ceph.mon.d:Restarting daemon 2026-02-12T18:05:45.114 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i d 2026-02-12T18:05:45.116 INFO:tasks.ceph.mon.d:Started 2026-02-12T18:05:45.116 INFO:tasks.ceph.mon.e:Restarting daemon 2026-02-12T18:05:45.116 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2026-02-12T18:05:45.118 INFO:tasks.ceph.mon.e:Started 2026-02-12T18:05:45.119 INFO:tasks.ceph.mon.f:Restarting daemon 2026-02-12T18:05:45.119 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i f 2026-02-12T18:05:45.146 INFO:tasks.ceph.mon.f:Started 2026-02-12T18:05:45.147 INFO:tasks.ceph.mon.g:Restarting daemon 2026-02-12T18:05:45.147 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i g 2026-02-12T18:05:45.149 INFO:tasks.ceph.mon.g:Started 2026-02-12T18:05:45.149 INFO:tasks.ceph.mon.h:Restarting daemon 2026-02-12T18:05:45.149 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i h 2026-02-12T18:05:45.152 INFO:tasks.ceph.mon.h:Started 2026-02-12T18:05:45.152 INFO:tasks.ceph.mon.i:Restarting daemon 2026-02-12T18:05:45.152 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i i 2026-02-12T18:05:45.154 INFO:tasks.ceph.mon.i:Started 2026-02-12T18:05:45.154 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2026-02-12T18:05:45.155 INFO:tasks.ceph.mgr.x:Restarting daemon 2026-02-12T18:05:45.155 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2026-02-12T18:05:45.157 INFO:tasks.ceph.mgr.x:Started 2026-02-12T18:05:45.157 DEBUG:tasks.ceph:set 0 configs 2026-02-12T18:05:45.158 DEBUG:teuthology.orchestra.run.trial048:> sudo ceph --cluster ceph config dump 2026-02-12T18:05:45.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.221+0000 7fe3147be640 10 monclient: get_monmap_and_config 2026-02-12T18:05:45.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.221+0000 7fe3147be640 10 monclient: build_initial_monmap 2026-02-12T18:05:45.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.221+0000 7fe3147be640 10 monclient: monmap: 2026-02-12T18:05:45.222 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:05:45.222 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:45.222 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:45.222764+0000 2026-02-12T18:05:45.222 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:45.222764+0000 2026-02-12T18:05:45.222 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:05:45.222 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:05:45.223 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:05:45.223 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:05:45.223 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:05:45.223 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:05:45.223 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:05:45.223 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:05:45.223 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:05:45.223 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:05:45.223 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:05:45.223 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:05:45.223 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:05:45.223 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:05:45.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe3147be640 1 Processor -- start 2026-02-12T18:05:45.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe3147be640 1 -- start start 2026-02-12T18:05:45.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe3147be640 10 monclient: init 2026-02-12T18:05:45.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe3147be640 10 monclient: _reopen_session rank -1 2026-02-12T18:05:45.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe3147be640 10 monclient: _add_conns ranks=[2,7,9,10,6,5,8,1,3,0,4] 2026-02-12T18:05:45.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe3147be640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe30c08d920 0x7fe30c054330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:45.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe3147be640 10 monclient(hunting): picked mon.noname-b con 0x7fe30c08d920 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:05:45.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe3147be640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe30c08f470 0x7fe30c054870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:45.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe3147be640 10 monclient(hunting): picked mon.noname-i con 0x7fe30c08f470 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:05:45.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe3147be640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fe30c054db0 0x7fe30c1a2930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:45.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe3147be640 10 monclient(hunting): picked mon.noname-a con 0x7fe30c054db0 addr v2:10.20.193.48:3300/0 2026-02-12T18:05:45.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe3147be640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:45.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe3147be640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7fe30c055200 con 0x7fe30c054db0 2026-02-12T18:05:45.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe3147be640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:45.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe3147be640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fe30c08a320 con 0x7fe30c08d920 2026-02-12T18:05:45.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe3147be640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:45.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe3147be640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fe30c08a070 con 0x7fe30c08f470 2026-02-12T18:05:45.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe3147be640 10 monclient(hunting): _renew_subs 2026-02-12T18:05:45.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe3147be640 10 monclient(hunting): authenticate will time out at 583.948514s 2026-02-12T18:05:45.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe312d34640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fe30c054db0 0x7fe30c1a2930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:45.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe312533640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe30c08d920 0x7fe30c054330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:45.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe312d34640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fe30c054db0 0x7fe30c1a2930 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:43348/0 (socket says 10.20.193.48:43348) 2026-02-12T18:05:45.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe312d34640 1 -- 10.20.193.48:0/2327114674 learned_addr learned my addr 10.20.193.48:0/2327114674 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:05:45.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe312d34640 10 monclient(hunting): get_auth_request con 0x7fe30c054db0 auth_method 0 2026-02-12T18:05:45.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe312d34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:45.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe312d34640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:45.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe312d34640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:45.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe312533640 10 monclient(hunting): get_auth_request con 0x7fe30c08d920 auth_method 0 2026-02-12T18:05:45.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe312533640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:45.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe312533640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:45.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe312533640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:45.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe312d34640 1 -- 10.20.193.48:0/2327114674 >> v2:10.20.193.48:3300/0 conn(0x7fe30c054db0 msgr2=0x7fe30c1a2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-12T18:05:45.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe312d34640 1 -- 10.20.193.48:0/2327114674 >> v2:10.20.193.48:3300/0 conn(0x7fe30c054db0 msgr2=0x7fe30c1a2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:45.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe312d34640 1 --2- 10.20.193.48:0/2327114674 >> v2:10.20.193.48:3300/0 conn(0x7fe30c054db0 0x7fe30c1a2930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:45.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe312d34640 1 --2- 10.20.193.48:0/2327114674 >> v2:10.20.193.48:3300/0 conn(0x7fe30c054db0 0x7fe30c1a2930 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:05:45.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe30c08f470 0x7fe30c054870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:45.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe30c08d920 msgr2=0x7fe30c054330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:05:45.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe30c08d920 msgr2=0x7fe30c054330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:45.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe30c08d920 0x7fe30c054330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:45.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe311d32640 10 monclient(hunting): get_auth_request con 0x7fe30c08f470 auth_method 0 2026-02-12T18:05:45.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe311d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:45.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe311d32640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:45.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe311d32640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:45.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe30c08d920 0x7fe30c054330 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:05:45.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe311d32640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe30c08f470 msgr2=0x7fe30c054870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:05:45.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe311d32640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe30c08f470 msgr2=0x7fe30c054870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:45.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe30c08f470 0x7fe30c054870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:45.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.222+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe30c08f470 0x7fe30c054870 unknown :-1 s=START_CONNECT pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:05:45.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.423+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe30c08f470 0x7fe30c054870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:45.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.423+0000 7fe311d32640 10 monclient(hunting): get_auth_request con 0x7fe30c08f470 auth_method 0 2026-02-12T18:05:45.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.423+0000 7fe311d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:45.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.423+0000 7fe311d32640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:45.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.423+0000 7fe311d32640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:45.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.423+0000 7fe311d32640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe30c08f470 msgr2=0x7fe30c054870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:05:45.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.423+0000 7fe311d32640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe30c08f470 msgr2=0x7fe30c054870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:45.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.423+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe30c08f470 0x7fe30c054870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=7 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:45.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.423+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe30c08f470 0x7fe30c054870 unknown :-1 s=START_CONNECT pgs=0 gs=8 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:05:45.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.424+0000 7fe312d34640 1 --2- 10.20.193.48:0/2327114674 >> v2:10.20.193.48:3300/0 conn(0x7fe30c054db0 0x7fe30c1a2930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=9 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:45.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.424+0000 7fe312d34640 10 monclient(hunting): get_auth_request con 0x7fe30c054db0 auth_method 0 2026-02-12T18:05:45.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.424+0000 7fe312d34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:45.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.424+0000 7fe312d34640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:45.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.424+0000 7fe312d34640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:45.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.424+0000 7fe312d34640 1 -- 10.20.193.48:0/2327114674 >> v2:10.20.193.48:3300/0 conn(0x7fe30c054db0 msgr2=0x7fe30c1a2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:05:45.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.424+0000 7fe312d34640 1 -- 10.20.193.48:0/2327114674 >> v2:10.20.193.48:3300/0 conn(0x7fe30c054db0 msgr2=0x7fe30c1a2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:45.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.424+0000 7fe312d34640 1 --2- 10.20.193.48:0/2327114674 >> v2:10.20.193.48:3300/0 conn(0x7fe30c054db0 0x7fe30c1a2930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=9 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:45.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.424+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe30c08d920 0x7fe30c054330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=10 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:45.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.424+0000 7fe312533640 10 monclient(hunting): get_auth_request con 0x7fe30c08d920 auth_method 0 2026-02-12T18:05:45.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.424+0000 7fe312533640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:45.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.424+0000 7fe312d34640 1 --2- 10.20.193.48:0/2327114674 >> v2:10.20.193.48:3300/0 conn(0x7fe30c054db0 0x7fe30c1a2930 unknown :-1 s=START_CONNECT pgs=0 gs=11 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:05:45.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.424+0000 7fe312533640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:45.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.424+0000 7fe312533640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:45.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.424+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe30c08d920 msgr2=0x7fe30c054330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:05:45.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.424+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe30c08d920 msgr2=0x7fe30c054330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:45.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.424+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe30c08d920 0x7fe30c054330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=10 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:45.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.424+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe30c08d920 0x7fe30c054330 unknown :-1 s=START_CONNECT pgs=0 gs=12 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:05:45.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.824+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe30c08f470 0x7fe30c054870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=13 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:45.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.824+0000 7fe311d32640 10 monclient(hunting): get_auth_request con 0x7fe30c08f470 auth_method 0 2026-02-12T18:05:45.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.824+0000 7fe311d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:45.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.824+0000 7fe311d32640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:45.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.824+0000 7fe311d32640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:45.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.824+0000 7fe311d32640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe30c08f470 msgr2=0x7fe30c054870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:05:45.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.824+0000 7fe311d32640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe30c08f470 msgr2=0x7fe30c054870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:45.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.824+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe30c08f470 0x7fe30c054870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=13 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:45.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.824+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe30c08f470 0x7fe30c054870 unknown :-1 s=START_CONNECT pgs=0 gs=14 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:05:45.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.825+0000 7fe312d34640 1 --2- 10.20.193.48:0/2327114674 >> v2:10.20.193.48:3300/0 conn(0x7fe30c054db0 0x7fe30c1a2930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=15 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:45.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.825+0000 7fe312d34640 10 monclient(hunting): get_auth_request con 0x7fe30c054db0 auth_method 0 2026-02-12T18:05:45.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.825+0000 7fe312d34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:45.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.825+0000 7fe312d34640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:45.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.825+0000 7fe312d34640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:45.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.825+0000 7fe312d34640 1 -- 10.20.193.48:0/2327114674 >> v2:10.20.193.48:3300/0 conn(0x7fe30c054db0 msgr2=0x7fe30c1a2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:05:45.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.825+0000 7fe312d34640 1 -- 10.20.193.48:0/2327114674 >> v2:10.20.193.48:3300/0 conn(0x7fe30c054db0 msgr2=0x7fe30c1a2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:45.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.825+0000 7fe312d34640 1 --2- 10.20.193.48:0/2327114674 >> v2:10.20.193.48:3300/0 conn(0x7fe30c054db0 0x7fe30c1a2930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=15 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:45.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.825+0000 7fe312d34640 1 --2- 10.20.193.48:0/2327114674 >> v2:10.20.193.48:3300/0 conn(0x7fe30c054db0 0x7fe30c1a2930 unknown :-1 s=START_CONNECT pgs=0 gs=17 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:05:45.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.825+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe30c08d920 0x7fe30c054330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=16 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:45.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.825+0000 7fe312533640 10 monclient(hunting): get_auth_request con 0x7fe30c08d920 auth_method 0 2026-02-12T18:05:45.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.825+0000 7fe312533640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:45.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.825+0000 7fe312533640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:45.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.825+0000 7fe312533640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:45.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.825+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe30c08d920 msgr2=0x7fe30c054330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:05:45.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.825+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe30c08d920 msgr2=0x7fe30c054330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:45.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.825+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe30c08d920 0x7fe30c054330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=16 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:45.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:45.825+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe30c08d920 0x7fe30c054330 unknown :-1 s=START_CONNECT pgs=0 gs=18 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:05:46.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.625+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe30c08f470 0x7fe30c054870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=19 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:46.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.625+0000 7fe311d32640 10 monclient(hunting): get_auth_request con 0x7fe30c08f470 auth_method 0 2026-02-12T18:05:46.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.625+0000 7fe311d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:46.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.625+0000 7fe311d32640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:46.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.625+0000 7fe311d32640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:46.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.625+0000 7fe311d32640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe30c08f470 msgr2=0x7fe30c054870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:05:46.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.625+0000 7fe311d32640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe30c08f470 msgr2=0x7fe30c054870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:46.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.625+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe30c08f470 0x7fe30c054870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=19 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:46.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.625+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe30c08f470 0x7fe30c054870 unknown :-1 s=START_CONNECT pgs=0 gs=20 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:05:46.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.626+0000 7fe312d34640 1 --2- 10.20.193.48:0/2327114674 >> v2:10.20.193.48:3300/0 conn(0x7fe30c054db0 0x7fe30c1a2930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=21 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:46.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.626+0000 7fe312d34640 10 monclient(hunting): get_auth_request con 0x7fe30c054db0 auth_method 0 2026-02-12T18:05:46.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.626+0000 7fe312d34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:46.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.626+0000 7fe312d34640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:46.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.626+0000 7fe312d34640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:46.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.626+0000 7fe312d34640 1 -- 10.20.193.48:0/2327114674 >> v2:10.20.193.48:3300/0 conn(0x7fe30c054db0 msgr2=0x7fe30c1a2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:05:46.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.626+0000 7fe312d34640 1 -- 10.20.193.48:0/2327114674 >> v2:10.20.193.48:3300/0 conn(0x7fe30c054db0 msgr2=0x7fe30c1a2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:46.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.626+0000 7fe312d34640 1 --2- 10.20.193.48:0/2327114674 >> v2:10.20.193.48:3300/0 conn(0x7fe30c054db0 0x7fe30c1a2930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=21 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:46.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.626+0000 7fe312d34640 1 --2- 10.20.193.48:0/2327114674 >> v2:10.20.193.48:3300/0 conn(0x7fe30c054db0 0x7fe30c1a2930 unknown :-1 s=START_CONNECT pgs=0 gs=23 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:05:46.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.626+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe30c08d920 0x7fe30c054330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=22 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:46.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.626+0000 7fe312533640 10 monclient(hunting): get_auth_request con 0x7fe30c08d920 auth_method 0 2026-02-12T18:05:46.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.626+0000 7fe312533640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:46.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.626+0000 7fe312533640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:46.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.626+0000 7fe312533640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:46.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.626+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe30c08d920 msgr2=0x7fe30c054330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:05:46.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.626+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe30c08d920 msgr2=0x7fe30c054330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:46.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.626+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe30c08d920 0x7fe30c054330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=22 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:46.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:46.626+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe30c08d920 0x7fe30c054330 unknown :-1 s=START_CONNECT pgs=0 gs=24 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:05:48.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe2f3fff640 10 monclient(hunting): tick 2026-02-12T18:05:48.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe2f3fff640 10 monclient(hunting): _check_auth_tickets 2026-02-12T18:05:48.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe2f3fff640 1 monclient(hunting): continuing hunt 2026-02-12T18:05:48.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe2f3fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T18:05:48.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe2f3fff640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe30c08f470 msgr2=0x7fe30c054870 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:05:48.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe2f3fff640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe30c08f470 0x7fe30c054870 unknown :-1 s=START_CONNECT pgs=0 gs=20 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:48.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe2f3fff640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe30c08d920 msgr2=0x7fe30c054330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:05:48.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe2f3fff640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe30c08d920 0x7fe30c054330 unknown :-1 s=START_CONNECT pgs=0 gs=24 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:48.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe2f3fff640 1 -- 10.20.193.48:0/2327114674 >> v2:10.20.193.48:3300/0 conn(0x7fe30c054db0 msgr2=0x7fe30c1a2930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:05:48.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe2f3fff640 1 --2- 10.20.193.48:0/2327114674 >> v2:10.20.193.48:3300/0 conn(0x7fe30c054db0 0x7fe30c1a2930 unknown :-1 s=START_CONNECT pgs=0 gs=23 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:48.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe2f3fff640 10 monclient: _add_conns ranks=[6,3,0,4,1,10,5,8] 2026-02-12T18:05:48.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe2f3fff640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe2ec003890 0x7fe2ec023cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:48.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe2f3fff640 10 monclient(hunting): picked mon.noname-d con 0x7fe2ec003890 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:05:48.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe2f3fff640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe2ec0242b0 0x7fe2ec044730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:48.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe2f3fff640 10 monclient(hunting): picked mon.noname-g con 0x7fe2ec0242b0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:05:48.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe2f3fff640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe2ec044e00 addr v1:10.20.193.48:6789/0 2026-02-12T18:05:48.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe2f3fff640 1 -- 10.20.193.48:0/2327114674 --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe30c060390 con 0x7fe2ec044e00 2026-02-12T18:05:48.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe2f3fff640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:48.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe2f3fff640 1 -- 10.20.193.48:0/2327114674 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe30c055200 con 0x7fe2ec0242b0 2026-02-12T18:05:48.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe2f3fff640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:48.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe2f3fff640 1 -- 10.20.193.48:0/2327114674 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fe30c08a320 con 0x7fe2ec003890 2026-02-12T18:05:48.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe2f3fff640 10 monclient(hunting): _renew_subs 2026-02-12T18:05:48.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe2ec003890 0x7fe2ec023cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=26 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:48.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe312533640 10 monclient(hunting): get_auth_request con 0x7fe2ec003890 auth_method 0 2026-02-12T18:05:48.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe312533640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:48.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe312533640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:48.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe312533640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:48.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe2ec0242b0 0x7fe2ec044730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=27 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:48.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe2ec003890 msgr2=0x7fe2ec023cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:05:48.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe2ec003890 msgr2=0x7fe2ec023cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:48.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe2ec003890 0x7fe2ec023cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=26 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:48.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe2ec003890 0x7fe2ec023cb0 unknown :-1 s=START_CONNECT pgs=0 gs=28 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:05:48.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe311d32640 10 monclient(hunting): get_auth_request con 0x7fe2ec0242b0 auth_method 0 2026-02-12T18:05:48.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe311d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:48.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe311d32640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:48.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe311d32640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:48.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe311d32640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe2ec0242b0 msgr2=0x7fe2ec044730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:05:48.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe311d32640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe2ec0242b0 msgr2=0x7fe2ec044730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:48.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe2ec0242b0 0x7fe2ec044730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=27 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:48.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.223+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe2ec0242b0 0x7fe2ec044730 unknown :-1 s=START_CONNECT pgs=0 gs=29 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:05:48.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.224+0000 7fe312d34640 1 -- 10.20.193.48:0/2327114674 >> v1:10.20.193.48:6789/0 conn(0x7fe2ec044e00 legacy=0x7fe2ec0652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:05:48.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.424+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe2ec003890 0x7fe2ec023cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=30 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:48.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.424+0000 7fe312533640 10 monclient(hunting): get_auth_request con 0x7fe2ec003890 auth_method 0 2026-02-12T18:05:48.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.424+0000 7fe312533640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:48.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.424+0000 7fe312533640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:48.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.424+0000 7fe312533640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:48.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.424+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe2ec003890 msgr2=0x7fe2ec023cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:05:48.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.424+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe2ec003890 msgr2=0x7fe2ec023cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:48.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.424+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe2ec003890 0x7fe2ec023cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=30 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:48.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.424+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe2ec003890 0x7fe2ec023cb0 unknown :-1 s=START_CONNECT pgs=0 gs=31 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:05:48.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.424+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe2ec0242b0 0x7fe2ec044730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=32 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:48.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.424+0000 7fe311d32640 10 monclient(hunting): get_auth_request con 0x7fe2ec0242b0 auth_method 0 2026-02-12T18:05:48.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.424+0000 7fe311d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:48.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.424+0000 7fe311d32640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:48.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.424+0000 7fe311d32640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:48.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.424+0000 7fe311d32640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe2ec0242b0 msgr2=0x7fe2ec044730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:05:48.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.424+0000 7fe311d32640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe2ec0242b0 msgr2=0x7fe2ec044730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:48.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.424+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe2ec0242b0 0x7fe2ec044730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=32 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:48.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.424+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe2ec0242b0 0x7fe2ec044730 unknown :-1 s=START_CONNECT pgs=0 gs=33 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:05:48.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.825+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe2ec0242b0 0x7fe2ec044730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=34 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:48.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.825+0000 7fe311d32640 10 monclient(hunting): get_auth_request con 0x7fe2ec0242b0 auth_method 0 2026-02-12T18:05:48.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.825+0000 7fe311d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:48.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.825+0000 7fe311d32640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:48.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.825+0000 7fe311d32640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:48.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.825+0000 7fe311d32640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe2ec0242b0 msgr2=0x7fe2ec044730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:05:48.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.825+0000 7fe311d32640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe2ec0242b0 msgr2=0x7fe2ec044730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:48.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.825+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe2ec0242b0 0x7fe2ec044730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=34 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:48.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.825+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe2ec0242b0 0x7fe2ec044730 unknown :-1 s=START_CONNECT pgs=0 gs=35 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:05:48.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.825+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe2ec003890 0x7fe2ec023cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=36 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:48.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.825+0000 7fe312533640 10 monclient(hunting): get_auth_request con 0x7fe2ec003890 auth_method 0 2026-02-12T18:05:48.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.825+0000 7fe312533640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:48.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.825+0000 7fe312533640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:48.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.825+0000 7fe312533640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:48.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.826+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe2ec003890 msgr2=0x7fe2ec023cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:05:48.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.826+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe2ec003890 msgr2=0x7fe2ec023cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:48.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.826+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe2ec003890 0x7fe2ec023cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=36 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:48.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:48.826+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe2ec003890 0x7fe2ec023cb0 unknown :-1 s=START_CONNECT pgs=0 gs=37 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:05:49.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:49.626+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe2ec0242b0 0x7fe2ec044730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=38 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:49.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:49.626+0000 7fe311d32640 10 monclient(hunting): get_auth_request con 0x7fe2ec0242b0 auth_method 0 2026-02-12T18:05:49.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:49.626+0000 7fe311d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:49.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:49.626+0000 7fe311d32640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:49.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:49.626+0000 7fe311d32640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:49.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:49.626+0000 7fe311d32640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe2ec0242b0 msgr2=0x7fe2ec044730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:05:49.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:49.626+0000 7fe311d32640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe2ec0242b0 msgr2=0x7fe2ec044730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:49.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:49.626+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe2ec0242b0 0x7fe2ec044730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=38 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:49.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:49.626+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe2ec0242b0 0x7fe2ec044730 unknown :-1 s=START_CONNECT pgs=0 gs=39 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:05:49.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:49.627+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe2ec003890 0x7fe2ec023cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=40 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:49.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:49.627+0000 7fe312533640 10 monclient(hunting): get_auth_request con 0x7fe2ec003890 auth_method 0 2026-02-12T18:05:49.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:49.628+0000 7fe312533640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:49.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:49.628+0000 7fe312533640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:49.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:49.628+0000 7fe312533640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:49.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:49.628+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe2ec003890 msgr2=0x7fe2ec023cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:05:49.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:49.628+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe2ec003890 msgr2=0x7fe2ec023cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:49.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:49.628+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe2ec003890 0x7fe2ec023cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=40 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:49.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:49.628+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe2ec003890 0x7fe2ec023cb0 unknown :-1 s=START_CONNECT pgs=0 gs=41 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:05:51.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe2f3fff640 10 monclient(hunting): tick 2026-02-12T18:05:51.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe2f3fff640 10 monclient(hunting): _check_auth_tickets 2026-02-12T18:05:51.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe2f3fff640 1 monclient(hunting): continuing hunt 2026-02-12T18:05:51.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe2f3fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T18:05:51.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe2f3fff640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe2ec003890 msgr2=0x7fe2ec023cb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:05:51.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe2f3fff640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe2ec003890 0x7fe2ec023cb0 unknown :-1 s=START_CONNECT pgs=0 gs=41 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:51.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe2f3fff640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe2ec0242b0 msgr2=0x7fe2ec044730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:05:51.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe2f3fff640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe2ec0242b0 0x7fe2ec044730 unknown :-1 s=START_CONNECT pgs=0 gs=39 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:51.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe2f3fff640 1 -- 10.20.193.48:0/2327114674 >> v1:10.20.193.48:6789/0 conn(0x7fe2ec044e00 legacy=0x7fe2ec0652b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:51.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe312d34640 1 -- 10.20.193.48:0/2327114674 reap_dead start 2026-02-12T18:05:51.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe312d34640 1 -- 10.20.193.48:0/2327114674 reap_dead start 2026-02-12T18:05:51.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe2f3fff640 10 monclient: _add_conns ranks=[4,8,10,1,5] 2026-02-12T18:05:51.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe2f3fff640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2ec066e80 0x7fe2ec067250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:51.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe2f3fff640 10 monclient(hunting): picked mon.noname-c con 0x7fe2ec066e80 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:05:51.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe2f3fff640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe2ec067790 0x7fe2ec023c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:51.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe2f3fff640 10 monclient(hunting): picked mon.noname-e con 0x7fe2ec067790 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:05:51.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe2f3fff640 1 --2- 10.20.193.48:0/2327114674 >> v2:10.20.193.111:3300/0 conn(0x7fe2ec0654a0 0x7fe2ec0446b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:51.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe2f3fff640 10 monclient(hunting): picked mon.noname-f con 0x7fe2ec0654a0 addr v2:10.20.193.111:3300/0 2026-02-12T18:05:51.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe2f3fff640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:51.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe2f3fff640 1 -- 10.20.193.48:0/2327114674 --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7fe30c055200 con 0x7fe2ec0654a0 2026-02-12T18:05:51.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe2f3fff640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:51.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe2f3fff640 1 -- 10.20.193.48:0/2327114674 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fe30c08a320 con 0x7fe2ec066e80 2026-02-12T18:05:51.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe2f3fff640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:51.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe2f3fff640 1 -- 10.20.193.48:0/2327114674 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fe30c08a070 con 0x7fe2ec067790 2026-02-12T18:05:51.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe2f3fff640 10 monclient(hunting): _renew_subs 2026-02-12T18:05:51.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2ec066e80 0x7fe2ec067250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=42 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:51.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe2ec067790 0x7fe2ec023c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=43 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:51.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe312533640 10 monclient(hunting): get_auth_request con 0x7fe2ec066e80 auth_method 0 2026-02-12T18:05:51.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe312533640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:51.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe312533640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:51.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe312533640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:51.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe311d32640 10 monclient(hunting): get_auth_request con 0x7fe2ec067790 auth_method 0 2026-02-12T18:05:51.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe311d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:51.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe311d32640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:51.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe311d32640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:51.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.222+0000 7fe312d34640 1 --2- 10.20.193.48:0/2327114674 >> v2:10.20.193.111:3300/0 conn(0x7fe2ec0654a0 0x7fe2ec0446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=44 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:51.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.223+0000 7fe312d34640 10 monclient(hunting): get_auth_request con 0x7fe2ec0654a0 auth_method 0 2026-02-12T18:05:51.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.223+0000 7fe312d34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:51.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.223+0000 7fe312d34640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:51.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.223+0000 7fe312d34640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:51.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.223+0000 7fe311d32640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe2ec067790 msgr2=0x7fe2ec023c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:05:51.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.223+0000 7fe311d32640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe2ec067790 msgr2=0x7fe2ec023c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:51.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.223+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe2ec067790 0x7fe2ec023c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=43 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:51.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.223+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2ec066e80 msgr2=0x7fe2ec067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:05:51.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.223+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2ec066e80 msgr2=0x7fe2ec067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:51.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.223+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2ec066e80 0x7fe2ec067250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=42 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:51.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.223+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2ec066e80 0x7fe2ec067250 unknown :-1 s=START_CONNECT pgs=0 gs=45 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:05:51.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.223+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe2ec067790 0x7fe2ec023c90 unknown :-1 s=START_CONNECT pgs=0 gs=46 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:05:51.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.223+0000 7fe312d34640 1 -- 10.20.193.48:0/2327114674 >> v2:10.20.193.111:3300/0 conn(0x7fe2ec0654a0 msgr2=0x7fe2ec0446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-12T18:05:51.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.223+0000 7fe312d34640 1 -- 10.20.193.48:0/2327114674 >> v2:10.20.193.111:3300/0 conn(0x7fe2ec0654a0 msgr2=0x7fe2ec0446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:51.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.223+0000 7fe312d34640 1 --2- 10.20.193.48:0/2327114674 >> v2:10.20.193.111:3300/0 conn(0x7fe2ec0654a0 0x7fe2ec0446b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=44 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:51.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.223+0000 7fe312d34640 1 --2- 10.20.193.48:0/2327114674 >> v2:10.20.193.111:3300/0 conn(0x7fe2ec0654a0 0x7fe2ec0446b0 unknown :-1 s=START_CONNECT pgs=0 gs=47 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:05:51.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe2ec067790 0x7fe2ec023c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=49 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:51.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2ec066e80 0x7fe2ec067250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=48 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:51.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe311d32640 10 monclient(hunting): get_auth_request con 0x7fe2ec067790 auth_method 0 2026-02-12T18:05:51.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe311d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:51.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe311d32640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:51.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe311d32640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:51.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe312533640 10 monclient(hunting): get_auth_request con 0x7fe2ec066e80 auth_method 0 2026-02-12T18:05:51.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe312533640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:51.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe312533640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:51.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe312533640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:51.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe311d32640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe2ec067790 msgr2=0x7fe2ec023c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:05:51.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe311d32640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe2ec067790 msgr2=0x7fe2ec023c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:51.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe2ec067790 0x7fe2ec023c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=49 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:51.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe2ec067790 0x7fe2ec023c90 unknown :-1 s=START_CONNECT pgs=0 gs=50 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:05:51.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2ec066e80 msgr2=0x7fe2ec067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:05:51.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2ec066e80 msgr2=0x7fe2ec067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:51.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2ec066e80 0x7fe2ec067250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=48 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:51.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2ec066e80 0x7fe2ec067250 unknown :-1 s=START_CONNECT pgs=0 gs=52 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:05:51.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe312d34640 1 --2- 10.20.193.48:0/2327114674 >> v2:10.20.193.111:3300/0 conn(0x7fe2ec0654a0 0x7fe2ec0446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=51 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:51.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe312d34640 10 monclient(hunting): get_auth_request con 0x7fe2ec0654a0 auth_method 0 2026-02-12T18:05:51.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe312d34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:51.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe312d34640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:51.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe312d34640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:51.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe312d34640 1 -- 10.20.193.48:0/2327114674 >> v2:10.20.193.111:3300/0 conn(0x7fe2ec0654a0 msgr2=0x7fe2ec0446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-12T18:05:51.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe312d34640 1 -- 10.20.193.48:0/2327114674 >> v2:10.20.193.111:3300/0 conn(0x7fe2ec0654a0 msgr2=0x7fe2ec0446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:51.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe312d34640 1 --2- 10.20.193.48:0/2327114674 >> v2:10.20.193.111:3300/0 conn(0x7fe2ec0654a0 0x7fe2ec0446b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=51 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:51.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.425+0000 7fe312d34640 1 --2- 10.20.193.48:0/2327114674 >> v2:10.20.193.111:3300/0 conn(0x7fe2ec0654a0 0x7fe2ec0446b0 unknown :-1 s=START_CONNECT pgs=0 gs=53 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:05:51.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe2ec067790 0x7fe2ec023c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=54 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:51.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe311d32640 10 monclient(hunting): get_auth_request con 0x7fe2ec067790 auth_method 0 2026-02-12T18:05:51.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe311d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:51.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe311d32640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:51.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe311d32640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:51.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe311d32640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe2ec067790 msgr2=0x7fe2ec023c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:05:51.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe311d32640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe2ec067790 msgr2=0x7fe2ec023c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:51.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe2ec067790 0x7fe2ec023c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=54 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:51.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe2ec067790 0x7fe2ec023c90 unknown :-1 s=START_CONNECT pgs=0 gs=56 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:05:51.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2ec066e80 0x7fe2ec067250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=55 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:51.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe312533640 10 monclient(hunting): get_auth_request con 0x7fe2ec066e80 auth_method 0 2026-02-12T18:05:51.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe312533640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:51.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe312533640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:51.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe312533640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:51.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2ec066e80 msgr2=0x7fe2ec067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:05:51.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2ec066e80 msgr2=0x7fe2ec067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:51.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2ec066e80 0x7fe2ec067250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=55 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:51.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2ec066e80 0x7fe2ec067250 unknown :-1 s=START_CONNECT pgs=0 gs=57 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:05:51.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe312d34640 1 --2- 10.20.193.48:0/2327114674 >> v2:10.20.193.111:3300/0 conn(0x7fe2ec0654a0 0x7fe2ec0446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=58 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:51.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe312d34640 10 monclient(hunting): get_auth_request con 0x7fe2ec0654a0 auth_method 0 2026-02-12T18:05:51.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe312d34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:51.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe312d34640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:51.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe312d34640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:51.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe312d34640 1 -- 10.20.193.48:0/2327114674 >> v2:10.20.193.111:3300/0 conn(0x7fe2ec0654a0 msgr2=0x7fe2ec0446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:05:51.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe312d34640 1 -- 10.20.193.48:0/2327114674 >> v2:10.20.193.111:3300/0 conn(0x7fe2ec0654a0 msgr2=0x7fe2ec0446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:51.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe312d34640 1 --2- 10.20.193.48:0/2327114674 >> v2:10.20.193.111:3300/0 conn(0x7fe2ec0654a0 0x7fe2ec0446b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=58 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:51.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:51.826+0000 7fe312d34640 1 --2- 10.20.193.48:0/2327114674 >> v2:10.20.193.111:3300/0 conn(0x7fe2ec0654a0 0x7fe2ec0446b0 unknown :-1 s=START_CONNECT pgs=0 gs=59 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:05:52.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.627+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe2ec067790 0x7fe2ec023c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=60 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:52.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.627+0000 7fe311d32640 10 monclient(hunting): get_auth_request con 0x7fe2ec067790 auth_method 0 2026-02-12T18:05:52.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.627+0000 7fe311d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:52.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.627+0000 7fe311d32640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:52.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.627+0000 7fe311d32640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:52.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.627+0000 7fe311d32640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe2ec067790 msgr2=0x7fe2ec023c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:05:52.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.627+0000 7fe311d32640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe2ec067790 msgr2=0x7fe2ec023c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:52.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.627+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe2ec067790 0x7fe2ec023c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=60 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:52.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.627+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe2ec067790 0x7fe2ec023c90 unknown :-1 s=START_CONNECT pgs=0 gs=62 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:05:52.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.627+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2ec066e80 0x7fe2ec067250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=61 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:52.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.627+0000 7fe312533640 10 monclient(hunting): get_auth_request con 0x7fe2ec066e80 auth_method 0 2026-02-12T18:05:52.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.627+0000 7fe312533640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:52.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.627+0000 7fe312533640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:52.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.627+0000 7fe312533640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:52.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.627+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2ec066e80 msgr2=0x7fe2ec067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:05:52.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.627+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2ec066e80 msgr2=0x7fe2ec067250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:52.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.627+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2ec066e80 0x7fe2ec067250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=61 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:52.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.627+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2ec066e80 0x7fe2ec067250 unknown :-1 s=START_CONNECT pgs=0 gs=63 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:05:52.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.627+0000 7fe312d34640 1 --2- 10.20.193.48:0/2327114674 >> v2:10.20.193.111:3300/0 conn(0x7fe2ec0654a0 0x7fe2ec0446b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=64 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:52.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.627+0000 7fe312d34640 10 monclient(hunting): get_auth_request con 0x7fe2ec0654a0 auth_method 0 2026-02-12T18:05:52.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.627+0000 7fe312d34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:52.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.627+0000 7fe312d34640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:52.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.627+0000 7fe312d34640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:52.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.627+0000 7fe312d34640 1 -- 10.20.193.48:0/2327114674 >> v2:10.20.193.111:3300/0 conn(0x7fe2ec0654a0 msgr2=0x7fe2ec0446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:05:52.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.628+0000 7fe312d34640 1 -- 10.20.193.48:0/2327114674 >> v2:10.20.193.111:3300/0 conn(0x7fe2ec0654a0 msgr2=0x7fe2ec0446b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:52.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.628+0000 7fe312d34640 1 --2- 10.20.193.48:0/2327114674 >> v2:10.20.193.111:3300/0 conn(0x7fe2ec0654a0 0x7fe2ec0446b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=64 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:52.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:52.628+0000 7fe312d34640 1 --2- 10.20.193.48:0/2327114674 >> v2:10.20.193.111:3300/0 conn(0x7fe2ec0654a0 0x7fe2ec0446b0 unknown :-1 s=START_CONNECT pgs=0 gs=65 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:05:54.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe2f3fff640 10 monclient(hunting): tick 2026-02-12T18:05:54.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe2f3fff640 10 monclient(hunting): _check_auth_tickets 2026-02-12T18:05:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe2f3fff640 1 monclient(hunting): continuing hunt 2026-02-12T18:05:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe2f3fff640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T18:05:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe2f3fff640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe2ec067790 msgr2=0x7fe2ec023c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:05:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe2f3fff640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe2ec067790 0x7fe2ec023c90 unknown :-1 s=START_CONNECT pgs=0 gs=62 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe2f3fff640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2ec066e80 msgr2=0x7fe2ec067250 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:05:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe2f3fff640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2ec066e80 0x7fe2ec067250 unknown :-1 s=START_CONNECT pgs=0 gs=63 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe2f3fff640 1 -- 10.20.193.48:0/2327114674 >> v2:10.20.193.111:3300/0 conn(0x7fe2ec0654a0 msgr2=0x7fe2ec0446b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:05:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe2f3fff640 1 --2- 10.20.193.48:0/2327114674 >> v2:10.20.193.111:3300/0 conn(0x7fe2ec0654a0 0x7fe2ec0446b0 unknown :-1 s=START_CONNECT pgs=0 gs=65 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe2f3fff640 10 monclient: _add_conns ranks=[5,1] 2026-02-12T18:05:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe2f3fff640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2ec065e60 0x7fe2ec066230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe2f3fff640 10 monclient(hunting): picked mon.noname-h con 0x7fe2ec065e60 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:05:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe2f3fff640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fe2ec088010 addr v1:10.20.193.111:6789/0 2026-02-12T18:05:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe2f3fff640 1 -- 10.20.193.48:0/2327114674 --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2ec067d10 con 0x7fe2ec088010 2026-02-12T18:05:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe2f3fff640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe2f3fff640 1 -- 10.20.193.48:0/2327114674 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fe30c055200 con 0x7fe2ec065e60 2026-02-12T18:05:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe2f3fff640 10 monclient(hunting): _renew_subs 2026-02-12T18:05:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2ec065e60 0x7fe2ec066230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=67 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe312533640 10 monclient(hunting): get_auth_request con 0x7fe2ec065e60 auth_method 0 2026-02-12T18:05:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe312533640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe312533640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe312533640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:54.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2ec065e60 msgr2=0x7fe2ec066230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:05:54.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2ec065e60 msgr2=0x7fe2ec066230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:54.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2ec065e60 0x7fe2ec066230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=67 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:54.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.223+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2ec065e60 0x7fe2ec066230 unknown :-1 s=START_CONNECT pgs=0 gs=68 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:05:54.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.225+0000 7fe311d32640 1 -- 10.20.193.48:0/2327114674 >> v1:10.20.193.111:6789/0 conn(0x7fe2ec088010 legacy=0x7fe2ec0a83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:05:54.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.424+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2ec065e60 0x7fe2ec066230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=69 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:54.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.424+0000 7fe312533640 10 monclient(hunting): get_auth_request con 0x7fe2ec065e60 auth_method 0 2026-02-12T18:05:54.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.424+0000 7fe312533640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:54.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.424+0000 7fe312533640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:54.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.424+0000 7fe312533640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:54.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.425+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2ec065e60 msgr2=0x7fe2ec066230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:05:54.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.425+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2ec065e60 msgr2=0x7fe2ec066230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:54.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.425+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2ec065e60 0x7fe2ec066230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=69 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:54.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.425+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2ec065e60 0x7fe2ec066230 unknown :-1 s=START_CONNECT pgs=0 gs=70 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:05:54.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.826+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2ec065e60 0x7fe2ec066230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=71 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:54.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.826+0000 7fe312533640 10 monclient(hunting): get_auth_request con 0x7fe2ec065e60 auth_method 0 2026-02-12T18:05:54.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.826+0000 7fe312533640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:54.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.826+0000 7fe312533640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:54.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.826+0000 7fe312533640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:54.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.826+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2ec065e60 msgr2=0x7fe2ec066230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:05:54.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.826+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2ec065e60 msgr2=0x7fe2ec066230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:54.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.826+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2ec065e60 0x7fe2ec066230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=71 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:54.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:54.826+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2ec065e60 0x7fe2ec066230 unknown :-1 s=START_CONNECT pgs=0 gs=72 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:05:55.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:55.627+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2ec065e60 0x7fe2ec066230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=73 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:55.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:55.627+0000 7fe312533640 10 monclient(hunting): get_auth_request con 0x7fe2ec065e60 auth_method 0 2026-02-12T18:05:55.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:55.627+0000 7fe312533640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:55.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:55.627+0000 7fe312533640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:55.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:55.627+0000 7fe312533640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:55.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:55.627+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2ec065e60 msgr2=0x7fe2ec066230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:05:55.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:55.627+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2ec065e60 msgr2=0x7fe2ec066230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:55.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:55.627+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2ec065e60 0x7fe2ec066230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=73 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:55.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:55.627+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2ec065e60 0x7fe2ec066230 unknown :-1 s=START_CONNECT pgs=0 gs=74 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.207+0000 7fe311531640 1 -- 10.20.193.48:0/2327114674 <== mon.1 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 743406430 0 0) 0x7fe2ec067d10 con 0x7fe2ec088010 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.207+0000 7fe311531640 10 monclient(hunting): _negotiate 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.207+0000 7fe311531640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.207+0000 7fe311531640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.207+0000 7fe311531640 10 monclient(hunting): my global_id is 4105 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.207+0000 7fe311531640 1 -- 10.20.193.48:0/2327114674 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2f40035e0 con 0x7fe2ec088010 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.207+0000 7fe311531640 1 -- 10.20.193.48:0/2327114674 <== mon.1 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3356705870 0 0) 0x7fe2f40035e0 con 0x7fe2ec088010 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.207+0000 7fe311531640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2ec065e60 msgr2=0x7fe2ec066230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.207+0000 7fe311531640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2ec065e60 0x7fe2ec066230 unknown :-1 s=START_CONNECT pgs=0 gs=74 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.207+0000 7fe311531640 10 monclient: _finish_hunting 0 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.207+0000 7fe311531640 1 monclient: found mon.noname-f-legacy 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.207+0000 7fe311531640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.207+0000 7fe311531640 10 monclient: _send_mon_message to mon.noname-f-legacy at v1:10.20.193.111:6789/0 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.207+0000 7fe311531640 1 -- 10.20.193.48:0/2327114674 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2ec0aab20 con 0x7fe2ec088010 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.207+0000 7fe311531640 10 monclient: _finish_auth 0 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.207+0000 7fe311531640 10 monclient: _check_auth_tickets 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.207+0000 7fe311531640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.207+0000 7fe311531640 1 -- 10.20.193.48:0/2327114674 <== mon.1 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (unknown 3750814960 0 0) 0x7fe3000044b0 con 0x7fe2ec088010 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.207+0000 7fe311531640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311531640 10 monclient: got monmap 1 from mon.noname-f-legacy (according to old e1) 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311531640 10 monclient: dump: 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:05:56.209 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311531640 1 monclient: mon.f has (v2) addrs [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] but i'm connected to v1:10.20.193.111:6789/0, reconnecting 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311531640 10 monclient: _reopen_session rank -1 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311531640 1 -- 10.20.193.48:0/2327114674 >> v1:10.20.193.111:6789/0 conn(0x7fe2ec088010 legacy=0x7fe2ec0a83f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312d34640 1 -- 10.20.193.48:0/2327114674 reap_dead start 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311531640 10 monclient: _add_conns ranks=[5,1,4,7,6,2,8,3,0] 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311531640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2f4004280 0x7fe2f4004850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311531640 10 monclient(hunting): picked mon.h con 0x7fe2f4004280 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311531640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe2f4004eb0 0x7fe2f4005320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311531640 10 monclient(hunting): picked mon.f con 0x7fe2f4004eb0 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311531640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2f4045cf0 0x7fe2f4066170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311531640 10 monclient(hunting): picked mon.c con 0x7fe2f4045cf0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311531640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311531640 1 -- 10.20.193.48:0/2327114674 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c055200 con 0x7fe2f4004eb0 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311531640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311531640 1 -- 10.20.193.48:0/2327114674 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fe2f4066a50 con 0x7fe2f4045cf0 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311531640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311531640 1 -- 10.20.193.48:0/2327114674 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fe2f4066bc0 con 0x7fe2f4004280 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311531640 10 monclient(hunting): _renew_subs 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311531640 10 monclient(hunting): _finish_auth 0 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312d34640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2f4045cf0 0x7fe2f4066170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=75 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312d34640 10 monclient(hunting): get_auth_request con 0x7fe2f4045cf0 auth_method 0 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312d34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312d34640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312d34640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2f4004280 0x7fe2f4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=76 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312533640 10 monclient(hunting): get_auth_request con 0x7fe2f4004280 auth_method 0 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312533640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312533640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312533640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:56.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311d32640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe2f4004eb0 0x7fe2f4005320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=77 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312d34640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2f4045cf0 msgr2=0x7fe2f4066170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312d34640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2f4045cf0 msgr2=0x7fe2f4066170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312d34640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2f4045cf0 0x7fe2f4066170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=75 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311d32640 10 monclient(hunting): get_auth_request con 0x7fe2f4004eb0 auth_method 0 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311d32640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311d32640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312d34640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2f4045cf0 0x7fe2f4066170 unknown :-1 s=START_CONNECT pgs=0 gs=78 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312533640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312533640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312533640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311d32640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311d32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe311d32640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312533640 10 monclient(hunting): handle_auth_done global_id 4105 payload 293 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2f4045cf0 msgr2=0x7fe2f4066170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2f4045cf0 0x7fe2f4066170 unknown :-1 s=START_CONNECT pgs=0 gs=78 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe2f4004eb0 msgr2=0x7fe2f4005320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe2f4004eb0 0x7fe2f4005320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=77 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312533640 10 monclient: _finish_hunting 0 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312533640 1 monclient: found mon.h 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312533640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312533640 10 monclient: _send_mon_message to mon.h at v2:10.20.193.111:3302/0 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f40035e0 con 0x7fe2f4004280 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312533640 10 monclient: _finish_auth 0 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312533640 10 monclient: _check_auth_tickets 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe312533640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe3147be640 5 monclient: authenticate success, global_id 4105 2026-02-12T18:05:56.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.208+0000 7fe3147be640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:05:56.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.211+0000 7fe312533640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2f4004280 msgr2=0x7fe2f4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:05:56.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.211+0000 7fe312533640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2f4004280 0x7fe2f4004850 secure :-1 s=READY pgs=24 gs=76 cs=0 l=1 c_cookie=11692188038332868218 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2ec067c80 tx=0x7fe2fc0320b0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=a242ff12afe6e67a server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:05:56.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.211+0000 7fe311531640 1 -- 10.20.193.48:0/2327114674 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe2fc032d90 con 0x7fe2f4004280 2026-02-12T18:05:56.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.211+0000 7fe311531640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:56.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.211+0000 7fe311531640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:05:56.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.211+0000 7fe311531640 10 monclient: dump: 2026-02-12T18:05:56.212 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:05:56.212 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:56.212 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:56.212 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:56.212 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:56.212 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:05:56.212 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:56.212 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:56.212 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:56.212 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:56.212 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:56.212 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:56.212 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:56.212 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:56.212 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:56.212 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:05:56.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.211+0000 7fe3147be640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:05:56.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.211+0000 7fe311531640 1 -- 10.20.193.48:0/2327114674 <== mon.5 v2:10.20.193.111:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2fc01e040 con 0x7fe2f4004280 2026-02-12T18:05:56.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.211+0000 7fe311531640 10 monclient: handle_config config(0 keys) 2026-02-12T18:05:56.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.211+0000 7fe311531640 1 -- 10.20.193.48:0/2327114674 <== mon.5 v2:10.20.193.111:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe2fc038340 con 0x7fe2f4004280 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.211+0000 7fe311531640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.211+0000 7fe311531640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.211+0000 7fe311531640 10 monclient: dump: 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.211+0000 7fe3147be640 10 monclient: get_monmap_and_config success 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.211+0000 7fe3147be640 4 set_mon_vals no callback set 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.211+0000 7fe3147be640 10 monclient: shutdown 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.211+0000 7fe3147be640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.211+0000 7fe3147be640 1 -- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2f4004280 msgr2=0x7fe2f4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.211+0000 7fe3147be640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2f4004280 0x7fe2f4004850 secure :-1 s=READY pgs=24 gs=76 cs=0 l=1 c_cookie=11692188038332868218 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2ec067c80 tx=0x7fe2fc0320b0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.211+0000 7fe3147be640 1 -- 10.20.193.48:0/2327114674 shutdown_connections 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.211+0000 7fe3147be640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe2f4045cf0 0x7fe2f4066170 unknown :-1 s=CLOSED pgs=0 gs=78 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.211+0000 7fe3147be640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe2f4004eb0 0x7fe2f4005320 unknown :-1 s=CLOSED pgs=0 gs=77 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.211+0000 7fe3147be640 1 --2- 10.20.193.48:0/2327114674 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe2f4004280 0x7fe2f4004850 unknown :-1 s=CLOSED pgs=24 gs=76 cs=0 l=1 c_cookie=11692188038332868218 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.211+0000 7fe3147be640 1 -- 10.20.193.48:0/2327114674 >> 10.20.193.48:0/2327114674 conn(0x7fe30c056cb0 msgr2=0x7fe30c094120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.212+0000 7fe3147be640 1 -- 10.20.193.48:0/2327114674 shutdown_connections 2026-02-12T18:05:56.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.212+0000 7fe3147be640 1 -- 10.20.193.48:0/2327114674 wait complete. 2026-02-12T18:05:56.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.212+0000 7fe3147be640 10 monclient: build_initial_monmap 2026-02-12T18:05:56.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.212+0000 7fe3147be640 10 monclient: monmap: 2026-02-12T18:05:56.214 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:05:56.214 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:05:56.214 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:05:56.214 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:05:56.214 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:05:56.214 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:05:56.214 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.212+0000 7fe3147be640 1 Processor -- start 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.212+0000 7fe3147be640 1 -- start start 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.212+0000 7fe3147be640 10 monclient: init 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe3147be640 10 monclient: _reopen_session rank -1 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe3147be640 10 monclient: _add_conns ranks=[0,1,7,5,6,4,3,8,2] 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe3147be640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fe2f4004280 0x7fe30c1baf80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe3147be640 10 monclient(hunting): picked mon.noname-a con 0x7fe2f4004280 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe3147be640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe2f4004eb0 0x7fe30c1d4d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe3147be640 10 monclient(hunting): picked mon.noname-f con 0x7fe2f4004eb0 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe3147be640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe2f4045cf0 0x7fe30c1d7900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe3147be640 10 monclient(hunting): picked mon.noname-i con 0x7fe2f4045cf0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe3147be640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe3147be640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c1bc1c0 con 0x7fe2f4004280 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe3147be640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe3147be640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe30c08d650 con 0x7fe2f4004eb0 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe3147be640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe3147be640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fe30c1db750 con 0x7fe2f4045cf0 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe3147be640 10 monclient(hunting): _renew_subs 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe3147be640 10 monclient(hunting): authenticate will time out at 594.939193s 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312533640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fe2f4004280 0x7fe30c1baf80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312533640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fe2f4004280 0x7fe30c1baf80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:52414/0 (socket says 10.20.193.48:52414) 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312533640 1 -- 10.20.193.48:0/3267072257 learned_addr learned my addr 10.20.193.48:0/3267072257 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312533640 10 monclient(hunting): get_auth_request con 0x7fe2f4004280 auth_method 0 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312533640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312533640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312533640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312d34640 1 --2- 10.20.193.48:0/3267072257 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe2f4045cf0 0x7fe30c1d7900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312d34640 10 monclient(hunting): get_auth_request con 0x7fe2f4045cf0 auth_method 0 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312d34640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:56.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312d34640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:56.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312d34640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:56.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312533640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:56.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312533640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:56.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe311d32640 1 --2- 10.20.193.48:0/3267072257 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe2f4004eb0 0x7fe30c1d4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:56.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312533640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:56.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe311d32640 10 monclient(hunting): get_auth_request con 0x7fe2f4004eb0 auth_method 0 2026-02-12T18:05:56.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe311d32640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:56.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe311d32640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:56.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe311d32640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:56.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312d34640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:56.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312d34640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:56.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312d34640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:56.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe311d32640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:56.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe311d32640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:56.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe311d32640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:56.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312533640 10 monclient(hunting): handle_auth_done global_id 4113 payload 824 2026-02-12T18:05:56.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312533640 1 -- 10.20.193.48:0/3267072257 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe2f4045cf0 msgr2=0x7fe30c1d7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:56.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312533640 1 --2- 10.20.193.48:0/3267072257 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe2f4045cf0 0x7fe30c1d7900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312533640 1 -- 10.20.193.48:0/3267072257 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe2f4004eb0 msgr2=0x7fe30c1d4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:56.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312533640 1 --2- 10.20.193.48:0/3267072257 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe2f4004eb0 0x7fe30c1d4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312533640 10 monclient: _finish_hunting 0 2026-02-12T18:05:56.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312533640 1 monclient: found mon.noname-a 2026-02-12T18:05:56.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312533640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:05:56.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312533640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:05:56.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.213+0000 7fe312533640 1 -- 10.20.193.48:0/3267072257 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe30c1bb910 con 0x7fe2f4004280 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.215+0000 7fe312533640 1 -- 10.20.193.48:0/3267072257 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fe2f4004280 msgr2=0x7fe30c1baf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.215+0000 7fe312533640 1 --2- 10.20.193.48:0/3267072257 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fe2f4004280 0x7fe30c1baf80 secure :-1 s=READY pgs=29 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2fc0023d0 tx=0x7fe2fc0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.215+0000 7fe2f2ffd640 1 -- 10.20.193.48:0/3267072257 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe2fc0044f0 con 0x7fe2f4004280 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.215+0000 7fe2f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.215+0000 7fe2f2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.215+0000 7fe2f2ffd640 10 monclient: dump: 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.215+0000 7fe2f2ffd640 10 monclient: _finish_auth 0 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.215+0000 7fe2f2ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.215+0000 7fe2f2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.215+0000 7fe2f2ffd640 1 -- 10.20.193.48:0/3267072257 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2fc00c040 con 0x7fe2f4004280 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.215+0000 7fe2f2ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.215+0000 7fe2f2ffd640 1 -- 10.20.193.48:0/3267072257 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe2fc003b90 con 0x7fe2f4004280 2026-02-12T18:05:56.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.215+0000 7fe2f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.215+0000 7fe2f2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.215+0000 7fe2f2ffd640 10 monclient: dump: 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.215+0000 7fe310d30640 4 set_mon_vals no callback set 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.216+0000 7fe3147be640 5 monclient: authenticate success, global_id 4113 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.216+0000 7fe3147be640 10 monclient: _renew_subs 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.216+0000 7fe3147be640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.216+0000 7fe3147be640 1 -- 10.20.193.48:0/3267072257 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe30c1ba420 con 0x7fe2f4004280 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.216+0000 7fe3147be640 10 monclient: _renew_subs 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.216+0000 7fe3147be640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.216+0000 7fe3147be640 1 -- 10.20.193.48:0/3267072257 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe30c1bbee0 con 0x7fe2f4004280 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.216+0000 7fe2f2ffd640 1 -- 10.20.193.48:0/3267072257 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7fe2fc003cf0 con 0x7fe2f4004280 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.216+0000 7fe2f2ffd640 1 -- 10.20.193.48:0/3267072257 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7fe2fc050820 con 0x7fe2f4004280 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.216+0000 7fe3147be640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.216+0000 7fe3147be640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.216+0000 7fe3147be640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.216+0000 7fe3147be640 1 -- 10.20.193.48:0/3267072257 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe30c1bc3c0 con 0x7fe2f4004280 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.217+0000 7fe2f2ffd640 1 -- 10.20.193.48:0/3267072257 <== mon.0 v2:10.20.193.48:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7fe2fc03f070 con 0x7fe2f4004280 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.217+0000 7fe2f2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:56.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.217+0000 7fe2f2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:05:56.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.245+0000 7fe3147be640 10 start_mon_command cmd=[{"prefix": "config dump"}] 2026-02-12T18:05:56.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.245+0000 7fe3147be640 10 monclient: _send_command 2 [{"prefix": "config dump"}] 2026-02-12T18:05:56.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.245+0000 7fe3147be640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:05:56.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.246+0000 7fe3147be640 1 -- 10.20.193.48:0/3267072257 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fe30c1bc3c0 con 0x7fe2f4004280 2026-02-12T18:05:56.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.246+0000 7fe2f2ffd640 1 -- 10.20.193.48:0/3267072257 <== mon.0 v2:10.20.193.48:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v1) ==== 59+0+36 (secure 0 0 0) 0x7fe2fc00f040 con 0x7fe2f4004280 2026-02-12T18:05:56.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.246+0000 7fe2f2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config dump"}] 2026-02-12T18:05:56.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.246+0000 7fe2f2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:05:56.246 INFO:teuthology.orchestra.run.trial048.stdout:WHO MASK LEVEL OPTION VALUE RO 2026-02-12T18:05:56.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.246+0000 7fe3147be640 10 monclient: shutdown 2026-02-12T18:05:56.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.246+0000 7fe3147be640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:05:56.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.246+0000 7fe3147be640 1 -- 10.20.193.48:0/3267072257 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fe2f4004280 msgr2=0x7fe30c1baf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:56.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.246+0000 7fe3147be640 1 --2- 10.20.193.48:0/3267072257 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fe2f4004280 0x7fe30c1baf80 secure :-1 s=READY pgs=29 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe2fc0023d0 tx=0x7fe2fc0047e0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.246+0000 7fe3147be640 1 -- 10.20.193.48:0/3267072257 shutdown_connections 2026-02-12T18:05:56.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.246+0000 7fe3147be640 1 --2- 10.20.193.48:0/3267072257 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe2f4045cf0 0x7fe30c1d7900 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.246+0000 7fe3147be640 1 --2- 10.20.193.48:0/3267072257 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe2f4004eb0 0x7fe30c1d4d20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.246+0000 7fe3147be640 1 --2- 10.20.193.48:0/3267072257 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fe2f4004280 0x7fe30c1baf80 unknown :-1 s=CLOSED pgs=29 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.246+0000 7fe3147be640 1 -- 10.20.193.48:0/3267072257 >> 10.20.193.48:0/3267072257 conn(0x7fe30c056cb0 msgr2=0x7fe30c090c00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:05:56.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.246+0000 7fe3147be640 1 -- 10.20.193.48:0/3267072257 shutdown_connections 2026-02-12T18:05:56.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.246+0000 7fe3147be640 1 -- 10.20.193.48:0/3267072257 wait complete. 2026-02-12T18:05:56.254 INFO:tasks.ceph:Setting crush tunables to default 2026-02-12T18:05:56.254 DEBUG:teuthology.orchestra.run.trial048:> sudo ceph --cluster ceph osd crush tunables default 2026-02-12T18:05:56.315 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.314+0000 7fabe3994640 10 monclient: get_monmap_and_config 2026-02-12T18:05:56.315 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.314+0000 7fabe3994640 10 monclient: build_initial_monmap 2026-02-12T18:05:56.315 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.314+0000 7fabe3994640 10 monclient: monmap: 2026-02-12T18:05:56.315 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:05:56.315 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:56.315 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:56.315562+0000 2026-02-12T18:05:56.315 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:56.315562+0000 2026-02-12T18:05:56.315 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:05:56.315 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:05:56.316 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:05:56.316 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:05:56.316 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:05:56.316 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:05:56.316 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:05:56.316 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:05:56.316 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:05:56.316 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:05:56.316 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:05:56.316 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:05:56.316 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:05:56.316 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:05:56.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.314+0000 7fabe3994640 1 Processor -- start 2026-02-12T18:05:56.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.314+0000 7fabe3994640 1 -- start start 2026-02-12T18:05:56.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.314+0000 7fabe3994640 10 monclient: init 2026-02-12T18:05:56.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe3994640 10 monclient: _reopen_session rank -1 2026-02-12T18:05:56.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe3994640 10 monclient: _add_conns ranks=[1,2,6,8,10,5,3,9,0,7,4] 2026-02-12T18:05:56.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe3994640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fabdc090070 addr v1:10.20.193.111:6789/0 2026-02-12T18:05:56.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe3994640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fabdc08cf80 0x7fabdc05dd40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:56.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe3994640 10 monclient(hunting): picked mon.noname-b con 0x7fabdc08cf80 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:05:56.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe3994640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fabdc183300 0x7fabdc1a36e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:56.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe3994640 10 monclient(hunting): picked mon.noname-d con 0x7fabdc183300 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:05:56.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe3994640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabdc04dc20 con 0x7fabdc090070 2026-02-12T18:05:56.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe3994640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:56.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe3994640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fabdc057de0 con 0x7fabdc08cf80 2026-02-12T18:05:56.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe3994640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:56.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe3994640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fabdc090440 con 0x7fabdc183300 2026-02-12T18:05:56.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe3994640 10 monclient(hunting): _renew_subs 2026-02-12T18:05:56.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe3994640 10 monclient(hunting): authenticate will time out at 595.041288s 2026-02-12T18:05:56.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe0f08640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fabdc08cf80 0x7fabdc05dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:56.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe1f0a640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fabdc183300 0x7fabdc1a36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:56.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe0f08640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fabdc08cf80 0x7fabdc05dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:37640/0 (socket says 10.20.193.48:37640) 2026-02-12T18:05:56.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe0f08640 1 -- 10.20.193.48:0/671788962 learned_addr learned my addr 10.20.193.48:0/671788962 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:05:56.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe0f08640 10 monclient(hunting): get_auth_request con 0x7fabdc08cf80 auth_method 0 2026-02-12T18:05:56.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe0f08640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:56.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe0f08640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:56.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe0f08640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:56.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe1f0a640 10 monclient(hunting): get_auth_request con 0x7fabdc183300 auth_method 0 2026-02-12T18:05:56.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe1f0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:56.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe1f0a640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:56.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe1f0a640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:56.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe1f0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:56.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe1f0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:56.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe0f08640 1 -- 10.20.193.48:0/671788962 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fabdc08cf80 msgr2=0x7fabdc05dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:05:56.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe0f08640 1 -- 10.20.193.48:0/671788962 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fabdc08cf80 msgr2=0x7fabdc05dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:56.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe0f08640 1 --2- 10.20.193.48:0/671788962 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fabdc08cf80 0x7fabdc05dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:56.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe1f0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:56.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe0f08640 1 --2- 10.20.193.48:0/671788962 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fabdc08cf80 0x7fabdc05dd40 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:05:56.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe1f0a640 10 monclient(hunting): handle_auth_done global_id 4110 payload 274 2026-02-12T18:05:56.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe1f0a640 1 -- 10.20.193.48:0/671788962 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fabdc08cf80 msgr2=0x7fabdc05dd40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:05:56.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe1f0a640 1 --2- 10.20.193.48:0/671788962 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fabdc08cf80 0x7fabdc05dd40 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe1f0a640 1 -- 10.20.193.48:0/671788962 >> v1:10.20.193.111:6789/0 conn(0x7fabdc090070 legacy=0x7fabdc05d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:05:56.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe1f0a640 10 monclient: _finish_hunting 0 2026-02-12T18:05:56.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe1f0a640 1 monclient: found mon.noname-d 2026-02-12T18:05:56.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe1f0a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:05:56.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe1f0a640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:05:56.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.315+0000 7fabe1f0a640 1 -- 10.20.193.48:0/671788962 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabdc13f130 con 0x7fabdc183300 2026-02-12T18:05:56.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabe1f0a640 1 -- 10.20.193.48:0/671788962 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fabdc183300 msgr2=0x7fabdc1a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:05:56.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabe1f0a640 1 --2- 10.20.193.48:0/671788962 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fabdc183300 0x7fabdc1a36e0 secure :-1 s=READY pgs=26 gs=3 cs=0 l=1 c_cookie=2297981245206106794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fabd800a8e0 tx=0x7fabd802fe20 comp rx=0 tx=0).ready entity=mon.6 client_cookie=1fe411c46d0512aa server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:05:56.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabcbfff640 1 -- 10.20.193.48:0/671788962 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fabd8036340 con 0x7fabdc183300 2026-02-12T18:05:56.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabcbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:56.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabcbfff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:05:56.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabcbfff640 10 monclient: dump: 2026-02-12T18:05:56.329 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:05:56.329 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:56.329 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:56.329 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:56.329 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:56.329 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:05:56.330 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:56.330 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:56.330 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:56.330 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:56.330 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:56.330 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:56.330 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:56.330 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:56.330 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:56.330 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:05:56.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabcbfff640 10 monclient: _finish_auth 0 2026-02-12T18:05:56.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabcbfff640 10 monclient: _check_auth_tickets 2026-02-12T18:05:56.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabcbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:05:56.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabe3994640 5 monclient: authenticate success, global_id 4110 2026-02-12T18:05:56.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabcbfff640 1 -- 10.20.193.48:0/671788962 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabd80364c0 con 0x7fabdc183300 2026-02-12T18:05:56.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabe3994640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:05:56.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabcbfff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:05:56.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabcbfff640 1 -- 10.20.193.48:0/671788962 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fabd8036af0 con 0x7fabdc183300 2026-02-12T18:05:56.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabe3994640 10 monclient: get_monmap_and_config success 2026-02-12T18:05:56.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabe3994640 4 set_mon_vals no callback set 2026-02-12T18:05:56.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabcbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:56.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabcbfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:05:56.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabcbfff640 10 monclient: dump: 2026-02-12T18:05:56.331 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:05:56.332 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:56.332 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:56.332 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:56.332 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:56.332 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:05:56.332 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:56.332 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:56.332 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:56.332 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:56.332 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:56.332 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:56.332 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:56.332 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:56.333 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:56.333 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:05:56.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabe3994640 10 monclient: shutdown 2026-02-12T18:05:56.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabe3994640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:05:56.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabe3994640 1 -- 10.20.193.48:0/671788962 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fabdc183300 msgr2=0x7fabdc1a36e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:56.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabe3994640 1 --2- 10.20.193.48:0/671788962 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fabdc183300 0x7fabdc1a36e0 secure :-1 s=READY pgs=26 gs=3 cs=0 l=1 c_cookie=2297981245206106794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fabd800a8e0 tx=0x7fabd802fe20 comp rx=0 tx=0).stop 2026-02-12T18:05:56.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabe3994640 1 -- 10.20.193.48:0/671788962 shutdown_connections 2026-02-12T18:05:56.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabe3994640 1 --2- 10.20.193.48:0/671788962 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fabdc183300 0x7fabdc1a36e0 unknown :-1 s=CLOSED pgs=26 gs=3 cs=0 l=1 c_cookie=2297981245206106794 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabe3994640 1 --2- 10.20.193.48:0/671788962 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fabdc08cf80 0x7fabdc05dd40 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabe3994640 1 -- 10.20.193.48:0/671788962 >> 10.20.193.48:0/671788962 conn(0x7fabdc0546a0 msgr2=0x7fabdc054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:05:56.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabe3994640 1 -- 10.20.193.48:0/671788962 shutdown_connections 2026-02-12T18:05:56.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.318+0000 7fabe3994640 1 -- 10.20.193.48:0/671788962 wait complete. 2026-02-12T18:05:56.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.319+0000 7fabe3994640 10 monclient: build_initial_monmap 2026-02-12T18:05:56.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.319+0000 7fabe3994640 10 monclient: monmap: 2026-02-12T18:05:56.334 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:05:56.334 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:05:56.334 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:05:56.334 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:05:56.334 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:05:56.334 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:05:56.334 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:05:56.334 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:05:56.334 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:05:56.334 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:05:56.335 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:05:56.335 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:05:56.335 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:05:56.335 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:05:56.335 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:05:56.335 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:05:56.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.319+0000 7fabe3994640 1 Processor -- start 2026-02-12T18:05:56.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.319+0000 7fabe3994640 1 -- start start 2026-02-12T18:05:56.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.319+0000 7fabe3994640 10 monclient: init 2026-02-12T18:05:56.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.319+0000 7fabe3994640 10 monclient: _reopen_session rank -1 2026-02-12T18:05:56.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.319+0000 7fabe3994640 10 monclient: _add_conns ranks=[7,1,6,2,8,4,0,3,5] 2026-02-12T18:05:56.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.319+0000 7fabe3994640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fabdc08cf80 0x7fabdc1a2c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:56.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.319+0000 7fabe3994640 10 monclient(hunting): picked mon.noname-i con 0x7fabdc08cf80 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:05:56.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.319+0000 7fabe3994640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fabdc090070 0x7fabdc12cb60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:56.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.319+0000 7fabe3994640 10 monclient(hunting): picked mon.noname-f con 0x7fabdc090070 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:05:56.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.319+0000 7fabe3994640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fabdc183300 0x7fabdc12d0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:56.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.319+0000 7fabe3994640 10 monclient(hunting): picked mon.noname-d con 0x7fabdc183300 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:05:56.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.319+0000 7fabe3994640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:56.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.319+0000 7fabe3994640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fabdc1a01b0 con 0x7fabdc090070 2026-02-12T18:05:56.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.319+0000 7fabe3994640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:56.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.319+0000 7fabe3994640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fabdc13d1f0 con 0x7fabdc183300 2026-02-12T18:05:56.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.319+0000 7fabe3994640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:56.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.319+0000 7fabe3994640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fabdc1a1c70 con 0x7fabdc08cf80 2026-02-12T18:05:56.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.319+0000 7fabe3994640 10 monclient(hunting): _renew_subs 2026-02-12T18:05:56.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.319+0000 7fabe3994640 10 monclient(hunting): authenticate will time out at 595.045933s 2026-02-12T18:05:56.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.319+0000 7fabe1f0a640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fabdc183300 0x7fabdc12d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:56.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe1f0a640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fabdc183300 0x7fabdc12d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:58146/0 (socket says 10.20.193.48:58146) 2026-02-12T18:05:56.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe1f0a640 1 -- 10.20.193.48:0/2697685592 learned_addr learned my addr 10.20.193.48:0/2697685592 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:05:56.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe1f0a640 10 monclient(hunting): get_auth_request con 0x7fabdc183300 auth_method 0 2026-02-12T18:05:56.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe1f0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:56.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe1f0a640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:56.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe1f0a640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:56.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe1f0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:56.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe1f0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:56.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe1f0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:56.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe1709640 1 --2- 10.20.193.48:0/2697685592 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fabdc08cf80 0x7fabdc1a2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:56.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe1709640 10 monclient(hunting): get_auth_request con 0x7fabdc08cf80 auth_method 0 2026-02-12T18:05:56.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe1709640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:56.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe1709640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:56.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe1709640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:56.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe0f08640 1 --2- 10.20.193.48:0/2697685592 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fabdc090070 0x7fabdc12cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:56.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe0f08640 10 monclient(hunting): get_auth_request con 0x7fabdc090070 auth_method 0 2026-02-12T18:05:56.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe0f08640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:56.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe0f08640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:56.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe0f08640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:56.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe1f0a640 10 monclient(hunting): handle_auth_done global_id 4119 payload 824 2026-02-12T18:05:56.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe1f0a640 1 -- 10.20.193.48:0/2697685592 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fabdc08cf80 msgr2=0x7fabdc1a2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:56.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe1f0a640 1 --2- 10.20.193.48:0/2697685592 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fabdc08cf80 0x7fabdc1a2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe1f0a640 1 -- 10.20.193.48:0/2697685592 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fabdc090070 msgr2=0x7fabdc12cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:56.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe1f0a640 1 --2- 10.20.193.48:0/2697685592 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fabdc090070 0x7fabdc12cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe1f0a640 10 monclient: _finish_hunting 0 2026-02-12T18:05:56.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe1f0a640 1 monclient: found mon.noname-d 2026-02-12T18:05:56.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe1f0a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:05:56.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe1f0a640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:05:56.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.320+0000 7fabe1f0a640 1 -- 10.20.193.48:0/2697685592 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd800a500 con 0x7fabdc183300 2026-02-12T18:05:56.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.322+0000 7fabe1f0a640 1 -- 10.20.193.48:0/2697685592 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fabdc183300 msgr2=0x7fabdc12d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:05:56.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.322+0000 7fabe1f0a640 1 --2- 10.20.193.48:0/2697685592 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fabdc183300 0x7fabdc12d0a0 secure :-1 s=READY pgs=27 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fabd802fe20 tx=0x7fabd8005850 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:05:56.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.322+0000 7fabc9ffb640 1 -- 10.20.193.48:0/2697685592 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fabd80054f0 con 0x7fabdc183300 2026-02-12T18:05:56.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.322+0000 7fabc9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:56.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.322+0000 7fabc9ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:05:56.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.322+0000 7fabc9ffb640 10 monclient: dump: 2026-02-12T18:05:56.340 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:05:56.340 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:56.340 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:56.340 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:56.340 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:56.340 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:05:56.340 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:56.340 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:56.340 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:56.340 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:56.340 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:56.340 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:56.340 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:56.340 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:56.341 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:56.341 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:05:56.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.322+0000 7fabc9ffb640 10 monclient: _finish_auth 0 2026-02-12T18:05:56.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.322+0000 7fabc9ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:05:56.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.322+0000 7fabc9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:05:56.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.322+0000 7fabc9ffb640 1 -- 10.20.193.48:0/2697685592 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabd8005690 con 0x7fabdc183300 2026-02-12T18:05:56.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.322+0000 7fabc9ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:05:56.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.322+0000 7fabc9ffb640 1 -- 10.20.193.48:0/2697685592 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fabd8004c70 con 0x7fabdc183300 2026-02-12T18:05:56.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.322+0000 7fabe3994640 5 monclient: authenticate success, global_id 4119 2026-02-12T18:05:56.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.322+0000 7fabcb7fe640 4 set_mon_vals no callback set 2026-02-12T18:05:56.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.322+0000 7fabe3994640 10 monclient: _renew_subs 2026-02-12T18:05:56.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.322+0000 7fabe3994640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:05:56.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.322+0000 7fabe3994640 1 -- 10.20.193.48:0/2697685592 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabdc1a1f50 con 0x7fabdc183300 2026-02-12T18:05:56.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.322+0000 7fabc9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:56.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.322+0000 7fabc9ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:05:56.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.322+0000 7fabc9ffb640 10 monclient: dump: 2026-02-12T18:05:56.342 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:05:56.342 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:56.342 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:56.342 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:56.342 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:56.342 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:05:56.342 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:56.342 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:56.343 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:56.343 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:56.343 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:56.343 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:56.343 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:56.343 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:56.343 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:56.343 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:05:56.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.322+0000 7fabe3994640 10 monclient: _renew_subs 2026-02-12T18:05:56.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.322+0000 7fabe3994640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:05:56.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.322+0000 7fabe3994640 1 -- 10.20.193.48:0/2697685592 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fabdc1a0d10 con 0x7fabdc183300 2026-02-12T18:05:56.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.322+0000 7fabc9ffb640 1 -- 10.20.193.48:0/2697685592 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7fabd8005030 con 0x7fabdc183300 2026-02-12T18:05:56.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.322+0000 7fabc9ffb640 1 -- 10.20.193.48:0/2697685592 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(1..1 src has 1..1) ==== 720+0+0 (secure 0 0 0) 0x7fabd8038440 con 0x7fabdc183300 2026-02-12T18:05:56.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.323+0000 7fabe3994640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:56.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.323+0000 7fabe3994640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:56.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.323+0000 7fabe3994640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:05:56.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.323+0000 7fabe3994640 1 -- 10.20.193.48:0/2697685592 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabdc05d630 con 0x7fabdc183300 2026-02-12T18:05:56.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.324+0000 7fabc9ffb640 1 -- 10.20.193.48:0/2697685592 <== mon.6 v2:10.20.193.48:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7fabd8048070 con 0x7fabdc183300 2026-02-12T18:05:56.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.324+0000 7fabc9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:56.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.324+0000 7fabc9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:05:56.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.354+0000 7fabe3994640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-12T18:05:56.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.354+0000 7fabe3994640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-12T18:05:56.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.354+0000 7fabe3994640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:05:56.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.354+0000 7fabe3994640 1 -- 10.20.193.48:0/2697685592 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fabdc0637c0 con 0x7fabdc183300 2026-02-12T18:05:56.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.381+0000 7fabc9ffb640 1 -- 10.20.193.48:0/2697685592 <== mon.6 v2:10.20.193.48:3303/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fabd803d070 con 0x7fabdc183300 2026-02-12T18:05:56.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.381+0000 7fabc9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2026-02-12T18:05:56.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.381+0000 7fabc9ffb640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2026-02-12T18:05:56.383 INFO:teuthology.orchestra.run.trial048.stderr:adjusted tunables profile to default 2026-02-12T18:05:56.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.382+0000 7fabe3994640 10 monclient: shutdown 2026-02-12T18:05:56.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.382+0000 7fabe3994640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:05:56.384 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.382+0000 7fabe3994640 1 -- 10.20.193.48:0/2697685592 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fabdc183300 msgr2=0x7fabdc12d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:56.384 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.382+0000 7fabe3994640 1 --2- 10.20.193.48:0/2697685592 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fabdc183300 0x7fabdc12d0a0 secure :-1 s=READY pgs=27 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fabd802fe20 tx=0x7fabd8005850 comp rx=0 tx=0).stop 2026-02-12T18:05:56.384 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.382+0000 7fabe3994640 1 -- 10.20.193.48:0/2697685592 shutdown_connections 2026-02-12T18:05:56.384 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.382+0000 7fabe3994640 1 --2- 10.20.193.48:0/2697685592 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fabdc183300 0x7fabdc12d0a0 unknown :-1 s=CLOSED pgs=27 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.384 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.382+0000 7fabe3994640 1 --2- 10.20.193.48:0/2697685592 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fabdc090070 0x7fabdc12cb60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.384 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.382+0000 7fabe3994640 1 --2- 10.20.193.48:0/2697685592 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fabdc08cf80 0x7fabdc1a2c90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.384 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.382+0000 7fabe3994640 1 -- 10.20.193.48:0/2697685592 >> 10.20.193.48:0/2697685592 conn(0x7fabdc0546a0 msgr2=0x7fabdc08e300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:05:56.384 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.382+0000 7fabe3994640 1 -- 10.20.193.48:0/2697685592 shutdown_connections 2026-02-12T18:05:56.384 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:56.382+0000 7fabe3994640 1 -- 10.20.193.48:0/2697685592 wait complete. 2026-02-12T18:05:56.390 INFO:tasks.ceph:check_enable_crimson: False 2026-02-12T18:05:56.390 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2026-02-12T18:05:56.390 DEBUG:teuthology.orchestra.run.trial048:> set -ex 2026-02-12T18:05:56.390 DEBUG:teuthology.orchestra.run.trial048:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2026-02-12T18:05:56.415 DEBUG:teuthology.orchestra.run.trial048:> set -ex 2026-02-12T18:05:56.415 DEBUG:teuthology.orchestra.run.trial048:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2026-02-12T18:05:56.479 DEBUG:teuthology.orchestra.run.trial048:> set -ex 2026-02-12T18:05:56.479 DEBUG:teuthology.orchestra.run.trial048:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2026-02-12T18:05:56.544 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T18:05:56.544 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2026-02-12T18:05:56.571 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T18:05:56.571 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2026-02-12T18:05:56.634 DEBUG:teuthology.orchestra.run.trial111:> set -ex 2026-02-12T18:05:56.634 DEBUG:teuthology.orchestra.run.trial111:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2026-02-12T18:05:56.700 DEBUG:teuthology.orchestra.run.trial111:> sudo ceph --cluster ceph osd new a8255145-baf3-4c84-9a14-58a24c915493 0 2026-02-12T18:05:56.804 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.804+0000 7f92b30cc640 10 monclient: get_monmap_and_config 2026-02-12T18:05:56.805 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.804+0000 7f92b30cc640 10 monclient: build_initial_monmap 2026-02-12T18:05:56.805 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.804+0000 7f92b30cc640 10 monclient: monmap: 2026-02-12T18:05:56.805 INFO:teuthology.orchestra.run.trial111.stderr:epoch 0 2026-02-12T18:05:56.805 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:56.805 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:56.804711+0000 2026-02-12T18:05:56.805 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:56.804711+0000 2026-02-12T18:05:56.805 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 0 (unknown) 2026-02-12T18:05:56.805 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:56.806 INFO:teuthology.orchestra.run.trial111.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:05:56.806 INFO:teuthology.orchestra.run.trial111.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:05:56.806 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:05:56.806 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:05:56.806 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:05:56.806 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:05:56.806 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:05:56.806 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:05:56.806 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:05:56.806 INFO:teuthology.orchestra.run.trial111.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:05:56.806 INFO:teuthology.orchestra.run.trial111.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:05:56.806 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:56.807 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.804+0000 7f92b30cc640 1 Processor -- start 2026-02-12T18:05:56.807 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.804+0000 7f92b30cc640 1 -- start start 2026-02-12T18:05:56.807 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.804+0000 7f92b30cc640 10 monclient: init 2026-02-12T18:05:56.816 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b30cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:05:56.816 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b30cc640 10 monclient: _add_conns ranks=[3,1,4,0,6,9,2,7,10,5,8] 2026-02-12T18:05:56.817 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b30cc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f92ac144b70 0x7f92ac144f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:56.817 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b30cc640 10 monclient(hunting): picked mon.noname-g con 0x7f92ac144b70 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:05:56.817 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b30cc640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f92ac091690 addr v1:10.20.193.111:6789/0 2026-02-12T18:05:56.817 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b30cc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f92ac145480 0x7f92ac05d060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:56.817 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b30cc640 10 monclient(hunting): picked mon.noname-c con 0x7f92ac145480 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:05:56.817 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b30cc640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92ac04dc20 con 0x7f92ac091690 2026-02-12T18:05:56.817 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b30cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:56.817 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b30cc640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f92ac093510 con 0x7f92ac144b70 2026-02-12T18:05:56.817 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b30cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:56.817 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b30cc640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f92ac091e20 con 0x7f92ac145480 2026-02-12T18:05:56.817 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b30cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:05:56.818 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b30cc640 10 monclient(hunting): authenticate will time out at 554.493146s 2026-02-12T18:05:56.818 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92a3fff640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f92ac091690 0x7f92ac05c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.111:56002/0 (socket says 10.20.193.111:56002) 2026-02-12T18:05:56.818 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92a3fff640 1 -- 10.20.193.111:0/1319068606 learned_addr learned my addr 10.20.193.111:0/1319068606 (peer_addr_for_me v1:10.20.193.111:0/0) 2026-02-12T18:05:56.818 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b0e41640 1 --2- 10.20.193.111:0/1319068606 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f92ac144b70 0x7f92ac144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:56.818 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b0e41640 10 monclient(hunting): get_auth_request con 0x7f92ac144b70 auth_method 0 2026-02-12T18:05:56.818 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b0e41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:56.818 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b0e41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:56.818 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b0e41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:56.818 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b0e41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:56.818 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b0e41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:56.818 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b0e41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:56.818 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b1642640 1 --2- 10.20.193.111:0/1319068606 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f92ac145480 0x7f92ac05d060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:56.819 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b1642640 10 monclient(hunting): get_auth_request con 0x7f92ac145480 auth_method 0 2026-02-12T18:05:56.819 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b1642640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:56.819 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b1642640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:56.819 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b1642640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:56.819 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b0e41640 10 monclient(hunting): handle_auth_done global_id 4107 payload 274 2026-02-12T18:05:56.819 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b0e41640 1 -- 10.20.193.111:0/1319068606 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f92ac145480 msgr2=0x7f92ac05d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:05:56.819 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b0e41640 1 --2- 10.20.193.111:0/1319068606 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f92ac145480 0x7f92ac05d060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.819 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b0e41640 1 -- 10.20.193.111:0/1319068606 >> v1:10.20.193.111:6789/0 conn(0x7f92ac091690 legacy=0x7f92ac05c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:05:56.819 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b0e41640 10 monclient: _finish_hunting 0 2026-02-12T18:05:56.819 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b0e41640 1 monclient: found mon.noname-g 2026-02-12T18:05:56.819 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b0e41640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:05:56.819 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b0e41640 10 monclient: _send_mon_message to mon.noname-g at v2:10.20.193.111:3301/0 2026-02-12T18:05:56.820 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.805+0000 7f92b0e41640 1 -- 10.20.193.111:0/1319068606 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92ac05e780 con 0x7f92ac144b70 2026-02-12T18:05:56.820 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.807+0000 7f92b0e41640 1 -- 10.20.193.111:0/1319068606 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f92ac144b70 msgr2=0x7f92ac144f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:05:56.820 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.807+0000 7f92b0e41640 1 --2- 10.20.193.111:0/1319068606 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f92ac144b70 0x7f92ac144f40 secure :-1 s=READY pgs=20 gs=2 cs=0 l=1 c_cookie=11096476336852721121 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f929c009830 tx=0x7f929c02ed30 comp rx=0 tx=0).ready entity=mon.3 client_cookie=99fe9a6fcca25de1 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:05:56.820 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92a37fe640 1 -- 10.20.193.111:0/1319068606 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f929c02fe70 con 0x7f92ac144b70 2026-02-12T18:05:56.820 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:56.820 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92a37fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2026-02-12T18:05:56.820 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92a37fe640 10 monclient: dump: 2026-02-12T18:05:56.820 INFO:teuthology.orchestra.run.trial111.stderr:epoch 1 2026-02-12T18:05:56.820 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:56.820 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:56.820 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:56.820 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:56.821 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:56.821 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:56.821 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:56.821 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:56.821 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:56.821 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:56.821 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:56.821 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:56.821 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:56.821 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:56.821 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:56.822 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92a37fe640 10 monclient: _finish_auth 0 2026-02-12T18:05:56.822 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92a37fe640 10 monclient: _check_auth_tickets 2026-02-12T18:05:56.822 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92a37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:05:56.822 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92a37fe640 1 -- 10.20.193.111:0/1319068606 <== mon.3 v2:10.20.193.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f929c035340 con 0x7f92ac144b70 2026-02-12T18:05:56.822 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92b30cc640 5 monclient: authenticate success, global_id 4107 2026-02-12T18:05:56.822 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92a37fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:05:56.822 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92a37fe640 1 -- 10.20.193.111:0/1319068606 <== mon.3 v2:10.20.193.111:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f929c035970 con 0x7f92ac144b70 2026-02-12T18:05:56.822 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92b30cc640 10 monclient: get_monmap_and_config success 2026-02-12T18:05:56.822 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92b30cc640 4 set_mon_vals no callback set 2026-02-12T18:05:56.822 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92a37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:56.822 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92a37fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:05:56.823 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92a37fe640 10 monclient: dump: 2026-02-12T18:05:56.823 INFO:teuthology.orchestra.run.trial111.stderr:epoch 1 2026-02-12T18:05:56.823 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:56.823 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:56.823 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:56.823 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:56.823 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:56.823 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:56.823 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:56.823 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:56.823 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:56.823 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:56.823 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:56.824 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:56.824 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:56.824 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:56.824 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:56.824 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92b30cc640 10 monclient: shutdown 2026-02-12T18:05:56.824 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92b30cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:05:56.824 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92b30cc640 1 -- 10.20.193.111:0/1319068606 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f92ac144b70 msgr2=0x7f92ac144f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:56.824 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92b30cc640 1 --2- 10.20.193.111:0/1319068606 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f92ac144b70 0x7f92ac144f40 secure :-1 s=READY pgs=20 gs=2 cs=0 l=1 c_cookie=11096476336852721121 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f929c009830 tx=0x7f929c02ed30 comp rx=0 tx=0).stop 2026-02-12T18:05:56.824 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92b30cc640 1 -- 10.20.193.111:0/1319068606 shutdown_connections 2026-02-12T18:05:56.824 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92b30cc640 1 --2- 10.20.193.111:0/1319068606 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f92ac145480 0x7f92ac05d060 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.824 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92b30cc640 1 --2- 10.20.193.111:0/1319068606 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f92ac144b70 0x7f92ac144f40 unknown :-1 s=CLOSED pgs=20 gs=2 cs=0 l=1 c_cookie=11096476336852721121 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.824 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92b30cc640 1 -- 10.20.193.111:0/1319068606 >> 10.20.193.111:0/1319068606 conn(0x7f92ac054ae0 msgr2=0x7f92ac0973a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:05:56.824 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92b30cc640 1 -- 10.20.193.111:0/1319068606 shutdown_connections 2026-02-12T18:05:56.825 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92b30cc640 1 -- 10.20.193.111:0/1319068606 wait complete. 2026-02-12T18:05:56.825 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92b30cc640 10 monclient: build_initial_monmap 2026-02-12T18:05:56.825 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.808+0000 7f92b30cc640 10 monclient: monmap: 2026-02-12T18:05:56.825 INFO:teuthology.orchestra.run.trial111.stderr:epoch 0 2026-02-12T18:05:56.825 INFO:teuthology.orchestra.run.trial111.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:05:56.825 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 0.000000 2026-02-12T18:05:56.825 INFO:teuthology.orchestra.run.trial111.stderr:created 0.000000 2026-02-12T18:05:56.825 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 0 (unknown) 2026-02-12T18:05:56.825 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:56.825 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:05:56.825 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:05:56.825 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:05:56.826 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:05:56.826 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:05:56.826 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:05:56.826 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:05:56.826 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:05:56.826 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:05:56.826 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:56.826 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b30cc640 1 Processor -- start 2026-02-12T18:05:56.826 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b30cc640 1 -- start start 2026-02-12T18:05:56.826 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b30cc640 10 monclient: init 2026-02-12T18:05:56.826 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b30cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:05:56.826 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b30cc640 10 monclient: _add_conns ranks=[2,4,6,7,1,8,0,5,3] 2026-02-12T18:05:56.826 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b30cc640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f92ac091690 0x7f92ac110480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:56.827 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b30cc640 10 monclient(hunting): picked mon.noname-b con 0x7f92ac091690 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:05:56.827 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b30cc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f92ac144b70 0x7f92ac10e040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:56.827 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b30cc640 10 monclient(hunting): picked mon.noname-c con 0x7f92ac144b70 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:05:56.827 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b30cc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f92ac145480 0x7f92ac10e580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:56.827 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b30cc640 10 monclient(hunting): picked mon.noname-d con 0x7f92ac145480 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:05:56.827 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b30cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:56.827 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b30cc640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f92ac08d300 con 0x7f92ac091690 2026-02-12T18:05:56.827 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b30cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:56.827 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b30cc640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f92ac10f920 con 0x7f92ac144b70 2026-02-12T18:05:56.827 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b30cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:56.827 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b30cc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f92ac097710 con 0x7f92ac145480 2026-02-12T18:05:56.827 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b30cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:05:56.828 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b30cc640 10 monclient(hunting): authenticate will time out at 554.497341s 2026-02-12T18:05:56.828 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92a3fff640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f92ac144b70 0x7f92ac10e040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:56.828 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92a3fff640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f92ac144b70 0x7f92ac10e040 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.111:53980/0 (socket says 10.20.193.111:53980) 2026-02-12T18:05:56.828 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92a3fff640 1 -- 10.20.193.111:0/2697146542 learned_addr learned my addr 10.20.193.111:0/2697146542 (peer_addr_for_me v2:10.20.193.111:0/0) 2026-02-12T18:05:56.828 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92a3fff640 10 monclient(hunting): get_auth_request con 0x7f92ac144b70 auth_method 0 2026-02-12T18:05:56.828 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92a3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:56.828 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92a3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:56.828 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92a3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:56.828 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b0e41640 1 --2- 10.20.193.111:0/2697146542 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f92ac091690 0x7f92ac110480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:56.828 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b1642640 1 --2- 10.20.193.111:0/2697146542 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f92ac145480 0x7f92ac10e580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:56.828 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b1642640 10 monclient(hunting): get_auth_request con 0x7f92ac145480 auth_method 0 2026-02-12T18:05:56.828 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b1642640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:56.829 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b1642640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:56.829 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b1642640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:56.829 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b0e41640 10 monclient(hunting): get_auth_request con 0x7f92ac091690 auth_method 0 2026-02-12T18:05:56.829 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b0e41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:56.829 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b0e41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:56.829 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b0e41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:56.829 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92a3fff640 1 -- 10.20.193.111:0/2697146542 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f92ac144b70 msgr2=0x7f92ac10e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-12T18:05:56.829 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92a3fff640 1 -- 10.20.193.111:0/2697146542 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f92ac144b70 msgr2=0x7f92ac10e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:05:56.829 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92a3fff640 1 --2- 10.20.193.111:0/2697146542 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f92ac144b70 0x7f92ac10e040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:56.829 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92a3fff640 1 --2- 10.20.193.111:0/2697146542 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f92ac144b70 0x7f92ac10e040 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:05:56.829 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b1642640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:56.829 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b1642640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:56.830 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b1642640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:56.830 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b0e41640 1 -- 10.20.193.111:0/2697146542 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f92ac091690 msgr2=0x7f92ac110480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-12T18:05:56.830 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b0e41640 1 -- 10.20.193.111:0/2697146542 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f92ac091690 msgr2=0x7f92ac110480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:05:56.830 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b0e41640 1 --2- 10.20.193.111:0/2697146542 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f92ac091690 0x7f92ac110480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:56.830 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b0e41640 1 --2- 10.20.193.111:0/2697146542 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f92ac091690 0x7f92ac110480 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:05:56.830 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b1642640 10 monclient(hunting): handle_auth_done global_id 4128 payload 824 2026-02-12T18:05:56.830 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b1642640 1 -- 10.20.193.111:0/2697146542 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f92ac144b70 msgr2=0x7f92ac10e040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:05:56.830 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.809+0000 7f92b1642640 1 --2- 10.20.193.111:0/2697146542 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f92ac144b70 0x7f92ac10e040 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.830 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.810+0000 7f92b1642640 1 -- 10.20.193.111:0/2697146542 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f92ac091690 msgr2=0x7f92ac110480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:05:56.830 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.810+0000 7f92b1642640 1 --2- 10.20.193.111:0/2697146542 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f92ac091690 0x7f92ac110480 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.830 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.810+0000 7f92b1642640 10 monclient: _finish_hunting 0 2026-02-12T18:05:56.830 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.810+0000 7f92b1642640 1 monclient: found mon.noname-d 2026-02-12T18:05:56.831 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.810+0000 7f92b1642640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:05:56.831 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.810+0000 7f92b1642640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:05:56.831 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.810+0000 7f92b1642640 1 -- 10.20.193.111:0/2697146542 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f929c009420 con 0x7f92ac145480 2026-02-12T18:05:56.831 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.812+0000 7f92b1642640 1 -- 10.20.193.111:0/2697146542 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f92ac145480 msgr2=0x7f92ac10e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:05:56.831 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.812+0000 7f92b1642640 1 --2- 10.20.193.111:0/2697146542 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f92ac145480 0x7f92ac10e580 secure :-1 s=READY pgs=28 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92a800f7e0 tx=0x7f92a800fcb0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:05:56.831 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.812+0000 7f92a17fa640 1 -- 10.20.193.111:0/2697146542 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f92a800db90 con 0x7f92ac145480 2026-02-12T18:05:56.831 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.812+0000 7f92a17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:56.831 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.812+0000 7f92a17fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:05:56.831 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.812+0000 7f92a17fa640 10 monclient: dump: 2026-02-12T18:05:56.831 INFO:teuthology.orchestra.run.trial111.stderr:epoch 1 2026-02-12T18:05:56.831 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:56.831 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:56.831 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:56.832 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:56.832 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:56.832 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:56.832 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:56.832 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:56.832 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:56.832 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:56.832 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:56.832 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:56.832 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:56.832 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:56.832 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:56.832 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.812+0000 7f92a17fa640 10 monclient: _finish_auth 0 2026-02-12T18:05:56.833 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.812+0000 7f92a17fa640 10 monclient: _check_auth_tickets 2026-02-12T18:05:56.833 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.812+0000 7f92a17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:05:56.833 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.812+0000 7f92b30cc640 5 monclient: authenticate success, global_id 4128 2026-02-12T18:05:56.833 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.812+0000 7f92b30cc640 10 monclient: _renew_subs 2026-02-12T18:05:56.833 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.812+0000 7f92b30cc640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:05:56.833 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.812+0000 7f92b30cc640 1 -- 10.20.193.111:0/2697146542 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92ac110e10 con 0x7f92ac145480 2026-02-12T18:05:56.833 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.812+0000 7f92b30cc640 10 monclient: _renew_subs 2026-02-12T18:05:56.833 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.812+0000 7f92b30cc640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:05:56.833 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.812+0000 7f92b30cc640 1 -- 10.20.193.111:0/2697146542 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f92ac111c80 con 0x7f92ac145480 2026-02-12T18:05:56.833 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.812+0000 7f92a17fa640 1 -- 10.20.193.111:0/2697146542 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92a800dcf0 con 0x7f92ac145480 2026-02-12T18:05:56.833 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.812+0000 7f92a17fa640 10 monclient: handle_config config(0 keys) 2026-02-12T18:05:56.833 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.812+0000 7f92a17fa640 1 -- 10.20.193.111:0/2697146542 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f92a800de60 con 0x7f92ac145480 2026-02-12T18:05:56.834 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.812+0000 7f92a17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:56.834 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.812+0000 7f92a2ffd640 4 set_mon_vals no callback set 2026-02-12T18:05:56.834 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.812+0000 7f92a17fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:05:56.834 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.812+0000 7f92a17fa640 10 monclient: dump: 2026-02-12T18:05:56.834 INFO:teuthology.orchestra.run.trial111.stderr:epoch 1 2026-02-12T18:05:56.834 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:56.834 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:56.834 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:56.834 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:56.834 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:56.834 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:56.834 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:56.834 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:56.835 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:56.835 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:56.835 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:56.835 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:56.835 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:56.835 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:56.835 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:56.835 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.812+0000 7f92a17fa640 1 -- 10.20.193.111:0/2697146542 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f92a8014410 con 0x7f92ac145480 2026-02-12T18:05:56.835 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.812+0000 7f92a17fa640 1 -- 10.20.193.111:0/2697146542 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(2..2 src has 1..2) ==== 720+0+0 (secure 0 0 0) 0x7f92a8013af0 con 0x7f92ac145480 2026-02-12T18:05:56.835 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.813+0000 7f92b30cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:56.835 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.813+0000 7f92b30cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:56.835 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.813+0000 7f92b30cc640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:05:56.836 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.813+0000 7f92b30cc640 1 -- 10.20.193.111:0/2697146542 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92ac1113e0 con 0x7f92ac145480 2026-02-12T18:05:56.836 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.814+0000 7f92a17fa640 1 -- 10.20.193.111:0/2697146542 <== mon.6 v2:10.20.193.48:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f92a8022060 con 0x7f92ac145480 2026-02-12T18:05:56.836 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.814+0000 7f92a17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:56.836 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.814+0000 7f92a17fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:05:56.847 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.847+0000 7f92b30cc640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "a8255145-baf3-4c84-9a14-58a24c915493", "id": 0}] 2026-02-12T18:05:56.848 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.847+0000 7f92b30cc640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "a8255145-baf3-4c84-9a14-58a24c915493", "id": 0}] 2026-02-12T18:05:56.848 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.847+0000 7f92b30cc640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:05:56.848 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.847+0000 7f92b30cc640 1 -- 10.20.193.111:0/2697146542 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "osd new", "uuid": "a8255145-baf3-4c84-9a14-58a24c915493", "id": 0} v 0) -- 0x7f92ac144f40 con 0x7f92ac145480 2026-02-12T18:05:56.991 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.991+0000 7f92a17fa640 1 -- 10.20.193.111:0/2697146542 <== mon.6 v2:10.20.193.48:3303/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a8255145-baf3-4c84-9a14-58a24c915493", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f92a802b0b0 con 0x7f92ac145480 2026-02-12T18:05:56.991 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.991+0000 7f92a17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "a8255145-baf3-4c84-9a14-58a24c915493", "id": 0}] 2026-02-12T18:05:56.992 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.991+0000 7f92a17fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:05:56.992 INFO:teuthology.orchestra.run.trial111.stdout:0 2026-02-12T18:05:56.993 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.991+0000 7f92b30cc640 10 monclient: shutdown 2026-02-12T18:05:56.993 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.991+0000 7f92b30cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:05:56.993 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.991+0000 7f92b30cc640 1 -- 10.20.193.111:0/2697146542 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f92ac145480 msgr2=0x7f92ac10e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:56.993 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.991+0000 7f92b30cc640 1 --2- 10.20.193.111:0/2697146542 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f92ac145480 0x7f92ac10e580 secure :-1 s=READY pgs=28 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f92a800f7e0 tx=0x7f92a800fcb0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.993 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.991+0000 7f92b30cc640 1 -- 10.20.193.111:0/2697146542 shutdown_connections 2026-02-12T18:05:56.993 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.991+0000 7f92b30cc640 1 --2- 10.20.193.111:0/2697146542 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f92ac145480 0x7f92ac10e580 unknown :-1 s=CLOSED pgs=28 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.994 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.991+0000 7f92b30cc640 1 --2- 10.20.193.111:0/2697146542 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f92ac144b70 0x7f92ac10e040 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.994 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.991+0000 7f92b30cc640 1 --2- 10.20.193.111:0/2697146542 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f92ac091690 0x7f92ac110480 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:56.994 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.991+0000 7f92b30cc640 1 -- 10.20.193.111:0/2697146542 >> 10.20.193.111:0/2697146542 conn(0x7f92ac054ae0 msgr2=0x7f92ac08f090 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:05:56.994 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.991+0000 7f92b30cc640 1 -- 10.20.193.111:0/2697146542 shutdown_connections 2026-02-12T18:05:56.994 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:56.991+0000 7f92b30cc640 1 -- 10.20.193.111:0/2697146542 wait complete. 2026-02-12T18:05:57.001 DEBUG:teuthology.orchestra.run.trial111:> sudo ceph --cluster ceph osd new 4cf3730c-446c-4c4f-baf9-b354e06bf2b9 1 2026-02-12T18:05:57.048 INFO:tasks.ceph.mgr.x.trial111.stderr:/usr/lib64/python3.9/site-packages/scipy/__init__.py:73: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2026-02-12T18:05:57.048 INFO:tasks.ceph.mgr.x.trial111.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2026-02-12T18:05:57.048 INFO:tasks.ceph.mgr.x.trial111.stderr: from numpy import show_config as show_numpy_config 2026-02-12T18:05:57.062 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.062+0000 7f09f959d640 10 monclient: get_monmap_and_config 2026-02-12T18:05:57.063 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.062+0000 7f09f959d640 10 monclient: build_initial_monmap 2026-02-12T18:05:57.063 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.062+0000 7f09f959d640 10 monclient: monmap: 2026-02-12T18:05:57.063 INFO:teuthology.orchestra.run.trial111.stderr:epoch 0 2026-02-12T18:05:57.063 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:57.063 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:57.063179+0000 2026-02-12T18:05:57.063 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:57.063179+0000 2026-02-12T18:05:57.063 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 0 (unknown) 2026-02-12T18:05:57.063 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.063 INFO:teuthology.orchestra.run.trial111.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:05:57.063 INFO:teuthology.orchestra.run.trial111.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:05:57.063 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:05:57.064 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:05:57.064 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:05:57.064 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:05:57.064 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:05:57.064 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:05:57.064 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:05:57.064 INFO:teuthology.orchestra.run.trial111.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:05:57.064 INFO:teuthology.orchestra.run.trial111.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:05:57.064 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.073 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.062+0000 7f09f959d640 1 Processor -- start 2026-02-12T18:05:57.073 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f959d640 1 -- start start 2026-02-12T18:05:57.073 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f959d640 10 monclient: init 2026-02-12T18:05:57.073 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f959d640 10 monclient: _reopen_session rank -1 2026-02-12T18:05:57.073 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f959d640 10 monclient: _add_conns ranks=[7,4,6,5,2,3,1,9,0,10,8] 2026-02-12T18:05:57.073 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f959d640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f09f4144650 0x7f09f4144a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.074 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f959d640 10 monclient(hunting): picked mon.noname-i con 0x7f09f4144650 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:05:57.074 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f959d640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f09f408ff70 0x7f09f405d2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.074 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f959d640 10 monclient(hunting): picked mon.noname-c con 0x7f09f408ff70 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:05:57.074 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f959d640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f09f405d830 0x7f09f405dc80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.074 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f959d640 10 monclient(hunting): picked mon.noname-d con 0x7f09f405d830 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:05:57.074 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f959d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.074 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f959d640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f09f405e1c0 con 0x7f09f408ff70 2026-02-12T18:05:57.074 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f959d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.074 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f959d640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f09f408f2b0 con 0x7f09f405d830 2026-02-12T18:05:57.074 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f959d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.074 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f959d640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f09f4144200 con 0x7f09f4144650 2026-02-12T18:05:57.075 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f959d640 10 monclient(hunting): _renew_subs 2026-02-12T18:05:57.075 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f959d640 10 monclient(hunting): authenticate will time out at 554.751309s 2026-02-12T18:05:57.075 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f2ffd640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f09f4144650 0x7f09f4144a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.075 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f2ffd640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f09f4144650 0x7f09f4144a20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3303/0 says I am v2:10.20.193.111:45954/0 (socket says 10.20.193.111:45954) 2026-02-12T18:05:57.075 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f37fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f09f405d830 0x7f09f405dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.075 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f2ffd640 1 -- 10.20.193.111:0/3820281707 learned_addr learned my addr 10.20.193.111:0/3820281707 (peer_addr_for_me v2:10.20.193.111:0/0) 2026-02-12T18:05:57.075 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f2ffd640 10 monclient(hunting): get_auth_request con 0x7f09f4144650 auth_method 0 2026-02-12T18:05:57.075 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.075 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.075 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.075 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f37fe640 10 monclient(hunting): get_auth_request con 0x7f09f405d830 auth_method 0 2026-02-12T18:05:57.075 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.075 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.076 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.076 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f2ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:57.076 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f2ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:57.076 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f2ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:57.076 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f27fc640 1 --2- 10.20.193.111:0/3820281707 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f09f408ff70 0x7f09f405d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.076 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f27fc640 10 monclient(hunting): get_auth_request con 0x7f09f408ff70 auth_method 0 2026-02-12T18:05:57.076 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.076 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.076 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.076 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f2ffd640 10 monclient(hunting): handle_auth_done global_id 4129 payload 274 2026-02-12T18:05:57.076 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f2ffd640 1 -- 10.20.193.111:0/3820281707 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f09f405d830 msgr2=0x7f09f405dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:05:57.076 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f2ffd640 1 --2- 10.20.193.111:0/3820281707 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f09f405d830 0x7f09f405dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.077 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f2ffd640 1 -- 10.20.193.111:0/3820281707 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f09f408ff70 msgr2=0x7f09f405d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:05:57.077 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f2ffd640 1 --2- 10.20.193.111:0/3820281707 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f09f408ff70 0x7f09f405d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.077 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f2ffd640 10 monclient: _finish_hunting 0 2026-02-12T18:05:57.077 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f2ffd640 1 monclient: found mon.noname-i 2026-02-12T18:05:57.077 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:05:57.077 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f2ffd640 10 monclient: _send_mon_message to mon.noname-i at v2:10.20.193.111:3303/0 2026-02-12T18:05:57.077 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.063+0000 7f09f2ffd640 1 -- 10.20.193.111:0/3820281707 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09f404dc20 con 0x7f09f4144650 2026-02-12T18:05:57.077 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f2ffd640 1 -- 10.20.193.111:0/3820281707 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f09f4144650 msgr2=0x7f09f4144a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:05:57.077 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f2ffd640 1 --2- 10.20.193.111:0/3820281707 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f09f4144650 0x7f09f4144a20 secure :-1 s=READY pgs=30 gs=1 cs=0 l=1 c_cookie=7667708904473508352 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09e80098d0 tx=0x7f09e802ee20 comp rx=0 tx=0).ready entity=mon.7 client_cookie=6a692c9f943e3a00 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:05:57.077 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f1ffb640 1 -- 10.20.193.111:0/3820281707 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f09e8035340 con 0x7f09f4144650 2026-02-12T18:05:57.077 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:57.078 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f1ffb640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2026-02-12T18:05:57.078 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f1ffb640 10 monclient: dump: 2026-02-12T18:05:57.078 INFO:teuthology.orchestra.run.trial111.stderr:epoch 1 2026-02-12T18:05:57.078 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:57.078 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.078 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.078 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:57.078 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.078 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:57.078 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:57.078 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:57.078 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:57.078 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:57.079 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:57.079 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:57.079 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:57.079 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:57.079 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.079 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f1ffb640 10 monclient: _finish_auth 0 2026-02-12T18:05:57.079 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f1ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:05:57.079 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:05:57.079 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f1ffb640 1 -- 10.20.193.111:0/3820281707 <== mon.7 v2:10.20.193.111:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e80354c0 con 0x7f09f4144650 2026-02-12T18:05:57.079 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f959d640 5 monclient: authenticate success, global_id 4129 2026-02-12T18:05:57.079 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f959d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:05:57.079 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f1ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:05:57.079 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f1ffb640 1 -- 10.20.193.111:0/3820281707 <== mon.7 v2:10.20.193.111:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f09e8035af0 con 0x7f09f4144650 2026-02-12T18:05:57.080 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f959d640 10 monclient: get_monmap_and_config success 2026-02-12T18:05:57.080 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:57.080 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f959d640 4 set_mon_vals no callback set 2026-02-12T18:05:57.080 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f1ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:05:57.080 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f1ffb640 10 monclient: dump: 2026-02-12T18:05:57.080 INFO:teuthology.orchestra.run.trial111.stderr:epoch 1 2026-02-12T18:05:57.080 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:57.080 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.080 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.080 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:57.080 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.080 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:57.080 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:57.081 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:57.081 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:57.081 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:57.081 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:57.081 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:57.081 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:57.081 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:57.081 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.081 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f959d640 10 monclient: shutdown 2026-02-12T18:05:57.081 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f959d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:05:57.081 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f959d640 1 -- 10.20.193.111:0/3820281707 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f09f4144650 msgr2=0x7f09f4144a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:57.081 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f959d640 1 --2- 10.20.193.111:0/3820281707 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f09f4144650 0x7f09f4144a20 secure :-1 s=READY pgs=30 gs=1 cs=0 l=1 c_cookie=7667708904473508352 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09e80098d0 tx=0x7f09e802ee20 comp rx=0 tx=0).stop 2026-02-12T18:05:57.082 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f959d640 1 -- 10.20.193.111:0/3820281707 shutdown_connections 2026-02-12T18:05:57.082 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f959d640 1 --2- 10.20.193.111:0/3820281707 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f09f405d830 0x7f09f405dc80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.082 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f959d640 1 --2- 10.20.193.111:0/3820281707 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f09f408ff70 0x7f09f405d2f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.082 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f959d640 1 --2- 10.20.193.111:0/3820281707 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f09f4144650 0x7f09f4144a20 unknown :-1 s=CLOSED pgs=30 gs=1 cs=0 l=1 c_cookie=7667708904473508352 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.082 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f959d640 1 -- 10.20.193.111:0/3820281707 >> 10.20.193.111:0/3820281707 conn(0x7f09f4090ae0 msgr2=0x7f09f40918a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:05:57.082 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f959d640 1 -- 10.20.193.111:0/3820281707 shutdown_connections 2026-02-12T18:05:57.082 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.066+0000 7f09f959d640 1 -- 10.20.193.111:0/3820281707 wait complete. 2026-02-12T18:05:57.082 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.067+0000 7f09f959d640 10 monclient: build_initial_monmap 2026-02-12T18:05:57.082 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.067+0000 7f09f959d640 10 monclient: monmap: 2026-02-12T18:05:57.082 INFO:teuthology.orchestra.run.trial111.stderr:epoch 0 2026-02-12T18:05:57.082 INFO:teuthology.orchestra.run.trial111.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:05:57.082 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 0.000000 2026-02-12T18:05:57.082 INFO:teuthology.orchestra.run.trial111.stderr:created 0.000000 2026-02-12T18:05:57.083 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 0 (unknown) 2026-02-12T18:05:57.083 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.083 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:05:57.083 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:05:57.083 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:05:57.083 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:05:57.083 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:05:57.083 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:05:57.083 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:05:57.083 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:05:57.083 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:05:57.083 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.083 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.067+0000 7f09f959d640 1 Processor -- start 2026-02-12T18:05:57.084 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.067+0000 7f09f959d640 1 -- start start 2026-02-12T18:05:57.084 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.067+0000 7f09f959d640 10 monclient: init 2026-02-12T18:05:57.084 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.067+0000 7f09f959d640 10 monclient: _reopen_session rank -1 2026-02-12T18:05:57.084 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.067+0000 7f09f959d640 10 monclient: _add_conns ranks=[8,0,1,7,6,3,5,2,4] 2026-02-12T18:05:57.084 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.067+0000 7f09f959d640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f09f405d830 0x7f09f408d630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.084 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.067+0000 7f09f959d640 10 monclient(hunting): picked mon.noname-e con 0x7f09f405d830 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:05:57.084 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.067+0000 7f09f959d640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f09f408ff70 0x7f09f40878a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.084 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.067+0000 7f09f959d640 10 monclient(hunting): picked mon.noname-a con 0x7f09f408ff70 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:05:57.084 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.067+0000 7f09f959d640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f09f4144650 0x7f09f4087de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.084 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f959d640 10 monclient(hunting): picked mon.noname-f con 0x7f09f4144650 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:05:57.084 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f959d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.084 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f959d640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f09f40929a0 con 0x7f09f408ff70 2026-02-12T18:05:57.084 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f959d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.085 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f959d640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f09f4089e20 con 0x7f09f4144650 2026-02-12T18:05:57.085 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f959d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.085 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f959d640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f09f4141af0 con 0x7f09f405d830 2026-02-12T18:05:57.085 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f959d640 10 monclient(hunting): _renew_subs 2026-02-12T18:05:57.085 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f959d640 10 monclient(hunting): authenticate will time out at 554.756017s 2026-02-12T18:05:57.085 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f37fe640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f09f4144650 0x7f09f4087de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.085 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f37fe640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f09f4144650 0x7f09f4087de0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3300/0 says I am v2:10.20.193.111:40244/0 (socket says 10.20.193.111:40244) 2026-02-12T18:05:57.085 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f37fe640 1 -- 10.20.193.111:0/152697336 learned_addr learned my addr 10.20.193.111:0/152697336 (peer_addr_for_me v2:10.20.193.111:0/0) 2026-02-12T18:05:57.085 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f37fe640 10 monclient(hunting): get_auth_request con 0x7f09f4144650 auth_method 0 2026-02-12T18:05:57.085 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.085 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.085 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.086 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:57.086 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:57.086 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f27fc640 1 --2- 10.20.193.111:0/152697336 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f09f408ff70 0x7f09f40878a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.086 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:57.086 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f27fc640 10 monclient(hunting): get_auth_request con 0x7f09f408ff70 auth_method 0 2026-02-12T18:05:57.086 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.086 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.086 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.086 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f2ffd640 1 --2- 10.20.193.111:0/152697336 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f09f405d830 0x7f09f408d630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.086 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f2ffd640 10 monclient(hunting): get_auth_request con 0x7f09f405d830 auth_method 0 2026-02-12T18:05:57.086 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.086 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.086 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.087 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:57.087 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:57.087 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:57.087 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f37fe640 10 monclient(hunting): handle_auth_done global_id 4141 payload 824 2026-02-12T18:05:57.087 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f37fe640 1 -- 10.20.193.111:0/152697336 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f09f405d830 msgr2=0x7f09f408d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:57.087 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f37fe640 1 --2- 10.20.193.111:0/152697336 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f09f405d830 0x7f09f408d630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.087 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f37fe640 1 -- 10.20.193.111:0/152697336 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f09f408ff70 msgr2=0x7f09f40878a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:57.087 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f37fe640 1 --2- 10.20.193.111:0/152697336 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f09f408ff70 0x7f09f40878a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.087 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f37fe640 10 monclient: _finish_hunting 0 2026-02-12T18:05:57.087 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f37fe640 1 monclient: found mon.noname-f 2026-02-12T18:05:57.087 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:05:57.087 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f37fe640 10 monclient: _send_mon_message to mon.noname-f at v2:10.20.193.111:3300/0 2026-02-12T18:05:57.087 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.068+0000 7f09f37fe640 1 -- 10.20.193.111:0/152697336 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09e80094f0 con 0x7f09f4144650 2026-02-12T18:05:57.088 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.070+0000 7f09f37fe640 1 -- 10.20.193.111:0/152697336 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f09f4144650 msgr2=0x7f09f4087de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:05:57.088 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.070+0000 7f09f37fe640 1 --2- 10.20.193.111:0/152697336 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f09f4144650 0x7f09f4087de0 secure :-1 s=READY pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09e400f7e0 tx=0x7f09e400fcb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:05:57.088 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.070+0000 7f09d37fe640 1 -- 10.20.193.111:0/152697336 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f09e400db90 con 0x7f09f4144650 2026-02-12T18:05:57.088 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.070+0000 7f09d37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:57.088 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.070+0000 7f09d37fe640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2026-02-12T18:05:57.088 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.070+0000 7f09d37fe640 10 monclient: dump: 2026-02-12T18:05:57.088 INFO:teuthology.orchestra.run.trial111.stderr:epoch 1 2026-02-12T18:05:57.088 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:57.088 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.088 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.088 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:57.088 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.088 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:57.089 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:57.089 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:57.089 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:57.089 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:57.089 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:57.089 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:57.089 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:57.089 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:57.089 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.089 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.070+0000 7f09d37fe640 10 monclient: _finish_auth 0 2026-02-12T18:05:57.089 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.070+0000 7f09d37fe640 10 monclient: _check_auth_tickets 2026-02-12T18:05:57.089 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.070+0000 7f09d37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:05:57.089 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.070+0000 7f09d37fe640 1 -- 10.20.193.111:0/152697336 <== mon.1 v2:10.20.193.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09e400dd10 con 0x7f09f4144650 2026-02-12T18:05:57.090 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.070+0000 7f09d37fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:05:57.090 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.070+0000 7f09d37fe640 1 -- 10.20.193.111:0/152697336 <== mon.1 v2:10.20.193.111:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f09e400de80 con 0x7f09f4144650 2026-02-12T18:05:57.090 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.070+0000 7f09d37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:57.090 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.070+0000 7f09f17fa640 4 set_mon_vals no callback set 2026-02-12T18:05:57.090 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.070+0000 7f09d37fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:05:57.090 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.070+0000 7f09d37fe640 10 monclient: dump: 2026-02-12T18:05:57.090 INFO:teuthology.orchestra.run.trial111.stderr:epoch 1 2026-02-12T18:05:57.090 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:57.090 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.090 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.090 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:57.090 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.091 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:57.091 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:57.091 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:57.091 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:57.091 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:57.091 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:57.091 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:57.091 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:57.091 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:57.091 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.091 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.070+0000 7f09f959d640 5 monclient: authenticate success, global_id 4141 2026-02-12T18:05:57.091 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.070+0000 7f09f959d640 10 monclient: _renew_subs 2026-02-12T18:05:57.092 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.070+0000 7f09f959d640 10 monclient: _send_mon_message to mon.f at v2:10.20.193.111:3300/0 2026-02-12T18:05:57.092 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.070+0000 7f09f959d640 1 -- 10.20.193.111:0/152697336 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09f4141630 con 0x7f09f4144650 2026-02-12T18:05:57.092 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.070+0000 7f09f959d640 10 monclient: _renew_subs 2026-02-12T18:05:57.092 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.070+0000 7f09f959d640 10 monclient: _send_mon_message to mon.f at v2:10.20.193.111:3300/0 2026-02-12T18:05:57.092 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.070+0000 7f09f959d640 1 -- 10.20.193.111:0/152697336 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09f4118d00 con 0x7f09f4144650 2026-02-12T18:05:57.092 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.070+0000 7f09d37fe640 1 -- 10.20.193.111:0/152697336 <== mon.1 v2:10.20.193.111:3300/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f09e4023020 con 0x7f09f4144650 2026-02-12T18:05:57.092 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.071+0000 7f09d37fe640 1 -- 10.20.193.111:0/152697336 <== mon.1 v2:10.20.193.111:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 835+0+0 (secure 0 0 0) 0x7f09e401ccb0 con 0x7f09f4144650 2026-02-12T18:05:57.092 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.071+0000 7f09f959d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:57.092 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.071+0000 7f09f959d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:57.092 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.071+0000 7f09f959d640 10 monclient: _send_mon_message to mon.f at v2:10.20.193.111:3300/0 2026-02-12T18:05:57.092 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.071+0000 7f09f959d640 1 -- 10.20.193.111:0/152697336 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09f405eb50 con 0x7f09f4144650 2026-02-12T18:05:57.092 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.072+0000 7f09d37fe640 1 -- 10.20.193.111:0/152697336 <== mon.1 v2:10.20.193.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f09e4018070 con 0x7f09f4144650 2026-02-12T18:05:57.092 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.072+0000 7f09d37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:57.093 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.072+0000 7f09d37fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:05:57.108 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.108+0000 7f09f959d640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "4cf3730c-446c-4c4f-baf9-b354e06bf2b9", "id": 1}] 2026-02-12T18:05:57.109 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.108+0000 7f09f959d640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "4cf3730c-446c-4c4f-baf9-b354e06bf2b9", "id": 1}] 2026-02-12T18:05:57.109 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.108+0000 7f09f959d640 10 monclient: _send_mon_message to mon.f at v2:10.20.193.111:3300/0 2026-02-12T18:05:57.109 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.108+0000 7f09f959d640 1 -- 10.20.193.111:0/152697336 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4cf3730c-446c-4c4f-baf9-b354e06bf2b9", "id": 1} v 0) -- 0x7f09f4056510 con 0x7f09f4144650 2026-02-12T18:05:57.125 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.125+0000 7f09d37fe640 1 -- 10.20.193.111:0/152697336 <== mon.1 v2:10.20.193.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4cf3730c-446c-4c4f-baf9-b354e06bf2b9", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f09e4010040 con 0x7f09f4144650 2026-02-12T18:05:57.126 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.125+0000 7f09d37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "4cf3730c-446c-4c4f-baf9-b354e06bf2b9", "id": 1}] 2026-02-12T18:05:57.126 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.125+0000 7f09d37fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:05:57.126 INFO:teuthology.orchestra.run.trial111.stdout:1 2026-02-12T18:05:57.127 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.126+0000 7f09f959d640 10 monclient: shutdown 2026-02-12T18:05:57.127 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.126+0000 7f09f959d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:05:57.127 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.126+0000 7f09f959d640 1 -- 10.20.193.111:0/152697336 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f09f4144650 msgr2=0x7f09f4087de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:57.127 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.126+0000 7f09f959d640 1 --2- 10.20.193.111:0/152697336 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f09f4144650 0x7f09f4087de0 secure :-1 s=READY pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f09e400f7e0 tx=0x7f09e400fcb0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.127 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.126+0000 7f09f959d640 1 -- 10.20.193.111:0/152697336 shutdown_connections 2026-02-12T18:05:57.128 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.126+0000 7f09f959d640 1 --2- 10.20.193.111:0/152697336 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f09f4144650 0x7f09f4087de0 unknown :-1 s=CLOSED pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.128 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.126+0000 7f09f959d640 1 --2- 10.20.193.111:0/152697336 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f09f408ff70 0x7f09f40878a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.128 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.126+0000 7f09f959d640 1 --2- 10.20.193.111:0/152697336 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f09f405d830 0x7f09f408d630 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.128 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.126+0000 7f09f959d640 1 -- 10.20.193.111:0/152697336 >> 10.20.193.111:0/152697336 conn(0x7f09f4090ae0 msgr2=0x7f09f413fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:05:57.128 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.126+0000 7f09f959d640 1 -- 10.20.193.111:0/152697336 shutdown_connections 2026-02-12T18:05:57.128 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.126+0000 7f09f959d640 1 -- 10.20.193.111:0/152697336 wait complete. 2026-02-12T18:05:57.134 DEBUG:teuthology.orchestra.run.trial111:> sudo ceph --cluster ceph osd new 4ca2a3bb-4801-48eb-9814-12473a6c12bc 2 2026-02-12T18:05:57.197 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.197+0000 7fcd3b94c640 10 monclient: get_monmap_and_config 2026-02-12T18:05:57.198 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.197+0000 7fcd3b94c640 10 monclient: build_initial_monmap 2026-02-12T18:05:57.198 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.197+0000 7fcd3b94c640 10 monclient: monmap: 2026-02-12T18:05:57.198 INFO:teuthology.orchestra.run.trial111.stderr:epoch 0 2026-02-12T18:05:57.198 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:57.198 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:57.197939+0000 2026-02-12T18:05:57.198 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:57.197939+0000 2026-02-12T18:05:57.198 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 0 (unknown) 2026-02-12T18:05:57.198 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.198 INFO:teuthology.orchestra.run.trial111.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:05:57.198 INFO:teuthology.orchestra.run.trial111.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:05:57.198 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:05:57.198 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:05:57.199 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:05:57.199 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:05:57.199 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:05:57.199 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:05:57.199 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:05:57.199 INFO:teuthology.orchestra.run.trial111.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:05:57.199 INFO:teuthology.orchestra.run.trial111.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:05:57.199 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.209 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.197+0000 7fcd3b94c640 1 Processor -- start 2026-02-12T18:05:57.209 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.197+0000 7fcd3b94c640 1 -- start start 2026-02-12T18:05:57.209 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.197+0000 7fcd3b94c640 10 monclient: init 2026-02-12T18:05:57.209 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd3b94c640 10 monclient: _reopen_session rank -1 2026-02-12T18:05:57.209 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd3b94c640 10 monclient: _add_conns ranks=[7,4,9,0,6,3,1,10,8,5,2] 2026-02-12T18:05:57.209 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd3b94c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcd340914d0 0x7fcd3405c950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.209 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd3b94c640 10 monclient(hunting): picked mon.noname-i con 0x7fcd340914d0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:05:57.209 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd3b94c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcd3408e210 0x7fcd3405ce90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.209 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd3b94c640 10 monclient(hunting): picked mon.noname-c con 0x7fcd3408e210 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:05:57.210 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd3b94c640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fcd3405e4b0 0x7fcd3405d3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.210 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd3b94c640 10 monclient(hunting): picked mon.noname-a con 0x7fcd3405e4b0 addr v2:10.20.193.48:3300/0 2026-02-12T18:05:57.210 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd3b94c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.210 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd3b94c640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7fcd34093d70 con 0x7fcd3405e4b0 2026-02-12T18:05:57.210 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd3b94c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.210 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd3b94c640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fcd34092f90 con 0x7fcd3408e210 2026-02-12T18:05:57.210 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd3b94c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.210 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd3b94c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fcd340918a0 con 0x7fcd340914d0 2026-02-12T18:05:57.210 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd3b94c640 10 monclient(hunting): _renew_subs 2026-02-12T18:05:57.210 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd3b94c640 10 monclient(hunting): authenticate will time out at 554.886072s 2026-02-12T18:05:57.210 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd396c1640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcd340914d0 0x7fcd3405c950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.210 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd396c1640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcd340914d0 0x7fcd3405c950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3303/0 says I am v2:10.20.193.111:45968/0 (socket says 10.20.193.111:45968) 2026-02-12T18:05:57.211 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd396c1640 1 -- 10.20.193.111:0/635097537 learned_addr learned my addr 10.20.193.111:0/635097537 (peer_addr_for_me v2:10.20.193.111:0/0) 2026-02-12T18:05:57.211 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd396c1640 10 monclient(hunting): get_auth_request con 0x7fcd340914d0 auth_method 0 2026-02-12T18:05:57.211 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd396c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.211 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd396c1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.211 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd396c1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.211 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd38ec0640 1 --2- 10.20.193.111:0/635097537 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcd3408e210 0x7fcd3405ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.211 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd396c1640 1 -- 10.20.193.111:0/635097537 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcd340914d0 msgr2=0x7fcd3405c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:05:57.211 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd396c1640 1 -- 10.20.193.111:0/635097537 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcd340914d0 msgr2=0x7fcd3405c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:57.211 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd38ec0640 10 monclient(hunting): get_auth_request con 0x7fcd3408e210 auth_method 0 2026-02-12T18:05:57.211 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd38ec0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.211 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd38ec0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.211 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd396c1640 1 --2- 10.20.193.111:0/635097537 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcd340914d0 0x7fcd3405c950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:57.211 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd38ec0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.212 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd396c1640 1 --2- 10.20.193.111:0/635097537 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcd340914d0 0x7fcd3405c950 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:05:57.212 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd39ec2640 1 --2- 10.20.193.111:0/635097537 >> v2:10.20.193.48:3300/0 conn(0x7fcd3405e4b0 0x7fcd3405d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.212 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd39ec2640 10 monclient(hunting): get_auth_request con 0x7fcd3405e4b0 auth_method 0 2026-02-12T18:05:57.212 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd39ec2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.212 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd39ec2640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.212 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd39ec2640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.212 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd38ec0640 1 -- 10.20.193.111:0/635097537 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcd3408e210 msgr2=0x7fcd3405ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:05:57.212 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd38ec0640 1 -- 10.20.193.111:0/635097537 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcd3408e210 msgr2=0x7fcd3405ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:57.212 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd38ec0640 1 --2- 10.20.193.111:0/635097537 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcd3408e210 0x7fcd3405ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:57.212 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd38ec0640 1 --2- 10.20.193.111:0/635097537 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcd3408e210 0x7fcd3405ce90 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:05:57.212 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd39ec2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:57.212 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd39ec2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:57.212 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd39ec2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:57.213 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd39ec2640 10 monclient(hunting): handle_auth_done global_id 4131 payload 274 2026-02-12T18:05:57.213 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd39ec2640 1 -- 10.20.193.111:0/635097537 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcd340914d0 msgr2=0x7fcd3405c950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:05:57.213 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd39ec2640 1 --2- 10.20.193.111:0/635097537 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcd340914d0 0x7fcd3405c950 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.213 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd39ec2640 1 -- 10.20.193.111:0/635097537 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcd3408e210 msgr2=0x7fcd3405ce90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:05:57.213 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd39ec2640 1 --2- 10.20.193.111:0/635097537 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcd3408e210 0x7fcd3405ce90 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.213 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd39ec2640 10 monclient: _finish_hunting 0 2026-02-12T18:05:57.213 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd39ec2640 1 monclient: found mon.noname-a 2026-02-12T18:05:57.213 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd39ec2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:05:57.213 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd39ec2640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:05:57.213 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.198+0000 7fcd39ec2640 1 -- 10.20.193.111:0/635097537 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd3404dc20 con 0x7fcd3405e4b0 2026-02-12T18:05:57.213 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.201+0000 7fcd39ec2640 1 -- 10.20.193.111:0/635097537 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fcd3405e4b0 msgr2=0x7fcd3405d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:05:57.213 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.201+0000 7fcd39ec2640 1 --2- 10.20.193.111:0/635097537 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fcd3405e4b0 0x7fcd3405d3d0 secure :-1 s=READY pgs=36 gs=2 cs=0 l=1 c_cookie=5968880451048640744 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd3000a8e0 tx=0x7fcd3002fde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52d5b9254f8710e8 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:05:57.214 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.201+0000 7fcd23fff640 1 -- 10.20.193.111:0/635097537 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcd30036340 con 0x7fcd3405e4b0 2026-02-12T18:05:57.214 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.201+0000 7fcd23fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:57.214 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.201+0000 7fcd23fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:05:57.214 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.201+0000 7fcd23fff640 10 monclient: dump: 2026-02-12T18:05:57.214 INFO:teuthology.orchestra.run.trial111.stderr:epoch 1 2026-02-12T18:05:57.214 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:57.214 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.214 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.214 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:57.214 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.214 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:57.214 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:57.215 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:57.215 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:57.215 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:57.215 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:57.215 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:57.215 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:57.215 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:57.215 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.215 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.201+0000 7fcd23fff640 10 monclient: _finish_auth 0 2026-02-12T18:05:57.215 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.201+0000 7fcd23fff640 10 monclient: _check_auth_tickets 2026-02-12T18:05:57.215 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.201+0000 7fcd23fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:05:57.215 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.201+0000 7fcd3b94c640 5 monclient: authenticate success, global_id 4131 2026-02-12T18:05:57.216 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.201+0000 7fcd3b94c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:05:57.216 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.201+0000 7fcd23fff640 1 -- 10.20.193.111:0/635097537 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd30030a60 con 0x7fcd3405e4b0 2026-02-12T18:05:57.216 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.201+0000 7fcd23fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:05:57.216 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.201+0000 7fcd23fff640 1 -- 10.20.193.111:0/635097537 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcd30030bd0 con 0x7fcd3405e4b0 2026-02-12T18:05:57.216 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.201+0000 7fcd23fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:57.216 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.201+0000 7fcd23fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:05:57.216 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.201+0000 7fcd23fff640 10 monclient: dump: 2026-02-12T18:05:57.216 INFO:teuthology.orchestra.run.trial111.stderr:epoch 1 2026-02-12T18:05:57.216 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:57.216 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.216 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.216 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:57.217 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.217 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:57.217 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:57.217 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:57.217 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:57.217 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:57.217 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:57.217 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:57.217 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:57.217 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:57.217 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.217 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.201+0000 7fcd3b94c640 10 monclient: get_monmap_and_config success 2026-02-12T18:05:57.217 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.201+0000 7fcd3b94c640 4 set_mon_vals no callback set 2026-02-12T18:05:57.217 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.202+0000 7fcd3b94c640 10 monclient: shutdown 2026-02-12T18:05:57.218 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.202+0000 7fcd3b94c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:05:57.218 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.202+0000 7fcd3b94c640 1 -- 10.20.193.111:0/635097537 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fcd3405e4b0 msgr2=0x7fcd3405d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:57.218 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.202+0000 7fcd3b94c640 1 --2- 10.20.193.111:0/635097537 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fcd3405e4b0 0x7fcd3405d3d0 secure :-1 s=READY pgs=36 gs=2 cs=0 l=1 c_cookie=5968880451048640744 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd3000a8e0 tx=0x7fcd3002fde0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.218 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.202+0000 7fcd3b94c640 1 -- 10.20.193.111:0/635097537 shutdown_connections 2026-02-12T18:05:57.218 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.202+0000 7fcd3b94c640 1 --2- 10.20.193.111:0/635097537 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fcd3405e4b0 0x7fcd3405d3d0 unknown :-1 s=CLOSED pgs=36 gs=2 cs=0 l=1 c_cookie=5968880451048640744 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.218 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.202+0000 7fcd3b94c640 1 --2- 10.20.193.111:0/635097537 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcd3408e210 0x7fcd3405ce90 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.218 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.202+0000 7fcd3b94c640 1 --2- 10.20.193.111:0/635097537 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcd340914d0 0x7fcd3405c950 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.218 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.202+0000 7fcd3b94c640 1 -- 10.20.193.111:0/635097537 >> 10.20.193.111:0/635097537 conn(0x7fcd340548a0 msgr2=0x7fcd34097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:05:57.218 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.202+0000 7fcd3b94c640 1 -- 10.20.193.111:0/635097537 shutdown_connections 2026-02-12T18:05:57.218 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.202+0000 7fcd3b94c640 1 -- 10.20.193.111:0/635097537 wait complete. 2026-02-12T18:05:57.218 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.202+0000 7fcd3b94c640 10 monclient: build_initial_monmap 2026-02-12T18:05:57.218 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.202+0000 7fcd3b94c640 10 monclient: monmap: 2026-02-12T18:05:57.219 INFO:teuthology.orchestra.run.trial111.stderr:epoch 0 2026-02-12T18:05:57.219 INFO:teuthology.orchestra.run.trial111.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:05:57.219 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 0.000000 2026-02-12T18:05:57.219 INFO:teuthology.orchestra.run.trial111.stderr:created 0.000000 2026-02-12T18:05:57.219 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 0 (unknown) 2026-02-12T18:05:57.219 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.219 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:05:57.219 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:05:57.219 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:05:57.219 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:05:57.219 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:05:57.219 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:05:57.219 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:05:57.220 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:05:57.220 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:05:57.220 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.220 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.202+0000 7fcd3b94c640 1 Processor -- start 2026-02-12T18:05:57.220 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.202+0000 7fcd3b94c640 1 -- start start 2026-02-12T18:05:57.220 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.202+0000 7fcd3b94c640 10 monclient: init 2026-02-12T18:05:57.220 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd3b94c640 10 monclient: _reopen_session rank -1 2026-02-12T18:05:57.220 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd3b94c640 10 monclient: _add_conns ranks=[8,3,6,7,1,5,4,0,2] 2026-02-12T18:05:57.220 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd3b94c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcd3405e4b0 0x7fcd341db000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.220 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd3b94c640 10 monclient(hunting): picked mon.noname-e con 0x7fcd3405e4b0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:05:57.220 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd3b94c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fcd3408e210 0x7fcd341b0d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.220 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd3b94c640 10 monclient(hunting): picked mon.noname-g con 0x7fcd3408e210 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:05:57.221 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd3b94c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcd340914d0 0x7fcd34198a20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.221 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd3b94c640 10 monclient(hunting): picked mon.noname-d con 0x7fcd340914d0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:05:57.221 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd3b94c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.221 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd3b94c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fcd341db540 con 0x7fcd3408e210 2026-02-12T18:05:57.221 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd3b94c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.221 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd3b94c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fcd3408d020 con 0x7fcd340914d0 2026-02-12T18:05:57.221 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd3b94c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.221 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd3b94c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fcd34094520 con 0x7fcd3405e4b0 2026-02-12T18:05:57.221 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd3b94c640 10 monclient(hunting): _renew_subs 2026-02-12T18:05:57.221 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd3b94c640 10 monclient(hunting): authenticate will time out at 554.891122s 2026-02-12T18:05:57.221 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd38ec0640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fcd3408e210 0x7fcd341b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.221 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd38ec0640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fcd3408e210 0x7fcd341b0d10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3301/0 says I am v2:10.20.193.111:35934/0 (socket says 10.20.193.111:35934) 2026-02-12T18:05:57.222 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd38ec0640 1 -- 10.20.193.111:0/3251513195 learned_addr learned my addr 10.20.193.111:0/3251513195 (peer_addr_for_me v2:10.20.193.111:0/0) 2026-02-12T18:05:57.222 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd38ec0640 10 monclient(hunting): get_auth_request con 0x7fcd3408e210 auth_method 0 2026-02-12T18:05:57.222 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd38ec0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.222 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd38ec0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.222 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd38ec0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.222 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd396c1640 1 --2- 10.20.193.111:0/3251513195 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcd3405e4b0 0x7fcd341db000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.222 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd396c1640 10 monclient(hunting): get_auth_request con 0x7fcd3405e4b0 auth_method 0 2026-02-12T18:05:57.222 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd396c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.222 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd396c1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.222 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd396c1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.222 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd39ec2640 1 --2- 10.20.193.111:0/3251513195 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcd340914d0 0x7fcd34198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.222 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd38ec0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:57.222 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd38ec0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:57.223 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd38ec0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:57.223 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd39ec2640 10 monclient(hunting): get_auth_request con 0x7fcd340914d0 auth_method 0 2026-02-12T18:05:57.223 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd39ec2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.223 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd39ec2640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.223 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd39ec2640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.223 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd39ec2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:57.223 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd39ec2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:57.223 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd39ec2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:57.223 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd396c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:57.223 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd396c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:57.223 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd396c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:57.223 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd38ec0640 10 monclient(hunting): handle_auth_done global_id 4116 payload 824 2026-02-12T18:05:57.223 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd38ec0640 1 -- 10.20.193.111:0/3251513195 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcd3405e4b0 msgr2=0x7fcd341db000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:57.224 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd38ec0640 1 --2- 10.20.193.111:0/3251513195 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcd3405e4b0 0x7fcd341db000 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.224 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd38ec0640 1 -- 10.20.193.111:0/3251513195 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcd340914d0 msgr2=0x7fcd34198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:57.224 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd38ec0640 1 --2- 10.20.193.111:0/3251513195 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcd340914d0 0x7fcd34198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.224 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd38ec0640 10 monclient: _finish_hunting 0 2026-02-12T18:05:57.224 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd38ec0640 1 monclient: found mon.noname-g 2026-02-12T18:05:57.224 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd38ec0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:05:57.224 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd38ec0640 10 monclient: _send_mon_message to mon.noname-g at v2:10.20.193.111:3301/0 2026-02-12T18:05:57.224 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.203+0000 7fcd38ec0640 1 -- 10.20.193.111:0/3251513195 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd3000a500 con 0x7fcd3408e210 2026-02-12T18:05:57.224 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.205+0000 7fcd38ec0640 1 -- 10.20.193.111:0/3251513195 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fcd3408e210 msgr2=0x7fcd341b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:05:57.224 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.205+0000 7fcd38ec0640 1 --2- 10.20.193.111:0/3251513195 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fcd3408e210 0x7fcd341b0d10 secure :-1 s=READY pgs=21 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd28006f30 tx=0x7fcd2800ebb0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:05:57.225 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.205+0000 7fcd21ffb640 1 -- 10.20.193.111:0/3251513195 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcd2800ee10 con 0x7fcd3408e210 2026-02-12T18:05:57.225 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.205+0000 7fcd21ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:57.225 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.205+0000 7fcd21ffb640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2026-02-12T18:05:57.225 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.205+0000 7fcd21ffb640 10 monclient: dump: 2026-02-12T18:05:57.225 INFO:teuthology.orchestra.run.trial111.stderr:epoch 1 2026-02-12T18:05:57.225 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:57.225 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.225 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.225 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:57.225 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.225 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:57.225 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:57.226 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:57.226 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:57.226 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:57.226 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:57.226 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:57.226 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:57.226 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:57.226 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.226 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.205+0000 7fcd21ffb640 10 monclient: _finish_auth 0 2026-02-12T18:05:57.226 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.205+0000 7fcd21ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:05:57.226 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.205+0000 7fcd21ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:05:57.226 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.205+0000 7fcd21ffb640 1 -- 10.20.193.111:0/3251513195 <== mon.3 v2:10.20.193.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd2800cda0 con 0x7fcd3408e210 2026-02-12T18:05:57.226 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.205+0000 7fcd21ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:05:57.227 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.205+0000 7fcd21ffb640 1 -- 10.20.193.111:0/3251513195 <== mon.3 v2:10.20.193.111:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcd280138d0 con 0x7fcd3408e210 2026-02-12T18:05:57.227 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.205+0000 7fcd21ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:57.227 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.205+0000 7fcd237fe640 4 set_mon_vals no callback set 2026-02-12T18:05:57.227 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.205+0000 7fcd21ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:05:57.227 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.205+0000 7fcd21ffb640 10 monclient: dump: 2026-02-12T18:05:57.227 INFO:teuthology.orchestra.run.trial111.stderr:epoch 1 2026-02-12T18:05:57.227 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:57.227 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.227 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.227 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:57.227 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.227 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:57.227 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:57.228 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:57.228 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:57.228 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:57.228 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:57.228 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:57.228 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:57.228 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:57.228 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.228 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.205+0000 7fcd3b94c640 5 monclient: authenticate success, global_id 4116 2026-02-12T18:05:57.228 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.205+0000 7fcd3b94c640 10 monclient: _renew_subs 2026-02-12T18:05:57.228 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.205+0000 7fcd3b94c640 10 monclient: _send_mon_message to mon.g at v2:10.20.193.111:3301/0 2026-02-12T18:05:57.228 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.205+0000 7fcd3b94c640 1 -- 10.20.193.111:0/3251513195 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd3419a350 con 0x7fcd3408e210 2026-02-12T18:05:57.229 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.205+0000 7fcd3b94c640 10 monclient: _renew_subs 2026-02-12T18:05:57.229 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.205+0000 7fcd3b94c640 10 monclient: _send_mon_message to mon.g at v2:10.20.193.111:3301/0 2026-02-12T18:05:57.229 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.205+0000 7fcd3b94c640 1 -- 10.20.193.111:0/3251513195 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd3419be10 con 0x7fcd3408e210 2026-02-12T18:05:57.229 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.206+0000 7fcd21ffb640 1 -- 10.20.193.111:0/3251513195 <== mon.3 v2:10.20.193.111:3301/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7fcd2800c8e0 con 0x7fcd3408e210 2026-02-12T18:05:57.229 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.206+0000 7fcd21ffb640 1 -- 10.20.193.111:0/3251513195 <== mon.3 v2:10.20.193.111:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 950+0+0 (secure 0 0 0) 0x7fcd2801a360 con 0x7fcd3408e210 2026-02-12T18:05:57.229 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.206+0000 7fcd3b94c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:57.229 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.206+0000 7fcd3b94c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:57.229 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.206+0000 7fcd3b94c640 10 monclient: _send_mon_message to mon.g at v2:10.20.193.111:3301/0 2026-02-12T18:05:57.229 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.206+0000 7fcd3b94c640 1 -- 10.20.193.111:0/3251513195 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd3405c950 con 0x7fcd3408e210 2026-02-12T18:05:57.229 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.207+0000 7fcd21ffb640 1 -- 10.20.193.111:0/3251513195 <== mon.3 v2:10.20.193.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7fcd28021060 con 0x7fcd3408e210 2026-02-12T18:05:57.229 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.207+0000 7fcd21ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:57.229 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.207+0000 7fcd21ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:05:57.240 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.240+0000 7fcd3b94c640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "4ca2a3bb-4801-48eb-9814-12473a6c12bc", "id": 2}] 2026-02-12T18:05:57.240 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.240+0000 7fcd3b94c640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "4ca2a3bb-4801-48eb-9814-12473a6c12bc", "id": 2}] 2026-02-12T18:05:57.240 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.240+0000 7fcd3b94c640 10 monclient: _send_mon_message to mon.g at v2:10.20.193.111:3301/0 2026-02-12T18:05:57.241 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.240+0000 7fcd3b94c640 1 -- 10.20.193.111:0/3251513195 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4ca2a3bb-4801-48eb-9814-12473a6c12bc", "id": 2} v 0) -- 0x7fcd3419c1f0 con 0x7fcd3408e210 2026-02-12T18:05:57.243 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.243+0000 7fcd21ffb640 1 -- 10.20.193.111:0/3251513195 <== mon.3 v2:10.20.193.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4ca2a3bb-4801-48eb-9814-12473a6c12bc", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fcd2802a0b0 con 0x7fcd3408e210 2026-02-12T18:05:57.243 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.243+0000 7fcd21ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "4ca2a3bb-4801-48eb-9814-12473a6c12bc", "id": 2}] 2026-02-12T18:05:57.243 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.243+0000 7fcd21ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:05:57.244 INFO:teuthology.orchestra.run.trial111.stdout:2 2026-02-12T18:05:57.245 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.243+0000 7fcd3b94c640 10 monclient: shutdown 2026-02-12T18:05:57.245 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.243+0000 7fcd3b94c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:05:57.245 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.243+0000 7fcd3b94c640 1 -- 10.20.193.111:0/3251513195 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fcd3408e210 msgr2=0x7fcd341b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:57.245 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.243+0000 7fcd3b94c640 1 --2- 10.20.193.111:0/3251513195 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fcd3408e210 0x7fcd341b0d10 secure :-1 s=READY pgs=21 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcd28006f30 tx=0x7fcd2800ebb0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.245 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.243+0000 7fcd3b94c640 1 -- 10.20.193.111:0/3251513195 shutdown_connections 2026-02-12T18:05:57.245 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.243+0000 7fcd3b94c640 1 --2- 10.20.193.111:0/3251513195 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcd340914d0 0x7fcd34198a20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.245 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.243+0000 7fcd3b94c640 1 --2- 10.20.193.111:0/3251513195 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fcd3408e210 0x7fcd341b0d10 unknown :-1 s=CLOSED pgs=21 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.245 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.243+0000 7fcd3b94c640 1 --2- 10.20.193.111:0/3251513195 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcd3405e4b0 0x7fcd341db000 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.245 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.243+0000 7fcd3b94c640 1 -- 10.20.193.111:0/3251513195 >> 10.20.193.111:0/3251513195 conn(0x7fcd340548a0 msgr2=0x7fcd340900f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:05:57.246 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.243+0000 7fcd3b94c640 1 -- 10.20.193.111:0/3251513195 shutdown_connections 2026-02-12T18:05:57.246 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.243+0000 7fcd3b94c640 1 -- 10.20.193.111:0/3251513195 wait complete. 2026-02-12T18:05:57.251 DEBUG:teuthology.orchestra.run.trial111:> sudo ceph --cluster ceph osd new e64b1a76-9d2c-4c4a-bd2d-7b5b8c1df21e 3 2026-02-12T18:05:57.314 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.314+0000 7f252685b640 10 monclient: get_monmap_and_config 2026-02-12T18:05:57.315 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.314+0000 7f252685b640 10 monclient: build_initial_monmap 2026-02-12T18:05:57.315 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.314+0000 7f252685b640 10 monclient: monmap: 2026-02-12T18:05:57.315 INFO:teuthology.orchestra.run.trial111.stderr:epoch 0 2026-02-12T18:05:57.315 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:57.315 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:57.315156+0000 2026-02-12T18:05:57.315 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:57.315156+0000 2026-02-12T18:05:57.315 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 0 (unknown) 2026-02-12T18:05:57.315 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.315 INFO:teuthology.orchestra.run.trial111.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:05:57.315 INFO:teuthology.orchestra.run.trial111.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:05:57.316 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:05:57.316 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:05:57.316 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:05:57.316 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:05:57.316 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:05:57.316 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:05:57.316 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:05:57.316 INFO:teuthology.orchestra.run.trial111.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:05:57.316 INFO:teuthology.orchestra.run.trial111.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:05:57.316 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.326 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f252685b640 1 Processor -- start 2026-02-12T18:05:57.326 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f252685b640 1 -- start start 2026-02-12T18:05:57.326 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f252685b640 10 monclient: init 2026-02-12T18:05:57.326 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f252685b640 10 monclient: _reopen_session rank -1 2026-02-12T18:05:57.326 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f252685b640 10 monclient: _add_conns ranks=[3,7,9,10,5,8,1,2,4,0,6] 2026-02-12T18:05:57.326 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f252685b640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2520144b70 0x7f2520144f40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.326 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f252685b640 10 monclient(hunting): picked mon.noname-g con 0x7f2520144b70 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:05:57.326 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f252685b640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2520091690 0x7f2520145480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.326 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f252685b640 10 monclient(hunting): picked mon.noname-i con 0x7f2520091690 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:05:57.326 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f252685b640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f252005c950 0x7f252005cda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.327 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f252685b640 10 monclient(hunting): picked mon.noname-a con 0x7f252005c950 addr v2:10.20.193.48:3300/0 2026-02-12T18:05:57.327 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f252685b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.327 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f252685b640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f2520093510 con 0x7f252005c950 2026-02-12T18:05:57.327 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f252685b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.327 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f252685b640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f25201459c0 con 0x7f2520144b70 2026-02-12T18:05:57.327 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f252685b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.327 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f252685b640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f2520091e20 con 0x7f2520091690 2026-02-12T18:05:57.327 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f252685b640 10 monclient(hunting): _renew_subs 2026-02-12T18:05:57.327 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f252685b640 10 monclient(hunting): authenticate will time out at 555.003464s 2026-02-12T18:05:57.327 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251f7fe640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2520091690 0x7f2520145480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.327 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251ffff640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2520144b70 0x7f2520144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.327 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251f7fe640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2520091690 0x7f2520145480 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3303/0 says I am v2:10.20.193.111:45972/0 (socket says 10.20.193.111:45972) 2026-02-12T18:05:57.328 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251f7fe640 1 -- 10.20.193.111:0/1757663993 learned_addr learned my addr 10.20.193.111:0/1757663993 (peer_addr_for_me v2:10.20.193.111:0/0) 2026-02-12T18:05:57.328 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251ffff640 10 monclient(hunting): get_auth_request con 0x7f2520144b70 auth_method 0 2026-02-12T18:05:57.328 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.328 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.328 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.328 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251f7fe640 10 monclient(hunting): get_auth_request con 0x7f2520091690 auth_method 0 2026-02-12T18:05:57.328 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.328 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.328 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.328 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:57.328 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:57.328 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:57.328 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:57.329 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:57.329 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:57.329 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f2524dd1640 1 --2- 10.20.193.111:0/1757663993 >> v2:10.20.193.48:3300/0 conn(0x7f252005c950 0x7f252005cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.329 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f2524dd1640 10 monclient(hunting): get_auth_request con 0x7f252005c950 auth_method 0 2026-02-12T18:05:57.329 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f2524dd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.329 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f2524dd1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.329 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f2524dd1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.329 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251ffff640 10 monclient(hunting): handle_auth_done global_id 4125 payload 274 2026-02-12T18:05:57.329 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251ffff640 1 -- 10.20.193.111:0/1757663993 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2520091690 msgr2=0x7f2520145480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:05:57.329 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251ffff640 1 --2- 10.20.193.111:0/1757663993 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2520091690 0x7f2520145480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.329 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251ffff640 1 -- 10.20.193.111:0/1757663993 >> v2:10.20.193.48:3300/0 conn(0x7f252005c950 msgr2=0x7f252005cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:05:57.329 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251ffff640 1 --2- 10.20.193.111:0/1757663993 >> v2:10.20.193.48:3300/0 conn(0x7f252005c950 0x7f252005cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.330 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251ffff640 10 monclient: _finish_hunting 0 2026-02-12T18:05:57.330 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251ffff640 1 monclient: found mon.noname-g 2026-02-12T18:05:57.330 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:05:57.330 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251ffff640 10 monclient: _send_mon_message to mon.noname-g at v2:10.20.193.111:3301/0 2026-02-12T18:05:57.330 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.315+0000 7f251ffff640 1 -- 10.20.193.111:0/1757663993 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f252004dc20 con 0x7f2520144b70 2026-02-12T18:05:57.330 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f251ffff640 1 -- 10.20.193.111:0/1757663993 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2520144b70 msgr2=0x7f2520144f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:05:57.330 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f251ffff640 1 --2- 10.20.193.111:0/1757663993 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2520144b70 0x7f2520144f40 secure :-1 s=READY pgs=22 gs=2 cs=0 l=1 c_cookie=16832975815407991248 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f250c009800 tx=0x7f250c02ed10 comp rx=0 tx=0).ready entity=mon.3 client_cookie=e99abe51b62279d0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:05:57.330 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f251effd640 1 -- 10.20.193.111:0/1757663993 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f250c02fe50 con 0x7f2520144b70 2026-02-12T18:05:57.330 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f251effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:57.330 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f251effd640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2026-02-12T18:05:57.330 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f251effd640 10 monclient: dump: 2026-02-12T18:05:57.331 INFO:teuthology.orchestra.run.trial111.stderr:epoch 1 2026-02-12T18:05:57.331 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:57.331 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.331 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.331 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:57.331 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.331 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:57.331 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:57.331 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:57.331 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:57.331 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:57.331 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:57.331 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:57.332 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:57.332 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:57.332 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.332 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f251effd640 10 monclient: _finish_auth 0 2026-02-12T18:05:57.332 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f251effd640 10 monclient: _check_auth_tickets 2026-02-12T18:05:57.332 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f251effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:05:57.332 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f251effd640 1 -- 10.20.193.111:0/1757663993 <== mon.3 v2:10.20.193.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f250c035340 con 0x7f2520144b70 2026-02-12T18:05:57.332 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f251effd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:05:57.332 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f251effd640 1 -- 10.20.193.111:0/1757663993 <== mon.3 v2:10.20.193.111:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f250c035970 con 0x7f2520144b70 2026-02-12T18:05:57.332 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f252685b640 5 monclient: authenticate success, global_id 4125 2026-02-12T18:05:57.332 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f252685b640 10 monclient: get_monmap_and_config success 2026-02-12T18:05:57.332 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f252685b640 4 set_mon_vals no callback set 2026-02-12T18:05:57.332 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f251effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:57.333 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f251effd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:05:57.333 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f251effd640 10 monclient: dump: 2026-02-12T18:05:57.333 INFO:teuthology.orchestra.run.trial111.stderr:epoch 1 2026-02-12T18:05:57.333 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:57.333 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.333 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.333 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:57.333 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.333 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:57.333 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:57.333 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:57.333 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:57.334 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:57.334 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:57.334 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:57.334 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:57.334 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:57.334 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.334 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f252685b640 10 monclient: shutdown 2026-02-12T18:05:57.334 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f252685b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:05:57.334 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f252685b640 1 -- 10.20.193.111:0/1757663993 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2520144b70 msgr2=0x7f2520144f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:57.334 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f252685b640 1 --2- 10.20.193.111:0/1757663993 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2520144b70 0x7f2520144f40 secure :-1 s=READY pgs=22 gs=2 cs=0 l=1 c_cookie=16832975815407991248 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f250c009800 tx=0x7f250c02ed10 comp rx=0 tx=0).stop 2026-02-12T18:05:57.334 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f252685b640 1 -- 10.20.193.111:0/1757663993 shutdown_connections 2026-02-12T18:05:57.334 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f252685b640 1 --2- 10.20.193.111:0/1757663993 >> v2:10.20.193.48:3300/0 conn(0x7f252005c950 0x7f252005cda0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.335 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f252685b640 1 --2- 10.20.193.111:0/1757663993 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2520091690 0x7f2520145480 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.335 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f252685b640 1 --2- 10.20.193.111:0/1757663993 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2520144b70 0x7f2520144f40 unknown :-1 s=CLOSED pgs=22 gs=2 cs=0 l=1 c_cookie=16832975815407991248 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.335 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.318+0000 7f252685b640 1 -- 10.20.193.111:0/1757663993 >> 10.20.193.111:0/1757663993 conn(0x7f2520054ae0 msgr2=0x7f25200973a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:05:57.335 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.319+0000 7f252685b640 1 -- 10.20.193.111:0/1757663993 shutdown_connections 2026-02-12T18:05:57.335 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.319+0000 7f252685b640 1 -- 10.20.193.111:0/1757663993 wait complete. 2026-02-12T18:05:57.335 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.319+0000 7f252685b640 10 monclient: build_initial_monmap 2026-02-12T18:05:57.335 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.319+0000 7f252685b640 10 monclient: monmap: 2026-02-12T18:05:57.335 INFO:teuthology.orchestra.run.trial111.stderr:epoch 0 2026-02-12T18:05:57.335 INFO:teuthology.orchestra.run.trial111.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:05:57.335 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 0.000000 2026-02-12T18:05:57.335 INFO:teuthology.orchestra.run.trial111.stderr:created 0.000000 2026-02-12T18:05:57.335 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 0 (unknown) 2026-02-12T18:05:57.335 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.336 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:05:57.336 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:05:57.336 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:05:57.336 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:05:57.336 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:05:57.336 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:05:57.336 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:05:57.336 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:05:57.336 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:05:57.336 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.336 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.319+0000 7f252685b640 1 Processor -- start 2026-02-12T18:05:57.336 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.319+0000 7f252685b640 1 -- start start 2026-02-12T18:05:57.336 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.319+0000 7f252685b640 10 monclient: init 2026-02-12T18:05:57.337 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.319+0000 7f252685b640 10 monclient: _reopen_session rank -1 2026-02-12T18:05:57.337 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.319+0000 7f252685b640 10 monclient: _add_conns ranks=[8,2,5,1,6,0,7,3,4] 2026-02-12T18:05:57.337 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.319+0000 7f252685b640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f252005c950 0x7f2520117cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.337 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.319+0000 7f252685b640 10 monclient(hunting): picked mon.noname-e con 0x7f252005c950 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:05:57.337 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.319+0000 7f252685b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2520091690 0x7f2520118230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.337 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.319+0000 7f252685b640 10 monclient(hunting): picked mon.noname-b con 0x7f2520091690 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:05:57.337 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.319+0000 7f252685b640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f2520144b70 0x7f252012c410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.337 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.319+0000 7f252685b640 10 monclient(hunting): picked mon.noname-h con 0x7f2520144b70 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:05:57.337 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.319+0000 7f252685b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.337 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.319+0000 7f252685b640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f252012ec20 con 0x7f2520091690 2026-02-12T18:05:57.337 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.319+0000 7f252685b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.337 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.319+0000 7f252685b640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f252012fd70 con 0x7f2520144b70 2026-02-12T18:05:57.338 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.319+0000 7f252685b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.338 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.319+0000 7f252685b640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f252012dfc0 con 0x7f252005c950 2026-02-12T18:05:57.338 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.319+0000 7f252685b640 10 monclient(hunting): _renew_subs 2026-02-12T18:05:57.338 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.319+0000 7f252685b640 10 monclient(hunting): authenticate will time out at 555.007978s 2026-02-12T18:05:57.338 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f2524dd1640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f2520144b70 0x7f252012c410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.338 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f2524dd1640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f2520144b70 0x7f252012c410 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3302/0 says I am v2:10.20.193.111:34606/0 (socket says 10.20.193.111:34606) 2026-02-12T18:05:57.338 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f2524dd1640 1 -- 10.20.193.111:0/3022140421 learned_addr learned my addr 10.20.193.111:0/3022140421 (peer_addr_for_me v2:10.20.193.111:0/0) 2026-02-12T18:05:57.338 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f2524dd1640 10 monclient(hunting): get_auth_request con 0x7f2520144b70 auth_method 0 2026-02-12T18:05:57.338 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f2524dd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.338 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f2524dd1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.338 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f2524dd1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.338 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f251ffff640 1 --2- 10.20.193.111:0/3022140421 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f252005c950 0x7f2520117cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.339 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f2524dd1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:57.339 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f2524dd1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:57.339 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f2524dd1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:57.339 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f251ffff640 10 monclient(hunting): get_auth_request con 0x7f252005c950 auth_method 0 2026-02-12T18:05:57.339 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f251ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.339 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f251ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.339 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f251ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.339 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f251f7fe640 1 --2- 10.20.193.111:0/3022140421 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2520091690 0x7f2520118230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.339 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f251f7fe640 10 monclient(hunting): get_auth_request con 0x7f2520091690 auth_method 0 2026-02-12T18:05:57.339 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f251f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.339 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f251f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.339 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f251f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.339 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f251ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:57.340 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f251ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:57.340 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f251ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:57.340 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f2524dd1640 10 monclient(hunting): handle_auth_done global_id 4109 payload 824 2026-02-12T18:05:57.340 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f2524dd1640 1 -- 10.20.193.111:0/3022140421 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f252005c950 msgr2=0x7f2520117cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:57.340 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f2524dd1640 1 --2- 10.20.193.111:0/3022140421 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f252005c950 0x7f2520117cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.340 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f2524dd1640 1 -- 10.20.193.111:0/3022140421 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2520091690 msgr2=0x7f2520118230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:57.340 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f2524dd1640 1 --2- 10.20.193.111:0/3022140421 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2520091690 0x7f2520118230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.340 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f2524dd1640 10 monclient: _finish_hunting 0 2026-02-12T18:05:57.340 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f2524dd1640 1 monclient: found mon.noname-h 2026-02-12T18:05:57.340 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f2524dd1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:05:57.340 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f2524dd1640 10 monclient: _send_mon_message to mon.noname-h at v2:10.20.193.111:3302/0 2026-02-12T18:05:57.340 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.320+0000 7f2524dd1640 1 -- 10.20.193.111:0/3022140421 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f250c009420 con 0x7f2520144b70 2026-02-12T18:05:57.340 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.322+0000 7f2524dd1640 1 -- 10.20.193.111:0/3022140421 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f2520144b70 msgr2=0x7f252012c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:05:57.341 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.322+0000 7f2524dd1640 1 --2- 10.20.193.111:0/3022140421 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f2520144b70 0x7f252012c410 secure :-1 s=READY pgs=25 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f251400a2a0 tx=0x7f251400fbb0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:05:57.341 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.322+0000 7f251cff9640 1 -- 10.20.193.111:0/3022140421 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f251400db90 con 0x7f2520144b70 2026-02-12T18:05:57.341 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.322+0000 7f251cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:57.341 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.322+0000 7f251cff9640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2026-02-12T18:05:57.341 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.322+0000 7f251cff9640 10 monclient: dump: 2026-02-12T18:05:57.341 INFO:teuthology.orchestra.run.trial111.stderr:epoch 1 2026-02-12T18:05:57.341 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:57.341 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.341 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.341 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:57.341 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.341 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:57.341 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:57.342 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:57.342 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:57.342 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:57.342 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:57.342 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:57.342 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:57.342 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:57.342 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.342 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.322+0000 7f251cff9640 10 monclient: _finish_auth 0 2026-02-12T18:05:57.342 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.322+0000 7f251cff9640 10 monclient: _check_auth_tickets 2026-02-12T18:05:57.342 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.322+0000 7f251cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:05:57.342 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.322+0000 7f251cff9640 1 -- 10.20.193.111:0/3022140421 <== mon.5 v2:10.20.193.111:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f251400dd30 con 0x7f2520144b70 2026-02-12T18:05:57.342 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.322+0000 7f252685b640 5 monclient: authenticate success, global_id 4109 2026-02-12T18:05:57.343 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.322+0000 7f252685b640 10 monclient: _renew_subs 2026-02-12T18:05:57.343 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.322+0000 7f252685b640 10 monclient: _send_mon_message to mon.h at v2:10.20.193.111:3302/0 2026-02-12T18:05:57.343 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.322+0000 7f252685b640 1 -- 10.20.193.111:0/3022140421 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f252008d0c0 con 0x7f2520144b70 2026-02-12T18:05:57.343 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.322+0000 7f251cff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:05:57.343 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.322+0000 7f251cff9640 1 -- 10.20.193.111:0/3022140421 <== mon.5 v2:10.20.193.111:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f251400dea0 con 0x7f2520144b70 2026-02-12T18:05:57.343 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.322+0000 7f251cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:57.343 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.322+0000 7f251e7fc640 4 set_mon_vals no callback set 2026-02-12T18:05:57.343 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.322+0000 7f251cff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:05:57.343 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.322+0000 7f251cff9640 10 monclient: dump: 2026-02-12T18:05:57.343 INFO:teuthology.orchestra.run.trial111.stderr:epoch 1 2026-02-12T18:05:57.343 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:57.343 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.344 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.344 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:57.344 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.344 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:57.344 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:57.344 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:57.344 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:57.344 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:57.344 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:57.344 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:57.344 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:57.344 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:57.345 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.345 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.322+0000 7f252685b640 10 monclient: _renew_subs 2026-02-12T18:05:57.345 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.322+0000 7f252685b640 10 monclient: _send_mon_message to mon.h at v2:10.20.193.111:3302/0 2026-02-12T18:05:57.345 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.322+0000 7f252685b640 1 -- 10.20.193.111:0/3022140421 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f252008ef00 con 0x7f2520144b70 2026-02-12T18:05:57.345 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.322+0000 7f251cff9640 1 -- 10.20.193.111:0/3022140421 <== mon.5 v2:10.20.193.111:3302/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f2514014410 con 0x7f2520144b70 2026-02-12T18:05:57.345 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.322+0000 7f251cff9640 1 -- 10.20.193.111:0/3022140421 <== mon.5 v2:10.20.193.111:3302/0 5 ==== osd_map(5..5 src has 1..5) ==== 1065+0+0 (secure 0 0 0) 0x7f2514025350 con 0x7f2520144b70 2026-02-12T18:05:57.345 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.323+0000 7f252685b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:57.345 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.323+0000 7f252685b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:57.345 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.323+0000 7f252685b640 10 monclient: _send_mon_message to mon.h at v2:10.20.193.111:3302/0 2026-02-12T18:05:57.345 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.323+0000 7f252685b640 1 -- 10.20.193.111:0/3022140421 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2520144f40 con 0x7f2520144b70 2026-02-12T18:05:57.345 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.324+0000 7f251cff9640 1 -- 10.20.193.111:0/3022140421 <== mon.5 v2:10.20.193.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f2514022060 con 0x7f2520144b70 2026-02-12T18:05:57.345 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.324+0000 7f251cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:57.345 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.324+0000 7f251cff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:05:57.358 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.358+0000 7f252685b640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "e64b1a76-9d2c-4c4a-bd2d-7b5b8c1df21e", "id": 3}] 2026-02-12T18:05:57.359 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.358+0000 7f252685b640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "e64b1a76-9d2c-4c4a-bd2d-7b5b8c1df21e", "id": 3}] 2026-02-12T18:05:57.359 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.358+0000 7f252685b640 10 monclient: _send_mon_message to mon.h at v2:10.20.193.111:3302/0 2026-02-12T18:05:57.359 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.358+0000 7f252685b640 1 -- 10.20.193.111:0/3022140421 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_command({"prefix": "osd new", "uuid": "e64b1a76-9d2c-4c4a-bd2d-7b5b8c1df21e", "id": 3} v 0) -- 0x7f2520055580 con 0x7f2520144b70 2026-02-12T18:05:57.389 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.389+0000 7f251cff9640 1 -- 10.20.193.111:0/3022140421 <== mon.5 v2:10.20.193.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e64b1a76-9d2c-4c4a-bd2d-7b5b8c1df21e", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f251402b0b0 con 0x7f2520144b70 2026-02-12T18:05:57.389 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.389+0000 7f251cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "e64b1a76-9d2c-4c4a-bd2d-7b5b8c1df21e", "id": 3}] 2026-02-12T18:05:57.389 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.389+0000 7f251cff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:05:57.390 INFO:teuthology.orchestra.run.trial111.stdout:3 2026-02-12T18:05:57.391 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.390+0000 7f252685b640 10 monclient: shutdown 2026-02-12T18:05:57.391 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.390+0000 7f252685b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:05:57.391 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.390+0000 7f252685b640 1 -- 10.20.193.111:0/3022140421 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f2520144b70 msgr2=0x7f252012c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:57.391 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.390+0000 7f252685b640 1 --2- 10.20.193.111:0/3022140421 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f2520144b70 0x7f252012c410 secure :-1 s=READY pgs=25 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f251400a2a0 tx=0x7f251400fbb0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.391 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.390+0000 7f252685b640 1 -- 10.20.193.111:0/3022140421 shutdown_connections 2026-02-12T18:05:57.391 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.390+0000 7f252685b640 1 --2- 10.20.193.111:0/3022140421 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f2520144b70 0x7f252012c410 unknown :-1 s=CLOSED pgs=25 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.391 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.390+0000 7f252685b640 1 --2- 10.20.193.111:0/3022140421 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2520091690 0x7f2520118230 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.391 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.390+0000 7f252685b640 1 --2- 10.20.193.111:0/3022140421 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f252005c950 0x7f2520117cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.391 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.390+0000 7f252685b640 1 -- 10.20.193.111:0/3022140421 >> 10.20.193.111:0/3022140421 conn(0x7f2520054ae0 msgr2=0x7f2520128ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:05:57.392 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.390+0000 7f252685b640 1 -- 10.20.193.111:0/3022140421 shutdown_connections 2026-02-12T18:05:57.392 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.390+0000 7f252685b640 1 -- 10.20.193.111:0/3022140421 wait complete. 2026-02-12T18:05:57.398 DEBUG:teuthology.orchestra.run.trial111:> sudo ceph --cluster ceph osd new ad82216b-0e68-44da-a293-d4c97dec6b79 4 2026-02-12T18:05:57.461 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.461+0000 7f0f27ccc640 10 monclient: get_monmap_and_config 2026-02-12T18:05:57.462 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.461+0000 7f0f27ccc640 10 monclient: build_initial_monmap 2026-02-12T18:05:57.462 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.461+0000 7f0f27ccc640 10 monclient: monmap: 2026-02-12T18:05:57.462 INFO:teuthology.orchestra.run.trial111.stderr:epoch 0 2026-02-12T18:05:57.462 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:57.462 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:57.462116+0000 2026-02-12T18:05:57.462 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:57.462116+0000 2026-02-12T18:05:57.462 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 0 (unknown) 2026-02-12T18:05:57.462 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.462 INFO:teuthology.orchestra.run.trial111.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:05:57.462 INFO:teuthology.orchestra.run.trial111.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:05:57.463 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:05:57.463 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:05:57.463 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:05:57.463 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:05:57.463 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:05:57.463 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:05:57.463 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:05:57.463 INFO:teuthology.orchestra.run.trial111.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:05:57.463 INFO:teuthology.orchestra.run.trial111.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:05:57.463 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.471 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.461+0000 7f0f27ccc640 1 Processor -- start 2026-02-12T18:05:57.471 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.461+0000 7f0f27ccc640 1 -- start start 2026-02-12T18:05:57.472 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.461+0000 7f0f27ccc640 10 monclient: init 2026-02-12T18:05:57.472 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f27ccc640 10 monclient: _reopen_session rank -1 2026-02-12T18:05:57.472 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f27ccc640 10 monclient: _add_conns ranks=[9,7,6,4,10,3,5,0,2,8,1] 2026-02-12T18:05:57.472 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f27ccc640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f0f200914d0 0x7f0f2005c950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.472 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f27ccc640 10 monclient(hunting): picked mon.noname-a con 0x7f0f200914d0 addr v2:10.20.193.48:3300/0 2026-02-12T18:05:57.472 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f27ccc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0f2008e210 0x7f0f2005ce90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.472 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f27ccc640 10 monclient(hunting): picked mon.noname-i con 0x7f0f2008e210 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:05:57.472 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f27ccc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f0f2005e4b0 0x7f0f2005d3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.472 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f27ccc640 10 monclient(hunting): picked mon.noname-d con 0x7f0f2005e4b0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:05:57.472 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f27ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.472 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f27ccc640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f0f20093d70 con 0x7f0f200914d0 2026-02-12T18:05:57.473 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f27ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.473 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f27ccc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f0f20092f90 con 0x7f0f2005e4b0 2026-02-12T18:05:57.473 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f27ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.473 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f27ccc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f0f200918a0 con 0x7f0f2008e210 2026-02-12T18:05:57.473 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f27ccc640 10 monclient(hunting): _renew_subs 2026-02-12T18:05:57.473 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f27ccc640 10 monclient(hunting): authenticate will time out at 555.150423s 2026-02-12T18:05:57.473 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f25240640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0f2008e210 0x7f0f2005ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.473 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f25240640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0f2008e210 0x7f0f2005ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3303/0 says I am v2:10.20.193.111:45986/0 (socket says 10.20.193.111:45986) 2026-02-12T18:05:57.473 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f25240640 1 -- 10.20.193.111:0/2340232907 learned_addr learned my addr 10.20.193.111:0/2340232907 (peer_addr_for_me v2:10.20.193.111:0/0) 2026-02-12T18:05:57.473 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f25240640 10 monclient(hunting): get_auth_request con 0x7f0f2008e210 auth_method 0 2026-02-12T18:05:57.473 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f25240640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.473 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f25240640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.474 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f25240640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.474 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f26242640 1 --2- 10.20.193.111:0/2340232907 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f0f2005e4b0 0x7f0f2005d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.474 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f26242640 10 monclient(hunting): get_auth_request con 0x7f0f2005e4b0 auth_method 0 2026-02-12T18:05:57.474 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f26242640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.474 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f26242640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.474 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f26242640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.474 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f25a41640 1 --2- 10.20.193.111:0/2340232907 >> v2:10.20.193.48:3300/0 conn(0x7f0f200914d0 0x7f0f2005c950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.474 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f25a41640 10 monclient(hunting): get_auth_request con 0x7f0f200914d0 auth_method 0 2026-02-12T18:05:57.474 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f25a41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.474 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f25a41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.474 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f25a41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.474 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f25240640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:57.475 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f25240640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:57.475 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f25240640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:57.475 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f25240640 10 monclient(hunting): handle_auth_done global_id 4156 payload 274 2026-02-12T18:05:57.475 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f25240640 1 -- 10.20.193.111:0/2340232907 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f0f2005e4b0 msgr2=0x7f0f2005d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:05:57.475 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f25240640 1 --2- 10.20.193.111:0/2340232907 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f0f2005e4b0 0x7f0f2005d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.475 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f25240640 1 -- 10.20.193.111:0/2340232907 >> v2:10.20.193.48:3300/0 conn(0x7f0f200914d0 msgr2=0x7f0f2005c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:05:57.475 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f25240640 1 --2- 10.20.193.111:0/2340232907 >> v2:10.20.193.48:3300/0 conn(0x7f0f200914d0 0x7f0f2005c950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.475 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f25240640 10 monclient: _finish_hunting 0 2026-02-12T18:05:57.475 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f25240640 1 monclient: found mon.noname-i 2026-02-12T18:05:57.475 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f25240640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:05:57.475 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f25240640 10 monclient: _send_mon_message to mon.noname-i at v2:10.20.193.111:3303/0 2026-02-12T18:05:57.475 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.462+0000 7f0f25240640 1 -- 10.20.193.111:0/2340232907 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f2004dc20 con 0x7f0f2008e210 2026-02-12T18:05:57.475 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.465+0000 7f0f25240640 1 -- 10.20.193.111:0/2340232907 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0f2008e210 msgr2=0x7f0f2005ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:05:57.476 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.465+0000 7f0f25240640 1 --2- 10.20.193.111:0/2340232907 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0f2008e210 0x7f0f2005ce90 secure :-1 s=READY pgs=31 gs=1 cs=0 l=1 c_cookie=12618391209700582926 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f14009060 tx=0x7f0f1402edf0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=af1d87f33b1d660e server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:05:57.476 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.465+0000 7f0f24a3f640 1 -- 10.20.193.111:0/2340232907 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f0f14035340 con 0x7f0f2008e210 2026-02-12T18:05:57.476 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.465+0000 7f0f24a3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:57.476 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.465+0000 7f0f24a3f640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2026-02-12T18:05:57.476 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.465+0000 7f0f24a3f640 10 monclient: dump: 2026-02-12T18:05:57.476 INFO:teuthology.orchestra.run.trial111.stderr:epoch 1 2026-02-12T18:05:57.476 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:57.476 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.476 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.476 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:57.476 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.476 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:57.477 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:57.477 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:57.477 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:57.477 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:57.477 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:57.477 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:57.477 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:57.477 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:57.477 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.477 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.465+0000 7f0f24a3f640 10 monclient: _finish_auth 0 2026-02-12T18:05:57.477 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.465+0000 7f0f24a3f640 10 monclient: _check_auth_tickets 2026-02-12T18:05:57.477 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.465+0000 7f0f24a3f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:05:57.477 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.465+0000 7f0f24a3f640 1 -- 10.20.193.111:0/2340232907 <== mon.7 v2:10.20.193.111:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f140354c0 con 0x7f0f2008e210 2026-02-12T18:05:57.478 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.465+0000 7f0f24a3f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:05:57.478 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.465+0000 7f0f27ccc640 5 monclient: authenticate success, global_id 4156 2026-02-12T18:05:57.478 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.465+0000 7f0f24a3f640 1 -- 10.20.193.111:0/2340232907 <== mon.7 v2:10.20.193.111:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f0f14035af0 con 0x7f0f2008e210 2026-02-12T18:05:57.478 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.465+0000 7f0f27ccc640 10 monclient: get_monmap_and_config success 2026-02-12T18:05:57.478 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.465+0000 7f0f24a3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:57.478 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.465+0000 7f0f27ccc640 4 set_mon_vals no callback set 2026-02-12T18:05:57.478 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.465+0000 7f0f24a3f640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:05:57.478 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.465+0000 7f0f24a3f640 10 monclient: dump: 2026-02-12T18:05:57.478 INFO:teuthology.orchestra.run.trial111.stderr:epoch 1 2026-02-12T18:05:57.478 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:57.478 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.478 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.479 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:57.479 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.479 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:57.479 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:57.479 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:57.479 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:57.479 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:57.479 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:57.479 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:57.479 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:57.479 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:57.479 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.479 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.466+0000 7f0f27ccc640 10 monclient: shutdown 2026-02-12T18:05:57.480 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.466+0000 7f0f27ccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:05:57.480 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.466+0000 7f0f27ccc640 1 -- 10.20.193.111:0/2340232907 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0f2008e210 msgr2=0x7f0f2005ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:57.480 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.466+0000 7f0f27ccc640 1 --2- 10.20.193.111:0/2340232907 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0f2008e210 0x7f0f2005ce90 secure :-1 s=READY pgs=31 gs=1 cs=0 l=1 c_cookie=12618391209700582926 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f14009060 tx=0x7f0f1402edf0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.480 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.466+0000 7f0f27ccc640 1 -- 10.20.193.111:0/2340232907 shutdown_connections 2026-02-12T18:05:57.480 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.466+0000 7f0f27ccc640 1 --2- 10.20.193.111:0/2340232907 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f0f2005e4b0 0x7f0f2005d3d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.480 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.466+0000 7f0f27ccc640 1 --2- 10.20.193.111:0/2340232907 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0f2008e210 0x7f0f2005ce90 unknown :-1 s=CLOSED pgs=31 gs=1 cs=0 l=1 c_cookie=12618391209700582926 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.480 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.466+0000 7f0f27ccc640 1 --2- 10.20.193.111:0/2340232907 >> v2:10.20.193.48:3300/0 conn(0x7f0f200914d0 0x7f0f2005c950 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.480 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.466+0000 7f0f27ccc640 1 -- 10.20.193.111:0/2340232907 >> 10.20.193.111:0/2340232907 conn(0x7f0f200548a0 msgr2=0x7f0f20097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:05:57.480 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.466+0000 7f0f27ccc640 1 -- 10.20.193.111:0/2340232907 shutdown_connections 2026-02-12T18:05:57.480 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.466+0000 7f0f27ccc640 1 -- 10.20.193.111:0/2340232907 wait complete. 2026-02-12T18:05:57.480 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.466+0000 7f0f27ccc640 10 monclient: build_initial_monmap 2026-02-12T18:05:57.480 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.466+0000 7f0f27ccc640 10 monclient: monmap: 2026-02-12T18:05:57.481 INFO:teuthology.orchestra.run.trial111.stderr:epoch 0 2026-02-12T18:05:57.481 INFO:teuthology.orchestra.run.trial111.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:05:57.481 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 0.000000 2026-02-12T18:05:57.481 INFO:teuthology.orchestra.run.trial111.stderr:created 0.000000 2026-02-12T18:05:57.481 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 0 (unknown) 2026-02-12T18:05:57.481 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.481 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:05:57.481 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:05:57.481 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:05:57.481 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:05:57.481 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:05:57.481 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:05:57.481 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:05:57.482 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:05:57.482 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:05:57.482 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.482 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.466+0000 7f0f27ccc640 1 Processor -- start 2026-02-12T18:05:57.482 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.466+0000 7f0f27ccc640 1 -- start start 2026-02-12T18:05:57.482 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.466+0000 7f0f27ccc640 10 monclient: init 2026-02-12T18:05:57.482 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f27ccc640 10 monclient: _reopen_session rank -1 2026-02-12T18:05:57.482 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f27ccc640 10 monclient: _add_conns ranks=[6,8,0,5,2,4,3,1,7] 2026-02-12T18:05:57.482 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f27ccc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f0f2005e4b0 0x7f0f201daf20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.482 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f27ccc640 10 monclient(hunting): picked mon.noname-d con 0x7f0f2005e4b0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:05:57.482 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f27ccc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f0f2008e210 0x7f0f201b0bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.482 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f27ccc640 10 monclient(hunting): picked mon.noname-e con 0x7f0f2008e210 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:05:57.483 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f27ccc640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f0f200914d0 0x7f0f201b10f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.483 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f27ccc640 10 monclient(hunting): picked mon.noname-a con 0x7f0f200914d0 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:05:57.483 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f27ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.483 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f27ccc640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2008cff0 con 0x7f0f200914d0 2026-02-12T18:05:57.483 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f27ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.483 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f27ccc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f0f2019c650 con 0x7f0f2005e4b0 2026-02-12T18:05:57.483 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f27ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.483 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f27ccc640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f0f2008fec0 con 0x7f0f2008e210 2026-02-12T18:05:57.483 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f27ccc640 10 monclient(hunting): _renew_subs 2026-02-12T18:05:57.483 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f27ccc640 10 monclient(hunting): authenticate will time out at 555.155209s 2026-02-12T18:05:57.483 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25240640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f0f2008e210 0x7f0f201b0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.483 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f26242640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f0f200914d0 0x7f0f201b10f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.484 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25a41640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f0f2005e4b0 0x7f0f201daf20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.484 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25240640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f0f2008e210 0x7f0f201b0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.111:60722/0 (socket says 10.20.193.111:60722) 2026-02-12T18:05:57.484 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f26242640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f0f200914d0 0x7f0f201b10f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.111:57362/0 (socket says 10.20.193.111:57362) 2026-02-12T18:05:57.484 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25240640 1 -- 10.20.193.111:0/1217272145 learned_addr learned my addr 10.20.193.111:0/1217272145 (peer_addr_for_me v2:10.20.193.111:0/0) 2026-02-12T18:05:57.484 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25a41640 10 monclient(hunting): get_auth_request con 0x7f0f2005e4b0 auth_method 0 2026-02-12T18:05:57.484 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25a41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.484 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25a41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.484 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25a41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.484 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25240640 10 monclient(hunting): get_auth_request con 0x7f0f2008e210 auth_method 0 2026-02-12T18:05:57.484 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25240640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.484 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25240640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.484 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25240640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.485 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f26242640 10 monclient(hunting): get_auth_request con 0x7f0f200914d0 auth_method 0 2026-02-12T18:05:57.485 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f26242640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.485 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f26242640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.485 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f26242640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.485 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25240640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:57.485 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25240640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:57.485 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25240640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:57.485 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f26242640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:57.485 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f26242640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:57.485 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f26242640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:57.485 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25a41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:57.485 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25a41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:57.485 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25a41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:57.485 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25240640 10 monclient(hunting): handle_auth_done global_id 4139 payload 824 2026-02-12T18:05:57.486 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25240640 1 -- 10.20.193.111:0/1217272145 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f0f2005e4b0 msgr2=0x7f0f201daf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:57.486 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25240640 1 --2- 10.20.193.111:0/1217272145 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f0f2005e4b0 0x7f0f201daf20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.486 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25240640 1 -- 10.20.193.111:0/1217272145 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f0f200914d0 msgr2=0x7f0f201b10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:57.486 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25240640 1 --2- 10.20.193.111:0/1217272145 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f0f200914d0 0x7f0f201b10f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.486 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25240640 10 monclient: _finish_hunting 0 2026-02-12T18:05:57.486 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25240640 1 monclient: found mon.noname-e 2026-02-12T18:05:57.486 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25240640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:05:57.486 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25240640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:05:57.486 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f25240640 1 -- 10.20.193.111:0/1217272145 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f140094f0 con 0x7f0f2008e210 2026-02-12T18:05:57.486 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.467+0000 7f0f26242640 1 --2- 10.20.193.111:0/1217272145 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f0f200914d0 0x7f0f201b10f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:05:57.486 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f25240640 1 -- 10.20.193.111:0/1217272145 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f0f2008e210 msgr2=0x7f0f201b0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:05:57.486 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f25240640 1 --2- 10.20.193.111:0/1217272145 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f0f2008e210 0x7f0f201b0bb0 secure :-1 s=READY pgs=26 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f14004740 tx=0x7f0f140047e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:05:57.487 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f0e7fc640 1 -- 10.20.193.111:0/1217272145 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f0f140044f0 con 0x7f0f2008e210 2026-02-12T18:05:57.487 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f0e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:57.487 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f0e7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:05:57.487 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f0e7fc640 10 monclient: dump: 2026-02-12T18:05:57.487 INFO:teuthology.orchestra.run.trial111.stderr:epoch 1 2026-02-12T18:05:57.487 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:57.487 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.487 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.487 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:57.487 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.487 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:57.487 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:57.487 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:57.488 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:57.488 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:57.488 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:57.488 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:57.488 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:57.488 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:57.488 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.488 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f0e7fc640 10 monclient: _finish_auth 0 2026-02-12T18:05:57.488 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f0e7fc640 10 monclient: _check_auth_tickets 2026-02-12T18:05:57.488 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f0e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:05:57.488 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f0e7fc640 1 -- 10.20.193.111:0/1217272145 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f14035d80 con 0x7f0f2008e210 2026-02-12T18:05:57.488 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f0e7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:05:57.488 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f0e7fc640 1 -- 10.20.193.111:0/1217272145 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f0f14003b90 con 0x7f0f2008e210 2026-02-12T18:05:57.489 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f0e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:57.489 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f0ffff640 4 set_mon_vals no callback set 2026-02-12T18:05:57.489 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f0e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:05:57.489 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f0e7fc640 10 monclient: dump: 2026-02-12T18:05:57.489 INFO:teuthology.orchestra.run.trial111.stderr:epoch 1 2026-02-12T18:05:57.489 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:57.489 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.489 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.489 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:57.489 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.489 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:57.489 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:57.489 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:57.490 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:57.490 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:57.490 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:57.490 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:57.490 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:57.490 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:57.490 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.490 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f27ccc640 5 monclient: authenticate success, global_id 4139 2026-02-12T18:05:57.490 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f27ccc640 10 monclient: _renew_subs 2026-02-12T18:05:57.490 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f27ccc640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:05:57.490 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f27ccc640 1 -- 10.20.193.111:0/1217272145 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f2019b4c0 con 0x7f0f2008e210 2026-02-12T18:05:57.490 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f27ccc640 10 monclient: _renew_subs 2026-02-12T18:05:57.491 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f27ccc640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:05:57.491 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f27ccc640 1 -- 10.20.193.111:0/1217272145 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f2019c370 con 0x7f0f2008e210 2026-02-12T18:05:57.491 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f0e7fc640 1 -- 10.20.193.111:0/1217272145 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f0f1404a070 con 0x7f0f2008e210 2026-02-12T18:05:57.491 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f0e7fc640 1 -- 10.20.193.111:0/1217272145 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(6..6 src has 1..6) ==== 1180+0+0 (secure 0 0 0) 0x7f0f14037440 con 0x7f0f2008e210 2026-02-12T18:05:57.491 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f27ccc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:57.491 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f27ccc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:57.491 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f27ccc640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:05:57.491 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.470+0000 7f0f27ccc640 1 -- 10.20.193.111:0/1217272145 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f2005c950 con 0x7f0f2008e210 2026-02-12T18:05:57.492 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.472+0000 7f0f0e7fc640 1 -- 10.20.193.111:0/1217272145 <== mon.8 v2:10.20.193.48:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f0f1403c070 con 0x7f0f2008e210 2026-02-12T18:05:57.492 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.472+0000 7f0f0e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:57.492 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.472+0000 7f0f0e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:05:57.505 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.505+0000 7f0f27ccc640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "ad82216b-0e68-44da-a293-d4c97dec6b79", "id": 4}] 2026-02-12T18:05:57.505 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.505+0000 7f0f27ccc640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "ad82216b-0e68-44da-a293-d4c97dec6b79", "id": 4}] 2026-02-12T18:05:57.505 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.505+0000 7f0f27ccc640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:05:57.505 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.505+0000 7f0f27ccc640 1 -- 10.20.193.111:0/1217272145 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_command({"prefix": "osd new", "uuid": "ad82216b-0e68-44da-a293-d4c97dec6b79", "id": 4} v 0) -- 0x7f0f200636e0 con 0x7f0f2008e210 2026-02-12T18:05:57.868 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.867+0000 7f0f0e7fc640 1 -- 10.20.193.111:0/1217272145 <== mon.8 v2:10.20.193.48:3304/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ad82216b-0e68-44da-a293-d4c97dec6b79", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f0f14043450 con 0x7f0f2008e210 2026-02-12T18:05:57.868 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.867+0000 7f0f0e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "ad82216b-0e68-44da-a293-d4c97dec6b79", "id": 4}] 2026-02-12T18:05:57.868 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.867+0000 7f0f0e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:05:57.868 INFO:teuthology.orchestra.run.trial111.stdout:4 2026-02-12T18:05:57.869 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.868+0000 7f0f27ccc640 10 monclient: shutdown 2026-02-12T18:05:57.869 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.868+0000 7f0f27ccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:05:57.870 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.868+0000 7f0f27ccc640 1 -- 10.20.193.111:0/1217272145 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f0f2008e210 msgr2=0x7f0f201b0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:57.870 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.868+0000 7f0f27ccc640 1 --2- 10.20.193.111:0/1217272145 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f0f2008e210 0x7f0f201b0bb0 secure :-1 s=READY pgs=26 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0f14004740 tx=0x7f0f140047e0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.870 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.868+0000 7f0f27ccc640 1 -- 10.20.193.111:0/1217272145 shutdown_connections 2026-02-12T18:05:57.870 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.868+0000 7f0f27ccc640 1 --2- 10.20.193.111:0/1217272145 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f0f200914d0 0x7f0f201b10f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.870 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.868+0000 7f0f27ccc640 1 --2- 10.20.193.111:0/1217272145 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f0f2008e210 0x7f0f201b0bb0 unknown :-1 s=CLOSED pgs=26 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.870 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.868+0000 7f0f27ccc640 1 --2- 10.20.193.111:0/1217272145 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f0f2005e4b0 0x7f0f201daf20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.870 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.868+0000 7f0f27ccc640 1 -- 10.20.193.111:0/1217272145 >> 10.20.193.111:0/1217272145 conn(0x7f0f200548a0 msgr2=0x7f0f2008f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:05:57.870 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.868+0000 7f0f27ccc640 1 -- 10.20.193.111:0/1217272145 shutdown_connections 2026-02-12T18:05:57.870 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.868+0000 7f0f27ccc640 1 -- 10.20.193.111:0/1217272145 wait complete. 2026-02-12T18:05:57.876 DEBUG:teuthology.orchestra.run.trial111:> sudo ceph --cluster ceph osd new accc3f03-6123-444b-8c5a-42e927b0ed23 5 2026-02-12T18:05:57.937 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.937+0000 7f61d685b640 10 monclient: get_monmap_and_config 2026-02-12T18:05:57.937 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.937+0000 7f61d685b640 10 monclient: build_initial_monmap 2026-02-12T18:05:57.938 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.937+0000 7f61d685b640 10 monclient: monmap: 2026-02-12T18:05:57.938 INFO:teuthology.orchestra.run.trial111.stderr:epoch 0 2026-02-12T18:05:57.938 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:57.938 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:57.937839+0000 2026-02-12T18:05:57.938 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:57.937839+0000 2026-02-12T18:05:57.938 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 0 (unknown) 2026-02-12T18:05:57.938 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.938 INFO:teuthology.orchestra.run.trial111.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:05:57.938 INFO:teuthology.orchestra.run.trial111.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:05:57.938 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:05:57.938 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:05:57.939 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:05:57.939 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:05:57.939 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:05:57.939 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:05:57.939 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:05:57.939 INFO:teuthology.orchestra.run.trial111.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:05:57.939 INFO:teuthology.orchestra.run.trial111.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:05:57.939 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.949 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.937+0000 7f61d685b640 1 Processor -- start 2026-02-12T18:05:57.949 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.937+0000 7f61d685b640 1 -- start start 2026-02-12T18:05:57.949 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.937+0000 7f61d685b640 10 monclient: init 2026-02-12T18:05:57.949 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d685b640 10 monclient: _reopen_session rank -1 2026-02-12T18:05:57.949 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d685b640 10 monclient: _add_conns ranks=[2,4,9,3,7,5,8,6,1,10,0] 2026-02-12T18:05:57.949 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d685b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f61d008fc50 0x7f61d0090020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.949 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d685b640 10 monclient(hunting): picked mon.noname-b con 0x7f61d008fc50 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:05:57.950 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d685b640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f61d0090560 0x7f61d0090930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.950 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d685b640 10 monclient(hunting): picked mon.noname-c con 0x7f61d0090560 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:05:57.950 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d685b640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f61d0182990 0x7f61d01a2d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.950 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d685b640 10 monclient(hunting): picked mon.noname-a con 0x7f61d0182990 addr v2:10.20.193.48:3300/0 2026-02-12T18:05:57.950 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d685b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.950 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d685b640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f61d008a180 con 0x7f61d0182990 2026-02-12T18:05:57.950 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d685b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.950 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d685b640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f61d008a350 con 0x7f61d008fc50 2026-02-12T18:05:57.950 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d685b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.950 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d685b640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f61d008c250 con 0x7f61d0090560 2026-02-12T18:05:57.950 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d685b640 10 monclient(hunting): _renew_subs 2026-02-12T18:05:57.950 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d685b640 10 monclient(hunting): authenticate will time out at 555.626107s 2026-02-12T18:05:57.951 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61cffff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f61d008fc50 0x7f61d0090020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.951 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d4dd1640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f61d0182990 0x7f61d01a2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.951 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61cffff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f61d008fc50 0x7f61d0090020 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.111:59864/0 (socket says 10.20.193.111:59864) 2026-02-12T18:05:57.951 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61cffff640 1 -- 10.20.193.111:0/4275603003 learned_addr learned my addr 10.20.193.111:0/4275603003 (peer_addr_for_me v2:10.20.193.111:0/0) 2026-02-12T18:05:57.951 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61cffff640 10 monclient(hunting): get_auth_request con 0x7f61d008fc50 auth_method 0 2026-02-12T18:05:57.951 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.951 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61cffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.951 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61cffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.951 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61cf7fe640 1 --2- 10.20.193.111:0/4275603003 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f61d0090560 0x7f61d0090930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.951 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d4dd1640 10 monclient(hunting): get_auth_request con 0x7f61d0182990 auth_method 0 2026-02-12T18:05:57.951 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d4dd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.952 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d4dd1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.952 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d4dd1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.952 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61cf7fe640 10 monclient(hunting): get_auth_request con 0x7f61d0090560 auth_method 0 2026-02-12T18:05:57.952 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.952 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.952 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.952 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61cffff640 1 -- 10.20.193.111:0/4275603003 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f61d008fc50 msgr2=0x7f61d0090020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:05:57.952 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61cffff640 1 -- 10.20.193.111:0/4275603003 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f61d008fc50 msgr2=0x7f61d0090020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:57.952 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61cffff640 1 --2- 10.20.193.111:0/4275603003 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f61d008fc50 0x7f61d0090020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:57.952 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61cffff640 1 --2- 10.20.193.111:0/4275603003 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f61d008fc50 0x7f61d0090020 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:05:57.952 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d4dd1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:57.952 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d4dd1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:57.953 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d4dd1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:57.953 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61cf7fe640 1 -- 10.20.193.111:0/4275603003 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f61d0090560 msgr2=0x7f61d0090930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:05:57.953 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61cf7fe640 1 -- 10.20.193.111:0/4275603003 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f61d0090560 msgr2=0x7f61d0090930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:57.953 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61cf7fe640 1 --2- 10.20.193.111:0/4275603003 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f61d0090560 0x7f61d0090930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:57.953 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61cf7fe640 1 --2- 10.20.193.111:0/4275603003 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f61d0090560 0x7f61d0090930 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:05:57.953 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d4dd1640 10 monclient(hunting): handle_auth_done global_id 4167 payload 274 2026-02-12T18:05:57.953 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d4dd1640 1 -- 10.20.193.111:0/4275603003 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f61d0090560 msgr2=0x7f61d0090930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:05:57.953 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d4dd1640 1 --2- 10.20.193.111:0/4275603003 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f61d0090560 0x7f61d0090930 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.953 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d4dd1640 1 -- 10.20.193.111:0/4275603003 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f61d008fc50 msgr2=0x7f61d0090020 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:05:57.953 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d4dd1640 1 --2- 10.20.193.111:0/4275603003 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f61d008fc50 0x7f61d0090020 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.953 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d4dd1640 10 monclient: _finish_hunting 0 2026-02-12T18:05:57.953 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d4dd1640 1 monclient: found mon.noname-a 2026-02-12T18:05:57.954 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d4dd1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:05:57.954 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d4dd1640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:05:57.954 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.938+0000 7f61d4dd1640 1 -- 10.20.193.111:0/4275603003 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d004dc20 con 0x7f61d0182990 2026-02-12T18:05:57.954 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61d4dd1640 1 -- 10.20.193.111:0/4275603003 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f61d0182990 msgr2=0x7f61d01a2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:05:57.954 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61d4dd1640 1 --2- 10.20.193.111:0/4275603003 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f61d0182990 0x7f61d01a2d70 secure :-1 s=READY pgs=39 gs=2 cs=0 l=1 c_cookie=4202070512824376047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61c4005820 tx=0x7f61c402fe80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a50c0de2e0a5aef server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:05:57.954 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61ceffd640 1 -- 10.20.193.111:0/4275603003 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f61c4036340 con 0x7f61d0182990 2026-02-12T18:05:57.954 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61ceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:57.954 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61ceffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:05:57.954 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61ceffd640 10 monclient: dump: 2026-02-12T18:05:57.954 INFO:teuthology.orchestra.run.trial111.stderr:epoch 1 2026-02-12T18:05:57.954 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:57.954 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.955 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.955 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:57.955 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.955 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:57.955 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:57.955 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:57.955 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:57.955 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:57.955 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:57.955 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:57.955 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:57.955 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:57.955 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.956 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61ceffd640 10 monclient: _finish_auth 0 2026-02-12T18:05:57.956 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61ceffd640 10 monclient: _check_auth_tickets 2026-02-12T18:05:57.956 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61ceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:05:57.956 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61ceffd640 1 -- 10.20.193.111:0/4275603003 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c40364c0 con 0x7f61d0182990 2026-02-12T18:05:57.956 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61d685b640 5 monclient: authenticate success, global_id 4167 2026-02-12T18:05:57.956 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61d685b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:05:57.956 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61ceffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:05:57.956 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61ceffd640 1 -- 10.20.193.111:0/4275603003 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f61c4036af0 con 0x7f61d0182990 2026-02-12T18:05:57.956 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61d685b640 10 monclient: get_monmap_and_config success 2026-02-12T18:05:57.956 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61d685b640 4 set_mon_vals no callback set 2026-02-12T18:05:57.956 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61ceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:57.956 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61ceffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:05:57.957 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61ceffd640 10 monclient: dump: 2026-02-12T18:05:57.957 INFO:teuthology.orchestra.run.trial111.stderr:epoch 1 2026-02-12T18:05:57.957 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:57.957 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.957 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.957 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:57.957 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.957 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:57.957 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:57.957 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:57.957 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:57.957 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:57.958 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:57.958 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:57.958 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:57.958 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:57.958 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.958 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61d685b640 10 monclient: shutdown 2026-02-12T18:05:57.958 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61d685b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:05:57.958 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61d685b640 1 -- 10.20.193.111:0/4275603003 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f61d0182990 msgr2=0x7f61d01a2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:57.958 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61d685b640 1 --2- 10.20.193.111:0/4275603003 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f61d0182990 0x7f61d01a2d70 secure :-1 s=READY pgs=39 gs=2 cs=0 l=1 c_cookie=4202070512824376047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61c4005820 tx=0x7f61c402fe80 comp rx=0 tx=0).stop 2026-02-12T18:05:57.958 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61d685b640 1 -- 10.20.193.111:0/4275603003 shutdown_connections 2026-02-12T18:05:57.958 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61d685b640 1 --2- 10.20.193.111:0/4275603003 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f61d0182990 0x7f61d01a2d70 unknown :-1 s=CLOSED pgs=39 gs=2 cs=0 l=1 c_cookie=4202070512824376047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.958 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61d685b640 1 --2- 10.20.193.111:0/4275603003 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f61d0090560 0x7f61d0090930 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.959 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61d685b640 1 --2- 10.20.193.111:0/4275603003 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f61d008fc50 0x7f61d0090020 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.959 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61d685b640 1 -- 10.20.193.111:0/4275603003 >> 10.20.193.111:0/4275603003 conn(0x7f61d00951a0 msgr2=0x7f61d00955a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:05:57.959 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.941+0000 7f61d685b640 1 -- 10.20.193.111:0/4275603003 shutdown_connections 2026-02-12T18:05:57.959 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.942+0000 7f61d685b640 1 -- 10.20.193.111:0/4275603003 wait complete. 2026-02-12T18:05:57.959 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.942+0000 7f61d685b640 10 monclient: build_initial_monmap 2026-02-12T18:05:57.959 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.942+0000 7f61d685b640 10 monclient: monmap: 2026-02-12T18:05:57.959 INFO:teuthology.orchestra.run.trial111.stderr:epoch 0 2026-02-12T18:05:57.959 INFO:teuthology.orchestra.run.trial111.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:05:57.959 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 0.000000 2026-02-12T18:05:57.959 INFO:teuthology.orchestra.run.trial111.stderr:created 0.000000 2026-02-12T18:05:57.959 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 0 (unknown) 2026-02-12T18:05:57.959 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.959 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:05:57.960 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:05:57.960 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:05:57.960 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:05:57.960 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:05:57.960 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:05:57.960 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:05:57.960 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:05:57.960 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:05:57.960 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.960 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.942+0000 7f61d685b640 1 Processor -- start 2026-02-12T18:05:57.960 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.942+0000 7f61d685b640 1 -- start start 2026-02-12T18:05:57.960 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.942+0000 7f61d685b640 10 monclient: init 2026-02-12T18:05:57.961 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61d685b640 10 monclient: _reopen_session rank -1 2026-02-12T18:05:57.961 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61d685b640 10 monclient: _add_conns ranks=[0,7,8,1,4,5,3,6,2] 2026-02-12T18:05:57.961 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61d685b640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f61d008fc50 0x7f61d0152110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.961 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61d685b640 10 monclient(hunting): picked mon.noname-a con 0x7f61d008fc50 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:05:57.961 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61d685b640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f61d0090560 0x7f61d0127e40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.961 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61d685b640 10 monclient(hunting): picked mon.noname-i con 0x7f61d0090560 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:05:57.961 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61d685b640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f61d0182990 0x7f61d010fb60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:57.961 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61d685b640 10 monclient(hunting): picked mon.noname-e con 0x7f61d0182990 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:05:57.961 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61d685b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.961 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61d685b640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f61d0111480 con 0x7f61d008fc50 2026-02-12T18:05:57.961 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61d685b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.961 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61d685b640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f61d008dd30 con 0x7f61d0090560 2026-02-12T18:05:57.962 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61d685b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:57.962 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61d685b640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f61d0112d40 con 0x7f61d0182990 2026-02-12T18:05:57.962 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61d685b640 10 monclient(hunting): _renew_subs 2026-02-12T18:05:57.962 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61d685b640 10 monclient(hunting): authenticate will time out at 555.631149s 2026-02-12T18:05:57.962 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cf7fe640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f61d0090560 0x7f61d0127e40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.962 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cf7fe640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f61d0090560 0x7f61d0127e40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3303/0 says I am v2:10.20.193.111:45996/0 (socket says 10.20.193.111:45996) 2026-02-12T18:05:57.962 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cf7fe640 1 -- 10.20.193.111:0/699621799 learned_addr learned my addr 10.20.193.111:0/699621799 (peer_addr_for_me v2:10.20.193.111:0/0) 2026-02-12T18:05:57.962 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cf7fe640 10 monclient(hunting): get_auth_request con 0x7f61d0090560 auth_method 0 2026-02-12T18:05:57.962 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.962 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.962 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.962 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cffff640 1 --2- 10.20.193.111:0/699621799 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f61d008fc50 0x7f61d0152110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.962 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:57.963 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:57.963 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61d4dd1640 1 --2- 10.20.193.111:0/699621799 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f61d0182990 0x7f61d010fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:57.963 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:57.963 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cffff640 10 monclient(hunting): get_auth_request con 0x7f61d008fc50 auth_method 0 2026-02-12T18:05:57.963 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.963 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.963 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.963 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61d4dd1640 10 monclient(hunting): get_auth_request con 0x7f61d0182990 auth_method 0 2026-02-12T18:05:57.963 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61d4dd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:57.963 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61d4dd1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:57.963 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61d4dd1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:57.963 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:57.963 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:57.964 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:57.964 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61d4dd1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:57.964 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61d4dd1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:57.964 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61d4dd1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:57.964 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cf7fe640 10 monclient(hunting): handle_auth_done global_id 4165 payload 824 2026-02-12T18:05:57.964 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cf7fe640 1 -- 10.20.193.111:0/699621799 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f61d0182990 msgr2=0x7f61d010fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:57.964 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cf7fe640 1 --2- 10.20.193.111:0/699621799 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f61d0182990 0x7f61d010fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.964 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cf7fe640 1 -- 10.20.193.111:0/699621799 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f61d008fc50 msgr2=0x7f61d0152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:57.964 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cf7fe640 1 --2- 10.20.193.111:0/699621799 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f61d008fc50 0x7f61d0152110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.964 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cf7fe640 10 monclient: _finish_hunting 0 2026-02-12T18:05:57.964 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cf7fe640 1 monclient: found mon.noname-i 2026-02-12T18:05:57.964 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:05:57.964 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cf7fe640 10 monclient: _send_mon_message to mon.noname-i at v2:10.20.193.111:3303/0 2026-02-12T18:05:57.965 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.943+0000 7f61cf7fe640 1 -- 10.20.193.111:0/699621799 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61c400a500 con 0x7f61d0090560 2026-02-12T18:05:57.965 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.945+0000 7f61cf7fe640 1 -- 10.20.193.111:0/699621799 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f61d0090560 msgr2=0x7f61d0127e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:05:57.965 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.945+0000 7f61cf7fe640 1 --2- 10.20.193.111:0/699621799 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f61d0090560 0x7f61d0127e40 secure :-1 s=READY pgs=32 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61c000e7e0 tx=0x7f61c000ebe0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:05:57.965 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.945+0000 7f61ccff9640 1 -- 10.20.193.111:0/699621799 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f61c000ee40 con 0x7f61d0090560 2026-02-12T18:05:57.965 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.945+0000 7f61ccff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:57.965 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.945+0000 7f61ccff9640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2026-02-12T18:05:57.965 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.945+0000 7f61ccff9640 10 monclient: dump: 2026-02-12T18:05:57.965 INFO:teuthology.orchestra.run.trial111.stderr:epoch 1 2026-02-12T18:05:57.965 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:57.965 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.965 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.966 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:57.966 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.966 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:57.966 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:57.966 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:57.966 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:57.966 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:57.966 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:57.966 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:57.966 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:57.966 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:57.966 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.966 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.945+0000 7f61ccff9640 10 monclient: _finish_auth 0 2026-02-12T18:05:57.967 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.945+0000 7f61ccff9640 10 monclient: _check_auth_tickets 2026-02-12T18:05:57.967 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.945+0000 7f61ccff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:05:57.967 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.945+0000 7f61ccff9640 1 -- 10.20.193.111:0/699621799 <== mon.7 v2:10.20.193.111:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c000cda0 con 0x7f61d0090560 2026-02-12T18:05:57.967 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.945+0000 7f61ccff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:05:57.967 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.945+0000 7f61ccff9640 1 -- 10.20.193.111:0/699621799 <== mon.7 v2:10.20.193.111:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f61c00138d0 con 0x7f61d0090560 2026-02-12T18:05:57.967 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.945+0000 7f61d685b640 5 monclient: authenticate success, global_id 4165 2026-02-12T18:05:57.967 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.945+0000 7f61ce7fc640 4 set_mon_vals no callback set 2026-02-12T18:05:57.967 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.945+0000 7f61d685b640 10 monclient: _renew_subs 2026-02-12T18:05:57.967 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.945+0000 7f61d685b640 10 monclient: _send_mon_message to mon.i at v2:10.20.193.111:3303/0 2026-02-12T18:05:57.967 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.945+0000 7f61d685b640 1 -- 10.20.193.111:0/699621799 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61d005d550 con 0x7f61d0090560 2026-02-12T18:05:57.967 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.945+0000 7f61ccff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:57.967 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.945+0000 7f61ccff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:05:57.967 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.945+0000 7f61ccff9640 10 monclient: dump: 2026-02-12T18:05:57.968 INFO:teuthology.orchestra.run.trial111.stderr:epoch 1 2026-02-12T18:05:57.968 INFO:teuthology.orchestra.run.trial111.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:57.968 INFO:teuthology.orchestra.run.trial111.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.968 INFO:teuthology.orchestra.run.trial111.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:57.968 INFO:teuthology.orchestra.run.trial111.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:57.968 INFO:teuthology.orchestra.run.trial111.stderr:election_strategy: 1 2026-02-12T18:05:57.968 INFO:teuthology.orchestra.run.trial111.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:57.968 INFO:teuthology.orchestra.run.trial111.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:57.968 INFO:teuthology.orchestra.run.trial111.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:57.968 INFO:teuthology.orchestra.run.trial111.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:57.968 INFO:teuthology.orchestra.run.trial111.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:57.968 INFO:teuthology.orchestra.run.trial111.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:57.968 INFO:teuthology.orchestra.run.trial111.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:57.969 INFO:teuthology.orchestra.run.trial111.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:57.969 INFO:teuthology.orchestra.run.trial111.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:57.969 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:05:57.969 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.945+0000 7f61d685b640 10 monclient: _renew_subs 2026-02-12T18:05:57.969 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.945+0000 7f61d685b640 10 monclient: _send_mon_message to mon.i at v2:10.20.193.111:3303/0 2026-02-12T18:05:57.969 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.945+0000 7f61d685b640 1 -- 10.20.193.111:0/699621799 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f61d0113500 con 0x7f61d0090560 2026-02-12T18:05:57.969 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.946+0000 7f61ccff9640 1 -- 10.20.193.111:0/699621799 <== mon.7 v2:10.20.193.111:3303/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7f61c000c8e0 con 0x7f61d0090560 2026-02-12T18:05:57.969 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.946+0000 7f61ccff9640 1 -- 10.20.193.111:0/699621799 <== mon.7 v2:10.20.193.111:3303/0 5 ==== osd_map(7..7 src has 1..7) ==== 1295+0+0 (secure 0 0 0) 0x7f61c0024350 con 0x7f61d0090560 2026-02-12T18:05:57.969 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.946+0000 7f61d685b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:57.969 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.946+0000 7f61d685b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:57.969 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.946+0000 7f61d685b640 10 monclient: _send_mon_message to mon.i at v2:10.20.193.111:3303/0 2026-02-12T18:05:57.969 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.946+0000 7f61d685b640 1 -- 10.20.193.111:0/699621799 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61d005d000 con 0x7f61d0090560 2026-02-12T18:05:57.970 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.947+0000 7f61ccff9640 1 -- 10.20.193.111:0/699621799 <== mon.7 v2:10.20.193.111:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7f61c0021060 con 0x7f61d0090560 2026-02-12T18:05:57.970 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.947+0000 7f61ccff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:57.970 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.947+0000 7f61ccff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:05:57.980 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.980+0000 7f61d685b640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "accc3f03-6123-444b-8c5a-42e927b0ed23", "id": 5}] 2026-02-12T18:05:57.980 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.980+0000 7f61d685b640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "accc3f03-6123-444b-8c5a-42e927b0ed23", "id": 5}] 2026-02-12T18:05:57.980 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.980+0000 7f61d685b640 10 monclient: _send_mon_message to mon.i at v2:10.20.193.111:3303/0 2026-02-12T18:05:57.981 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.980+0000 7f61d685b640 1 -- 10.20.193.111:0/699621799 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_command({"prefix": "osd new", "uuid": "accc3f03-6123-444b-8c5a-42e927b0ed23", "id": 5} v 0) -- 0x7f61d0090020 con 0x7f61d0090560 2026-02-12T18:05:57.983 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.983+0000 7f61ccff9640 1 -- 10.20.193.111:0/699621799 <== mon.7 v2:10.20.193.111:3303/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "accc3f03-6123-444b-8c5a-42e927b0ed23", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f61c002a0b0 con 0x7f61d0090560 2026-02-12T18:05:57.983 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.983+0000 7f61ccff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "accc3f03-6123-444b-8c5a-42e927b0ed23", "id": 5}] 2026-02-12T18:05:57.983 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.983+0000 7f61ccff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:05:57.984 INFO:teuthology.orchestra.run.trial111.stdout:5 2026-02-12T18:05:57.984 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.984+0000 7f61d685b640 10 monclient: shutdown 2026-02-12T18:05:57.984 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.984+0000 7f61d685b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:05:57.985 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.984+0000 7f61d685b640 1 -- 10.20.193.111:0/699621799 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f61d0090560 msgr2=0x7f61d0127e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:57.985 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.984+0000 7f61d685b640 1 --2- 10.20.193.111:0/699621799 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f61d0090560 0x7f61d0127e40 secure :-1 s=READY pgs=32 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f61c000e7e0 tx=0x7f61c000ebe0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.985 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.984+0000 7f61d685b640 1 -- 10.20.193.111:0/699621799 shutdown_connections 2026-02-12T18:05:57.985 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.984+0000 7f61d685b640 1 --2- 10.20.193.111:0/699621799 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f61d0182990 0x7f61d010fb60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.985 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.984+0000 7f61d685b640 1 --2- 10.20.193.111:0/699621799 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f61d0090560 0x7f61d0127e40 unknown :-1 s=CLOSED pgs=32 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.985 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.984+0000 7f61d685b640 1 --2- 10.20.193.111:0/699621799 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f61d008fc50 0x7f61d0152110 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:57.985 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.984+0000 7f61d685b640 1 -- 10.20.193.111:0/699621799 >> 10.20.193.111:0/699621799 conn(0x7f61d00951a0 msgr2=0x7f61d008d260 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:05:57.985 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.984+0000 7f61d685b640 1 -- 10.20.193.111:0/699621799 shutdown_connections 2026-02-12T18:05:57.985 INFO:teuthology.orchestra.run.trial111.stderr:2026-02-12T18:05:57.984+0000 7f61d685b640 1 -- 10.20.193.111:0/699621799 wait complete. 2026-02-12T18:05:57.992 INFO:tasks.ceph.osd.0:Restarting daemon 2026-02-12T18:05:57.992 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2026-02-12T18:05:57.993 INFO:tasks.ceph.osd.0:Started 2026-02-12T18:05:57.994 INFO:tasks.ceph.osd.1:Restarting daemon 2026-02-12T18:05:57.994 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2026-02-12T18:05:57.995 INFO:tasks.ceph.osd.1:Started 2026-02-12T18:05:57.995 INFO:tasks.ceph.osd.2:Restarting daemon 2026-02-12T18:05:57.995 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2026-02-12T18:05:57.996 INFO:tasks.ceph.osd.2:Started 2026-02-12T18:05:57.997 INFO:tasks.ceph.osd.3:Restarting daemon 2026-02-12T18:05:57.997 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2026-02-12T18:05:57.998 INFO:tasks.ceph.osd.3:Started 2026-02-12T18:05:57.998 INFO:tasks.ceph.osd.4:Restarting daemon 2026-02-12T18:05:57.998 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2026-02-12T18:05:57.999 INFO:tasks.ceph.osd.4:Started 2026-02-12T18:05:58.000 INFO:tasks.ceph.osd.5:Restarting daemon 2026-02-12T18:05:58.000 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2026-02-12T18:05:58.001 INFO:tasks.ceph.osd.5:Started 2026-02-12T18:05:58.001 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T18:05:58.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.065+0000 7fd17be8c640 10 monclient: get_monmap_and_config 2026-02-12T18:05:58.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.065+0000 7fd17be8c640 10 monclient: build_initial_monmap 2026-02-12T18:05:58.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.065+0000 7fd17be8c640 10 monclient: monmap: 2026-02-12T18:05:58.065 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:05:58.065 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:58.065 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:58.066421+0000 2026-02-12T18:05:58.066 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:58.066421+0000 2026-02-12T18:05:58.066 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:05:58.066 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:05:58.066 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:05:58.066 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:05:58.066 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:05:58.066 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:05:58.066 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:05:58.066 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:05:58.066 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:05:58.066 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:05:58.066 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:05:58.066 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:05:58.066 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:05:58.066 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:05:58.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.065+0000 7fd17be8c640 1 Processor -- start 2026-02-12T18:05:58.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.065+0000 7fd17be8c640 1 -- start start 2026-02-12T18:05:58.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.065+0000 7fd17be8c640 10 monclient: init 2026-02-12T18:05:58.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd17be8c640 10 monclient: _reopen_session rank -1 2026-02-12T18:05:58.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd17be8c640 10 monclient: _add_conns ranks=[6,2,8,1,0,4,3,5,9,7,10] 2026-02-12T18:05:58.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd17be8c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd174057e10 0x7fd174090cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:58.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd17be8c640 10 monclient(hunting): picked mon.noname-d con 0x7fd174057e10 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:05:58.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd17be8c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd174144550 0x7fd174140cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:58.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd17be8c640 10 monclient(hunting): picked mon.noname-b con 0x7fd174144550 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:05:58.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd17be8c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd1741449a0 0x7fd174141210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:58.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd17be8c640 10 monclient(hunting): picked mon.noname-e con 0x7fd1741449a0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:05:58.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd17be8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:58.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd17be8c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fd17408c330 con 0x7fd174144550 2026-02-12T18:05:58.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd17be8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd17be8c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fd1740573a0 con 0x7fd174057e10 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd17be8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd17be8c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fd1740581e0 con 0x7fd1741449a0 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd17be8c640 10 monclient(hunting): _renew_subs 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd17be8c640 10 monclient(hunting): authenticate will time out at 596.792276s 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179400640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd174144550 0x7fd174140cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179400640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd174144550 0x7fd174140cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:37662/0 (socket says 10.20.193.48:37662) 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179c01640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd174057e10 0x7fd174090cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179400640 1 -- 10.20.193.48:0/418018673 learned_addr learned my addr 10.20.193.48:0/418018673 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179400640 10 monclient(hunting): get_auth_request con 0x7fd174144550 auth_method 0 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179400640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179400640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179400640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179c01640 10 monclient(hunting): get_auth_request con 0x7fd174057e10 auth_method 0 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179c01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179c01640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179c01640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd17a402640 1 --2- 10.20.193.48:0/418018673 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd1741449a0 0x7fd174141210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179400640 1 -- 10.20.193.48:0/418018673 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd174144550 msgr2=0x7fd174140cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd17a402640 10 monclient(hunting): get_auth_request con 0x7fd1741449a0 auth_method 0 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179400640 1 -- 10.20.193.48:0/418018673 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd174144550 msgr2=0x7fd174140cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd17a402640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd17a402640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd17a402640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179400640 1 --2- 10.20.193.48:0/418018673 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd174144550 0x7fd174140cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179c01640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179c01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179400640 1 --2- 10.20.193.48:0/418018673 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd174144550 0x7fd174140cd0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179c01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd17a402640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:58.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd17a402640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:58.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd17a402640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:58.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179c01640 10 monclient(hunting): handle_auth_done global_id 4182 payload 274 2026-02-12T18:05:58.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179c01640 1 -- 10.20.193.48:0/418018673 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd1741449a0 msgr2=0x7fd174141210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:05:58.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179c01640 1 --2- 10.20.193.48:0/418018673 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd1741449a0 0x7fd174141210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:58.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179c01640 1 -- 10.20.193.48:0/418018673 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd174144550 msgr2=0x7fd174140cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:05:58.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179c01640 1 --2- 10.20.193.48:0/418018673 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd174144550 0x7fd174140cd0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:58.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179c01640 10 monclient: _finish_hunting 0 2026-02-12T18:05:58.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179c01640 1 monclient: found mon.noname-d 2026-02-12T18:05:58.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179c01640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:05:58.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179c01640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:05:58.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.066+0000 7fd179c01640 1 -- 10.20.193.48:0/418018673 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd174060390 con 0x7fd174057e10 2026-02-12T18:05:58.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd179c01640 1 -- 10.20.193.48:0/418018673 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd174057e10 msgr2=0x7fd174090cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:05:58.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd179c01640 1 --2- 10.20.193.48:0/418018673 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd174057e10 0x7fd174090cb0 secure :-1 s=READY pgs=31 gs=1 cs=0 l=1 c_cookie=14310687087007080171 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd164009860 tx=0x7fd16402ed70 comp rx=0 tx=0).ready entity=mon.6 client_cookie=c699c61598d39eeb server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:05:58.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd178bff640 1 -- 10.20.193.48:0/418018673 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd16402fe70 con 0x7fd174057e10 2026-02-12T18:05:58.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd178bff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:58.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd178bff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:05:58.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd178bff640 10 monclient: dump: 2026-02-12T18:05:58.070 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:05:58.070 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:58.070 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:58.070 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:58.070 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:58.070 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:05:58.070 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:58.070 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:58.070 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:58.070 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:58.070 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:58.070 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:58.070 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:58.070 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:58.070 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:58.070 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:05:58.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd178bff640 10 monclient: _finish_auth 0 2026-02-12T18:05:58.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd178bff640 10 monclient: _check_auth_tickets 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd178bff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd178bff640 1 -- 10.20.193.48:0/418018673 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd164035340 con 0x7fd174057e10 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd17be8c640 5 monclient: authenticate success, global_id 4182 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd17be8c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd178bff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd178bff640 1 -- 10.20.193.48:0/418018673 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd164035970 con 0x7fd174057e10 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd17be8c640 10 monclient: get_monmap_and_config success 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd17be8c640 4 set_mon_vals no callback set 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd178bff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd178bff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd178bff640 10 monclient: dump: 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd17be8c640 10 monclient: shutdown 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd17be8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd17be8c640 1 -- 10.20.193.48:0/418018673 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd174057e10 msgr2=0x7fd174090cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd17be8c640 1 --2- 10.20.193.48:0/418018673 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd174057e10 0x7fd174090cb0 secure :-1 s=READY pgs=31 gs=1 cs=0 l=1 c_cookie=14310687087007080171 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd164009860 tx=0x7fd16402ed70 comp rx=0 tx=0).stop 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd17be8c640 1 -- 10.20.193.48:0/418018673 shutdown_connections 2026-02-12T18:05:58.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd17be8c640 1 --2- 10.20.193.48:0/418018673 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd1741449a0 0x7fd174141210 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:58.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd17be8c640 1 --2- 10.20.193.48:0/418018673 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd174144550 0x7fd174140cd0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:58.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd17be8c640 1 --2- 10.20.193.48:0/418018673 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd174057e10 0x7fd174090cb0 unknown :-1 s=CLOSED pgs=31 gs=1 cs=0 l=1 c_cookie=14310687087007080171 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:58.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd17be8c640 1 -- 10.20.193.48:0/418018673 >> 10.20.193.48:0/418018673 conn(0x7fd174091da0 msgr2=0x7fd1740921a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:05:58.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd17be8c640 1 -- 10.20.193.48:0/418018673 shutdown_connections 2026-02-12T18:05:58.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.069+0000 7fd17be8c640 1 -- 10.20.193.48:0/418018673 wait complete. 2026-02-12T18:05:58.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd17be8c640 10 monclient: build_initial_monmap 2026-02-12T18:05:58.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd17be8c640 10 monclient: monmap: 2026-02-12T18:05:58.072 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:05:58.072 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:05:58.072 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:05:58.072 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:05:58.072 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:05:58.072 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:05:58.072 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:05:58.072 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:05:58.072 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:05:58.072 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:05:58.072 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:05:58.072 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:05:58.072 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:05:58.072 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:05:58.072 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:05:58.072 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:05:58.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd17be8c640 1 Processor -- start 2026-02-12T18:05:58.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd17be8c640 1 -- start start 2026-02-12T18:05:58.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd17be8c640 10 monclient: init 2026-02-12T18:05:58.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd17be8c640 10 monclient: _reopen_session rank -1 2026-02-12T18:05:58.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd17be8c640 10 monclient: _add_conns ranks=[5,6,1,7,2,0,4,8,3] 2026-02-12T18:05:58.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd17be8c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd174057e10 0x7fd1741313f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:58.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd17be8c640 10 monclient(hunting): picked mon.noname-h con 0x7fd174057e10 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:05:58.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd17be8c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd174144550 0x7fd174131ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:58.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd17be8c640 10 monclient(hunting): picked mon.noname-d con 0x7fd174144550 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:05:58.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd17be8c640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd1741449a0 0x7fd17410eda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:58.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd17be8c640 10 monclient(hunting): picked mon.noname-f con 0x7fd1741449a0 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:05:58.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd17be8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:58.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd17be8c640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd174131930 con 0x7fd1741449a0 2026-02-12T18:05:58.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd17be8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:58.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd17be8c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fd174110f30 con 0x7fd174057e10 2026-02-12T18:05:58.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd17be8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:58.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd17be8c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fd1741113e0 con 0x7fd174144550 2026-02-12T18:05:58.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd17be8c640 10 monclient(hunting): _renew_subs 2026-02-12T18:05:58.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd17be8c640 10 monclient(hunting): authenticate will time out at 596.796509s 2026-02-12T18:05:58.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd179400640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd174144550 0x7fd174131ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd179400640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd174144550 0x7fd174131ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:58178/0 (socket says 10.20.193.48:58178) 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd179400640 1 -- 10.20.193.48:0/3306377527 learned_addr learned my addr 10.20.193.48:0/3306377527 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd179400640 10 monclient(hunting): get_auth_request con 0x7fd174144550 auth_method 0 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd179400640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd179400640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd179400640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd179400640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd179400640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd179400640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd17a402640 1 --2- 10.20.193.48:0/3306377527 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd1741449a0 0x7fd17410eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd17a402640 10 monclient(hunting): get_auth_request con 0x7fd1741449a0 auth_method 0 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd17a402640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd17a402640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd17a402640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd179c01640 1 --2- 10.20.193.48:0/3306377527 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd174057e10 0x7fd1741313f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd179c01640 10 monclient(hunting): get_auth_request con 0x7fd174057e10 auth_method 0 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd179c01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd179c01640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd179c01640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd179400640 10 monclient(hunting): handle_auth_done global_id 4191 payload 824 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd179400640 1 -- 10.20.193.48:0/3306377527 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd174057e10 msgr2=0x7fd1741313f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd179400640 1 --2- 10.20.193.48:0/3306377527 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd174057e10 0x7fd1741313f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd179400640 1 -- 10.20.193.48:0/3306377527 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd1741449a0 msgr2=0x7fd17410eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd179400640 1 --2- 10.20.193.48:0/3306377527 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd1741449a0 0x7fd17410eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd179400640 10 monclient: _finish_hunting 0 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd179400640 1 monclient: found mon.noname-d 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd179400640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd179400640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.070+0000 7fd179400640 1 -- 10.20.193.48:0/3306377527 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd164009420 con 0x7fd174144550 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.072+0000 7fd179400640 1 -- 10.20.193.48:0/3306377527 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd174144550 msgr2=0x7fd174131ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.072+0000 7fd179400640 1 --2- 10.20.193.48:0/3306377527 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd174144550 0x7fd174131ca0 secure :-1 s=READY pgs=32 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd16800e7e0 tx=0x7fd16800ecb0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd1627fc640 1 -- 10.20.193.48:0/3306377527 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd1680036d0 con 0x7fd174144550 2026-02-12T18:05:58.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd1627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd1627fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd1627fc640 10 monclient: dump: 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd1627fc640 10 monclient: _finish_auth 0 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd1627fc640 10 monclient: _check_auth_tickets 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd1627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd1627fc640 1 -- 10.20.193.48:0/3306377527 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd168003850 con 0x7fd174144550 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd1627fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd1627fc640 1 -- 10.20.193.48:0/3306377527 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd168003e80 con 0x7fd174144550 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd1627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd163fff640 4 set_mon_vals no callback set 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd1627fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd1627fc640 10 monclient: dump: 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:58.076 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:58.077 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:58.077 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:05:58.077 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:58.077 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:58.077 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:58.077 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:58.077 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:58.077 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:58.077 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:58.077 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:58.077 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:58.077 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:05:58.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd17be8c640 5 monclient: authenticate success, global_id 4191 2026-02-12T18:05:58.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd17be8c640 10 monclient: _renew_subs 2026-02-12T18:05:58.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd17be8c640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:05:58.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd17be8c640 1 -- 10.20.193.48:0/3306377527 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd174122970 con 0x7fd174144550 2026-02-12T18:05:58.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd17be8c640 10 monclient: _renew_subs 2026-02-12T18:05:58.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd17be8c640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:05:58.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd17be8c640 1 -- 10.20.193.48:0/3306377527 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fd17408b630 con 0x7fd174144550 2026-02-12T18:05:58.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd1627fc640 1 -- 10.20.193.48:0/3306377527 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 1) ==== 939+0+0 (secure 0 0 0) 0x7fd168004240 con 0x7fd174144550 2026-02-12T18:05:58.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd1627fc640 1 -- 10.20.193.48:0/3306377527 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(8..8 src has 1..8) ==== 1410+0+0 (secure 0 0 0) 0x7fd168013d70 con 0x7fd174144550 2026-02-12T18:05:58.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd17be8c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:58.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd17be8c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:58.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd17be8c640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:05:58.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.073+0000 7fd17be8c640 1 -- 10.20.193.48:0/3306377527 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd174057070 con 0x7fd174144550 2026-02-12T18:05:58.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.074+0000 7fd179400640 1 --2- 10.20.193.48:0/3306377527 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd174144550 0x7fd174131ca0 secure :-1 s=READY pgs=32 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd16800e7e0 tx=0x7fd16800ecb0 comp rx=0 tx=0).queue_received will delay after 1.77092e+09 on 0x7fd168017020 mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) 2026-02-12T18:05:58.232 INFO:tasks.ceph.osd.0.trial048.stderr:2026-02-12T18:05:58.231+0000 7f0491639780 -1 Falling back to public interface 2026-02-12T18:05:58.232 INFO:tasks.ceph.osd.2.trial048.stderr:2026-02-12T18:05:58.231+0000 7f3871c14780 -1 Falling back to public interface 2026-02-12T18:05:58.232 INFO:tasks.ceph.osd.0.trial048.stderr:2026-02-12T18:05:58.231+0000 7f048f5fd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2026-02-12T18:05:58.232 INFO:tasks.ceph.osd.0.trial048.stderr:2026-02-12T18:05:58.232+0000 7f048f5fd640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6805/0: (98) Address already in use 2026-02-12T18:05:58.242 INFO:tasks.ceph.osd.1.trial048.stderr:2026-02-12T18:05:58.242+0000 7f0b5e257780 -1 Falling back to public interface 2026-02-12T18:05:58.285 INFO:tasks.ceph.osd.3.trial111.stderr:2026-02-12T18:05:58.285+0000 7f15eca10780 -1 Falling back to public interface 2026-02-12T18:05:58.286 INFO:tasks.ceph.osd.5.trial111.stderr:2026-02-12T18:05:58.286+0000 7f2eab04b780 -1 Falling back to public interface 2026-02-12T18:05:58.293 INFO:tasks.ceph.osd.4.trial111.stderr:2026-02-12T18:05:58.293+0000 7ff2e5c42780 -1 Falling back to public interface 2026-02-12T18:05:58.384 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.383+0000 7fd1627fc640 1 -- 10.20.193.48:0/3306377527 <== mon.6 v2:10.20.193.48:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7fd168017020 con 0x7fd174144550 2026-02-12T18:05:58.384 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.383+0000 7fd1627fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:58.384 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.383+0000 7fd1627fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:05:58.412 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.412+0000 7fd17be8c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-12T18:05:58.412 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.412+0000 7fd17be8c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T18:05:58.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.412+0000 7fd17be8c640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:05:58.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.412+0000 7fd17be8c640 1 -- 10.20.193.48:0/3306377527 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd174091b10 con 0x7fd174144550 2026-02-12T18:05:58.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.413+0000 7fd1627fc640 1 -- 10.20.193.48:0/3306377527 <== mon.6 v2:10.20.193.48:3303/0 7 ==== mgrmap(e 2) ==== 51714+0+0 (secure 0 0 0) 0x7fd168013780 con 0x7fd174144550 2026-02-12T18:05:58.767 INFO:tasks.ceph.osd.1.trial048.stderr:2026-02-12T18:05:58.767+0000 7f0b5e257780 -1 osd.1 0 log_to_monitors true 2026-02-12T18:05:58.767 INFO:tasks.ceph.osd.0.trial048.stderr:2026-02-12T18:05:58.767+0000 7f0491639780 -1 osd.0 0 log_to_monitors true 2026-02-12T18:05:58.786 INFO:tasks.ceph.osd.2.trial048.stderr:2026-02-12T18:05:58.786+0000 7f3871c14780 -1 osd.2 0 log_to_monitors true 2026-02-12T18:05:58.799 INFO:tasks.ceph.osd.5.trial111.stderr:2026-02-12T18:05:58.799+0000 7f2eab04b780 -1 osd.5 0 log_to_monitors true 2026-02-12T18:05:58.799 INFO:tasks.ceph.osd.4.trial111.stderr:2026-02-12T18:05:58.799+0000 7ff2e5c42780 -1 osd.4 0 log_to_monitors true 2026-02-12T18:05:58.799 INFO:tasks.ceph.osd.3.trial111.stderr:2026-02-12T18:05:58.799+0000 7f15eca10780 -1 osd.3 0 log_to_monitors true 2026-02-12T18:05:58.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.903+0000 7fd1627fc640 1 -- 10.20.193.48:0/3306377527 <== mon.6 v2:10.20.193.48:3303/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5603 (secure 0 0 0) 0x7fd174091b10 con 0x7fd174144550 2026-02-12T18:05:58.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.903+0000 7fd1627fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T18:05:58.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.903+0000 7fd1627fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:05:58.903 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:05:58.903 INFO:teuthology.orchestra.run.trial048.stdout:{"epoch":8,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","created":"2026-02-12T18:05:56.090643+0000","modified":"2026-02-12T18:05:57.981781+0000","last_up_change":"0.000000","last_in_change":"2026-02-12T18:05:57.981781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a8255145-baf3-4c84-9a14-58a24c915493","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4cf3730c-446c-4c4f-baf9-b354e06bf2b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4ca2a3bb-4801-48eb-9814-12473a6c12bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e64b1a76-9d2c-4c4a-bd2d-7b5b8c1df21e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ad82216b-0e68-44da-a293-d4c97dec6b79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"accc3f03-6123-444b-8c5a-42e927b0ed23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T18:05:58.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.903+0000 7fd17be8c640 10 monclient: shutdown 2026-02-12T18:05:58.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.903+0000 7fd17be8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:05:58.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.903+0000 7fd17be8c640 1 -- 10.20.193.48:0/3306377527 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd174144550 msgr2=0x7fd174131ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:58.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.903+0000 7fd17be8c640 1 --2- 10.20.193.48:0/3306377527 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd174144550 0x7fd174131ca0 secure :-1 s=READY pgs=32 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd16800e7e0 tx=0x7fd16800ecb0 comp rx=0 tx=0).stop 2026-02-12T18:05:58.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.903+0000 7fd17be8c640 1 -- 10.20.193.48:0/3306377527 shutdown_connections 2026-02-12T18:05:58.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.903+0000 7fd17be8c640 1 --2- 10.20.193.48:0/3306377527 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd1741449a0 0x7fd17410eda0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:58.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.903+0000 7fd17be8c640 1 --2- 10.20.193.48:0/3306377527 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd174144550 0x7fd174131ca0 unknown :-1 s=CLOSED pgs=32 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:58.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.903+0000 7fd17be8c640 1 --2- 10.20.193.48:0/3306377527 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd174057e10 0x7fd1741313f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:58.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.903+0000 7fd17be8c640 1 -- 10.20.193.48:0/3306377527 >> 10.20.193.48:0/3306377527 conn(0x7fd174091da0 msgr2=0x7fd174054b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:05:58.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.903+0000 7fd17be8c640 1 -- 10.20.193.48:0/3306377527 shutdown_connections 2026-02-12T18:05:58.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:05:58.903+0000 7fd17be8c640 1 -- 10.20.193.48:0/3306377527 wait complete. 2026-02-12T18:05:58.911 INFO:tasks.ceph.ceph_manager.ceph:[] 2026-02-12T18:05:58.911 INFO:tasks.ceph:Waiting for OSDs to come up 2026-02-12T18:05:59.513 DEBUG:teuthology.orchestra.run.trial048:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T18:05:59.572 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.571+0000 7fcabd79d640 10 monclient: get_monmap_and_config 2026-02-12T18:05:59.572 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.571+0000 7fcabd79d640 10 monclient: build_initial_monmap 2026-02-12T18:05:59.572 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.571+0000 7fcabd79d640 10 monclient: monmap: 2026-02-12T18:05:59.572 INFO:teuthology.misc.health.trial048.stderr:epoch 0 2026-02-12T18:05:59.572 INFO:teuthology.misc.health.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:59.572 INFO:teuthology.misc.health.trial048.stderr:last_changed 2026-02-12T18:05:59.572628+0000 2026-02-12T18:05:59.572 INFO:teuthology.misc.health.trial048.stderr:created 2026-02-12T18:05:59.572628+0000 2026-02-12T18:05:59.572 INFO:teuthology.misc.health.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:05:59.573 INFO:teuthology.misc.health.trial048.stderr:election_strategy: 1 2026-02-12T18:05:59.573 INFO:teuthology.misc.health.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:05:59.573 INFO:teuthology.misc.health.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:05:59.573 INFO:teuthology.misc.health.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:05:59.573 INFO:teuthology.misc.health.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:05:59.573 INFO:teuthology.misc.health.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:05:59.573 INFO:teuthology.misc.health.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:05:59.573 INFO:teuthology.misc.health.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:05:59.573 INFO:teuthology.misc.health.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:05:59.573 INFO:teuthology.misc.health.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:05:59.573 INFO:teuthology.misc.health.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:05:59.574 INFO:teuthology.misc.health.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:05:59.574 INFO:teuthology.misc.health.trial048.stderr: 2026-02-12T18:05:59.583 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.571+0000 7fcabd79d640 1 Processor -- start 2026-02-12T18:05:59.583 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcabd79d640 1 -- start start 2026-02-12T18:05:59.583 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcabd79d640 10 monclient: init 2026-02-12T18:05:59.583 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcabd79d640 10 monclient: _reopen_session rank -1 2026-02-12T18:05:59.583 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcabd79d640 10 monclient: _add_conns ranks=[5,4,0,6,1,7,9,3,8,10,2] 2026-02-12T18:05:59.583 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcabd79d640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fcab805dc20 0x7fcab8144660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:59.583 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcabd79d640 10 monclient(hunting): picked mon.noname-h con 0x7fcab805dc20 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:05:59.583 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcabd79d640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcab805dff0 0x7fcab805e3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:59.584 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcabd79d640 10 monclient(hunting): picked mon.noname-c con 0x7fcab805dff0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:05:59.584 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcabd79d640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fcab8089df0 addr v1:10.20.193.48:6789/0 2026-02-12T18:05:59.584 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcabd79d640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcab8060390 con 0x7fcab8089df0 2026-02-12T18:05:59.584 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcabd79d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:59.584 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcabd79d640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fcab808b0d0 con 0x7fcab805dff0 2026-02-12T18:05:59.584 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcabd79d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:59.584 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcabd79d640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fcab8093a30 con 0x7fcab805dc20 2026-02-12T18:05:59.584 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcabd79d640 10 monclient(hunting): _renew_subs 2026-02-12T18:05:59.584 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcabd79d640 10 monclient(hunting): authenticate will time out at 598.298332s 2026-02-12T18:05:59.584 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcab67fc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcab805dff0 0x7fcab805e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:59.584 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcab67fc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcab805dff0 0x7fcab805e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:56308/0 (socket says 10.20.193.48:56308) 2026-02-12T18:05:59.584 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcab67fc640 1 -- 10.20.193.48:0/2813996397 learned_addr learned my addr 10.20.193.48:0/2813996397 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:05:59.585 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcab67fc640 10 monclient(hunting): get_auth_request con 0x7fcab805dff0 auth_method 0 2026-02-12T18:05:59.585 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcab67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:59.585 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcab67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:59.585 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcab67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:59.585 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcab67fc640 1 -- 10.20.193.48:0/2813996397 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcab805dff0 msgr2=0x7fcab805e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:05:59.585 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcab67fc640 1 -- 10.20.193.48:0/2813996397 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcab805dff0 msgr2=0x7fcab805e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:05:59.585 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcab67fc640 1 --2- 10.20.193.48:0/2813996397 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcab805dff0 0x7fcab805e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:59.585 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcab67fc640 1 --2- 10.20.193.48:0/2813996397 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcab805dff0 0x7fcab805e3c0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:05:59.585 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcab6ffd640 1 --2- 10.20.193.48:0/2813996397 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fcab805dc20 0x7fcab8144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:59.585 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcab6ffd640 10 monclient(hunting): get_auth_request con 0x7fcab805dc20 auth_method 0 2026-02-12T18:05:59.585 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcab6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:59.586 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcab6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:59.586 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcab6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:59.586 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcab6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:59.586 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcab6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:59.586 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcab6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:59.586 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.572+0000 7fcab6ffd640 10 monclient(hunting): handle_auth_done global_id 4190 payload 274 2026-02-12T18:05:59.586 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.573+0000 7fcab6ffd640 1 -- 10.20.193.48:0/2813996397 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcab805dff0 msgr2=0x7fcab805e3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:05:59.586 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.573+0000 7fcab6ffd640 1 --2- 10.20.193.48:0/2813996397 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcab805dff0 0x7fcab805e3c0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:59.586 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.573+0000 7fcab6ffd640 1 -- 10.20.193.48:0/2813996397 >> v1:10.20.193.48:6789/0 conn(0x7fcab8089df0 legacy=0x7fcab808a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:05:59.586 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.573+0000 7fcab6ffd640 10 monclient: _finish_hunting 0 2026-02-12T18:05:59.586 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.573+0000 7fcab6ffd640 1 monclient: found mon.noname-h 2026-02-12T18:05:59.586 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.573+0000 7fcab6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:05:59.586 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.573+0000 7fcab6ffd640 10 monclient: _send_mon_message to mon.noname-h at v2:10.20.193.111:3302/0 2026-02-12T18:05:59.587 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.573+0000 7fcab6ffd640 1 -- 10.20.193.48:0/2813996397 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcab808b250 con 0x7fcab805dc20 2026-02-12T18:05:59.587 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.575+0000 7fcab6ffd640 1 -- 10.20.193.48:0/2813996397 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fcab805dc20 msgr2=0x7fcab8144660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:05:59.587 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.575+0000 7fcab6ffd640 1 --2- 10.20.193.48:0/2813996397 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fcab805dc20 0x7fcab8144660 secure :-1 s=READY pgs=32 gs=3 cs=0 l=1 c_cookie=1009447687070164318 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaac009800 tx=0x7fcaac02edd0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=e024752b728255e server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:05:59.587 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcab5ffb640 1 -- 10.20.193.48:0/2813996397 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcaac035340 con 0x7fcab805dc20 2026-02-12T18:05:59.587 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcab5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:59.587 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcab5ffb640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2026-02-12T18:05:59.587 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcab5ffb640 10 monclient: dump: 2026-02-12T18:05:59.587 INFO:teuthology.misc.health.trial048.stderr:epoch 1 2026-02-12T18:05:59.587 INFO:teuthology.misc.health.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:59.587 INFO:teuthology.misc.health.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:59.587 INFO:teuthology.misc.health.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:59.588 INFO:teuthology.misc.health.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:59.588 INFO:teuthology.misc.health.trial048.stderr:election_strategy: 1 2026-02-12T18:05:59.588 INFO:teuthology.misc.health.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:59.588 INFO:teuthology.misc.health.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:59.588 INFO:teuthology.misc.health.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:59.588 INFO:teuthology.misc.health.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:59.588 INFO:teuthology.misc.health.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:59.588 INFO:teuthology.misc.health.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:59.588 INFO:teuthology.misc.health.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:59.588 INFO:teuthology.misc.health.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:59.588 INFO:teuthology.misc.health.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:59.588 INFO:teuthology.misc.health.trial048.stderr: 2026-02-12T18:05:59.588 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcab5ffb640 10 monclient: _finish_auth 0 2026-02-12T18:05:59.589 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcab5ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:05:59.589 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcab5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:05:59.589 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcab5ffb640 1 -- 10.20.193.48:0/2813996397 <== mon.5 v2:10.20.193.111:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaac0354c0 con 0x7fcab805dc20 2026-02-12T18:05:59.589 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcabd79d640 5 monclient: authenticate success, global_id 4190 2026-02-12T18:05:59.589 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcabd79d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:05:59.589 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcab5ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:05:59.589 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcab5ffb640 1 -- 10.20.193.48:0/2813996397 <== mon.5 v2:10.20.193.111:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcaac035af0 con 0x7fcab805dc20 2026-02-12T18:05:59.589 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcabd79d640 10 monclient: get_monmap_and_config success 2026-02-12T18:05:59.589 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcabd79d640 4 set_mon_vals no callback set 2026-02-12T18:05:59.589 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcab5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:59.589 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcab5ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:05:59.589 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcab5ffb640 10 monclient: dump: 2026-02-12T18:05:59.589 INFO:teuthology.misc.health.trial048.stderr:epoch 1 2026-02-12T18:05:59.590 INFO:teuthology.misc.health.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:59.590 INFO:teuthology.misc.health.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:59.590 INFO:teuthology.misc.health.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:59.590 INFO:teuthology.misc.health.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:59.590 INFO:teuthology.misc.health.trial048.stderr:election_strategy: 1 2026-02-12T18:05:59.590 INFO:teuthology.misc.health.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:59.590 INFO:teuthology.misc.health.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:59.590 INFO:teuthology.misc.health.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:59.590 INFO:teuthology.misc.health.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:59.590 INFO:teuthology.misc.health.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:59.590 INFO:teuthology.misc.health.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:59.590 INFO:teuthology.misc.health.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:59.590 INFO:teuthology.misc.health.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:59.591 INFO:teuthology.misc.health.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:59.591 INFO:teuthology.misc.health.trial048.stderr: 2026-02-12T18:05:59.591 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcabd79d640 10 monclient: shutdown 2026-02-12T18:05:59.591 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcabd79d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:05:59.591 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcabd79d640 1 -- 10.20.193.48:0/2813996397 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fcab805dc20 msgr2=0x7fcab8144660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:59.591 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcabd79d640 1 --2- 10.20.193.48:0/2813996397 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fcab805dc20 0x7fcab8144660 secure :-1 s=READY pgs=32 gs=3 cs=0 l=1 c_cookie=1009447687070164318 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaac009800 tx=0x7fcaac02edd0 comp rx=0 tx=0).stop 2026-02-12T18:05:59.591 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcabd79d640 1 -- 10.20.193.48:0/2813996397 shutdown_connections 2026-02-12T18:05:59.591 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcabd79d640 1 --2- 10.20.193.48:0/2813996397 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcab805dff0 0x7fcab805e3c0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:59.591 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcabd79d640 1 --2- 10.20.193.48:0/2813996397 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fcab805dc20 0x7fcab8144660 unknown :-1 s=CLOSED pgs=32 gs=3 cs=0 l=1 c_cookie=1009447687070164318 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:59.591 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcabd79d640 1 -- 10.20.193.48:0/2813996397 >> 10.20.193.48:0/2813996397 conn(0x7fcab80546d0 msgr2=0x7fcab8054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:05:59.591 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcabd79d640 1 -- 10.20.193.48:0/2813996397 shutdown_connections 2026-02-12T18:05:59.592 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcabd79d640 1 -- 10.20.193.48:0/2813996397 wait complete. 2026-02-12T18:05:59.592 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcabd79d640 10 monclient: build_initial_monmap 2026-02-12T18:05:59.592 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.576+0000 7fcabd79d640 10 monclient: monmap: 2026-02-12T18:05:59.592 INFO:teuthology.misc.health.trial048.stderr:epoch 0 2026-02-12T18:05:59.592 INFO:teuthology.misc.health.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:05:59.592 INFO:teuthology.misc.health.trial048.stderr:last_changed 0.000000 2026-02-12T18:05:59.592 INFO:teuthology.misc.health.trial048.stderr:created 0.000000 2026-02-12T18:05:59.592 INFO:teuthology.misc.health.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:05:59.592 INFO:teuthology.misc.health.trial048.stderr:election_strategy: 1 2026-02-12T18:05:59.592 INFO:teuthology.misc.health.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:05:59.592 INFO:teuthology.misc.health.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:05:59.592 INFO:teuthology.misc.health.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:05:59.592 INFO:teuthology.misc.health.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:05:59.593 INFO:teuthology.misc.health.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:05:59.593 INFO:teuthology.misc.health.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:05:59.593 INFO:teuthology.misc.health.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:05:59.593 INFO:teuthology.misc.health.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:05:59.593 INFO:teuthology.misc.health.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:05:59.593 INFO:teuthology.misc.health.trial048.stderr: 2026-02-12T18:05:59.593 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcabd79d640 1 Processor -- start 2026-02-12T18:05:59.593 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcabd79d640 1 -- start start 2026-02-12T18:05:59.593 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcabd79d640 10 monclient: init 2026-02-12T18:05:59.593 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcabd79d640 10 monclient: _reopen_session rank -1 2026-02-12T18:05:59.593 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcabd79d640 10 monclient: _add_conns ranks=[6,7,2,5,0,8,3,4,1] 2026-02-12T18:05:59.593 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcabd79d640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcab805dc20 0x7fcab810e7f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:59.593 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcabd79d640 10 monclient(hunting): picked mon.noname-d con 0x7fcab805dc20 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:05:59.594 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcabd79d640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcab805dff0 0x7fcab810db60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:59.594 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcabd79d640 10 monclient(hunting): picked mon.noname-i con 0x7fcab805dff0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:05:59.594 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcabd79d640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fcab8089df0 0x7fcab8131450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:05:59.594 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcabd79d640 10 monclient(hunting): picked mon.noname-b con 0x7fcab8089df0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:05:59.594 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcabd79d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:59.594 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcabd79d640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fcab808e700 con 0x7fcab8089df0 2026-02-12T18:05:59.594 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcabd79d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:59.594 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcabd79d640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fcab8091890 con 0x7fcab805dc20 2026-02-12T18:05:59.594 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcabd79d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:05:59.594 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcabd79d640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fcab810ed30 con 0x7fcab805dff0 2026-02-12T18:05:59.594 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcabd79d640 10 monclient(hunting): _renew_subs 2026-02-12T18:05:59.594 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcabd79d640 10 monclient(hunting): authenticate will time out at 598.303528s 2026-02-12T18:05:59.595 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab6ffd640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcab805dc20 0x7fcab810e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:59.595 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab77fe640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fcab8089df0 0x7fcab8131450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:59.595 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab6ffd640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcab805dc20 0x7fcab810e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:58216/0 (socket says 10.20.193.48:58216) 2026-02-12T18:05:59.595 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab6ffd640 1 -- 10.20.193.48:0/4174776218 learned_addr learned my addr 10.20.193.48:0/4174776218 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:05:59.595 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab6ffd640 10 monclient(hunting): get_auth_request con 0x7fcab805dc20 auth_method 0 2026-02-12T18:05:59.595 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:59.595 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:59.595 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:59.595 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab77fe640 10 monclient(hunting): get_auth_request con 0x7fcab8089df0 auth_method 0 2026-02-12T18:05:59.595 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:59.595 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:59.596 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:59.596 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:05:59.596 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:05:59.596 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:05:59.596 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab77fe640 1 -- 10.20.193.48:0/4174776218 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fcab8089df0 msgr2=0x7fcab8131450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-12T18:05:59.596 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab77fe640 1 -- 10.20.193.48:0/4174776218 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fcab8089df0 msgr2=0x7fcab8131450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:05:59.596 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab77fe640 1 --2- 10.20.193.48:0/4174776218 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fcab8089df0 0x7fcab8131450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:05:59.596 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab77fe640 1 --2- 10.20.193.48:0/4174776218 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fcab8089df0 0x7fcab8131450 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:05:59.596 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab67fc640 1 --2- 10.20.193.48:0/4174776218 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcab805dff0 0x7fcab810db60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:05:59.596 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab67fc640 10 monclient(hunting): get_auth_request con 0x7fcab805dff0 auth_method 0 2026-02-12T18:05:59.596 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:05:59.596 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:05:59.596 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:05:59.597 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab6ffd640 10 monclient(hunting): handle_auth_done global_id 4245 payload 824 2026-02-12T18:05:59.597 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab6ffd640 1 -- 10.20.193.48:0/4174776218 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcab805dff0 msgr2=0x7fcab810db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:59.597 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab6ffd640 1 --2- 10.20.193.48:0/4174776218 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcab805dff0 0x7fcab810db60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:59.597 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab6ffd640 1 -- 10.20.193.48:0/4174776218 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fcab8089df0 msgr2=0x7fcab8131450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:05:59.597 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab6ffd640 1 --2- 10.20.193.48:0/4174776218 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fcab8089df0 0x7fcab8131450 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:59.597 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab6ffd640 10 monclient: _finish_hunting 0 2026-02-12T18:05:59.597 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab6ffd640 1 monclient: found mon.noname-d 2026-02-12T18:05:59.597 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:05:59.597 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab6ffd640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:05:59.597 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.577+0000 7fcab6ffd640 1 -- 10.20.193.48:0/4174776218 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaac009420 con 0x7fcab805dc20 2026-02-12T18:05:59.597 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.579+0000 7fcab6ffd640 1 -- 10.20.193.48:0/4174776218 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcab805dc20 msgr2=0x7fcab810e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:05:59.597 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fcab6ffd640 1 --2- 10.20.193.48:0/4174776218 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcab805dc20 0x7fcab810e7f0 secure :-1 s=READY pgs=36 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaac0090b0 tx=0x7fcaac0047e0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:05:59.598 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fca977fe640 1 -- 10.20.193.48:0/4174776218 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcaac0044f0 con 0x7fcab805dc20 2026-02-12T18:05:59.598 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fca977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:59.598 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fca977fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:05:59.598 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fca977fe640 10 monclient: dump: 2026-02-12T18:05:59.598 INFO:teuthology.misc.health.trial048.stderr:epoch 1 2026-02-12T18:05:59.598 INFO:teuthology.misc.health.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:59.598 INFO:teuthology.misc.health.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:59.598 INFO:teuthology.misc.health.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:59.598 INFO:teuthology.misc.health.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:59.598 INFO:teuthology.misc.health.trial048.stderr:election_strategy: 1 2026-02-12T18:05:59.598 INFO:teuthology.misc.health.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:59.598 INFO:teuthology.misc.health.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:59.598 INFO:teuthology.misc.health.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:59.599 INFO:teuthology.misc.health.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:59.599 INFO:teuthology.misc.health.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:59.599 INFO:teuthology.misc.health.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:59.599 INFO:teuthology.misc.health.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:59.599 INFO:teuthology.misc.health.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:59.599 INFO:teuthology.misc.health.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:59.599 INFO:teuthology.misc.health.trial048.stderr: 2026-02-12T18:05:59.599 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fca977fe640 10 monclient: _finish_auth 0 2026-02-12T18:05:59.599 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fca977fe640 10 monclient: _check_auth_tickets 2026-02-12T18:05:59.599 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fca977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:05:59.599 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fca977fe640 1 -- 10.20.193.48:0/4174776218 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaac0036d0 con 0x7fcab805dc20 2026-02-12T18:05:59.599 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fcabd79d640 5 monclient: authenticate success, global_id 4245 2026-02-12T18:05:59.600 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fca977fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:05:59.600 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fca977fe640 1 -- 10.20.193.48:0/4174776218 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcaac003d00 con 0x7fcab805dc20 2026-02-12T18:05:59.600 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fca977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:05:59.600 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fcab57fa640 4 set_mon_vals no callback set 2026-02-12T18:05:59.600 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fca977fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:05:59.600 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fca977fe640 10 monclient: dump: 2026-02-12T18:05:59.600 INFO:teuthology.misc.health.trial048.stderr:epoch 1 2026-02-12T18:05:59.600 INFO:teuthology.misc.health.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:05:59.600 INFO:teuthology.misc.health.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:59.600 INFO:teuthology.misc.health.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:05:59.600 INFO:teuthology.misc.health.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:05:59.600 INFO:teuthology.misc.health.trial048.stderr:election_strategy: 1 2026-02-12T18:05:59.601 INFO:teuthology.misc.health.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:05:59.601 INFO:teuthology.misc.health.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:05:59.601 INFO:teuthology.misc.health.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:05:59.601 INFO:teuthology.misc.health.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:05:59.601 INFO:teuthology.misc.health.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:05:59.601 INFO:teuthology.misc.health.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:05:59.601 INFO:teuthology.misc.health.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:05:59.601 INFO:teuthology.misc.health.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:05:59.601 INFO:teuthology.misc.health.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:05:59.601 INFO:teuthology.misc.health.trial048.stderr: 2026-02-12T18:05:59.601 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fcabd79d640 10 monclient: _renew_subs 2026-02-12T18:05:59.601 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fcabd79d640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:05:59.601 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fcabd79d640 1 -- 10.20.193.48:0/4174776218 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcab81103b0 con 0x7fcab805dc20 2026-02-12T18:05:59.602 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fcabd79d640 10 monclient: _renew_subs 2026-02-12T18:05:59.602 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fcabd79d640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:05:59.602 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fcabd79d640 1 -- 10.20.193.48:0/4174776218 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fcab810e0a0 con 0x7fcab805dc20 2026-02-12T18:05:59.602 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fca977fe640 1 -- 10.20.193.48:0/4174776218 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 2) ==== 51714+0+0 (secure 0 0 0) 0x7fcaac003840 con 0x7fcab805dc20 2026-02-12T18:05:59.602 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fcabd79d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:59.602 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fcabd79d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:59.602 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fcabd79d640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:05:59.602 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fca977fe640 1 -- 10.20.193.48:0/4174776218 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(8..8 src has 1..8) ==== 1410+0+0 (secure 0 0 0) 0x7fcaac076fa0 con 0x7fcab805dc20 2026-02-12T18:05:59.602 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.580+0000 7fcabd79d640 1 -- 10.20.193.48:0/4174776218 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcab8093470 con 0x7fcab805dc20 2026-02-12T18:05:59.602 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.581+0000 7fca977fe640 1 -- 10.20.193.48:0/4174776218 <== mon.6 v2:10.20.193.48:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+77541 (secure 0 0 0) 0x7fcaac042450 con 0x7fcab805dc20 2026-02-12T18:05:59.602 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.581+0000 7fca977fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:05:59.602 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.581+0000 7fca977fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:05:59.610 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.610+0000 7fcabd79d640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-12T18:05:59.610 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.610+0000 7fcabd79d640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T18:05:59.611 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.610+0000 7fcabd79d640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:05:59.611 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.610+0000 7fcabd79d640 1 -- 10.20.193.48:0/4174776218 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcab8092510 con 0x7fcab805dc20 2026-02-12T18:05:59.743 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.742+0000 7fca977fe640 1 -- 10.20.193.48:0/4174776218 <== mon.6 v2:10.20.193.48:3303/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5603 (secure 0 0 0) 0x7fcaac03c030 con 0x7fcab805dc20 2026-02-12T18:05:59.743 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.742+0000 7fca977fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T18:05:59.743 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.742+0000 7fca977fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:05:59.744 INFO:teuthology.misc.health.trial048.stdout: 2026-02-12T18:05:59.744 INFO:teuthology.misc.health.trial048.stdout:{"epoch":8,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","created":"2026-02-12T18:05:56.090643+0000","modified":"2026-02-12T18:05:57.981781+0000","last_up_change":"0.000000","last_in_change":"2026-02-12T18:05:57.981781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a8255145-baf3-4c84-9a14-58a24c915493","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"4cf3730c-446c-4c4f-baf9-b354e06bf2b9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4ca2a3bb-4801-48eb-9814-12473a6c12bc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e64b1a76-9d2c-4c4a-bd2d-7b5b8c1df21e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ad82216b-0e68-44da-a293-d4c97dec6b79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"accc3f03-6123-444b-8c5a-42e927b0ed23","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T18:05:59.745 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.743+0000 7fcabd79d640 10 monclient: shutdown 2026-02-12T18:05:59.745 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.743+0000 7fcabd79d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:05:59.745 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.743+0000 7fcabd79d640 1 -- 10.20.193.48:0/4174776218 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcab805dc20 msgr2=0x7fcab810e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:05:59.745 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.743+0000 7fcabd79d640 1 --2- 10.20.193.48:0/4174776218 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcab805dc20 0x7fcab810e7f0 secure :-1 s=READY pgs=36 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaac0090b0 tx=0x7fcaac0047e0 comp rx=0 tx=0).stop 2026-02-12T18:05:59.745 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.743+0000 7fcabd79d640 1 -- 10.20.193.48:0/4174776218 shutdown_connections 2026-02-12T18:05:59.745 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.743+0000 7fcabd79d640 1 --2- 10.20.193.48:0/4174776218 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fcab8089df0 0x7fcab8131450 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:59.745 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.743+0000 7fcabd79d640 1 --2- 10.20.193.48:0/4174776218 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcab805dff0 0x7fcab810db60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:59.746 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.743+0000 7fcabd79d640 1 --2- 10.20.193.48:0/4174776218 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcab805dc20 0x7fcab810e7f0 unknown :-1 s=CLOSED pgs=36 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:05:59.746 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.743+0000 7fcabd79d640 1 -- 10.20.193.48:0/4174776218 >> 10.20.193.48:0/4174776218 conn(0x7fcab80546d0 msgr2=0x7fcab8124ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:05:59.746 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.743+0000 7fcabd79d640 1 -- 10.20.193.48:0/4174776218 shutdown_connections 2026-02-12T18:05:59.746 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:05:59.743+0000 7fcabd79d640 1 -- 10.20.193.48:0/4174776218 wait complete. 2026-02-12T18:05:59.750 DEBUG:teuthology.misc:0 of 6 OSDs are up 2026-02-12T18:05:59.769 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-12T18:05:59.768+0000 7f7c8986c640 -1 mgr.server handle_report got status from non-daemon mon.f 2026-02-12T18:05:59.769 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-12T18:05:59.768+0000 7f7c8986c640 -1 mgr.server handle_report got status from non-daemon mon.h 2026-02-12T18:05:59.771 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-12T18:05:59.771+0000 7f7c8986c640 -1 mgr.server handle_report got status from non-daemon mon.g 2026-02-12T18:05:59.776 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-12T18:05:59.775+0000 7f7c8986c640 -1 mgr.server handle_report got status from non-daemon mon.b 2026-02-12T18:05:59.776 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-12T18:05:59.775+0000 7f7c8986c640 -1 mgr.server handle_report got status from non-daemon mon.d 2026-02-12T18:05:59.776 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-12T18:05:59.775+0000 7f7c8986c640 -1 mgr.server handle_report got status from non-daemon mon.i 2026-02-12T18:05:59.776 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-12T18:05:59.776+0000 7f7c8986c640 -1 mgr.server handle_report got status from non-daemon mon.e 2026-02-12T18:06:00.761 INFO:tasks.ceph.osd.5.trial111.stderr:2026-02-12T18:06:00.760+0000 7f2ea5ff7640 -1 osd.5 0 waiting for initial osdmap 2026-02-12T18:06:00.761 INFO:tasks.ceph.osd.4.trial111.stderr:2026-02-12T18:06:00.760+0000 7ff2e0bf7640 -1 osd.4 0 waiting for initial osdmap 2026-02-12T18:06:00.762 INFO:tasks.ceph.osd.1.trial048.stderr:2026-02-12T18:06:00.760+0000 7f0b595f7640 -1 osd.1 0 waiting for initial osdmap 2026-02-12T18:06:00.762 INFO:tasks.ceph.osd.0.trial048.stderr:2026-02-12T18:06:00.760+0000 7f048c5f7640 -1 osd.0 0 waiting for initial osdmap 2026-02-12T18:06:00.762 INFO:tasks.ceph.osd.2.trial048.stderr:2026-02-12T18:06:00.760+0000 7f386cff7640 -1 osd.2 0 waiting for initial osdmap 2026-02-12T18:06:00.763 INFO:tasks.ceph.osd.5.trial111.stderr:2026-02-12T18:06:00.762+0000 7f2ea1fef640 -1 osd.5 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:06:00.763 INFO:tasks.ceph.osd.1.trial048.stderr:2026-02-12T18:06:00.762+0000 7f0b515e7640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:06:00.763 INFO:tasks.ceph.osd.4.trial111.stderr:2026-02-12T18:06:00.762+0000 7ff2dcbef640 -1 osd.4 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:06:00.764 INFO:tasks.ceph.osd.0.trial048.stderr:2026-02-12T18:06:00.762+0000 7f04845e7640 -1 osd.0 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:06:00.764 INFO:tasks.ceph.osd.2.trial048.stderr:2026-02-12T18:06:00.763+0000 7f3868f32640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:06:00.765 INFO:tasks.ceph.mgr.x.trial111.stderr:2026-02-12T18:06:00.765+0000 7f7c8986c640 -1 mgr.server handle_report got status from non-daemon mon.c 2026-02-12T18:06:01.769 INFO:tasks.ceph.osd.3.trial111.stderr:2026-02-12T18:06:01.769+0000 7f15e7df7640 -1 osd.3 0 waiting for initial osdmap 2026-02-12T18:06:01.771 INFO:tasks.ceph.osd.3.trial111.stderr:2026-02-12T18:06:01.771+0000 7f15e3def640 -1 osd.3 11 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2026-02-12T18:06:06.353 DEBUG:teuthology.orchestra.run.trial048:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2026-02-12T18:06:06.418 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.417+0000 7fcab5ff6640 10 monclient: get_monmap_and_config 2026-02-12T18:06:06.418 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.417+0000 7fcab5ff6640 10 monclient: build_initial_monmap 2026-02-12T18:06:06.418 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.417+0000 7fcab5ff6640 10 monclient: monmap: 2026-02-12T18:06:06.418 INFO:teuthology.misc.health.trial048.stderr:epoch 0 2026-02-12T18:06:06.418 INFO:teuthology.misc.health.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:06.418 INFO:teuthology.misc.health.trial048.stderr:last_changed 2026-02-12T18:06:06.418647+0000 2026-02-12T18:06:06.418 INFO:teuthology.misc.health.trial048.stderr:created 2026-02-12T18:06:06.418647+0000 2026-02-12T18:06:06.419 INFO:teuthology.misc.health.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:06.419 INFO:teuthology.misc.health.trial048.stderr:election_strategy: 1 2026-02-12T18:06:06.419 INFO:teuthology.misc.health.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:06.419 INFO:teuthology.misc.health.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:06.419 INFO:teuthology.misc.health.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:06.419 INFO:teuthology.misc.health.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:06.419 INFO:teuthology.misc.health.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:06.419 INFO:teuthology.misc.health.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:06.419 INFO:teuthology.misc.health.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:06.419 INFO:teuthology.misc.health.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:06.419 INFO:teuthology.misc.health.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:06.419 INFO:teuthology.misc.health.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:06.419 INFO:teuthology.misc.health.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:06.420 INFO:teuthology.misc.health.trial048.stderr: 2026-02-12T18:06:06.428 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcab5ff6640 1 Processor -- start 2026-02-12T18:06:06.428 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcab5ff6640 1 -- start start 2026-02-12T18:06:06.428 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcab5ff6640 10 monclient: init 2026-02-12T18:06:06.428 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcab5ff6640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:06.428 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcab5ff6640 10 monclient: _add_conns ranks=[4,1,7,6,0,2,8,9,10,5,3] 2026-02-12T18:06:06.428 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcab5ff6640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcab005dc20 0x7fcab0144660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:06.428 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcab5ff6640 10 monclient(hunting): picked mon.noname-c con 0x7fcab005dc20 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:06:06.428 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcab5ff6640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fcab005dff0 addr v1:10.20.193.111:6789/0 2026-02-12T18:06:06.429 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcab5ff6640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcab005e3e0 0x7fcab008a500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:06.429 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcab5ff6640 10 monclient(hunting): picked mon.noname-i con 0x7fcab005e3e0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:06.429 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcab5ff6640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcab0060390 con 0x7fcab005dff0 2026-02-12T18:06:06.429 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcab5ff6640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:06.429 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcab5ff6640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fcab0093a30 con 0x7fcab005dc20 2026-02-12T18:06:06.429 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcab5ff6640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:06.429 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcab5ff6640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fcab0092200 con 0x7fcab005e3e0 2026-02-12T18:06:06.429 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcab5ff6640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:06.429 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcab5ff6640 10 monclient(hunting): authenticate will time out at 605.144414s 2026-02-12T18:06:06.429 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcaaf7fe640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcab005dc20 0x7fcab0144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:06.429 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcaaf7fe640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcab005dc20 0x7fcab0144660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:52718/0 (socket says 10.20.193.48:52718) 2026-02-12T18:06:06.429 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcaaf7fe640 1 -- 10.20.193.48:0/4088301852 learned_addr learned my addr 10.20.193.48:0/4088301852 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:06.430 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcaaf7fe640 10 monclient(hunting): get_auth_request con 0x7fcab005dc20 auth_method 0 2026-02-12T18:06:06.430 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcaaf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:06.430 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcaaf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:06.430 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcaaf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:06.430 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcaaf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:06.430 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcaaf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:06.430 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcaaffff640 1 --2- 10.20.193.48:0/4088301852 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcab005e3e0 0x7fcab008a500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:06.430 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcaaf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:06.430 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcaaffff640 10 monclient(hunting): get_auth_request con 0x7fcab005e3e0 auth_method 0 2026-02-12T18:06:06.430 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcaaffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:06.431 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcaaffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:06.431 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcaaffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:06.431 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcaaf7fe640 10 monclient(hunting): handle_auth_done global_id 34123 payload 274 2026-02-12T18:06:06.431 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcaaf7fe640 1 -- 10.20.193.48:0/4088301852 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcab005e3e0 msgr2=0x7fcab008a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:06.431 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcaaf7fe640 1 --2- 10.20.193.48:0/4088301852 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcab005e3e0 0x7fcab008a500 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:06.431 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcaaf7fe640 1 -- 10.20.193.48:0/4088301852 >> v1:10.20.193.111:6789/0 conn(0x7fcab005dff0 legacy=0x7fcab0089df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:06.431 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcaaf7fe640 10 monclient: _finish_hunting 0 2026-02-12T18:06:06.431 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcaaf7fe640 1 monclient: found mon.noname-c 2026-02-12T18:06:06.431 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcaaf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:06.431 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcaaf7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:06:06.432 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.418+0000 7fcaaf7fe640 1 -- 10.20.193.48:0/4088301852 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcab005e830 con 0x7fcab005dc20 2026-02-12T18:06:06.432 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcaaf7fe640 1 -- 10.20.193.48:0/4088301852 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcab005dc20 msgr2=0x7fcab0144660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:06.432 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcaaf7fe640 1 --2- 10.20.193.48:0/4088301852 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcab005dc20 0x7fcab0144660 secure :-1 s=READY pgs=35 gs=2 cs=0 l=1 c_cookie=12144545662069715917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca9c0098d0 tx=0x7fca9c02eeb0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=a88a17ef622d33cd server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:06.432 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcaae7fc640 1 -- 10.20.193.48:0/4088301852 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fca9c035340 con 0x7fcab005dc20 2026-02-12T18:06:06.432 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcaae7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:06.432 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcaae7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:06:06.432 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcaae7fc640 10 monclient: dump: 2026-02-12T18:06:06.432 INFO:teuthology.misc.health.trial048.stderr:epoch 1 2026-02-12T18:06:06.432 INFO:teuthology.misc.health.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:06.432 INFO:teuthology.misc.health.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:06.432 INFO:teuthology.misc.health.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:06.433 INFO:teuthology.misc.health.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:06.433 INFO:teuthology.misc.health.trial048.stderr:election_strategy: 1 2026-02-12T18:06:06.433 INFO:teuthology.misc.health.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:06.433 INFO:teuthology.misc.health.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:06.433 INFO:teuthology.misc.health.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:06.433 INFO:teuthology.misc.health.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:06.433 INFO:teuthology.misc.health.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:06.433 INFO:teuthology.misc.health.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:06.433 INFO:teuthology.misc.health.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:06.433 INFO:teuthology.misc.health.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:06.433 INFO:teuthology.misc.health.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:06.433 INFO:teuthology.misc.health.trial048.stderr: 2026-02-12T18:06:06.434 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcaae7fc640 10 monclient: _finish_auth 0 2026-02-12T18:06:06.434 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcaae7fc640 10 monclient: _check_auth_tickets 2026-02-12T18:06:06.434 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcaae7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:06.434 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcab5ff6640 5 monclient: authenticate success, global_id 34123 2026-02-12T18:06:06.434 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcaae7fc640 1 -- 10.20.193.48:0/4088301852 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca9c0354c0 con 0x7fcab005dc20 2026-02-12T18:06:06.434 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcab5ff6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:06.434 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcaae7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:06.434 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcaae7fc640 1 -- 10.20.193.48:0/4088301852 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fca9c035af0 con 0x7fcab005dc20 2026-02-12T18:06:06.434 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcab5ff6640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:06.434 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcab5ff6640 4 set_mon_vals no callback set 2026-02-12T18:06:06.434 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcaae7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:06.434 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcaae7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:06:06.435 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcaae7fc640 10 monclient: dump: 2026-02-12T18:06:06.435 INFO:teuthology.misc.health.trial048.stderr:epoch 1 2026-02-12T18:06:06.435 INFO:teuthology.misc.health.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:06.435 INFO:teuthology.misc.health.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:06.435 INFO:teuthology.misc.health.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:06.435 INFO:teuthology.misc.health.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:06.435 INFO:teuthology.misc.health.trial048.stderr:election_strategy: 1 2026-02-12T18:06:06.435 INFO:teuthology.misc.health.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:06.435 INFO:teuthology.misc.health.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:06.435 INFO:teuthology.misc.health.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:06.435 INFO:teuthology.misc.health.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:06.435 INFO:teuthology.misc.health.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:06.436 INFO:teuthology.misc.health.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:06.436 INFO:teuthology.misc.health.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:06.436 INFO:teuthology.misc.health.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:06.436 INFO:teuthology.misc.health.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:06.436 INFO:teuthology.misc.health.trial048.stderr: 2026-02-12T18:06:06.436 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcab5ff6640 10 monclient: shutdown 2026-02-12T18:06:06.436 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcab5ff6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:06.436 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcab5ff6640 1 -- 10.20.193.48:0/4088301852 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcab005dc20 msgr2=0x7fcab0144660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:06.436 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcab5ff6640 1 --2- 10.20.193.48:0/4088301852 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcab005dc20 0x7fcab0144660 secure :-1 s=READY pgs=35 gs=2 cs=0 l=1 c_cookie=12144545662069715917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca9c0098d0 tx=0x7fca9c02eeb0 comp rx=0 tx=0).stop 2026-02-12T18:06:06.436 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcab5ff6640 1 -- 10.20.193.48:0/4088301852 shutdown_connections 2026-02-12T18:06:06.436 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcab5ff6640 1 --2- 10.20.193.48:0/4088301852 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcab005e3e0 0x7fcab008a500 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:06.436 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcab5ff6640 1 --2- 10.20.193.48:0/4088301852 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcab005dc20 0x7fcab0144660 unknown :-1 s=CLOSED pgs=35 gs=2 cs=0 l=1 c_cookie=12144545662069715917 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:06.437 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcab5ff6640 1 -- 10.20.193.48:0/4088301852 >> 10.20.193.48:0/4088301852 conn(0x7fcab00546d0 msgr2=0x7fcab0054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:06.437 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcab5ff6640 1 -- 10.20.193.48:0/4088301852 shutdown_connections 2026-02-12T18:06:06.437 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.421+0000 7fcab5ff6640 1 -- 10.20.193.48:0/4088301852 wait complete. 2026-02-12T18:06:06.437 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcab5ff6640 10 monclient: build_initial_monmap 2026-02-12T18:06:06.437 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcab5ff6640 10 monclient: monmap: 2026-02-12T18:06:06.437 INFO:teuthology.misc.health.trial048.stderr:epoch 0 2026-02-12T18:06:06.437 INFO:teuthology.misc.health.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:06.437 INFO:teuthology.misc.health.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:06.437 INFO:teuthology.misc.health.trial048.stderr:created 0.000000 2026-02-12T18:06:06.437 INFO:teuthology.misc.health.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:06.437 INFO:teuthology.misc.health.trial048.stderr:election_strategy: 1 2026-02-12T18:06:06.437 INFO:teuthology.misc.health.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:06.437 INFO:teuthology.misc.health.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:06.438 INFO:teuthology.misc.health.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:06.438 INFO:teuthology.misc.health.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:06.438 INFO:teuthology.misc.health.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:06.438 INFO:teuthology.misc.health.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:06.438 INFO:teuthology.misc.health.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:06.438 INFO:teuthology.misc.health.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:06.438 INFO:teuthology.misc.health.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:06.438 INFO:teuthology.misc.health.trial048.stderr: 2026-02-12T18:06:06.438 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcab5ff6640 1 Processor -- start 2026-02-12T18:06:06.438 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcab5ff6640 1 -- start start 2026-02-12T18:06:06.438 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcab5ff6640 10 monclient: init 2026-02-12T18:06:06.438 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcab5ff6640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:06.439 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcab5ff6640 10 monclient: _add_conns ranks=[8,0,4,1,2,3,7,5,6] 2026-02-12T18:06:06.439 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcab5ff6640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcab005dc20 0x7fcab010db60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:06.439 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcab5ff6640 10 monclient(hunting): picked mon.noname-e con 0x7fcab005dc20 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:06.439 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcab5ff6640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fcab005dff0 0x7fcab010e0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:06.439 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcab5ff6640 10 monclient(hunting): picked mon.noname-a con 0x7fcab005dff0 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:06:06.439 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcab5ff6640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcab005e3e0 0x7fcab010e5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:06.439 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcab5ff6640 10 monclient(hunting): picked mon.noname-c con 0x7fcab005e3e0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:06:06.439 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcab5ff6640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:06.439 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcab5ff6640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fcab01423e0 con 0x7fcab005dff0 2026-02-12T18:06:06.439 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcab5ff6640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:06.439 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcab5ff6640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fcab008e130 con 0x7fcab005e3e0 2026-02-12T18:06:06.439 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcab5ff6640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:06.440 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcab5ff6640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fcab0110980 con 0x7fcab005dc20 2026-02-12T18:06:06.440 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcab5ff6640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:06.440 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcab5ff6640 10 monclient(hunting): authenticate will time out at 605.148765s 2026-02-12T18:06:06.440 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcaaf7fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcab005dc20 0x7fcab010db60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:06.440 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcaaf7fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcab005dc20 0x7fcab010db60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:33810/0 (socket says 10.20.193.48:33810) 2026-02-12T18:06:06.440 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcaaf7fe640 1 -- 10.20.193.48:0/1764745795 learned_addr learned my addr 10.20.193.48:0/1764745795 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:06.440 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcaaf7fe640 10 monclient(hunting): get_auth_request con 0x7fcab005dc20 auth_method 0 2026-02-12T18:06:06.440 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcaaf7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:06.440 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcaaf7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:06.440 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcaaf7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:06.440 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcaaeffd640 1 --2- 10.20.193.48:0/1764745795 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fcab005dff0 0x7fcab010e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:06.440 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcaaffff640 1 --2- 10.20.193.48:0/1764745795 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcab005e3e0 0x7fcab010e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:06.440 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcaaf7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:06.441 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcaaf7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:06.441 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcaaf7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:06.441 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcaaffff640 10 monclient(hunting): get_auth_request con 0x7fcab005e3e0 auth_method 0 2026-02-12T18:06:06.441 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcaaffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:06.441 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcaaffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:06.441 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcaaffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:06.441 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcaaeffd640 10 monclient(hunting): get_auth_request con 0x7fcab005dff0 auth_method 0 2026-02-12T18:06:06.441 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcaaeffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:06.441 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcaaeffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:06.441 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcaaeffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:06.441 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcaaffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:06.441 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcaaffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:06.441 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcaaffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:06.442 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcaaeffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:06.442 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.422+0000 7fcaaeffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:06.442 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.423+0000 7fcaaeffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:06.442 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.423+0000 7fcaaf7fe640 10 monclient(hunting): handle_auth_done global_id 4229 payload 824 2026-02-12T18:06:06.442 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.423+0000 7fcaaf7fe640 1 -- 10.20.193.48:0/1764745795 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcab005e3e0 msgr2=0x7fcab010e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:06.442 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.423+0000 7fcaaf7fe640 1 --2- 10.20.193.48:0/1764745795 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcab005e3e0 0x7fcab010e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:06.442 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.423+0000 7fcaaf7fe640 1 -- 10.20.193.48:0/1764745795 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fcab005dff0 msgr2=0x7fcab010e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:06.442 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.423+0000 7fcaaf7fe640 1 --2- 10.20.193.48:0/1764745795 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fcab005dff0 0x7fcab010e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:06.442 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.423+0000 7fcaaf7fe640 10 monclient: _finish_hunting 0 2026-02-12T18:06:06.442 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.423+0000 7fcaaf7fe640 1 monclient: found mon.noname-e 2026-02-12T18:06:06.442 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.423+0000 7fcaaf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:06.442 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.423+0000 7fcaaf7fe640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:06:06.443 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.423+0000 7fcaaf7fe640 1 -- 10.20.193.48:0/1764745795 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca9c0094f0 con 0x7fcab005dc20 2026-02-12T18:06:06.443 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.425+0000 7fcaaf7fe640 1 -- 10.20.193.48:0/1764745795 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcab005dc20 msgr2=0x7fcab010db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:06.443 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.425+0000 7fcaaf7fe640 1 --2- 10.20.193.48:0/1764745795 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcab005dc20 0x7fcab010db60 secure :-1 s=READY pgs=30 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca9c004740 tx=0x7fca9c004770 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:06.443 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.425+0000 7fca8bfff640 1 -- 10.20.193.48:0/1764745795 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fca9c035e40 con 0x7fcab005dc20 2026-02-12T18:06:06.443 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.425+0000 7fca8bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:06.443 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.425+0000 7fca8bfff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:06:06.443 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.425+0000 7fca8bfff640 10 monclient: dump: 2026-02-12T18:06:06.443 INFO:teuthology.misc.health.trial048.stderr:epoch 1 2026-02-12T18:06:06.443 INFO:teuthology.misc.health.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:06.443 INFO:teuthology.misc.health.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:06.443 INFO:teuthology.misc.health.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:06.443 INFO:teuthology.misc.health.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:06.444 INFO:teuthology.misc.health.trial048.stderr:election_strategy: 1 2026-02-12T18:06:06.444 INFO:teuthology.misc.health.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:06.444 INFO:teuthology.misc.health.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:06.444 INFO:teuthology.misc.health.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:06.444 INFO:teuthology.misc.health.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:06.444 INFO:teuthology.misc.health.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:06.444 INFO:teuthology.misc.health.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:06.444 INFO:teuthology.misc.health.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:06.444 INFO:teuthology.misc.health.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:06.444 INFO:teuthology.misc.health.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:06.444 INFO:teuthology.misc.health.trial048.stderr: 2026-02-12T18:06:06.444 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.425+0000 7fca8bfff640 10 monclient: _finish_auth 0 2026-02-12T18:06:06.444 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.425+0000 7fca8bfff640 10 monclient: _check_auth_tickets 2026-02-12T18:06:06.445 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.425+0000 7fca8bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:06.445 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.425+0000 7fca8bfff640 1 -- 10.20.193.48:0/1764745795 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca9c0044f0 con 0x7fcab005dc20 2026-02-12T18:06:06.445 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.425+0000 7fcab5ff6640 5 monclient: authenticate success, global_id 4229 2026-02-12T18:06:06.445 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.425+0000 7fcab5ff6640 10 monclient: _renew_subs 2026-02-12T18:06:06.445 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.425+0000 7fcab5ff6640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:06.445 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.425+0000 7fcab5ff6640 1 -- 10.20.193.48:0/1764745795 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcab0142930 con 0x7fcab005dc20 2026-02-12T18:06:06.445 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.425+0000 7fca8bfff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:06.445 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.425+0000 7fca8bfff640 1 -- 10.20.193.48:0/1764745795 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fca9c003b90 con 0x7fcab005dc20 2026-02-12T18:06:06.445 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.425+0000 7fca8bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:06.445 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.425+0000 7fca8bfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:06:06.445 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.425+0000 7fca8bfff640 10 monclient: dump: 2026-02-12T18:06:06.445 INFO:teuthology.misc.health.trial048.stderr:epoch 1 2026-02-12T18:06:06.445 INFO:teuthology.misc.health.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:06.446 INFO:teuthology.misc.health.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:06.446 INFO:teuthology.misc.health.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:06.446 INFO:teuthology.misc.health.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:06.446 INFO:teuthology.misc.health.trial048.stderr:election_strategy: 1 2026-02-12T18:06:06.446 INFO:teuthology.misc.health.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:06.446 INFO:teuthology.misc.health.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:06.446 INFO:teuthology.misc.health.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:06.446 INFO:teuthology.misc.health.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:06.446 INFO:teuthology.misc.health.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:06.446 INFO:teuthology.misc.health.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:06.446 INFO:teuthology.misc.health.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:06.446 INFO:teuthology.misc.health.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:06.446 INFO:teuthology.misc.health.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:06.447 INFO:teuthology.misc.health.trial048.stderr: 2026-02-12T18:06:06.447 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.425+0000 7fcaadffb640 4 set_mon_vals no callback set 2026-02-12T18:06:06.447 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.425+0000 7fcab5ff6640 10 monclient: _renew_subs 2026-02-12T18:06:06.447 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.425+0000 7fcab5ff6640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:06.447 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.425+0000 7fcab5ff6640 1 -- 10.20.193.48:0/1764745795 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fcab0123930 con 0x7fcab005dc20 2026-02-12T18:06:06.447 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.425+0000 7fca8bfff640 1 -- 10.20.193.48:0/1764745795 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 4) ==== 51912+0+0 (secure 0 0 0) 0x7fca9c003cf0 con 0x7fcab005dc20 2026-02-12T18:06:06.447 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.426+0000 7fcab5ff6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:06.447 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.426+0000 7fcab5ff6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:06.447 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.426+0000 7fcab5ff6640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:06.447 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.426+0000 7fcab5ff6640 1 -- 10.20.193.48:0/1764745795 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcab0110270 con 0x7fcab005dc20 2026-02-12T18:06:06.447 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.426+0000 7fca8bfff640 1 --2- 10.20.193.48:0/1764745795 >> v2:10.20.193.111:6812/977811348 conn(0x7fca8003f760 0x7fca8005fc10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:06.448 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.426+0000 7fca8bfff640 1 -- 10.20.193.48:0/1764745795 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(14..14 src has 1..14) ==== 3147+0+0 (secure 0 0 0) 0x7fca9c077c20 con 0x7fcab005dc20 2026-02-12T18:06:06.448 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.426+0000 7fcaaeffd640 1 --2- 10.20.193.48:0/1764745795 >> v2:10.20.193.111:6812/977811348 conn(0x7fca8003f760 0x7fca8005fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:06.448 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.426+0000 7fcaaeffd640 10 monclient: get_auth_request con 0x7fca8003f760 auth_method 0 2026-02-12T18:06:06.448 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.428+0000 7fca8bfff640 1 -- 10.20.193.48:0/1764745795 <== mon.8 v2:10.20.193.48:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fca9c037440 con 0x7fcab005dc20 2026-02-12T18:06:06.448 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.428+0000 7fca8bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:06.449 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.428+0000 7fca8bfff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:06.449 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.428+0000 7fcaaeffd640 1 --2- 10.20.193.48:0/1764745795 >> v2:10.20.193.111:6812/977811348 conn(0x7fca8003f760 0x7fca8005fc10 secure :-1 s=READY pgs=32 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcab0145170 tx=0x7fcaa0007ec0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:06.533 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.532+0000 7fcab5ff6640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-12T18:06:06.533 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.532+0000 7fcab5ff6640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T18:06:06.533 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.532+0000 7fcab5ff6640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:06.533 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:06.532+0000 7fcab5ff6640 1 -- 10.20.193.48:0/1764745795 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcab0092510 con 0x7fcab005dc20 2026-02-12T18:06:07.179 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:07.179+0000 7fca8bfff640 1 -- 10.20.193.48:0/1764745795 <== mon.8 v2:10.20.193.48:3304/0 7 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fca9c004030 con 0x7fcab005dc20 2026-02-12T18:06:07.180 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:07.180+0000 7fca8bfff640 1 -- 10.20.193.48:0/1764745795 <== mon.8 v2:10.20.193.48:3304/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8995 (secure 0 0 0) 0x7fca9c0473a0 con 0x7fcab005dc20 2026-02-12T18:06:07.180 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:07.180+0000 7fca8bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T18:06:07.180 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:07.180+0000 7fca8bfff640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:07.181 INFO:teuthology.misc.health.trial048.stdout: 2026-02-12T18:06:07.181 INFO:teuthology.misc.health.trial048.stdout:{"epoch":14,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","created":"2026-02-12T18:05:56.090643+0000","modified":"2026-02-12T18:06:05.378511+0000","last_up_change":"2026-02-12T18:06:02.768915+0000","last_in_change":"2026-02-12T18:05:57.981781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T18:06:02.611941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8255145-baf3-4c84-9a14-58a24c915493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6801","nonce":447356640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6803","nonce":447356640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6807","nonce":447356640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6806","nonce":447356640}]},"public_addr":"10.20.193.48:6801/447356640","cluster_addr":"10.20.193.48:6803/447356640","heartbeat_back_addr":"10.20.193.48:6807/447356640","heartbeat_front_addr":"10.20.193.48:6806/447356640","state":["exists","up"]},{"osd":1,"uuid":"4cf3730c-446c-4c4f-baf9-b354e06bf2b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6808","nonce":3694032686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6809","nonce":3694032686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6811","nonce":3694032686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6810","nonce":3694032686}]},"public_addr":"10.20.193.48:6808/3694032686","cluster_addr":"10.20.193.48:6809/3694032686","heartbeat_back_addr":"10.20.193.48:6811/3694032686","heartbeat_front_addr":"10.20.193.48:6810/3694032686","state":["exists","up"]},{"osd":2,"uuid":"4ca2a3bb-4801-48eb-9814-12473a6c12bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6800","nonce":2690693575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6802","nonce":2690693575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6805","nonce":2690693575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6804","nonce":2690693575}]},"public_addr":"10.20.193.48:6800/2690693575","cluster_addr":"10.20.193.48:6802/2690693575","heartbeat_back_addr":"10.20.193.48:6805/2690693575","heartbeat_front_addr":"10.20.193.48:6804/2690693575","state":["exists","up"]},{"osd":3,"uuid":"e64b1a76-9d2c-4c4a-bd2d-7b5b8c1df21e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6800","nonce":449363714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6801","nonce":449363714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6803","nonce":449363714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6802","nonce":449363714}]},"public_addr":"10.20.193.111:6800/449363714","cluster_addr":"10.20.193.111:6801/449363714","heartbeat_back_addr":"10.20.193.111:6803/449363714","heartbeat_front_addr":"10.20.193.111:6802/449363714","state":["exists","up"]},{"osd":4,"uuid":"ad82216b-0e68-44da-a293-d4c97dec6b79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6808","nonce":3554486394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6809","nonce":3554486394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6811","nonce":3554486394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6810","nonce":3554486394}]},"public_addr":"10.20.193.111:6808/3554486394","cluster_addr":"10.20.193.111:6809/3554486394","heartbeat_back_addr":"10.20.193.111:6811/3554486394","heartbeat_front_addr":"10.20.193.111:6810/3554486394","state":["exists","up"]},{"osd":5,"uuid":"accc3f03-6123-444b-8c5a-42e927b0ed23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6804","nonce":1701961573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6805","nonce":1701961573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6807","nonce":1701961573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6806","nonce":1701961573}]},"public_addr":"10.20.193.111:6804/1701961573","cluster_addr":"10.20.193.111:6805/1701961573","heartbeat_back_addr":"10.20.193.111:6807/1701961573","heartbeat_front_addr":"10.20.193.111:6806/1701961573","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T18:05:59.805170+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T18:05:59.787798+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T18:05:59.791881+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T18:06:07.183 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:07.182+0000 7fcab5ff6640 1 -- 10.20.193.48:0/1764745795 >> v2:10.20.193.111:6812/977811348 conn(0x7fca8003f760 msgr2=0x7fca8005fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:07.183 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:07.182+0000 7fcab5ff6640 1 --2- 10.20.193.48:0/1764745795 >> v2:10.20.193.111:6812/977811348 conn(0x7fca8003f760 0x7fca8005fc10 secure :-1 s=READY pgs=32 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcab0145170 tx=0x7fcaa0007ec0 comp rx=0 tx=0).stop 2026-02-12T18:06:07.183 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:07.182+0000 7fcab5ff6640 10 monclient: shutdown 2026-02-12T18:06:07.183 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:07.182+0000 7fcab5ff6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:07.183 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:07.182+0000 7fcab5ff6640 1 -- 10.20.193.48:0/1764745795 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcab005dc20 msgr2=0x7fcab010db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:07.183 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:07.182+0000 7fcab5ff6640 1 --2- 10.20.193.48:0/1764745795 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcab005dc20 0x7fcab010db60 secure :-1 s=READY pgs=30 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca9c004740 tx=0x7fca9c004770 comp rx=0 tx=0).stop 2026-02-12T18:06:07.183 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:07.182+0000 7fcab5ff6640 1 -- 10.20.193.48:0/1764745795 shutdown_connections 2026-02-12T18:06:07.183 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:07.182+0000 7fcab5ff6640 1 --2- 10.20.193.48:0/1764745795 >> v2:10.20.193.111:6812/977811348 conn(0x7fca8003f760 0x7fca8005fc10 unknown :-1 s=CLOSED pgs=32 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:07.184 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:07.182+0000 7fcab5ff6640 1 --2- 10.20.193.48:0/1764745795 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcab005e3e0 0x7fcab010e5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:07.184 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:07.182+0000 7fcab5ff6640 1 --2- 10.20.193.48:0/1764745795 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fcab005dff0 0x7fcab010e0a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:07.184 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:07.182+0000 7fcab5ff6640 1 --2- 10.20.193.48:0/1764745795 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcab005dc20 0x7fcab010db60 unknown :-1 s=CLOSED pgs=30 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:07.184 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:07.182+0000 7fcab5ff6640 1 -- 10.20.193.48:0/1764745795 >> 10.20.193.48:0/1764745795 conn(0x7fcab00546d0 msgr2=0x7fcab01439f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:07.184 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:07.182+0000 7fcab5ff6640 1 -- 10.20.193.48:0/1764745795 shutdown_connections 2026-02-12T18:06:07.184 INFO:teuthology.misc.health.trial048.stderr:2026-02-12T18:06:07.182+0000 7fcab5ff6640 1 -- 10.20.193.48:0/1764745795 wait complete. 2026-02-12T18:06:07.191 DEBUG:teuthology.misc:6 of 6 OSDs are up 2026-02-12T18:06:07.191 INFO:tasks.ceph:Creating RBD pool 2026-02-12T18:06:07.191 DEBUG:teuthology.orchestra.run.trial048:> sudo ceph --cluster ceph osd pool create rbd 8 2026-02-12T18:06:07.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.253+0000 7f69a877e640 10 monclient: get_monmap_and_config 2026-02-12T18:06:07.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.253+0000 7f69a877e640 10 monclient: build_initial_monmap 2026-02-12T18:06:07.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.253+0000 7f69a877e640 10 monclient: monmap: 2026-02-12T18:06:07.254 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:07.254 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:07.255 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:07.254855+0000 2026-02-12T18:06:07.255 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:07.254855+0000 2026-02-12T18:06:07.255 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:07.255 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:07.255 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:07.255 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:07.255 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:07.255 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:07.255 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:07.255 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:07.255 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:07.255 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:07.256 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:07.256 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:07.256 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:07.256 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:07.264 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a877e640 1 Processor -- start 2026-02-12T18:06:07.264 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a877e640 1 -- start start 2026-02-12T18:06:07.264 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a877e640 10 monclient: init 2026-02-12T18:06:07.264 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a877e640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:07.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a877e640 10 monclient: _add_conns ranks=[8,6,10,2,7,5,1,3,4,9,0] 2026-02-12T18:06:07.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a877e640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f69a00914d0 0x7f69a005c950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:07.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a877e640 10 monclient(hunting): picked mon.noname-e con 0x7f69a00914d0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:07.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a877e640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f69a008e210 0x7f69a005ce90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:07.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a877e640 10 monclient(hunting): picked mon.noname-d con 0x7f69a008e210 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:06:07.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a877e640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f69a005e4b0 0x7f69a005d3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:07.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a877e640 10 monclient(hunting): picked mon.noname-f con 0x7f69a005e4b0 addr v2:10.20.193.111:3300/0 2026-02-12T18:06:07.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a877e640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:07.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a877e640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f69a0093d70 con 0x7f69a005e4b0 2026-02-12T18:06:07.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a877e640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:07.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a877e640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f69a0092f90 con 0x7f69a008e210 2026-02-12T18:06:07.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a877e640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:07.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a877e640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f69a00918a0 con 0x7f69a00914d0 2026-02-12T18:06:07.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a877e640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:07.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a877e640 10 monclient(hunting): authenticate will time out at 605.980576s 2026-02-12T18:06:07.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a5cf2640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f69a008e210 0x7f69a005ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:07.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a64f3640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f69a00914d0 0x7f69a005c950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:07.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a5cf2640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f69a008e210 0x7f69a005ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:38040/0 (socket says 10.20.193.48:38040) 2026-02-12T18:06:07.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a64f3640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f69a00914d0 0x7f69a005c950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:33820/0 (socket says 10.20.193.48:33820) 2026-02-12T18:06:07.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a5cf2640 1 -- 10.20.193.48:0/3302067897 learned_addr learned my addr 10.20.193.48:0/3302067897 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:07.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a5cf2640 10 monclient(hunting): get_auth_request con 0x7f69a008e210 auth_method 0 2026-02-12T18:06:07.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a5cf2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:07.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a5cf2640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:07.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a5cf2640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:07.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a64f3640 10 monclient(hunting): get_auth_request con 0x7f69a00914d0 auth_method 0 2026-02-12T18:06:07.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a64f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:07.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a64f3640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:07.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a64f3640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:07.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a5cf2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:07.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a5cf2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:07.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a6cf4640 1 --2- 10.20.193.48:0/3302067897 >> v2:10.20.193.111:3300/0 conn(0x7f69a005e4b0 0x7f69a005d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:07.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a5cf2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:07.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a64f3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:07.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a64f3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:07.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a64f3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:07.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a6cf4640 10 monclient(hunting): get_auth_request con 0x7f69a005e4b0 auth_method 0 2026-02-12T18:06:07.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a6cf4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:07.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a6cf4640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:07.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a6cf4640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:07.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a5cf2640 10 monclient(hunting): handle_auth_done global_id 4263 payload 274 2026-02-12T18:06:07.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a5cf2640 1 -- 10.20.193.48:0/3302067897 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f69a00914d0 msgr2=0x7f69a005c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:07.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a5cf2640 1 --2- 10.20.193.48:0/3302067897 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f69a00914d0 0x7f69a005c950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:07.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a5cf2640 1 -- 10.20.193.48:0/3302067897 >> v2:10.20.193.111:3300/0 conn(0x7f69a005e4b0 msgr2=0x7f69a005d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:07.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a5cf2640 1 --2- 10.20.193.48:0/3302067897 >> v2:10.20.193.111:3300/0 conn(0x7f69a005e4b0 0x7f69a005d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:07.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a5cf2640 10 monclient: _finish_hunting 0 2026-02-12T18:06:07.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a5cf2640 1 monclient: found mon.noname-d 2026-02-12T18:06:07.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a5cf2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:07.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a5cf2640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:06:07.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.254+0000 7f69a5cf2640 1 -- 10.20.193.48:0/3302067897 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a004dc20 con 0x7f69a008e210 2026-02-12T18:06:07.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a5cf2640 1 -- 10.20.193.48:0/3302067897 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f69a008e210 msgr2=0x7f69a005ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:07.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a5cf2640 1 --2- 10.20.193.48:0/3302067897 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f69a008e210 0x7f69a005ce90 secure :-1 s=READY pgs=39 gs=2 cs=0 l=1 c_cookie=5011735017254459199 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69940098d0 tx=0x7f699402ede0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=458d4271e3d6973f server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:07.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a54f1640 1 -- 10.20.193.48:0/3302067897 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6994035340 con 0x7f69a008e210 2026-02-12T18:06:07.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a54f1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:07.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a54f1640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:06:07.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a54f1640 10 monclient: dump: 2026-02-12T18:06:07.269 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:07.269 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:07.269 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:07.269 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:07.269 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:07.269 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:07.270 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:07.270 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:07.270 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:07.270 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:07.270 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:07.270 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:07.270 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:07.270 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:07.270 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:07.270 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:07.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a54f1640 10 monclient: _finish_auth 0 2026-02-12T18:06:07.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a54f1640 10 monclient: _check_auth_tickets 2026-02-12T18:06:07.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a54f1640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:07.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a54f1640 1 -- 10.20.193.48:0/3302067897 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69940354c0 con 0x7f69a008e210 2026-02-12T18:06:07.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a54f1640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:07.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a877e640 5 monclient: authenticate success, global_id 4263 2026-02-12T18:06:07.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a54f1640 1 -- 10.20.193.48:0/3302067897 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6994035af0 con 0x7f69a008e210 2026-02-12T18:06:07.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a877e640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:07.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a54f1640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:07.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a877e640 4 set_mon_vals no callback set 2026-02-12T18:06:07.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a54f1640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:06:07.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a54f1640 10 monclient: dump: 2026-02-12T18:06:07.271 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:07.271 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:07.271 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:07.272 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:07.272 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:07.272 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:07.272 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:07.272 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:07.272 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:07.272 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:07.272 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:07.272 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:07.272 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:07.272 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:07.272 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:07.272 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:07.273 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a877e640 10 monclient: shutdown 2026-02-12T18:06:07.273 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a877e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:07.273 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a877e640 1 -- 10.20.193.48:0/3302067897 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f69a008e210 msgr2=0x7f69a005ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:07.273 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a877e640 1 --2- 10.20.193.48:0/3302067897 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f69a008e210 0x7f69a005ce90 secure :-1 s=READY pgs=39 gs=2 cs=0 l=1 c_cookie=5011735017254459199 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f69940098d0 tx=0x7f699402ede0 comp rx=0 tx=0).stop 2026-02-12T18:06:07.273 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a877e640 1 -- 10.20.193.48:0/3302067897 shutdown_connections 2026-02-12T18:06:07.273 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a877e640 1 --2- 10.20.193.48:0/3302067897 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f69a008e210 0x7f69a005ce90 unknown :-1 s=CLOSED pgs=39 gs=2 cs=0 l=1 c_cookie=5011735017254459199 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:07.273 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a877e640 1 --2- 10.20.193.48:0/3302067897 >> v2:10.20.193.111:3300/0 conn(0x7f69a005e4b0 0x7f69a005d3d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:07.273 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a877e640 1 --2- 10.20.193.48:0/3302067897 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f69a00914d0 0x7f69a005c950 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:07.273 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a877e640 1 -- 10.20.193.48:0/3302067897 >> 10.20.193.48:0/3302067897 conn(0x7f69a00548a0 msgr2=0x7f69a0097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:07.273 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a877e640 1 -- 10.20.193.48:0/3302067897 shutdown_connections 2026-02-12T18:06:07.273 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.257+0000 7f69a877e640 1 -- 10.20.193.48:0/3302067897 wait complete. 2026-02-12T18:06:07.273 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.258+0000 7f69a877e640 10 monclient: build_initial_monmap 2026-02-12T18:06:07.274 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.258+0000 7f69a877e640 10 monclient: monmap: 2026-02-12T18:06:07.274 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:07.274 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:07.274 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:07.274 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:07.274 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:07.274 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:07.274 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:07.274 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:07.274 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:07.274 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:07.274 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:07.274 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:07.275 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:07.275 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:07.275 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:07.275 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:07.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.258+0000 7f69a877e640 1 Processor -- start 2026-02-12T18:06:07.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.258+0000 7f69a877e640 1 -- start start 2026-02-12T18:06:07.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.258+0000 7f69a877e640 10 monclient: init 2026-02-12T18:06:07.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a877e640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:07.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a877e640 10 monclient: _add_conns ranks=[5,8,1,7,2,6,3,4,0] 2026-02-12T18:06:07.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a877e640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f69a005e4b0 0x7f69a01bb1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:07.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a877e640 10 monclient(hunting): picked mon.noname-h con 0x7f69a005e4b0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:07.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a877e640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f69a008e210 0x7f69a01db580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:07.276 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a877e640 10 monclient(hunting): picked mon.noname-e con 0x7f69a008e210 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:07.276 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a877e640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f69a00914d0 0x7f69a01d4f60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:07.276 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a877e640 10 monclient(hunting): picked mon.noname-f con 0x7f69a00914d0 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:06:07.276 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a877e640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:07.276 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a877e640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f69a0094520 con 0x7f69a00914d0 2026-02-12T18:06:07.276 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a877e640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:07.276 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a877e640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f69a01bbb50 con 0x7f69a005e4b0 2026-02-12T18:06:07.276 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a877e640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:07.276 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a877e640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f69a01ba660 con 0x7f69a008e210 2026-02-12T18:06:07.276 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a877e640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:07.276 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a877e640 10 monclient(hunting): authenticate will time out at 605.985163s 2026-02-12T18:06:07.276 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a5cf2640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f69a008e210 0x7f69a01db580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:07.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a5cf2640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f69a008e210 0x7f69a01db580 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:33836/0 (socket says 10.20.193.48:33836) 2026-02-12T18:06:07.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a5cf2640 1 -- 10.20.193.48:0/2432831920 learned_addr learned my addr 10.20.193.48:0/2432831920 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:07.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a5cf2640 10 monclient(hunting): get_auth_request con 0x7f69a008e210 auth_method 0 2026-02-12T18:06:07.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a5cf2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:07.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a5cf2640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:07.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a5cf2640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:07.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a5cf2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:07.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a5cf2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:07.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a5cf2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:07.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a64f3640 1 --2- 10.20.193.48:0/2432831920 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f69a005e4b0 0x7f69a01bb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:07.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a6cf4640 1 --2- 10.20.193.48:0/2432831920 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f69a00914d0 0x7f69a01d4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:07.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a6cf4640 10 monclient(hunting): get_auth_request con 0x7f69a00914d0 auth_method 0 2026-02-12T18:06:07.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a6cf4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:07.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a6cf4640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:07.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a6cf4640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:07.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a64f3640 10 monclient(hunting): get_auth_request con 0x7f69a005e4b0 auth_method 0 2026-02-12T18:06:07.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a64f3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:07.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a64f3640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:07.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a64f3640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:07.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a5cf2640 10 monclient(hunting): handle_auth_done global_id 4247 payload 824 2026-02-12T18:06:07.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a5cf2640 1 -- 10.20.193.48:0/2432831920 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f69a005e4b0 msgr2=0x7f69a01bb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:07.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a5cf2640 1 --2- 10.20.193.48:0/2432831920 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f69a005e4b0 0x7f69a01bb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:07.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a5cf2640 1 -- 10.20.193.48:0/2432831920 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f69a00914d0 msgr2=0x7f69a01d4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:07.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a5cf2640 1 --2- 10.20.193.48:0/2432831920 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f69a00914d0 0x7f69a01d4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:07.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a5cf2640 10 monclient: _finish_hunting 0 2026-02-12T18:06:07.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a5cf2640 1 monclient: found mon.noname-e 2026-02-12T18:06:07.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a5cf2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:07.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a5cf2640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:06:07.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.259+0000 7f69a5cf2640 1 -- 10.20.193.48:0/2432831920 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69940094f0 con 0x7f69a008e210 2026-02-12T18:06:07.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.261+0000 7f69a5cf2640 1 -- 10.20.193.48:0/2432831920 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f69a008e210 msgr2=0x7f69a01db580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:07.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.261+0000 7f69a5cf2640 1 --2- 10.20.193.48:0/2432831920 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f69a008e210 0x7f69a01db580 secure :-1 s=READY pgs=31 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6994004740 tx=0x7f6994004770 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:07.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.261+0000 7f6986ffd640 1 -- 10.20.193.48:0/2432831920 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6994035e00 con 0x7f69a008e210 2026-02-12T18:06:07.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.261+0000 7f6986ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:07.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.261+0000 7f6986ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:06:07.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.261+0000 7f6986ffd640 10 monclient: dump: 2026-02-12T18:06:07.279 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:07.279 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:07.279 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:07.280 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:07.280 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:07.280 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:07.280 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:07.280 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:07.280 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:07.280 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:07.280 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:07.280 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:07.280 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:07.280 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:07.280 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:07.280 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:07.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.261+0000 7f6986ffd640 10 monclient: _finish_auth 0 2026-02-12T18:06:07.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.261+0000 7f6986ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:06:07.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.261+0000 7f6986ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:07.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.261+0000 7f6986ffd640 1 -- 10.20.193.48:0/2432831920 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6994037900 con 0x7f69a008e210 2026-02-12T18:06:07.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.261+0000 7f6986ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:07.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.261+0000 7f6986ffd640 1 -- 10.20.193.48:0/2432831920 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6994040410 con 0x7f69a008e210 2026-02-12T18:06:07.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.261+0000 7f6986ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:07.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.261+0000 7f69a4cf0640 4 set_mon_vals no callback set 2026-02-12T18:06:07.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.261+0000 7f6986ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:06:07.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.261+0000 7f6986ffd640 10 monclient: dump: 2026-02-12T18:06:07.281 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:07.281 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:07.282 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:07.282 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:07.282 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:07.282 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:07.282 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:07.282 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:07.282 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:07.282 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:07.282 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:07.282 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:07.282 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:07.282 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:07.282 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:07.283 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:07.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.261+0000 7f69a877e640 5 monclient: authenticate success, global_id 4247 2026-02-12T18:06:07.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.261+0000 7f69a877e640 10 monclient: _renew_subs 2026-02-12T18:06:07.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.261+0000 7f69a877e640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:07.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.261+0000 7f69a877e640 1 -- 10.20.193.48:0/2432831920 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69a01bc9c0 con 0x7f69a008e210 2026-02-12T18:06:07.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.261+0000 7f69a877e640 10 monclient: _renew_subs 2026-02-12T18:06:07.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.261+0000 7f69a877e640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:07.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.261+0000 7f69a877e640 1 -- 10.20.193.48:0/2432831920 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f69a01d54a0 con 0x7f69a008e210 2026-02-12T18:06:07.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.262+0000 7f69a877e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:07.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.262+0000 7f69a877e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:07.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.262+0000 7f69a877e640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:07.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.262+0000 7f69a877e640 1 -- 10.20.193.48:0/2432831920 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69a005c950 con 0x7f69a008e210 2026-02-12T18:06:07.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.262+0000 7f6986ffd640 1 -- 10.20.193.48:0/2432831920 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f6994046020 con 0x7f69a008e210 2026-02-12T18:06:07.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.262+0000 7f6986ffd640 1 --2- 10.20.193.48:0/2432831920 >> v2:10.20.193.111:6812/977811348 conn(0x7f697003f800 0x7f697005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:07.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.263+0000 7f6986ffd640 1 -- 10.20.193.48:0/2432831920 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(14..14 src has 1..14) ==== 3147+0+0 (secure 0 0 0) 0x7f6994077b30 con 0x7f69a008e210 2026-02-12T18:06:07.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.263+0000 7f69a64f3640 1 --2- 10.20.193.48:0/2432831920 >> v2:10.20.193.111:6812/977811348 conn(0x7f697003f800 0x7f697005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:07.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.263+0000 7f69a64f3640 10 monclient: get_auth_request con 0x7f697003f800 auth_method 0 2026-02-12T18:06:07.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.265+0000 7f6986ffd640 1 -- 10.20.193.48:0/2432831920 <== mon.8 v2:10.20.193.48:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f699403fbe0 con 0x7f69a008e210 2026-02-12T18:06:07.285 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.265+0000 7f6986ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:07.285 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.265+0000 7f6986ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:07.285 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.265+0000 7f69a64f3640 1 --2- 10.20.193.48:0/2432831920 >> v2:10.20.193.111:6812/977811348 conn(0x7f697003f800 0x7f697005fcb0 secure :-1 s=READY pgs=33 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6990004740 tx=0x7f6990008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:07.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.368+0000 7f69a877e640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-12T18:06:07.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.368+0000 7f69a877e640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-12T18:06:07.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.368+0000 7f69a877e640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:07.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:07.368+0000 7f69a877e640 1 -- 10.20.193.48:0/2432831920 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f69a01d56c0 con 0x7f69a008e210 2026-02-12T18:06:08.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.184+0000 7f6986ffd640 1 -- 10.20.193.48:0/2432831920 <== mon.8 v2:10.20.193.48:3304/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) ==== 109+0+0 (secure 0 0 0) 0x7f699403c0a0 con 0x7f69a008e210 2026-02-12T18:06:08.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.184+0000 7f6986ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2026-02-12T18:06:08.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.184+0000 7f6986ffd640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2026-02-12T18:06:08.185 INFO:teuthology.orchestra.run.trial048.stderr:pool 'rbd' created 2026-02-12T18:06:08.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.186+0000 7f69a877e640 1 -- 10.20.193.48:0/2432831920 >> v2:10.20.193.111:6812/977811348 conn(0x7f697003f800 msgr2=0x7f697005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:08.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.186+0000 7f69a877e640 1 --2- 10.20.193.48:0/2432831920 >> v2:10.20.193.111:6812/977811348 conn(0x7f697003f800 0x7f697005fcb0 secure :-1 s=READY pgs=33 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6990004740 tx=0x7f6990008040 comp rx=0 tx=0).stop 2026-02-12T18:06:08.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.186+0000 7f69a877e640 10 monclient: shutdown 2026-02-12T18:06:08.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.186+0000 7f69a877e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:08.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.186+0000 7f69a877e640 1 -- 10.20.193.48:0/2432831920 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f69a008e210 msgr2=0x7f69a01db580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:08.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.186+0000 7f69a877e640 1 --2- 10.20.193.48:0/2432831920 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f69a008e210 0x7f69a01db580 secure :-1 s=READY pgs=31 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6994004740 tx=0x7f6994004770 comp rx=0 tx=0).stop 2026-02-12T18:06:08.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.186+0000 7f69a877e640 1 -- 10.20.193.48:0/2432831920 shutdown_connections 2026-02-12T18:06:08.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.186+0000 7f69a877e640 1 --2- 10.20.193.48:0/2432831920 >> v2:10.20.193.111:6812/977811348 conn(0x7f697003f800 0x7f697005fcb0 unknown :-1 s=CLOSED pgs=33 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:08.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.186+0000 7f69a877e640 1 --2- 10.20.193.48:0/2432831920 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f69a00914d0 0x7f69a01d4f60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:08.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.186+0000 7f69a877e640 1 --2- 10.20.193.48:0/2432831920 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f69a008e210 0x7f69a01db580 unknown :-1 s=CLOSED pgs=31 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:08.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.186+0000 7f69a877e640 1 --2- 10.20.193.48:0/2432831920 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f69a005e4b0 0x7f69a01bb1c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:08.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.186+0000 7f69a877e640 1 -- 10.20.193.48:0/2432831920 >> 10.20.193.48:0/2432831920 conn(0x7f69a00548a0 msgr2=0x7f69a00900f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:08.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.186+0000 7f69a877e640 1 -- 10.20.193.48:0/2432831920 shutdown_connections 2026-02-12T18:06:08.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.186+0000 7f69a877e640 1 -- 10.20.193.48:0/2432831920 wait complete. 2026-02-12T18:06:08.196 DEBUG:teuthology.orchestra.run.trial048:> rbd --cluster ceph pool init rbd 2026-02-12T18:06:08.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.228+0000 7f3b3ace8240 10 monclient: get_monmap_and_config 2026-02-12T18:06:08.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.228+0000 7f3b3ace8240 10 monclient: build_initial_monmap 2026-02-12T18:06:08.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.228+0000 7f3b3ace8240 10 monclient: monmap: 2026-02-12T18:06:08.229 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:08.229 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:08.229 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:08.229607+0000 2026-02-12T18:06:08.229 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:08.229607+0000 2026-02-12T18:06:08.230 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:08.230 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:08.230 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:08.230 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:08.230 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:08.230 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:08.230 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:08.230 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:08.230 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:08.230 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:08.230 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:08.230 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:08.231 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:08.231 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:08.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b3ace8240 1 Processor -- start 2026-02-12T18:06:08.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b3ace8240 1 -- start start 2026-02-12T18:06:08.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b3ace8240 10 monclient: init 2026-02-12T18:06:08.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b3ace8240 10 monclient: _reopen_session rank -1 2026-02-12T18:06:08.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b3ace8240 10 monclient: _add_conns ranks=[6,3,0,5,2,1,8,9,7,10,4] 2026-02-12T18:06:08.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b3ace8240 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x1522550 0x1522920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:08.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b3ace8240 10 monclient(hunting): picked mon.noname-d con 0x1522550 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:06:08.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b3ace8240 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x1475710 0x1457ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:08.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b3ace8240 10 monclient(hunting): picked mon.noname-g con 0x1475710 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:08.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b3ace8240 10 monclient(hunting): picked mon.noname-a-legacy con 0x1458420 addr v1:10.20.193.48:6789/0 2026-02-12T18:06:08.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b3ace8240 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x12c6920 con 0x1458420 2026-02-12T18:06:08.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b3ace8240 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:08.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b3ace8240 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x1350870 con 0x1475710 2026-02-12T18:06:08.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b3ace8240 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:08.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b3ace8240 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x134c5a0 con 0x1522550 2026-02-12T18:06:08.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b3ace8240 10 monclient(hunting): _renew_subs 2026-02-12T18:06:08.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b3ace8240 10 monclient(hunting): authenticate will time out at 606.955370s 2026-02-12T18:06:08.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b38eb5640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x1522550 0x1522920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:08.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b3a13e640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x1458420 0x1589e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:35094/0 (socket says 10.20.193.48:35094) 2026-02-12T18:06:08.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b3a13e640 1 -- 10.20.193.48:0/4084003944 learned_addr learned my addr 10.20.193.48:0/4084003944 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:06:08.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b38eb5640 10 monclient(hunting): get_auth_request con 0x1522550 auth_method 0 2026-02-12T18:06:08.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b38eb5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:08.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b38eb5640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:08.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b38eb5640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:08.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b33fff640 1 --2- 10.20.193.48:0/4084003944 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x1475710 0x1457ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:08.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b33fff640 10 monclient(hunting): get_auth_request con 0x1475710 auth_method 0 2026-02-12T18:06:08.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b33fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:08.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b33fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:08.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b33fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:08.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b38eb5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:08.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b38eb5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:08.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b38eb5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:08.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b33fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:08.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b33fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:08.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b33fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:08.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b38eb5640 10 monclient(hunting): handle_auth_done global_id 4272 payload 274 2026-02-12T18:06:08.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b38eb5640 1 -- 10.20.193.48:0/4084003944 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x1475710 msgr2=0x1457ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:08.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b38eb5640 1 --2- 10.20.193.48:0/4084003944 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x1475710 0x1457ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:08.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b38eb5640 1 -- 10.20.193.48:0/4084003944 >> v1:10.20.193.48:6789/0 conn(0x1458420 legacy=0x1589e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:08.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b38eb5640 10 monclient: _finish_hunting 0 2026-02-12T18:06:08.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b38eb5640 1 monclient: found mon.noname-d 2026-02-12T18:06:08.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b38eb5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:08.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b38eb5640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:06:08.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.229+0000 7f3b38eb5640 1 -- 10.20.193.48:0/4084003944 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x12f0ac0 con 0x1522550 2026-02-12T18:06:08.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.232+0000 7f3b38eb5640 1 -- 10.20.193.48:0/4084003944 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x1522550 msgr2=0x1522920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:08.244 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.232+0000 7f3b38eb5640 1 --2- 10.20.193.48:0/4084003944 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x1522550 0x1522920 secure :-1 s=READY pgs=40 gs=2 cs=0 l=1 c_cookie=16790280070399021518 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b2800a490 tx=0x7f3b28058620 comp rx=0 tx=0).ready entity=mon.6 client_cookie=e9030ec3eb7451ce server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:08.244 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b337fe640 1 -- 10.20.193.48:0/4084003944 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3b28006370 con 0x1522550 2026-02-12T18:06:08.244 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b337fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:08.244 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b337fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:06:08.244 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b337fe640 10 monclient: dump: 2026-02-12T18:06:08.244 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:08.244 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:08.244 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:08.244 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:08.244 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:08.244 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:08.244 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:08.245 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:08.245 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:08.245 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:08.245 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:08.245 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:08.245 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:08.245 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:08.245 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:08.245 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:08.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b337fe640 10 monclient: _finish_auth 0 2026-02-12T18:06:08.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b337fe640 10 monclient: _check_auth_tickets 2026-02-12T18:06:08.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b337fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:08.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b337fe640 1 -- 10.20.193.48:0/4084003944 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b280064f0 con 0x1522550 2026-02-12T18:06:08.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b3ace8240 5 monclient: authenticate success, global_id 4272 2026-02-12T18:06:08.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b3ace8240 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:08.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b337fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:08.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b337fe640 1 -- 10.20.193.48:0/4084003944 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3b28006b20 con 0x1522550 2026-02-12T18:06:08.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b3ace8240 10 monclient: get_monmap_and_config success 2026-02-12T18:06:08.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b3ace8240 4 set_mon_vals no callback set 2026-02-12T18:06:08.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b337fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:08.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b337fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:06:08.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b337fe640 10 monclient: dump: 2026-02-12T18:06:08.246 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:08.246 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:08.246 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:08.247 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:08.247 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:08.247 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:08.247 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:08.247 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:08.247 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:08.247 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:08.247 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:08.247 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:08.247 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:08.247 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:08.247 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:08.247 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:08.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b3ace8240 10 monclient: shutdown 2026-02-12T18:06:08.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b3ace8240 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:08.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b3ace8240 1 -- 10.20.193.48:0/4084003944 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x1522550 msgr2=0x1522920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:08.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b3ace8240 1 --2- 10.20.193.48:0/4084003944 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x1522550 0x1522920 secure :-1 s=READY pgs=40 gs=2 cs=0 l=1 c_cookie=16790280070399021518 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b2800a490 tx=0x7f3b28058620 comp rx=0 tx=0).stop 2026-02-12T18:06:08.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b3ace8240 1 -- 10.20.193.48:0/4084003944 shutdown_connections 2026-02-12T18:06:08.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b3ace8240 1 --2- 10.20.193.48:0/4084003944 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x1475710 0x1457ee0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:08.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b3ace8240 1 --2- 10.20.193.48:0/4084003944 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x1522550 0x1522920 unknown :-1 s=CLOSED pgs=40 gs=2 cs=0 l=1 c_cookie=16790280070399021518 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:08.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b3ace8240 1 -- 10.20.193.48:0/4084003944 >> 10.20.193.48:0/4084003944 conn(0x1459030 msgr2=0x14789b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:08.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b3ace8240 1 -- 10.20.193.48:0/4084003944 shutdown_connections 2026-02-12T18:06:08.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b3ace8240 1 -- 10.20.193.48:0/4084003944 wait complete. 2026-02-12T18:06:08.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b3ace8240 10 monclient: build_initial_monmap 2026-02-12T18:06:08.249 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b3ace8240 10 monclient: monmap: 2026-02-12T18:06:08.249 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:08.249 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:08.249 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:08.249 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:08.249 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:08.249 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:08.249 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:08.249 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:08.249 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:08.249 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:08.249 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:08.249 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:08.250 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:08.250 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:08.250 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:08.250 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:08.250 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b3ace8240 1 Processor -- start 2026-02-12T18:06:08.250 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b3ace8240 1 -- start start 2026-02-12T18:06:08.250 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.233+0000 7f3b3ace8240 10 monclient: init 2026-02-12T18:06:08.250 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3ace8240 10 monclient: _reopen_session rank -1 2026-02-12T18:06:08.250 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3ace8240 10 monclient: _add_conns ranks=[7,3,2,4,8,1,6,0,5] 2026-02-12T18:06:08.250 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3ace8240 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x1458420 0x1472cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:08.250 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3ace8240 10 monclient(hunting): picked mon.noname-i con 0x1458420 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:08.250 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3ace8240 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x1475710 0x1473200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:08.250 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3ace8240 10 monclient(hunting): picked mon.noname-g con 0x1475710 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:08.251 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3ace8240 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x1522550 0x1473740 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:08.251 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3ace8240 10 monclient(hunting): picked mon.noname-b con 0x1522550 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:08.251 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3ace8240 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:08.251 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3ace8240 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x1346540 con 0x1522550 2026-02-12T18:06:08.251 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3ace8240 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:08.251 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3ace8240 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x1344170 con 0x1475710 2026-02-12T18:06:08.251 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3ace8240 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:08.251 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3ace8240 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x12a3330 con 0x1458420 2026-02-12T18:06:08.251 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3ace8240 10 monclient(hunting): _renew_subs 2026-02-12T18:06:08.251 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3ace8240 10 monclient(hunting): authenticate will time out at 606.960234s 2026-02-12T18:06:08.251 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3a13e640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x1522550 0x1473740 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:08.251 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3a13e640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x1522550 0x1473740 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:44960/0 (socket says 10.20.193.48:44960) 2026-02-12T18:06:08.251 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3a13e640 1 -- 10.20.193.48:0/1899755456 learned_addr learned my addr 10.20.193.48:0/1899755456 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:08.252 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3a13e640 10 monclient(hunting): get_auth_request con 0x1522550 auth_method 0 2026-02-12T18:06:08.252 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3a13e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:08.252 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3a13e640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:08.252 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3a13e640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:08.252 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b38eb5640 1 --2- 10.20.193.48:0/1899755456 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x1458420 0x1472cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:08.252 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3a13e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:08.252 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3a13e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:08.252 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b33fff640 1 --2- 10.20.193.48:0/1899755456 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x1475710 0x1473200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:08.252 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3a13e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:08.252 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b33fff640 10 monclient(hunting): get_auth_request con 0x1475710 auth_method 0 2026-02-12T18:06:08.252 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b33fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:08.252 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b33fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:08.253 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b33fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:08.253 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b38eb5640 10 monclient(hunting): get_auth_request con 0x1458420 auth_method 0 2026-02-12T18:06:08.253 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b38eb5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:08.253 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b38eb5640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:08.253 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b38eb5640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:08.253 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b33fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:08.253 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b33fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:08.253 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b33fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:08.253 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b38eb5640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:08.253 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b38eb5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:08.253 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b38eb5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:08.253 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3a13e640 10 monclient(hunting): handle_auth_done global_id 34112 payload 824 2026-02-12T18:06:08.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3a13e640 1 -- 10.20.193.48:0/1899755456 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x1458420 msgr2=0x1472cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:08.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3a13e640 1 --2- 10.20.193.48:0/1899755456 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x1458420 0x1472cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:08.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3a13e640 1 -- 10.20.193.48:0/1899755456 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x1475710 msgr2=0x1473200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:08.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3a13e640 1 --2- 10.20.193.48:0/1899755456 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x1475710 0x1473200 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:08.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3a13e640 10 monclient: _finish_hunting 0 2026-02-12T18:06:08.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3a13e640 1 monclient: found mon.noname-b 2026-02-12T18:06:08.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3a13e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:08.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3a13e640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:06:08.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.234+0000 7f3b3a13e640 1 -- 10.20.193.48:0/1899755456 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b28005c80 con 0x1522550 2026-02-12T18:06:08.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.236+0000 7f3b3a13e640 1 -- 10.20.193.48:0/1899755456 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x1522550 msgr2=0x1473740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:08.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.236+0000 7f3b3a13e640 1 --2- 10.20.193.48:0/1899755456 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x1522550 0x1473740 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b2c005680 tx=0x7f3b2c00c230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:08.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.236+0000 7f3b30ff9640 1 -- 10.20.193.48:0/1899755456 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3b2c00ce60 con 0x1522550 2026-02-12T18:06:08.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.236+0000 7f3b30ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:08.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.236+0000 7f3b30ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:06:08.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.236+0000 7f3b30ff9640 10 monclient: dump: 2026-02-12T18:06:08.255 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:08.255 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:08.255 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:08.255 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:08.255 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:08.255 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:08.255 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:08.255 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:08.255 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:08.255 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:08.256 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:08.256 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:08.256 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:08.256 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:08.256 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:08.256 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:08.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.236+0000 7f3b30ff9640 10 monclient: _finish_auth 0 2026-02-12T18:06:08.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.236+0000 7f3b30ff9640 10 monclient: _check_auth_tickets 2026-02-12T18:06:08.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.236+0000 7f3b30ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:08.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.236+0000 7f3b3ace8240 5 monclient: authenticate success, global_id 34112 2026-02-12T18:06:08.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.236+0000 7f3b3ace8240 10 monclient: _renew_subs 2026-02-12T18:06:08.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.236+0000 7f3b3ace8240 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:08.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.236+0000 7f3b3ace8240 1 -- 10.20.193.48:0/1899755456 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x12da490 con 0x1522550 2026-02-12T18:06:08.257 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.236+0000 7f3b30ff9640 1 -- 10.20.193.48:0/1899755456 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b2c0070d0 con 0x1522550 2026-02-12T18:06:08.257 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.236+0000 7f3b30ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:08.257 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.236+0000 7f3b30ff9640 1 -- 10.20.193.48:0/1899755456 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3b2c0056b0 con 0x1522550 2026-02-12T18:06:08.257 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.236+0000 7f3b30ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:08.257 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.236+0000 7f3b30ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:06:08.257 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.236+0000 7f3b30ff9640 10 monclient: dump: 2026-02-12T18:06:08.257 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:08.257 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:08.257 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:08.257 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:08.257 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:08.257 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:08.257 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:08.258 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:08.258 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:08.258 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:08.258 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:08.258 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:08.258 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:08.258 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:08.258 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:08.258 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:08.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.236+0000 7f3b3ace8240 10 monclient: _renew_subs 2026-02-12T18:06:08.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.236+0000 7f3b3ace8240 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:08.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.237+0000 7f3b3ace8240 1 -- 10.20.193.48:0/1899755456 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x12d4b50 con 0x1522550 2026-02-12T18:06:08.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.236+0000 7f3b32ffd640 4 set_mon_vals no callback set 2026-02-12T18:06:08.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.237+0000 7f3b3a13e640 1 --2- 10.20.193.48:0/1899755456 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x1522550 0x1473740 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b2c005680 tx=0x7f3b2c00c230 comp rx=0 tx=0).queue_received will delay after 1.77092e+09 on 0x7f3b2c0517b0 osd_map(15..15 src has 1..15) 2026-02-12T18:06:08.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.237+0000 7f3b30ff9640 1 -- 10.20.193.48:0/1899755456 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f3b2c007240 con 0x1522550 2026-02-12T18:06:08.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.237+0000 7f3b30ff9640 1 --2- 10.20.193.48:0/1899755456 >> v2:10.20.193.111:6812/977811348 conn(0x7f3b1803e020 0x7f3b1805e4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:08.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.238+0000 7f3b38eb5640 1 --2- 10.20.193.48:0/1899755456 >> v2:10.20.193.111:6812/977811348 conn(0x7f3b1803e020 0x7f3b1805e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:08.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.238+0000 7f3b38eb5640 10 monclient: get_auth_request con 0x7f3b1803e020 auth_method 0 2026-02-12T18:06:08.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:08.240+0000 7f3b38eb5640 1 --2- 10.20.193.48:0/1899755456 >> v2:10.20.193.111:6812/977811348 conn(0x7f3b1803e020 0x7f3b1805e4d0 secure :-1 s=READY pgs=34 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b28005fb0 tx=0x7f3b28064000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:09.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.065+0000 7f3b30ff9640 1 -- 10.20.193.48:0/1899755456 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(15..15 src has 1..15) ==== 3492+0+0 (secure 0 0 0) 0x7f3b2c0517b0 con 0x1522550 2026-02-12T18:06:09.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.065+0000 7f3b3ace8240 10 start_mon_command cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-12T18:06:09.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.065+0000 7f3b3ace8240 10 monclient: _send_command 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-12T18:06:09.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.065+0000 7f3b3ace8240 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:09.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.065+0000 7f3b3ace8240 1 -- 10.20.193.48:0/1899755456 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x12c6c50 con 0x1522550 2026-02-12T18:06:09.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.279+0000 7f3b30ff9640 1 -- 10.20.193.48:0/1899755456 <== mon.2 v2:10.20.193.48:3301/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v16) ==== 141+0+0 (secure 0 0 0) 0x7f3b2c017070 con 0x1522550 2026-02-12T18:06:09.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.279+0000 7f3b30ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2026-02-12T18:06:09.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.279+0000 7f3b30ff9640 10 monclient: _finish_command 1 = system:0 enabled application 'rbd' on pool 'rbd' 2026-02-12T18:06:09.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.279+0000 7f3b3ace8240 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:09.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.279+0000 7f3b3ace8240 1 -- 10.20.193.48:0/1899755456 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x12ca320 con 0x1522550 2026-02-12T18:06:09.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.281+0000 7f3b30ff9640 1 -- 10.20.193.48:0/1899755456 <== mon.2 v2:10.20.193.48:3301/0 7 ==== mon_get_version_reply(handle=1 version=16) ==== 24+0+0 (secure 0 0 0) 0x7f3b2c005850 con 0x1522550 2026-02-12T18:06:09.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.281+0000 7f3b30ff9640 10 monclient: handle_get_version_reply finishing 1 version 16 2026-02-12T18:06:09.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.281+0000 7f3b32ffd640 10 monclient: _renew_subs 2026-02-12T18:06:09.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.281+0000 7f3b32ffd640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:09.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.281+0000 7f3b32ffd640 1 -- 10.20.193.48:0/1899755456 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=16}) -- 0x7f3b10002c40 con 0x1522550 2026-02-12T18:06:09.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.281+0000 7f3b30ff9640 1 -- 10.20.193.48:0/1899755456 <== mon.2 v2:10.20.193.48:3301/0 8 ==== osd_map(16..16 src has 1..16) ==== 661+0+0 (secure 0 0 0) 0x7f3b2c007520 con 0x1522550 2026-02-12T18:06:09.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.281+0000 7f3b3ace8240 1 --2- 10.20.193.48:0/1899755456 >> v2:10.20.193.111:6804/1701961573 conn(0x159b130 0x15bb510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:09.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.281+0000 7f3b3ace8240 1 -- 10.20.193.48:0/1899755456 --> v2:10.20.193.111:6804/1701961573 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e16) -- 0x1455ca0 con 0x159b130 2026-02-12T18:06:09.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.281+0000 7f3b33fff640 1 --2- 10.20.193.48:0/1899755456 >> v2:10.20.193.111:6804/1701961573 conn(0x159b130 0x15bb510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:09.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.281+0000 7f3b33fff640 10 monclient: get_auth_request con 0x159b130 auth_method 0 2026-02-12T18:06:09.286 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.285+0000 7f3b33fff640 1 --2- 10.20.193.48:0/1899755456 >> v2:10.20.193.111:6804/1701961573 conn(0x159b130 0x15bb510 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:09.287 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.287+0000 7f3b33fff640 1 -- 10.20.193.48:0/1899755456 <== osd.5 v2:10.20.193.111:6804/1701961573 1 ==== osd_op_reply(1 rbd_trash [create] v16'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f3b20012040 con 0x159b130 2026-02-12T18:06:09.289 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.288+0000 7f3b3ace8240 1 -- 10.20.193.48:0/1899755456 --> v2:10.20.193.111:6804/1701961573 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) -- 0x15f66b0 con 0x159b130 2026-02-12T18:06:09.289 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.288+0000 7f3b33fff640 1 -- 10.20.193.48:0/1899755456 <== osd.5 v2:10.20.193.111:6804/1701961573 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3b20012040 con 0x159b130 2026-02-12T18:06:09.290 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.288+0000 7f3b3ace8240 1 -- 10.20.193.48:0/1899755456 --> v2:10.20.193.111:6804/1701961573 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e16) -- 0x15f57c0 con 0x159b130 2026-02-12T18:06:09.290 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.289+0000 7f3b33fff640 1 -- 10.20.193.48:0/1899755456 <== osd.5 v2:10.20.193.111:6804/1701961573 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3b20012040 con 0x159b130 2026-02-12T18:06:09.290 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.289+0000 7f3b327fc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:09.290 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:09.289+0000 7f3b327fc640 1 -- 10.20.193.48:0/1899755456 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f3b14001f40 con 0x1522550 2026-02-12T18:06:10.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:10.282+0000 7f3b30ff9640 1 -- 10.20.193.48:0/1899755456 <== mon.2 v2:10.20.193.48:3301/0 9 ==== pool_op_reply(tid 4 (0) Success v17) ==== 55+0+0 (secure 0 0 0) 0x7f3b2c011540 con 0x1522550 2026-02-12T18:06:10.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:10.282+0000 7f3b30ff9640 10 monclient: _renew_subs 2026-02-12T18:06:10.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:10.282+0000 7f3b30ff9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:10.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:10.282+0000 7f3b30ff9640 1 -- 10.20.193.48:0/1899755456 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=17}) -- 0x7f3b18002800 con 0x1522550 2026-02-12T18:06:10.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:10.282+0000 7f3b30ff9640 1 -- 10.20.193.48:0/1899755456 <== mon.2 v2:10.20.193.48:3301/0 10 ==== osd_map(17..17 src has 1..17) ==== 629+0+0 (secure 0 0 0) 0x7f3b2c00fdd0 con 0x1522550 2026-02-12T18:06:10.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:10.282+0000 7f3b32ffd640 1 -- 10.20.193.48:0/1899755456 --> v2:10.20.193.111:6804/1701961573 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x7f3b10005970 con 0x159b130 2026-02-12T18:06:10.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:10.283+0000 7f3b33fff640 1 -- 10.20.193.48:0/1899755456 <== osd.5 v2:10.20.193.111:6804/1701961573 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v17'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f3b20012040 con 0x159b130 2026-02-12T18:06:10.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:10.283+0000 7f3b327fc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:10.285 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:10.283+0000 7f3b327fc640 1 -- 10.20.193.48:0/1899755456 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v17) -- 0x7f3b14003350 con 0x1522550 2026-02-12T18:06:11.235 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.234+0000 7f3b1f7fe640 10 monclient: tick 2026-02-12T18:06:11.235 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.234+0000 7f3b1f7fe640 10 monclient: _check_auth_tickets 2026-02-12T18:06:11.235 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.234+0000 7f3b1f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:11.235 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.234+0000 7f3b1f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:11.386 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.385+0000 7f3b30ff9640 1 -- 10.20.193.48:0/1899755456 <== mon.2 v2:10.20.193.48:3301/0 11 ==== pool_op_reply(tid 6 (0) Success v18) ==== 43+0+0 (secure 0 0 0) 0x7f3b2c011bb0 con 0x1522550 2026-02-12T18:06:11.386 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.385+0000 7f3b30ff9640 10 monclient: _renew_subs 2026-02-12T18:06:11.386 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.385+0000 7f3b30ff9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:11.386 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.385+0000 7f3b30ff9640 1 -- 10.20.193.48:0/1899755456 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=18}) -- 0x7f3b18061f70 con 0x1522550 2026-02-12T18:06:11.386 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.385+0000 7f3b30ff9640 1 -- 10.20.193.48:0/1899755456 <== mon.2 v2:10.20.193.48:3301/0 12 ==== osd_map(18..18 src has 1..18) ==== 657+0+0 (secure 0 0 0) 0x7f3b2c0506b0 con 0x1522550 2026-02-12T18:06:11.387 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.385+0000 7f3b32ffd640 1 -- 10.20.193.48:0/1899755456 --> v2:10.20.193.111:6804/1701961573 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x7f3b10005cd0 con 0x159b130 2026-02-12T18:06:11.388 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.387+0000 7f3b33fff640 1 -- 10.20.193.48:0/1899755456 <== osd.5 v2:10.20.193.111:6804/1701961573 5 ==== osd_op_reply(7 rbd_info [write 0~19] v18'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b20012040 con 0x159b130 2026-02-12T18:06:11.388 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.387+0000 7f3b3ace8240 1 -- 10.20.193.48:0/1899755456 >> v2:10.20.193.111:6804/1701961573 conn(0x159b130 msgr2=0x15bb510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:11.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.387+0000 7f3b3ace8240 1 --2- 10.20.193.48:0/1899755456 >> v2:10.20.193.111:6804/1701961573 conn(0x159b130 0x15bb510 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.387+0000 7f3b3ace8240 1 -- 10.20.193.48:0/1899755456 >> v2:10.20.193.111:6812/977811348 conn(0x7f3b1803e020 msgr2=0x7f3b1805e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:11.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.387+0000 7f3b3ace8240 1 --2- 10.20.193.48:0/1899755456 >> v2:10.20.193.111:6812/977811348 conn(0x7f3b1803e020 0x7f3b1805e4d0 secure :-1 s=READY pgs=34 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b28005fb0 tx=0x7f3b28064000 comp rx=0 tx=0).stop 2026-02-12T18:06:11.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.387+0000 7f3b3ace8240 10 monclient: shutdown 2026-02-12T18:06:11.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.387+0000 7f3b3ace8240 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:11.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.387+0000 7f3b3ace8240 1 -- 10.20.193.48:0/1899755456 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x1522550 msgr2=0x1473740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:11.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.387+0000 7f3b3ace8240 1 --2- 10.20.193.48:0/1899755456 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x1522550 0x1473740 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b2c005680 tx=0x7f3b2c00c230 comp rx=0 tx=0).stop 2026-02-12T18:06:11.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.387+0000 7f3b3a13e640 1 -- 10.20.193.48:0/1899755456 reap_dead start 2026-02-12T18:06:11.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.387+0000 7f3b3ace8240 1 -- 10.20.193.48:0/1899755456 shutdown_connections 2026-02-12T18:06:11.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.387+0000 7f3b3ace8240 1 -- 10.20.193.48:0/1899755456 >> 10.20.193.48:0/1899755456 conn(0x1459030 msgr2=0x1479fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:11.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.387+0000 7f3b3ace8240 1 -- 10.20.193.48:0/1899755456 shutdown_connections 2026-02-12T18:06:11.390 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.387+0000 7f3b3ace8240 1 -- 10.20.193.48:0/1899755456 wait complete. 2026-02-12T18:06:11.391 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2026-02-12T18:06:11.392 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2026-02-12T18:06:11.393 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2026-02-12T18:06:11.497 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f54482cc640 10 monclient: get_monmap_and_config 2026-02-12T18:06:11.498 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f54482cc640 10 monclient: build_initial_monmap 2026-02-12T18:06:11.498 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f54482cc640 10 monclient: monmap: 2026-02-12T18:06:11.498 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:11.498 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:11.498 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:11.498119+0000 2026-02-12T18:06:11.498 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:11.498119+0000 2026-02-12T18:06:11.498 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:11.498 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:11.498 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:11.498 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:11.499 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:11.499 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:11.499 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:11.499 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:11.499 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:11.499 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:11.499 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:11.499 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:11.499 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:11.499 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:11.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f54482cc640 1 Processor -- start 2026-02-12T18:06:11.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f54482cc640 1 -- start start 2026-02-12T18:06:11.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f54482cc640 10 monclient: init 2026-02-12T18:06:11.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f54482cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:11.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f54482cc640 10 monclient: _add_conns ranks=[7,6,9,0,5,2,1,4,8,3,10] 2026-02-12T18:06:11.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f54482cc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f54400951a0 0x7f5440093850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:11.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f54482cc640 10 monclient(hunting): picked mon.noname-i con 0x7f54400951a0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:11.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f54482cc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5440096ad0 0x7f5440095570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:11.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f54482cc640 10 monclient(hunting): picked mon.noname-d con 0x7f5440096ad0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:06:11.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f54482cc640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f5440095ab0 0x7f54401a4ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:11.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f54482cc640 10 monclient(hunting): picked mon.noname-a con 0x7f5440095ab0 addr v2:10.20.193.48:3300/0 2026-02-12T18:06:11.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f54482cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:11.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f54482cc640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f5440096900 con 0x7f5440095ab0 2026-02-12T18:06:11.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f54482cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:11.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f54482cc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f5440092260 con 0x7f5440096ad0 2026-02-12T18:06:11.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f54482cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:11.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f54482cc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f5440093070 con 0x7f54400951a0 2026-02-12T18:06:11.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f54482cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:11.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f54482cc640 10 monclient(hunting): authenticate will time out at 610.223862s 2026-02-12T18:06:11.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f5445840640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5440096ad0 0x7f5440095570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:11.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f5446842640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f5440095ab0 0x7f54401a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:11.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f5445840640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5440096ad0 0x7f5440095570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:38054/0 (socket says 10.20.193.48:38054) 2026-02-12T18:06:11.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f5445840640 1 -- 10.20.193.48:0/4185559926 learned_addr learned my addr 10.20.193.48:0/4185559926 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:11.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f5446842640 10 monclient(hunting): get_auth_request con 0x7f5440095ab0 auth_method 0 2026-02-12T18:06:11.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.497+0000 7f5446842640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:11.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.498+0000 7f5446842640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:11.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.498+0000 7f5446842640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:11.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.498+0000 7f5445840640 10 monclient(hunting): get_auth_request con 0x7f5440096ad0 auth_method 0 2026-02-12T18:06:11.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.498+0000 7f5445840640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:11.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.498+0000 7f5445840640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:11.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.498+0000 7f5445840640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:11.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.498+0000 7f5445840640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:11.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.498+0000 7f5445840640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:11.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.498+0000 7f5445840640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:11.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.498+0000 7f5446842640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:11.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.498+0000 7f5446842640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:11.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.498+0000 7f5446842640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:11.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.498+0000 7f5446041640 1 --2- 10.20.193.48:0/4185559926 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f54400951a0 0x7f5440093850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:11.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.498+0000 7f5445840640 10 monclient(hunting): handle_auth_done global_id 4281 payload 274 2026-02-12T18:06:11.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.498+0000 7f5445840640 1 -- 10.20.193.48:0/4185559926 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f54400951a0 msgr2=0x7f5440093850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:11.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.498+0000 7f5445840640 1 --2- 10.20.193.48:0/4185559926 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f54400951a0 0x7f5440093850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.498+0000 7f5445840640 1 -- 10.20.193.48:0/4185559926 >> v2:10.20.193.48:3300/0 conn(0x7f5440095ab0 msgr2=0x7f54401a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:11.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.498+0000 7f5445840640 1 --2- 10.20.193.48:0/4185559926 >> v2:10.20.193.48:3300/0 conn(0x7f5440095ab0 0x7f54401a4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.498+0000 7f5445840640 10 monclient: _finish_hunting 0 2026-02-12T18:06:11.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.498+0000 7f5445840640 1 monclient: found mon.noname-d 2026-02-12T18:06:11.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.498+0000 7f5445840640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:11.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.498+0000 7f5445840640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:06:11.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.498+0000 7f5445840640 1 -- 10.20.193.48:0/4185559926 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f544004dc20 con 0x7f5440096ad0 2026-02-12T18:06:11.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.498+0000 7f5446842640 1 --2- 10.20.193.48:0/4185559926 >> v2:10.20.193.48:3300/0 conn(0x7f5440095ab0 0x7f54401a4ba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:06:11.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.500+0000 7f5445840640 1 -- 10.20.193.48:0/4185559926 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5440096ad0 msgr2=0x7f5440095570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:11.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.500+0000 7f5445840640 1 --2- 10.20.193.48:0/4185559926 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5440096ad0 0x7f5440095570 secure :-1 s=READY pgs=41 gs=1 cs=0 l=1 c_cookie=7515690454829483319 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5434009060 tx=0x7f543402edf0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=684d18a619e7c537 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:11.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.500+0000 7f544503f640 1 -- 10.20.193.48:0/4185559926 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5434035340 con 0x7f5440096ad0 2026-02-12T18:06:11.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.500+0000 7f544503f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:11.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.500+0000 7f544503f640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:06:11.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.500+0000 7f544503f640 10 monclient: dump: 2026-02-12T18:06:11.513 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:11.514 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:11.514 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:11.514 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:11.514 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:11.514 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:11.514 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:11.514 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:11.514 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:11.514 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:11.514 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:11.514 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:11.514 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:11.515 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:11.515 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:11.515 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:11.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.500+0000 7f544503f640 10 monclient: _finish_auth 0 2026-02-12T18:06:11.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.500+0000 7f544503f640 10 monclient: _check_auth_tickets 2026-02-12T18:06:11.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.500+0000 7f544503f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:11.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.500+0000 7f544503f640 1 -- 10.20.193.48:0/4185559926 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54340354c0 con 0x7f5440096ad0 2026-02-12T18:06:11.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.500+0000 7f544503f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:11.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.500+0000 7f54482cc640 5 monclient: authenticate success, global_id 4281 2026-02-12T18:06:11.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.500+0000 7f544503f640 1 -- 10.20.193.48:0/4185559926 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5434035af0 con 0x7f5440096ad0 2026-02-12T18:06:11.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.500+0000 7f54482cc640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:11.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.500+0000 7f54482cc640 4 set_mon_vals no callback set 2026-02-12T18:06:11.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.500+0000 7f544503f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:11.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.500+0000 7f544503f640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:06:11.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.500+0000 7f544503f640 10 monclient: dump: 2026-02-12T18:06:11.516 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:11.516 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:11.516 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:11.516 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:11.516 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:11.516 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:11.516 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:11.516 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:11.516 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:11.517 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:11.517 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:11.517 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:11.517 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:11.517 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:11.517 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:11.517 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:11.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.501+0000 7f54482cc640 10 monclient: shutdown 2026-02-12T18:06:11.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.501+0000 7f54482cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:11.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.501+0000 7f54482cc640 1 -- 10.20.193.48:0/4185559926 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5440096ad0 msgr2=0x7f5440095570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:11.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.501+0000 7f54482cc640 1 --2- 10.20.193.48:0/4185559926 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5440096ad0 0x7f5440095570 secure :-1 s=READY pgs=41 gs=1 cs=0 l=1 c_cookie=7515690454829483319 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5434009060 tx=0x7f543402edf0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.501+0000 7f54482cc640 1 -- 10.20.193.48:0/4185559926 shutdown_connections 2026-02-12T18:06:11.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.501+0000 7f54482cc640 1 --2- 10.20.193.48:0/4185559926 >> v2:10.20.193.48:3300/0 conn(0x7f5440095ab0 0x7f54401a4ba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.501+0000 7f54482cc640 1 --2- 10.20.193.48:0/4185559926 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5440096ad0 0x7f5440095570 unknown :-1 s=CLOSED pgs=41 gs=1 cs=0 l=1 c_cookie=7515690454829483319 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.501+0000 7f54482cc640 1 --2- 10.20.193.48:0/4185559926 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f54400951a0 0x7f5440093850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.501+0000 7f54482cc640 1 -- 10.20.193.48:0/4185559926 >> 10.20.193.48:0/4185559926 conn(0x7f54400548c0 msgr2=0x7f54400973a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:11.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.501+0000 7f54482cc640 1 -- 10.20.193.48:0/4185559926 shutdown_connections 2026-02-12T18:06:11.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.501+0000 7f54482cc640 1 -- 10.20.193.48:0/4185559926 wait complete. 2026-02-12T18:06:11.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.501+0000 7f54482cc640 10 monclient: build_initial_monmap 2026-02-12T18:06:11.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.501+0000 7f54482cc640 10 monclient: monmap: 2026-02-12T18:06:11.518 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:11.518 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:11.518 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:11.518 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:11.519 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:11.519 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:11.519 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:11.519 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:11.519 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:11.519 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:11.519 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:11.519 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:11.519 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:11.519 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:11.519 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:11.519 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:11.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.501+0000 7f54482cc640 1 Processor -- start 2026-02-12T18:06:11.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.501+0000 7f54482cc640 1 -- start start 2026-02-12T18:06:11.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.501+0000 7f54482cc640 10 monclient: init 2026-02-12T18:06:11.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f54482cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:11.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f54482cc640 10 monclient: _add_conns ranks=[5,7,4,6,8,0,2,1,3] 2026-02-12T18:06:11.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f54482cc640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f54400951a0 0x7f54401ab5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:11.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f54482cc640 10 monclient(hunting): picked mon.noname-h con 0x7f54400951a0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:11.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f54482cc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5440095ab0 0x7f54401abb20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:11.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f54482cc640 10 monclient(hunting): picked mon.noname-i con 0x7f5440095ab0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:11.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f54482cc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5440096ad0 0x7f5440195250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:11.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f54482cc640 10 monclient(hunting): picked mon.noname-c con 0x7f5440096ad0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:06:11.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f54482cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:11.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f54482cc640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f54401afe60 con 0x7f5440096ad0 2026-02-12T18:06:11.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f54482cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:11.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f54482cc640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f54401ac3f0 con 0x7f54400951a0 2026-02-12T18:06:11.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f54482cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:11.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f54482cc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f5440198ef0 con 0x7f5440095ab0 2026-02-12T18:06:11.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f54482cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:11.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f54482cc640 10 monclient(hunting): authenticate will time out at 610.228261s 2026-02-12T18:06:11.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5446842640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5440096ad0 0x7f5440195250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:11.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5446842640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5440096ad0 0x7f5440195250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:52736/0 (socket says 10.20.193.48:52736) 2026-02-12T18:06:11.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5446842640 1 -- 10.20.193.48:0/2496690644 learned_addr learned my addr 10.20.193.48:0/2496690644 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:11.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5446842640 10 monclient(hunting): get_auth_request con 0x7f5440096ad0 auth_method 0 2026-02-12T18:06:11.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5446842640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:11.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5446842640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:11.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5446842640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:11.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5446842640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:11.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5446842640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:11.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5446842640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:11.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5445840640 1 --2- 10.20.193.48:0/2496690644 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5440095ab0 0x7f54401abb20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:11.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5445840640 10 monclient(hunting): get_auth_request con 0x7f5440095ab0 auth_method 0 2026-02-12T18:06:11.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5445840640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:11.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5445840640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:11.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5445840640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:11.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5446041640 1 --2- 10.20.193.48:0/2496690644 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f54400951a0 0x7f54401ab5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:11.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5446041640 10 monclient(hunting): get_auth_request con 0x7f54400951a0 auth_method 0 2026-02-12T18:06:11.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5446041640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:11.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5446041640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:11.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5446041640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:11.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5446842640 10 monclient(hunting): handle_auth_done global_id 34141 payload 824 2026-02-12T18:06:11.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5446842640 1 -- 10.20.193.48:0/2496690644 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5440095ab0 msgr2=0x7f54401abb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:11.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5446842640 1 --2- 10.20.193.48:0/2496690644 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5440095ab0 0x7f54401abb20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5446842640 1 -- 10.20.193.48:0/2496690644 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f54400951a0 msgr2=0x7f54401ab5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:11.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5446842640 1 --2- 10.20.193.48:0/2496690644 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f54400951a0 0x7f54401ab5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5446842640 10 monclient: _finish_hunting 0 2026-02-12T18:06:11.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5446842640 1 monclient: found mon.noname-c 2026-02-12T18:06:11.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5446842640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:11.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5446842640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:06:11.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5446842640 1 -- 10.20.193.48:0/2496690644 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f543c00a500 con 0x7f5440096ad0 2026-02-12T18:06:11.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.502+0000 7f5445840640 1 --2- 10.20.193.48:0/2496690644 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5440095ab0 0x7f54401abb20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:06:11.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.504+0000 7f5446842640 1 -- 10.20.193.48:0/2496690644 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5440096ad0 msgr2=0x7f5440195250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:11.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.504+0000 7f5446842640 1 --2- 10.20.193.48:0/2496690644 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5440096ad0 0x7f5440195250 secure :-1 s=READY pgs=36 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f543c00fb30 tx=0x7f543c00af20 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:11.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.504+0000 7f5426ffd640 1 -- 10.20.193.48:0/2496690644 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f543c00dce0 con 0x7f5440096ad0 2026-02-12T18:06:11.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.504+0000 7f5426ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:11.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.504+0000 7f5426ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:06:11.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.504+0000 7f5426ffd640 10 monclient: dump: 2026-02-12T18:06:11.524 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:11.524 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:11.524 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:11.525 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:11.525 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:11.525 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:11.525 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:11.525 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:11.525 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:11.525 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:11.525 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:11.525 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:11.525 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:11.525 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:11.525 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:11.525 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:11.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.504+0000 7f5426ffd640 10 monclient: _finish_auth 0 2026-02-12T18:06:11.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.504+0000 7f5426ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:06:11.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.504+0000 7f5426ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:11.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.504+0000 7f5426ffd640 1 -- 10.20.193.48:0/2496690644 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f543c00de80 con 0x7f5440096ad0 2026-02-12T18:06:11.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.504+0000 7f5426ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:11.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.504+0000 7f5426ffd640 1 -- 10.20.193.48:0/2496690644 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f543c0054f0 con 0x7f5440096ad0 2026-02-12T18:06:11.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.504+0000 7f5426ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:11.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.504+0000 7f5426ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:06:11.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.504+0000 7f544483e640 4 set_mon_vals no callback set 2026-02-12T18:06:11.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.504+0000 7f5426ffd640 10 monclient: dump: 2026-02-12T18:06:11.526 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:11.526 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:11.527 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:11.527 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:11.527 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:11.527 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:11.527 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:11.527 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:11.527 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:11.527 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:11.527 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:11.527 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:11.527 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:11.527 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:11.527 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:11.528 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:11.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.504+0000 7f54482cc640 5 monclient: authenticate success, global_id 34141 2026-02-12T18:06:11.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.504+0000 7f54482cc640 10 monclient: _renew_subs 2026-02-12T18:06:11.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.504+0000 7f54482cc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:11.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.504+0000 7f54482cc640 1 -- 10.20.193.48:0/2496690644 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54340094f0 con 0x7f5440096ad0 2026-02-12T18:06:11.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.505+0000 7f54482cc640 10 monclient: _renew_subs 2026-02-12T18:06:11.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.505+0000 7f54482cc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:11.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.505+0000 7f54482cc640 1 -- 10.20.193.48:0/2496690644 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f544008ff50 con 0x7f5440096ad0 2026-02-12T18:06:11.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.505+0000 7f54482cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:11.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.505+0000 7f54482cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:11.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.505+0000 7f54482cc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:11.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.505+0000 7f54482cc640 1 -- 10.20.193.48:0/2496690644 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5440093850 con 0x7f5440096ad0 2026-02-12T18:06:11.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.505+0000 7f5426ffd640 1 -- 10.20.193.48:0/2496690644 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f543c012070 con 0x7f5440096ad0 2026-02-12T18:06:11.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.505+0000 7f5426ffd640 1 --2- 10.20.193.48:0/2496690644 >> v2:10.20.193.111:6812/977811348 conn(0x7f541003f730 0x7f541005fbe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:11.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.505+0000 7f5426ffd640 1 -- 10.20.193.48:0/2496690644 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7f543c053d70 con 0x7f5440096ad0 2026-02-12T18:06:11.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.506+0000 7f5446041640 1 --2- 10.20.193.48:0/2496690644 >> v2:10.20.193.111:6812/977811348 conn(0x7f541003f730 0x7f541005fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:11.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.506+0000 7f5446041640 10 monclient: get_auth_request con 0x7f541003f730 auth_method 0 2026-02-12T18:06:11.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.508+0000 7f5426ffd640 1 -- 10.20.193.48:0/2496690644 <== mon.4 v2:10.20.193.48:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f543c004b90 con 0x7f5440096ad0 2026-02-12T18:06:11.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.508+0000 7f5426ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:11.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.508+0000 7f5426ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:11.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.509+0000 7f5446041640 1 --2- 10.20.193.48:0/2496690644 >> v2:10.20.193.111:6812/977811348 conn(0x7f541003f730 0x7f541005fbe0 secure :-1 s=READY pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5430004740 tx=0x7f5430008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:11.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.610+0000 7f54482cc640 10 start_mon_command cmd=[{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-12T18:06:11.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.610+0000 7f54482cc640 10 monclient: _send_command 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-12T18:06:11.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.610+0000 7f54482cc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:11.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.610+0000 7f54482cc640 1 -- 10.20.193.48:0/2496690644 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f5440196b90 con 0x7f5440096ad0 2026-02-12T18:06:11.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.611+0000 7f5426ffd640 1 -- 10.20.193.48:0/2496690644 <== mon.4 v2:10.20.193.48:3302/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v1) ==== 86+0+61 (secure 0 0 0) 0x7f543c021020 con 0x7f5440096ad0 2026-02-12T18:06:11.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.611+0000 7f5426ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2026-02-12T18:06:11.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.611+0000 7f5426ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:11.612 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:06:11.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.612+0000 7f54482cc640 1 -- 10.20.193.48:0/2496690644 >> v2:10.20.193.111:6812/977811348 conn(0x7f541003f730 msgr2=0x7f541005fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:11.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.612+0000 7f54482cc640 1 --2- 10.20.193.48:0/2496690644 >> v2:10.20.193.111:6812/977811348 conn(0x7f541003f730 0x7f541005fbe0 secure :-1 s=READY pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5430004740 tx=0x7f5430008040 comp rx=0 tx=0).stop 2026-02-12T18:06:11.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.612+0000 7f54482cc640 10 monclient: shutdown 2026-02-12T18:06:11.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.612+0000 7f54482cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:11.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.612+0000 7f54482cc640 1 -- 10.20.193.48:0/2496690644 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5440096ad0 msgr2=0x7f5440195250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:11.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.612+0000 7f54482cc640 1 --2- 10.20.193.48:0/2496690644 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5440096ad0 0x7f5440195250 secure :-1 s=READY pgs=36 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f543c00fb30 tx=0x7f543c00af20 comp rx=0 tx=0).stop 2026-02-12T18:06:11.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.612+0000 7f54482cc640 1 -- 10.20.193.48:0/2496690644 shutdown_connections 2026-02-12T18:06:11.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.612+0000 7f54482cc640 1 --2- 10.20.193.48:0/2496690644 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5440096ad0 0x7f5440195250 unknown :-1 s=CLOSED pgs=36 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.612+0000 7f54482cc640 1 --2- 10.20.193.48:0/2496690644 >> v2:10.20.193.111:6812/977811348 conn(0x7f541003f730 0x7f541005fbe0 unknown :-1 s=CLOSED pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.612+0000 7f54482cc640 1 --2- 10.20.193.48:0/2496690644 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5440095ab0 0x7f54401abb20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.612+0000 7f54482cc640 1 --2- 10.20.193.48:0/2496690644 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f54400951a0 0x7f54401ab5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.612+0000 7f54482cc640 1 -- 10.20.193.48:0/2496690644 >> 10.20.193.48:0/2496690644 conn(0x7f54400548c0 msgr2=0x7f54401ae470 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:11.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.612+0000 7f54482cc640 1 -- 10.20.193.48:0/2496690644 shutdown_connections 2026-02-12T18:06:11.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.612+0000 7f54482cc640 1 -- 10.20.193.48:0/2496690644 wait complete. 2026-02-12T18:06:11.620 INFO:teuthology.orchestra.run.trial048.stdout:[{"version":1,"timestamp":"0.000000","name":"","changes":[]}] 2026-02-12T18:06:11.621 INFO:tasks.ceph_manager:config epoch is 1 2026-02-12T18:06:11.621 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2026-02-12T18:06:11.621 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2026-02-12T18:06:11.621 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2026-02-12T18:06:11.687 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.686+0000 7f2596c47640 10 monclient: get_monmap_and_config 2026-02-12T18:06:11.687 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.686+0000 7f2596c47640 10 monclient: build_initial_monmap 2026-02-12T18:06:11.687 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.686+0000 7f2596c47640 10 monclient: monmap: 2026-02-12T18:06:11.687 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:11.688 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:11.688 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:11.687903+0000 2026-02-12T18:06:11.688 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:11.687903+0000 2026-02-12T18:06:11.688 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:11.688 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:11.688 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:11.688 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:11.688 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:11.688 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:11.688 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:11.688 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:11.688 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:11.689 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:11.689 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:11.689 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:11.689 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:11.689 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:11.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2596c47640 1 Processor -- start 2026-02-12T18:06:11.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2596c47640 1 -- start start 2026-02-12T18:06:11.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2596c47640 10 monclient: init 2026-02-12T18:06:11.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2596c47640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:11.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2596c47640 10 monclient: _add_conns ranks=[7,9,8,2,3,1,10,0,4,6,5] 2026-02-12T18:06:11.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2596c47640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f259005dc20 0x7f2590144660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:11.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2596c47640 10 monclient(hunting): picked mon.noname-i con 0x7f259005dc20 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:11.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2596c47640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f259005dff0 0x7f259005e3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:11.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2596c47640 10 monclient(hunting): picked mon.noname-a con 0x7f259005dff0 addr v2:10.20.193.48:3300/0 2026-02-12T18:06:11.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2596c47640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2590089df0 0x7f259008a240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:11.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2596c47640 10 monclient(hunting): picked mon.noname-e con 0x7f2590089df0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:11.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2596c47640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:11.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2596c47640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f259008b0d0 con 0x7f259005dff0 2026-02-12T18:06:11.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2596c47640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:11.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2596c47640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f2590093a30 con 0x7f259005dc20 2026-02-12T18:06:11.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2596c47640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:11.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2596c47640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f2590092200 con 0x7f2590089df0 2026-02-12T18:06:11.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2596c47640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:11.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2596c47640 10 monclient(hunting): authenticate will time out at 610.413600s 2026-02-12T18:06:11.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2587fff640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f259005dff0 0x7f259005e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:11.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f25951bd640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2590089df0 0x7f259008a240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:11.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2587fff640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f259005dff0 0x7f259005e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:44370/0 (socket says 10.20.193.48:44370) 2026-02-12T18:06:11.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2587fff640 1 -- 10.20.193.48:0/3172177874 learned_addr learned my addr 10.20.193.48:0/3172177874 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:11.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f25951bd640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2590089df0 0x7f259008a240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:33842/0 (socket says 10.20.193.48:33842) 2026-02-12T18:06:11.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2587fff640 10 monclient(hunting): get_auth_request con 0x7f259005dff0 auth_method 0 2026-02-12T18:06:11.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2587fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:11.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2587fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:11.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2587fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:11.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f25951bd640 10 monclient(hunting): get_auth_request con 0x7f2590089df0 auth_method 0 2026-02-12T18:06:11.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f25949bc640 1 --2- 10.20.193.48:0/3172177874 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f259005dc20 0x7f2590144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:11.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f25951bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:11.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f25951bd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:11.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f25951bd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:11.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f25949bc640 10 monclient(hunting): get_auth_request con 0x7f259005dc20 auth_method 0 2026-02-12T18:06:11.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f25949bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:11.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f25949bc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:11.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f25949bc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:11.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f25951bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:11.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f25951bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:11.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f25951bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:11.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2587fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:11.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2587fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:11.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f2587fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:11.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f25949bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:11.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f25949bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:11.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.687+0000 7f25949bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:11.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.688+0000 7f25951bd640 10 monclient(hunting): handle_auth_done global_id 4256 payload 274 2026-02-12T18:06:11.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.688+0000 7f25951bd640 1 -- 10.20.193.48:0/3172177874 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f259005dc20 msgr2=0x7f2590144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:11.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.688+0000 7f25951bd640 1 --2- 10.20.193.48:0/3172177874 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f259005dc20 0x7f2590144660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.688+0000 7f25951bd640 1 -- 10.20.193.48:0/3172177874 >> v2:10.20.193.48:3300/0 conn(0x7f259005dff0 msgr2=0x7f259005e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:11.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.688+0000 7f25951bd640 1 --2- 10.20.193.48:0/3172177874 >> v2:10.20.193.48:3300/0 conn(0x7f259005dff0 0x7f259005e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.688+0000 7f25951bd640 10 monclient: _finish_hunting 0 2026-02-12T18:06:11.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.688+0000 7f25951bd640 1 monclient: found mon.noname-e 2026-02-12T18:06:11.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.688+0000 7f25951bd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:11.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.688+0000 7f25951bd640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:06:11.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.688+0000 7f25951bd640 1 -- 10.20.193.48:0/3172177874 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2590060390 con 0x7f2590089df0 2026-02-12T18:06:11.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.690+0000 7f25951bd640 1 -- 10.20.193.48:0/3172177874 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2590089df0 msgr2=0x7f259008a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:11.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.690+0000 7f25951bd640 1 --2- 10.20.193.48:0/3172177874 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2590089df0 0x7f259008a240 secure :-1 s=READY pgs=32 gs=2 cs=0 l=1 c_cookie=2866572391098717921 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f258c00a8e0 tx=0x7f258c02feb0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=27c81c66e66196e1 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:11.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.690+0000 7f25877fe640 1 -- 10.20.193.48:0/3172177874 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f258c036340 con 0x7f2590089df0 2026-02-12T18:06:11.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.690+0000 7f25877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:11.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.690+0000 7f25877fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:06:11.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.690+0000 7f25877fe640 10 monclient: dump: 2026-02-12T18:06:11.703 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:11.703 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:11.703 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:11.703 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:11.703 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:11.703 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:11.703 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:11.703 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:11.703 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:11.704 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:11.704 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:11.704 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:11.704 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:11.704 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:11.704 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:11.704 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:11.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.690+0000 7f25877fe640 10 monclient: _finish_auth 0 2026-02-12T18:06:11.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.690+0000 7f25877fe640 10 monclient: _check_auth_tickets 2026-02-12T18:06:11.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.690+0000 7f25877fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:11.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.690+0000 7f25877fe640 1 -- 10.20.193.48:0/3172177874 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f258c0364c0 con 0x7f2590089df0 2026-02-12T18:06:11.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.690+0000 7f2596c47640 5 monclient: authenticate success, global_id 4256 2026-02-12T18:06:11.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.690+0000 7f2596c47640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:11.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.690+0000 7f25877fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:11.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.690+0000 7f25877fe640 1 -- 10.20.193.48:0/3172177874 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f258c036af0 con 0x7f2590089df0 2026-02-12T18:06:11.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.690+0000 7f25877fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:11.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.690+0000 7f25877fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:06:11.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.690+0000 7f25877fe640 10 monclient: dump: 2026-02-12T18:06:11.705 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:11.705 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:11.705 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:11.705 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:11.705 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:11.705 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:11.705 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:11.706 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:11.706 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:11.706 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:11.706 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:11.706 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:11.706 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:11.706 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:11.706 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:11.706 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:11.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.690+0000 7f2596c47640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:11.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.690+0000 7f2596c47640 4 set_mon_vals no callback set 2026-02-12T18:06:11.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.691+0000 7f2596c47640 10 monclient: shutdown 2026-02-12T18:06:11.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.691+0000 7f2596c47640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:11.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.691+0000 7f2596c47640 1 -- 10.20.193.48:0/3172177874 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2590089df0 msgr2=0x7f259008a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:11.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.691+0000 7f2596c47640 1 --2- 10.20.193.48:0/3172177874 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2590089df0 0x7f259008a240 secure :-1 s=READY pgs=32 gs=2 cs=0 l=1 c_cookie=2866572391098717921 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f258c00a8e0 tx=0x7f258c02feb0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.691+0000 7f2596c47640 1 -- 10.20.193.48:0/3172177874 shutdown_connections 2026-02-12T18:06:11.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.691+0000 7f2596c47640 1 --2- 10.20.193.48:0/3172177874 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2590089df0 0x7f259008a240 unknown :-1 s=CLOSED pgs=32 gs=2 cs=0 l=1 c_cookie=2866572391098717921 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.691+0000 7f2596c47640 1 --2- 10.20.193.48:0/3172177874 >> v2:10.20.193.48:3300/0 conn(0x7f259005dff0 0x7f259005e3e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.691+0000 7f2596c47640 1 --2- 10.20.193.48:0/3172177874 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f259005dc20 0x7f2590144660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.691+0000 7f2596c47640 1 -- 10.20.193.48:0/3172177874 >> 10.20.193.48:0/3172177874 conn(0x7f25900546d0 msgr2=0x7f2590054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:11.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.691+0000 7f2596c47640 1 -- 10.20.193.48:0/3172177874 shutdown_connections 2026-02-12T18:06:11.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.691+0000 7f2596c47640 1 -- 10.20.193.48:0/3172177874 wait complete. 2026-02-12T18:06:11.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.691+0000 7f2596c47640 10 monclient: build_initial_monmap 2026-02-12T18:06:11.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.691+0000 7f2596c47640 10 monclient: monmap: 2026-02-12T18:06:11.708 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:11.708 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:11.708 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:11.708 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:11.708 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:11.708 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:11.708 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:11.708 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:11.708 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:11.708 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:11.708 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:11.708 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:11.708 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:11.709 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:11.709 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:11.709 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:11.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.691+0000 7f2596c47640 1 Processor -- start 2026-02-12T18:06:11.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.691+0000 7f2596c47640 1 -- start start 2026-02-12T18:06:11.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.691+0000 7f2596c47640 10 monclient: init 2026-02-12T18:06:11.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f2596c47640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:11.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f2596c47640 10 monclient: _add_conns ranks=[0,2,8,4,1,6,7,5,3] 2026-02-12T18:06:11.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f2596c47640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f259005dc20 0x7f25901311a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:11.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f2596c47640 10 monclient(hunting): picked mon.noname-a con 0x7f259005dc20 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:06:11.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f2596c47640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f259005dff0 0x7f2590131a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:11.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f2596c47640 10 monclient(hunting): picked mon.noname-b con 0x7f259005dff0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:11.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f2596c47640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2590089df0 0x7f259010db60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:11.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f2596c47640 10 monclient(hunting): picked mon.noname-e con 0x7f2590089df0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:11.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f2596c47640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:11.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f2596c47640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f2590110270 con 0x7f259005dc20 2026-02-12T18:06:11.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f2596c47640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:11.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f2596c47640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f25901316e0 con 0x7f259005dff0 2026-02-12T18:06:11.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f2596c47640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:11.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f2596c47640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f25901246b0 con 0x7f2590089df0 2026-02-12T18:06:11.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f2596c47640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:11.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f2596c47640 10 monclient(hunting): authenticate will time out at 610.418166s 2026-02-12T18:06:11.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25949bc640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f259005dc20 0x7f25901311a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:11.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25951bd640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2590089df0 0x7f259010db60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:11.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f2587fff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f259005dff0 0x7f2590131a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:11.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25951bd640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2590089df0 0x7f259010db60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:33850/0 (socket says 10.20.193.48:33850) 2026-02-12T18:06:11.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25951bd640 1 -- 10.20.193.48:0/2217308816 learned_addr learned my addr 10.20.193.48:0/2217308816 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:11.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25949bc640 10 monclient(hunting): get_auth_request con 0x7f259005dc20 auth_method 0 2026-02-12T18:06:11.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25949bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:11.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25949bc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:11.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25949bc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:11.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25951bd640 10 monclient(hunting): get_auth_request con 0x7f2590089df0 auth_method 0 2026-02-12T18:06:11.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25951bd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:11.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25951bd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:11.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25951bd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:11.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f2587fff640 10 monclient(hunting): get_auth_request con 0x7f259005dff0 auth_method 0 2026-02-12T18:06:11.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f2587fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:11.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f2587fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:11.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f2587fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:11.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25951bd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:11.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25951bd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:11.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25951bd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:11.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25949bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:11.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25949bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:11.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25949bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:11.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f2587fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:11.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f2587fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:11.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f2587fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:11.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25951bd640 10 monclient(hunting): handle_auth_done global_id 4265 payload 824 2026-02-12T18:06:11.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25951bd640 1 -- 10.20.193.48:0/2217308816 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f259005dff0 msgr2=0x7f2590131a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:11.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25951bd640 1 --2- 10.20.193.48:0/2217308816 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f259005dff0 0x7f2590131a50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25951bd640 1 -- 10.20.193.48:0/2217308816 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f259005dc20 msgr2=0x7f25901311a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:11.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25951bd640 1 --2- 10.20.193.48:0/2217308816 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f259005dc20 0x7f25901311a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25951bd640 10 monclient: _finish_hunting 0 2026-02-12T18:06:11.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25951bd640 1 monclient: found mon.noname-e 2026-02-12T18:06:11.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25951bd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:11.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25951bd640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:06:11.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25951bd640 1 -- 10.20.193.48:0/2217308816 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258c00a500 con 0x7f2590089df0 2026-02-12T18:06:11.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f25949bc640 1 --2- 10.20.193.48:0/2217308816 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f259005dc20 0x7f25901311a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:06:11.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.692+0000 7f2587fff640 1 --2- 10.20.193.48:0/2217308816 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f259005dff0 0x7f2590131a50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:06:11.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.694+0000 7f25951bd640 1 -- 10.20.193.48:0/2217308816 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2590089df0 msgr2=0x7f259010db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:11.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.694+0000 7f25951bd640 1 --2- 10.20.193.48:0/2217308816 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2590089df0 0x7f259010db60 secure :-1 s=READY pgs=33 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f258c005820 tx=0x7f258c005850 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:11.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.694+0000 7f25857fa640 1 -- 10.20.193.48:0/2217308816 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f258c036a50 con 0x7f2590089df0 2026-02-12T18:06:11.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.694+0000 7f25857fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:11.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.694+0000 7f25857fa640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:06:11.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.694+0000 7f25857fa640 10 monclient: dump: 2026-02-12T18:06:11.714 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:11.714 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:11.714 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:11.714 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:11.714 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:11.714 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:11.714 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:11.714 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:11.715 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:11.715 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:11.715 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:11.715 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:11.715 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:11.715 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:11.715 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:11.715 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:11.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.694+0000 7f25857fa640 10 monclient: _finish_auth 0 2026-02-12T18:06:11.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.694+0000 7f25857fa640 10 monclient: _check_auth_tickets 2026-02-12T18:06:11.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.694+0000 7f25857fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:11.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.694+0000 7f25857fa640 1 -- 10.20.193.48:0/2217308816 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f258c0054f0 con 0x7f2590089df0 2026-02-12T18:06:11.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.694+0000 7f2596c47640 5 monclient: authenticate success, global_id 4265 2026-02-12T18:06:11.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.694+0000 7f2596c47640 10 monclient: _renew_subs 2026-02-12T18:06:11.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.694+0000 7f2596c47640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:11.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.694+0000 7f2596c47640 1 -- 10.20.193.48:0/2217308816 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25901421a0 con 0x7f2590089df0 2026-02-12T18:06:11.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.694+0000 7f25857fa640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:11.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.694+0000 7f25857fa640 1 -- 10.20.193.48:0/2217308816 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f258c005660 con 0x7f2590089df0 2026-02-12T18:06:11.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.694+0000 7f25857fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:11.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.694+0000 7f2586ffd640 4 set_mon_vals no callback set 2026-02-12T18:06:11.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.694+0000 7f25857fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:06:11.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.694+0000 7f25857fa640 10 monclient: dump: 2026-02-12T18:06:11.716 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:11.716 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:11.717 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:11.717 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:11.717 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:11.717 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:11.717 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:11.717 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:11.717 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:11.717 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:11.717 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:11.717 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:11.717 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:11.717 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:11.717 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:11.718 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:11.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.694+0000 7f2596c47640 10 monclient: _renew_subs 2026-02-12T18:06:11.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.694+0000 7f2596c47640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:11.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.694+0000 7f2596c47640 1 -- 10.20.193.48:0/2217308816 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f2590111700 con 0x7f2590089df0 2026-02-12T18:06:11.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.695+0000 7f2596c47640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:11.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.695+0000 7f2596c47640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:11.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.695+0000 7f2596c47640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:11.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.695+0000 7f2596c47640 1 -- 10.20.193.48:0/2217308816 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2590092510 con 0x7f2590089df0 2026-02-12T18:06:11.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.695+0000 7f25857fa640 1 -- 10.20.193.48:0/2217308816 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f258c005030 con 0x7f2590089df0 2026-02-12T18:06:11.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.695+0000 7f25857fa640 1 --2- 10.20.193.48:0/2217308816 >> v2:10.20.193.111:6812/977811348 conn(0x7f256003f800 0x7f256005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:11.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.695+0000 7f25857fa640 1 -- 10.20.193.48:0/2217308816 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7f258c078d80 con 0x7f2590089df0 2026-02-12T18:06:11.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.695+0000 7f25949bc640 1 --2- 10.20.193.48:0/2217308816 >> v2:10.20.193.111:6812/977811348 conn(0x7f256003f800 0x7f256005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:11.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.695+0000 7f25949bc640 10 monclient: get_auth_request con 0x7f256003f800 auth_method 0 2026-02-12T18:06:11.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.698+0000 7f25857fa640 1 -- 10.20.193.48:0/2217308816 <== mon.8 v2:10.20.193.48:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f258c038440 con 0x7f2590089df0 2026-02-12T18:06:11.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.698+0000 7f25857fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:11.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.698+0000 7f25857fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:11.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.698+0000 7f25949bc640 1 --2- 10.20.193.48:0/2217308816 >> v2:10.20.193.111:6812/977811348 conn(0x7f256003f800 0x7f256005fcb0 secure :-1 s=READY pgs=36 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2580004740 tx=0x7f2580009210 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:11.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.828+0000 7f2596c47640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2026-02-12T18:06:11.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.828+0000 7f2596c47640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-12T18:06:11.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.828+0000 7f2596c47640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:11.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.828+0000 7f2596c47640 1 -- 10.20.193.48:0/2217308816 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f259005e3e0 con 0x7f2590089df0 2026-02-12T18:06:11.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.829+0000 7f25857fa640 1 -- 10.20.193.48:0/2217308816 <== mon.8 v2:10.20.193.48:3304/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+98530 (secure 0 0 0) 0x7f258c051350 con 0x7f2590089df0 2026-02-12T18:06:11.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.829+0000 7f25857fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2026-02-12T18:06:11.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.829+0000 7f25857fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:11.831 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:06:11.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.830+0000 7f2596c47640 1 -- 10.20.193.48:0/2217308816 >> v2:10.20.193.111:6812/977811348 conn(0x7f256003f800 msgr2=0x7f256005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:11.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.830+0000 7f2596c47640 1 --2- 10.20.193.48:0/2217308816 >> v2:10.20.193.111:6812/977811348 conn(0x7f256003f800 0x7f256005fcb0 secure :-1 s=READY pgs=36 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2580004740 tx=0x7f2580009210 comp rx=0 tx=0).stop 2026-02-12T18:06:11.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.830+0000 7f2596c47640 10 monclient: shutdown 2026-02-12T18:06:11.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.830+0000 7f2596c47640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:11.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.830+0000 7f2596c47640 1 -- 10.20.193.48:0/2217308816 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2590089df0 msgr2=0x7f259010db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:11.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.830+0000 7f2596c47640 1 --2- 10.20.193.48:0/2217308816 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2590089df0 0x7f259010db60 secure :-1 s=READY pgs=33 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f258c005820 tx=0x7f258c005850 comp rx=0 tx=0).stop 2026-02-12T18:06:11.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.830+0000 7f2596c47640 1 -- 10.20.193.48:0/2217308816 shutdown_connections 2026-02-12T18:06:11.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.830+0000 7f2596c47640 1 --2- 10.20.193.48:0/2217308816 >> v2:10.20.193.111:6812/977811348 conn(0x7f256003f800 0x7f256005fcb0 unknown :-1 s=CLOSED pgs=36 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.830+0000 7f2596c47640 1 --2- 10.20.193.48:0/2217308816 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2590089df0 0x7f259010db60 unknown :-1 s=CLOSED pgs=33 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.830+0000 7f2596c47640 1 --2- 10.20.193.48:0/2217308816 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f259005dff0 0x7f2590131a50 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.830+0000 7f2596c47640 1 --2- 10.20.193.48:0/2217308816 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f259005dc20 0x7f25901311a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.830+0000 7f2596c47640 1 -- 10.20.193.48:0/2217308816 >> 10.20.193.48:0/2217308816 conn(0x7f25900546d0 msgr2=0x7f2590124e90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:11.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.830+0000 7f2596c47640 1 -- 10.20.193.48:0/2217308816 shutdown_connections 2026-02-12T18:06:11.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.830+0000 7f2596c47640 1 -- 10.20.193.48:0/2217308816 wait complete. 2026-02-12T18:06:11.839 INFO:teuthology.orchestra.run.trial048.stdout:{"epoch":5,"flags":0,"active_gid":4123,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6812","nonce":977811348}]},"active_addr":"10.20.193.111:6812/977811348","active_change":"2026-02-12T18:05:58.245555+0000","active_mgr_features":4544132024016699391,"available":true,"standbys":[],"modules":["iostat","nfs"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_pg_upmap_activity":{"name":"update_pg_upmap_activity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Updates pg_upmap activity stats to be used in `balancer status detail`","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often the agent on each host will gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"The first TCP port the agent will try to bind to. Up to 1000 subsequent ports will be attempted if this port cannot be bound","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this option can facilitate debugging daemons that encounter runtime problems.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"Fraction of total system memory to divide among autotuned daemons. Converged systems hosting both Ceph and compute should set a lower value; systems with more than 10 GiB of memory per OSD may benefit from a slightly larger value so that the abundance of RAM can be fully utilized","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command persistent logging","long_desc":"","tags":[],"see_also":[]},"certificate_automated_rotation_enabled":{"name":"certificate_automated_rotation_enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"This flag controls whether cephadm automatically rotates certificates upon expiration.","long_desc":"","tags":[],"see_also":[]},"certificate_check_debug_mode":{"name":"certificate_check_debug_mode","type":"bool","level":"dev","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"FOR TESTING ONLY: This flag forces the certificate check instead of waiting for certificate_check_period.","long_desc":"","tags":[],"see_also":[]},"certificate_check_period":{"name":"certificate_check_period","type":"int","level":"advanced","flags":0,"default_value":"1","min":"0","max":"30","enum_allowed":[],"desc":"Specifies how often (in days) the certificate should be checked for validity.","long_desc":"","tags":[],"see_also":[]},"certificate_duration_days":{"name":"certificate_duration_days","type":"int","level":"advanced","flags":0,"default_value":"1095","min":"90","max":"3650","enum_allowed":[],"desc":"Specifies the duration of self-signed certificates generated and signed by the cephadm root CA","long_desc":"","tags":[],"see_also":[]},"certificate_renewal_threshold_days":{"name":"certificate_renewal_threshold_days","type":"int","level":"advanced","flags":0,"default_value":"30","min":"10","max":"90","enum_allowed":[],"desc":"Specifies the lead time in days to initiate certificate renewal before expiration.","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently Podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.28.1","min":"","max":"","enum_allowed":[],"desc":"Alertmanager container image","long_desc":"","tags":[],"see_also":[]},"container_image_alloy":{"name":"container_image_alloy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/alloy:latest","min":"","max":"","enum_allowed":[],"desc":"Alloy container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"Elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:12.3.1","min":"","max":"","enum_allowed":[],"desc":"Grafana container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"Haproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.9.1","min":"","max":"","enum_allowed":[],"desc":"Node exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.6","min":"","max":"","enum_allowed":[],"desc":"Nvmeof container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"Oauth2 proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v3.6.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba metrics container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"Snmp gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"quay.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"Seconds for which to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"Location of dashboards to include in Grafana","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"How frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether the hardware monitoring daemon be deployed on every host?","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at the debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of daemons per service per host: guard against mistakes and runaways","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"Max number of OSDs that will be drained simultaneously when OSDs are removed","long_desc":"","tags":[],"see_also":[]},"max_parallel_osd_upgrades":{"name":"max_parallel_osd_upgrades","type":"int","level":"advanced","flags":0,"default_value":"16","min":"","max":"","enum_allowed":[],"desc":"Maximum number of OSD daemons upgraded in parallel.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"Mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default IP address for RedFish API (OOB management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"Location of alerts to include in Prometheus Alertmanager","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry URL for login purposes. This is not the default registry.","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"Cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Customized SSH config file to distribute to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many sequential SSH connection liveness check failures before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often SSH connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"stray_daemon_check_interval":{"name":"stray_daemon_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"How frequently cephadm should check for the presence of stray daemons","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use the cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest to ensure that all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROM_ALERT_CREDENTIAL_CACHE_TTL":{"name":"PROM_ALERT_CREDENTIAL_CACHE_TTL","type":"int","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_HOSTNAME_PER_DAEMON":{"name":"RGW_HOSTNAME_PER_DAEMON","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crypto_caller":{"name":"crypto_caller","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"healthcheck_history_max_entries":{"name":"healthcheck_history_max_entries","type":"int","level":"advanced","flags":1,"default_value":"1000","min":"","max":"","enum_allowed":[],"desc":"Maximum number of health check history entries to keep","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"prometheus_tls_secret_name":{"name":"prometheus_tls_secret_name","type":"str","level":"advanced","flags":0,"default_value":"rook-ceph-prometheus-server-tls","min":"","max":"","enum_allowed":[],"desc":"name of tls secret in k8s for prometheus","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_cloning":{"name":"pause_cloning","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"pause_purging":{"name":"pause_purging","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Pause asynchronous subvolume purge threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"tentacle":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"force_disabled_modules":{},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"10.20.193.111:0","nonce":1758293020}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"10.20.193.111:0","nonce":3656165693}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"10.20.193.111:0","nonce":1994835898}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"10.20.193.111:0","nonce":510405349}]}]} 2026-02-12T18:06:11.846 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2026-02-12T18:06:11.847 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2026-02-12T18:06:11.847 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T18:06:11.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.912+0000 7f313aa07640 10 monclient: get_monmap_and_config 2026-02-12T18:06:11.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.912+0000 7f313aa07640 10 monclient: build_initial_monmap 2026-02-12T18:06:11.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.912+0000 7f313aa07640 10 monclient: monmap: 2026-02-12T18:06:11.912 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:11.913 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:11.913 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:11.913240+0000 2026-02-12T18:06:11.913 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:11.913240+0000 2026-02-12T18:06:11.913 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:11.913 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:11.913 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:11.913 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:11.913 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:11.913 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:11.913 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:11.913 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:11.913 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:11.913 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:11.913 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:11.913 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:11.913 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:11.913 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:11.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.912+0000 7f313aa07640 1 Processor -- start 2026-02-12T18:06:11.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.912+0000 7f313aa07640 1 -- start start 2026-02-12T18:06:11.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.912+0000 7f313aa07640 10 monclient: init 2026-02-12T18:06:11.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.912+0000 7f313aa07640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:11.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.912+0000 7f313aa07640 10 monclient: _add_conns ranks=[5,9,1,4,7,8,10,3,6,0,2] 2026-02-12T18:06:11.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.912+0000 7f313aa07640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f313405dc20 0x7f3134144660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:11.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.912+0000 7f313aa07640 10 monclient(hunting): picked mon.noname-h con 0x7f313405dc20 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:11.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.912+0000 7f313aa07640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f313405dff0 0x7f313405e3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:11.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.912+0000 7f313aa07640 10 monclient(hunting): picked mon.noname-a con 0x7f313405dff0 addr v2:10.20.193.48:3300/0 2026-02-12T18:06:11.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.912+0000 7f313aa07640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f3134089df0 addr v1:10.20.193.111:6789/0 2026-02-12T18:06:11.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.912+0000 7f313aa07640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3134060390 con 0x7f3134089df0 2026-02-12T18:06:11.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.912+0000 7f313aa07640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:11.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.912+0000 7f313aa07640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f313408b0d0 con 0x7f313405dff0 2026-02-12T18:06:11.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.912+0000 7f313aa07640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:11.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.912+0000 7f313aa07640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f3134093a30 con 0x7f313405dc20 2026-02-12T18:06:11.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.912+0000 7f313aa07640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:11.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.912+0000 7f313aa07640 10 monclient(hunting): authenticate will time out at 610.638966s 2026-02-12T18:06:11.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f31337fe640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f313405dff0 0x7f313405e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:11.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f31337fe640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f313405dff0 0x7f313405e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:44382/0 (socket says 10.20.193.48:44382) 2026-02-12T18:06:11.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f31337fe640 1 -- 10.20.193.48:0/318177498 learned_addr learned my addr 10.20.193.48:0/318177498 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:11.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f31337fe640 10 monclient(hunting): get_auth_request con 0x7f313405dff0 auth_method 0 2026-02-12T18:06:11.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f31337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:11.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f31337fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:11.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f31337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:11.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f3133fff640 1 --2- 10.20.193.48:0/318177498 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f313405dc20 0x7f3134144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:11.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f3133fff640 10 monclient(hunting): get_auth_request con 0x7f313405dc20 auth_method 0 2026-02-12T18:06:11.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f3133fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:11.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f3133fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:11.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f3133fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:11.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f31337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:11.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f31337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:11.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f31337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:11.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f3133fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:11.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f3133fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:11.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f3133fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:11.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f31337fe640 10 monclient(hunting): handle_auth_done global_id 4275 payload 274 2026-02-12T18:06:11.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f31337fe640 1 -- 10.20.193.48:0/318177498 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f313405dc20 msgr2=0x7f3134144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:11.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f31337fe640 1 --2- 10.20.193.48:0/318177498 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f313405dc20 0x7f3134144660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f31337fe640 1 -- 10.20.193.48:0/318177498 >> v1:10.20.193.111:6789/0 conn(0x7f3134089df0 legacy=0x7f313408a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:11.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f31337fe640 10 monclient: _finish_hunting 0 2026-02-12T18:06:11.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f31337fe640 1 monclient: found mon.noname-a 2026-02-12T18:06:11.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f31337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:11.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f31337fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:06:11.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.913+0000 7f31337fe640 1 -- 10.20.193.48:0/318177498 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3134092200 con 0x7f313405dff0 2026-02-12T18:06:11.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.915+0000 7f31337fe640 1 -- 10.20.193.48:0/318177498 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f313405dff0 msgr2=0x7f313405e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:11.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.915+0000 7f31337fe640 1 --2- 10.20.193.48:0/318177498 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f313405dff0 0x7f313405e3e0 secure :-1 s=READY pgs=57 gs=2 cs=0 l=1 c_cookie=17653798972712602181 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3124009060 tx=0x7f312402ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4fee4a1c0b0ca45 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:11.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.915+0000 7f3132ffd640 1 -- 10.20.193.48:0/318177498 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3124035340 con 0x7f313405dff0 2026-02-12T18:06:11.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f3132ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:11.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f3132ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:06:11.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f3132ffd640 10 monclient: dump: 2026-02-12T18:06:11.916 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f3132ffd640 10 monclient: _finish_auth 0 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f3132ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f3132ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f313aa07640 5 monclient: authenticate success, global_id 4275 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f3132ffd640 1 -- 10.20.193.48:0/318177498 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31240354c0 con 0x7f313405dff0 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f313aa07640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f3132ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f3132ffd640 1 -- 10.20.193.48:0/318177498 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3124035af0 con 0x7f313405dff0 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f313aa07640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f313aa07640 4 set_mon_vals no callback set 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f3132ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f3132ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f3132ffd640 10 monclient: dump: 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:11.917 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:11.918 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:11.918 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:11.918 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:11.918 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:11.918 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:11.918 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:11.918 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:11.918 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:11.918 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:11.918 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:11.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f313aa07640 10 monclient: shutdown 2026-02-12T18:06:11.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f313aa07640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:11.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f313aa07640 1 -- 10.20.193.48:0/318177498 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f313405dff0 msgr2=0x7f313405e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:11.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f313aa07640 1 --2- 10.20.193.48:0/318177498 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f313405dff0 0x7f313405e3e0 secure :-1 s=READY pgs=57 gs=2 cs=0 l=1 c_cookie=17653798972712602181 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3124009060 tx=0x7f312402ee80 comp rx=0 tx=0).stop 2026-02-12T18:06:11.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f313aa07640 1 -- 10.20.193.48:0/318177498 shutdown_connections 2026-02-12T18:06:11.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f313aa07640 1 --2- 10.20.193.48:0/318177498 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f313405dff0 0x7f313405e3e0 unknown :-1 s=CLOSED pgs=57 gs=2 cs=0 l=1 c_cookie=17653798972712602181 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f313aa07640 1 --2- 10.20.193.48:0/318177498 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f313405dc20 0x7f3134144660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f313aa07640 1 -- 10.20.193.48:0/318177498 >> 10.20.193.48:0/318177498 conn(0x7f31340546d0 msgr2=0x7f3134054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:11.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f313aa07640 1 -- 10.20.193.48:0/318177498 shutdown_connections 2026-02-12T18:06:11.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f313aa07640 1 -- 10.20.193.48:0/318177498 wait complete. 2026-02-12T18:06:11.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f313aa07640 10 monclient: build_initial_monmap 2026-02-12T18:06:11.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f313aa07640 10 monclient: monmap: 2026-02-12T18:06:11.919 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:11.919 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:11.919 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:11.919 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:11.919 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:11.919 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:11.919 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.916+0000 7f313aa07640 1 Processor -- start 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f313aa07640 1 -- start start 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f313aa07640 10 monclient: init 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f313aa07640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f313aa07640 10 monclient: _add_conns ranks=[8,0,4,5,1,6,3,2,7] 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f313aa07640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f313405dc20 0x7f3134131910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f313aa07640 10 monclient(hunting): picked mon.noname-e con 0x7f313405dc20 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f313aa07640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f313405dff0 0x7f313410db60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f313aa07640 10 monclient(hunting): picked mon.noname-a con 0x7f313405dff0 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f313aa07640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3134089df0 0x7f313410e0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f313aa07640 10 monclient(hunting): picked mon.noname-c con 0x7f3134089df0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f313aa07640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f313aa07640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f3134141bb0 con 0x7f313405dff0 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f313aa07640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f313aa07640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f31341264a0 con 0x7f3134089df0 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f313aa07640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f313aa07640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f313410ed00 con 0x7f313405dc20 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f313aa07640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f313aa07640 10 monclient(hunting): authenticate will time out at 610.643244s 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f3133fff640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f313405dc20 0x7f3134131910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f31337fe640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f313405dff0 0x7f313410db60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f31337fe640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f313405dff0 0x7f313410db60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:44396/0 (socket says 10.20.193.48:44396) 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f31337fe640 1 -- 10.20.193.48:0/2964147844 learned_addr learned my addr 10.20.193.48:0/2964147844 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f31337fe640 10 monclient(hunting): get_auth_request con 0x7f313405dff0 auth_method 0 2026-02-12T18:06:11.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f31337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f31337fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f31337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f3133fff640 10 monclient(hunting): get_auth_request con 0x7f313405dc20 auth_method 0 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f3133fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f3133fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f3133fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f3138f7d640 1 --2- 10.20.193.48:0/2964147844 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3134089df0 0x7f313410e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f3138f7d640 10 monclient(hunting): get_auth_request con 0x7f3134089df0 auth_method 0 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f3138f7d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f3138f7d640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f3138f7d640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f31337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f31337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f31337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f3133fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f3133fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f3133fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f3138f7d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f3138f7d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f3138f7d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f31337fe640 10 monclient(hunting): handle_auth_done global_id 4284 payload 824 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f31337fe640 1 -- 10.20.193.48:0/2964147844 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f313405dc20 msgr2=0x7f3134131910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f31337fe640 1 --2- 10.20.193.48:0/2964147844 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f313405dc20 0x7f3134131910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f31337fe640 1 -- 10.20.193.48:0/2964147844 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3134089df0 msgr2=0x7f313410e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f31337fe640 1 --2- 10.20.193.48:0/2964147844 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3134089df0 0x7f313410e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f31337fe640 10 monclient: _finish_hunting 0 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f31337fe640 1 monclient: found mon.noname-a 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f31337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f31337fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:06:11.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.917+0000 7f31337fe640 1 -- 10.20.193.48:0/2964147844 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31240094f0 con 0x7f313405dff0 2026-02-12T18:06:11.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.919+0000 7f31337fe640 1 -- 10.20.193.48:0/2964147844 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f313405dff0 msgr2=0x7f313410db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:11.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.919+0000 7f31337fe640 1 --2- 10.20.193.48:0/2964147844 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f313405dff0 0x7f313410db60 secure :-1 s=READY pgs=58 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3124004740 tx=0x7f3124004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:11.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.919+0000 7f3130ff9640 1 -- 10.20.193.48:0/2964147844 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3124035a50 con 0x7f313405dff0 2026-02-12T18:06:11.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.920+0000 7f3130ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:11.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.920+0000 7f3130ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:06:11.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.920+0000 7f3130ff9640 10 monclient: dump: 2026-02-12T18:06:11.922 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:11.922 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:11.922 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.920+0000 7f3130ff9640 10 monclient: _finish_auth 0 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.920+0000 7f3130ff9640 10 monclient: _check_auth_tickets 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.920+0000 7f3130ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.920+0000 7f313aa07640 5 monclient: authenticate success, global_id 4284 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.920+0000 7f313aa07640 10 monclient: _renew_subs 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.920+0000 7f313aa07640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.920+0000 7f313aa07640 1 -- 10.20.193.48:0/2964147844 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31341103c0 con 0x7f313405dff0 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.920+0000 7f3130ff9640 1 -- 10.20.193.48:0/2964147844 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3124037900 con 0x7f313405dff0 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.920+0000 7f3130ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.920+0000 7f3130ff9640 1 -- 10.20.193.48:0/2964147844 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3124037a70 con 0x7f313405dff0 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.920+0000 7f3130ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.920+0000 7f3130ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.920+0000 7f31327fc640 4 set_mon_vals no callback set 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.920+0000 7f3130ff9640 10 monclient: dump: 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:11.923 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:11.924 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:11.924 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:11.924 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:11.924 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:11.924 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:11.924 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:11.924 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:11.924 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:11.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.920+0000 7f313aa07640 10 monclient: _renew_subs 2026-02-12T18:06:11.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.920+0000 7f313aa07640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:11.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.920+0000 7f313aa07640 1 -- 10.20.193.48:0/2964147844 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3134142810 con 0x7f313405dff0 2026-02-12T18:06:11.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.920+0000 7f313aa07640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:11.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.920+0000 7f313aa07640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:11.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.920+0000 7f313aa07640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:11.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.920+0000 7f313aa07640 1 -- 10.20.193.48:0/2964147844 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3134092510 con 0x7f313405dff0 2026-02-12T18:06:11.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.920+0000 7f3130ff9640 1 -- 10.20.193.48:0/2964147844 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f3124046020 con 0x7f313405dff0 2026-02-12T18:06:11.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.921+0000 7f3130ff9640 1 --2- 10.20.193.48:0/2964147844 >> v2:10.20.193.111:6812/977811348 conn(0x7f310403f800 0x7f310405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:11.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.921+0000 7f3130ff9640 1 -- 10.20.193.48:0/2964147844 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7f3124077c90 con 0x7f313405dff0 2026-02-12T18:06:11.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.921+0000 7f3133fff640 1 --2- 10.20.193.48:0/2964147844 >> v2:10.20.193.111:6812/977811348 conn(0x7f310403f800 0x7f310405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:11.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.921+0000 7f3133fff640 10 monclient: get_auth_request con 0x7f310403f800 auth_method 0 2026-02-12T18:06:11.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.923+0000 7f3133fff640 1 --2- 10.20.193.48:0/2964147844 >> v2:10.20.193.111:6812/977811348 conn(0x7f310403f800 0x7f310405fcb0 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3120004740 tx=0x7f3120009210 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:11.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.923+0000 7f3130ff9640 1 -- 10.20.193.48:0/2964147844 <== mon.0 v2:10.20.193.48:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f31240407a0 con 0x7f313405dff0 2026-02-12T18:06:11.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.923+0000 7f3130ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:11.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:11.923+0000 7f3130ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:12.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.026+0000 7f313aa07640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-12T18:06:12.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.026+0000 7f313aa07640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T18:06:12.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.026+0000 7f313aa07640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:12.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.026+0000 7f313aa07640 1 -- 10.20.193.48:0/2964147844 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f31341422c0 con 0x7f313405dff0 2026-02-12T18:06:12.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.026+0000 7f3130ff9640 1 -- 10.20.193.48:0/2964147844 <== mon.0 v2:10.20.193.48:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+10924 (secure 0 0 0) 0x7f312403c090 con 0x7f313405dff0 2026-02-12T18:06:12.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.026+0000 7f3130ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T18:06:12.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.026+0000 7f3130ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:12.027 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:06:12.027 INFO:teuthology.orchestra.run.trial048.stdout:{"epoch":18,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","created":"2026-02-12T18:05:56.090643+0000","modified":"2026-02-12T18:06:11.284799+0000","last_up_change":"2026-02-12T18:06:02.768915+0000","last_in_change":"2026-02-12T18:05:57.981781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T18:06:02.611941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-12T18:06:07.373478+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8255145-baf3-4c84-9a14-58a24c915493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6801","nonce":447356640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6803","nonce":447356640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6807","nonce":447356640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6806","nonce":447356640}]},"public_addr":"10.20.193.48:6801/447356640","cluster_addr":"10.20.193.48:6803/447356640","heartbeat_back_addr":"10.20.193.48:6807/447356640","heartbeat_front_addr":"10.20.193.48:6806/447356640","state":["exists","up"]},{"osd":1,"uuid":"4cf3730c-446c-4c4f-baf9-b354e06bf2b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6808","nonce":3694032686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6809","nonce":3694032686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6811","nonce":3694032686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6810","nonce":3694032686}]},"public_addr":"10.20.193.48:6808/3694032686","cluster_addr":"10.20.193.48:6809/3694032686","heartbeat_back_addr":"10.20.193.48:6811/3694032686","heartbeat_front_addr":"10.20.193.48:6810/3694032686","state":["exists","up"]},{"osd":2,"uuid":"4ca2a3bb-4801-48eb-9814-12473a6c12bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6800","nonce":2690693575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6802","nonce":2690693575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6805","nonce":2690693575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6804","nonce":2690693575}]},"public_addr":"10.20.193.48:6800/2690693575","cluster_addr":"10.20.193.48:6802/2690693575","heartbeat_back_addr":"10.20.193.48:6805/2690693575","heartbeat_front_addr":"10.20.193.48:6804/2690693575","state":["exists","up"]},{"osd":3,"uuid":"e64b1a76-9d2c-4c4a-bd2d-7b5b8c1df21e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6800","nonce":449363714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6801","nonce":449363714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6803","nonce":449363714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6802","nonce":449363714}]},"public_addr":"10.20.193.111:6800/449363714","cluster_addr":"10.20.193.111:6801/449363714","heartbeat_back_addr":"10.20.193.111:6803/449363714","heartbeat_front_addr":"10.20.193.111:6802/449363714","state":["exists","up"]},{"osd":4,"uuid":"ad82216b-0e68-44da-a293-d4c97dec6b79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6808","nonce":3554486394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6809","nonce":3554486394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6811","nonce":3554486394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6810","nonce":3554486394}]},"public_addr":"10.20.193.111:6808/3554486394","cluster_addr":"10.20.193.111:6809/3554486394","heartbeat_back_addr":"10.20.193.111:6811/3554486394","heartbeat_front_addr":"10.20.193.111:6810/3554486394","state":["exists","up"]},{"osd":5,"uuid":"accc3f03-6123-444b-8c5a-42e927b0ed23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6804","nonce":1701961573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6805","nonce":1701961573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6807","nonce":1701961573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6806","nonce":1701961573}]},"public_addr":"10.20.193.111:6804/1701961573","cluster_addr":"10.20.193.111:6805/1701961573","heartbeat_back_addr":"10.20.193.111:6807/1701961573","heartbeat_front_addr":"10.20.193.111:6806/1701961573","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T18:05:59.805170+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T18:05:59.787798+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T18:05:59.791881+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T18:06:12.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.027+0000 7f313aa07640 1 -- 10.20.193.48:0/2964147844 >> v2:10.20.193.111:6812/977811348 conn(0x7f310403f800 msgr2=0x7f310405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.027+0000 7f313aa07640 1 --2- 10.20.193.48:0/2964147844 >> v2:10.20.193.111:6812/977811348 conn(0x7f310403f800 0x7f310405fcb0 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3120004740 tx=0x7f3120009210 comp rx=0 tx=0).stop 2026-02-12T18:06:12.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.027+0000 7f313aa07640 10 monclient: shutdown 2026-02-12T18:06:12.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.027+0000 7f313aa07640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.027+0000 7f313aa07640 1 -- 10.20.193.48:0/2964147844 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f313405dff0 msgr2=0x7f313410db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.027+0000 7f313aa07640 1 --2- 10.20.193.48:0/2964147844 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f313405dff0 0x7f313410db60 secure :-1 s=READY pgs=58 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3124004740 tx=0x7f3124004770 comp rx=0 tx=0).stop 2026-02-12T18:06:12.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.027+0000 7f313aa07640 1 -- 10.20.193.48:0/2964147844 shutdown_connections 2026-02-12T18:06:12.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.027+0000 7f313aa07640 1 --2- 10.20.193.48:0/2964147844 >> v2:10.20.193.111:6812/977811348 conn(0x7f310403f800 0x7f310405fcb0 unknown :-1 s=CLOSED pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.027+0000 7f313aa07640 1 --2- 10.20.193.48:0/2964147844 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3134089df0 0x7f313410e0a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.027+0000 7f313aa07640 1 --2- 10.20.193.48:0/2964147844 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f313405dff0 0x7f313410db60 unknown :-1 s=CLOSED pgs=58 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.027+0000 7f313aa07640 1 --2- 10.20.193.48:0/2964147844 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f313405dc20 0x7f3134131910 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.027+0000 7f313aa07640 1 -- 10.20.193.48:0/2964147844 >> 10.20.193.48:0/2964147844 conn(0x7f31340546d0 msgr2=0x7f3134124e40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.027+0000 7f313aa07640 1 -- 10.20.193.48:0/2964147844 shutdown_connections 2026-02-12T18:06:12.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.027+0000 7f313aa07640 1 -- 10.20.193.48:0/2964147844 wait complete. 2026-02-12T18:06:12.037 INFO:tasks.ceph.ceph_manager.ceph:all up! 2026-02-12T18:06:12.037 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T18:06:12.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.102+0000 7faf9b70c640 10 monclient: get_monmap_and_config 2026-02-12T18:06:12.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.102+0000 7faf9b70c640 10 monclient: build_initial_monmap 2026-02-12T18:06:12.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.102+0000 7faf9b70c640 10 monclient: monmap: 2026-02-12T18:06:12.106 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:12.106 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.106 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:12.103196+0000 2026-02-12T18:06:12.106 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:12.103196+0000 2026-02-12T18:06:12.106 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:12.106 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.106 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:12.107 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:12.107 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:12.107 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:12.107 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:12.107 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:12.107 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:12.107 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:12.107 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:12.107 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:12.107 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:12.108 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.102+0000 7faf9b70c640 1 Processor -- start 2026-02-12T18:06:12.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.102+0000 7faf9b70c640 1 -- start start 2026-02-12T18:06:12.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.102+0000 7faf9b70c640 10 monclient: init 2026-02-12T18:06:12.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.102+0000 7faf9b70c640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:12.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.102+0000 7faf9b70c640 10 monclient: _add_conns ranks=[10,2,6,0,1,3,9,8,4,5,7] 2026-02-12T18:06:12.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.102+0000 7faf9b70c640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7faf9405dc20 0x7faf94144660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.102+0000 7faf9b70c640 10 monclient(hunting): picked mon.noname-f con 0x7faf9405dc20 addr v2:10.20.193.111:3300/0 2026-02-12T18:06:12.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.102+0000 7faf9b70c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7faf9405dff0 0x7faf9405e3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.102+0000 7faf9b70c640 10 monclient(hunting): picked mon.noname-b con 0x7faf9405dff0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:12.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.102+0000 7faf9b70c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7faf94089df0 0x7faf9408a240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.102+0000 7faf9b70c640 10 monclient(hunting): picked mon.noname-d con 0x7faf94089df0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:06:12.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.102+0000 7faf9b70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.102+0000 7faf9b70c640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7faf9408b0d0 con 0x7faf9405dc20 2026-02-12T18:06:12.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.102+0000 7faf9b70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.102+0000 7faf9b70c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7faf94093a30 con 0x7faf9405dff0 2026-02-12T18:06:12.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.102+0000 7faf9b70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.102+0000 7faf9b70c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7faf94092200 con 0x7faf94089df0 2026-02-12T18:06:12.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.102+0000 7faf9b70c640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:12.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.102+0000 7faf9b70c640 10 monclient(hunting): authenticate will time out at 610.828873s 2026-02-12T18:06:12.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.102+0000 7faf98c80640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7faf9405dff0 0x7faf9405e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.102+0000 7faf99c82640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7faf94089df0 0x7faf9408a240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf99c82640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7faf94089df0 0x7faf9408a240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:38066/0 (socket says 10.20.193.48:38066) 2026-02-12T18:06:12.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf98c80640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7faf9405dff0 0x7faf9405e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:44976/0 (socket says 10.20.193.48:44976) 2026-02-12T18:06:12.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf99c82640 1 -- 10.20.193.48:0/2959225456 learned_addr learned my addr 10.20.193.48:0/2959225456 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:12.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf99c82640 10 monclient(hunting): get_auth_request con 0x7faf94089df0 auth_method 0 2026-02-12T18:06:12.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf99481640 1 --2- 10.20.193.48:0/2959225456 >> v2:10.20.193.111:3300/0 conn(0x7faf9405dc20 0x7faf94144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf99c82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf99c82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf99c82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf98c80640 10 monclient(hunting): get_auth_request con 0x7faf9405dff0 auth_method 0 2026-02-12T18:06:12.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf98c80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf98c80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf98c80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf99481640 10 monclient(hunting): get_auth_request con 0x7faf9405dc20 auth_method 0 2026-02-12T18:06:12.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf99481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf99481640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf99481640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf98c80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf98c80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf98c80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf99c82640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf99c82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf99c82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf98c80640 10 monclient(hunting): handle_auth_done global_id 34130 payload 274 2026-02-12T18:06:12.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf98c80640 1 -- 10.20.193.48:0/2959225456 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7faf94089df0 msgr2=0x7faf9408a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:12.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf98c80640 1 --2- 10.20.193.48:0/2959225456 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7faf94089df0 0x7faf9408a240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf98c80640 1 -- 10.20.193.48:0/2959225456 >> v2:10.20.193.111:3300/0 conn(0x7faf9405dc20 msgr2=0x7faf94144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:12.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf98c80640 1 --2- 10.20.193.48:0/2959225456 >> v2:10.20.193.111:3300/0 conn(0x7faf9405dc20 0x7faf94144660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf98c80640 10 monclient: _finish_hunting 0 2026-02-12T18:06:12.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf98c80640 1 monclient: found mon.noname-b 2026-02-12T18:06:12.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf98c80640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:12.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf98c80640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:06:12.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf98c80640 1 -- 10.20.193.48:0/2959225456 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf94060390 con 0x7faf9405dff0 2026-02-12T18:06:12.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.103+0000 7faf99481640 1 --2- 10.20.193.48:0/2959225456 >> v2:10.20.193.111:3300/0 conn(0x7faf9405dc20 0x7faf94144660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:06:12.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.105+0000 7faf98c80640 1 -- 10.20.193.48:0/2959225456 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7faf9405dff0 msgr2=0x7faf9405e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:12.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.105+0000 7faf98c80640 1 --2- 10.20.193.48:0/2959225456 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7faf9405dff0 0x7faf9405e3e0 secure :-1 s=READY pgs=24 gs=1 cs=0 l=1 c_cookie=4686320953555753751 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf88004740 tx=0x7faf8802eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41092813fc291b17 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.105+0000 7faf83fff640 1 -- 10.20.193.48:0/2959225456 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7faf88035340 con 0x7faf9405dff0 2026-02-12T18:06:12.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.105+0000 7faf83fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.105+0000 7faf83fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:06:12.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.105+0000 7faf83fff640 10 monclient: dump: 2026-02-12T18:06:12.121 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.121 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.122 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.122 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.122 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.122 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.122 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.122 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.122 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.122 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.122 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.122 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.123 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.123 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.123 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.123 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.105+0000 7faf83fff640 10 monclient: _finish_auth 0 2026-02-12T18:06:12.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.105+0000 7faf83fff640 10 monclient: _check_auth_tickets 2026-02-12T18:06:12.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.105+0000 7faf83fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:12.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.105+0000 7faf83fff640 1 -- 10.20.193.48:0/2959225456 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf880354c0 con 0x7faf9405dff0 2026-02-12T18:06:12.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.105+0000 7faf83fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:12.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.105+0000 7faf83fff640 1 -- 10.20.193.48:0/2959225456 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7faf88035af0 con 0x7faf9405dff0 2026-02-12T18:06:12.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.105+0000 7faf9b70c640 5 monclient: authenticate success, global_id 34130 2026-02-12T18:06:12.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.105+0000 7faf9b70c640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:12.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.105+0000 7faf9b70c640 4 set_mon_vals no callback set 2026-02-12T18:06:12.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.105+0000 7faf83fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.105+0000 7faf83fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:06:12.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.105+0000 7faf83fff640 10 monclient: dump: 2026-02-12T18:06:12.124 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.124 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.124 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.124 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.125 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.125 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.125 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.125 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.125 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.125 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.125 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.125 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.125 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.125 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.125 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.126 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 10 monclient: shutdown 2026-02-12T18:06:12.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 1 -- 10.20.193.48:0/2959225456 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7faf9405dff0 msgr2=0x7faf9405e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 1 --2- 10.20.193.48:0/2959225456 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7faf9405dff0 0x7faf9405e3e0 secure :-1 s=READY pgs=24 gs=1 cs=0 l=1 c_cookie=4686320953555753751 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf88004740 tx=0x7faf8802eda0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 1 -- 10.20.193.48:0/2959225456 shutdown_connections 2026-02-12T18:06:12.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 1 --2- 10.20.193.48:0/2959225456 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7faf94089df0 0x7faf9408a240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 1 --2- 10.20.193.48:0/2959225456 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7faf9405dff0 0x7faf9405e3e0 unknown :-1 s=CLOSED pgs=24 gs=1 cs=0 l=1 c_cookie=4686320953555753751 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 1 --2- 10.20.193.48:0/2959225456 >> v2:10.20.193.111:3300/0 conn(0x7faf9405dc20 0x7faf94144660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 1 -- 10.20.193.48:0/2959225456 >> 10.20.193.48:0/2959225456 conn(0x7faf940546d0 msgr2=0x7faf94054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 1 -- 10.20.193.48:0/2959225456 shutdown_connections 2026-02-12T18:06:12.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 1 -- 10.20.193.48:0/2959225456 wait complete. 2026-02-12T18:06:12.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 10 monclient: build_initial_monmap 2026-02-12T18:06:12.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 10 monclient: monmap: 2026-02-12T18:06:12.127 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:12.127 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:12.127 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:12.127 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:12.127 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:12.127 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.127 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:12.128 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:12.128 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:12.128 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:12.128 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:12.128 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:12.128 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:12.128 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:12.128 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:12.128 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 1 Processor -- start 2026-02-12T18:06:12.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 1 -- start start 2026-02-12T18:06:12.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 10 monclient: init 2026-02-12T18:06:12.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:12.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 10 monclient: _add_conns ranks=[6,1,7,2,8,5,4,0,3] 2026-02-12T18:06:12.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7faf9405dc20 0x7faf9410db60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 10 monclient(hunting): picked mon.noname-d con 0x7faf9405dc20 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:06:12.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7faf9405dff0 0x7faf9410e0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 10 monclient(hunting): picked mon.noname-f con 0x7faf9405dff0 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:06:12.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7faf94089df0 0x7faf9410e5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 10 monclient(hunting): picked mon.noname-i con 0x7faf94089df0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:12.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7faf94142840 con 0x7faf9405dff0 2026-02-12T18:06:12.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7faf9410fcd0 con 0x7faf9405dc20 2026-02-12T18:06:12.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7faf941234b0 con 0x7faf94089df0 2026-02-12T18:06:12.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:12.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.106+0000 7faf9b70c640 10 monclient(hunting): authenticate will time out at 610.832983s 2026-02-12T18:06:12.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf99481640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7faf9405dc20 0x7faf9410db60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf99481640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7faf9405dc20 0x7faf9410db60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:38080/0 (socket says 10.20.193.48:38080) 2026-02-12T18:06:12.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf99481640 1 -- 10.20.193.48:0/2375552507 learned_addr learned my addr 10.20.193.48:0/2375552507 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:12.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf99481640 10 monclient(hunting): get_auth_request con 0x7faf9405dc20 auth_method 0 2026-02-12T18:06:12.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf99481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf99481640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf99481640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf99481640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf99481640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf98c80640 1 --2- 10.20.193.48:0/2375552507 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7faf9405dff0 0x7faf9410e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf99481640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf98c80640 10 monclient(hunting): get_auth_request con 0x7faf9405dff0 auth_method 0 2026-02-12T18:06:12.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf98c80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf98c80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf98c80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf99c82640 1 --2- 10.20.193.48:0/2375552507 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7faf94089df0 0x7faf9410e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf99c82640 10 monclient(hunting): get_auth_request con 0x7faf94089df0 auth_method 0 2026-02-12T18:06:12.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf99c82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf99c82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf99c82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf98c80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf98c80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf98c80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf99481640 10 monclient(hunting): handle_auth_done global_id 4299 payload 824 2026-02-12T18:06:12.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf99481640 1 -- 10.20.193.48:0/2375552507 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7faf94089df0 msgr2=0x7faf9410e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf99481640 1 --2- 10.20.193.48:0/2375552507 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7faf94089df0 0x7faf9410e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf99481640 1 -- 10.20.193.48:0/2375552507 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7faf9405dff0 msgr2=0x7faf9410e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf99481640 1 --2- 10.20.193.48:0/2375552507 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7faf9405dff0 0x7faf9410e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf99481640 10 monclient: _finish_hunting 0 2026-02-12T18:06:12.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf99481640 1 monclient: found mon.noname-d 2026-02-12T18:06:12.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf99481640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:12.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf99481640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:06:12.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.107+0000 7faf99481640 1 -- 10.20.193.48:0/2375552507 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf88009420 con 0x7faf9405dc20 2026-02-12T18:06:12.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.109+0000 7faf99481640 1 -- 10.20.193.48:0/2375552507 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7faf9405dc20 msgr2=0x7faf9410db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:12.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.109+0000 7faf99481640 1 --2- 10.20.193.48:0/2375552507 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7faf9405dc20 0x7faf9410db60 secure :-1 s=READY pgs=42 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf8400e7c0 tx=0x7faf8400ec90 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.109+0000 7faf81ffb640 1 -- 10.20.193.48:0/2375552507 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7faf8400ee90 con 0x7faf9405dc20 2026-02-12T18:06:12.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.109+0000 7faf81ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.109+0000 7faf81ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:06:12.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.109+0000 7faf81ffb640 10 monclient: dump: 2026-02-12T18:06:12.134 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.134 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.134 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.134 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.134 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.134 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.134 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.134 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.134 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.135 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.135 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.135 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.135 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.135 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.135 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.135 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.109+0000 7faf81ffb640 10 monclient: _finish_auth 0 2026-02-12T18:06:12.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.109+0000 7faf81ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:06:12.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.109+0000 7faf81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:12.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.109+0000 7faf81ffb640 1 -- 10.20.193.48:0/2375552507 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf840044f0 con 0x7faf9405dc20 2026-02-12T18:06:12.136 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.109+0000 7faf81ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:12.136 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.109+0000 7faf81ffb640 1 -- 10.20.193.48:0/2375552507 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7faf8400cda0 con 0x7faf9405dc20 2026-02-12T18:06:12.136 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.109+0000 7faf81ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.136 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.109+0000 7faf81ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:06:12.136 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.109+0000 7faf837fe640 4 set_mon_vals no callback set 2026-02-12T18:06:12.136 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.109+0000 7faf81ffb640 10 monclient: dump: 2026-02-12T18:06:12.136 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.136 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.136 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.136 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.136 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.137 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.137 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.137 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.137 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.137 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.137 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.137 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.137 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.137 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.137 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.137 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.109+0000 7faf9b70c640 5 monclient: authenticate success, global_id 4299 2026-02-12T18:06:12.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.109+0000 7faf9b70c640 10 monclient: _renew_subs 2026-02-12T18:06:12.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.109+0000 7faf9b70c640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:06:12.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.109+0000 7faf9b70c640 1 -- 10.20.193.48:0/2375552507 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf941102f0 con 0x7faf9405dc20 2026-02-12T18:06:12.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.109+0000 7faf9b70c640 10 monclient: _renew_subs 2026-02-12T18:06:12.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.109+0000 7faf9b70c640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:06:12.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.109+0000 7faf9b70c640 1 -- 10.20.193.48:0/2375552507 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7faf941422a0 con 0x7faf9405dc20 2026-02-12T18:06:12.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.110+0000 7faf9b70c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:12.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.110+0000 7faf9b70c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:12.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.110+0000 7faf9b70c640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:06:12.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.110+0000 7faf9b70c640 1 -- 10.20.193.48:0/2375552507 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf94091140 con 0x7faf9405dc20 2026-02-12T18:06:12.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.110+0000 7faf81ffb640 1 -- 10.20.193.48:0/2375552507 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7faf8400c8e0 con 0x7faf9405dc20 2026-02-12T18:06:12.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.110+0000 7faf81ffb640 1 --2- 10.20.193.48:0/2375552507 >> v2:10.20.193.111:6812/977811348 conn(0x7faf6403f800 0x7faf6405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.110+0000 7faf81ffb640 1 -- 10.20.193.48:0/2375552507 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7faf84052920 con 0x7faf9405dc20 2026-02-12T18:06:12.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.110+0000 7faf98c80640 1 --2- 10.20.193.48:0/2375552507 >> v2:10.20.193.111:6812/977811348 conn(0x7faf6403f800 0x7faf6405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.110+0000 7faf98c80640 10 monclient: get_auth_request con 0x7faf6403f800 auth_method 0 2026-02-12T18:06:12.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.112+0000 7faf81ffb640 1 -- 10.20.193.48:0/2375552507 <== mon.6 v2:10.20.193.48:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7faf84003a60 con 0x7faf9405dc20 2026-02-12T18:06:12.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.113+0000 7faf81ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:12.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.113+0000 7faf81ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:12.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.113+0000 7faf98c80640 1 --2- 10.20.193.48:0/2375552507 >> v2:10.20.193.111:6812/977811348 conn(0x7faf6403f800 0x7faf6405fcb0 secure :-1 s=READY pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf88009080 tx=0x7faf88033000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.217+0000 7faf9b70c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-12T18:06:12.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.217+0000 7faf9b70c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T18:06:12.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.217+0000 7faf9b70c640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:06:12.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.217+0000 7faf9b70c640 1 -- 10.20.193.48:0/2375552507 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf9410ff10 con 0x7faf9405dc20 2026-02-12T18:06:12.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.218+0000 7faf81ffb640 1 -- 10.20.193.48:0/2375552507 <== mon.6 v2:10.20.193.48:3303/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+10924 (secure 0 0 0) 0x7faf84020020 con 0x7faf9405dc20 2026-02-12T18:06:12.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.218+0000 7faf81ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T18:06:12.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.218+0000 7faf81ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:12.219 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:06:12.219 INFO:teuthology.orchestra.run.trial048.stdout:{"epoch":18,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","created":"2026-02-12T18:05:56.090643+0000","modified":"2026-02-12T18:06:11.284799+0000","last_up_change":"2026-02-12T18:06:02.768915+0000","last_in_change":"2026-02-12T18:05:57.981781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T18:06:02.611941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-12T18:06:07.373478+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8255145-baf3-4c84-9a14-58a24c915493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6801","nonce":447356640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6803","nonce":447356640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6807","nonce":447356640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6806","nonce":447356640}]},"public_addr":"10.20.193.48:6801/447356640","cluster_addr":"10.20.193.48:6803/447356640","heartbeat_back_addr":"10.20.193.48:6807/447356640","heartbeat_front_addr":"10.20.193.48:6806/447356640","state":["exists","up"]},{"osd":1,"uuid":"4cf3730c-446c-4c4f-baf9-b354e06bf2b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6808","nonce":3694032686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6809","nonce":3694032686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6811","nonce":3694032686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6810","nonce":3694032686}]},"public_addr":"10.20.193.48:6808/3694032686","cluster_addr":"10.20.193.48:6809/3694032686","heartbeat_back_addr":"10.20.193.48:6811/3694032686","heartbeat_front_addr":"10.20.193.48:6810/3694032686","state":["exists","up"]},{"osd":2,"uuid":"4ca2a3bb-4801-48eb-9814-12473a6c12bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6800","nonce":2690693575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6802","nonce":2690693575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6805","nonce":2690693575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6804","nonce":2690693575}]},"public_addr":"10.20.193.48:6800/2690693575","cluster_addr":"10.20.193.48:6802/2690693575","heartbeat_back_addr":"10.20.193.48:6805/2690693575","heartbeat_front_addr":"10.20.193.48:6804/2690693575","state":["exists","up"]},{"osd":3,"uuid":"e64b1a76-9d2c-4c4a-bd2d-7b5b8c1df21e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6800","nonce":449363714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6801","nonce":449363714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6803","nonce":449363714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6802","nonce":449363714}]},"public_addr":"10.20.193.111:6800/449363714","cluster_addr":"10.20.193.111:6801/449363714","heartbeat_back_addr":"10.20.193.111:6803/449363714","heartbeat_front_addr":"10.20.193.111:6802/449363714","state":["exists","up"]},{"osd":4,"uuid":"ad82216b-0e68-44da-a293-d4c97dec6b79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6808","nonce":3554486394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6809","nonce":3554486394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6811","nonce":3554486394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6810","nonce":3554486394}]},"public_addr":"10.20.193.111:6808/3554486394","cluster_addr":"10.20.193.111:6809/3554486394","heartbeat_back_addr":"10.20.193.111:6811/3554486394","heartbeat_front_addr":"10.20.193.111:6810/3554486394","state":["exists","up"]},{"osd":5,"uuid":"accc3f03-6123-444b-8c5a-42e927b0ed23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6804","nonce":1701961573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6805","nonce":1701961573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6807","nonce":1701961573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6806","nonce":1701961573}]},"public_addr":"10.20.193.111:6804/1701961573","cluster_addr":"10.20.193.111:6805/1701961573","heartbeat_back_addr":"10.20.193.111:6807/1701961573","heartbeat_front_addr":"10.20.193.111:6806/1701961573","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T18:05:59.805170+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T18:05:59.787798+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T18:05:59.791881+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T18:06:12.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.219+0000 7faf9b70c640 1 -- 10.20.193.48:0/2375552507 >> v2:10.20.193.111:6812/977811348 conn(0x7faf6403f800 msgr2=0x7faf6405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.219+0000 7faf9b70c640 1 --2- 10.20.193.48:0/2375552507 >> v2:10.20.193.111:6812/977811348 conn(0x7faf6403f800 0x7faf6405fcb0 secure :-1 s=READY pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf88009080 tx=0x7faf88033000 comp rx=0 tx=0).stop 2026-02-12T18:06:12.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.219+0000 7faf9b70c640 10 monclient: shutdown 2026-02-12T18:06:12.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.219+0000 7faf9b70c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.219+0000 7faf9b70c640 1 -- 10.20.193.48:0/2375552507 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7faf9405dc20 msgr2=0x7faf9410db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.219+0000 7faf9b70c640 1 --2- 10.20.193.48:0/2375552507 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7faf9405dc20 0x7faf9410db60 secure :-1 s=READY pgs=42 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf8400e7c0 tx=0x7faf8400ec90 comp rx=0 tx=0).stop 2026-02-12T18:06:12.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.219+0000 7faf9b70c640 1 -- 10.20.193.48:0/2375552507 shutdown_connections 2026-02-12T18:06:12.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.219+0000 7faf9b70c640 1 --2- 10.20.193.48:0/2375552507 >> v2:10.20.193.111:6812/977811348 conn(0x7faf6403f800 0x7faf6405fcb0 unknown :-1 s=CLOSED pgs=38 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.219+0000 7faf9b70c640 1 --2- 10.20.193.48:0/2375552507 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7faf94089df0 0x7faf9410e5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.219+0000 7faf9b70c640 1 --2- 10.20.193.48:0/2375552507 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7faf9405dff0 0x7faf9410e0a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.219+0000 7faf9b70c640 1 --2- 10.20.193.48:0/2375552507 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7faf9405dc20 0x7faf9410db60 unknown :-1 s=CLOSED pgs=42 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.219+0000 7faf9b70c640 1 -- 10.20.193.48:0/2375552507 >> 10.20.193.48:0/2375552507 conn(0x7faf940546d0 msgr2=0x7faf941256b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.219+0000 7faf9b70c640 1 -- 10.20.193.48:0/2375552507 shutdown_connections 2026-02-12T18:06:12.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.219+0000 7faf9b70c640 1 -- 10.20.193.48:0/2375552507 wait complete. 2026-02-12T18:06:12.228 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2026-02-12T18:06:12.229 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2026-02-12T18:06:12.229 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2026-02-12T18:06:12.230 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2026-02-12T18:06:12.230 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2026-02-12T18:06:12.231 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2026-02-12T18:06:12.301 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.298+0000 7fcfebccc640 10 monclient: get_monmap_and_config 2026-02-12T18:06:12.301 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.298+0000 7fcfebccc640 10 monclient: build_initial_monmap 2026-02-12T18:06:12.301 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.298+0000 7fcfebccc640 10 monclient: monmap: 2026-02-12T18:06:12.301 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:12.301 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.301 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:12.299309+0000 2026-02-12T18:06:12.301 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:12.299309+0000 2026-02-12T18:06:12.301 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:12.301 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.301 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:12.302 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:12.302 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:12.302 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:12.302 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:12.302 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:12.302 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:12.302 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:12.302 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:12.302 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:12.302 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:12.302 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.298+0000 7fbb3641b640 10 monclient: get_monmap_and_config 2026-02-12T18:06:12.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.298+0000 7fbb3641b640 10 monclient: build_initial_monmap 2026-02-12T18:06:12.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.298+0000 7fbb3641b640 10 monclient: monmap: 2026-02-12T18:06:12.302 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:12.302 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.302 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:12.299583+0000 2026-02-12T18:06:12.302 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:12.299583+0000 2026-02-12T18:06:12.302 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:12.302 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.302 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:12.302 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:12.302 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:12.302 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:12.303 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:12.303 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:12.303 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:12.303 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:12.303 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:12.303 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:12.303 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:12.303 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.303 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.298+0000 7fcfebccc640 1 Processor -- start 2026-02-12T18:06:12.303 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.298+0000 7fcfebccc640 1 -- start start 2026-02-12T18:06:12.303 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.298+0000 7fcfebccc640 10 monclient: init 2026-02-12T18:06:12.303 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.298+0000 7f787790c640 10 monclient: get_monmap_and_config 2026-02-12T18:06:12.303 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.298+0000 7f787790c640 10 monclient: build_initial_monmap 2026-02-12T18:06:12.303 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.298+0000 7f787790c640 10 monclient: monmap: 2026-02-12T18:06:12.303 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:12.303 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.303 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:12.299945+0000 2026-02-12T18:06:12.303 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:12.299945+0000 2026-02-12T18:06:12.303 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:12.303 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.303 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:12.303 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:12.304 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:12.304 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:12.304 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:12.304 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:12.304 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:12.304 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:12.304 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:12.304 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:12.304 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:12.304 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.298+0000 7fbb3641b640 1 Processor -- start 2026-02-12T18:06:12.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.298+0000 7fbb3641b640 1 -- start start 2026-02-12T18:06:12.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.298+0000 7fbb3641b640 10 monclient: init 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.298+0000 7fcfebccc640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.298+0000 7fcfebccc640 10 monclient: _add_conns ranks=[6,7,4,2,9,1,3,10,0,5,8] 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfebccc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcfe4089d10 0x7fcfe413ef20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfebccc640 10 monclient(hunting): picked mon.noname-d con 0x7fcfe4089d10 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfebccc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcfe408a0e0 0x7fcfe4141fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfebccc640 10 monclient(hunting): picked mon.noname-i con 0x7fcfe408a0e0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfebccc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcfe408a510 0x7fcfe4142510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfebccc640 10 monclient(hunting): picked mon.noname-c con 0x7fcfe408a510 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfebccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfebccc640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fcfe408d700 con 0x7fcfe408a510 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfebccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfebccc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fcfe408d450 con 0x7fcfe4089d10 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfebccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfebccc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fcfe4087830 con 0x7fcfe408a0e0 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfebccc640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfebccc640 10 monclient(hunting): authenticate will time out at 611.025042s 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfe9a41640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcfe4089d10 0x7fcfe413ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfea242640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcfe408a510 0x7fcfe4142510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfe9a41640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcfe4089d10 0x7fcfe413ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:38088/0 (socket says 10.20.193.48:38088) 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfe9a41640 1 -- 10.20.193.48:0/2951787093 learned_addr learned my addr 10.20.193.48:0/2951787093 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfea242640 10 monclient(hunting): get_auth_request con 0x7fcfe408a510 auth_method 0 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfea242640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfea242640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfea242640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfe9a41640 10 monclient(hunting): get_auth_request con 0x7fcfe4089d10 auth_method 0 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfe9a41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfe9a41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfe9a41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f12fbc8c640 10 monclient: get_monmap_and_config 2026-02-12T18:06:12.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f12fbc8c640 10 monclient: build_initial_monmap 2026-02-12T18:06:12.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f12fbc8c640 10 monclient: monmap: 2026-02-12T18:06:12.306 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:12.306 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.306 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:12.300255+0000 2026-02-12T18:06:12.306 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:12.300255+0000 2026-02-12T18:06:12.306 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:12.306 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.306 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:12.306 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:12.306 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:12.306 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:12.306 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:12.306 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:12.306 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:12.306 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:12.306 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:12.306 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:12.306 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:12.306 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb3641b640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:12.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb3641b640 10 monclient: _add_conns ranks=[3,6,8,2,10,7,9,0,1,5,4] 2026-02-12T18:06:12.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb3641b640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fbb300951a0 0x7fbb30093850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb3641b640 10 monclient(hunting): picked mon.noname-g con 0x7fbb300951a0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:12.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfea242640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfea242640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb3641b640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fbb30096ad0 0x7fbb30095570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfea242640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfe9a41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb3641b640 10 monclient(hunting): picked mon.noname-d con 0x7fbb30096ad0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:06:12.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfe9a41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f787790c640 1 Processor -- start 2026-02-12T18:06:12.308 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb3641b640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbb30095ab0 0x7fbb301a4ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.308 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb3641b640 10 monclient(hunting): picked mon.noname-e con 0x7fbb30095ab0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:12.308 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb3641b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.308 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb3641b640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fbb30096900 con 0x7fbb300951a0 2026-02-12T18:06:12.308 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb3641b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.308 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb3641b640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fbb30092260 con 0x7fbb30096ad0 2026-02-12T18:06:12.308 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb3641b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.308 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfe9a41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.308 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb3641b640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fbb30093070 con 0x7fbb30095ab0 2026-02-12T18:06:12.308 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb3641b640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:12.308 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb3641b640 10 monclient(hunting): authenticate will time out at 611.025360s 2026-02-12T18:06:12.308 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfe9240640 1 --2- 10.20.193.48:0/2951787093 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcfe408a0e0 0x7fcfe4141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.308 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfe9240640 10 monclient(hunting): get_auth_request con 0x7fcfe408a0e0 auth_method 0 2026-02-12T18:06:12.308 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f787790c640 1 -- start start 2026-02-12T18:06:12.308 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f787790c640 10 monclient: init 2026-02-12T18:06:12.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfe9240640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfe9240640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfe9240640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfea242640 10 monclient(hunting): handle_auth_done global_id 34159 payload 274 2026-02-12T18:06:12.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb34991640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbb30095ab0 0x7fbb301a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb2f7fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fbb30096ad0 0x7fbb30095570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfea242640 1 -- 10.20.193.48:0/2951787093 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcfe408a0e0 msgr2=0x7fcfe4141fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:12.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfea242640 1 --2- 10.20.193.48:0/2951787093 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcfe408a0e0 0x7fcfe4141fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfea242640 1 -- 10.20.193.48:0/2951787093 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcfe4089d10 msgr2=0x7fcfe413ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:12.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb34991640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbb30095ab0 0x7fbb301a4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:33870/0 (socket says 10.20.193.48:33870) 2026-02-12T18:06:12.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb34991640 1 -- 10.20.193.48:0/495872559 learned_addr learned my addr 10.20.193.48:0/495872559 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:12.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb34991640 10 monclient(hunting): get_auth_request con 0x7fbb30095ab0 auth_method 0 2026-02-12T18:06:12.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfea242640 1 --2- 10.20.193.48:0/2951787093 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcfe4089d10 0x7fcfe413ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfea242640 10 monclient: _finish_hunting 0 2026-02-12T18:06:12.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfea242640 1 monclient: found mon.noname-c 2026-02-12T18:06:12.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfea242640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:12.310 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb34991640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.310 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb34991640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.310 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb34991640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.310 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfea242640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:06:12.310 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fcfea242640 1 -- 10.20.193.48:0/2951787093 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe404dc20 con 0x7fcfe408a510 2026-02-12T18:06:12.310 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb2f7fe640 10 monclient(hunting): get_auth_request con 0x7fbb30096ad0 auth_method 0 2026-02-12T18:06:12.310 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb2f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.310 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb2f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.310 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb2f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.310 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb34991640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.310 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb34991640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.310 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb34991640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.310 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb2f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.310 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb2f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.310 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f12fbc8c640 1 Processor -- start 2026-02-12T18:06:12.310 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb2f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f12fbc8c640 1 -- start start 2026-02-12T18:06:12.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f12fbc8c640 10 monclient: init 2026-02-12T18:06:12.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb34991640 10 monclient(hunting): handle_auth_done global_id 4283 payload 274 2026-02-12T18:06:12.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb2ffff640 1 --2- 10.20.193.48:0/495872559 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fbb300951a0 0x7fbb30093850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb34991640 1 -- 10.20.193.48:0/495872559 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fbb30096ad0 msgr2=0x7fbb30095570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:12.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb34991640 1 --2- 10.20.193.48:0/495872559 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fbb30096ad0 0x7fbb30095570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb34991640 1 -- 10.20.193.48:0/495872559 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fbb300951a0 msgr2=0x7fbb30093850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:12.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb34991640 1 --2- 10.20.193.48:0/495872559 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fbb300951a0 0x7fbb30093850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb34991640 10 monclient: _finish_hunting 0 2026-02-12T18:06:12.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb34991640 1 monclient: found mon.noname-e 2026-02-12T18:06:12.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb34991640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:12.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb34991640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:06:12.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb34991640 1 -- 10.20.193.48:0/495872559 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb3004dc20 con 0x7fbb30095ab0 2026-02-12T18:06:12.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb2ffff640 10 monclient: get_auth_request con 0x7fbb300951a0 auth_method 0 2026-02-12T18:06:12.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb2f7fe640 1 --2- 10.20.193.48:0/495872559 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fbb30096ad0 0x7fbb30095570 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:06:12.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7fbb2ffff640 1 --2- 10.20.193.48:0/495872559 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fbb300951a0 0x7fbb30093850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-12T18:06:12.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f787790c640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:12.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f787790c640 10 monclient: _add_conns ranks=[5,2,1,6,4,7,9,10,3,8,0] 2026-02-12T18:06:12.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f787790c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f787005c950 0x7f787005cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f787790c640 10 monclient(hunting): picked mon.noname-h con 0x7f787005c950 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:12.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f787790c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f787005e490 0x7f787005d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f787790c640 10 monclient(hunting): picked mon.noname-b con 0x7f787005e490 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:12.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f787790c640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f787013db70 addr v1:10.20.193.111:6789/0 2026-02-12T18:06:12.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f787790c640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f787004dc20 con 0x7f787013db70 2026-02-12T18:06:12.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f787790c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f787790c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f787005ddd0 con 0x7f787005e490 2026-02-12T18:06:12.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f787790c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f787790c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f787005d7a0 con 0x7f787005c950 2026-02-12T18:06:12.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f787790c640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:12.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f787790c640 10 monclient(hunting): authenticate will time out at 611.025841s 2026-02-12T18:06:12.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f12fbc8c640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:12.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f12fbc8c640 10 monclient: _add_conns ranks=[9,2,0,7,4,3,10,6,8,1,5] 2026-02-12T18:06:12.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f7874e80640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f787005e490 0x7f787005d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f12fbc8c640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f12f4090730 0x7f12f408fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f12fbc8c640 10 monclient(hunting): picked mon.noname-a con 0x7f12f4090730 addr v2:10.20.193.48:3300/0 2026-02-12T18:06:12.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f12fbc8c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f12f4090b00 0x7f12f4090f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f12fbc8c640 10 monclient(hunting): picked mon.noname-b con 0x7f12f4090b00 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:12.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f7874e80640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f787005e490 0x7f787005d260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:44978/0 (socket says 10.20.193.48:44978) 2026-02-12T18:06:12.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f7874e80640 1 -- 10.20.193.48:0/446371180 learned_addr learned my addr 10.20.193.48:0/446371180 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:12.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f7874e80640 10 monclient(hunting): get_auth_request con 0x7f787005e490 auth_method 0 2026-02-12T18:06:12.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f7874e80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f7874e80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f12fbc8c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f12f41442e0 addr v1:10.20.193.48:6789/0 2026-02-12T18:06:12.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f12fbc8c640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12f404dc20 con 0x7f12f41442e0 2026-02-12T18:06:12.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f7874e80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f12fbc8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f12fbc8c640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f12f4091810 con 0x7f12f4090730 2026-02-12T18:06:12.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f12fbc8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12fbc8c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f12f40914d0 con 0x7f12f4090b00 2026-02-12T18:06:12.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12fbc8c640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:12.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12fbc8c640 10 monclient(hunting): authenticate will time out at 611.026007s 2026-02-12T18:06:12.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f1c859d2640 10 monclient: get_monmap_and_config 2026-02-12T18:06:12.314 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f1c859d2640 10 monclient: build_initial_monmap 2026-02-12T18:06:12.314 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.299+0000 7f1c859d2640 10 monclient: monmap: 2026-02-12T18:06:12.314 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:12.314 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.314 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:12.301022+0000 2026-02-12T18:06:12.314 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:12.301022+0000 2026-02-12T18:06:12.314 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:12.314 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.314 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:12.314 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:12.314 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:12.314 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:12.314 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:12.314 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:12.314 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:12.314 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:12.314 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:12.314 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:12.314 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:12.314 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.314 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f7874e80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.314 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f7874e80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.314 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f7874e80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.314 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9200640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f12f4090b00 0x7f12f4090f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.314 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9200640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f12f4090b00 0x7f12f4090f30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:44984/0 (socket says 10.20.193.48:44984) 2026-02-12T18:06:12.314 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9200640 1 -- 10.20.193.48:0/1578436574 learned_addr learned my addr 10.20.193.48:0/1578436574 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:12.315 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f7875681640 1 --2- 10.20.193.48:0/446371180 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f787005c950 0x7f787005cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.315 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9200640 10 monclient(hunting): get_auth_request con 0x7f12f4090b00 auth_method 0 2026-02-12T18:06:12.315 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9200640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.315 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9200640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.315 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9200640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.315 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9a01640 1 --2- 10.20.193.48:0/1578436574 >> v2:10.20.193.48:3300/0 conn(0x7f12f4090730 0x7f12f408fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.315 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f7875681640 10 monclient(hunting): get_auth_request con 0x7f787005c950 auth_method 0 2026-02-12T18:06:12.315 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f7875681640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.315 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f7875681640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.315 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f7875681640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.315 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9a01640 10 monclient(hunting): get_auth_request con 0x7f12f4090730 auth_method 0 2026-02-12T18:06:12.315 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9a01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.315 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9a01640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.315 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9a01640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.315 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9a01640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.315 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9a01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.315 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9a01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.315 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9200640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.315 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9200640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f7874e80640 10 monclient(hunting): handle_auth_done global_id 34139 payload 274 2026-02-12T18:06:12.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9200640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f7874e80640 1 -- 10.20.193.48:0/446371180 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f787005c950 msgr2=0x7f787005cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:12.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f7874e80640 1 --2- 10.20.193.48:0/446371180 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f787005c950 0x7f787005cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f7874e80640 1 -- 10.20.193.48:0/446371180 >> v1:10.20.193.111:6789/0 conn(0x7f787013db70 legacy=0x7f787013dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:12.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f7874e80640 10 monclient: _finish_hunting 0 2026-02-12T18:06:12.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f7874e80640 1 monclient: found mon.noname-b 2026-02-12T18:06:12.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f7874e80640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:12.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f7874e80640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:06:12.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f7874e80640 1 -- 10.20.193.48:0/446371180 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7870092990 con 0x7f787005e490 2026-02-12T18:06:12.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9a01640 10 monclient(hunting): handle_auth_done global_id 4293 payload 274 2026-02-12T18:06:12.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9a01640 1 -- 10.20.193.48:0/1578436574 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f12f4090b00 msgr2=0x7f12f4090f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:12.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9a01640 1 --2- 10.20.193.48:0/1578436574 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f12f4090b00 0x7f12f4090f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9a01640 1 -- 10.20.193.48:0/1578436574 >> v1:10.20.193.48:6789/0 conn(0x7f12f41442e0 legacy=0x7f12f4144780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:12.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9a01640 10 monclient: _finish_hunting 0 2026-02-12T18:06:12.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9a01640 1 monclient: found mon.noname-a 2026-02-12T18:06:12.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9a01640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:12.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9a01640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:06:12.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c859d2640 1 Processor -- start 2026-02-12T18:06:12.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9a01640 1 -- 10.20.193.48:0/1578436574 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12f40570c0 con 0x7f12f4090730 2026-02-12T18:06:12.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f12f9200640 1 --2- 10.20.193.48:0/1578436574 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f12f4090b00 0x7f12f4090f30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c859d2640 1 -- start start 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c859d2640 10 monclient: init 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c859d2640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c859d2640 10 monclient: _add_conns ranks=[7,3,9,6,1,0,10,8,2,4,5] 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c859d2640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1c800951a0 0x7f1c80093850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c859d2640 10 monclient(hunting): picked mon.noname-i con 0x7f1c800951a0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c859d2640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f1c80096ad0 0x7f1c80095570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c859d2640 10 monclient(hunting): picked mon.noname-g con 0x7f1c80096ad0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c859d2640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f1c80095ab0 0x7f1c801a4ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c859d2640 10 monclient(hunting): picked mon.noname-a con 0x7f1c80095ab0 addr v2:10.20.193.48:3300/0 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c859d2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c859d2640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f1c80096900 con 0x7f1c80095ab0 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c859d2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c859d2640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f1c80092260 con 0x7f1c80096ad0 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c859d2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c859d2640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f1c80093070 con 0x7f1c800951a0 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c859d2640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c859d2640 10 monclient(hunting): authenticate will time out at 611.026706s 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c7f7fe640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f1c80095ab0 0x7f1c801a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c7f7fe640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f1c80095ab0 0x7f1c801a4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:44408/0 (socket says 10.20.193.48:44408) 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c7f7fe640 1 -- 10.20.193.48:0/2411356192 learned_addr learned my addr 10.20.193.48:0/2411356192 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c7f7fe640 10 monclient(hunting): get_auth_request con 0x7f1c80095ab0 auth_method 0 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c7f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c7f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c7f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c7e7fc640 1 --2- 10.20.193.48:0/2411356192 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f1c80096ad0 0x7f1c80095570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c7f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c7f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c7f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c7e7fc640 10 monclient(hunting): get_auth_request con 0x7f1c80096ad0 auth_method 0 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c7e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c7e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c7e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c7effd640 1 --2- 10.20.193.48:0/2411356192 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1c800951a0 0x7f1c80093850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c7effd640 10 monclient(hunting): get_auth_request con 0x7f1c800951a0 auth_method 0 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c7effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c7effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c7effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c7f7fe640 10 monclient(hunting): handle_auth_done global_id 4302 payload 274 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c7f7fe640 1 -- 10.20.193.48:0/2411356192 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1c800951a0 msgr2=0x7f1c80093850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.300+0000 7f1c7f7fe640 1 --2- 10.20.193.48:0/2411356192 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1c800951a0 0x7f1c80093850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.301+0000 7f1c7f7fe640 1 -- 10.20.193.48:0/2411356192 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f1c80096ad0 msgr2=0x7f1c80095570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.301+0000 7f1c7f7fe640 1 --2- 10.20.193.48:0/2411356192 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f1c80096ad0 0x7f1c80095570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.301+0000 7f1c7f7fe640 10 monclient: _finish_hunting 0 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.301+0000 7f1c7f7fe640 1 monclient: found mon.noname-a 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.301+0000 7f1c7f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.301+0000 7f1c7f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.301+0000 7f1c7f7fe640 1 -- 10.20.193.48:0/2411356192 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c8004dc20 con 0x7f1c80095ab0 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfea242640 1 -- 10.20.193.48:0/2951787093 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcfe408a510 msgr2=0x7fcfe4142510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfea242640 1 --2- 10.20.193.48:0/2951787093 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcfe408a510 0x7fcfe4142510 secure :-1 s=READY pgs=37 gs=2 cs=0 l=1 c_cookie=16680491598685699145 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfe000a910 tx=0x7fcfe002fe10 comp rx=0 tx=0).ready entity=mon.4 client_cookie=e77d02bb628c7c49 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfe8a3f640 1 -- 10.20.193.48:0/2951787093 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcfe0036340 con 0x7fcfe408a510 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfe8a3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfe8a3f640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfe8a3f640 10 monclient: dump: 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.319 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfe8a3f640 10 monclient: _finish_auth 0 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfe8a3f640 10 monclient: _check_auth_tickets 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfe8a3f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfe8a3f640 1 -- 10.20.193.48:0/2951787093 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfe00364c0 con 0x7fcfe408a510 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfe8a3f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfe8a3f640 1 -- 10.20.193.48:0/2951787093 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcfe0036af0 con 0x7fcfe408a510 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfebccc640 5 monclient: authenticate success, global_id 34159 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfebccc640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfebccc640 4 set_mon_vals no callback set 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfe8a3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfe8a3f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfe8a3f640 10 monclient: dump: 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.320 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fbb34991640 1 -- 10.20.193.48:0/495872559 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbb30095ab0 msgr2=0x7fbb301a4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fbb34991640 1 --2- 10.20.193.48:0/495872559 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbb30095ab0 0x7fbb301a4ba0 secure :-1 s=READY pgs=34 gs=2 cs=0 l=1 c_cookie=13938442163096846047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb2400a9e0 tx=0x7fbb2402fef0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=c16f4b4c5db6fedf server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fbb2effd640 1 -- 10.20.193.48:0/495872559 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fbb24030b70 con 0x7fbb30095ab0 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fbb2effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fbb2effd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fbb2effd640 10 monclient: dump: 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fbb2effd640 10 monclient: _finish_auth 0 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fbb2effd640 10 monclient: _check_auth_tickets 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fbb2effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fbb2effd640 1 -- 10.20.193.48:0/495872559 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb24030cf0 con 0x7fbb30095ab0 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fbb2effd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fbb2effd640 1 -- 10.20.193.48:0/495872559 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fbb24030e60 con 0x7fbb30095ab0 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fbb3641b640 5 monclient: authenticate success, global_id 4283 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fbb3641b640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fbb3641b640 4 set_mon_vals no callback set 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fbb2effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fbb2effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fbb2effd640 10 monclient: dump: 2026-02-12T18:06:12.321 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.322 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.322 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.322 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.322 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.322 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.322 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.322 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.322 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.322 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.322 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.322 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.322 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.322 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.322 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.322 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfebccc640 10 monclient: shutdown 2026-02-12T18:06:12.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfebccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfebccc640 1 -- 10.20.193.48:0/2951787093 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcfe408a510 msgr2=0x7fcfe4142510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfebccc640 1 --2- 10.20.193.48:0/2951787093 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcfe408a510 0x7fcfe4142510 secure :-1 s=READY pgs=37 gs=2 cs=0 l=1 c_cookie=16680491598685699145 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfe000a910 tx=0x7fcfe002fe10 comp rx=0 tx=0).stop 2026-02-12T18:06:12.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfebccc640 1 -- 10.20.193.48:0/2951787093 shutdown_connections 2026-02-12T18:06:12.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfebccc640 1 --2- 10.20.193.48:0/2951787093 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcfe408a510 0x7fcfe4142510 unknown :-1 s=CLOSED pgs=37 gs=2 cs=0 l=1 c_cookie=16680491598685699145 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfebccc640 1 --2- 10.20.193.48:0/2951787093 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcfe408a0e0 0x7fcfe4141fd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfebccc640 1 --2- 10.20.193.48:0/2951787093 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcfe4089d10 0x7fcfe413ef20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfebccc640 1 -- 10.20.193.48:0/2951787093 >> 10.20.193.48:0/2951787093 conn(0x7fcfe4090ae0 msgr2=0x7fcfe4091730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfebccc640 1 -- 10.20.193.48:0/2951787093 shutdown_connections 2026-02-12T18:06:12.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fcfebccc640 1 -- 10.20.193.48:0/2951787093 wait complete. 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7f7874e80640 1 -- 10.20.193.48:0/446371180 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f787005e490 msgr2=0x7f787005d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7f7874e80640 1 --2- 10.20.193.48:0/446371180 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f787005e490 0x7f787005d260 secure :-1 s=READY pgs=25 gs=2 cs=0 l=1 c_cookie=10869448732946458592 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78640098d0 tx=0x7f786402ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96d80a08a797e7e0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fbb3641b640 10 monclient: shutdown 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fbb3641b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fbb3641b640 1 -- 10.20.193.48:0/495872559 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbb30095ab0 msgr2=0x7fbb301a4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fbb3641b640 1 --2- 10.20.193.48:0/495872559 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbb30095ab0 0x7fbb301a4ba0 secure :-1 s=READY pgs=34 gs=2 cs=0 l=1 c_cookie=13938442163096846047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb2400a9e0 tx=0x7fbb2402fef0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fa28f165640 10 monclient: get_monmap_and_config 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fa28f165640 10 monclient: build_initial_monmap 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7fa28f165640 10 monclient: monmap: 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:12.303987+0000 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:12.303987+0000 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.323 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7f785ffff640 1 -- 10.20.193.48:0/446371180 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f7864035340 con 0x7f787005e490 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7f785ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fbb3641b640 1 -- 10.20.193.48:0/495872559 shutdown_connections 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fbb3641b640 1 --2- 10.20.193.48:0/495872559 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbb30095ab0 0x7fbb301a4ba0 unknown :-1 s=CLOSED pgs=34 gs=2 cs=0 l=1 c_cookie=13938442163096846047 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fbb3641b640 1 --2- 10.20.193.48:0/495872559 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fbb30096ad0 0x7fbb30095570 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fbb3641b640 1 --2- 10.20.193.48:0/495872559 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fbb300951a0 0x7fbb30093850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fbb3641b640 1 -- 10.20.193.48:0/495872559 >> 10.20.193.48:0/495872559 conn(0x7fbb300548c0 msgr2=0x7fbb300973a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f785ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f785ffff640 10 monclient: dump: 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f785ffff640 10 monclient: _finish_auth 0 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f785ffff640 10 monclient: _check_auth_tickets 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f785ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f785ffff640 1 -- 10.20.193.48:0/446371180 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78640354c0 con 0x7f787005e490 2026-02-12T18:06:12.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fbb3641b640 1 -- 10.20.193.48:0/495872559 shutdown_connections 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f787790c640 5 monclient: authenticate success, global_id 34139 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f787790c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f785ffff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f787790c640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f785ffff640 1 -- 10.20.193.48:0/446371180 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f7864035af0 con 0x7f787005e490 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f787790c640 4 set_mon_vals no callback set 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f785ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f785ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fbb3641b640 1 -- 10.20.193.48:0/495872559 wait complete. 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f785ffff640 10 monclient: dump: 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fcfebccc640 10 monclient: build_initial_monmap 2026-02-12T18:06:12.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f787790c640 10 monclient: shutdown 2026-02-12T18:06:12.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f787790c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f787790c640 1 -- 10.20.193.48:0/446371180 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f787005e490 msgr2=0x7f787005d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fcfebccc640 10 monclient: monmap: 2026-02-12T18:06:12.326 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:12.326 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:12.326 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:12.326 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:12.326 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:12.326 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.326 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:12.326 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:12.326 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:12.326 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:12.326 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:12.326 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:12.326 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:12.326 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:12.326 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:12.326 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f787790c640 1 --2- 10.20.193.48:0/446371180 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f787005e490 0x7f787005d260 secure :-1 s=READY pgs=25 gs=2 cs=0 l=1 c_cookie=10869448732946458592 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78640098d0 tx=0x7f786402ee20 comp rx=0 tx=0).stop 2026-02-12T18:06:12.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7f12f9a01640 1 -- 10.20.193.48:0/1578436574 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f12f4090730 msgr2=0x7f12f408fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:12.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.302+0000 7f12f9a01640 1 --2- 10.20.193.48:0/1578436574 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f12f4090730 0x7f12f408fca0 secure :-1 s=READY pgs=60 gs=3 cs=0 l=1 c_cookie=3411470321259434189 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12e4004740 tx=0x7f12e402ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f57fa2eb474d0cd server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f12f89ff640 1 -- 10.20.193.48:0/1578436574 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f12e402fe70 con 0x7f12f4090730 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f12f89ff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f12f89ff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f12f89ff640 10 monclient: dump: 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f12f89ff640 10 monclient: _finish_auth 0 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f12f89ff640 10 monclient: _check_auth_tickets 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f12f89ff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f12f89ff640 1 -- 10.20.193.48:0/1578436574 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12e4035340 con 0x7f12f4090730 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f12f89ff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f12f89ff640 1 -- 10.20.193.48:0/1578436574 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f12e4035970 con 0x7f12f4090730 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f12fbc8c640 5 monclient: authenticate success, global_id 4293 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f12fbc8c640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f12fbc8c640 4 set_mon_vals no callback set 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f12f89ff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f12f89ff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f12f89ff640 10 monclient: dump: 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.327 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.328 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.328 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.328 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.328 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.328 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f787790c640 1 -- 10.20.193.48:0/446371180 shutdown_connections 2026-02-12T18:06:12.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f787790c640 1 --2- 10.20.193.48:0/446371180 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f787005e490 0x7f787005d260 unknown :-1 s=CLOSED pgs=25 gs=2 cs=0 l=1 c_cookie=10869448732946458592 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f787790c640 1 --2- 10.20.193.48:0/446371180 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f787005c950 0x7f787005cd20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f787790c640 1 -- 10.20.193.48:0/446371180 >> 10.20.193.48:0/446371180 conn(0x7f78700548a0 msgr2=0x7f7870097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f787790c640 1 -- 10.20.193.48:0/446371180 shutdown_connections 2026-02-12T18:06:12.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f787790c640 1 -- 10.20.193.48:0/446371180 wait complete. 2026-02-12T18:06:12.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f12fbc8c640 10 monclient: shutdown 2026-02-12T18:06:12.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f12fbc8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f12fbc8c640 1 -- 10.20.193.48:0/1578436574 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f12f4090730 msgr2=0x7f12f408fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f12fbc8c640 1 --2- 10.20.193.48:0/1578436574 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f12f4090730 0x7f12f408fca0 secure :-1 s=READY pgs=60 gs=3 cs=0 l=1 c_cookie=3411470321259434189 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12e4004740 tx=0x7f12e402ed30 comp rx=0 tx=0).stop 2026-02-12T18:06:12.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f12fbc8c640 1 -- 10.20.193.48:0/1578436574 shutdown_connections 2026-02-12T18:06:12.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f12fbc8c640 1 --2- 10.20.193.48:0/1578436574 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f12f4090b00 0x7f12f4090f30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f12fbc8c640 1 --2- 10.20.193.48:0/1578436574 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f12f4090730 0x7f12f408fca0 unknown :-1 s=CLOSED pgs=60 gs=3 cs=0 l=1 c_cookie=3411470321259434189 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fa28f165640 1 Processor -- start 2026-02-12T18:06:12.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c7f7fe640 1 -- 10.20.193.48:0/2411356192 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1c80095ab0 msgr2=0x7f1c801a4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:12.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f12fbc8c640 1 -- 10.20.193.48:0/1578436574 >> 10.20.193.48:0/1578436574 conn(0x7f12f4054e50 msgr2=0x7f12f40952a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c7f7fe640 1 --2- 10.20.193.48:0/2411356192 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1c80095ab0 0x7f1c801a4ba0 secure :-1 s=READY pgs=61 gs=1 cs=0 l=1 c_cookie=11590957501955302635 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c7000a140 tx=0x7f1c7002fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0db5a6fbeb1e4eb server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fcfebccc640 1 Processor -- start 2026-02-12T18:06:12.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fa28f165640 1 -- start start 2026-02-12T18:06:12.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fa28f165640 10 monclient: init 2026-02-12T18:06:12.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fbb3641b640 10 monclient: build_initial_monmap 2026-02-12T18:06:12.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fbb3641b640 10 monclient: monmap: 2026-02-12T18:06:12.329 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:12.329 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:12.329 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:12.329 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:12.329 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:12.329 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.329 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:12.329 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:12.329 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:12.329 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:12.329 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:12.329 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:12.329 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:12.329 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:12.329 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:12.329 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c7dffb640 1 -- 10.20.193.48:0/2411356192 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1c70030b50 con 0x7f1c80095ab0 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c7dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c7dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c7dffb640 10 monclient: dump: 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c7dffb640 10 monclient: _finish_auth 0 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c7dffb640 10 monclient: _check_auth_tickets 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c7dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c7dffb640 1 -- 10.20.193.48:0/2411356192 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c70030cd0 con 0x7f1c80095ab0 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c7dffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c7dffb640 1 -- 10.20.193.48:0/2411356192 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1c70030e40 con 0x7f1c80095ab0 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c859d2640 5 monclient: authenticate success, global_id 4302 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c859d2640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c859d2640 4 set_mon_vals no callback set 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c7dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c7dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c7dffb640 10 monclient: dump: 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.330 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f787790c640 10 monclient: build_initial_monmap 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f787790c640 10 monclient: monmap: 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fbb3641b640 1 Processor -- start 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f12fbc8c640 1 -- 10.20.193.48:0/1578436574 shutdown_connections 2026-02-12T18:06:12.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f12fbc8c640 1 -- 10.20.193.48:0/1578436574 wait complete. 2026-02-12T18:06:12.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fa28f165640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:12.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fa28f165640 10 monclient: _add_conns ranks=[9,1,3,5,6,8,10,2,0,4,7] 2026-02-12T18:06:12.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fbb3641b640 1 -- start start 2026-02-12T18:06:12.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fa28f165640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fa28808d920 0x7fa288054330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fbb3641b640 10 monclient: init 2026-02-12T18:06:12.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c859d2640 10 monclient: shutdown 2026-02-12T18:06:12.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c859d2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c859d2640 1 -- 10.20.193.48:0/2411356192 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1c80095ab0 msgr2=0x7f1c801a4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c859d2640 1 --2- 10.20.193.48:0/2411356192 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1c80095ab0 0x7f1c801a4ba0 secure :-1 s=READY pgs=61 gs=1 cs=0 l=1 c_cookie=11590957501955302635 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c7000a140 tx=0x7f1c7002fed0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fa28f165640 10 monclient(hunting): picked mon.noname-a con 0x7fa28808d920 addr v2:10.20.193.48:3300/0 2026-02-12T18:06:12.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fa28f165640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fa28808a050 addr v1:10.20.193.111:6789/0 2026-02-12T18:06:12.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fa28f165640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa28808f4c0 0x7fa2881a39b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fa28f165640 10 monclient(hunting): picked mon.noname-g con 0x7fa28808f4c0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:12.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c859d2640 1 -- 10.20.193.48:0/2411356192 shutdown_connections 2026-02-12T18:06:12.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c859d2640 1 --2- 10.20.193.48:0/2411356192 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1c80095ab0 0x7f1c801a4ba0 unknown :-1 s=CLOSED pgs=61 gs=1 cs=0 l=1 c_cookie=11590957501955302635 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c859d2640 1 --2- 10.20.193.48:0/2411356192 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f1c80096ad0 0x7f1c80095570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fa28f165640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa28804dc20 con 0x7fa28808a050 2026-02-12T18:06:12.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fa28f165640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fa28f165640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7fa28808dcf0 con 0x7fa28808d920 2026-02-12T18:06:12.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c859d2640 1 --2- 10.20.193.48:0/2411356192 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1c800951a0 0x7f1c80093850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7f1c859d2640 1 -- 10.20.193.48:0/2411356192 >> 10.20.193.48:0/2411356192 conn(0x7f1c800548c0 msgr2=0x7f1c800973a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fa28f165640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fa28f165640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa28808a7a0 con 0x7fa28808f4c0 2026-02-12T18:06:12.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fa28f165640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:12.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.303+0000 7fa28f165640 10 monclient(hunting): authenticate will time out at 611.029997s 2026-02-12T18:06:12.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f1c859d2640 1 -- 10.20.193.48:0/2411356192 shutdown_connections 2026-02-12T18:06:12.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f787790c640 1 Processor -- start 2026-02-12T18:06:12.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfebccc640 1 -- start start 2026-02-12T18:06:12.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfebccc640 10 monclient: init 2026-02-12T18:06:12.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f1c859d2640 1 -- 10.20.193.48:0/2411356192 wait complete. 2026-02-12T18:06:12.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28ceda640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fa28808d920 0x7fa288054330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f787790c640 1 -- start start 2026-02-12T18:06:12.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f787790c640 10 monclient: init 2026-02-12T18:06:12.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28ceda640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fa28808d920 0x7fa288054330 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:44416/0 (socket says 10.20.193.48:44416) 2026-02-12T18:06:12.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28ceda640 1 -- 10.20.193.48:0/1964942741 learned_addr learned my addr 10.20.193.48:0/1964942741 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:12.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28ceda640 10 monclient(hunting): get_auth_request con 0x7fa28808d920 auth_method 0 2026-02-12T18:06:12.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28ceda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28ceda640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28ceda640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28d6db640 1 --2- 10.20.193.48:0/1964942741 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa28808f4c0 0x7fa2881a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28d6db640 10 monclient(hunting): get_auth_request con 0x7fa28808f4c0 auth_method 0 2026-02-12T18:06:12.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28d6db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28d6db640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28d6db640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfebccc640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:12.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfebccc640 10 monclient: _add_conns ranks=[8,6,7,4,3,2,1,5,0] 2026-02-12T18:06:12.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfebccc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcfe4089d10 0x7fcfe405e460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfebccc640 10 monclient(hunting): picked mon.noname-e con 0x7fcfe4089d10 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:12.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb3641b640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:12.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfebccc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcfe408a0e0 0x7fcfe408ad30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfebccc640 10 monclient(hunting): picked mon.noname-d con 0x7fcfe408a0e0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:06:12.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfebccc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcfe408a510 0x7fcfe408b270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb3641b640 10 monclient: _add_conns ranks=[4,2,8,6,1,5,0,3,7] 2026-02-12T18:06:12.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfebccc640 10 monclient(hunting): picked mon.noname-i con 0x7fcfe408a510 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:12.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfebccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfebccc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fcfe408f080 con 0x7fcfe408a0e0 2026-02-12T18:06:12.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfebccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfebccc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fcfe405da00 con 0x7fcfe408a510 2026-02-12T18:06:12.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfebccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28d6db640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28d6db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb3641b640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fbb300951a0 0x7fbb301dafd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb3641b640 10 monclient(hunting): picked mon.noname-c con 0x7fbb300951a0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:06:12.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb3641b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fbb30095ab0 0x7fbb301b0d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb3641b640 10 monclient(hunting): picked mon.noname-b con 0x7fbb30095ab0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:12.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f787790c640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:12.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28d6db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb3641b640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbb30096ad0 0x7fbb301b1260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb3641b640 10 monclient(hunting): picked mon.noname-e con 0x7fbb30096ad0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:12.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f787790c640 10 monclient: _add_conns ranks=[5,0,2,6,1,4,3,8,7] 2026-02-12T18:06:12.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb3641b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb3641b640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fbb301dbf20 con 0x7fbb30095ab0 2026-02-12T18:06:12.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb3641b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb3641b640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fbb3008d770 con 0x7fbb300951a0 2026-02-12T18:06:12.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb3641b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb3641b640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fbb300901e0 con 0x7fbb30096ad0 2026-02-12T18:06:12.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb3641b640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:12.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb3641b640 10 monclient(hunting): authenticate will time out at 611.030368s 2026-02-12T18:06:12.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfebccc640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fcfe405dce0 con 0x7fcfe4089d10 2026-02-12T18:06:12.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfebccc640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:12.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f787790c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f787005c950 0x7f787008d330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f787790c640 10 monclient(hunting): picked mon.noname-h con 0x7f787005c950 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:12.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfebccc640 10 monclient(hunting): authenticate will time out at 611.030325s 2026-02-12T18:06:12.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f787790c640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f787005e490 0x7f787008d870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f787790c640 10 monclient(hunting): picked mon.noname-a con 0x7f787005e490 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:06:12.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f787790c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f787013db70 0x7f787013cc90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f787790c640 10 monclient(hunting): picked mon.noname-b con 0x7f787013db70 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:12.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9a41640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcfe4089d10 0x7fcfe405e460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f787790c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f787790c640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f787012d7f0 con 0x7f787005e490 2026-02-12T18:06:12.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f787790c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f787790c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f787013e7a0 con 0x7f787013db70 2026-02-12T18:06:12.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f787790c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f787790c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f787013e3e0 con 0x7f787005c950 2026-02-12T18:06:12.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f787790c640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:12.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f787790c640 10 monclient(hunting): authenticate will time out at 611.030421s 2026-02-12T18:06:12.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28ceda640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28ceda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9240640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcfe408a0e0 0x7fcfe408ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f1c859d2640 10 monclient: build_initial_monmap 2026-02-12T18:06:12.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb34991640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbb30096ad0 0x7fbb301b1260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2f7fe640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fbb30095ab0 0x7fbb301b0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9240640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcfe408a0e0 0x7fcfe408ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:38102/0 (socket says 10.20.193.48:38102) 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9a41640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcfe4089d10 0x7fcfe405e460 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:33882/0 (socket says 10.20.193.48:33882) 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9240640 1 -- 10.20.193.48:0/4179421653 learned_addr learned my addr 10.20.193.48:0/4179421653 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9240640 10 monclient(hunting): get_auth_request con 0x7fcfe408a0e0 auth_method 0 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9240640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9240640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9240640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2f7fe640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fbb30095ab0 0x7fbb301b0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:44992/0 (socket says 10.20.193.48:44992) 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb34991640 10 monclient(hunting): get_auth_request con 0x7fbb30096ad0 auth_method 0 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9a41640 10 monclient(hunting): get_auth_request con 0x7fcfe4089d10 auth_method 0 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9a41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9a41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f1c859d2640 10 monclient: monmap: 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:12.338 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:12.339 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:12.339 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2f7fe640 1 -- 10.20.193.48:0/189657780 learned_addr learned my addr 10.20.193.48:0/189657780 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:12.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb34991640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb34991640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb34991640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9a41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f12fbc8c640 10 monclient: build_initial_monmap 2026-02-12T18:06:12.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2f7fe640 10 monclient(hunting): get_auth_request con 0x7fbb30095ab0 auth_method 0 2026-02-12T18:06:12.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2ffff640 1 --2- 10.20.193.48:0/189657780 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fbb300951a0 0x7fbb301dafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfea242640 1 --2- 10.20.193.48:0/4179421653 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcfe408a510 0x7fcfe408b270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f12fbc8c640 10 monclient: monmap: 2026-02-12T18:06:12.339 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:12.339 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:12.339 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:12.339 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:12.339 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:12.339 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.339 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:12.340 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:12.340 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:12.340 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:12.340 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:12.340 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:12.340 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:12.340 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:12.340 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:12.340 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7874e80640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f787005e490 0x7f787008d870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28ceda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2ffff640 10 monclient(hunting): get_auth_request con 0x7fbb300951a0 auth_method 0 2026-02-12T18:06:12.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfea242640 10 monclient(hunting): get_auth_request con 0x7fcfe408a510 auth_method 0 2026-02-12T18:06:12.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfea242640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28d6db640 10 monclient(hunting): handle_auth_done global_id 4206 payload 274 2026-02-12T18:06:12.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfea242640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfea242640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7874e80640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f787005e490 0x7f787008d870 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:44420/0 (socket says 10.20.193.48:44420) 2026-02-12T18:06:12.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7874e80640 1 -- 10.20.193.48:0/1559983568 learned_addr learned my addr 10.20.193.48:0/1559983568 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:12.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9240640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7874e80640 10 monclient(hunting): get_auth_request con 0x7f787005e490 auth_method 0 2026-02-12T18:06:12.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7874e80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7874e80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7874e80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7875e82640 1 --2- 10.20.193.48:0/1559983568 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f787013db70 0x7f787013cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28d6db640 1 -- 10.20.193.48:0/1964942741 >> v2:10.20.193.48:3300/0 conn(0x7fa28808d920 msgr2=0x7fa288054330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:12.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28d6db640 1 --2- 10.20.193.48:0/1964942741 >> v2:10.20.193.48:3300/0 conn(0x7fa28808d920 0x7fa288054330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9240640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28d6db640 1 -- 10.20.193.48:0/1964942741 >> v1:10.20.193.111:6789/0 conn(0x7fa28808a050 legacy=0x7fa288054870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:12.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28d6db640 10 monclient: _finish_hunting 0 2026-02-12T18:06:12.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28d6db640 1 monclient: found mon.noname-g 2026-02-12T18:06:12.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb34991640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9240640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9a41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9a41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7875e82640 10 monclient(hunting): get_auth_request con 0x7f787013db70 auth_method 0 2026-02-12T18:06:12.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7875e82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28d6db640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:12.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28d6db640 10 monclient: _send_mon_message to mon.noname-g at v2:10.20.193.111:3301/0 2026-02-12T18:06:12.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb34991640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb34991640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9a41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7875e82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7875e82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7874e80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7874e80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7875681640 1 --2- 10.20.193.48:0/1559983568 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f787005c950 0x7f787008d330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7874e80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fa28d6db640 1 -- 10.20.193.48:0/1964942741 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa28808e660 con 0x7fa28808f4c0 2026-02-12T18:06:12.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7875681640 10 monclient(hunting): get_auth_request con 0x7f787005c950 auth_method 0 2026-02-12T18:06:12.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7875681640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7875681640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7875681640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfea242640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfea242640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfea242640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7875681640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7875681640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7875681640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f12fbc8c640 1 Processor -- start 2026-02-12T18:06:12.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f1c859d2640 1 Processor -- start 2026-02-12T18:06:12.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2f7fe640 10 monclient(hunting): handle_auth_done global_id 34157 payload 824 2026-02-12T18:06:12.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2f7fe640 1 -- 10.20.193.48:0/189657780 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbb30096ad0 msgr2=0x7fbb301b1260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2f7fe640 1 --2- 10.20.193.48:0/189657780 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbb30096ad0 0x7fbb301b1260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7875e82640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7875e82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2f7fe640 1 -- 10.20.193.48:0/189657780 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fbb300951a0 msgr2=0x7fbb301dafd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2f7fe640 1 --2- 10.20.193.48:0/189657780 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fbb300951a0 0x7fbb301dafd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2f7fe640 10 monclient: _finish_hunting 0 2026-02-12T18:06:12.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2f7fe640 1 monclient: found mon.noname-b 2026-02-12T18:06:12.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7875e82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:12.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2f7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:06:12.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fbb2f7fe640 1 -- 10.20.193.48:0/189657780 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb20009420 con 0x7fbb30095ab0 2026-02-12T18:06:12.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9240640 10 monclient(hunting): handle_auth_done global_id 4326 payload 824 2026-02-12T18:06:12.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9240640 1 -- 10.20.193.48:0/4179421653 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcfe4089d10 msgr2=0x7fcfe405e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9240640 1 --2- 10.20.193.48:0/4179421653 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcfe4089d10 0x7fcfe405e460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9240640 1 -- 10.20.193.48:0/4179421653 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcfe408a510 msgr2=0x7fcfe408b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9240640 1 --2- 10.20.193.48:0/4179421653 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcfe408a510 0x7fcfe408b270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9240640 10 monclient: _finish_hunting 0 2026-02-12T18:06:12.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9240640 1 monclient: found mon.noname-d 2026-02-12T18:06:12.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f12fbc8c640 1 -- start start 2026-02-12T18:06:12.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f12fbc8c640 10 monclient: init 2026-02-12T18:06:12.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7874e80640 10 monclient(hunting): handle_auth_done global_id 4320 payload 824 2026-02-12T18:06:12.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9240640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:12.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9240640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:06:12.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7fcfe9240640 1 -- 10.20.193.48:0/4179421653 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe000a500 con 0x7fcfe408a0e0 2026-02-12T18:06:12.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f1c859d2640 1 -- start start 2026-02-12T18:06:12.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f1c859d2640 10 monclient: init 2026-02-12T18:06:12.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7874e80640 1 -- 10.20.193.48:0/1559983568 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f787005c950 msgr2=0x7f787008d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7874e80640 1 --2- 10.20.193.48:0/1559983568 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f787005c950 0x7f787008d330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7874e80640 1 -- 10.20.193.48:0/1559983568 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f787013db70 msgr2=0x7f787013cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7874e80640 1 --2- 10.20.193.48:0/1559983568 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f787013db70 0x7f787013cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7874e80640 10 monclient: _finish_hunting 0 2026-02-12T18:06:12.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7874e80640 1 monclient: found mon.noname-a 2026-02-12T18:06:12.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7874e80640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:12.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7874e80640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:06:12.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.304+0000 7f7874e80640 1 -- 10.20.193.48:0/1559983568 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78640094f0 con 0x7f787005e490 2026-02-12T18:06:12.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c859d2640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:12.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12fbc8c640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:12.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c859d2640 10 monclient: _add_conns ranks=[1,8,5,3,4,7,0,2,6] 2026-02-12T18:06:12.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12fbc8c640 10 monclient: _add_conns ranks=[1,0,3,4,8,6,7,2,5] 2026-02-12T18:06:12.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c859d2640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f1c800951a0 0x7f1c801d7b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12fbc8c640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f12f4090730 0x7f12f41db410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12fbc8c640 10 monclient(hunting): picked mon.noname-f con 0x7f12f4090730 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:06:12.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c859d2640 10 monclient(hunting): picked mon.noname-f con 0x7f1c800951a0 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:06:12.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c859d2640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f1c80095ab0 0x7f1c801b0da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c859d2640 10 monclient(hunting): picked mon.noname-e con 0x7f1c80095ab0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:12.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12fbc8c640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f12f4090b00 0x7f12f413e110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12fbc8c640 10 monclient(hunting): picked mon.noname-a con 0x7f12f4090b00 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:06:12.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c859d2640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f1c80096ad0 0x7f1c801db040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c859d2640 10 monclient(hunting): picked mon.noname-h con 0x7f1c80096ad0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:12.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c859d2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12fbc8c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f12f41442e0 0x7f12f413e650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12fbc8c640 10 monclient(hunting): picked mon.noname-g con 0x7f12f41442e0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:12.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12fbc8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12fbc8c640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f12f412f550 con 0x7f12f4090b00 2026-02-12T18:06:12.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12fbc8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c859d2640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1c8019bea0 con 0x7f1c800951a0 2026-02-12T18:06:12.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c859d2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c859d2640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f1c8019c540 con 0x7f1c80096ad0 2026-02-12T18:06:12.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c859d2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c859d2640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f1c8019b740 con 0x7f1c80095ab0 2026-02-12T18:06:12.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c859d2640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:12.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12fbc8c640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f12f413eb90 con 0x7f12f4090730 2026-02-12T18:06:12.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12fbc8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12fbc8c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f12f4095310 con 0x7f12f41442e0 2026-02-12T18:06:12.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12fbc8c640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:12.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12fbc8c640 10 monclient(hunting): authenticate will time out at 611.031120s 2026-02-12T18:06:12.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c859d2640 10 monclient(hunting): authenticate will time out at 611.031114s 2026-02-12T18:06:12.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12f9200640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f12f4090b00 0x7f12f413e110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7e7fc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f1c80095ab0 0x7f1c801b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12f9200640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f12f4090b00 0x7f12f413e110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:44430/0 (socket says 10.20.193.48:44430) 2026-02-12T18:06:12.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12f9200640 1 -- 10.20.193.48:0/3185190474 learned_addr learned my addr 10.20.193.48:0/3185190474 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:12.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12f9200640 10 monclient(hunting): get_auth_request con 0x7f12f4090b00 auth_method 0 2026-02-12T18:06:12.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12f9200640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12f9200640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12f9200640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7e7fc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f1c80095ab0 0x7f1c801b0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:33892/0 (socket says 10.20.193.48:33892) 2026-02-12T18:06:12.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7e7fc640 1 -- 10.20.193.48:0/1728024029 learned_addr learned my addr 10.20.193.48:0/1728024029 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:12.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7e7fc640 10 monclient(hunting): get_auth_request con 0x7f1c80095ab0 auth_method 0 2026-02-12T18:06:12.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12f9200640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12f9200640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12f9200640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12f9a01640 1 --2- 10.20.193.48:0/3185190474 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f12f4090730 0x7f12f41db410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12f9a01640 10 monclient(hunting): get_auth_request con 0x7f12f4090730 auth_method 0 2026-02-12T18:06:12.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12f9a01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7f7fe640 1 --2- 10.20.193.48:0/1728024029 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f1c80096ad0 0x7f1c801db040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12f9a01640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12f9a01640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7f7fe640 10 monclient(hunting): get_auth_request con 0x7f1c80096ad0 auth_method 0 2026-02-12T18:06:12.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12fa202640 1 --2- 10.20.193.48:0/3185190474 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f12f41442e0 0x7f12f413e650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12f9200640 10 monclient(hunting): handle_auth_done global_id 4329 payload 824 2026-02-12T18:06:12.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12f9200640 1 -- 10.20.193.48:0/3185190474 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f12f41442e0 msgr2=0x7f12f413e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12f9200640 1 --2- 10.20.193.48:0/3185190474 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f12f41442e0 0x7f12f413e650 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12f9200640 1 -- 10.20.193.48:0/3185190474 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f12f4090730 msgr2=0x7f12f41db410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12f9200640 1 --2- 10.20.193.48:0/3185190474 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f12f4090730 0x7f12f41db410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12f9200640 10 monclient: _finish_hunting 0 2026-02-12T18:06:12.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12f9200640 1 monclient: found mon.noname-a 2026-02-12T18:06:12.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12f9200640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:12.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12f9200640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:06:12.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f12f9200640 1 -- 10.20.193.48:0/3185190474 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12e80094f0 con 0x7f12f4090b00 2026-02-12T18:06:12.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7e7fc640 10 monclient(hunting): handle_auth_done global_id 4310 payload 824 2026-02-12T18:06:12.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7effd640 1 --2- 10.20.193.48:0/1728024029 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f1c800951a0 0x7f1c801d7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7e7fc640 1 -- 10.20.193.48:0/1728024029 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f1c80096ad0 msgr2=0x7f1c801db040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7e7fc640 1 --2- 10.20.193.48:0/1728024029 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f1c80096ad0 0x7f1c801db040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7e7fc640 1 -- 10.20.193.48:0/1728024029 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f1c800951a0 msgr2=0x7f1c801d7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7e7fc640 1 --2- 10.20.193.48:0/1728024029 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f1c800951a0 0x7f1c801d7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7e7fc640 10 monclient: _finish_hunting 0 2026-02-12T18:06:12.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7e7fc640 1 monclient: found mon.noname-e 2026-02-12T18:06:12.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:12.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7e7fc640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:06:12.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7e7fc640 1 -- 10.20.193.48:0/1728024029 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c7000a5d0 con 0x7f1c80095ab0 2026-02-12T18:06:12.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7effd640 10 monclient: get_auth_request con 0x7f1c800951a0 auth_method 0 2026-02-12T18:06:12.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.305+0000 7f1c7effd640 1 --2- 10.20.193.48:0/1728024029 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f1c800951a0 0x7f1c801d7b00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-12T18:06:12.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.306+0000 7fcfe9240640 1 -- 10.20.193.48:0/4179421653 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcfe408a0e0 msgr2=0x7fcfe408ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:12.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fcfe9240640 1 --2- 10.20.193.48:0/4179421653 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcfe408a0e0 0x7fcfe408ad30 secure :-1 s=READY pgs=43 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfd800e7e0 tx=0x7fcfd800ecb0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb2f7fe640 1 -- 10.20.193.48:0/189657780 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fbb30095ab0 msgr2=0x7fbb301b0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:12.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb2f7fe640 1 --2- 10.20.193.48:0/189657780 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fbb30095ab0 0x7fbb301b0d20 secure :-1 s=READY pgs=26 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb200096d0 tx=0x7fbb2000c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f7874e80640 1 -- 10.20.193.48:0/1559983568 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f787005e490 msgr2=0x7f787008d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:12.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f7874e80640 1 --2- 10.20.193.48:0/1559983568 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f787005e490 0x7f787008d870 secure :-1 s=READY pgs=62 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7864004740 tx=0x7f7864004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb2cff9640 1 -- 10.20.193.48:0/189657780 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fbb2000ee90 con 0x7fbb30095ab0 2026-02-12T18:06:12.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb2cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fcfd27fc640 1 -- 10.20.193.48:0/4179421653 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcfd80044f0 con 0x7fcfe408a0e0 2026-02-12T18:06:12.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fcfd27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb2cff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fcfd27fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb2cff9640 10 monclient: dump: 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb2cff9640 10 monclient: _finish_auth 0 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb2cff9640 10 monclient: _check_auth_tickets 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fcfd27fc640 10 monclient: dump: 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.351 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.352 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.352 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.352 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.352 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.352 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.352 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.352 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.352 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.352 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fcfd27fc640 10 monclient: _finish_auth 0 2026-02-12T18:06:12.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fcfd27fc640 10 monclient: _check_auth_tickets 2026-02-12T18:06:12.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fcfd27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:12.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb2cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:12.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb2cff9640 1 -- 10.20.193.48:0/189657780 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb2000ce50 con 0x7fbb30095ab0 2026-02-12T18:06:12.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb3641b640 5 monclient: authenticate success, global_id 34157 2026-02-12T18:06:12.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb3641b640 10 monclient: _renew_subs 2026-02-12T18:06:12.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fcfebccc640 5 monclient: authenticate success, global_id 4326 2026-02-12T18:06:12.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fcfebccc640 10 monclient: _renew_subs 2026-02-12T18:06:12.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fcfd27fc640 1 -- 10.20.193.48:0/4179421653 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfd80036d0 con 0x7fcfe408a0e0 2026-02-12T18:06:12.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fcfebccc640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:06:12.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb3641b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:12.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb3641b640 1 -- 10.20.193.48:0/189657780 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb2400a5d0 con 0x7fbb30095ab0 2026-02-12T18:06:12.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fcfebccc640 1 -- 10.20.193.48:0/4179421653 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfe405c4e0 con 0x7fcfe408a0e0 2026-02-12T18:06:12.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fcfd27fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:12.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa28d6db640 1 -- 10.20.193.48:0/1964942741 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa28808f4c0 msgr2=0x7fa2881a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:12.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa28d6db640 1 --2- 10.20.193.48:0/1964942741 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa28808f4c0 0x7fa2881a39b0 secure :-1 s=READY pgs=29 gs=3 cs=0 l=1 c_cookie=4306180022669408738 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa284005820 tx=0x7fa28402fdf0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=3bc29fea5e17f9e2 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fcfd27fc640 1 -- 10.20.193.48:0/4179421653 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcfd8003840 con 0x7fcfe408a0e0 2026-02-12T18:06:12.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fcfd27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fcfd3fff640 4 set_mon_vals no callback set 2026-02-12T18:06:12.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f785dffb640 1 -- 10.20.193.48:0/1559983568 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f7864037900 con 0x7f787005e490 2026-02-12T18:06:12.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f785dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb2cff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:12.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb2cff9640 1 -- 10.20.193.48:0/189657780 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fbb20013df0 con 0x7fbb30095ab0 2026-02-12T18:06:12.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb2cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fcfd27fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:06:12.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fcfd27fc640 10 monclient: dump: 2026-02-12T18:06:12.353 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.353 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.353 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.353 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.353 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.353 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.353 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.353 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.353 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.353 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.353 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.353 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.353 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.353 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.353 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.353 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb2cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb2e7fc640 4 set_mon_vals no callback set 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb2cff9640 10 monclient: dump: 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f785dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f785dffb640 10 monclient: dump: 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.354 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.355 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f785dffb640 10 monclient: _finish_auth 0 2026-02-12T18:06:12.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb3641b640 10 monclient: _renew_subs 2026-02-12T18:06:12.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f785dffb640 10 monclient: _check_auth_tickets 2026-02-12T18:06:12.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f785dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:12.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f787790c640 5 monclient: authenticate success, global_id 4320 2026-02-12T18:06:12.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb3641b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:12.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb3641b640 1 -- 10.20.193.48:0/189657780 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb3019c6e0 con 0x7fbb30095ab0 2026-02-12T18:06:12.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f785dffb640 1 -- 10.20.193.48:0/1559983568 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7864037a60 con 0x7f787005e490 2026-02-12T18:06:12.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f787790c640 10 monclient: _renew_subs 2026-02-12T18:06:12.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f787790c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:12.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f787790c640 1 -- 10.20.193.48:0/1559983568 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7870143a80 con 0x7f787005e490 2026-02-12T18:06:12.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f785dffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:12.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f785dffb640 1 -- 10.20.193.48:0/1559983568 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f7864037bd0 con 0x7f787005e490 2026-02-12T18:06:12.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f785dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f785dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:12.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f785f7fe640 4 set_mon_vals no callback set 2026-02-12T18:06:12.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f785dffb640 10 monclient: dump: 2026-02-12T18:06:12.355 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.355 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.355 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.355 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.355 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.355 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f787790c640 10 monclient: _renew_subs 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f787790c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f787790c640 1 -- 10.20.193.48:0/1559983568 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f787008ab10 con 0x7f787005e490 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa27f7fe640 1 -- 10.20.193.48:0/1964942741 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa284036340 con 0x7fa28808f4c0 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa27f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa27f7fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa27f7fe640 10 monclient: dump: 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.356 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa27f7fe640 10 monclient: _finish_auth 0 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa27f7fe640 10 monclient: _check_auth_tickets 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa27f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa27f7fe640 1 -- 10.20.193.48:0/1964942741 <== mon.3 v2:10.20.193.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2840364c0 con 0x7fa28808f4c0 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa27f7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa27f7fe640 1 -- 10.20.193.48:0/1964942741 <== mon.3 v2:10.20.193.111:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa284036af0 con 0x7fa28808f4c0 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa27f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa27f7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa27f7fe640 10 monclient: dump: 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa28f165640 5 monclient: authenticate success, global_id 4206 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa28f165640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa28f165640 4 set_mon_vals no callback set 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f1c7e7fc640 1 -- 10.20.193.48:0/1728024029 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f1c80095ab0 msgr2=0x7f1c801b0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f1c7e7fc640 1 --2- 10.20.193.48:0/1728024029 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f1c80095ab0 0x7f1c801b0da0 secure :-1 s=READY pgs=35 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c6800e810 tx=0x7f1c6800ece0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f12f9200640 1 -- 10.20.193.48:0/3185190474 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f12f4090b00 msgr2=0x7f12f413e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:12.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f12f9200640 1 --2- 10.20.193.48:0/3185190474 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f12f4090b00 0x7f12f413e110 secure :-1 s=READY pgs=63 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12e8004740 tx=0x7f12e800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb3641b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb3641b640 1 -- 10.20.193.48:0/189657780 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbb30095f20 con 0x7fbb30095ab0 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa28f165640 10 monclient: shutdown 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa28f165640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa28f165640 1 -- 10.20.193.48:0/1964942741 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa28808f4c0 msgr2=0x7fa2881a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa28f165640 1 --2- 10.20.193.48:0/1964942741 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa28808f4c0 0x7fa2881a39b0 secure :-1 s=READY pgs=29 gs=3 cs=0 l=1 c_cookie=4306180022669408738 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa284005820 tx=0x7fa28402fdf0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fcfd27fc640 1 -- 10.20.193.48:0/4179421653 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fcfd8004030 con 0x7fcfe408a0e0 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f12e27fc640 1 -- 10.20.193.48:0/3185190474 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f12e800ce50 con 0x7f12f4090b00 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f12e27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f12e27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f12e27fc640 10 monclient: dump: 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f12e27fc640 10 monclient: _finish_auth 0 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f12e27fc640 10 monclient: _check_auth_tickets 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f12e27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f12fbc8c640 5 monclient: authenticate success, global_id 4329 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f12fbc8c640 10 monclient: _renew_subs 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f12e27fc640 1 -- 10.20.193.48:0/3185190474 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f12e800ee90 con 0x7f12f4090b00 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f1c57fff640 1 -- 10.20.193.48:0/1728024029 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1c680036d0 con 0x7f1c80095ab0 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f1c57fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f1c57fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f1c57fff640 10 monclient: dump: 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f1c57fff640 10 monclient: _finish_auth 0 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f1c57fff640 10 monclient: _check_auth_tickets 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f1c57fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f1c57fff640 1 -- 10.20.193.48:0/1728024029 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c68003830 con 0x7f1c80095ab0 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f1c57fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f1c57fff640 1 -- 10.20.193.48:0/1728024029 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1c68003e60 con 0x7f1c80095ab0 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f1c57fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f1c7d7fa640 4 set_mon_vals no callback set 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f1c57fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f1c57fff640 10 monclient: dump: 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.359 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.360 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.360 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.360 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.360 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.360 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.360 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.360 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.360 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.360 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.360 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.360 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.360 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f787790c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:12.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f787790c640 1 -- 10.20.193.48:0/1559983568 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7870097de0 con 0x7f787005e490 2026-02-12T18:06:12.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa28f165640 1 -- 10.20.193.48:0/1964942741 shutdown_connections 2026-02-12T18:06:12.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa28f165640 1 --2- 10.20.193.48:0/1964942741 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa28808f4c0 0x7fa2881a39b0 unknown :-1 s=CLOSED pgs=29 gs=3 cs=0 l=1 c_cookie=4306180022669408738 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa28f165640 1 --2- 10.20.193.48:0/1964942741 >> v2:10.20.193.48:3300/0 conn(0x7fa28808d920 0x7fa288054330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa28f165640 1 -- 10.20.193.48:0/1964942741 >> 10.20.193.48:0/1964942741 conn(0x7fa288094e80 msgr2=0x7fa288090c90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa28f165640 1 -- 10.20.193.48:0/1964942741 shutdown_connections 2026-02-12T18:06:12.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fa28f165640 1 -- 10.20.193.48:0/1964942741 wait complete. 2026-02-12T18:06:12.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb2f7fe640 1 --2- 10.20.193.48:0/189657780 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fbb30095ab0 0x7fbb301b0d20 secure :-1 s=READY pgs=26 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb200096d0 tx=0x7fbb2000c520 comp rx=0 tx=0).queue_received will delay after 1.77092e+09 on 0x7fbb20052e90 osd_map(18..18 src has 1..18) 2026-02-12T18:06:12.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fcfebccc640 10 monclient: _renew_subs 2026-02-12T18:06:12.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fcfebccc640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:06:12.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fcfebccc640 1 -- 10.20.193.48:0/4179421653 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfe405ec00 con 0x7fcfe408a0e0 2026-02-12T18:06:12.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f12fbc8c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f12fbc8c640 1 -- 10.20.193.48:0/3185190474 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12e4009420 con 0x7f12f4090b00 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f12e27fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f12e27fc640 1 -- 10.20.193.48:0/3185190474 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f12e80044f0 con 0x7f12f4090b00 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f12e27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f12e27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f12e3fff640 4 set_mon_vals no callback set 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f12e27fc640 10 monclient: dump: 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f12fbc8c640 10 monclient: _renew_subs 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f12fbc8c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7f12fbc8c640 1 -- 10.20.193.48:0/3185190474 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12f412f270 con 0x7f12f4090b00 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.307+0000 7fbb2cff9640 1 -- 10.20.193.48:0/189657780 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fbb20011070 con 0x7fbb30095ab0 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7f1c859d2640 5 monclient: authenticate success, global_id 4310 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7f1c859d2640 10 monclient: _renew_subs 2026-02-12T18:06:12.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fcfd27fc640 1 --2- 10.20.193.48:0/4179421653 >> v2:10.20.193.111:6812/977811348 conn(0x7fcfac03f800 0x7fcfac05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7f1c859d2640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:12.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7f1c859d2640 1 -- 10.20.193.48:0/1728024029 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c80199e70 con 0x7f1c80095ab0 2026-02-12T18:06:12.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fcfd27fc640 1 -- 10.20.193.48:0/4179421653 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7fcfd8057020 con 0x7fcfe408a0e0 2026-02-12T18:06:12.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7f1c859d2640 10 monclient: _renew_subs 2026-02-12T18:06:12.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fbb2cff9640 1 --2- 10.20.193.48:0/189657780 >> v2:10.20.193.111:6812/977811348 conn(0x7fbb0003f800 0x7fbb0005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fbb2cff9640 1 -- 10.20.193.48:0/189657780 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7fbb20052e90 con 0x7fbb30095ab0 2026-02-12T18:06:12.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fbb2cff9640 1 --2- 10.20.193.48:0/189657780 >> v2:10.20.193.48:6801/447356640 conn(0x7fbb000631d0 0x7fbb00083600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7f785dffb640 1 -- 10.20.193.48:0/1559983568 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f7864046020 con 0x7f787005e490 2026-02-12T18:06:12.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fbb2cff9640 1 -- 10.20.193.48:0/189657780 --> v2:10.20.193.48:6801/447356640 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbb00083c90 con 0x7fbb000631d0 2026-02-12T18:06:12.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fcfe9a41640 1 --2- 10.20.193.48:0/4179421653 >> v2:10.20.193.111:6812/977811348 conn(0x7fcfac03f800 0x7fcfac05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fcfe9a41640 10 monclient: get_auth_request con 0x7fcfac03f800 auth_method 0 2026-02-12T18:06:12.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7f1c859d2640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:12.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fa28f165640 10 monclient: build_initial_monmap 2026-02-12T18:06:12.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7f1c859d2640 1 -- 10.20.193.48:0/1728024029 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c8019a3e0 con 0x7f1c80095ab0 2026-02-12T18:06:12.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fbb34991640 1 --2- 10.20.193.48:0/189657780 >> v2:10.20.193.48:6801/447356640 conn(0x7fbb000631d0 0x7fbb00083600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fa28f165640 10 monclient: monmap: 2026-02-12T18:06:12.363 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:12.363 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:12.363 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:12.363 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:12.363 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:12.363 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.363 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:12.363 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:12.363 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:12.363 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:12.363 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:12.363 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:12.363 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:12.363 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:12.363 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:12.363 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fbb34991640 10 monclient: get_auth_request con 0x7fbb000631d0 auth_method 0 2026-02-12T18:06:12.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fbb2ffff640 1 --2- 10.20.193.48:0/189657780 >> v2:10.20.193.111:6812/977811348 conn(0x7fbb0003f800 0x7fbb0005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7f12fbc8c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:12.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7f12fbc8c640 1 -- 10.20.193.48:0/3185190474 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f12f40901e0 con 0x7f12f4090b00 2026-02-12T18:06:12.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fcfebccc640 1 --2- 10.20.193.48:0/4179421653 >> v2:10.20.193.48:6808/3694032686 conn(0x7fcfe405d440 0x7fcfe413dca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fcfebccc640 1 -- 10.20.193.48:0/4179421653 --> v2:10.20.193.48:6808/3694032686 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcfe408fcc0 con 0x7fcfe405d440 2026-02-12T18:06:12.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7f785dffb640 1 --2- 10.20.193.48:0/1559983568 >> v2:10.20.193.111:6812/977811348 conn(0x7f784003f800 0x7f784005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fbb2ffff640 10 monclient: get_auth_request con 0x7fbb0003f800 auth_method 0 2026-02-12T18:06:12.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fa28f165640 1 Processor -- start 2026-02-12T18:06:12.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7f785dffb640 1 -- 10.20.193.48:0/1559983568 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7f7864077d80 con 0x7f787005e490 2026-02-12T18:06:12.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fcfea242640 1 --2- 10.20.193.48:0/4179421653 >> v2:10.20.193.48:6808/3694032686 conn(0x7fcfe405d440 0x7fcfe413dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fcfea242640 10 monclient: get_auth_request con 0x7fcfe405d440 auth_method 0 2026-02-12T18:06:12.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7f785dffb640 1 --2- 10.20.193.48:0/1559983568 >> v2:10.20.193.111:6808/3554486394 conn(0x7f7840063340 0x7f7840083770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7f785dffb640 1 -- 10.20.193.48:0/1559983568 --> v2:10.20.193.111:6808/3554486394 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7840083e00 con 0x7f7840063340 2026-02-12T18:06:12.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7f785dffb640 1 -- 10.20.193.48:0/1559983568 <== mon.0 v2:10.20.193.48:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f786407a310 con 0x7f787005e490 2026-02-12T18:06:12.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7f785dffb640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-12T18:06:12.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7f7875681640 1 --2- 10.20.193.48:0/1559983568 >> v2:10.20.193.111:6812/977811348 conn(0x7f784003f800 0x7f784005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7f7875681640 10 monclient: get_auth_request con 0x7f784003f800 auth_method 0 2026-02-12T18:06:12.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7f7875e82640 1 --2- 10.20.193.48:0/1559983568 >> v2:10.20.193.111:6808/3554486394 conn(0x7f7840063340 0x7f7840083770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7f7875e82640 10 monclient: get_auth_request con 0x7f7840063340 auth_method 0 2026-02-12T18:06:12.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7f1c859d2640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:12.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7f1c859d2640 1 -- 10.20.193.48:0/1728024029 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1c80095f20 con 0x7f1c80095ab0 2026-02-12T18:06:12.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7f12e27fc640 1 -- 10.20.193.48:0/3185190474 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f12e8011070 con 0x7f12f4090b00 2026-02-12T18:06:12.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fa28f165640 1 -- start start 2026-02-12T18:06:12.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fa28f165640 10 monclient: init 2026-02-12T18:06:12.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7f1c57fff640 1 -- 10.20.193.48:0/1728024029 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f1c680039a0 con 0x7f1c80095ab0 2026-02-12T18:06:12.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fa28f165640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:12.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fa28f165640 10 monclient: _add_conns ranks=[5,3,1,8,6,4,2,0,7] 2026-02-12T18:06:12.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fa28f165640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa28808a050 0x7fa28808b690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fa28f165640 10 monclient(hunting): picked mon.noname-h con 0x7fa28808a050 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:12.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fa28f165640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa28808d920 0x7fa28808bbd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fa28f165640 10 monclient(hunting): picked mon.noname-g con 0x7fa28808d920 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:12.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fa28f165640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fa28808f4c0 0x7fa28808c110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fa28f165640 10 monclient(hunting): picked mon.noname-f con 0x7fa28808f4c0 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fa28f165640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fa28f165640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa288195910 con 0x7fa28808f4c0 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fa28f165640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fa28f165640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa28808d370 con 0x7fa28808d920 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fa28f165640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fa28f165640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fa288196c10 con 0x7fa28808a050 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fa28f165640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.308+0000 7fa28f165640 10 monclient(hunting): authenticate will time out at 611.034925s 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa27ffff640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa28808d920 0x7fa28808bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa27ffff640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa28808d920 0x7fa28808bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3301/0 says I am v2:10.20.193.48:57150/0 (socket says 10.20.193.48:57150) 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa28ceda640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa28808a050 0x7fa28808b690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa27ffff640 1 -- 10.20.193.48:0/804157028 learned_addr learned my addr 10.20.193.48:0/804157028 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa28d6db640 1 --2- 10.20.193.48:0/804157028 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fa28808f4c0 0x7fa28808c110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa27ffff640 10 monclient(hunting): get_auth_request con 0x7fa28808d920 auth_method 0 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa27ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa27ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa27ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa28d6db640 10 monclient(hunting): get_auth_request con 0x7fa28808f4c0 auth_method 0 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa28d6db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa28d6db640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa28d6db640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa28ceda640 10 monclient(hunting): get_auth_request con 0x7fa28808a050 auth_method 0 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa28ceda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa28ceda640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa28ceda640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7f12e27fc640 1 --2- 10.20.193.48:0/3185190474 >> v2:10.20.193.111:6812/977811348 conn(0x7f12c403f800 0x7f12c405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7f12e27fc640 1 -- 10.20.193.48:0/3185190474 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7f12e8052d80 con 0x7f12f4090b00 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa28ceda640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa28ceda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa28ceda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7f12e27fc640 1 --2- 10.20.193.48:0/3185190474 >> v2:10.20.193.48:6800/2690693575 conn(0x7f12c4063340 0x7f12c4083770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7f12e27fc640 1 -- 10.20.193.48:0/3185190474 --> v2:10.20.193.48:6800/2690693575 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f12c4083e00 con 0x7f12c4063340 2026-02-12T18:06:12.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa27ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa27ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7f12e27fc640 1 -- 10.20.193.48:0/3185190474 <== mon.0 v2:10.20.193.48:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f12e8055310 con 0x7f12f4090b00 2026-02-12T18:06:12.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7f12e27fc640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-12T18:06:12.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa27ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa28d6db640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa28d6db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa28d6db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7f1c57fff640 1 --2- 10.20.193.48:0/1728024029 >> v2:10.20.193.111:6812/977811348 conn(0x7f1c5003f800 0x7f1c5005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7f12fa202640 1 --2- 10.20.193.48:0/3185190474 >> v2:10.20.193.48:6800/2690693575 conn(0x7f12c4063340 0x7f12c4083770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7f12fa202640 10 monclient: get_auth_request con 0x7f12c4063340 auth_method 0 2026-02-12T18:06:12.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7f1c57fff640 1 -- 10.20.193.48:0/1728024029 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7f1c68052c00 con 0x7f1c80095ab0 2026-02-12T18:06:12.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa28ceda640 10 monclient(hunting): handle_auth_done global_id 4262 payload 824 2026-02-12T18:06:12.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa28ceda640 1 -- 10.20.193.48:0/804157028 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa28808d920 msgr2=0x7fa28808bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa28ceda640 1 --2- 10.20.193.48:0/804157028 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa28808d920 0x7fa28808bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa28ceda640 1 -- 10.20.193.48:0/804157028 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fa28808f4c0 msgr2=0x7fa28808c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa28ceda640 1 --2- 10.20.193.48:0/804157028 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fa28808f4c0 0x7fa28808c110 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa28ceda640 10 monclient: _finish_hunting 0 2026-02-12T18:06:12.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa28ceda640 1 monclient: found mon.noname-h 2026-02-12T18:06:12.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa28ceda640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:12.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa28ceda640 10 monclient: _send_mon_message to mon.noname-h at v2:10.20.193.111:3302/0 2026-02-12T18:06:12.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7f1c57fff640 1 --2- 10.20.193.48:0/1728024029 >> v2:10.20.193.111:6800/449363714 conn(0x7f1c50063350 0x7f1c50083780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa28ceda640 1 -- 10.20.193.48:0/804157028 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa28400a500 con 0x7fa28808a050 2026-02-12T18:06:12.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7fa27ffff640 1 --2- 10.20.193.48:0/804157028 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa28808d920 0x7fa28808bbd0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:06:12.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7f1c57fff640 1 -- 10.20.193.48:0/1728024029 --> v2:10.20.193.111:6800/449363714 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c50083e10 con 0x7f1c50063350 2026-02-12T18:06:12.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7f1c57fff640 1 -- 10.20.193.48:0/1728024029 <== mon.8 v2:10.20.193.48:3304/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7f1c68057220 con 0x7f1c80095ab0 2026-02-12T18:06:12.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7f1c57fff640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-12T18:06:12.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7f1c7f7fe640 1 --2- 10.20.193.48:0/1728024029 >> v2:10.20.193.111:6800/449363714 conn(0x7f1c50063350 0x7f1c50083780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.309+0000 7f1c7f7fe640 10 monclient: get_auth_request con 0x7f1c50063350 auth_method 0 2026-02-12T18:06:12.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.310+0000 7fbb2ffff640 1 --2- 10.20.193.48:0/189657780 >> v2:10.20.193.111:6812/977811348 conn(0x7fbb0003f800 0x7fbb0005fcb0 secure :-1 s=READY pgs=39 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb1c004740 tx=0x7fbb1c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.310+0000 7f1c7effd640 1 --2- 10.20.193.48:0/1728024029 >> v2:10.20.193.111:6812/977811348 conn(0x7f1c5003f800 0x7f1c5005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.311+0000 7f1c7effd640 10 monclient: get_auth_request con 0x7f1c5003f800 auth_method 0 2026-02-12T18:06:12.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.311+0000 7fcfe9a41640 1 --2- 10.20.193.48:0/4179421653 >> v2:10.20.193.111:6812/977811348 conn(0x7fcfac03f800 0x7fcfac05fcb0 secure :-1 s=READY pgs=40 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfd4006d40 tx=0x7fcfd40092c0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.311+0000 7f12f9a01640 1 --2- 10.20.193.48:0/3185190474 >> v2:10.20.193.111:6812/977811348 conn(0x7f12c403f800 0x7f12c405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.311+0000 7f12f9a01640 10 monclient: get_auth_request con 0x7f12c403f800 auth_method 0 2026-02-12T18:06:12.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.311+0000 7f7875681640 1 --2- 10.20.193.48:0/1559983568 >> v2:10.20.193.111:6812/977811348 conn(0x7f784003f800 0x7f784005fcb0 secure :-1 s=READY pgs=41 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7860004740 tx=0x7f7860008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.311+0000 7fa28ceda640 1 -- 10.20.193.48:0/804157028 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa28808a050 msgr2=0x7fa28808b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:12.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.311+0000 7fa28ceda640 1 --2- 10.20.193.48:0/804157028 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa28808a050 0x7fa28808b690 secure :-1 s=READY pgs=41 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa278006fd0 tx=0x7fa27800ece0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.311+0000 7fa27d7fa640 1 -- 10.20.193.48:0/804157028 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa278013470 con 0x7fa28808a050 2026-02-12T18:06:12.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.311+0000 7fa27d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.311+0000 7fa27d7fa640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2026-02-12T18:06:12.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.311+0000 7fa27d7fa640 10 monclient: dump: 2026-02-12T18:06:12.369 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.369 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.369 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.369 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.312+0000 7fa27d7fa640 10 monclient: _finish_auth 0 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.312+0000 7fa27d7fa640 10 monclient: _check_auth_tickets 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.312+0000 7fa27d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.312+0000 7fa28f165640 5 monclient: authenticate success, global_id 4262 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.312+0000 7fa27d7fa640 1 -- 10.20.193.48:0/804157028 <== mon.5 v2:10.20.193.111:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa278013610 con 0x7fa28808a050 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.312+0000 7fa27d7fa640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.312+0000 7fa27d7fa640 1 -- 10.20.193.48:0/804157028 <== mon.5 v2:10.20.193.111:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa278013c40 con 0x7fa28808a050 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.312+0000 7fa27d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.312+0000 7fa27effd640 4 set_mon_vals no callback set 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.312+0000 7fa27d7fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.312+0000 7fa27d7fa640 10 monclient: dump: 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.312+0000 7fa28f165640 10 monclient: _renew_subs 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.312+0000 7fa28f165640 10 monclient: _send_mon_message to mon.h at v2:10.20.193.111:3302/0 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.312+0000 7fa28f165640 1 -- 10.20.193.48:0/804157028 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa28805d670 con 0x7fa28808a050 2026-02-12T18:06:12.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.312+0000 7fa28f165640 10 monclient: _renew_subs 2026-02-12T18:06:12.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.312+0000 7fa28f165640 10 monclient: _send_mon_message to mon.h at v2:10.20.193.111:3302/0 2026-02-12T18:06:12.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.312+0000 7fa28f165640 1 -- 10.20.193.48:0/804157028 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fa28805a500 con 0x7fa28808a050 2026-02-12T18:06:12.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.312+0000 7fa28f165640 10 monclient: _send_mon_message to mon.h at v2:10.20.193.111:3302/0 2026-02-12T18:06:12.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.312+0000 7fa28f165640 1 -- 10.20.193.48:0/804157028 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa28805e340 con 0x7fa28808a050 2026-02-12T18:06:12.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.312+0000 7fbb34991640 1 --2- 10.20.193.48:0/189657780 >> v2:10.20.193.48:6801/447356640 conn(0x7fbb000631d0 0x7fbb00083600 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.312+0000 7fa27d7fa640 1 -- 10.20.193.48:0/804157028 <== mon.5 v2:10.20.193.111:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fa278011070 con 0x7fa28808a050 2026-02-12T18:06:12.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.313+0000 7fa27d7fa640 1 --2- 10.20.193.48:0/804157028 >> v2:10.20.193.111:6812/977811348 conn(0x7fa25803f800 0x7fa25805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.313+0000 7fcfea242640 1 --2- 10.20.193.48:0/4179421653 >> v2:10.20.193.48:6808/3694032686 conn(0x7fcfe405d440 0x7fcfe413dca0 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.313+0000 7fa27d7fa640 1 -- 10.20.193.48:0/804157028 <== mon.5 v2:10.20.193.111:3302/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7fa2780533c0 con 0x7fa28808a050 2026-02-12T18:06:12.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.313+0000 7fa27d7fa640 1 --2- 10.20.193.48:0/804157028 >> v2:10.20.193.111:6804/1701961573 conn(0x7fa258063340 0x7fa258083770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.313+0000 7fa27d7fa640 1 -- 10.20.193.48:0/804157028 --> v2:10.20.193.111:6804/1701961573 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa258083e00 con 0x7fa258063340 2026-02-12T18:06:12.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.313+0000 7fa27d7fa640 1 -- 10.20.193.48:0/804157028 <== mon.5 v2:10.20.193.111:3302/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (secure 0 0 0) 0x7fa278053660 con 0x7fa28808a050 2026-02-12T18:06:12.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.313+0000 7fa27d7fa640 10 monclient: handle_get_version_reply finishing 1 version 18 2026-02-12T18:06:12.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.313+0000 7fbb2cff9640 1 -- 10.20.193.48:0/189657780 <== osd.0 v2:10.20.193.48:6801/447356640 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fbb00083c90 con 0x7fbb000631d0 2026-02-12T18:06:12.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.313+0000 7fa28d6db640 1 --2- 10.20.193.48:0/804157028 >> v2:10.20.193.111:6804/1701961573 conn(0x7fa258063340 0x7fa258083770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.313+0000 7fa28d6db640 10 monclient: get_auth_request con 0x7fa258063340 auth_method 0 2026-02-12T18:06:12.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.313+0000 7f7875e82640 1 --2- 10.20.193.48:0/1559983568 >> v2:10.20.193.111:6808/3554486394 conn(0x7f7840063340 0x7f7840083770 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.313+0000 7fcfd27fc640 1 -- 10.20.193.48:0/4179421653 <== osd.1 v2:10.20.193.48:6808/3694032686 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fcfe0036340 con 0x7fcfe405d440 2026-02-12T18:06:12.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.313+0000 7f12fa202640 1 --2- 10.20.193.48:0/3185190474 >> v2:10.20.193.48:6800/2690693575 conn(0x7f12c4063340 0x7f12c4083770 crc :-1 s=READY pgs=14 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.313+0000 7f1c7effd640 1 --2- 10.20.193.48:0/1728024029 >> v2:10.20.193.111:6812/977811348 conn(0x7f1c5003f800 0x7f1c5005fcb0 secure :-1 s=READY pgs=42 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c74004740 tx=0x7f1c74008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.313+0000 7fa27ffff640 1 --2- 10.20.193.48:0/804157028 >> v2:10.20.193.111:6812/977811348 conn(0x7fa25803f800 0x7fa25805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.313+0000 7fa27ffff640 10 monclient: get_auth_request con 0x7fa25803f800 auth_method 0 2026-02-12T18:06:12.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.313+0000 7f12f9a01640 1 --2- 10.20.193.48:0/3185190474 >> v2:10.20.193.111:6812/977811348 conn(0x7f12c403f800 0x7f12c405fcb0 secure :-1 s=READY pgs=43 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12e4009750 tx=0x7f12e4033000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.314+0000 7f12e27fc640 1 -- 10.20.193.48:0/3185190474 <== osd.2 v2:10.20.193.48:6800/2690693575 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f12c4083e00 con 0x7f12c4063340 2026-02-12T18:06:12.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.314+0000 7f1c7f7fe640 1 --2- 10.20.193.48:0/1728024029 >> v2:10.20.193.111:6800/449363714 conn(0x7f1c50063350 0x7f1c50083780 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.314+0000 7f785dffb640 1 -- 10.20.193.48:0/1559983568 <== osd.4 v2:10.20.193.111:6808/3554486394 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f7840083e00 con 0x7f7840063340 2026-02-12T18:06:12.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.314+0000 7f1c57fff640 1 -- 10.20.193.48:0/1728024029 <== osd.3 v2:10.20.193.111:6800/449363714 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f1c50083e10 con 0x7f1c50063350 2026-02-12T18:06:12.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.316+0000 7fa27ffff640 1 --2- 10.20.193.48:0/804157028 >> v2:10.20.193.111:6812/977811348 conn(0x7fa25803f800 0x7fa25805fcb0 secure :-1 s=READY pgs=44 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa270007cf0 tx=0x7fa270007c40 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.317+0000 7fa28d6db640 1 --2- 10.20.193.48:0/804157028 >> v2:10.20.193.111:6804/1701961573 conn(0x7fa258063340 0x7fa258083770 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.318+0000 7fa27d7fa640 1 -- 10.20.193.48:0/804157028 <== osd.5 v2:10.20.193.111:6804/1701961573 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fa258083e00 con 0x7fa258063340 2026-02-12T18:06:12.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fbb3641b640 1 -- 10.20.193.48:0/189657780 --> v2:10.20.193.48:6801/447356640 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbb3005dc10 con 0x7fbb000631d0 2026-02-12T18:06:12.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fcfebccc640 1 -- 10.20.193.48:0/4179421653 --> v2:10.20.193.48:6808/3694032686 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcfe413f460 con 0x7fcfe405d440 2026-02-12T18:06:12.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fbb2cff9640 1 -- 10.20.193.48:0/189657780 <== osd.0 v2:10.20.193.48:6801/447356640 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fbb24007d60 con 0x7fbb000631d0 2026-02-12T18:06:12.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fcfd27fc640 1 -- 10.20.193.48:0/4179421653 <== osd.1 v2:10.20.193.48:6808/3694032686 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fcfe0030c10 con 0x7fcfe405d440 2026-02-12T18:06:12.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fbb3641b640 1 -- 10.20.193.48:0/189657780 >> v2:10.20.193.48:6801/447356640 conn(0x7fbb000631d0 msgr2=0x7fbb00083600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fbb3641b640 1 --2- 10.20.193.48:0/189657780 >> v2:10.20.193.48:6801/447356640 conn(0x7fbb000631d0 0x7fbb00083600 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fcfebccc640 1 -- 10.20.193.48:0/4179421653 >> v2:10.20.193.48:6808/3694032686 conn(0x7fcfe405d440 msgr2=0x7fcfe413dca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fcfebccc640 1 --2- 10.20.193.48:0/4179421653 >> v2:10.20.193.48:6808/3694032686 conn(0x7fcfe405d440 0x7fcfe413dca0 crc :-1 s=READY pgs=7 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fbb3641b640 1 -- 10.20.193.48:0/189657780 >> v2:10.20.193.111:6812/977811348 conn(0x7fbb0003f800 msgr2=0x7fbb0005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fbb3641b640 1 --2- 10.20.193.48:0/189657780 >> v2:10.20.193.111:6812/977811348 conn(0x7fbb0003f800 0x7fbb0005fcb0 secure :-1 s=READY pgs=39 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb1c004740 tx=0x7fbb1c008040 comp rx=0 tx=0).stop 2026-02-12T18:06:12.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fbb3641b640 10 monclient: shutdown 2026-02-12T18:06:12.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fbb3641b640 20 monclient: shutdown canceling and discarding version request 1 2026-02-12T18:06:12.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fbb3641b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fbb3641b640 1 -- 10.20.193.48:0/189657780 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fbb30095ab0 msgr2=0x7fbb301b0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fbb3641b640 1 --2- 10.20.193.48:0/189657780 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fbb30095ab0 0x7fbb301b0d20 secure :-1 s=READY pgs=26 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbb200096d0 tx=0x7fbb2000c520 comp rx=0 tx=0).stop 2026-02-12T18:06:12.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fbb34991640 1 -- 10.20.193.48:0/189657780 reap_dead start 2026-02-12T18:06:12.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fbb2cff9640 1 -- 10.20.193.48:0/189657780 <== mon.2 v2:10.20.193.48:3301/0 6 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 0 0 0) 0x7fbb20055420 con 0x7fbb30095ab0 2026-02-12T18:06:12.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fbb2cff9640 10 monclient: discarding stray monitor message mon_get_version_reply(handle=1 version=18) 2026-02-12T18:06:12.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fbb3641b640 1 -- 10.20.193.48:0/189657780 shutdown_connections 2026-02-12T18:06:12.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fbb3641b640 1 -- 10.20.193.48:0/189657780 >> 10.20.193.48:0/189657780 conn(0x7fbb300548c0 msgr2=0x7fbb3008f680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fcfebccc640 1 -- 10.20.193.48:0/4179421653 >> v2:10.20.193.111:6812/977811348 conn(0x7fcfac03f800 msgr2=0x7fcfac05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fcfebccc640 1 --2- 10.20.193.48:0/4179421653 >> v2:10.20.193.111:6812/977811348 conn(0x7fcfac03f800 0x7fcfac05fcb0 secure :-1 s=READY pgs=40 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfd4006d40 tx=0x7fcfd40092c0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fcfebccc640 10 monclient: shutdown 2026-02-12T18:06:12.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fcfebccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fcfebccc640 1 -- 10.20.193.48:0/4179421653 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcfe408a0e0 msgr2=0x7fcfe408ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fcfebccc640 1 --2- 10.20.193.48:0/4179421653 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcfe408a0e0 0x7fcfe408ad30 secure :-1 s=READY pgs=43 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcfd800e7e0 tx=0x7fcfd800ecb0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fcfea242640 1 -- 10.20.193.48:0/4179421653 reap_dead start 2026-02-12T18:06:12.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fbb3641b640 1 -- 10.20.193.48:0/189657780 shutdown_connections 2026-02-12T18:06:12.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fcfebccc640 1 -- 10.20.193.48:0/4179421653 shutdown_connections 2026-02-12T18:06:12.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fcfebccc640 1 -- 10.20.193.48:0/4179421653 >> 10.20.193.48:0/4179421653 conn(0x7fcfe4090ae0 msgr2=0x7fcfe413d590 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fbb3641b640 1 -- 10.20.193.48:0/189657780 wait complete. 2026-02-12T18:06:12.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fcfebccc640 1 -- 10.20.193.48:0/4179421653 shutdown_connections 2026-02-12T18:06:12.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.321+0000 7fcfebccc640 1 -- 10.20.193.48:0/4179421653 wait complete. 2026-02-12T18:06:12.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.323+0000 7f787790c640 1 -- 10.20.193.48:0/1559983568 --> v2:10.20.193.111:6808/3554486394 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f787008a550 con 0x7f7840063340 2026-02-12T18:06:12.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.323+0000 7f785dffb640 1 -- 10.20.193.48:0/1559983568 <== osd.4 v2:10.20.193.111:6808/3554486394 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f787008a550 con 0x7f7840063340 2026-02-12T18:06:12.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.323+0000 7f787790c640 1 -- 10.20.193.48:0/1559983568 >> v2:10.20.193.111:6808/3554486394 conn(0x7f7840063340 msgr2=0x7f7840083770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.323+0000 7f787790c640 1 --2- 10.20.193.48:0/1559983568 >> v2:10.20.193.111:6808/3554486394 conn(0x7f7840063340 0x7f7840083770 crc :-1 s=READY pgs=9 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.323+0000 7f787790c640 1 -- 10.20.193.48:0/1559983568 >> v2:10.20.193.111:6812/977811348 conn(0x7f784003f800 msgr2=0x7f784005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.323+0000 7f787790c640 1 --2- 10.20.193.48:0/1559983568 >> v2:10.20.193.111:6812/977811348 conn(0x7f784003f800 0x7f784005fcb0 secure :-1 s=READY pgs=41 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7860004740 tx=0x7f7860008040 comp rx=0 tx=0).stop 2026-02-12T18:06:12.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.323+0000 7f787790c640 10 monclient: shutdown 2026-02-12T18:06:12.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.323+0000 7f787790c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.323+0000 7f787790c640 1 -- 10.20.193.48:0/1559983568 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f787005e490 msgr2=0x7f787008d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.323+0000 7f787790c640 1 --2- 10.20.193.48:0/1559983568 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f787005e490 0x7f787008d870 secure :-1 s=READY pgs=62 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7864004740 tx=0x7f7864004770 comp rx=0 tx=0).stop 2026-02-12T18:06:12.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.323+0000 7f7875e82640 1 -- 10.20.193.48:0/1559983568 reap_dead start 2026-02-12T18:06:12.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.323+0000 7f787790c640 1 -- 10.20.193.48:0/1559983568 shutdown_connections 2026-02-12T18:06:12.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.323+0000 7f787790c640 1 -- 10.20.193.48:0/1559983568 >> 10.20.193.48:0/1559983568 conn(0x7f78700548a0 msgr2=0x7f7870093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.323+0000 7f787790c640 1 -- 10.20.193.48:0/1559983568 shutdown_connections 2026-02-12T18:06:12.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.323+0000 7f787790c640 1 -- 10.20.193.48:0/1559983568 wait complete. 2026-02-12T18:06:12.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.324+0000 7f12fbc8c640 1 -- 10.20.193.48:0/3185190474 --> v2:10.20.193.48:6800/2690693575 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f12f40564d0 con 0x7f12c4063340 2026-02-12T18:06:12.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.324+0000 7f12e27fc640 1 -- 10.20.193.48:0/3185190474 <== osd.2 v2:10.20.193.48:6800/2690693575 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f12f0004c10 con 0x7f12c4063340 2026-02-12T18:06:12.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.324+0000 7f1c859d2640 1 -- 10.20.193.48:0/1728024029 --> v2:10.20.193.111:6800/449363714 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1c8005dc10 con 0x7f1c50063350 2026-02-12T18:06:12.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.324+0000 7f12fbc8c640 1 -- 10.20.193.48:0/3185190474 >> v2:10.20.193.48:6800/2690693575 conn(0x7f12c4063340 msgr2=0x7f12c4083770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.324+0000 7f12fbc8c640 1 --2- 10.20.193.48:0/3185190474 >> v2:10.20.193.48:6800/2690693575 conn(0x7f12c4063340 0x7f12c4083770 crc :-1 s=READY pgs=14 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.324+0000 7f12fbc8c640 1 -- 10.20.193.48:0/3185190474 >> v2:10.20.193.111:6812/977811348 conn(0x7f12c403f800 msgr2=0x7f12c405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.324+0000 7f12fbc8c640 1 --2- 10.20.193.48:0/3185190474 >> v2:10.20.193.111:6812/977811348 conn(0x7f12c403f800 0x7f12c405fcb0 secure :-1 s=READY pgs=43 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12e4009750 tx=0x7f12e4033000 comp rx=0 tx=0).stop 2026-02-12T18:06:12.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.324+0000 7f12fbc8c640 10 monclient: shutdown 2026-02-12T18:06:12.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.324+0000 7f12fbc8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.324+0000 7f12fbc8c640 1 -- 10.20.193.48:0/3185190474 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f12f4090b00 msgr2=0x7f12f413e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.324+0000 7f12fbc8c640 1 --2- 10.20.193.48:0/3185190474 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f12f4090b00 0x7f12f413e110 secure :-1 s=READY pgs=63 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f12e8004740 tx=0x7f12e800c520 comp rx=0 tx=0).stop 2026-02-12T18:06:12.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.324+0000 7f12fa202640 1 -- 10.20.193.48:0/3185190474 reap_dead start 2026-02-12T18:06:12.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.324+0000 7f1c57fff640 1 -- 10.20.193.48:0/1728024029 <== osd.3 v2:10.20.193.111:6800/449363714 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1c70005040 con 0x7f1c50063350 2026-02-12T18:06:12.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.325+0000 7f12fbc8c640 1 -- 10.20.193.48:0/3185190474 shutdown_connections 2026-02-12T18:06:12.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.325+0000 7f12fbc8c640 1 -- 10.20.193.48:0/3185190474 >> 10.20.193.48:0/3185190474 conn(0x7f12f4054e50 msgr2=0x7f12f41439a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.325+0000 7f12fbc8c640 1 -- 10.20.193.48:0/3185190474 shutdown_connections 2026-02-12T18:06:12.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.325+0000 7f12fbc8c640 1 -- 10.20.193.48:0/3185190474 wait complete. 2026-02-12T18:06:12.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.325+0000 7f1c859d2640 1 -- 10.20.193.48:0/1728024029 >> v2:10.20.193.111:6800/449363714 conn(0x7f1c50063350 msgr2=0x7f1c50083780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.325+0000 7f1c859d2640 1 --2- 10.20.193.48:0/1728024029 >> v2:10.20.193.111:6800/449363714 conn(0x7f1c50063350 0x7f1c50083780 crc :-1 s=READY pgs=11 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.325+0000 7f1c859d2640 1 -- 10.20.193.48:0/1728024029 >> v2:10.20.193.111:6812/977811348 conn(0x7f1c5003f800 msgr2=0x7f1c5005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.325+0000 7f1c859d2640 1 --2- 10.20.193.48:0/1728024029 >> v2:10.20.193.111:6812/977811348 conn(0x7f1c5003f800 0x7f1c5005fcb0 secure :-1 s=READY pgs=42 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c74004740 tx=0x7f1c74008040 comp rx=0 tx=0).stop 2026-02-12T18:06:12.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.325+0000 7f1c859d2640 10 monclient: shutdown 2026-02-12T18:06:12.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.325+0000 7f1c859d2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.325+0000 7f1c859d2640 1 -- 10.20.193.48:0/1728024029 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f1c80095ab0 msgr2=0x7f1c801b0da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.325+0000 7f1c859d2640 1 --2- 10.20.193.48:0/1728024029 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f1c80095ab0 0x7f1c801b0da0 secure :-1 s=READY pgs=35 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c6800e810 tx=0x7f1c6800ece0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.325+0000 7f1c7f7fe640 1 -- 10.20.193.48:0/1728024029 reap_dead start 2026-02-12T18:06:12.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.325+0000 7f1c859d2640 1 -- 10.20.193.48:0/1728024029 shutdown_connections 2026-02-12T18:06:12.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.325+0000 7f1c859d2640 1 -- 10.20.193.48:0/1728024029 >> 10.20.193.48:0/1728024029 conn(0x7f1c800548c0 msgr2=0x7f1c8008f510 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.325+0000 7f1c859d2640 1 -- 10.20.193.48:0/1728024029 shutdown_connections 2026-02-12T18:06:12.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.325+0000 7f1c859d2640 1 -- 10.20.193.48:0/1728024029 wait complete. 2026-02-12T18:06:12.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.326+0000 7fa28f165640 1 -- 10.20.193.48:0/804157028 --> v2:10.20.193.111:6804/1701961573 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa288054330 con 0x7fa258063340 2026-02-12T18:06:12.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.326+0000 7fa27d7fa640 1 -- 10.20.193.48:0/804157028 <== osd.5 v2:10.20.193.111:6804/1701961573 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa288054330 con 0x7fa258063340 2026-02-12T18:06:12.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.327+0000 7fa28f165640 1 -- 10.20.193.48:0/804157028 >> v2:10.20.193.111:6804/1701961573 conn(0x7fa258063340 msgr2=0x7fa258083770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.327+0000 7fa28f165640 1 --2- 10.20.193.48:0/804157028 >> v2:10.20.193.111:6804/1701961573 conn(0x7fa258063340 0x7fa258083770 crc :-1 s=READY pgs=10 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.327+0000 7fa28f165640 1 -- 10.20.193.48:0/804157028 >> v2:10.20.193.111:6812/977811348 conn(0x7fa25803f800 msgr2=0x7fa25805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.327+0000 7fa28f165640 1 --2- 10.20.193.48:0/804157028 >> v2:10.20.193.111:6812/977811348 conn(0x7fa25803f800 0x7fa25805fcb0 secure :-1 s=READY pgs=44 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa270007cf0 tx=0x7fa270007c40 comp rx=0 tx=0).stop 2026-02-12T18:06:12.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.327+0000 7fa28f165640 10 monclient: shutdown 2026-02-12T18:06:12.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.327+0000 7fa28f165640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.327+0000 7fa28f165640 1 -- 10.20.193.48:0/804157028 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa28808a050 msgr2=0x7fa28808b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.327+0000 7fa28f165640 1 --2- 10.20.193.48:0/804157028 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa28808a050 0x7fa28808b690 secure :-1 s=READY pgs=41 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa278006fd0 tx=0x7fa27800ece0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.327+0000 7fa28d6db640 1 -- 10.20.193.48:0/804157028 reap_dead start 2026-02-12T18:06:12.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.327+0000 7fa28f165640 1 -- 10.20.193.48:0/804157028 shutdown_connections 2026-02-12T18:06:12.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.327+0000 7fa28f165640 1 -- 10.20.193.48:0/804157028 >> 10.20.193.48:0/804157028 conn(0x7fa288094e80 msgr2=0x7fa28808ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.327+0000 7fa28f165640 1 -- 10.20.193.48:0/804157028 shutdown_connections 2026-02-12T18:06:12.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.327+0000 7fa28f165640 1 -- 10.20.193.48:0/804157028 wait complete. 2026-02-12T18:06:12.378 INFO:teuthology.orchestra.run.trial048.stdout:47244640261 2026-02-12T18:06:12.379 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-12T18:06:12.379 INFO:teuthology.orchestra.run.trial048.stdout:47244640261 2026-02-12T18:06:12.379 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-12T18:06:12.379 INFO:teuthology.orchestra.run.trial048.stdout:47244640259 2026-02-12T18:06:12.379 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-12T18:06:12.380 INFO:teuthology.orchestra.run.trial048.stdout:51539607555 2026-02-12T18:06:12.380 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-12T18:06:12.380 INFO:teuthology.orchestra.run.trial048.stdout:47244640261 2026-02-12T18:06:12.380 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-12T18:06:12.380 INFO:teuthology.orchestra.run.trial048.stdout:47244640259 2026-02-12T18:06:12.381 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-12T18:06:12.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.485+0000 7f50bbb54640 10 monclient: get_monmap_and_config 2026-02-12T18:06:12.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.485+0000 7f50bbb54640 10 monclient: build_initial_monmap 2026-02-12T18:06:12.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.485+0000 7f50bbb54640 10 monclient: monmap: 2026-02-12T18:06:12.487 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:12.487 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.487 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:12.486946+0000 2026-02-12T18:06:12.487 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:12.486946+0000 2026-02-12T18:06:12.487 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:12.487 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.487 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:12.487 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:12.488 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:12.488 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:12.488 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:12.488 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:12.488 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:12.488 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:12.488 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:12.488 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:12.488 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:12.488 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50bbb54640 1 Processor -- start 2026-02-12T18:06:12.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50bbb54640 1 -- start start 2026-02-12T18:06:12.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50bbb54640 10 monclient: init 2026-02-12T18:06:12.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50bbb54640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:12.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50bbb54640 10 monclient: _add_conns ranks=[1,7,9,10,8,0,3,6,2,4,5] 2026-02-12T18:06:12.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50bbb54640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f50b405c950 addr v1:10.20.193.111:6789/0 2026-02-12T18:06:12.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50bbb54640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f50b405e490 0x7f50b41857b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50bbb54640 10 monclient(hunting): picked mon.noname-i con 0x7f50b405e490 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:12.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50bbb54640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f50b405d430 0x7f50b41a5d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50bbb54640 10 monclient(hunting): picked mon.noname-a con 0x7f50b405d430 addr v2:10.20.193.48:3300/0 2026-02-12T18:06:12.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50bbb54640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50b404dc20 con 0x7f50b405c950 2026-02-12T18:06:12.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50bbb54640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50bbb54640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f50b405ddd0 con 0x7f50b405d430 2026-02-12T18:06:12.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50bbb54640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50bbb54640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f50b4092990 con 0x7f50b405e490 2026-02-12T18:06:12.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50bbb54640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:12.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50bbb54640 10 monclient(hunting): authenticate will time out at 611.212739s 2026-02-12T18:06:12.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f30dd585640 10 monclient: get_monmap_and_config 2026-02-12T18:06:12.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f30dd585640 10 monclient: build_initial_monmap 2026-02-12T18:06:12.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50ba0ca640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f50b405d430 0x7f50b41a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f30dd585640 10 monclient: monmap: 2026-02-12T18:06:12.491 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:12.491 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.491 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:12.487905+0000 2026-02-12T18:06:12.491 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:12.487905+0000 2026-02-12T18:06:12.492 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:12.492 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.492 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:12.492 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:12.492 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:12.492 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:12.492 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:12.492 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:12.492 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:12.492 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:12.492 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:12.492 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:12.492 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:12.492 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.493 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50b98c9640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f50b405c950 0x7f50b405cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.48:35838/0 (socket says 10.20.193.48:35838) 2026-02-12T18:06:12.493 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50b98c9640 1 -- 10.20.193.48:0/2807550284 learned_addr learned my addr 10.20.193.48:0/2807550284 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:06:12.493 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50b90c8640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f50b405e490 0x7f50b41857b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.493 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50ba0ca640 10 monclient(hunting): get_auth_request con 0x7f50b405d430 auth_method 0 2026-02-12T18:06:12.493 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50ba0ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.493 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50ba0ca640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.493 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50ba0ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.493 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50b90c8640 10 monclient(hunting): get_auth_request con 0x7f50b405e490 auth_method 0 2026-02-12T18:06:12.493 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50b90c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.493 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50b90c8640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.493 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50b90c8640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.493 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50ba0ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.493 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50ba0ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.486+0000 7f50ba0ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f50b90c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f50b90c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f50b90c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f50ba0ca640 10 monclient(hunting): handle_auth_done global_id 4338 payload 274 2026-02-12T18:06:12.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f50ba0ca640 1 -- 10.20.193.48:0/2807550284 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f50b405e490 msgr2=0x7f50b41857b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:12.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f50ba0ca640 1 --2- 10.20.193.48:0/2807550284 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f50b405e490 0x7f50b41857b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f50ba0ca640 1 -- 10.20.193.48:0/2807550284 >> v1:10.20.193.111:6789/0 conn(0x7f50b405c950 legacy=0x7f50b405cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:12.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f50ba0ca640 10 monclient: _finish_hunting 0 2026-02-12T18:06:12.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f50ba0ca640 1 monclient: found mon.noname-a 2026-02-12T18:06:12.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f50ba0ca640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:12.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f50ba0ca640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:06:12.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f50ba0ca640 1 -- 10.20.193.48:0/2807550284 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b4092c70 con 0x7f50b405d430 2026-02-12T18:06:12.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fb55745b640 10 monclient: get_monmap_and_config 2026-02-12T18:06:12.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fb55745b640 10 monclient: build_initial_monmap 2026-02-12T18:06:12.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fb55745b640 10 monclient: monmap: 2026-02-12T18:06:12.494 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:12.494 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.494 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:12.488163+0000 2026-02-12T18:06:12.495 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:12.488163+0000 2026-02-12T18:06:12.495 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:12.495 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.495 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:12.495 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:12.495 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:12.495 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:12.495 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:12.495 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:12.495 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:12.495 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:12.495 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:12.495 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:12.495 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:12.495 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.495 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30dd585640 1 Processor -- start 2026-02-12T18:06:12.495 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fcaff59d640 10 monclient: get_monmap_and_config 2026-02-12T18:06:12.496 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fcaff59d640 10 monclient: build_initial_monmap 2026-02-12T18:06:12.496 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fcaff59d640 10 monclient: monmap: 2026-02-12T18:06:12.496 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:12.496 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.496 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:12.488339+0000 2026-02-12T18:06:12.496 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:12.488339+0000 2026-02-12T18:06:12.496 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:12.496 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.496 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:12.496 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:12.496 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:12.496 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:12.496 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:12.496 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:12.496 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:12.496 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:12.496 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:12.496 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:12.496 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:12.496 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.496 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30dd585640 1 -- start start 2026-02-12T18:06:12.497 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30dd585640 10 monclient: init 2026-02-12T18:06:12.497 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f9ee1e8c640 10 monclient: get_monmap_and_config 2026-02-12T18:06:12.497 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f9ee1e8c640 10 monclient: build_initial_monmap 2026-02-12T18:06:12.497 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f9ee1e8c640 10 monclient: monmap: 2026-02-12T18:06:12.497 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:12.497 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.497 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:12.488519+0000 2026-02-12T18:06:12.497 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:12.488519+0000 2026-02-12T18:06:12.497 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:12.497 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.497 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:12.497 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:12.497 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:12.497 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:12.497 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:12.497 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:12.497 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:12.497 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:12.497 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:12.497 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:12.498 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:12.498 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.498 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f370c90c640 10 monclient: get_monmap_and_config 2026-02-12T18:06:12.498 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f370c90c640 10 monclient: build_initial_monmap 2026-02-12T18:06:12.498 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f370c90c640 10 monclient: monmap: 2026-02-12T18:06:12.498 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:12.498 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.498 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:12.488543+0000 2026-02-12T18:06:12.498 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:12.488543+0000 2026-02-12T18:06:12.498 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:12.498 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.498 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:12.498 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:12.498 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:12.498 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:12.498 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:12.498 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:12.498 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:12.498 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:12.498 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:12.498 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:12.499 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:12.499 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fb55745b640 1 Processor -- start 2026-02-12T18:06:12.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fb55745b640 1 -- start start 2026-02-12T18:06:12.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fb55745b640 10 monclient: init 2026-02-12T18:06:12.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30dd585640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:12.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30dd585640 10 monclient: _add_conns ranks=[7,4,0,9,2,8,5,10,1,6,3] 2026-02-12T18:06:12.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30dd585640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f30d808f1a0 0x7f30d808fba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30dd585640 10 monclient(hunting): picked mon.noname-i con 0x7f30d808f1a0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:12.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30dd585640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f30d80900e0 0x7f30d80904b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30dd585640 10 monclient(hunting): picked mon.noname-c con 0x7f30d80900e0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:06:12.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30dd585640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f30d8182990 addr v1:10.20.193.48:6789/0 2026-02-12T18:06:12.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30dd585640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30d804dc20 con 0x7f30d8182990 2026-02-12T18:06:12.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30dd585640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30dd585640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f30d808ba70 con 0x7f30d80900e0 2026-02-12T18:06:12.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30dd585640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30dd585640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f30d8089df0 con 0x7f30d808f1a0 2026-02-12T18:06:12.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30dd585640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:12.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30dd585640 10 monclient(hunting): authenticate will time out at 611.213701s 2026-02-12T18:06:12.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fcaff59d640 1 Processor -- start 2026-02-12T18:06:12.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30d67fc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f30d80900e0 0x7f30d80904b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30d67fc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f30d80900e0 0x7f30d80904b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:52754/0 (socket says 10.20.193.48:52754) 2026-02-12T18:06:12.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30d67fc640 1 -- 10.20.193.48:0/3399964602 learned_addr learned my addr 10.20.193.48:0/3399964602 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:12.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fcaff59d640 1 -- start start 2026-02-12T18:06:12.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fcaff59d640 10 monclient: init 2026-02-12T18:06:12.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30d67fc640 10 monclient(hunting): get_auth_request con 0x7f30d80900e0 auth_method 0 2026-02-12T18:06:12.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30d67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30d67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30d67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f370c90c640 1 Processor -- start 2026-02-12T18:06:12.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30d67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30d67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fb55745b640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:12.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30d67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30d6ffd640 1 --2- 10.20.193.48:0/3399964602 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f30d808f1a0 0x7f30d808fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f370c90c640 1 -- start start 2026-02-12T18:06:12.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f370c90c640 10 monclient: init 2026-02-12T18:06:12.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fb55745b640 10 monclient: _add_conns ranks=[2,7,5,10,0,1,8,3,4,9,6] 2026-02-12T18:06:12.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fb55745b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb55005c950 0x7fb55005cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.503 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30d6ffd640 10 monclient(hunting): get_auth_request con 0x7f30d808f1a0 auth_method 0 2026-02-12T18:06:12.503 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30d6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.503 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.503 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f30d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.503 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fb55745b640 10 monclient(hunting): picked mon.noname-b con 0x7fb55005c950 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:12.503 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7f9ee1e8c640 1 Processor -- start 2026-02-12T18:06:12.503 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fb55745b640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb55005e490 0x7fb55005d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.503 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fb55745b640 10 monclient(hunting): picked mon.noname-i con 0x7fb55005e490 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:12.503 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fb55745b640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb55013db70 0x7fb55013dfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.503 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fb55745b640 10 monclient(hunting): picked mon.noname-h con 0x7fb55013db70 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:12.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fb55745b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fb55745b640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fb55005ddd0 con 0x7fb55005c950 2026-02-12T18:06:12.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fb55745b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fb55745b640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fb55005d7a0 con 0x7fb55013db70 2026-02-12T18:06:12.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fb55745b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fb55745b640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fb550092990 con 0x7fb55005e490 2026-02-12T18:06:12.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fb55745b640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:12.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.487+0000 7fb55745b640 10 monclient(hunting): authenticate will time out at 611.213991s 2026-02-12T18:06:12.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f30d67fc640 10 monclient(hunting): handle_auth_done global_id 34177 payload 274 2026-02-12T18:06:12.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f30d67fc640 1 -- 10.20.193.48:0/3399964602 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f30d808f1a0 msgr2=0x7f30d808fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:12.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f30d67fc640 1 --2- 10.20.193.48:0/3399964602 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f30d808f1a0 0x7f30d808fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9ee1e8c640 1 -- start start 2026-02-12T18:06:12.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9ee1e8c640 10 monclient: init 2026-02-12T18:06:12.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f30d67fc640 1 -- 10.20.193.48:0/3399964602 >> v1:10.20.193.48:6789/0 conn(0x7f30d8182990 legacy=0x7f30d81a2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:12.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f30d67fc640 10 monclient: _finish_hunting 0 2026-02-12T18:06:12.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f30d67fc640 1 monclient: found mon.noname-c 2026-02-12T18:06:12.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f30d67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:12.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f30d67fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:06:12.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f30d67fc640 1 -- 10.20.193.48:0/3399964602 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d808f570 con 0x7f30d80900e0 2026-02-12T18:06:12.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5549cf640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb55005e490 0x7fb55005d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5559d1640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb55013db70 0x7fb55013dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5551d0640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb55005c950 0x7fb55005cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f370c90c640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:12.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5549cf640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb55005e490 0x7fb55005d260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3303/0 says I am v2:10.20.193.48:50180/0 (socket says 10.20.193.48:50180) 2026-02-12T18:06:12.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5549cf640 1 -- 10.20.193.48:0/2082117487 learned_addr learned my addr 10.20.193.48:0/2082117487 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:12.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5549cf640 10 monclient(hunting): get_auth_request con 0x7fb55005e490 auth_method 0 2026-02-12T18:06:12.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5549cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5549cf640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5549cf640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f370c90c640 10 monclient: _add_conns ranks=[9,2,0,6,3,5,7,4,1,10,8] 2026-02-12T18:06:12.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5559d1640 10 monclient(hunting): get_auth_request con 0x7fb55013db70 auth_method 0 2026-02-12T18:06:12.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5559d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f370c90c640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f3704087540 0x7f3704087910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5559d1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5559d1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f370c90c640 10 monclient(hunting): picked mon.noname-a con 0x7f3704087540 addr v2:10.20.193.48:3300/0 2026-02-12T18:06:12.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5551d0640 10 monclient(hunting): get_auth_request con 0x7fb55005c950 auth_method 0 2026-02-12T18:06:12.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5551d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5551d0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f370c90c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f370408a070 0x7f3704087e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f370c90c640 10 monclient(hunting): picked mon.noname-b con 0x7f370408a070 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:12.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5551d0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f370c90c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3704086430 addr v1:10.20.193.48:6789/0 2026-02-12T18:06:12.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f370c90c640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f370404dc20 con 0x7f3704086430 2026-02-12T18:06:12.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f370c90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f370c90c640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f370408fd40 con 0x7f3704087540 2026-02-12T18:06:12.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f370c90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f370c90c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f3704089690 con 0x7f370408a070 2026-02-12T18:06:12.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f370c90c640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:12.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f370c90c640 10 monclient(hunting): authenticate will time out at 611.214245s 2026-02-12T18:06:12.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5549cf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5549cf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcaff59d640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:12.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5549cf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5551d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5551d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcaff59d640 10 monclient: _add_conns ranks=[10,3,8,2,0,5,7,1,9,6,4] 2026-02-12T18:06:12.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5551d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcaff59d640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7fcaf808f300 0x7fcaf808fd10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcaff59d640 10 monclient(hunting): picked mon.noname-f con 0x7fcaf808f300 addr v2:10.20.193.111:3300/0 2026-02-12T18:06:12.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcaff59d640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fcaf805e360 0x7fcaf8090250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcaff59d640 10 monclient(hunting): picked mon.noname-g con 0x7fcaf805e360 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:12.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcaff59d640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcaf8090790 0x7fcaf81a2b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcaff59d640 10 monclient(hunting): picked mon.noname-e con 0x7fcaf8090790 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:12.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcaff59d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcaff59d640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7fcaf808a7a0 con 0x7fcaf808f300 2026-02-12T18:06:12.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcaff59d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f3709e80640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f370408a070 0x7f3704087e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcaff59d640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fcaf808f6d0 con 0x7fcaf805e360 2026-02-12T18:06:12.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcaff59d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcaff59d640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fcaf808a1c0 con 0x7fcaf8090790 2026-02-12T18:06:12.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcaff59d640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:12.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5559d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5559d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcaff59d640 10 monclient(hunting): authenticate will time out at 611.214333s 2026-02-12T18:06:12.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f3709e80640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f370408a070 0x7f3704087e50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:45006/0 (socket says 10.20.193.48:45006) 2026-02-12T18:06:12.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f3709e80640 1 -- 10.20.193.48:0/1901343836 learned_addr learned my addr 10.20.193.48:0/1901343836 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:12.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5559d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f3709e80640 10 monclient(hunting): get_auth_request con 0x7f370408a070 auth_method 0 2026-02-12T18:06:12.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f3709e80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f3709e80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f3709e80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5549cf640 10 monclient(hunting): handle_auth_done global_id 4336 payload 274 2026-02-12T18:06:12.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5549cf640 1 -- 10.20.193.48:0/2082117487 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb55013db70 msgr2=0x7fb55013dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:12.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5549cf640 1 --2- 10.20.193.48:0/2082117487 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb55013db70 0x7fb55013dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5549cf640 1 -- 10.20.193.48:0/2082117487 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb55005c950 msgr2=0x7fb55005cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:12.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9ee1e8c640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:12.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5549cf640 1 --2- 10.20.193.48:0/2082117487 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb55005c950 0x7fb55005cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5549cf640 10 monclient: _finish_hunting 0 2026-02-12T18:06:12.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5549cf640 1 monclient: found mon.noname-i 2026-02-12T18:06:12.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9ee1e8c640 10 monclient: _add_conns ranks=[0,5,3,9,7,4,6,2,8,10,1] 2026-02-12T18:06:12.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5549cf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:12.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5549cf640 10 monclient: _send_mon_message to mon.noname-i at v2:10.20.193.111:3303/0 2026-02-12T18:06:12.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5549cf640 1 -- 10.20.193.48:0/2082117487 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb55004dc20 con 0x7fb55005e490 2026-02-12T18:06:12.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f3709e80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f3709e80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9ee1e8c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9edc08da20 addr v1:10.20.193.48:6789/0 2026-02-12T18:06:12.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9ee1e8c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9edc054a40 0x7f9edc183aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9ee1e8c640 10 monclient(hunting): picked mon.noname-h con 0x7f9edc054a40 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:12.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fb5551d0640 1 --2- 10.20.193.48:0/2082117487 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb55005c950 0x7fb55005cd20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:06:12.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f3709e80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9ee1e8c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9edc054e10 0x7f9edc1a3ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9ee1e8c640 10 monclient(hunting): picked mon.noname-g con 0x7f9edc054e10 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:12.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9ee1e8c640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9edc04dc20 con 0x7f9edc08da20 2026-02-12T18:06:12.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9ee1e8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9ee1e8c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f9edc08e740 con 0x7f9edc054e10 2026-02-12T18:06:12.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9ee1e8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9ee1e8c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f9edc08ddf0 con 0x7f9edc054a40 2026-02-12T18:06:12.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9ee1e8c640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:12.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9ee1e8c640 10 monclient(hunting): authenticate will time out at 611.214450s 2026-02-12T18:06:12.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafd312640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7fcaf808f300 0x7fcaf808fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafdb13640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcaf8090790 0x7fcaf81a2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafdb13640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcaf8090790 0x7fcaf81a2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:33898/0 (socket says 10.20.193.48:33898) 2026-02-12T18:06:12.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafd312640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7fcaf808f300 0x7fcaf808fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3300/0 says I am v2:10.20.193.48:38826/0 (socket says 10.20.193.48:38826) 2026-02-12T18:06:12.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafdb13640 1 -- 10.20.193.48:0/3548522532 learned_addr learned my addr 10.20.193.48:0/3548522532 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:12.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafdb13640 10 monclient(hunting): get_auth_request con 0x7fcaf8090790 auth_method 0 2026-02-12T18:06:12.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafdb13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafdb13640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafdb13640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafd312640 10 monclient(hunting): get_auth_request con 0x7fcaf808f300 auth_method 0 2026-02-12T18:06:12.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafd312640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafd312640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafd312640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafcb11640 1 --2- 10.20.193.48:0/3548522532 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fcaf805e360 0x7fcaf8090250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f3709e80640 10 monclient(hunting): handle_auth_done global_id 34184 payload 274 2026-02-12T18:06:12.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f3709e80640 1 -- 10.20.193.48:0/1901343836 >> v2:10.20.193.48:3300/0 conn(0x7f3704087540 msgr2=0x7f3704087910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:12.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f3709e80640 1 --2- 10.20.193.48:0/1901343836 >> v2:10.20.193.48:3300/0 conn(0x7f3704087540 0x7f3704087910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafcb11640 10 monclient(hunting): get_auth_request con 0x7fcaf805e360 auth_method 0 2026-02-12T18:06:12.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafcb11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafcb11640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafcb11640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f3709e80640 1 -- 10.20.193.48:0/1901343836 >> v1:10.20.193.48:6789/0 conn(0x7f3704086430 legacy=0x7f37040868a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:12.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f3709e80640 10 monclient: _finish_hunting 0 2026-02-12T18:06:12.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f3709e80640 1 monclient: found mon.noname-b 2026-02-12T18:06:12.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f3709e80640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:12.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f3709e80640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:06:12.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f3709e80640 1 -- 10.20.193.48:0/1901343836 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3704088390 con 0x7f370408a070 2026-02-12T18:06:12.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafdb13640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafdb13640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafdb13640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9edaffd640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9edc054a40 0x7f9edc183aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9edaffd640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9edc054a40 0x7f9edc183aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3302/0 says I am v2:10.20.193.48:42204/0 (socket says 10.20.193.48:42204) 2026-02-12T18:06:12.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9edaffd640 1 -- 10.20.193.48:0/3413042002 learned_addr learned my addr 10.20.193.48:0/3413042002 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:12.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9edaffd640 10 monclient(hunting): get_auth_request con 0x7f9edc054a40 auth_method 0 2026-02-12T18:06:12.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9edaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9edaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9edaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafcb11640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafcb11640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafcb11640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafd312640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafd312640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafd312640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafdb13640 10 monclient(hunting): handle_auth_done global_id 4319 payload 274 2026-02-12T18:06:12.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafdb13640 1 -- 10.20.193.48:0/3548522532 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fcaf805e360 msgr2=0x7fcaf8090250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:12.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafdb13640 1 --2- 10.20.193.48:0/3548522532 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fcaf805e360 0x7fcaf8090250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafdb13640 1 -- 10.20.193.48:0/3548522532 >> v2:10.20.193.111:3300/0 conn(0x7fcaf808f300 msgr2=0x7fcaf808fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:12.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafdb13640 1 --2- 10.20.193.48:0/3548522532 >> v2:10.20.193.111:3300/0 conn(0x7fcaf808f300 0x7fcaf808fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafdb13640 10 monclient: _finish_hunting 0 2026-02-12T18:06:12.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafdb13640 1 monclient: found mon.noname-e 2026-02-12T18:06:12.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafdb13640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:12.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafdb13640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:06:12.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7fcafdb13640 1 -- 10.20.193.48:0/3548522532 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf804dc20 con 0x7fcaf8090790 2026-02-12T18:06:12.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9edbfff640 1 --2- 10.20.193.48:0/3413042002 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9edc054e10 0x7f9edc1a3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9edaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9edaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9edaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9edbfff640 10 monclient(hunting): get_auth_request con 0x7f9edc054e10 auth_method 0 2026-02-12T18:06:12.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9edbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9edbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9edbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9edaffd640 10 monclient(hunting): handle_auth_done global_id 4280 payload 274 2026-02-12T18:06:12.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9edaffd640 1 -- 10.20.193.48:0/3413042002 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9edc054e10 msgr2=0x7f9edc1a3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:12.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9edaffd640 1 --2- 10.20.193.48:0/3413042002 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9edc054e10 0x7f9edc1a3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9edaffd640 1 -- 10.20.193.48:0/3413042002 >> v1:10.20.193.48:6789/0 conn(0x7f9edc08da20 legacy=0x7f9edc054330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:12.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9edaffd640 10 monclient: _finish_hunting 0 2026-02-12T18:06:12.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9edaffd640 1 monclient: found mon.noname-h 2026-02-12T18:06:12.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9edaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:12.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9edaffd640 10 monclient: _send_mon_message to mon.noname-h at v2:10.20.193.111:3302/0 2026-02-12T18:06:12.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.488+0000 7f9edaffd640 1 -- 10.20.193.48:0/3413042002 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc08a6a0 con 0x7f9edc054a40 2026-02-12T18:06:12.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.489+0000 7f50ba0ca640 1 -- 10.20.193.48:0/2807550284 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f50b405d430 msgr2=0x7f50b41a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:12.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.489+0000 7f50ba0ca640 1 --2- 10.20.193.48:0/2807550284 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f50b405d430 0x7f50b41a5d00 secure :-1 s=READY pgs=64 gs=2 cs=0 l=1 c_cookie=2289697968735804151 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50b0005820 tx=0x7f50b002fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc6a42bd56e5af7 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.489+0000 7f50b88c7640 1 -- 10.20.193.48:0/2807550284 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f50b0036340 con 0x7f50b405d430 2026-02-12T18:06:12.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.489+0000 7f50b88c7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.489+0000 7f50b88c7640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:06:12.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.489+0000 7f50b88c7640 10 monclient: dump: 2026-02-12T18:06:12.521 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.521 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.521 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.521 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.521 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.521 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.521 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.521 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.521 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.521 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.521 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.521 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.521 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.521 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.521 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.521 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.489+0000 7f50b88c7640 10 monclient: _finish_auth 0 2026-02-12T18:06:12.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.489+0000 7f50b88c7640 10 monclient: _check_auth_tickets 2026-02-12T18:06:12.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.489+0000 7f50b88c7640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:12.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.489+0000 7f50b88c7640 1 -- 10.20.193.48:0/2807550284 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50b00364c0 con 0x7f50b405d430 2026-02-12T18:06:12.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.489+0000 7f50bbb54640 5 monclient: authenticate success, global_id 4338 2026-02-12T18:06:12.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.489+0000 7f50bbb54640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:12.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.489+0000 7f50b88c7640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:12.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.489+0000 7f50b88c7640 1 -- 10.20.193.48:0/2807550284 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f50b0036af0 con 0x7f50b405d430 2026-02-12T18:06:12.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.489+0000 7f50bbb54640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:12.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.489+0000 7f50bbb54640 4 set_mon_vals no callback set 2026-02-12T18:06:12.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.489+0000 7f50b88c7640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.489+0000 7f50b88c7640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:12.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.489+0000 7f50b88c7640 10 monclient: dump: 2026-02-12T18:06:12.522 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.522 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.522 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.522 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.522 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.522 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.522 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.522 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.522 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.522 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.522 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.522 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.523 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.523 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.523 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.523 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f50bbb54640 10 monclient: shutdown 2026-02-12T18:06:12.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f50bbb54640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f50bbb54640 1 -- 10.20.193.48:0/2807550284 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f50b405d430 msgr2=0x7f50b41a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f50bbb54640 1 --2- 10.20.193.48:0/2807550284 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f50b405d430 0x7f50b41a5d00 secure :-1 s=READY pgs=64 gs=2 cs=0 l=1 c_cookie=2289697968735804151 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50b0005820 tx=0x7f50b002fdf0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f50bbb54640 1 -- 10.20.193.48:0/2807550284 shutdown_connections 2026-02-12T18:06:12.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f50bbb54640 1 --2- 10.20.193.48:0/2807550284 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f50b405d430 0x7f50b41a5d00 unknown :-1 s=CLOSED pgs=64 gs=2 cs=0 l=1 c_cookie=2289697968735804151 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f50bbb54640 1 --2- 10.20.193.48:0/2807550284 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f50b405e490 0x7f50b41857b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f50bbb54640 1 -- 10.20.193.48:0/2807550284 >> 10.20.193.48:0/2807550284 conn(0x7f50b40548a0 msgr2=0x7f50b4097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f50bbb54640 1 -- 10.20.193.48:0/2807550284 shutdown_connections 2026-02-12T18:06:12.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f50bbb54640 1 -- 10.20.193.48:0/2807550284 wait complete. 2026-02-12T18:06:12.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f30d67fc640 1 -- 10.20.193.48:0/3399964602 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f30d80900e0 msgr2=0x7f30d80904b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:12.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f30d67fc640 1 --2- 10.20.193.48:0/3399964602 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f30d80900e0 0x7f30d80904b0 secure :-1 s=READY pgs=38 gs=2 cs=0 l=1 c_cookie=3900720192438192013 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30c0009900 tx=0x7f30c002ee10 comp rx=0 tx=0).ready entity=mon.4 client_cookie=362224591e78c78d server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f50bbb54640 10 monclient: build_initial_monmap 2026-02-12T18:06:12.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f50bbb54640 10 monclient: monmap: 2026-02-12T18:06:12.524 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:12.524 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:12.524 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:12.524 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:12.524 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:12.524 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.524 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:12.524 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:12.524 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:12.524 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:12.524 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:12.524 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:12.524 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:12.524 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:12.524 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:12.524 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f30d5ffb640 1 -- 10.20.193.48:0/3399964602 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f30c0035340 con 0x7f30d80900e0 2026-02-12T18:06:12.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f30d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f30d5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:06:12.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f30d5ffb640 10 monclient: dump: 2026-02-12T18:06:12.525 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.525 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.525 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.525 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.525 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.525 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.525 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.525 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.525 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.525 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.525 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.525 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.525 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.525 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.525 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.525 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f30d5ffb640 10 monclient: _finish_auth 0 2026-02-12T18:06:12.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f30d5ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:06:12.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f30d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:12.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f50bbb54640 1 Processor -- start 2026-02-12T18:06:12.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f30d5ffb640 1 -- 10.20.193.48:0/3399964602 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30c00354c0 con 0x7f30d80900e0 2026-02-12T18:06:12.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f30dd585640 5 monclient: authenticate success, global_id 34177 2026-02-12T18:06:12.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f30dd585640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:12.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f30d5ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:12.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f30dd585640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:12.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f30d5ffb640 1 -- 10.20.193.48:0/3399964602 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f30c0035af0 con 0x7f30d80900e0 2026-02-12T18:06:12.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f30d5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f30dd585640 4 set_mon_vals no callback set 2026-02-12T18:06:12.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f30d5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:06:12.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f30d5ffb640 10 monclient: dump: 2026-02-12T18:06:12.526 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.526 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.526 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.526 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.526 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.526 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.527 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.527 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.527 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.527 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.527 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.527 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.527 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.527 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.527 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.527 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f50bbb54640 1 -- start start 2026-02-12T18:06:12.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.490+0000 7f50bbb54640 10 monclient: init 2026-02-12T18:06:12.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb5549cf640 1 -- 10.20.193.48:0/2082117487 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb55005e490 msgr2=0x7fb55005d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:12.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb5549cf640 1 --2- 10.20.193.48:0/2082117487 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb55005e490 0x7fb55005d260 secure :-1 s=READY pgs=38 gs=2 cs=0 l=1 c_cookie=9067286032372611269 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5440098d0 tx=0x7fb54402ee20 comp rx=0 tx=0).ready entity=mon.7 client_cookie=7dd5789b1c6e38c5 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f3709e80640 1 -- 10.20.193.48:0/1901343836 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f370408a070 msgr2=0x7f3704087e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:12.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f3709e80640 1 --2- 10.20.193.48:0/1901343836 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f370408a070 0x7f3704087e50 secure :-1 s=READY pgs=27 gs=3 cs=0 l=1 c_cookie=15794734603324772276 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36f0009060 tx=0x7f36f002ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db322b7008be4fb4 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f30dd585640 10 monclient: shutdown 2026-02-12T18:06:12.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f30dd585640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f30dd585640 1 -- 10.20.193.48:0/3399964602 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f30d80900e0 msgr2=0x7f30d80904b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f30dd585640 1 --2- 10.20.193.48:0/3399964602 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f30d80900e0 0x7f30d80904b0 secure :-1 s=READY pgs=38 gs=2 cs=0 l=1 c_cookie=3900720192438192013 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30c0009900 tx=0x7f30c002ee10 comp rx=0 tx=0).stop 2026-02-12T18:06:12.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50bbb54640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:12.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50bbb54640 10 monclient: _add_conns ranks=[0,6,1,5,4,3,2,7,8] 2026-02-12T18:06:12.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50bbb54640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f50b405c950 0x7f50b412d950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50bbb54640 10 monclient(hunting): picked mon.noname-a con 0x7f50b405c950 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:06:12.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50bbb54640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f50b405d430 0x7f50b408d540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50bbb54640 10 monclient(hunting): picked mon.noname-d con 0x7f50b405d430 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:06:12.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f30dd585640 1 -- 10.20.193.48:0/3399964602 shutdown_connections 2026-02-12T18:06:12.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f30dd585640 1 --2- 10.20.193.48:0/3399964602 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f30d80900e0 0x7f30d80904b0 unknown :-1 s=CLOSED pgs=38 gs=2 cs=0 l=1 c_cookie=3900720192438192013 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f30dd585640 1 --2- 10.20.193.48:0/3399964602 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f30d808f1a0 0x7f30d808fba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50bbb54640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f50b405e490 0x7f50b41a55b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50bbb54640 10 monclient(hunting): picked mon.noname-f con 0x7f50b405e490 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:06:12.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50bbb54640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50bbb54640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f50b4141950 con 0x7f50b405c950 2026-02-12T18:06:12.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50bbb54640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50bbb54640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f50b408bae0 con 0x7f50b405e490 2026-02-12T18:06:12.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f30dd585640 1 -- 10.20.193.48:0/3399964602 >> 10.20.193.48:0/3399964602 conn(0x7f30d8054f30 msgr2=0x7f30d80951a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50bbb54640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50bbb54640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f50b408c010 con 0x7f50b405d430 2026-02-12T18:06:12.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50bbb54640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:12.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50bbb54640 10 monclient(hunting): authenticate will time out at 611.217134s 2026-02-12T18:06:12.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f30dd585640 1 -- 10.20.193.48:0/3399964602 shutdown_connections 2026-02-12T18:06:12.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f30dd585640 1 -- 10.20.193.48:0/3399964602 wait complete. 2026-02-12T18:06:12.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcafdb13640 1 -- 10.20.193.48:0/3548522532 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcaf8090790 msgr2=0x7fcaf81a2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:12.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcafdb13640 1 --2- 10.20.193.48:0/3548522532 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcaf8090790 0x7fcaf81a2b10 secure :-1 s=READY pgs=36 gs=1 cs=0 l=1 c_cookie=640734763597715937 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaf400a140 tx=0x7fcaf402fed0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=8e458df6b7c59e1 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b98c9640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f50b405c950 0x7f50b412d950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b98c9640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f50b405c950 0x7f50b412d950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:44456/0 (socket says 10.20.193.48:44456) 2026-02-12T18:06:12.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b98c9640 1 -- 10.20.193.48:0/1259493172 learned_addr learned my addr 10.20.193.48:0/1259493172 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:12.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b98c9640 10 monclient(hunting): get_auth_request con 0x7f50b405c950 auth_method 0 2026-02-12T18:06:12.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b98c9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b98c9640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b98c9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370967f640 1 -- 10.20.193.48:0/1901343836 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f36f0035340 con 0x7f370408a070 2026-02-12T18:06:12.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370967f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370967f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:06:12.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370967f640 10 monclient: dump: 2026-02-12T18:06:12.530 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.530 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.531 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.531 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.531 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.531 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.531 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.531 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.531 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.531 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.531 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.531 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.531 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.531 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.531 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.531 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b90c8640 1 --2- 10.20.193.48:0/1259493172 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f50b405d430 0x7f50b408d540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370967f640 10 monclient: _finish_auth 0 2026-02-12T18:06:12.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370967f640 10 monclient: _check_auth_tickets 2026-02-12T18:06:12.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370967f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:12.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370967f640 1 -- 10.20.193.48:0/1901343836 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36f00354c0 con 0x7f370408a070 2026-02-12T18:06:12.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370c90c640 5 monclient: authenticate success, global_id 34184 2026-02-12T18:06:12.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370c90c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:12.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370967f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:12.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370967f640 1 -- 10.20.193.48:0/1901343836 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f36f0035af0 con 0x7f370408a070 2026-02-12T18:06:12.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b98c9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b98c9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370967f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370967f640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:06:12.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370967f640 10 monclient: dump: 2026-02-12T18:06:12.532 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.532 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.532 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.532 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.532 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.532 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.532 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.532 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.532 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.532 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.532 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.532 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.532 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.532 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.532 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.532 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b98c9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b90c8640 10 monclient(hunting): get_auth_request con 0x7f50b405d430 auth_method 0 2026-02-12T18:06:12.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370c90c640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:12.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370c90c640 4 set_mon_vals no callback set 2026-02-12T18:06:12.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb53ffff640 1 -- 10.20.193.48:0/2082117487 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb544035340 con 0x7fb55005e490 2026-02-12T18:06:12.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb53ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb53ffff640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2026-02-12T18:06:12.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b90c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b90c8640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b90c8640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb53ffff640 10 monclient: dump: 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb53ffff640 10 monclient: _finish_auth 0 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb53ffff640 10 monclient: _check_auth_tickets 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb53ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb53ffff640 1 -- 10.20.193.48:0/2082117487 <== mon.7 v2:10.20.193.111:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5440354c0 con 0x7fb55005e490 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb53ffff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb53ffff640 1 -- 10.20.193.48:0/2082117487 <== mon.7 v2:10.20.193.111:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb544035b30 con 0x7fb55005e490 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb55745b640 5 monclient: authenticate success, global_id 4336 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb53ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb53ffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb53ffff640 10 monclient: dump: 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.534 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.535 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.535 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.535 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.535 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.535 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.535 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.535 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.535 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.535 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.535 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.535 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.535 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50ba0ca640 1 --2- 10.20.193.48:0/1259493172 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f50b405e490 0x7f50b41a55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb55745b640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:12.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb55745b640 4 set_mon_vals no callback set 2026-02-12T18:06:12.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50ba0ca640 10 monclient(hunting): get_auth_request con 0x7f50b405e490 auth_method 0 2026-02-12T18:06:12.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50ba0ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50ba0ca640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50ba0ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b90c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b90c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b90c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcae7fff640 1 -- 10.20.193.48:0/3548522532 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcaf4030b50 con 0x7fcaf8090790 2026-02-12T18:06:12.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcae7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcae7fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:06:12.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcae7fff640 10 monclient: dump: 2026-02-12T18:06:12.536 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.536 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.536 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.536 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.536 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.536 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.536 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.536 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.536 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.536 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.536 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.536 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.536 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.536 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.536 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.536 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b98c9640 10 monclient(hunting): handle_auth_done global_id 4347 payload 824 2026-02-12T18:06:12.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcae7fff640 10 monclient: _finish_auth 0 2026-02-12T18:06:12.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcae7fff640 10 monclient: _check_auth_tickets 2026-02-12T18:06:12.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcae7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:12.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcaff59d640 5 monclient: authenticate success, global_id 4319 2026-02-12T18:06:12.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcaff59d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:12.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcae7fff640 1 -- 10.20.193.48:0/3548522532 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaf4030cd0 con 0x7fcaf8090790 2026-02-12T18:06:12.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b98c9640 1 -- 10.20.193.48:0/1259493172 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f50b405d430 msgr2=0x7f50b408d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b98c9640 1 --2- 10.20.193.48:0/1259493172 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f50b405d430 0x7f50b408d540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcae7fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:12.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcae7fff640 1 -- 10.20.193.48:0/3548522532 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcaf4030e40 con 0x7fcaf8090790 2026-02-12T18:06:12.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcaff59d640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:12.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcaff59d640 4 set_mon_vals no callback set 2026-02-12T18:06:12.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b98c9640 1 -- 10.20.193.48:0/1259493172 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f50b405e490 msgr2=0x7f50b41a55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b98c9640 1 --2- 10.20.193.48:0/1259493172 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f50b405e490 0x7f50b41a55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b98c9640 10 monclient: _finish_hunting 0 2026-02-12T18:06:12.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcae7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcae7fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:06:12.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b98c9640 1 monclient: found mon.noname-a 2026-02-12T18:06:12.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b98c9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:12.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b98c9640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:06:12.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f50b98c9640 1 -- 10.20.193.48:0/1259493172 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50b000a500 con 0x7f50b405c950 2026-02-12T18:06:12.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcae7fff640 10 monclient: dump: 2026-02-12T18:06:12.538 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.538 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.538 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.538 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.538 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.538 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.538 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.538 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.538 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.538 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.538 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.538 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.538 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.538 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.538 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.538 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f9edaffd640 1 -- 10.20.193.48:0/3413042002 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9edc054a40 msgr2=0x7f9edc183aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:12.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f9edaffd640 1 --2- 10.20.193.48:0/3413042002 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9edc054a40 0x7f9edc183aa0 secure :-1 s=READY pgs=42 gs=2 cs=0 l=1 c_cookie=9817414741785393525 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ecc0098d0 tx=0x7f9ecc02ee20 comp rx=0 tx=0).ready entity=mon.5 client_cookie=883e76b158cd3975 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370c90c640 10 monclient: shutdown 2026-02-12T18:06:12.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370c90c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370c90c640 1 -- 10.20.193.48:0/1901343836 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f370408a070 msgr2=0x7f3704087e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370c90c640 1 --2- 10.20.193.48:0/1901343836 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f370408a070 0x7f3704087e50 secure :-1 s=READY pgs=27 gs=3 cs=0 l=1 c_cookie=15794734603324772276 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36f0009060 tx=0x7f36f002ed90 comp rx=0 tx=0).stop 2026-02-12T18:06:12.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370c90c640 1 -- 10.20.193.48:0/1901343836 shutdown_connections 2026-02-12T18:06:12.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370c90c640 1 --2- 10.20.193.48:0/1901343836 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f370408a070 0x7f3704087e50 unknown :-1 s=CLOSED pgs=27 gs=3 cs=0 l=1 c_cookie=15794734603324772276 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370c90c640 1 --2- 10.20.193.48:0/1901343836 >> v2:10.20.193.48:3300/0 conn(0x7f3704087540 0x7f3704087910 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370c90c640 1 -- 10.20.193.48:0/1901343836 >> 10.20.193.48:0/1901343836 conn(0x7f3704093b10 msgr2=0x7f370408ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb55745b640 10 monclient: shutdown 2026-02-12T18:06:12.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb55745b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb55745b640 1 -- 10.20.193.48:0/2082117487 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb55005e490 msgr2=0x7fb55005d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb55745b640 1 --2- 10.20.193.48:0/2082117487 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb55005e490 0x7fb55005d260 secure :-1 s=READY pgs=38 gs=2 cs=0 l=1 c_cookie=9067286032372611269 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb5440098d0 tx=0x7fb54402ee20 comp rx=0 tx=0).stop 2026-02-12T18:06:12.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370c90c640 1 -- 10.20.193.48:0/1901343836 shutdown_connections 2026-02-12T18:06:12.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370c90c640 1 -- 10.20.193.48:0/1901343836 wait complete. 2026-02-12T18:06:12.540 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f30dd585640 10 monclient: build_initial_monmap 2026-02-12T18:06:12.540 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f30dd585640 10 monclient: monmap: 2026-02-12T18:06:12.540 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:12.540 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:12.540 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:12.540 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:12.540 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:12.540 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.540 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:12.540 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:12.540 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:12.540 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:12.540 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:12.540 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:12.540 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:12.540 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:12.540 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:12.540 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.540 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcaff59d640 10 monclient: shutdown 2026-02-12T18:06:12.540 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcaff59d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.540 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcaff59d640 1 -- 10.20.193.48:0/3548522532 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcaf8090790 msgr2=0x7fcaf81a2b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.540 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcaff59d640 1 --2- 10.20.193.48:0/3548522532 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcaf8090790 0x7fcaf81a2b10 secure :-1 s=READY pgs=36 gs=1 cs=0 l=1 c_cookie=640734763597715937 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaf400a140 tx=0x7fcaf402fed0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.540 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f9eda7fc640 1 -- 10.20.193.48:0/3413042002 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9ecc035340 con 0x7f9edc054a40 2026-02-12T18:06:12.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f9eda7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f9eda7fc640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2026-02-12T18:06:12.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f9eda7fc640 10 monclient: dump: 2026-02-12T18:06:12.541 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.541 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.541 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.541 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.541 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.541 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.541 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.541 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.541 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.541 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.541 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.541 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.541 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.541 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.541 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.541 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcaff59d640 1 -- 10.20.193.48:0/3548522532 shutdown_connections 2026-02-12T18:06:12.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcaff59d640 1 --2- 10.20.193.48:0/3548522532 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fcaf805e360 0x7fcaf8090250 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcaff59d640 1 --2- 10.20.193.48:0/3548522532 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcaf8090790 0x7fcaf81a2b10 unknown :-1 s=CLOSED pgs=36 gs=1 cs=0 l=1 c_cookie=640734763597715937 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f9eda7fc640 10 monclient: _finish_auth 0 2026-02-12T18:06:12.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f9eda7fc640 10 monclient: _check_auth_tickets 2026-02-12T18:06:12.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f9eda7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f9eda7fc640 1 -- 10.20.193.48:0/3413042002 <== mon.5 v2:10.20.193.111:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ecc0354c0 con 0x7f9edc054a40 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcaff59d640 1 --2- 10.20.193.48:0/3548522532 >> v2:10.20.193.111:3300/0 conn(0x7fcaf808f300 0x7fcaf808fd10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcaff59d640 1 -- 10.20.193.48:0/3548522532 >> 10.20.193.48:0/3548522532 conn(0x7fcaf8054330 msgr2=0x7fcaf8054730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f9eda7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f9eda7fc640 1 -- 10.20.193.48:0/3413042002 <== mon.5 v2:10.20.193.111:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9ecc035af0 con 0x7f9edc054a40 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f9ee1e8c640 5 monclient: authenticate success, global_id 4280 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f9ee1e8c640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f9ee1e8c640 4 set_mon_vals no callback set 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f9eda7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f9eda7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f9eda7fc640 10 monclient: dump: 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.542 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcaff59d640 1 -- 10.20.193.48:0/3548522532 shutdown_connections 2026-02-12T18:06:12.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370c90c640 10 monclient: build_initial_monmap 2026-02-12T18:06:12.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f30dd585640 1 Processor -- start 2026-02-12T18:06:12.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fcaff59d640 1 -- 10.20.193.48:0/3548522532 wait complete. 2026-02-12T18:06:12.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f370c90c640 10 monclient: monmap: 2026-02-12T18:06:12.543 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:12.543 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:12.543 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:12.543 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:12.543 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:12.543 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.543 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:12.543 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:12.543 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:12.543 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:12.543 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:12.543 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:12.543 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:12.543 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:12.543 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:12.543 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb55745b640 1 -- 10.20.193.48:0/2082117487 shutdown_connections 2026-02-12T18:06:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb55745b640 1 --2- 10.20.193.48:0/2082117487 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb55013db70 0x7fb55013dfc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb55745b640 1 --2- 10.20.193.48:0/2082117487 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb55005e490 0x7fb55005d260 unknown :-1 s=CLOSED pgs=38 gs=2 cs=0 l=1 c_cookie=9067286032372611269 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb55745b640 1 --2- 10.20.193.48:0/2082117487 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb55005c950 0x7fb55005cd20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb55745b640 1 -- 10.20.193.48:0/2082117487 >> 10.20.193.48:0/2082117487 conn(0x7fb5500548a0 msgr2=0x7fb550097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f30dd585640 1 -- start start 2026-02-12T18:06:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f30dd585640 10 monclient: init 2026-02-12T18:06:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f9ee1e8c640 10 monclient: shutdown 2026-02-12T18:06:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f9ee1e8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f9ee1e8c640 1 -- 10.20.193.48:0/3413042002 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9edc054a40 msgr2=0x7f9edc183aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7f9ee1e8c640 1 --2- 10.20.193.48:0/3413042002 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9edc054a40 0x7f9edc183aa0 secure :-1 s=READY pgs=42 gs=2 cs=0 l=1 c_cookie=9817414741785393525 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ecc0098d0 tx=0x7f9ecc02ee20 comp rx=0 tx=0).stop 2026-02-12T18:06:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.491+0000 7fb55745b640 1 -- 10.20.193.48:0/2082117487 shutdown_connections 2026-02-12T18:06:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fb55745b640 1 -- 10.20.193.48:0/2082117487 wait complete. 2026-02-12T18:06:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370c90c640 1 Processor -- start 2026-02-12T18:06:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f9ee1e8c640 1 -- 10.20.193.48:0/3413042002 shutdown_connections 2026-02-12T18:06:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f9ee1e8c640 1 --2- 10.20.193.48:0/3413042002 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9edc054e10 0x7f9edc1a3ff0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f9ee1e8c640 1 --2- 10.20.193.48:0/3413042002 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9edc054a40 0x7f9edc183aa0 unknown :-1 s=CLOSED pgs=42 gs=2 cs=0 l=1 c_cookie=9817414741785393525 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f9ee1e8c640 1 -- 10.20.193.48:0/3413042002 >> 10.20.193.48:0/3413042002 conn(0x7f9edc056d50 msgr2=0x7f9edc094290 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f9ee1e8c640 1 -- 10.20.193.48:0/3413042002 shutdown_connections 2026-02-12T18:06:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f9ee1e8c640 1 -- 10.20.193.48:0/3413042002 wait complete. 2026-02-12T18:06:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370c90c640 1 -- start start 2026-02-12T18:06:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370c90c640 10 monclient: init 2026-02-12T18:06:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcaff59d640 10 monclient: build_initial_monmap 2026-02-12T18:06:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcaff59d640 10 monclient: monmap: 2026-02-12T18:06:12.545 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:12.545 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:12.545 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:12.545 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:12.545 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:12.545 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.545 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:12.545 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:12.545 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:12.545 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:12.545 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:12.545 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:12.545 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:12.545 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:12.545 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30dd585640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:12.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30dd585640 10 monclient: _add_conns ranks=[1,6,5,7,2,8,3,0,4] 2026-02-12T18:06:12.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30dd585640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f30d808f1a0 0x7f30d81542e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30dd585640 10 monclient(hunting): picked mon.noname-f con 0x7f30d808f1a0 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:06:12.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30dd585640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f30d80900e0 0x7f30d8127f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30dd585640 10 monclient(hunting): picked mon.noname-d con 0x7f30d80900e0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:06:12.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30dd585640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f30d8182990 0x7f30d8150d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30dd585640 10 monclient(hunting): picked mon.noname-h con 0x7f30d8182990 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:12.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30dd585640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30dd585640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f30d805d4a0 con 0x7f30d808f1a0 2026-02-12T18:06:12.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30dd585640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30dd585640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f30d805cee0 con 0x7f30d8182990 2026-02-12T18:06:12.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30dd585640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30dd585640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f30d8115050 con 0x7f30d80900e0 2026-02-12T18:06:12.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30dd585640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:12.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30dd585640 10 monclient(hunting): authenticate will time out at 611.218327s 2026-02-12T18:06:12.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcaff59d640 1 Processor -- start 2026-02-12T18:06:12.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d67fc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f30d80900e0 0x7f30d8127f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370c90c640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370c90c640 10 monclient: _add_conns ranks=[4,1,2,6,8,7,3,5,0] 2026-02-12T18:06:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d67fc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f30d80900e0 0x7f30d8127f30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:38122/0 (socket says 10.20.193.48:38122) 2026-02-12T18:06:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d67fc640 1 -- 10.20.193.48:0/599366878 learned_addr learned my addr 10.20.193.48:0/599366878 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d67fc640 10 monclient(hunting): get_auth_request con 0x7f30d80900e0 auth_method 0 2026-02-12T18:06:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcaff59d640 1 -- start start 2026-02-12T18:06:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370c90c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3704086430 0x7f37040858f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370c90c640 10 monclient(hunting): picked mon.noname-c con 0x7f3704086430 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:06:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcaff59d640 10 monclient: init 2026-02-12T18:06:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fb55745b640 10 monclient: build_initial_monmap 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370c90c640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f3704087540 0x7f3704085e30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370c90c640 10 monclient(hunting): picked mon.noname-f con 0x7f3704087540 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370c90c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f370408a070 0x7f370407fda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370c90c640 10 monclient(hunting): picked mon.noname-b con 0x7f370408a070 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370c90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370c90c640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f370408ec00 con 0x7f3704087540 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370c90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370c90c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f3704081e00 con 0x7f370408a070 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fb55745b640 10 monclient: monmap: 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370c90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370c90c640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f37040823c0 con 0x7f3704086430 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370c90c640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370c90c640 10 monclient(hunting): authenticate will time out at 611.218467s 2026-02-12T18:06:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d77fe640 1 --2- 10.20.193.48:0/599366878 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f30d8182990 0x7f30d8150d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d6ffd640 1 --2- 10.20.193.48:0/599366878 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f30d808f1a0 0x7f30d81542e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d77fe640 10 monclient(hunting): get_auth_request con 0x7f30d8182990 auth_method 0 2026-02-12T18:06:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d6ffd640 10 monclient(hunting): get_auth_request con 0x7f30d808f1a0 auth_method 0 2026-02-12T18:06:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370a681640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3704086430 0x7f37040858f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370a681640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3704086430 0x7f37040858f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:52766/0 (socket says 10.20.193.48:52766) 2026-02-12T18:06:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370a681640 1 -- 10.20.193.48:0/629448447 learned_addr learned my addr 10.20.193.48:0/629448447 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370ae82640 1 --2- 10.20.193.48:0/629448447 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f370408a070 0x7f370407fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370a681640 10 monclient(hunting): get_auth_request con 0x7f3704086430 auth_method 0 2026-02-12T18:06:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370a681640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370a681640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370a681640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f9ee1e8c640 10 monclient: build_initial_monmap 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f9ee1e8c640 10 monclient: monmap: 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370ae82640 10 monclient(hunting): get_auth_request con 0x7f370408a070 auth_method 0 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370ae82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370ae82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370ae82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370a681640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370a681640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370a681640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370ae82640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370ae82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d67fc640 10 monclient(hunting): handle_auth_done global_id 4344 payload 824 2026-02-12T18:06:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370ae82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fb55745b640 1 Processor -- start 2026-02-12T18:06:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcaff59d640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcaff59d640 10 monclient: _add_conns ranks=[6,5,0,2,3,4,7,8,1] 2026-02-12T18:06:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d67fc640 1 -- 10.20.193.48:0/599366878 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f30d8182990 msgr2=0x7f30d8150d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d67fc640 1 --2- 10.20.193.48:0/599366878 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f30d8182990 0x7f30d8150d60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcaff59d640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcaf808f300 0x7fcaf80561b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d67fc640 1 -- 10.20.193.48:0/599366878 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f30d808f1a0 msgr2=0x7f30d81542e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d67fc640 1 --2- 10.20.193.48:0/599366878 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f30d808f1a0 0x7f30d81542e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d67fc640 10 monclient: _finish_hunting 0 2026-02-12T18:06:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcaff59d640 10 monclient(hunting): picked mon.noname-d con 0x7fcaf808f300 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:06:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcaff59d640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fcaf8090790 0x7fcaf80566f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fb55745b640 1 -- start start 2026-02-12T18:06:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fb55745b640 10 monclient: init 2026-02-12T18:06:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d67fc640 1 monclient: found mon.noname-d 2026-02-12T18:06:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcaff59d640 10 monclient(hunting): picked mon.noname-h con 0x7fcaf8090790 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d67fc640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:06:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d67fc640 1 -- 10.20.193.48:0/599366878 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c00094f0 con 0x7f30d80900e0 2026-02-12T18:06:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f30d6ffd640 1 --2- 10.20.193.48:0/599366878 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f30d808f1a0 0x7f30d81542e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:06:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcaff59d640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fcaf8056c30 0x7fcaf823bb70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcaff59d640 10 monclient(hunting): picked mon.noname-a con 0x7fcaf8056c30 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:06:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcaff59d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcaff59d640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fcaf81ae940 con 0x7fcaf8056c30 2026-02-12T18:06:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcaff59d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcaff59d640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fcaf819c640 con 0x7fcaf8090790 2026-02-12T18:06:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcaff59d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcaff59d640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fcaf819c8b0 con 0x7fcaf808f300 2026-02-12T18:06:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcaff59d640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcaff59d640 10 monclient(hunting): authenticate will time out at 611.218766s 2026-02-12T18:06:12.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370a681640 10 monclient(hunting): handle_auth_done global_id 34186 payload 824 2026-02-12T18:06:12.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370a681640 1 -- 10.20.193.48:0/629448447 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f370408a070 msgr2=0x7f370407fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370a681640 1 --2- 10.20.193.48:0/629448447 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f370408a070 0x7f370407fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370a681640 1 -- 10.20.193.48:0/629448447 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f3704087540 msgr2=0x7f3704085e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370a681640 1 --2- 10.20.193.48:0/629448447 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f3704087540 0x7f3704085e30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370a681640 10 monclient: _finish_hunting 0 2026-02-12T18:06:12.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370a681640 1 monclient: found mon.noname-c 2026-02-12T18:06:12.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f9ee1e8c640 1 Processor -- start 2026-02-12T18:06:12.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370a681640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:12.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370a681640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:06:12.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370a681640 1 -- 10.20.193.48:0/629448447 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f00094f0 con 0x7f3704086430 2026-02-12T18:06:12.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f370ae82640 1 --2- 10.20.193.48:0/629448447 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f370408a070 0x7f370407fda0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:06:12.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcafd312640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcaf808f300 0x7fcaf80561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcafd312640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcaf808f300 0x7fcaf80561b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:38128/0 (socket says 10.20.193.48:38128) 2026-02-12T18:06:12.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcafd312640 1 -- 10.20.193.48:0/2283532166 learned_addr learned my addr 10.20.193.48:0/2283532166 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:12.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcafd312640 10 monclient(hunting): get_auth_request con 0x7fcaf808f300 auth_method 0 2026-02-12T18:06:12.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcafd312640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcafd312640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcafd312640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f9ee1e8c640 1 -- start start 2026-02-12T18:06:12.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7f9ee1e8c640 10 monclient: init 2026-02-12T18:06:12.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcafd312640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcafd312640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.492+0000 7fcafd312640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb55745b640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:12.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb55745b640 10 monclient: _add_conns ranks=[5,7,2,3,4,0,8,6,1] 2026-02-12T18:06:12.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb55745b640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb55005c950 0x7fb55012cab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb55745b640 10 monclient(hunting): picked mon.noname-h con 0x7fb55005c950 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:12.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fcafcb11640 1 --2- 10.20.193.48:0/2283532166 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fcaf8090790 0x7fcaf80566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb55745b640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb55005e490 0x7fb55008d3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb55745b640 10 monclient(hunting): picked mon.noname-i con 0x7fb55005e490 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:12.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb55745b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb55013db70 0x7fb55013cd30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb55745b640 10 monclient(hunting): picked mon.noname-b con 0x7fb55013db70 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:12.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb55745b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb55745b640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fb55012d820 con 0x7fb55013db70 2026-02-12T18:06:12.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fcafcb11640 10 monclient(hunting): get_auth_request con 0x7fcaf8090790 auth_method 0 2026-02-12T18:06:12.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fcafcb11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fcafcb11640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fcafcb11640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb55745b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb55745b640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fb55008abc0 con 0x7fb55005c950 2026-02-12T18:06:12.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb55745b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb55745b640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fb55008aea0 con 0x7fb55005e490 2026-02-12T18:06:12.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb55745b640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:12.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb55745b640 10 monclient(hunting): authenticate will time out at 611.219073s 2026-02-12T18:06:12.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5559d1640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb55013db70 0x7fb55013cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fcafd312640 10 monclient(hunting): handle_auth_done global_id 4353 payload 824 2026-02-12T18:06:12.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5559d1640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb55013db70 0x7fb55013cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:45020/0 (socket says 10.20.193.48:45020) 2026-02-12T18:06:12.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5559d1640 1 -- 10.20.193.48:0/2889937350 learned_addr learned my addr 10.20.193.48:0/2889937350 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:12.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5559d1640 10 monclient(hunting): get_auth_request con 0x7fb55013db70 auth_method 0 2026-02-12T18:06:12.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5559d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5559d1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fcafd312640 1 -- 10.20.193.48:0/2283532166 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fcaf8090790 msgr2=0x7fcaf80566f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fcafd312640 1 --2- 10.20.193.48:0/2283532166 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fcaf8090790 0x7fcaf80566f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5559d1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fcafd312640 1 -- 10.20.193.48:0/2283532166 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fcaf8056c30 msgr2=0x7fcaf823bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fcafd312640 1 --2- 10.20.193.48:0/2283532166 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fcaf8056c30 0x7fcaf823bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fcafd312640 10 monclient: _finish_hunting 0 2026-02-12T18:06:12.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fcafd312640 1 monclient: found mon.noname-d 2026-02-12T18:06:12.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fcafd312640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:12.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fcafd312640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:06:12.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fcafd312640 1 -- 10.20.193.48:0/2283532166 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf400a5d0 con 0x7fcaf808f300 2026-02-12T18:06:12.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fcafcb11640 1 --2- 10.20.193.48:0/2283532166 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fcaf8090790 0x7fcaf80566f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:06:12.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5559d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5559d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5559d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9ee1e8c640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:12.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9ee1e8c640 10 monclient: _add_conns ranks=[5,8,2,1,3,4,7,6,0] 2026-02-12T18:06:12.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5549cf640 1 --2- 10.20.193.48:0/2889937350 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb55005e490 0x7fb55008d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9ee1e8c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9edc054a40 0x7f9edc1d7de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9ee1e8c640 10 monclient(hunting): picked mon.noname-h con 0x7f9edc054a40 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:12.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5549cf640 10 monclient(hunting): get_auth_request con 0x7fb55005e490 auth_method 0 2026-02-12T18:06:12.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5549cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5549cf640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9ee1e8c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9edc054e10 0x7f9edc1abdd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9ee1e8c640 10 monclient(hunting): picked mon.noname-e con 0x7f9edc054e10 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:12.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5549cf640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9ee1e8c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9edc08da20 0x7f9edc1db340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9ee1e8c640 10 monclient(hunting): picked mon.noname-b con 0x7f9edc08da20 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:12.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9ee1e8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9ee1e8c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f9edc1983d0 con 0x7f9edc08da20 2026-02-12T18:06:12.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9ee1e8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9ee1e8c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f9edc198ef0 con 0x7f9edc054a40 2026-02-12T18:06:12.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9ee1e8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:12.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9ee1e8c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f9edc08d0a0 con 0x7f9edc054e10 2026-02-12T18:06:12.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9ee1e8c640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:12.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9ee1e8c640 10 monclient(hunting): authenticate will time out at 611.219278s 2026-02-12T18:06:12.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5551d0640 1 --2- 10.20.193.48:0/2889937350 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb55005c950 0x7fb55012cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5551d0640 10 monclient(hunting): get_auth_request con 0x7fb55005c950 auth_method 0 2026-02-12T18:06:12.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5551d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5551d0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5551d0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5559d1640 10 monclient(hunting): handle_auth_done global_id 34202 payload 824 2026-02-12T18:06:12.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5559d1640 1 -- 10.20.193.48:0/2889937350 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb55005e490 msgr2=0x7fb55008d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5559d1640 1 --2- 10.20.193.48:0/2889937350 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb55005e490 0x7fb55008d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5559d1640 1 -- 10.20.193.48:0/2889937350 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb55005c950 msgr2=0x7fb55012cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5559d1640 1 --2- 10.20.193.48:0/2889937350 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb55005c950 0x7fb55012cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5559d1640 10 monclient: _finish_hunting 0 2026-02-12T18:06:12.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5559d1640 1 monclient: found mon.noname-b 2026-02-12T18:06:12.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edaffd640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9edc054e10 0x7f9edc1abdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5559d1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:12.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5559d1640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:06:12.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7fb5559d1640 1 -- 10.20.193.48:0/2889937350 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb540009420 con 0x7fb55013db70 2026-02-12T18:06:12.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edaffd640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9edc054e10 0x7f9edc1abdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:33902/0 (socket says 10.20.193.48:33902) 2026-02-12T18:06:12.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edaffd640 1 -- 10.20.193.48:0/638133329 learned_addr learned my addr 10.20.193.48:0/638133329 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:12.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edaffd640 10 monclient(hunting): get_auth_request con 0x7f9edc054e10 auth_method 0 2026-02-12T18:06:12.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edbfff640 1 --2- 10.20.193.48:0/638133329 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9edc08da20 0x7f9edc1db340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edbfff640 10 monclient(hunting): get_auth_request con 0x7f9edc08da20 auth_method 0 2026-02-12T18:06:12.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edb7fe640 1 --2- 10.20.193.48:0/638133329 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9edc054a40 0x7f9edc1d7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edb7fe640 10 monclient(hunting): get_auth_request con 0x7f9edc054a40 auth_method 0 2026-02-12T18:06:12.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:12.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:12.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:12.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:12.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:12.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:12.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edbfff640 10 monclient(hunting): handle_auth_done global_id 34211 payload 824 2026-02-12T18:06:12.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edbfff640 1 -- 10.20.193.48:0/638133329 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9edc054e10 msgr2=0x7f9edc1abdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edbfff640 1 --2- 10.20.193.48:0/638133329 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9edc054e10 0x7f9edc1abdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edbfff640 1 -- 10.20.193.48:0/638133329 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9edc054a40 msgr2=0x7f9edc1d7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edbfff640 1 --2- 10.20.193.48:0/638133329 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9edc054a40 0x7f9edc1d7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edbfff640 10 monclient: _finish_hunting 0 2026-02-12T18:06:12.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edbfff640 1 monclient: found mon.noname-b 2026-02-12T18:06:12.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:12.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edbfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:06:12.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edbfff640 1 -- 10.20.193.48:0/638133329 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ecc0094f0 con 0x7f9edc08da20 2026-02-12T18:06:12.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f9edaffd640 1 --2- 10.20.193.48:0/638133329 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9edc054e10 0x7f9edc1abdd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f50b98c9640 1 -- 10.20.193.48:0/1259493172 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f50b405c950 msgr2=0x7f50b412d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f50b98c9640 1 --2- 10.20.193.48:0/1259493172 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f50b405c950 0x7f50b412d950 secure :-1 s=READY pgs=65 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50a4007fd0 tx=0x7f50a400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f50a27fc640 1 -- 10.20.193.48:0/1259493172 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f50a4005db0 con 0x7f50b405c950 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f50a27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f50a27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f50a27fc640 10 monclient: dump: 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f50a27fc640 10 monclient: _finish_auth 0 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f50a27fc640 10 monclient: _check_auth_tickets 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f50a27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f50a27fc640 1 -- 10.20.193.48:0/1259493172 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50a4007530 con 0x7f50b405c950 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f50bbb54640 5 monclient: authenticate success, global_id 4347 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f50bbb54640 10 monclient: _renew_subs 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f50bbb54640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f50bbb54640 1 -- 10.20.193.48:0/1259493172 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50b408ac50 con 0x7f50b405c950 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f50a27fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f50a27fc640 1 -- 10.20.193.48:0/1259493172 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f50a40076a0 con 0x7f50b405c950 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f50a27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f50a27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f50a3fff640 4 set_mon_vals no callback set 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f50a27fc640 10 monclient: dump: 2026-02-12T18:06:12.560 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f50bbb54640 10 monclient: _renew_subs 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f50bbb54640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.493+0000 7f50bbb54640 1 -- 10.20.193.48:0/1259493172 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50b408a990 con 0x7f50b405c950 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.494+0000 7f50bbb54640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.494+0000 7f50bbb54640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.494+0000 7f50bbb54640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.494+0000 7f50bbb54640 1 -- 10.20.193.48:0/1259493172 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50b405cd20 con 0x7f50b405c950 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.494+0000 7f50a27fc640 1 -- 10.20.193.48:0/1259493172 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f50a4007070 con 0x7f50b405c950 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.494+0000 7f50a27fc640 1 --2- 10.20.193.48:0/1259493172 >> v2:10.20.193.111:6812/977811348 conn(0x7f508403f7f0 0x7f508405fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.494+0000 7f50a27fc640 1 -- 10.20.193.48:0/1259493172 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7f50a4051f00 con 0x7f50b405c950 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.494+0000 7f30d67fc640 1 -- 10.20.193.48:0/599366878 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f30d80900e0 msgr2=0x7f30d8127f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.494+0000 7f30d67fc640 1 --2- 10.20.193.48:0/599366878 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f30d80900e0 0x7f30d8127f30 secure :-1 s=READY pgs=44 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30c002f320 tx=0x7f30c0004770 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f370a681640 1 -- 10.20.193.48:0/629448447 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3704086430 msgr2=0x7f37040858f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f370a681640 1 --2- 10.20.193.48:0/629448447 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3704086430 0x7f37040858f0 secure :-1 s=READY pgs=39 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36fc00b530 tx=0x7f36fc00ba00 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f50b90c8640 1 --2- 10.20.193.48:0/1259493172 >> v2:10.20.193.111:6812/977811348 conn(0x7f508403f7f0 0x7f508405fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f50b90c8640 10 monclient: get_auth_request con 0x7f508403f7f0 auth_method 0 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f36eeffd640 1 -- 10.20.193.48:0/629448447 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f36fc004490 con 0x7f3704086430 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f36eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f36eeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f30b77fe640 1 -- 10.20.193.48:0/599366878 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f30c00044f0 con 0x7f30d80900e0 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f30b77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f30b77fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f30b77fe640 10 monclient: dump: 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f36eeffd640 10 monclient: dump: 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.562 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f36eeffd640 10 monclient: _finish_auth 0 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f36eeffd640 10 monclient: _check_auth_tickets 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f36eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f36eeffd640 1 -- 10.20.193.48:0/629448447 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36fc002b60 con 0x7f3704086430 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f30b77fe640 10 monclient: _finish_auth 0 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f30b77fe640 10 monclient: _check_auth_tickets 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f30b77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f30dd585640 5 monclient: authenticate success, global_id 4344 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f30dd585640 10 monclient: _renew_subs 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f30b77fe640 1 -- 10.20.193.48:0/599366878 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30c0004030 con 0x7f30d80900e0 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f36eeffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f36eeffd640 1 -- 10.20.193.48:0/629448447 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f36fc002cd0 con 0x7f3704086430 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f36eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f36eeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f30dd585640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f30dd585640 1 -- 10.20.193.48:0/599366878 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30d80904b0 con 0x7f30d80900e0 2026-02-12T18:06:12.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f36eeffd640 10 monclient: dump: 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f3708e7e640 4 set_mon_vals no callback set 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f30b77fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f30b77fe640 1 -- 10.20.193.48:0/599366878 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f30c00041a0 con 0x7f30d80900e0 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f30b77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f30b77fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f30d57fa640 4 set_mon_vals no callback set 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f30b77fe640 10 monclient: dump: 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.564 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.565 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.565 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.565 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.565 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f30dd585640 10 monclient: _renew_subs 2026-02-12T18:06:12.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f30dd585640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:06:12.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f30dd585640 1 -- 10.20.193.48:0/599366878 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f30d81158f0 con 0x7f30d80900e0 2026-02-12T18:06:12.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fcafd312640 1 -- 10.20.193.48:0/2283532166 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcaf808f300 msgr2=0x7fcaf80561b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:12.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fcafd312640 1 --2- 10.20.193.48:0/2283532166 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcaf808f300 0x7fcaf80561b0 secure :-1 s=READY pgs=45 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcae80093f0 tx=0x7fcae800ed50 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f370c90c640 5 monclient: authenticate success, global_id 34186 2026-02-12T18:06:12.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f370c90c640 10 monclient: _renew_subs 2026-02-12T18:06:12.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f370c90c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:12.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f370c90c640 1 -- 10.20.193.48:0/629448447 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f370405e230 con 0x7f3704086430 2026-02-12T18:06:12.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f370c90c640 10 monclient: _renew_subs 2026-02-12T18:06:12.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f370c90c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:12.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f370c90c640 1 -- 10.20.193.48:0/629448447 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f370405dc60 con 0x7f3704086430 2026-02-12T18:06:12.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fb5559d1640 1 -- 10.20.193.48:0/2889937350 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb55013db70 msgr2=0x7fb55013cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:12.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fb5559d1640 1 --2- 10.20.193.48:0/2889937350 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb55013db70 0x7fb55013cd30 secure :-1 s=READY pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb54c00f900 tx=0x7fb54c00fdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fcae5ffb640 1 -- 10.20.193.48:0/2283532166 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcae8013470 con 0x7fcaf808f300 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fcae5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fcae5ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fcae5ffb640 10 monclient: dump: 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fcae5ffb640 10 monclient: _finish_auth 0 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fcae5ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fcae5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fcaff59d640 5 monclient: authenticate success, global_id 4353 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fcae5ffb640 1 -- 10.20.193.48:0/2283532166 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcae80135f0 con 0x7fcaf808f300 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fcae5ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fcae5ffb640 1 -- 10.20.193.48:0/2283532166 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcae8013c20 con 0x7fcaf808f300 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fcae5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fcae77fe640 4 set_mon_vals no callback set 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fcae5ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fcae5ffb640 10 monclient: dump: 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.566 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fcaff59d640 10 monclient: _renew_subs 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fb53dffb640 1 -- 10.20.193.48:0/2889937350 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb54c00dc70 con 0x7fb55013db70 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fb53dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fb53dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f30dd585640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f30dd585640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fb53dffb640 10 monclient: dump: 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.567 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fb53dffb640 10 monclient: _finish_auth 0 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fb53dffb640 10 monclient: _check_auth_tickets 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fb53dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f30dd585640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fb53dffb640 1 -- 10.20.193.48:0/2889937350 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb54c00ddf0 con 0x7fb55013db70 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fb53dffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fb53dffb640 1 -- 10.20.193.48:0/2889937350 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb54c014df0 con 0x7fb55013db70 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fb55745b640 5 monclient: authenticate success, global_id 34202 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fb55745b640 10 monclient: _renew_subs 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fb55745b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fb55745b640 1 -- 10.20.193.48:0/2889937350 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5440094f0 con 0x7fb55013db70 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fb53f7fe640 4 set_mon_vals no callback set 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fb53dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fb53dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fb53dffb640 10 monclient: dump: 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.568 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fb55745b640 10 monclient: _renew_subs 2026-02-12T18:06:12.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fb55745b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:12.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fb55745b640 1 -- 10.20.193.48:0/2889937350 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb55013e750 con 0x7fb55013db70 2026-02-12T18:06:12.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f30b77fe640 1 -- 10.20.193.48:0/599366878 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f30c00036d0 con 0x7f30d80900e0 2026-02-12T18:06:12.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f30dd585640 1 -- 10.20.193.48:0/599366878 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30d808a0a0 con 0x7f30d80900e0 2026-02-12T18:06:12.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fcaff59d640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:06:12.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fcaff59d640 1 -- 10.20.193.48:0/2283532166 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf805d5e0 con 0x7fcaf808f300 2026-02-12T18:06:12.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f9edbfff640 1 -- 10.20.193.48:0/638133329 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9edc08da20 msgr2=0x7f9edc1db340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:12.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7f9edbfff640 1 --2- 10.20.193.48:0/638133329 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9edc08da20 0x7f9edc1db340 secure :-1 s=READY pgs=29 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ed000f7e0 tx=0x7f9ed000fcb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fcaff59d640 10 monclient: _renew_subs 2026-02-12T18:06:12.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fcaff59d640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:06:12.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.495+0000 7fcaff59d640 1 -- 10.20.193.48:0/2283532166 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fcaf8092470 con 0x7fcaf808f300 2026-02-12T18:06:12.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f30b77fe640 1 --2- 10.20.193.48:0/599366878 >> v2:10.20.193.111:6812/977811348 conn(0x7f30a403f800 0x7f30a405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f36ecff9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:12.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f36ecff9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:12.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f36ecff9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:12.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f36ecff9640 1 -- 10.20.193.48:0/629448447 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3704082040 con 0x7f3704086430 2026-02-12T18:06:12.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f30b77fe640 1 -- 10.20.193.48:0/599366878 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7f30c0077e30 con 0x7f30d80900e0 2026-02-12T18:06:12.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f36eeffd640 1 -- 10.20.193.48:0/629448447 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f36fc00d040 con 0x7f3704086430 2026-02-12T18:06:12.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f30d6ffd640 1 --2- 10.20.193.48:0/599366878 >> v2:10.20.193.111:6812/977811348 conn(0x7f30a403f800 0x7f30a405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f30d6ffd640 10 monclient: get_auth_request con 0x7f30a403f800 auth_method 0 2026-02-12T18:06:12.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f36eeffd640 1 --2- 10.20.193.48:0/629448447 >> v2:10.20.193.111:6812/977811348 conn(0x7f36d403f800 0x7f36d405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7fb55745b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:12.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7fb55745b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:12.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7fb55745b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:12.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7fb55745b640 1 -- 10.20.193.48:0/2889937350 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb550142310 con 0x7fb55013db70 2026-02-12T18:06:12.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7fcaff59d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:12.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7fcaff59d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:12.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7fcaff59d640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:06:12.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f9eb7fff640 1 -- 10.20.193.48:0/638133329 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9ed000db90 con 0x7f9edc08da20 2026-02-12T18:06:12.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f9eb7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f9eb7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:06:12.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7fcaff59d640 1 -- 10.20.193.48:0/2283532166 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcaf8093210 con 0x7fcaf808f300 2026-02-12T18:06:12.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f9eb7fff640 10 monclient: dump: 2026-02-12T18:06:12.571 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.571 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.571 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.571 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.571 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.571 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.571 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.571 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.571 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.571 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.571 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.571 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.571 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.571 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.571 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.571 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f9eb7fff640 10 monclient: _finish_auth 0 2026-02-12T18:06:12.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f9eb7fff640 10 monclient: _check_auth_tickets 2026-02-12T18:06:12.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f9eb7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:12.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f9eb7fff640 1 -- 10.20.193.48:0/638133329 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ed000dd10 con 0x7f9edc08da20 2026-02-12T18:06:12.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f9eb7fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:12.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f36eeffd640 1 -- 10.20.193.48:0/629448447 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7f36fc052940 con 0x7f3704086430 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f9eb7fff640 1 -- 10.20.193.48:0/638133329 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9ed000de80 con 0x7f9edc08da20 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f9eb7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f9eb7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f9eb7fff640 10 monclient: dump: 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f9ed9ffb640 4 set_mon_vals no callback set 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f9ee1e8c640 5 monclient: authenticate success, global_id 34211 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f9ee1e8c640 10 monclient: _renew_subs 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f9ee1e8c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f9ee1e8c640 1 -- 10.20.193.48:0/638133329 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9edc1d89d0 con 0x7f9edc08da20 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f9ee1e8c640 10 monclient: _renew_subs 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f9ee1e8c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f9ee1e8c640 1 -- 10.20.193.48:0/638133329 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9edc197fb0 con 0x7f9edc08da20 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7fcae5ffb640 1 -- 10.20.193.48:0/2283532166 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fcae8011070 con 0x7fcaf808f300 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f3709e80640 1 --2- 10.20.193.48:0/629448447 >> v2:10.20.193.111:6812/977811348 conn(0x7f36d403f800 0x7f36d405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7f3709e80640 10 monclient: get_auth_request con 0x7f36d403f800 auth_method 0 2026-02-12T18:06:12.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.496+0000 7fcae5ffb640 1 --2- 10.20.193.48:0/2283532166 >> v2:10.20.193.111:6812/977811348 conn(0x7fcac803f800 0x7fcac805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.497+0000 7fcae5ffb640 1 -- 10.20.193.48:0/2283532166 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7fcae8052990 con 0x7fcaf808f300 2026-02-12T18:06:12.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.497+0000 7f9ee1e8c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:12.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.497+0000 7f9ee1e8c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:12.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.497+0000 7f9ee1e8c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:12.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.497+0000 7f9ee1e8c640 1 -- 10.20.193.48:0/638133329 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9edc093410 con 0x7f9edc08da20 2026-02-12T18:06:12.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.497+0000 7f9eb7fff640 1 -- 10.20.193.48:0/638133329 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f9ed000d6d0 con 0x7f9edc08da20 2026-02-12T18:06:12.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.497+0000 7f50a27fc640 1 -- 10.20.193.48:0/1259493172 <== mon.0 v2:10.20.193.48:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f50a401bab0 con 0x7f50b405c950 2026-02-12T18:06:12.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.497+0000 7f50a27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:12.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.497+0000 7f50a27fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:12.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.497+0000 7f9eb7fff640 1 --2- 10.20.193.48:0/638133329 >> v2:10.20.193.111:6812/977811348 conn(0x7f9eac03f800 0x7f9eac05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.497+0000 7f9eb7fff640 1 -- 10.20.193.48:0/638133329 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7f9ed0053a30 con 0x7f9edc08da20 2026-02-12T18:06:12.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.497+0000 7f50b90c8640 1 --2- 10.20.193.48:0/1259493172 >> v2:10.20.193.111:6812/977811348 conn(0x7f508403f7f0 0x7f508405fca0 secure :-1 s=READY pgs=45 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50b4091680 tx=0x7f50a8009210 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.498+0000 7f36eeffd640 1 -- 10.20.193.48:0/629448447 <== mon.4 v2:10.20.193.48:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f36fc00f7f0 con 0x7f3704086430 2026-02-12T18:06:12.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.498+0000 7f36eeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:12.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.498+0000 7f36eeffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:12.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.498+0000 7f30b77fe640 1 -- 10.20.193.48:0/599366878 <== mon.6 v2:10.20.193.48:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f30c0037440 con 0x7f30d80900e0 2026-02-12T18:06:12.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.498+0000 7f30b77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:12.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.498+0000 7f30b77fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:12.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.499+0000 7f30d6ffd640 1 --2- 10.20.193.48:0/599366878 >> v2:10.20.193.111:6812/977811348 conn(0x7f30a403f800 0x7f30a405fcb0 secure :-1 s=READY pgs=46 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30cc004740 tx=0x7f30cc008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.499+0000 7fcafcb11640 1 --2- 10.20.193.48:0/2283532166 >> v2:10.20.193.111:6812/977811348 conn(0x7fcac803f800 0x7fcac805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.499+0000 7fcafcb11640 10 monclient: get_auth_request con 0x7fcac803f800 auth_method 0 2026-02-12T18:06:12.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.499+0000 7f9edb7fe640 1 --2- 10.20.193.48:0/638133329 >> v2:10.20.193.111:6812/977811348 conn(0x7f9eac03f800 0x7f9eac05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.499+0000 7f9edb7fe640 10 monclient: get_auth_request con 0x7f9eac03f800 auth_method 0 2026-02-12T18:06:12.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.499+0000 7f3709e80640 1 --2- 10.20.193.48:0/629448447 >> v2:10.20.193.111:6812/977811348 conn(0x7f36d403f800 0x7f36d405fcb0 secure :-1 s=READY pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36f002edd0 tx=0x7f36f0031000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.501+0000 7fcafcb11640 1 --2- 10.20.193.48:0/2283532166 >> v2:10.20.193.111:6812/977811348 conn(0x7fcac803f800 0x7fcac805fcb0 secure :-1 s=READY pgs=48 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaf80580d0 tx=0x7fcaec008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.501+0000 7fb53dffb640 1 -- 10.20.193.48:0/2889937350 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fb54c012070 con 0x7fb55013db70 2026-02-12T18:06:12.575 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.501+0000 7f9edb7fe640 1 --2- 10.20.193.48:0/638133329 >> v2:10.20.193.111:6812/977811348 conn(0x7f9eac03f800 0x7f9eac05fcb0 secure :-1 s=READY pgs=49 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ec8004760 tx=0x7f9ec8009190 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.575 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.501+0000 7fb53dffb640 1 --2- 10.20.193.48:0/2889937350 >> v2:10.20.193.111:6812/977811348 conn(0x7fb52003f7f0 0x7fb52005fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:12.575 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.501+0000 7fb53dffb640 1 -- 10.20.193.48:0/2889937350 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7fb54c054060 con 0x7fb55013db70 2026-02-12T18:06:12.575 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.501+0000 7fb53dffb640 1 -- 10.20.193.48:0/2889937350 <== mon.2 v2:10.20.193.48:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fb54c0585e0 con 0x7fb55013db70 2026-02-12T18:06:12.575 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.501+0000 7fb53dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:12.575 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.501+0000 7fb53dffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:12.575 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.502+0000 7fb5551d0640 1 --2- 10.20.193.48:0/2889937350 >> v2:10.20.193.111:6812/977811348 conn(0x7fb52003f7f0 0x7fb52005fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:12.575 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.502+0000 7fb5551d0640 10 monclient: get_auth_request con 0x7fb52003f7f0 auth_method 0 2026-02-12T18:06:12.575 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.502+0000 7f9eb7fff640 1 -- 10.20.193.48:0/638133329 <== mon.2 v2:10.20.193.48:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f9ed0014980 con 0x7f9edc08da20 2026-02-12T18:06:12.575 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.502+0000 7f9eb7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:12.575 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.502+0000 7f9eb7fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:12.575 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.502+0000 7fcae5ffb640 1 -- 10.20.193.48:0/2283532166 <== mon.6 v2:10.20.193.48:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fcae8013760 con 0x7fcaf808f300 2026-02-12T18:06:12.575 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.502+0000 7fcae5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:12.575 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.502+0000 7fcae5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:12.575 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.505+0000 7fb5551d0640 1 --2- 10.20.193.48:0/2889937350 >> v2:10.20.193.111:6812/977811348 conn(0x7fb52003f7f0 0x7fb52005fca0 secure :-1 s=READY pgs=50 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb540004740 tx=0x7fb540008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:12.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.609+0000 7f36ecff9640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-12T18:06:12.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.609+0000 7f36ecff9640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-12T18:06:12.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.609+0000 7f36ecff9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:12.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.609+0000 7f36ecff9640 1 -- 10.20.193.48:0/629448447 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f370408f750 con 0x7f3704086430 2026-02-12T18:06:12.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.609+0000 7f36eeffd640 1 -- 10.20.193.48:0/629448447 <== mon.4 v2:10.20.193.48:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f36fc013070 con 0x7f3704086430 2026-02-12T18:06:12.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.609+0000 7f36eeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-12T18:06:12.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.609+0000 7f36eeffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:12.609 INFO:teuthology.orchestra.run.trial048.stdout:47244640259 2026-02-12T18:06:12.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.610+0000 7f30dd585640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-12T18:06:12.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.610+0000 7f30dd585640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-12T18:06:12.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.610+0000 7f30dd585640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:06:12.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.610+0000 7f30dd585640 1 -- 10.20.193.48:0/599366878 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f30d8055540 con 0x7f30d80900e0 2026-02-12T18:06:12.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.610+0000 7f30b77fe640 1 -- 10.20.193.48:0/599366878 <== mon.6 v2:10.20.193.48:3303/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f30c003c030 con 0x7f30d80900e0 2026-02-12T18:06:12.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.610+0000 7f30b77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-12T18:06:12.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.610+0000 7f30b77fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:12.611 INFO:teuthology.orchestra.run.trial048.stdout:47244640260 2026-02-12T18:06:12.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.611+0000 7f50bbb54640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-12T18:06:12.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.611+0000 7f50bbb54640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-12T18:06:12.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.611+0000 7f50bbb54640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:12.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.611+0000 7f50bbb54640 1 -- 10.20.193.48:0/1259493172 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f50b408b3e0 con 0x7f50b405c950 2026-02-12T18:06:12.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.611+0000 7f50a27fc640 1 -- 10.20.193.48:0/1259493172 <== mon.0 v2:10.20.193.48:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f50a4017020 con 0x7f50b405c950 2026-02-12T18:06:12.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.611+0000 7f50a27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-12T18:06:12.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.611+0000 7f50a27fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:12.612 INFO:teuthology.orchestra.run.trial048.stdout:47244640259 2026-02-12T18:06:12.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.611+0000 7f36ecff9640 1 -- 10.20.193.48:0/629448447 >> v2:10.20.193.111:6812/977811348 conn(0x7f36d403f800 msgr2=0x7f36d405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.611+0000 7f36ecff9640 1 --2- 10.20.193.48:0/629448447 >> v2:10.20.193.111:6812/977811348 conn(0x7f36d403f800 0x7f36d405fcb0 secure :-1 s=READY pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36f002edd0 tx=0x7f36f0031000 comp rx=0 tx=0).stop 2026-02-12T18:06:12.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.611+0000 7f36ecff9640 10 monclient: shutdown 2026-02-12T18:06:12.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.611+0000 7f36ecff9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.611+0000 7f36ecff9640 1 -- 10.20.193.48:0/629448447 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3704086430 msgr2=0x7f37040858f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.611+0000 7f36ecff9640 1 --2- 10.20.193.48:0/629448447 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3704086430 0x7f37040858f0 secure :-1 s=READY pgs=39 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f36fc00b530 tx=0x7f36fc00ba00 comp rx=0 tx=0).stop 2026-02-12T18:06:12.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.611+0000 7f36ecff9640 1 -- 10.20.193.48:0/629448447 shutdown_connections 2026-02-12T18:06:12.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.611+0000 7f36ecff9640 1 --2- 10.20.193.48:0/629448447 >> v2:10.20.193.111:6812/977811348 conn(0x7f36d403f800 0x7f36d405fcb0 unknown :-1 s=CLOSED pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.611+0000 7f36ecff9640 1 --2- 10.20.193.48:0/629448447 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f370408a070 0x7f370407fda0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.611+0000 7f36ecff9640 1 --2- 10.20.193.48:0/629448447 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f3704087540 0x7f3704085e30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.611+0000 7f36ecff9640 1 --2- 10.20.193.48:0/629448447 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3704086430 0x7f37040858f0 unknown :-1 s=CLOSED pgs=39 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.611+0000 7f36ecff9640 1 -- 10.20.193.48:0/629448447 >> 10.20.193.48:0/629448447 conn(0x7f3704093b10 msgr2=0x7f370408c310 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.611+0000 7f36ecff9640 1 -- 10.20.193.48:0/629448447 shutdown_connections 2026-02-12T18:06:12.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.611+0000 7f36ecff9640 1 -- 10.20.193.48:0/629448447 wait complete. 2026-02-12T18:06:12.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.613+0000 7fb55745b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-12T18:06:12.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.613+0000 7fb55745b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-12T18:06:12.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.613+0000 7fb55745b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:12.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.613+0000 7fb55745b640 1 -- 10.20.193.48:0/2889937350 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fb55005cd20 con 0x7fb55013db70 2026-02-12T18:06:12.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.613+0000 7f30dd585640 1 -- 10.20.193.48:0/599366878 >> v2:10.20.193.111:6812/977811348 conn(0x7f30a403f800 msgr2=0x7f30a405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.613+0000 7f30dd585640 1 --2- 10.20.193.48:0/599366878 >> v2:10.20.193.111:6812/977811348 conn(0x7f30a403f800 0x7f30a405fcb0 secure :-1 s=READY pgs=46 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30cc004740 tx=0x7f30cc008040 comp rx=0 tx=0).stop 2026-02-12T18:06:12.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.613+0000 7f30dd585640 10 monclient: shutdown 2026-02-12T18:06:12.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.613+0000 7f30dd585640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.613+0000 7f30dd585640 1 -- 10.20.193.48:0/599366878 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f30d80900e0 msgr2=0x7f30d8127f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.613+0000 7f30dd585640 1 --2- 10.20.193.48:0/599366878 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f30d80900e0 0x7f30d8127f30 secure :-1 s=READY pgs=44 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30c002f320 tx=0x7f30c0004770 comp rx=0 tx=0).stop 2026-02-12T18:06:12.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.613+0000 7f30dd585640 1 -- 10.20.193.48:0/599366878 shutdown_connections 2026-02-12T18:06:12.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.613+0000 7f30dd585640 1 --2- 10.20.193.48:0/599366878 >> v2:10.20.193.111:6812/977811348 conn(0x7f30a403f800 0x7f30a405fcb0 unknown :-1 s=CLOSED pgs=46 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.613+0000 7f30dd585640 1 --2- 10.20.193.48:0/599366878 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f30d8182990 0x7f30d8150d60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.613+0000 7f30dd585640 1 --2- 10.20.193.48:0/599366878 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f30d80900e0 0x7f30d8127f30 unknown :-1 s=CLOSED pgs=44 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.613+0000 7f30dd585640 1 --2- 10.20.193.48:0/599366878 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f30d808f1a0 0x7f30d81542e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.613+0000 7f30dd585640 1 -- 10.20.193.48:0/599366878 >> 10.20.193.48:0/599366878 conn(0x7f30d8054f30 msgr2=0x7f30d808df80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.613+0000 7f30dd585640 1 -- 10.20.193.48:0/599366878 shutdown_connections 2026-02-12T18:06:12.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.613+0000 7f30dd585640 1 -- 10.20.193.48:0/599366878 wait complete. 2026-02-12T18:06:12.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.613+0000 7fb53dffb640 1 -- 10.20.193.48:0/2889937350 <== mon.2 v2:10.20.193.48:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb54c018070 con 0x7fb55013db70 2026-02-12T18:06:12.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.613+0000 7fb53dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-12T18:06:12.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.613+0000 7fb53dffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:12.615 INFO:teuthology.orchestra.run.trial048.stdout:51539607554 2026-02-12T18:06:12.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.614+0000 7f50bbb54640 1 -- 10.20.193.48:0/1259493172 >> v2:10.20.193.111:6812/977811348 conn(0x7f508403f7f0 msgr2=0x7f508405fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.614+0000 7f50bbb54640 1 --2- 10.20.193.48:0/1259493172 >> v2:10.20.193.111:6812/977811348 conn(0x7f508403f7f0 0x7f508405fca0 secure :-1 s=READY pgs=45 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50b4091680 tx=0x7f50a8009210 comp rx=0 tx=0).stop 2026-02-12T18:06:12.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.614+0000 7f50bbb54640 10 monclient: shutdown 2026-02-12T18:06:12.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.614+0000 7f50bbb54640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.614+0000 7f50bbb54640 1 -- 10.20.193.48:0/1259493172 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f50b405c950 msgr2=0x7f50b412d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.614+0000 7f50bbb54640 1 --2- 10.20.193.48:0/1259493172 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f50b405c950 0x7f50b412d950 secure :-1 s=READY pgs=65 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f50a4007fd0 tx=0x7f50a400c970 comp rx=0 tx=0).stop 2026-02-12T18:06:12.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.614+0000 7f50bbb54640 1 -- 10.20.193.48:0/1259493172 shutdown_connections 2026-02-12T18:06:12.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.614+0000 7f50bbb54640 1 --2- 10.20.193.48:0/1259493172 >> v2:10.20.193.111:6812/977811348 conn(0x7f508403f7f0 0x7f508405fca0 unknown :-1 s=CLOSED pgs=45 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.614+0000 7f50bbb54640 1 --2- 10.20.193.48:0/1259493172 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f50b405e490 0x7f50b41a55b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.614+0000 7f50bbb54640 1 --2- 10.20.193.48:0/1259493172 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f50b405d430 0x7f50b408d540 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.614+0000 7f50bbb54640 1 --2- 10.20.193.48:0/1259493172 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f50b405c950 0x7f50b412d950 unknown :-1 s=CLOSED pgs=65 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.614+0000 7f50bbb54640 1 -- 10.20.193.48:0/1259493172 >> 10.20.193.48:0/1259493172 conn(0x7f50b40548a0 msgr2=0x7f50b413f120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.614+0000 7f50bbb54640 1 -- 10.20.193.48:0/1259493172 shutdown_connections 2026-02-12T18:06:12.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.614+0000 7f50bbb54640 1 -- 10.20.193.48:0/1259493172 wait complete. 2026-02-12T18:06:12.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.614+0000 7fcaff59d640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-12T18:06:12.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.614+0000 7fcaff59d640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-12T18:06:12.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.614+0000 7fcaff59d640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:06:12.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.614+0000 7fcaff59d640 1 -- 10.20.193.48:0/2283532166 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fcaf808fd10 con 0x7fcaf808f300 2026-02-12T18:06:12.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.614+0000 7f9ee1e8c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-12T18:06:12.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.614+0000 7f9ee1e8c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-12T18:06:12.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.614+0000 7f9ee1e8c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:12.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.614+0000 7f9ee1e8c640 1 -- 10.20.193.48:0/638133329 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f9edc1981d0 con 0x7f9edc08da20 2026-02-12T18:06:12.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.614+0000 7fcae5ffb640 1 -- 10.20.193.48:0/2283532166 <== mon.6 v2:10.20.193.48:3303/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fcae8021090 con 0x7fcaf808f300 2026-02-12T18:06:12.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.614+0000 7fcae5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-12T18:06:12.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.614+0000 7fcae5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:12.617 INFO:teuthology.orchestra.run.trial048.stdout:47244640258 2026-02-12T18:06:12.617 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.615+0000 7f9eb7fff640 1 -- 10.20.193.48:0/638133329 <== mon.2 v2:10.20.193.48:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9ed001c870 con 0x7f9edc08da20 2026-02-12T18:06:12.617 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.615+0000 7f9eb7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-12T18:06:12.617 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.615+0000 7f9eb7fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:12.617 INFO:teuthology.orchestra.run.trial048.stdout:47244640258 2026-02-12T18:06:12.617 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.616+0000 7fb55745b640 1 -- 10.20.193.48:0/2889937350 >> v2:10.20.193.111:6812/977811348 conn(0x7fb52003f7f0 msgr2=0x7fb52005fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.617 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.616+0000 7fb55745b640 1 --2- 10.20.193.48:0/2889937350 >> v2:10.20.193.111:6812/977811348 conn(0x7fb52003f7f0 0x7fb52005fca0 secure :-1 s=READY pgs=50 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb540004740 tx=0x7fb540008040 comp rx=0 tx=0).stop 2026-02-12T18:06:12.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.616+0000 7fb55745b640 10 monclient: shutdown 2026-02-12T18:06:12.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.616+0000 7fb55745b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.616+0000 7fb55745b640 1 -- 10.20.193.48:0/2889937350 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb55013db70 msgr2=0x7fb55013cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.616+0000 7fb55745b640 1 --2- 10.20.193.48:0/2889937350 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb55013db70 0x7fb55013cd30 secure :-1 s=READY pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb54c00f900 tx=0x7fb54c00fdd0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.616+0000 7fb55745b640 1 -- 10.20.193.48:0/2889937350 shutdown_connections 2026-02-12T18:06:12.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.616+0000 7fb55745b640 1 --2- 10.20.193.48:0/2889937350 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb55013db70 0x7fb55013cd30 unknown :-1 s=CLOSED pgs=28 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.616+0000 7fb55745b640 1 --2- 10.20.193.48:0/2889937350 >> v2:10.20.193.111:6812/977811348 conn(0x7fb52003f7f0 0x7fb52005fca0 unknown :-1 s=CLOSED pgs=50 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.616+0000 7fb55745b640 1 --2- 10.20.193.48:0/2889937350 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb55005e490 0x7fb55008d3c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.616+0000 7fb55745b640 1 --2- 10.20.193.48:0/2889937350 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb55005c950 0x7fb55012cab0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.616+0000 7fb55745b640 1 -- 10.20.193.48:0/2889937350 >> 10.20.193.48:0/2889937350 conn(0x7fb5500548a0 msgr2=0x7fb550093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.616+0000 7fb55745b640 1 -- 10.20.193.48:0/2889937350 shutdown_connections 2026-02-12T18:06:12.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.616+0000 7fb55745b640 1 -- 10.20.193.48:0/2889937350 wait complete. 2026-02-12T18:06:12.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.617+0000 7fcaff59d640 1 -- 10.20.193.48:0/2283532166 >> v2:10.20.193.111:6812/977811348 conn(0x7fcac803f800 msgr2=0x7fcac805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.617+0000 7fcaff59d640 1 --2- 10.20.193.48:0/2283532166 >> v2:10.20.193.111:6812/977811348 conn(0x7fcac803f800 0x7fcac805fcb0 secure :-1 s=READY pgs=48 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaf80580d0 tx=0x7fcaec008040 comp rx=0 tx=0).stop 2026-02-12T18:06:12.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.617+0000 7fcaff59d640 10 monclient: shutdown 2026-02-12T18:06:12.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.617+0000 7fcaff59d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.617+0000 7fcaff59d640 1 -- 10.20.193.48:0/2283532166 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcaf808f300 msgr2=0x7fcaf80561b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.617+0000 7fcaff59d640 1 --2- 10.20.193.48:0/2283532166 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcaf808f300 0x7fcaf80561b0 secure :-1 s=READY pgs=45 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcae80093f0 tx=0x7fcae800ed50 comp rx=0 tx=0).stop 2026-02-12T18:06:12.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.617+0000 7fcaff59d640 1 -- 10.20.193.48:0/2283532166 shutdown_connections 2026-02-12T18:06:12.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.617+0000 7fcaff59d640 1 --2- 10.20.193.48:0/2283532166 >> v2:10.20.193.111:6812/977811348 conn(0x7fcac803f800 0x7fcac805fcb0 unknown :-1 s=CLOSED pgs=48 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.617+0000 7fcaff59d640 1 --2- 10.20.193.48:0/2283532166 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fcaf8056c30 0x7fcaf823bb70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.617+0000 7fcaff59d640 1 --2- 10.20.193.48:0/2283532166 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fcaf8090790 0x7fcaf80566f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.617+0000 7fcaff59d640 1 --2- 10.20.193.48:0/2283532166 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcaf808f300 0x7fcaf80561b0 unknown :-1 s=CLOSED pgs=45 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.617+0000 7fcaff59d640 1 -- 10.20.193.48:0/2283532166 >> 10.20.193.48:0/2283532166 conn(0x7fcaf8054330 msgr2=0x7fcaf805a790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.617+0000 7fcaff59d640 1 -- 10.20.193.48:0/2283532166 shutdown_connections 2026-02-12T18:06:12.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.617+0000 7fcaff59d640 1 -- 10.20.193.48:0/2283532166 wait complete. 2026-02-12T18:06:12.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.617+0000 7f9ee1e8c640 1 -- 10.20.193.48:0/638133329 >> v2:10.20.193.111:6812/977811348 conn(0x7f9eac03f800 msgr2=0x7f9eac05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.617+0000 7f9ee1e8c640 1 --2- 10.20.193.48:0/638133329 >> v2:10.20.193.111:6812/977811348 conn(0x7f9eac03f800 0x7f9eac05fcb0 secure :-1 s=READY pgs=49 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ec8004760 tx=0x7f9ec8009190 comp rx=0 tx=0).stop 2026-02-12T18:06:12.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.617+0000 7f9ee1e8c640 10 monclient: shutdown 2026-02-12T18:06:12.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.617+0000 7f9ee1e8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:12.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.617+0000 7f9ee1e8c640 1 -- 10.20.193.48:0/638133329 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9edc08da20 msgr2=0x7f9edc1db340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:12.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.617+0000 7f9ee1e8c640 1 --2- 10.20.193.48:0/638133329 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9edc08da20 0x7f9edc1db340 secure :-1 s=READY pgs=29 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ed000f7e0 tx=0x7f9ed000fcb0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.618+0000 7f9ee1e8c640 1 -- 10.20.193.48:0/638133329 shutdown_connections 2026-02-12T18:06:12.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.618+0000 7f9ee1e8c640 1 --2- 10.20.193.48:0/638133329 >> v2:10.20.193.111:6812/977811348 conn(0x7f9eac03f800 0x7f9eac05fcb0 unknown :-1 s=CLOSED pgs=49 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.618+0000 7f9ee1e8c640 1 --2- 10.20.193.48:0/638133329 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9edc08da20 0x7f9edc1db340 unknown :-1 s=CLOSED pgs=29 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.618+0000 7f9ee1e8c640 1 --2- 10.20.193.48:0/638133329 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9edc054e10 0x7f9edc1abdd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.618+0000 7f9ee1e8c640 1 --2- 10.20.193.48:0/638133329 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9edc054a40 0x7f9edc1d7de0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:12.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.618+0000 7f9ee1e8c640 1 -- 10.20.193.48:0/638133329 >> 10.20.193.48:0/638133329 conn(0x7f9edc056d50 msgr2=0x7f9edc1ae870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:12.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.618+0000 7f9ee1e8c640 1 -- 10.20.193.48:0/638133329 shutdown_connections 2026-02-12T18:06:12.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:12.618+0000 7f9ee1e8c640 1 -- 10.20.193.48:0/638133329 wait complete. 2026-02-12T18:06:12.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640259 for osd.0 2026-02-12T18:06:12.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.2 2026-02-12T18:06:12.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640259 for osd.1 2026-02-12T18:06:12.625 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607554 for osd.3 2026-02-12T18:06:12.626 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.4 2026-02-12T18:06:12.627 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.5 2026-02-12T18:06:13.622 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2026-02-12T18:06:13.623 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2026-02-12T18:06:13.624 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2026-02-12T18:06:13.626 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2026-02-12T18:06:13.627 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2026-02-12T18:06:13.628 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2026-02-12T18:06:13.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.689+0000 7f1ee87ed640 10 monclient: get_monmap_and_config 2026-02-12T18:06:13.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.689+0000 7f1ee87ed640 10 monclient: build_initial_monmap 2026-02-12T18:06:13.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.689+0000 7f1ee87ed640 10 monclient: monmap: 2026-02-12T18:06:13.690 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:13.691 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.691 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:13.690773+0000 2026-02-12T18:06:13.691 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:13.690773+0000 2026-02-12T18:06:13.691 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:13.691 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.691 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:13.691 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:13.691 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:13.691 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:13.691 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:13.691 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:13.691 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:13.692 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:13.692 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:13.692 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:13.692 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:13.692 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.692 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.689+0000 7f1f69de6640 10 monclient: get_monmap_and_config 2026-02-12T18:06:13.692 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.689+0000 7f1f69de6640 10 monclient: build_initial_monmap 2026-02-12T18:06:13.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.689+0000 7f1f69de6640 10 monclient: monmap: 2026-02-12T18:06:13.693 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:13.693 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.693 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:13.690930+0000 2026-02-12T18:06:13.693 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:13.690930+0000 2026-02-12T18:06:13.693 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:13.693 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.693 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:13.693 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:13.693 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:13.693 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:13.693 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:13.694 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:13.694 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:13.694 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:13.694 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:13.694 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:13.694 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:13.694 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee87ed640 1 Processor -- start 2026-02-12T18:06:13.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee87ed640 1 -- start start 2026-02-12T18:06:13.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee87ed640 10 monclient: init 2026-02-12T18:06:13.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f69de6640 1 Processor -- start 2026-02-12T18:06:13.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f69de6640 1 -- start start 2026-02-12T18:06:13.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f69de6640 10 monclient: init 2026-02-12T18:06:13.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee87ed640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:13.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee87ed640 10 monclient: _add_conns ranks=[7,0,5,10,9,2,1,3,4,6,8] 2026-02-12T18:06:13.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee87ed640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1ee00951a0 0x7f1ee0093850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee87ed640 10 monclient(hunting): picked mon.noname-i con 0x7f1ee00951a0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:13.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee87ed640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f1ee0096ad0 addr v1:10.20.193.48:6789/0 2026-02-12T18:06:13.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee87ed640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f1ee0095c80 0x7f1ee01a5bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee87ed640 10 monclient(hunting): picked mon.noname-h con 0x7f1ee0095c80 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:13.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee87ed640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ee004dc20 con 0x7f1ee0096ad0 2026-02-12T18:06:13.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee87ed640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee87ed640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f1ee0096900 con 0x7f1ee0095c80 2026-02-12T18:06:13.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee87ed640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee87ed640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f1ee0092260 con 0x7f1ee00951a0 2026-02-12T18:06:13.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee87ed640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:13.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee87ed640 10 monclient(hunting): authenticate will time out at 612.416656s 2026-02-12T18:06:13.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f69de6640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:13.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f69de6640 10 monclient: _add_conns ranks=[9,3,1,2,8,7,0,4,5,10,6] 2026-02-12T18:06:13.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f69de6640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f1f640914d0 0x7f1f6405c950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f69de6640 10 monclient(hunting): picked mon.noname-a con 0x7f1f640914d0 addr v2:10.20.193.48:3300/0 2026-02-12T18:06:13.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f69de6640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f1f6405e4b0 0x7f1f6405ce90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f69de6640 10 monclient(hunting): picked mon.noname-g con 0x7f1f6405e4b0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:13.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f69de6640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f1f6408e210 addr v1:10.20.193.111:6789/0 2026-02-12T18:06:13.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f69de6640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f6404dc20 con 0x7f1f6408e210 2026-02-12T18:06:13.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f69de6640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f69de6640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f1f64092cb0 con 0x7f1f640914d0 2026-02-12T18:06:13.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f69de6640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f69de6640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f1f640918a0 con 0x7f1f6405e4b0 2026-02-12T18:06:13.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f69de6640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:13.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f69de6640 10 monclient(hunting): authenticate will time out at 612.416742s 2026-02-12T18:06:13.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee5d61640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f1ee0096ad0 0x7f1ee0095570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:35146/0 (socket says 10.20.193.48:35146) 2026-02-12T18:06:13.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee5d61640 1 -- 10.20.193.48:0/2184160499 learned_addr learned my addr 10.20.193.48:0/2184160499 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:06:13.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f637fe640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f1f640914d0 0x7f1f6405c950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee6562640 1 --2- 10.20.193.48:0/2184160499 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1ee00951a0 0x7f1ee0093850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f637fe640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f1f640914d0 0x7f1f6405c950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:44466/0 (socket says 10.20.193.48:44466) 2026-02-12T18:06:13.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f637fe640 1 -- 10.20.193.48:0/619553114 learned_addr learned my addr 10.20.193.48:0/619553114 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:13.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f637fe640 10 monclient(hunting): get_auth_request con 0x7f1f640914d0 auth_method 0 2026-02-12T18:06:13.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f637fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f637fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee6562640 10 monclient(hunting): get_auth_request con 0x7f1ee00951a0 auth_method 0 2026-02-12T18:06:13.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee6562640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee6562640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee6562640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f637fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:13.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f637fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:13.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f62ffd640 1 --2- 10.20.193.48:0/619553114 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f1f6405e4b0 0x7f1f6405ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f637fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:13.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee6d63640 1 --2- 10.20.193.48:0/2184160499 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f1ee0095c80 0x7f1ee01a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee6562640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:13.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1ee6562640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:13.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f62ffd640 10 monclient(hunting): get_auth_request con 0x7f1f6405e4b0 auth_method 0 2026-02-12T18:06:13.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f62ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f62ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.690+0000 7f1f62ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.691+0000 7f1ee6562640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:13.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.691+0000 7f1f637fe640 10 monclient(hunting): handle_auth_done global_id 4356 payload 274 2026-02-12T18:06:13.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.691+0000 7f1f637fe640 1 -- 10.20.193.48:0/619553114 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f1f6405e4b0 msgr2=0x7f1f6405ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:13.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.691+0000 7f1f637fe640 1 --2- 10.20.193.48:0/619553114 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f1f6405e4b0 0x7f1f6405ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.691+0000 7f1f637fe640 1 -- 10.20.193.48:0/619553114 >> v1:10.20.193.111:6789/0 conn(0x7f1f6408e210 legacy=0x7f1f641a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:13.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.691+0000 7f1f637fe640 10 monclient: _finish_hunting 0 2026-02-12T18:06:13.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.691+0000 7f1f637fe640 1 monclient: found mon.noname-a 2026-02-12T18:06:13.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.691+0000 7f1f637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:13.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.691+0000 7f1f637fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:06:13.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.691+0000 7f1f637fe640 1 -- 10.20.193.48:0/619553114 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f6405ddb0 con 0x7f1f640914d0 2026-02-12T18:06:13.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.691+0000 7f1ee6d63640 10 monclient(hunting): get_auth_request con 0x7f1ee0095c80 auth_method 0 2026-02-12T18:06:13.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.691+0000 7f1ee6d63640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.691+0000 7f1ee6d63640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.691+0000 7f1ee6d63640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.691+0000 7f1ee6562640 10 monclient(hunting): handle_auth_done global_id 4354 payload 274 2026-02-12T18:06:13.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.691+0000 7f1ee6562640 1 -- 10.20.193.48:0/2184160499 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f1ee0095c80 msgr2=0x7f1ee01a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:13.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.691+0000 7f1ee6562640 1 --2- 10.20.193.48:0/2184160499 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f1ee0095c80 0x7f1ee01a5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.691+0000 7f1ee6562640 1 -- 10.20.193.48:0/2184160499 >> v1:10.20.193.48:6789/0 conn(0x7f1ee0096ad0 legacy=0x7f1ee0095570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:13.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.691+0000 7f1ee6562640 10 monclient: _finish_hunting 0 2026-02-12T18:06:13.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.691+0000 7f1ee6562640 1 monclient: found mon.noname-i 2026-02-12T18:06:13.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.691+0000 7f1ee6562640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:13.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.691+0000 7f1ee6562640 10 monclient: _send_mon_message to mon.noname-i at v2:10.20.193.111:3303/0 2026-02-12T18:06:13.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.691+0000 7f1ee6562640 1 -- 10.20.193.48:0/2184160499 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee0093070 con 0x7f1ee00951a0 2026-02-12T18:06:13.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.693+0000 7f1f637fe640 1 -- 10.20.193.48:0/619553114 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1f640914d0 msgr2=0x7f1f6405c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:13.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.693+0000 7f1f637fe640 1 --2- 10.20.193.48:0/619553114 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1f640914d0 0x7f1f6405c950 secure :-1 s=READY pgs=67 gs=2 cs=0 l=1 c_cookie=1650776485800721367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f500098d0 tx=0x7f1f5002ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e8bc77b7b83bd7 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:13.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.693+0000 7f1f627fc640 1 -- 10.20.193.48:0/619553114 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1f5002fb80 con 0x7f1f640914d0 2026-02-12T18:06:13.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.693+0000 7f1f627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:13.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.693+0000 7f1f627fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:06:13.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.693+0000 7f1ee6562640 1 -- 10.20.193.48:0/2184160499 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1ee00951a0 msgr2=0x7f1ee0093850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:13.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.693+0000 7f1ee6562640 1 --2- 10.20.193.48:0/2184160499 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1ee00951a0 0x7f1ee0093850 secure :-1 s=READY pgs=39 gs=2 cs=0 l=1 c_cookie=12596118236950895900 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ed0009830 tx=0x7f1ed002ed30 comp rx=0 tx=0).ready entity=mon.7 client_cookie=aece66cca6471d1c server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:13.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.693+0000 7f1f627fc640 10 monclient: dump: 2026-02-12T18:06:13.711 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:13.711 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.711 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.711 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.711 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:13.712 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.712 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:13.712 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:13.712 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:13.712 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:13.712 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:13.712 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:13.712 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:13.712 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:13.712 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:13.712 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.693+0000 7f1f627fc640 10 monclient: _finish_auth 0 2026-02-12T18:06:13.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.693+0000 7f1f627fc640 10 monclient: _check_auth_tickets 2026-02-12T18:06:13.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.693+0000 7f1f627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:13.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.693+0000 7f1f69de6640 5 monclient: authenticate success, global_id 4356 2026-02-12T18:06:13.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.693+0000 7f1f627fc640 1 -- 10.20.193.48:0/619553114 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f5002fd00 con 0x7f1f640914d0 2026-02-12T18:06:13.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.693+0000 7f1f69de6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:13.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.693+0000 7f1f627fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:13.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.693+0000 7f1f69de6640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:13.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.693+0000 7f1f627fc640 1 -- 10.20.193.48:0/619553114 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1f5002fe70 con 0x7f1f640914d0 2026-02-12T18:06:13.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.693+0000 7f1f69de6640 4 set_mon_vals no callback set 2026-02-12T18:06:13.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.693+0000 7f1f627fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:13.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.693+0000 7f1f627fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:13.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.693+0000 7f1f627fc640 10 monclient: dump: 2026-02-12T18:06:13.714 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:13.714 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.714 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.714 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.714 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:13.714 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.714 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:13.714 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:13.714 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:13.714 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:13.714 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:13.714 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:13.714 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:13.715 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:13.715 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:13.715 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.693+0000 7f1ee5560640 1 -- 10.20.193.48:0/2184160499 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1ed002fe70 con 0x7f1ee00951a0 2026-02-12T18:06:13.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee5560640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:13.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee5560640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2026-02-12T18:06:13.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee5560640 10 monclient: dump: 2026-02-12T18:06:13.716 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:13.716 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.716 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.716 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.717 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:13.717 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.717 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:13.717 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:13.717 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:13.717 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:13.717 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:13.717 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:13.717 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:13.717 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:13.717 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:13.717 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee5560640 10 monclient: _finish_auth 0 2026-02-12T18:06:13.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee5560640 10 monclient: _check_auth_tickets 2026-02-12T18:06:13.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee5560640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:13.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee5560640 1 -- 10.20.193.48:0/2184160499 <== mon.7 v2:10.20.193.111:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ed0035340 con 0x7f1ee00951a0 2026-02-12T18:06:13.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee87ed640 5 monclient: authenticate success, global_id 4354 2026-02-12T18:06:13.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee87ed640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:13.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee5560640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:13.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee87ed640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:13.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee5560640 1 -- 10.20.193.48:0/2184160499 <== mon.7 v2:10.20.193.111:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1ed0035970 con 0x7f1ee00951a0 2026-02-12T18:06:13.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee5560640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:13.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee87ed640 4 set_mon_vals no callback set 2026-02-12T18:06:13.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee5560640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:06:13.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee5560640 10 monclient: dump: 2026-02-12T18:06:13.719 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:13.719 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.719 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.719 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.719 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:13.719 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.719 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:13.719 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:13.719 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:13.719 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:13.719 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:13.719 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:13.719 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:13.720 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:13.720 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:13.720 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1f69de6640 10 monclient: shutdown 2026-02-12T18:06:13.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1f69de6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:13.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1f69de6640 1 -- 10.20.193.48:0/619553114 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1f640914d0 msgr2=0x7f1f6405c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1f69de6640 1 --2- 10.20.193.48:0/619553114 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1f640914d0 0x7f1f6405c950 secure :-1 s=READY pgs=67 gs=2 cs=0 l=1 c_cookie=1650776485800721367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f500098d0 tx=0x7f1f5002ef40 comp rx=0 tx=0).stop 2026-02-12T18:06:13.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1f69de6640 1 -- 10.20.193.48:0/619553114 shutdown_connections 2026-02-12T18:06:13.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1f69de6640 1 --2- 10.20.193.48:0/619553114 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f1f6405e4b0 0x7f1f6405ce90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1f69de6640 1 --2- 10.20.193.48:0/619553114 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1f640914d0 0x7f1f6405c950 unknown :-1 s=CLOSED pgs=67 gs=2 cs=0 l=1 c_cookie=1650776485800721367 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1f69de6640 1 -- 10.20.193.48:0/619553114 >> 10.20.193.48:0/619553114 conn(0x7f1f640548a0 msgr2=0x7f1f64097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:13.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1f69de6640 1 -- 10.20.193.48:0/619553114 shutdown_connections 2026-02-12T18:06:13.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1f69de6640 1 -- 10.20.193.48:0/619553114 wait complete. 2026-02-12T18:06:13.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee87ed640 10 monclient: shutdown 2026-02-12T18:06:13.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee87ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:13.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee87ed640 1 -- 10.20.193.48:0/2184160499 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1ee00951a0 msgr2=0x7f1ee0093850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee87ed640 1 --2- 10.20.193.48:0/2184160499 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1ee00951a0 0x7f1ee0093850 secure :-1 s=READY pgs=39 gs=2 cs=0 l=1 c_cookie=12596118236950895900 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ed0009830 tx=0x7f1ed002ed30 comp rx=0 tx=0).stop 2026-02-12T18:06:13.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee87ed640 1 -- 10.20.193.48:0/2184160499 shutdown_connections 2026-02-12T18:06:13.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee87ed640 1 --2- 10.20.193.48:0/2184160499 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f1ee0095c80 0x7f1ee01a5bb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee87ed640 1 --2- 10.20.193.48:0/2184160499 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1ee00951a0 0x7f1ee0093850 unknown :-1 s=CLOSED pgs=39 gs=2 cs=0 l=1 c_cookie=12596118236950895900 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee87ed640 1 -- 10.20.193.48:0/2184160499 >> 10.20.193.48:0/2184160499 conn(0x7f1ee00548c0 msgr2=0x7f1ee00973a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:13.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee87ed640 1 -- 10.20.193.48:0/2184160499 shutdown_connections 2026-02-12T18:06:13.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee87ed640 1 -- 10.20.193.48:0/2184160499 wait complete. 2026-02-12T18:06:13.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1f69de6640 10 monclient: build_initial_monmap 2026-02-12T18:06:13.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1f69de6640 10 monclient: monmap: 2026-02-12T18:06:13.724 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:13.724 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:13.724 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:13.724 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:13.724 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:13.724 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.724 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:13.724 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:13.724 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:13.725 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:13.725 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:13.725 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:13.725 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:13.725 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:13.725 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:13.725 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee87ed640 10 monclient: build_initial_monmap 2026-02-12T18:06:13.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1f69de6640 1 Processor -- start 2026-02-12T18:06:13.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.694+0000 7f1ee87ed640 10 monclient: monmap: 2026-02-12T18:06:13.726 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:13.726 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:13.726 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:13.726 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:13.726 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:13.726 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.726 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:13.726 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:13.726 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:13.727 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:13.727 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:13.727 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:13.727 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:13.727 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:13.727 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:13.727 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f69de6640 1 -- start start 2026-02-12T18:06:13.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f69de6640 10 monclient: init 2026-02-12T18:06:13.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee87ed640 1 Processor -- start 2026-02-12T18:06:13.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee87ed640 1 -- start start 2026-02-12T18:06:13.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee87ed640 10 monclient: init 2026-02-12T18:06:13.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f69de6640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:13.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f69de6640 10 monclient: _add_conns ranks=[8,2,0,5,4,7,6,3,1] 2026-02-12T18:06:13.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f69de6640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f1f6408e210 0x7f1f641db040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f69de6640 10 monclient(hunting): picked mon.noname-e con 0x7f1f6408e210 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:13.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f69de6640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f1f640914d0 0x7f1f641b0da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f69de6640 10 monclient(hunting): picked mon.noname-b con 0x7f1f640914d0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:13.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f69de6640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1f6419af40 0x7f1f64198a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f69de6640 10 monclient(hunting): picked mon.noname-a con 0x7f1f6419af40 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:06:13.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f69de6640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f69de6640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f1f641db580 con 0x7f1f6419af40 2026-02-12T18:06:13.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f69de6640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f69de6640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f1f6408d0e0 con 0x7f1f640914d0 2026-02-12T18:06:13.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f69de6640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f69de6640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f1f640903d0 con 0x7f1f6408e210 2026-02-12T18:06:13.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f69de6640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:13.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f69de6640 10 monclient(hunting): authenticate will time out at 612.421317s 2026-02-12T18:06:13.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f63fff640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1f6419af40 0x7f1f64198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f637fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f1f6408e210 0x7f1f641db040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f63fff640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1f6419af40 0x7f1f64198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:44482/0 (socket says 10.20.193.48:44482) 2026-02-12T18:06:13.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f63fff640 1 -- 10.20.193.48:0/1069526243 learned_addr learned my addr 10.20.193.48:0/1069526243 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:13.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f63fff640 10 monclient(hunting): get_auth_request con 0x7f1f6419af40 auth_method 0 2026-02-12T18:06:13.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f63fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f63fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f63fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f62ffd640 1 --2- 10.20.193.48:0/1069526243 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f1f640914d0 0x7f1f641b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f637fe640 10 monclient(hunting): get_auth_request con 0x7f1f6408e210 auth_method 0 2026-02-12T18:06:13.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f637fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f637fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee87ed640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:13.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f62ffd640 10 monclient(hunting): get_auth_request con 0x7f1f640914d0 auth_method 0 2026-02-12T18:06:13.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f62ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f62ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f62ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee87ed640 10 monclient: _add_conns ranks=[5,2,7,1,6,8,4,3,0] 2026-02-12T18:06:13.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f63fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:13.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f63fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:13.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee87ed640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f1ee00951a0 0x7f1ee01db0d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee87ed640 10 monclient(hunting): picked mon.noname-h con 0x7f1ee00951a0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:13.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f63fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:13.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee87ed640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f1ee0095c80 0x7f1ee01afbe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee87ed640 10 monclient(hunting): picked mon.noname-b con 0x7f1ee0095c80 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:13.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee87ed640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1ee0096ad0 0x7f1ee01b0120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee87ed640 10 monclient(hunting): picked mon.noname-i con 0x7f1ee0096ad0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:13.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee87ed640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee87ed640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f1ee019b1c0 con 0x7f1ee0095c80 2026-02-12T18:06:13.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee87ed640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f62ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:13.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f62ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:13.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee87ed640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f1ee008d0d0 con 0x7f1ee00951a0 2026-02-12T18:06:13.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee87ed640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee87ed640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f1ee0090130 con 0x7f1ee0096ad0 2026-02-12T18:06:13.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee87ed640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:13.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee87ed640 10 monclient(hunting): authenticate will time out at 612.421536s 2026-02-12T18:06:13.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f62ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:13.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f637fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:13.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f637fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:13.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f637fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:13.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee5d61640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f1ee0095c80 0x7f1ee01afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee6d63640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1ee0096ad0 0x7f1ee01b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee6d63640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1ee0096ad0 0x7f1ee01b0120 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3303/0 says I am v2:10.20.193.48:50198/0 (socket says 10.20.193.48:50198) 2026-02-12T18:06:13.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee6d63640 1 -- 10.20.193.48:0/2804063001 learned_addr learned my addr 10.20.193.48:0/2804063001 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:13.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee6d63640 10 monclient(hunting): get_auth_request con 0x7f1ee0096ad0 auth_method 0 2026-02-12T18:06:13.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee6d63640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee6d63640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee6d63640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee5d61640 10 monclient(hunting): get_auth_request con 0x7f1ee0095c80 auth_method 0 2026-02-12T18:06:13.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee5d61640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee5d61640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee5d61640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f63fff640 10 monclient(hunting): handle_auth_done global_id 4365 payload 824 2026-02-12T18:06:13.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f63fff640 1 -- 10.20.193.48:0/1069526243 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f1f6408e210 msgr2=0x7f1f641db040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f63fff640 1 --2- 10.20.193.48:0/1069526243 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f1f6408e210 0x7f1f641db040 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f63fff640 1 -- 10.20.193.48:0/1069526243 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f1f640914d0 msgr2=0x7f1f641b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f63fff640 1 --2- 10.20.193.48:0/1069526243 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f1f640914d0 0x7f1f641b0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f63fff640 10 monclient: _finish_hunting 0 2026-02-12T18:06:13.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f63fff640 1 monclient: found mon.noname-a 2026-02-12T18:06:13.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f63fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:13.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f63fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:06:13.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f63fff640 1 -- 10.20.193.48:0/1069526243 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f500094f0 con 0x7f1f6419af40 2026-02-12T18:06:13.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1f62ffd640 1 --2- 10.20.193.48:0/1069526243 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f1f640914d0 0x7f1f641b0da0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:06:13.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee6562640 1 --2- 10.20.193.48:0/2804063001 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f1ee00951a0 0x7f1ee01db0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee6562640 10 monclient(hunting): get_auth_request con 0x7f1ee00951a0 auth_method 0 2026-02-12T18:06:13.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee6562640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee6562640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee6562640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee6d63640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:13.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee6d63640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:13.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee6d63640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:13.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee5d61640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:13.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee5d61640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:13.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.695+0000 7f1ee5d61640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:13.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.696+0000 7f1ee6562640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:13.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.696+0000 7f1ee6562640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:13.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.696+0000 7f1ee6562640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:13.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.696+0000 7f1ee6d63640 10 monclient(hunting): handle_auth_done global_id 4363 payload 824 2026-02-12T18:06:13.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.696+0000 7f1ee6d63640 1 -- 10.20.193.48:0/2804063001 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f1ee00951a0 msgr2=0x7f1ee01db0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.696+0000 7f1ee6d63640 1 --2- 10.20.193.48:0/2804063001 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f1ee00951a0 0x7f1ee01db0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.696+0000 7f1ee6d63640 1 -- 10.20.193.48:0/2804063001 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f1ee0095c80 msgr2=0x7f1ee01afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.696+0000 7f1ee6d63640 1 --2- 10.20.193.48:0/2804063001 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f1ee0095c80 0x7f1ee01afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.696+0000 7f1ee6d63640 10 monclient: _finish_hunting 0 2026-02-12T18:06:13.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.696+0000 7f1ee6d63640 1 monclient: found mon.noname-i 2026-02-12T18:06:13.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.696+0000 7f1ee6d63640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:13.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.696+0000 7f1ee6d63640 10 monclient: _send_mon_message to mon.noname-i at v2:10.20.193.111:3303/0 2026-02-12T18:06:13.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.696+0000 7f1ee6d63640 1 -- 10.20.193.48:0/2804063001 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed0009420 con 0x7f1ee0096ad0 2026-02-12T18:06:13.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.697+0000 7f1f63fff640 1 -- 10.20.193.48:0/1069526243 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1f6419af40 msgr2=0x7f1f64198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:13.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.697+0000 7f1f63fff640 1 --2- 10.20.193.48:0/1069526243 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1f6419af40 0x7f1f64198a30 secure :-1 s=READY pgs=68 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f5800d4b0 tx=0x7f1f5800d980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:13.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1f3ffff640 1 -- 10.20.193.48:0/1069526243 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1f58007e30 con 0x7f1f6419af40 2026-02-12T18:06:13.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1f3ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:13.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1f3ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:06:13.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1f3ffff640 10 monclient: dump: 2026-02-12T18:06:13.741 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:13.741 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.741 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.741 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.741 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:13.741 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.741 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:13.741 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:13.741 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:13.741 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:13.741 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:13.741 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:13.741 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:13.741 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:13.741 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:13.741 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1f3ffff640 10 monclient: _finish_auth 0 2026-02-12T18:06:13.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1f3ffff640 10 monclient: _check_auth_tickets 2026-02-12T18:06:13.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1f3ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:13.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1f3ffff640 1 -- 10.20.193.48:0/1069526243 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f58013840 con 0x7f1f6419af40 2026-02-12T18:06:13.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1f3ffff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:13.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1f3ffff640 1 -- 10.20.193.48:0/1069526243 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1f58013e70 con 0x7f1f6419af40 2026-02-12T18:06:13.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1f69de6640 5 monclient: authenticate success, global_id 4365 2026-02-12T18:06:13.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1f69de6640 10 monclient: _renew_subs 2026-02-12T18:06:13.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1f61ffb640 4 set_mon_vals no callback set 2026-02-12T18:06:13.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1f69de6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:13.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1f69de6640 1 -- 10.20.193.48:0/1069526243 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f6419a3e0 con 0x7f1f6419af40 2026-02-12T18:06:13.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1f3ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:13.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1f3ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:13.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1f3ffff640 10 monclient: dump: 2026-02-12T18:06:13.742 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:13.742 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.742 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.742 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.742 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:13.742 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.742 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:13.742 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:13.743 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:13.743 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:13.743 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:13.743 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:13.743 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:13.743 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:13.743 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:13.743 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1f69de6640 10 monclient: _renew_subs 2026-02-12T18:06:13.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1f69de6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:13.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1f69de6640 1 -- 10.20.193.48:0/1069526243 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f6419bea0 con 0x7f1f6419af40 2026-02-12T18:06:13.744 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1ee6d63640 1 -- 10.20.193.48:0/2804063001 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1ee0096ad0 msgr2=0x7f1ee01b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:13.744 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1ee6d63640 1 --2- 10.20.193.48:0/2804063001 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1ee0096ad0 0x7f1ee01b0120 secure :-1 s=READY pgs=40 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1edc00a340 tx=0x7f1edc00fc80 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:13.744 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1ec6ffd640 1 -- 10.20.193.48:0/2804063001 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1edc00fe80 con 0x7f1ee0096ad0 2026-02-12T18:06:13.744 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1ec6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:13.744 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1ec6ffd640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2026-02-12T18:06:13.744 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1ec6ffd640 10 monclient: dump: 2026-02-12T18:06:13.744 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:13.744 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.744 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.744 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.744 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:13.744 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.744 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:13.744 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:13.744 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:13.744 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:13.745 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:13.745 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:13.745 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:13.745 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:13.745 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:13.745 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1ec6ffd640 10 monclient: _finish_auth 0 2026-02-12T18:06:13.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1ec6ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:06:13.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1ec6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:13.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1ec6ffd640 1 -- 10.20.193.48:0/2804063001 <== mon.7 v2:10.20.193.111:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1edc00dd70 con 0x7f1ee0096ad0 2026-02-12T18:06:13.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1ee87ed640 5 monclient: authenticate success, global_id 4363 2026-02-12T18:06:13.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1ee87ed640 10 monclient: _renew_subs 2026-02-12T18:06:13.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1ee87ed640 10 monclient: _send_mon_message to mon.i at v2:10.20.193.111:3303/0 2026-02-12T18:06:13.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1ee87ed640 1 -- 10.20.193.48:0/2804063001 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ee0098010 con 0x7f1ee0096ad0 2026-02-12T18:06:13.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1ec6ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:13.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1ec6ffd640 1 -- 10.20.193.48:0/2804063001 <== mon.7 v2:10.20.193.111:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1edc0148d0 con 0x7f1ee0096ad0 2026-02-12T18:06:13.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1ec6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:13.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1ee4d5f640 4 set_mon_vals no callback set 2026-02-12T18:06:13.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1ec6ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:06:13.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1ec6ffd640 10 monclient: dump: 2026-02-12T18:06:13.745 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:13.745 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.746 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.746 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.746 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:13.746 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.746 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:13.746 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:13.746 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:13.746 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:13.746 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:13.746 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:13.746 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:13.746 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:13.746 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:13.746 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1ee87ed640 10 monclient: _renew_subs 2026-02-12T18:06:13.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1ee87ed640 10 monclient: _send_mon_message to mon.i at v2:10.20.193.111:3303/0 2026-02-12T18:06:13.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1ee87ed640 1 -- 10.20.193.48:0/2804063001 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ee019b680 con 0x7f1ee0096ad0 2026-02-12T18:06:13.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1f69de6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:13.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1f69de6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:13.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1f69de6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:13.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1f69de6640 1 -- 10.20.193.48:0/1069526243 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f6405c950 con 0x7f1f6419af40 2026-02-12T18:06:13.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.698+0000 7f1f3ffff640 1 -- 10.20.193.48:0/1069526243 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f1f5801a070 con 0x7f1f6419af40 2026-02-12T18:06:13.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.699+0000 7f1f3ffff640 1 --2- 10.20.193.48:0/1069526243 >> v2:10.20.193.111:6812/977811348 conn(0x7f1f3403f7f0 0x7f1f3405fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.699+0000 7f1f3ffff640 1 -- 10.20.193.48:0/1069526243 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7f1f58053bc0 con 0x7f1f6419af40 2026-02-12T18:06:13.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.699+0000 7f1ee87ed640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:13.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.699+0000 7f1ee87ed640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:13.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.699+0000 7f1ee87ed640 10 monclient: _send_mon_message to mon.i at v2:10.20.193.111:3303/0 2026-02-12T18:06:13.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.699+0000 7f1ee87ed640 1 -- 10.20.193.48:0/2804063001 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ee019ae40 con 0x7f1ee0096ad0 2026-02-12T18:06:13.748 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.699+0000 7f1f637fe640 1 --2- 10.20.193.48:0/1069526243 >> v2:10.20.193.111:6812/977811348 conn(0x7f1f3403f7f0 0x7f1f3405fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.748 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.699+0000 7f1f637fe640 10 monclient: get_auth_request con 0x7f1f3403f7f0 auth_method 0 2026-02-12T18:06:13.748 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.699+0000 7f1ec6ffd640 1 -- 10.20.193.48:0/2804063001 <== mon.7 v2:10.20.193.111:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f1edc014410 con 0x7f1ee0096ad0 2026-02-12T18:06:13.748 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.699+0000 7f1ec6ffd640 1 --2- 10.20.193.48:0/2804063001 >> v2:10.20.193.111:6812/977811348 conn(0x7f1eb003f800 0x7f1eb005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.748 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.699+0000 7f1ec6ffd640 1 -- 10.20.193.48:0/2804063001 <== mon.7 v2:10.20.193.111:3303/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7f1edc053ac0 con 0x7f1ee0096ad0 2026-02-12T18:06:13.748 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.700+0000 7f1ee6562640 1 --2- 10.20.193.48:0/2804063001 >> v2:10.20.193.111:6812/977811348 conn(0x7f1eb003f800 0x7f1eb005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.748 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.700+0000 7f1ee6562640 10 monclient: get_auth_request con 0x7f1eb003f800 auth_method 0 2026-02-12T18:06:13.748 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.702+0000 7f1f637fe640 1 --2- 10.20.193.48:0/1069526243 >> v2:10.20.193.111:6812/977811348 conn(0x7f1f3403f7f0 0x7f1f3405fca0 secure :-1 s=READY pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f500023d0 tx=0x7f1f50039040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:13.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.702+0000 7f1ec6ffd640 1 -- 10.20.193.48:0/2804063001 <== mon.7 v2:10.20.193.111:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f1edc014a30 con 0x7f1ee0096ad0 2026-02-12T18:06:13.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.702+0000 7f1ec6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:13.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.702+0000 7f1ec6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:13.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.702+0000 7f1f3ffff640 1 -- 10.20.193.48:0/1069526243 <== mon.0 v2:10.20.193.48:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f1f580083c0 con 0x7f1f6419af40 2026-02-12T18:06:13.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.702+0000 7f1f3ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:13.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.702+0000 7f1f3ffff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:13.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.702+0000 7f1ee6562640 1 --2- 10.20.193.48:0/2804063001 >> v2:10.20.193.111:6812/977811348 conn(0x7f1eb003f800 0x7f1eb005fcb0 secure :-1 s=READY pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ed0004740 tx=0x7f1ed0033000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:13.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.733+0000 7f79eb354640 10 monclient: get_monmap_and_config 2026-02-12T18:06:13.750 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.733+0000 7f79eb354640 10 monclient: build_initial_monmap 2026-02-12T18:06:13.750 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.733+0000 7f79eb354640 10 monclient: monmap: 2026-02-12T18:06:13.750 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:13.750 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.750 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:13.734700+0000 2026-02-12T18:06:13.750 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:13.734700+0000 2026-02-12T18:06:13.750 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:13.750 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.750 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:13.750 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:13.750 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:13.750 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:13.750 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:13.750 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:13.750 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:13.750 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:13.750 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:13.750 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:13.750 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:13.750 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.751 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.733+0000 7f49f690c640 10 monclient: get_monmap_and_config 2026-02-12T18:06:13.751 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.733+0000 7f49f690c640 10 monclient: build_initial_monmap 2026-02-12T18:06:13.751 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.733+0000 7f49f690c640 10 monclient: monmap: 2026-02-12T18:06:13.751 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:13.751 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.751 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:13.734861+0000 2026-02-12T18:06:13.751 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:13.734861+0000 2026-02-12T18:06:13.751 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:13.751 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.751 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:13.751 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:13.751 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:13.751 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:13.751 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:13.751 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:13.751 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:13.751 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:13.751 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:13.751 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:13.751 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:13.751 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.751 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79eb354640 1 Processor -- start 2026-02-12T18:06:13.752 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79eb354640 1 -- start start 2026-02-12T18:06:13.752 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79eb354640 10 monclient: init 2026-02-12T18:06:13.752 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49f690c640 1 Processor -- start 2026-02-12T18:06:13.752 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49f690c640 1 -- start start 2026-02-12T18:06:13.752 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49f690c640 10 monclient: init 2026-02-12T18:06:13.752 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79eb354640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:13.752 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79eb354640 10 monclient: _add_conns ranks=[3,4,8,9,1,6,0,5,2,7,10] 2026-02-12T18:06:13.752 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79eb354640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f79e40951a0 0x7f79e4093850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.753 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79eb354640 10 monclient(hunting): picked mon.noname-g con 0x7f79e40951a0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:13.753 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79eb354640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f79e4096ad0 0x7f79e4095570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.753 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79eb354640 10 monclient(hunting): picked mon.noname-c con 0x7f79e4096ad0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:06:13.753 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79eb354640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f79e4095ab0 0x7f79e41a4ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.753 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79eb354640 10 monclient(hunting): picked mon.noname-e con 0x7f79e4095ab0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:13.753 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79eb354640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.753 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79eb354640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f79e4096900 con 0x7f79e40951a0 2026-02-12T18:06:13.753 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79eb354640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.753 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79eb354640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f79e4092260 con 0x7f79e4096ad0 2026-02-12T18:06:13.753 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79eb354640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.753 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79eb354640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f79e4093070 con 0x7f79e4095ab0 2026-02-12T18:06:13.753 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79eb354640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:13.753 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79eb354640 10 monclient(hunting): authenticate will time out at 612.460472s 2026-02-12T18:06:13.753 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49f690c640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:13.753 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e88c8640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f79e4096ad0 0x7f79e4095570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.753 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e98ca640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f79e4095ab0 0x7f79e41a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49f690c640 10 monclient: _add_conns ranks=[4,9,3,1,10,7,2,8,0,5,6] 2026-02-12T18:06:13.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49f690c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f49f005c950 0x7f49f005cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49f690c640 10 monclient(hunting): picked mon.noname-c con 0x7f49f005c950 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:06:13.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49f690c640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f49f005e490 0x7f49f005d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49f690c640 10 monclient(hunting): picked mon.noname-a con 0x7f49f005e490 addr v2:10.20.193.48:3300/0 2026-02-12T18:06:13.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e88c8640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f79e4096ad0 0x7f79e4095570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:52774/0 (socket says 10.20.193.48:52774) 2026-02-12T18:06:13.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e88c8640 1 -- 10.20.193.48:0/3931659489 learned_addr learned my addr 10.20.193.48:0/3931659489 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:13.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e88c8640 10 monclient(hunting): get_auth_request con 0x7f79e4096ad0 auth_method 0 2026-02-12T18:06:13.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e88c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49f690c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f49f013db70 0x7f49f013e010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49f690c640 10 monclient(hunting): picked mon.noname-g con 0x7f49f013db70 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:13.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49f690c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e88c8640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e88c8640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.755 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49f690c640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f49f005ddd0 con 0x7f49f005e490 2026-02-12T18:06:13.755 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49f690c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.755 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49f690c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f49f005d7a0 con 0x7f49f013db70 2026-02-12T18:06:13.755 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49f690c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.755 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49f690c640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f49f0092990 con 0x7f49f005c950 2026-02-12T18:06:13.755 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49f690c640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:13.755 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49f690c640 10 monclient(hunting): authenticate will time out at 612.460594s 2026-02-12T18:06:13.755 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e98ca640 10 monclient(hunting): get_auth_request con 0x7f79e4095ab0 auth_method 0 2026-02-12T18:06:13.755 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e98ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.755 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e98ca640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.755 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e98ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.755 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e90c9640 1 --2- 10.20.193.48:0/3931659489 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f79e40951a0 0x7f79e4093850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.755 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e88c8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:13.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e88c8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:13.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e88c8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:13.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e98ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:13.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e98ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:13.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49effff640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f49f005c950 0x7f49f005cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49effff640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f49f005c950 0x7f49f005cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:52790/0 (socket says 10.20.193.48:52790) 2026-02-12T18:06:13.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49effff640 1 -- 10.20.193.48:0/2477491195 learned_addr learned my addr 10.20.193.48:0/2477491195 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:13.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e98ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:13.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e90c9640 10 monclient(hunting): get_auth_request con 0x7f79e40951a0 auth_method 0 2026-02-12T18:06:13.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49effff640 10 monclient(hunting): get_auth_request con 0x7f49f005c950 auth_method 0 2026-02-12T18:06:13.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49ef7fe640 1 --2- 10.20.193.48:0/2477491195 >> v2:10.20.193.48:3300/0 conn(0x7f49f005e490 0x7f49f005d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e90c9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e90c9640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e90c9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49effff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49ef7fe640 10 monclient(hunting): get_auth_request con 0x7f49f005e490 auth_method 0 2026-02-12T18:06:13.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49ef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49ef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49ef7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:13.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49ef7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:13.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e90c9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:13.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e90c9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:13.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49ef7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:13.758 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e90c9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:13.758 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e88c8640 10 monclient(hunting): handle_auth_done global_id 34195 payload 274 2026-02-12T18:06:13.758 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49effff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:13.758 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49effff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:13.758 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e88c8640 1 -- 10.20.193.48:0/3931659489 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f79e4095ab0 msgr2=0x7f79e41a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:13.758 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e88c8640 1 --2- 10.20.193.48:0/3931659489 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f79e4095ab0 0x7f79e41a4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.758 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49effff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:13.758 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e88c8640 1 -- 10.20.193.48:0/3931659489 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f79e40951a0 msgr2=0x7f79e4093850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:13.758 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e88c8640 1 --2- 10.20.193.48:0/3931659489 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f79e40951a0 0x7f79e4093850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.758 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e88c8640 10 monclient: _finish_hunting 0 2026-02-12T18:06:13.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e88c8640 1 monclient: found mon.noname-c 2026-02-12T18:06:13.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e88c8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:13.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e88c8640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:06:13.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e88c8640 1 -- 10.20.193.48:0/3931659489 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e404dc20 con 0x7f79e4096ad0 2026-02-12T18:06:13.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f79e98ca640 1 --2- 10.20.193.48:0/3931659489 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f79e4095ab0 0x7f79e41a4ba0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:06:13.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49ef7fe640 10 monclient(hunting): handle_auth_done global_id 4374 payload 274 2026-02-12T18:06:13.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49ef7fe640 1 -- 10.20.193.48:0/2477491195 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f49f005c950 msgr2=0x7f49f005cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:13.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49ef7fe640 1 --2- 10.20.193.48:0/2477491195 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f49f005c950 0x7f49f005cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49ef7fe640 1 -- 10.20.193.48:0/2477491195 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f49f013db70 msgr2=0x7f49f013e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:13.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49ef7fe640 1 --2- 10.20.193.48:0/2477491195 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f49f013db70 0x7f49f013e010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49ef7fe640 10 monclient: _finish_hunting 0 2026-02-12T18:06:13.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49ef7fe640 1 monclient: found mon.noname-a 2026-02-12T18:06:13.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49ef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:13.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49ef7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:06:13.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.734+0000 7f49ef7fe640 1 -- 10.20.193.48:0/2477491195 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49f004dc20 con 0x7f49f005e490 2026-02-12T18:06:13.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.735+0000 7ff40d1c7640 10 monclient: get_monmap_and_config 2026-02-12T18:06:13.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.735+0000 7ff40d1c7640 10 monclient: build_initial_monmap 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.735+0000 7ff40d1c7640 10 monclient: monmap: 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:13.736918+0000 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:13.736918+0000 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.735+0000 7fd24375d640 10 monclient: get_monmap_and_config 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.735+0000 7fd24375d640 10 monclient: build_initial_monmap 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.735+0000 7fd24375d640 10 monclient: monmap: 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:13.737001+0000 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:13.737001+0000 2026-02-12T18:06:13.760 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:13.761 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.761 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:13.761 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:13.761 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:13.761 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:13.761 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:13.761 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:13.761 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:13.761 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:13.761 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:13.761 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:13.761 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:13.761 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.761 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff40d1c7640 1 Processor -- start 2026-02-12T18:06:13.761 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff40d1c7640 1 -- start start 2026-02-12T18:06:13.761 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff40d1c7640 10 monclient: init 2026-02-12T18:06:13.761 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd24375d640 1 Processor -- start 2026-02-12T18:06:13.761 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd24375d640 1 -- start start 2026-02-12T18:06:13.761 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd24375d640 10 monclient: init 2026-02-12T18:06:13.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff40d1c7640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:13.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff40d1c7640 10 monclient: _add_conns ranks=[9,3,7,4,8,6,5,2,1,0,10] 2026-02-12T18:06:13.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff40d1c7640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7ff4080951a0 0x7ff408093850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff40d1c7640 10 monclient(hunting): picked mon.noname-a con 0x7ff4080951a0 addr v2:10.20.193.48:3300/0 2026-02-12T18:06:13.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff40d1c7640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff408096ad0 0x7ff408095570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff40d1c7640 10 monclient(hunting): picked mon.noname-g con 0x7ff408096ad0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:13.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff40d1c7640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ff408095ab0 0x7ff4081a4ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff40d1c7640 10 monclient(hunting): picked mon.noname-i con 0x7ff408095ab0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:13.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff40d1c7640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff40d1c7640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7ff408096900 con 0x7ff4080951a0 2026-02-12T18:06:13.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff40d1c7640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff40d1c7640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff408092260 con 0x7ff408096ad0 2026-02-12T18:06:13.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff40d1c7640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff40d1c7640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7ff408093070 con 0x7ff408095ab0 2026-02-12T18:06:13.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff40d1c7640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:13.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff40d1c7640 10 monclient(hunting): authenticate will time out at 612.462648s 2026-02-12T18:06:13.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd24375d640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:13.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd24375d640 10 monclient: _add_conns ranks=[9,2,3,1,10,4,8,5,7,0,6] 2026-02-12T18:06:13.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd24375d640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fd23c05c950 0x7fd23c05cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd24375d640 10 monclient(hunting): picked mon.noname-a con 0x7fd23c05c950 addr v2:10.20.193.48:3300/0 2026-02-12T18:06:13.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff406d76640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7ff4080951a0 0x7ff408093850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd24375d640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd23c05e490 0x7fd23c05d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd24375d640 10 monclient(hunting): picked mon.noname-b con 0x7fd23c05e490 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:13.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd24375d640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd23c13db70 0x7fd23c13e010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd24375d640 10 monclient(hunting): picked mon.noname-g con 0x7fd23c13db70 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:13.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd24375d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd24375d640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7fd23c05ddd0 con 0x7fd23c05c950 2026-02-12T18:06:13.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff406d76640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7ff4080951a0 0x7ff408093850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:44504/0 (socket says 10.20.193.48:44504) 2026-02-12T18:06:13.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd24375d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd24375d640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fd23c05d7a0 con 0x7fd23c05e490 2026-02-12T18:06:13.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd24375d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd24375d640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd23c092990 con 0x7fd23c13db70 2026-02-12T18:06:13.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd24375d640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:13.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd24375d640 10 monclient(hunting): authenticate will time out at 612.462723s 2026-02-12T18:06:13.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff406d76640 1 -- 10.20.193.48:0/1890260413 learned_addr learned my addr 10.20.193.48:0/1890260413 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:13.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff406d76640 10 monclient(hunting): get_auth_request con 0x7ff4080951a0 auth_method 0 2026-02-12T18:06:13.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff406d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff406d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff406d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff406d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:13.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff406d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:13.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff406575640 1 --2- 10.20.193.48:0/1890260413 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff408096ad0 0x7ff408095570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff406d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:13.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd240cd1640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd23c05e490 0x7fd23c05d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd2414d2640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fd23c05c950 0x7fd23c05cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff407577640 1 --2- 10.20.193.48:0/1890260413 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ff408095ab0 0x7ff4081a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd240cd1640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd23c05e490 0x7fd23c05d260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:45060/0 (socket says 10.20.193.48:45060) 2026-02-12T18:06:13.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd240cd1640 1 -- 10.20.193.48:0/3168762565 learned_addr learned my addr 10.20.193.48:0/3168762565 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:13.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff407577640 10 monclient(hunting): get_auth_request con 0x7ff408095ab0 auth_method 0 2026-02-12T18:06:13.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff407577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff407577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff407577640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd240cd1640 10 monclient(hunting): get_auth_request con 0x7fd23c05e490 auth_method 0 2026-02-12T18:06:13.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd240cd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd240cd1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd240cd1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd2414d2640 10 monclient(hunting): get_auth_request con 0x7fd23c05c950 auth_method 0 2026-02-12T18:06:13.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd2414d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff406575640 10 monclient(hunting): get_auth_request con 0x7ff408096ad0 auth_method 0 2026-02-12T18:06:13.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff406575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff406575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff406575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd2414d2640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd2414d2640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd241cd3640 1 --2- 10.20.193.48:0/3168762565 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd23c13db70 0x7fd23c13e010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd241cd3640 10 monclient(hunting): get_auth_request con 0x7fd23c13db70 auth_method 0 2026-02-12T18:06:13.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd241cd3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd241cd3640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd241cd3640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff406d76640 10 monclient(hunting): handle_auth_done global_id 4383 payload 274 2026-02-12T18:06:13.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff406d76640 1 -- 10.20.193.48:0/1890260413 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ff408095ab0 msgr2=0x7ff4081a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:13.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff406d76640 1 --2- 10.20.193.48:0/1890260413 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ff408095ab0 0x7ff4081a4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff406d76640 1 -- 10.20.193.48:0/1890260413 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff408096ad0 msgr2=0x7ff408095570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:13.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd240cd1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:13.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd240cd1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:13.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff406d76640 1 --2- 10.20.193.48:0/1890260413 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff408096ad0 0x7ff408095570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff406d76640 10 monclient: _finish_hunting 0 2026-02-12T18:06:13.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff406d76640 1 monclient: found mon.noname-a 2026-02-12T18:06:13.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff406d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:13.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff406d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:06:13.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd240cd1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:13.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7ff406d76640 1 -- 10.20.193.48:0/1890260413 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff40804dc20 con 0x7ff4080951a0 2026-02-12T18:06:13.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd2414d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:13.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd2414d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:13.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd2414d2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:13.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd241cd3640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:13.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd241cd3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:13.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd241cd3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:13.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd240cd1640 10 monclient(hunting): handle_auth_done global_id 34238 payload 274 2026-02-12T18:06:13.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.736+0000 7fd240cd1640 1 -- 10.20.193.48:0/3168762565 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd23c13db70 msgr2=0x7fd23c13e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:13.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7fd240cd1640 1 --2- 10.20.193.48:0/3168762565 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd23c13db70 0x7fd23c13e010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7fd240cd1640 1 -- 10.20.193.48:0/3168762565 >> v2:10.20.193.48:3300/0 conn(0x7fd23c05c950 msgr2=0x7fd23c05cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:13.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7fd240cd1640 1 --2- 10.20.193.48:0/3168762565 >> v2:10.20.193.48:3300/0 conn(0x7fd23c05c950 0x7fd23c05cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7fd240cd1640 10 monclient: _finish_hunting 0 2026-02-12T18:06:13.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7fd240cd1640 1 monclient: found mon.noname-b 2026-02-12T18:06:13.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7fd240cd1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:13.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7fd240cd1640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:06:13.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7fd240cd1640 1 -- 10.20.193.48:0/3168762565 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd23c04dc20 con 0x7fd23c05e490 2026-02-12T18:06:13.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79e88c8640 1 -- 10.20.193.48:0/3931659489 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f79e4096ad0 msgr2=0x7f79e4095570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:13.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79e88c8640 1 --2- 10.20.193.48:0/3931659489 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f79e4096ad0 0x7f79e4095570 secure :-1 s=READY pgs=40 gs=2 cs=0 l=1 c_cookie=4433648571405810440 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79d8009900 tx=0x7f79d802ee10 comp rx=0 tx=0).ready entity=mon.4 client_cookie=3d877be29d8fbb08 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:13.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49ef7fe640 1 -- 10.20.193.48:0/2477491195 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49f005e490 msgr2=0x7f49f005d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:13.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49ef7fe640 1 --2- 10.20.193.48:0/2477491195 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49f005e490 0x7f49f005d260 secure :-1 s=READY pgs=69 gs=2 cs=0 l=1 c_cookie=16774547613076896403 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49e0004740 tx=0x7f49e002ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8cb2a2dc1533a93 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:13.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79d3fff640 1 -- 10.20.193.48:0/3931659489 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f79d8035340 con 0x7f79e4096ad0 2026-02-12T18:06:13.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:13.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79d3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:06:13.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79d3fff640 10 monclient: dump: 2026-02-12T18:06:13.768 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:13.768 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.768 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.768 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.768 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:13.768 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.768 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:13.768 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:13.768 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:13.768 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:13.768 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:13.768 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:13.768 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:13.768 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:13.768 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:13.768 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79d3fff640 10 monclient: _finish_auth 0 2026-02-12T18:06:13.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79d3fff640 10 monclient: _check_auth_tickets 2026-02-12T18:06:13.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79d3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79d3fff640 1 -- 10.20.193.48:0/3931659489 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79d80354c0 con 0x7f79e4096ad0 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79eb354640 5 monclient: authenticate success, global_id 34195 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79eb354640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79d3fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79d3fff640 1 -- 10.20.193.48:0/3931659489 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f79d8035af0 con 0x7f79e4096ad0 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79eb354640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79eb354640 4 set_mon_vals no callback set 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79d3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79d3fff640 10 monclient: dump: 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49eeffd640 1 -- 10.20.193.48:0/2477491195 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f49e002fe50 con 0x7f49f005e490 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49eeffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49eeffd640 10 monclient: dump: 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49eeffd640 10 monclient: _finish_auth 0 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49eeffd640 10 monclient: _check_auth_tickets 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49eeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49eeffd640 1 -- 10.20.193.48:0/2477491195 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49e0035340 con 0x7f49f005e490 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49eeffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49f690c640 5 monclient: authenticate success, global_id 4374 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49eeffd640 1 -- 10.20.193.48:0/2477491195 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f49e0035970 con 0x7f49f005e490 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49f690c640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49f690c640 4 set_mon_vals no callback set 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49eeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49eeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49eeffd640 10 monclient: dump: 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:13.770 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.771 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:13.771 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:13.771 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:13.771 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:13.771 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:13.771 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:13.771 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:13.771 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:13.771 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:13.771 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79eb354640 10 monclient: shutdown 2026-02-12T18:06:13.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79eb354640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:13.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79eb354640 1 -- 10.20.193.48:0/3931659489 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f79e4096ad0 msgr2=0x7f79e4095570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79eb354640 1 --2- 10.20.193.48:0/3931659489 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f79e4096ad0 0x7f79e4095570 secure :-1 s=READY pgs=40 gs=2 cs=0 l=1 c_cookie=4433648571405810440 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79d8009900 tx=0x7f79d802ee10 comp rx=0 tx=0).stop 2026-02-12T18:06:13.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79eb354640 1 -- 10.20.193.48:0/3931659489 shutdown_connections 2026-02-12T18:06:13.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79eb354640 1 --2- 10.20.193.48:0/3931659489 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f79e4095ab0 0x7f79e41a4ba0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79eb354640 1 --2- 10.20.193.48:0/3931659489 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f79e4096ad0 0x7f79e4095570 unknown :-1 s=CLOSED pgs=40 gs=2 cs=0 l=1 c_cookie=4433648571405810440 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79eb354640 1 --2- 10.20.193.48:0/3931659489 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f79e40951a0 0x7f79e4093850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79eb354640 1 -- 10.20.193.48:0/3931659489 >> 10.20.193.48:0/3931659489 conn(0x7f79e40548c0 msgr2=0x7f79e40973a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:13.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79eb354640 1 -- 10.20.193.48:0/3931659489 shutdown_connections 2026-02-12T18:06:13.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f79eb354640 1 -- 10.20.193.48:0/3931659489 wait complete. 2026-02-12T18:06:13.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49f690c640 10 monclient: shutdown 2026-02-12T18:06:13.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49f690c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:13.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49f690c640 1 -- 10.20.193.48:0/2477491195 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49f005e490 msgr2=0x7f49f005d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49f690c640 1 --2- 10.20.193.48:0/2477491195 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49f005e490 0x7f49f005d260 secure :-1 s=READY pgs=69 gs=2 cs=0 l=1 c_cookie=16774547613076896403 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49e0004740 tx=0x7f49e002ed10 comp rx=0 tx=0).stop 2026-02-12T18:06:13.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49f690c640 1 -- 10.20.193.48:0/2477491195 shutdown_connections 2026-02-12T18:06:13.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49f690c640 1 --2- 10.20.193.48:0/2477491195 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f49f013db70 0x7f49f013e010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49f690c640 1 --2- 10.20.193.48:0/2477491195 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49f005e490 0x7f49f005d260 unknown :-1 s=CLOSED pgs=69 gs=2 cs=0 l=1 c_cookie=16774547613076896403 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49f690c640 1 --2- 10.20.193.48:0/2477491195 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f49f005c950 0x7f49f005cd20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49f690c640 1 -- 10.20.193.48:0/2477491195 >> 10.20.193.48:0/2477491195 conn(0x7f49f00548a0 msgr2=0x7f49f0097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:13.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49f690c640 1 -- 10.20.193.48:0/2477491195 shutdown_connections 2026-02-12T18:06:13.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.737+0000 7f49f690c640 1 -- 10.20.193.48:0/2477491195 wait complete. 2026-02-12T18:06:13.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79eb354640 10 monclient: build_initial_monmap 2026-02-12T18:06:13.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f49f690c640 10 monclient: build_initial_monmap 2026-02-12T18:06:13.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79eb354640 10 monclient: monmap: 2026-02-12T18:06:13.772 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:13.772 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:13.772 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:13.772 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:13.772 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:13.772 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.772 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:13.772 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:13.772 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:13.773 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:13.773 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:13.773 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:13.773 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:13.773 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:13.773 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:13.773 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f49f690c640 10 monclient: monmap: 2026-02-12T18:06:13.773 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:13.773 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:13.773 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:13.773 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:13.773 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:13.773 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.773 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:13.773 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:13.773 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:13.773 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:13.773 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:13.773 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:13.773 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:13.773 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:13.773 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:13.773 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79eb354640 1 Processor -- start 2026-02-12T18:06:13.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f49f690c640 1 Processor -- start 2026-02-12T18:06:13.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79eb354640 1 -- start start 2026-02-12T18:06:13.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79eb354640 10 monclient: init 2026-02-12T18:06:13.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79eb354640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:13.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79eb354640 10 monclient: _add_conns ranks=[7,3,4,8,5,6,2,1,0] 2026-02-12T18:06:13.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79eb354640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f79e40951a0 0x7f79e41dafb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79eb354640 10 monclient(hunting): picked mon.noname-i con 0x7f79e40951a0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:13.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79eb354640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f79e4095ab0 0x7f79e41b0cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79eb354640 10 monclient(hunting): picked mon.noname-g con 0x7f79e4095ab0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:13.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79eb354640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f79e4096ad0 0x7f79e41b1230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79eb354640 10 monclient(hunting): picked mon.noname-c con 0x7f79e4096ad0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:06:13.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79eb354640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79eb354640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f79e41db4f0 con 0x7f79e4095ab0 2026-02-12T18:06:13.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79eb354640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79eb354640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f79e408cf40 con 0x7f79e4096ad0 2026-02-12T18:06:13.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79eb354640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79eb354640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f79e41dbe70 con 0x7f79e40951a0 2026-02-12T18:06:13.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79eb354640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:13.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79eb354640 10 monclient(hunting): authenticate will time out at 612.464886s 2026-02-12T18:06:13.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f49f690c640 1 -- start start 2026-02-12T18:06:13.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f49f690c640 10 monclient: init 2026-02-12T18:06:13.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79e98ca640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f79e4096ad0 0x7f79e41b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79e98ca640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f79e4096ad0 0x7f79e41b1230 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:52792/0 (socket says 10.20.193.48:52792) 2026-02-12T18:06:13.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79e98ca640 1 -- 10.20.193.48:0/577247846 learned_addr learned my addr 10.20.193.48:0/577247846 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:13.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79e98ca640 10 monclient(hunting): get_auth_request con 0x7f79e4096ad0 auth_method 0 2026-02-12T18:06:13.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79e98ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79e98ca640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.738+0000 7f79e98ca640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f79e90c9640 1 --2- 10.20.193.48:0/577247846 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f79e40951a0 0x7f79e41dafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f79e98ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:13.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f79e98ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:13.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f79e98ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:13.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f79e88c8640 1 --2- 10.20.193.48:0/577247846 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f79e4095ab0 0x7f79e41b0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f79e90c9640 10 monclient(hunting): get_auth_request con 0x7f79e40951a0 auth_method 0 2026-02-12T18:06:13.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f79e90c9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f79e90c9640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f79e90c9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f79e88c8640 10 monclient(hunting): get_auth_request con 0x7f79e4095ab0 auth_method 0 2026-02-12T18:06:13.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f79e88c8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f79e88c8640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f79e88c8640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f79e98ca640 10 monclient(hunting): handle_auth_done global_id 34213 payload 824 2026-02-12T18:06:13.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f79e98ca640 1 -- 10.20.193.48:0/577247846 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f79e40951a0 msgr2=0x7f79e41dafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f79e98ca640 1 --2- 10.20.193.48:0/577247846 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f79e40951a0 0x7f79e41dafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f79e98ca640 1 -- 10.20.193.48:0/577247846 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f79e4095ab0 msgr2=0x7f79e41b0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f79e98ca640 1 --2- 10.20.193.48:0/577247846 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f79e4095ab0 0x7f79e41b0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f79e98ca640 10 monclient: _finish_hunting 0 2026-02-12T18:06:13.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f79e98ca640 1 monclient: found mon.noname-c 2026-02-12T18:06:13.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f79e98ca640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:13.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f79e98ca640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:06:13.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f79e98ca640 1 -- 10.20.193.48:0/577247846 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79e000a500 con 0x7f79e4096ad0 2026-02-12T18:06:13.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f79e88c8640 1 --2- 10.20.193.48:0/577247846 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f79e4095ab0 0x7f79e41b0cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:06:13.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f79e90c9640 1 --2- 10.20.193.48:0/577247846 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f79e40951a0 0x7f79e41dafb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:06:13.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49f690c640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:13.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49f690c640 10 monclient: _add_conns ranks=[0,1,5,2,3,6,8,4,7] 2026-02-12T18:06:13.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49f690c640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49f005c950 0x7f49f01db6a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49f690c640 10 monclient(hunting): picked mon.noname-a con 0x7f49f005c950 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:06:13.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49f690c640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49f005e490 0x7f49f01dbbe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49f690c640 10 monclient(hunting): picked mon.noname-f con 0x7f49f005e490 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:06:13.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49f690c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f49f013db70 0x7f49f008aad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49f690c640 10 monclient(hunting): picked mon.noname-h con 0x7f49f013db70 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:13.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49f690c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49f690c640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f49f013d440 con 0x7f49f005c950 2026-02-12T18:06:13.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49f690c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49f690c640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f49f01422e0 con 0x7f49f005e490 2026-02-12T18:06:13.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49f690c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49f690c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f49f012e440 con 0x7f49f013db70 2026-02-12T18:06:13.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49f690c640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:13.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49f690c640 10 monclient(hunting): authenticate will time out at 612.465313s 2026-02-12T18:06:13.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49effff640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49f005c950 0x7f49f01db6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49effff640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49f005c950 0x7f49f01db6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:44510/0 (socket says 10.20.193.48:44510) 2026-02-12T18:06:13.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49effff640 1 -- 10.20.193.48:0/2313440493 learned_addr learned my addr 10.20.193.48:0/2313440493 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:13.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49effff640 10 monclient(hunting): get_auth_request con 0x7f49f005c950 auth_method 0 2026-02-12T18:06:13.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49effff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49effff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49effff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff406d76640 1 -- 10.20.193.48:0/1890260413 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff4080951a0 msgr2=0x7ff408093850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:13.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff406d76640 1 --2- 10.20.193.48:0/1890260413 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff4080951a0 0x7ff408093850 secure :-1 s=READY pgs=70 gs=1 cs=0 l=1 c_cookie=16512379413423323095 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3fc009060 tx=0x7ff3fc02edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e527c1971591f7d7 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:13.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49effff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:13.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49effff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:13.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49effff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:13.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49ef7fe640 1 --2- 10.20.193.48:0/2313440493 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49f005e490 0x7f49f01dbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49ef7fe640 10 monclient(hunting): get_auth_request con 0x7f49f005e490 auth_method 0 2026-02-12T18:06:13.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49ef7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49ef7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49ef7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49f4e82640 1 --2- 10.20.193.48:0/2313440493 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f49f013db70 0x7f49f008aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49f4e82640 10 monclient(hunting): get_auth_request con 0x7f49f013db70 auth_method 0 2026-02-12T18:06:13.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49f4e82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49f4e82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49f4e82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff405d74640 1 -- 10.20.193.48:0/1890260413 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff3fc035340 con 0x7ff4080951a0 2026-02-12T18:06:13.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff405d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7fd240cd1640 1 -- 10.20.193.48:0/3168762565 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd23c05e490 msgr2=0x7fd23c05d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7fd240cd1640 1 --2- 10.20.193.48:0/3168762565 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd23c05e490 0x7fd23c05d260 secure :-1 s=READY pgs=30 gs=1 cs=0 l=1 c_cookie=7746988397746812492 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd230009060 tx=0x7fd23002edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b82d4e706c5764c server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff405d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff405d74640 10 monclient: dump: 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff405d74640 10 monclient: _finish_auth 0 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff405d74640 10 monclient: _check_auth_tickets 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff405d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49effff640 10 monclient(hunting): handle_auth_done global_id 4401 payload 824 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff405d74640 1 -- 10.20.193.48:0/1890260413 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3fc0354c0 con 0x7ff4080951a0 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff405d74640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff405d74640 1 -- 10.20.193.48:0/1890260413 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff3fc035af0 con 0x7ff4080951a0 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff40d1c7640 5 monclient: authenticate success, global_id 4383 2026-02-12T18:06:13.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff40d1c7640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff40d1c7640 4 set_mon_vals no callback set 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff405d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49effff640 1 -- 10.20.193.48:0/2313440493 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f49f013db70 msgr2=0x7f49f008aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49effff640 1 --2- 10.20.193.48:0/2313440493 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f49f013db70 0x7f49f008aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff405d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff405d74640 10 monclient: dump: 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49effff640 1 -- 10.20.193.48:0/2313440493 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49f005e490 msgr2=0x7f49f01dbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49effff640 1 --2- 10.20.193.48:0/2313440493 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49f005e490 0x7f49f01dbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49effff640 10 monclient: _finish_hunting 0 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49effff640 1 monclient: found mon.noname-a 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49effff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49effff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:06:13.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7f49effff640 1 -- 10.20.193.48:0/2313440493 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49e0009420 con 0x7f49f005c950 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7fd22bfff640 1 -- 10.20.193.48:0/3168762565 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd230035340 con 0x7fd23c05e490 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7fd22bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7fd22bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7fd22bfff640 10 monclient: dump: 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7fd22bfff640 10 monclient: _finish_auth 0 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7fd22bfff640 10 monclient: _check_auth_tickets 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7fd22bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7fd22bfff640 1 -- 10.20.193.48:0/3168762565 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2300354c0 con 0x7fd23c05e490 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7fd24375d640 5 monclient: authenticate success, global_id 34238 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7fd24375d640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7fd22bfff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7fd22bfff640 1 -- 10.20.193.48:0/3168762565 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd230035af0 con 0x7fd23c05e490 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7fd22bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7fd22bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7fd22bfff640 10 monclient: dump: 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.780 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.781 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.781 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:13.781 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.781 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:13.781 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:13.781 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:13.781 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:13.781 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:13.781 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:13.781 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:13.781 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:13.781 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:13.781 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7fd24375d640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:13.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7fd24375d640 4 set_mon_vals no callback set 2026-02-12T18:06:13.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff40d1c7640 10 monclient: shutdown 2026-02-12T18:06:13.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff40d1c7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:13.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff40d1c7640 1 -- 10.20.193.48:0/1890260413 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff4080951a0 msgr2=0x7ff408093850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff40d1c7640 1 --2- 10.20.193.48:0/1890260413 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff4080951a0 0x7ff408093850 secure :-1 s=READY pgs=70 gs=1 cs=0 l=1 c_cookie=16512379413423323095 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3fc009060 tx=0x7ff3fc02edf0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff40d1c7640 1 -- 10.20.193.48:0/1890260413 shutdown_connections 2026-02-12T18:06:13.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff40d1c7640 1 --2- 10.20.193.48:0/1890260413 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ff408095ab0 0x7ff4081a4ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff40d1c7640 1 --2- 10.20.193.48:0/1890260413 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff408096ad0 0x7ff408095570 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff40d1c7640 1 --2- 10.20.193.48:0/1890260413 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff4080951a0 0x7ff408093850 unknown :-1 s=CLOSED pgs=70 gs=1 cs=0 l=1 c_cookie=16512379413423323095 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff40d1c7640 1 -- 10.20.193.48:0/1890260413 >> 10.20.193.48:0/1890260413 conn(0x7ff4080548c0 msgr2=0x7ff4080973a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:13.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff40d1c7640 1 -- 10.20.193.48:0/1890260413 shutdown_connections 2026-02-12T18:06:13.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.739+0000 7ff40d1c7640 1 -- 10.20.193.48:0/1890260413 wait complete. 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 10 monclient: shutdown 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 1 -- 10.20.193.48:0/3168762565 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd23c05e490 msgr2=0x7fd23c05d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 1 --2- 10.20.193.48:0/3168762565 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd23c05e490 0x7fd23c05d260 secure :-1 s=READY pgs=30 gs=1 cs=0 l=1 c_cookie=7746988397746812492 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd230009060 tx=0x7fd23002edf0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 1 -- 10.20.193.48:0/3168762565 shutdown_connections 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 1 --2- 10.20.193.48:0/3168762565 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd23c13db70 0x7fd23c13e010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 1 --2- 10.20.193.48:0/3168762565 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd23c05e490 0x7fd23c05d260 unknown :-1 s=CLOSED pgs=30 gs=1 cs=0 l=1 c_cookie=7746988397746812492 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 1 --2- 10.20.193.48:0/3168762565 >> v2:10.20.193.48:3300/0 conn(0x7fd23c05c950 0x7fd23c05cd20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 1 -- 10.20.193.48:0/3168762565 >> 10.20.193.48:0/3168762565 conn(0x7fd23c0548a0 msgr2=0x7fd23c097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 1 -- 10.20.193.48:0/3168762565 shutdown_connections 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 1 -- 10.20.193.48:0/3168762565 wait complete. 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff40d1c7640 10 monclient: build_initial_monmap 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff40d1c7640 10 monclient: monmap: 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff40d1c7640 1 Processor -- start 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff40d1c7640 1 -- start start 2026-02-12T18:06:13.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff40d1c7640 10 monclient: init 2026-02-12T18:06:13.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 10 monclient: build_initial_monmap 2026-02-12T18:06:13.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 10 monclient: monmap: 2026-02-12T18:06:13.783 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:13.783 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:13.783 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:13.783 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:13.783 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:13.783 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.783 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:13.783 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:13.783 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:13.783 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:13.783 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:13.783 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:13.783 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:13.783 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:13.783 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:13.783 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 1 Processor -- start 2026-02-12T18:06:13.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff40d1c7640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:13.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff40d1c7640 10 monclient: _add_conns ranks=[4,3,8,1,5,7,2,6,0] 2026-02-12T18:06:13.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 1 -- start start 2026-02-12T18:06:13.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 10 monclient: init 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff40d1c7640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff4080951a0 0x7ff4081daff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff40d1c7640 10 monclient(hunting): picked mon.noname-c con 0x7ff4080951a0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff40d1c7640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff408095ab0 0x7ff4081b0dd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff40d1c7640 10 monclient(hunting): picked mon.noname-g con 0x7ff408095ab0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff40d1c7640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff408096ad0 0x7ff408198b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff40d1c7640 10 monclient(hunting): picked mon.noname-e con 0x7ff408096ad0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff40d1c7640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff40d1c7640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff40819a430 con 0x7ff408095ab0 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff40d1c7640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff40d1c7640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7ff408090070 con 0x7ff4080951a0 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff40d1c7640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff40d1c7640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7ff40819c790 con 0x7ff408096ad0 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff40d1c7640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff40d1c7640 10 monclient(hunting): authenticate will time out at 612.466764s 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff406d76640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff4080951a0 0x7ff4081daff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff406d76640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff4080951a0 0x7ff4081daff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:52802/0 (socket says 10.20.193.48:52802) 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff406d76640 1 -- 10.20.193.48:0/1281905320 learned_addr learned my addr 10.20.193.48:0/1281905320 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff406d76640 10 monclient(hunting): get_auth_request con 0x7ff4080951a0 auth_method 0 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff406d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff406d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff406d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff407577640 1 --2- 10.20.193.48:0/1281905320 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff408096ad0 0x7ff408198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff406d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff406d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff406d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff407577640 10 monclient(hunting): get_auth_request con 0x7ff408096ad0 auth_method 0 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff407577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff407577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff407577640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff406575640 1 --2- 10.20.193.48:0/1281905320 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff408095ab0 0x7ff4081b0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff406575640 10 monclient(hunting): get_auth_request con 0x7ff408095ab0 auth_method 0 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff406575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff406575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff406575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff407577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff407577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:13.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7ff407577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:13.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:13.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 10 monclient: _add_conns ranks=[4,5,3,7,2,6,0,8,1] 2026-02-12T18:06:13.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd23c05c950 0x7fd23c12c890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 10 monclient(hunting): picked mon.noname-c con 0x7fd23c05c950 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:06:13.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd23c05e490 0x7fd23c08d2e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 10 monclient(hunting): picked mon.noname-h con 0x7fd23c05e490 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:13.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd23c13db70 0x7fd23c08d820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 10 monclient(hunting): picked mon.noname-g con 0x7fd23c13db70 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:13.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd23c13e830 con 0x7fd23c13db70 2026-02-12T18:06:13.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fd23c13e3e0 con 0x7fd23c05c950 2026-02-12T18:06:13.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fd23c143a80 con 0x7fd23c05e490 2026-02-12T18:06:13.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:13.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.740+0000 7fd24375d640 10 monclient(hunting): authenticate will time out at 612.467007s 2026-02-12T18:06:13.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7ff406d76640 10 monclient(hunting): handle_auth_done global_id 34222 payload 824 2026-02-12T18:06:13.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7ff406d76640 1 -- 10.20.193.48:0/1281905320 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff408096ad0 msgr2=0x7ff408198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7ff406d76640 1 --2- 10.20.193.48:0/1281905320 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff408096ad0 0x7ff408198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7ff406d76640 1 -- 10.20.193.48:0/1281905320 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff408095ab0 msgr2=0x7ff4081b0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7ff406d76640 1 --2- 10.20.193.48:0/1281905320 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff408095ab0 0x7ff4081b0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7ff406d76640 10 monclient: _finish_hunting 0 2026-02-12T18:06:13.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7ff406d76640 1 monclient: found mon.noname-c 2026-02-12T18:06:13.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7ff406d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:13.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7ff406d76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7ff406d76640 1 -- 10.20.193.48:0/1281905320 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3fc0094f0 con 0x7ff4080951a0 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd2414d2640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd23c05c950 0x7fd23c12c890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd2414d2640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd23c05c950 0x7fd23c12c890 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:52808/0 (socket says 10.20.193.48:52808) 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd2414d2640 1 -- 10.20.193.48:0/2856865572 learned_addr learned my addr 10.20.193.48:0/2856865572 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd2414d2640 10 monclient(hunting): get_auth_request con 0x7fd23c05c950 auth_method 0 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd2414d2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd2414d2640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd2414d2640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd240cd1640 1 --2- 10.20.193.48:0/2856865572 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd23c05e490 0x7fd23c08d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd240cd1640 10 monclient(hunting): get_auth_request con 0x7fd23c05e490 auth_method 0 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd240cd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd240cd1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd240cd1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd2414d2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd2414d2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd241cd3640 1 --2- 10.20.193.48:0/2856865572 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd23c13db70 0x7fd23c08d820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd2414d2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd241cd3640 10 monclient(hunting): get_auth_request con 0x7fd23c13db70 auth_method 0 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd241cd3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd241cd3640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd241cd3640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd240cd1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd240cd1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd240cd1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd2414d2640 10 monclient(hunting): handle_auth_done global_id 34231 payload 824 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd2414d2640 1 -- 10.20.193.48:0/2856865572 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd23c05e490 msgr2=0x7fd23c08d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd2414d2640 1 --2- 10.20.193.48:0/2856865572 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd23c05e490 0x7fd23c08d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f79e98ca640 1 -- 10.20.193.48:0/577247846 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f79e4096ad0 msgr2=0x7f79e41b1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:13.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f79e98ca640 1 --2- 10.20.193.48:0/577247846 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f79e4096ad0 0x7f79e41b1230 secure :-1 s=READY pgs=41 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79e000fb60 tx=0x7f79e000d520 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:13.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd2414d2640 1 -- 10.20.193.48:0/2856865572 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd23c13db70 msgr2=0x7fd23c08d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd2414d2640 1 --2- 10.20.193.48:0/2856865572 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd23c13db70 0x7fd23c08d820 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd2414d2640 10 monclient: _finish_hunting 0 2026-02-12T18:06:13.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd2414d2640 1 monclient: found mon.noname-c 2026-02-12T18:06:13.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd2414d2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:13.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd2414d2640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:06:13.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd2414d2640 1 -- 10.20.193.48:0/2856865572 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2300094f0 con 0x7fd23c05c950 2026-02-12T18:06:13.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7fd241cd3640 1 --2- 10.20.193.48:0/2856865572 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd23c13db70 0x7fd23c08d820 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:06:13.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f79d1ffb640 1 -- 10.20.193.48:0/577247846 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f79e000de50 con 0x7f79e4096ad0 2026-02-12T18:06:13.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f79d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:13.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f79d1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:06:13.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f79d1ffb640 10 monclient: dump: 2026-02-12T18:06:13.787 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:13.787 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.787 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.787 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.787 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:13.787 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f79d1ffb640 10 monclient: _finish_auth 0 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f79d1ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f79d1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f79d1ffb640 1 -- 10.20.193.48:0/577247846 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79e00054f0 con 0x7f79e4096ad0 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f79d1ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f79d1ffb640 1 -- 10.20.193.48:0/577247846 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f79e0005660 con 0x7f79e4096ad0 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f79d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f79d1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f79d37fe640 4 set_mon_vals no callback set 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f79d1ffb640 10 monclient: dump: 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f79eb354640 5 monclient: authenticate success, global_id 34213 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f79eb354640 10 monclient: _renew_subs 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f79eb354640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f79eb354640 1 -- 10.20.193.48:0/577247846 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79d80094f0 con 0x7f79e4096ad0 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f79eb354640 10 monclient: _renew_subs 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f79eb354640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:13.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f79eb354640 1 -- 10.20.193.48:0/577247846 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f79e408ffe0 con 0x7f79e4096ad0 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f49effff640 1 -- 10.20.193.48:0/2313440493 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49f005c950 msgr2=0x7f49f01db6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f49effff640 1 --2- 10.20.193.48:0/2313440493 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49f005c950 0x7f49f01db6a0 secure :-1 s=READY pgs=71 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49dc0094c0 tx=0x7f49dc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f49ecff9640 1 -- 10.20.193.48:0/2313440493 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f49dc00cc10 con 0x7f49f005c950 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f49ecff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f49ecff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f49ecff9640 10 monclient: dump: 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f49ecff9640 10 monclient: _finish_auth 0 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f49ecff9640 10 monclient: _check_auth_tickets 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f49ecff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f49ecff9640 1 -- 10.20.193.48:0/2313440493 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49dc00cd70 con 0x7f49f005c950 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f49ecff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f49ecff9640 1 -- 10.20.193.48:0/2313440493 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f49dc013df0 con 0x7f49f005c950 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f49ecff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f49ecff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:13.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f49ee7fc640 4 set_mon_vals no callback set 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.741+0000 7f49ecff9640 10 monclient: dump: 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.742+0000 7f49f690c640 5 monclient: authenticate success, global_id 4401 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.742+0000 7f49f690c640 10 monclient: _renew_subs 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.742+0000 7f49f690c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.742+0000 7f49f690c640 1 -- 10.20.193.48:0/2313440493 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49f012de80 con 0x7f49f005c950 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.742+0000 7f49f690c640 10 monclient: _renew_subs 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.742+0000 7f49f690c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.742+0000 7f49f690c640 1 -- 10.20.193.48:0/2313440493 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49f013e760 con 0x7f49f005c950 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.742+0000 7f79eb354640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.742+0000 7f79eb354640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.742+0000 7f79eb354640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.742+0000 7f79d1ffb640 1 -- 10.20.193.48:0/577247846 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f79e0024020 con 0x7f79e4096ad0 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.742+0000 7f79eb354640 1 -- 10.20.193.48:0/577247846 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79e419a3b0 con 0x7f79e4096ad0 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.742+0000 7f79d1ffb640 1 --2- 10.20.193.48:0/577247846 >> v2:10.20.193.111:6812/977811348 conn(0x7f79b403f800 0x7f79b405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.742+0000 7f79d1ffb640 1 -- 10.20.193.48:0/577247846 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7f79e0054170 con 0x7f79e4096ad0 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.742+0000 7f79e90c9640 1 --2- 10.20.193.48:0/577247846 >> v2:10.20.193.111:6812/977811348 conn(0x7f79b403f800 0x7f79b405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.742+0000 7f79e90c9640 10 monclient: get_auth_request con 0x7f79b403f800 auth_method 0 2026-02-12T18:06:13.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.742+0000 7f49f690c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:13.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.742+0000 7f49f690c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:13.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.742+0000 7f49f690c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:13.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.742+0000 7f49f690c640 1 -- 10.20.193.48:0/2313440493 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49f0097de0 con 0x7f49f005c950 2026-02-12T18:06:13.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.742+0000 7f49ecff9640 1 -- 10.20.193.48:0/2313440493 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f49dc011070 con 0x7f49f005c950 2026-02-12T18:06:13.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.742+0000 7f49ecff9640 1 --2- 10.20.193.48:0/2313440493 >> v2:10.20.193.111:6812/977811348 conn(0x7f49c003f7f0 0x7f49c005fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.742+0000 7f49ecff9640 1 -- 10.20.193.48:0/2313440493 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7f49dc052d80 con 0x7f49f005c950 2026-02-12T18:06:13.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.743+0000 7f49ef7fe640 1 --2- 10.20.193.48:0/2313440493 >> v2:10.20.193.111:6812/977811348 conn(0x7f49c003f7f0 0x7f49c005fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.743+0000 7f49ef7fe640 10 monclient: get_auth_request con 0x7f49c003f7f0 auth_method 0 2026-02-12T18:06:13.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.743+0000 7ff406d76640 1 -- 10.20.193.48:0/1281905320 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff4080951a0 msgr2=0x7ff4081daff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:13.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.743+0000 7ff406d76640 1 --2- 10.20.193.48:0/1281905320 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff4080951a0 0x7ff4081daff0 secure :-1 s=READY pgs=42 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3fc004740 tx=0x7ff3fc004770 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:13.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.743+0000 7fd2414d2640 1 -- 10.20.193.48:0/2856865572 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd23c05c950 msgr2=0x7fd23c12c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:13.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.743+0000 7fd2414d2640 1 --2- 10.20.193.48:0/2856865572 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd23c05c950 0x7fd23c12c890 secure :-1 s=READY pgs=43 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd22c0093f0 tx=0x7fd22c00ed50 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:13.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7ff3e77fe640 1 -- 10.20.193.48:0/1281905320 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff3fc035e00 con 0x7ff4080951a0 2026-02-12T18:06:13.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7ff3e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:13.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7ff3e77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7ff3e77fe640 10 monclient: dump: 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7ff3e77fe640 10 monclient: _finish_auth 0 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7ff3e77fe640 10 monclient: _check_auth_tickets 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7ff3e77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7ff40d1c7640 5 monclient: authenticate success, global_id 34222 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7ff40d1c7640 10 monclient: _renew_subs 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7ff40d1c7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7ff40d1c7640 1 -- 10.20.193.48:0/1281905320 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff40819adc0 con 0x7ff4080951a0 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7ff40d1c7640 10 monclient: _renew_subs 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7ff40d1c7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7ff40d1c7640 1 -- 10.20.193.48:0/1281905320 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7ff40819c1d0 con 0x7ff4080951a0 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7fd229ffb640 1 -- 10.20.193.48:0/2856865572 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd22c00cb50 con 0x7fd23c05c950 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7fd229ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7fd229ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7fd229ffb640 10 monclient: dump: 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:13.792 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7fd229ffb640 10 monclient: _finish_auth 0 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7fd229ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7fd229ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7fd229ffb640 1 -- 10.20.193.48:0/2856865572 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd22c00ccd0 con 0x7fd23c05c950 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7fd229ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7fd22b7fe640 4 set_mon_vals no callback set 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7f79d1ffb640 1 -- 10.20.193.48:0/577247846 <== mon.4 v2:10.20.193.48:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f79e00047b0 con 0x7f79e4096ad0 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7f79d1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7f79d1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7ff3e77fe640 1 -- 10.20.193.48:0/1281905320 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3fc004030 con 0x7ff4080951a0 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7ff3e77fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7ff3e77fe640 1 -- 10.20.193.48:0/1281905320 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff3fc0036d0 con 0x7ff4080951a0 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7ff3e77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7ff3e77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7ff3e77fe640 10 monclient: dump: 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:13.793 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.744+0000 7ff405573640 4 set_mon_vals no callback set 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7fd229ffb640 1 -- 10.20.193.48:0/2856865572 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd22c00ce40 con 0x7fd23c05c950 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7fd24375d640 5 monclient: authenticate success, global_id 34231 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7fd24375d640 10 monclient: _renew_subs 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7fd24375d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7fd24375d640 1 -- 10.20.193.48:0/2856865572 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd23c090710 con 0x7fd23c05c950 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7fd229ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7fd229ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7fd229ffb640 10 monclient: dump: 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7fd24375d640 10 monclient: _renew_subs 2026-02-12T18:06:13.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7fd24375d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:13.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7f79e90c9640 1 --2- 10.20.193.48:0/577247846 >> v2:10.20.193.111:6812/977811348 conn(0x7f79b403f800 0x7f79b405fcb0 secure :-1 s=READY pgs=53 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79d4004740 tx=0x7f79d4008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:13.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7fd24375d640 1 -- 10.20.193.48:0/2856865572 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fd23c08aea0 con 0x7fd23c05c950 2026-02-12T18:06:13.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7ff40d1c7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:13.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7ff40d1c7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:13.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7ff40d1c7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:13.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7ff40d1c7640 1 -- 10.20.193.48:0/1281905320 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff40819af90 con 0x7ff4080951a0 2026-02-12T18:06:13.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7f49ecff9640 1 -- 10.20.193.48:0/2313440493 <== mon.0 v2:10.20.193.48:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f49dc013470 con 0x7f49f005c950 2026-02-12T18:06:13.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7f49ecff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:13.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7f49ecff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:13.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7ff3e77fe640 1 -- 10.20.193.48:0/1281905320 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7ff3fc0041a0 con 0x7ff4080951a0 2026-02-12T18:06:13.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7f49ef7fe640 1 --2- 10.20.193.48:0/2313440493 >> v2:10.20.193.111:6812/977811348 conn(0x7f49c003f7f0 0x7f49c005fca0 secure :-1 s=READY pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49e00023d0 tx=0x7f49e0039040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:13.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7fd24375d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:13.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7fd24375d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:13.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7fd24375d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:13.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7fd24375d640 1 -- 10.20.193.48:0/2856865572 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd23c13e550 con 0x7fd23c05c950 2026-02-12T18:06:13.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7ff3e77fe640 1 --2- 10.20.193.48:0/1281905320 >> v2:10.20.193.111:6812/977811348 conn(0x7ff3d403f800 0x7ff3d405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7ff3e77fe640 1 -- 10.20.193.48:0/1281905320 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7ff3fc077e80 con 0x7ff4080951a0 2026-02-12T18:06:13.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7fd229ffb640 1 -- 10.20.193.48:0/2856865572 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fd22c011070 con 0x7fd23c05c950 2026-02-12T18:06:13.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7ff406575640 1 --2- 10.20.193.48:0/1281905320 >> v2:10.20.193.111:6812/977811348 conn(0x7ff3d403f800 0x7ff3d405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.745+0000 7ff406575640 10 monclient: get_auth_request con 0x7ff3d403f800 auth_method 0 2026-02-12T18:06:13.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.746+0000 7fd229ffb640 1 --2- 10.20.193.48:0/2856865572 >> v2:10.20.193.111:6812/977811348 conn(0x7fd20c03f780 0x7fd20c05fc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.746+0000 7fd229ffb640 1 -- 10.20.193.48:0/2856865572 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7fd22c052a80 con 0x7fd23c05c950 2026-02-12T18:06:13.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.746+0000 7fd240cd1640 1 --2- 10.20.193.48:0/2856865572 >> v2:10.20.193.111:6812/977811348 conn(0x7fd20c03f780 0x7fd20c05fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.746+0000 7fd240cd1640 10 monclient: get_auth_request con 0x7fd20c03f780 auth_method 0 2026-02-12T18:06:13.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.748+0000 7ff3e77fe640 1 -- 10.20.193.48:0/1281905320 <== mon.4 v2:10.20.193.48:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7ff3fc037440 con 0x7ff4080951a0 2026-02-12T18:06:13.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.748+0000 7ff3e77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:13.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.748+0000 7ff3e77fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:13.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.748+0000 7ff406575640 1 --2- 10.20.193.48:0/1281905320 >> v2:10.20.193.111:6812/977811348 conn(0x7ff3d403f800 0x7ff3d405fcb0 secure :-1 s=READY pgs=55 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff408091770 tx=0x7ff3f0008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:13.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.748+0000 7fd240cd1640 1 --2- 10.20.193.48:0/2856865572 >> v2:10.20.193.111:6812/977811348 conn(0x7fd20c03f780 0x7fd20c05fc30 secure :-1 s=READY pgs=56 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd230009820 tx=0x7fd230039040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:13.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.750+0000 7fd229ffb640 1 -- 10.20.193.48:0/2856865572 <== mon.4 v2:10.20.193.48:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fd22c0063c0 con 0x7fd23c05c950 2026-02-12T18:06:13.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.750+0000 7fd229ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:13.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.750+0000 7fd229ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:13.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.813+0000 7f1f69de6640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-12T18:06:13.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.813+0000 7f1f69de6640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-12T18:06:13.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.813+0000 7f1f69de6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:13.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.813+0000 7f1f69de6640 1 -- 10.20.193.48:0/1069526243 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1f6419c1b0 con 0x7f1f6419af40 2026-02-12T18:06:13.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.814+0000 7f1f3ffff640 1 -- 10.20.193.48:0/1069526243 <== mon.0 v2:10.20.193.48:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1f5801ccb0 con 0x7f1f6419af40 2026-02-12T18:06:13.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.814+0000 7f1f3ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2026-02-12T18:06:13.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.814+0000 7f1f3ffff640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:13.815 INFO:teuthology.orchestra.run.trial048.stdout:47244640261 2026-02-12T18:06:13.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.815+0000 7f1ee87ed640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-12T18:06:13.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.815+0000 7f1ee87ed640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-12T18:06:13.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.815+0000 7f1ee87ed640 10 monclient: _send_mon_message to mon.i at v2:10.20.193.111:3303/0 2026-02-12T18:06:13.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.815+0000 7f1ee87ed640 1 -- 10.20.193.48:0/2804063001 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f1ee019ae40 con 0x7f1ee0096ad0 2026-02-12T18:06:13.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.815+0000 7f1ec6ffd640 1 -- 10.20.193.48:0/2804063001 <== mon.7 v2:10.20.193.111:3303/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1ee019ae40 con 0x7f1ee0096ad0 2026-02-12T18:06:13.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.815+0000 7f1ec6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2026-02-12T18:06:13.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.815+0000 7f1ec6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:13.816 INFO:teuthology.orchestra.run.trial048.stdout:47244640261 2026-02-12T18:06:13.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.816+0000 7f1f69de6640 1 -- 10.20.193.48:0/1069526243 >> v2:10.20.193.111:6812/977811348 conn(0x7f1f3403f7f0 msgr2=0x7f1f3405fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.816+0000 7f1f69de6640 1 --2- 10.20.193.48:0/1069526243 >> v2:10.20.193.111:6812/977811348 conn(0x7f1f3403f7f0 0x7f1f3405fca0 secure :-1 s=READY pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f500023d0 tx=0x7f1f50039040 comp rx=0 tx=0).stop 2026-02-12T18:06:13.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.816+0000 7f1f69de6640 10 monclient: shutdown 2026-02-12T18:06:13.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.816+0000 7f1f69de6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:13.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.816+0000 7f1f69de6640 1 -- 10.20.193.48:0/1069526243 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1f6419af40 msgr2=0x7f1f64198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.816+0000 7f1f69de6640 1 --2- 10.20.193.48:0/1069526243 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1f6419af40 0x7f1f64198a30 secure :-1 s=READY pgs=68 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1f5800d4b0 tx=0x7f1f5800d980 comp rx=0 tx=0).stop 2026-02-12T18:06:13.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.816+0000 7f1f69de6640 1 -- 10.20.193.48:0/1069526243 shutdown_connections 2026-02-12T18:06:13.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.816+0000 7f1f69de6640 1 --2- 10.20.193.48:0/1069526243 >> v2:10.20.193.111:6812/977811348 conn(0x7f1f3403f7f0 0x7f1f3405fca0 unknown :-1 s=CLOSED pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.816+0000 7f1f69de6640 1 --2- 10.20.193.48:0/1069526243 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1f6419af40 0x7f1f64198a30 unknown :-1 s=CLOSED pgs=68 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.816+0000 7f1f69de6640 1 --2- 10.20.193.48:0/1069526243 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f1f640914d0 0x7f1f641b0da0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.816+0000 7f1f69de6640 1 --2- 10.20.193.48:0/1069526243 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f1f6408e210 0x7f1f641db040 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.816+0000 7f1f69de6640 1 -- 10.20.193.48:0/1069526243 >> 10.20.193.48:0/1069526243 conn(0x7f1f640548a0 msgr2=0x7f1f6408a730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:13.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.816+0000 7f1f69de6640 1 -- 10.20.193.48:0/1069526243 shutdown_connections 2026-02-12T18:06:13.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.816+0000 7f1f69de6640 1 -- 10.20.193.48:0/1069526243 wait complete. 2026-02-12T18:06:13.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.818+0000 7f1ee87ed640 1 -- 10.20.193.48:0/2804063001 >> v2:10.20.193.111:6812/977811348 conn(0x7f1eb003f800 msgr2=0x7f1eb005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.818+0000 7f1ee87ed640 1 --2- 10.20.193.48:0/2804063001 >> v2:10.20.193.111:6812/977811348 conn(0x7f1eb003f800 0x7f1eb005fcb0 secure :-1 s=READY pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ed0004740 tx=0x7f1ed0033000 comp rx=0 tx=0).stop 2026-02-12T18:06:13.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.818+0000 7f1ee87ed640 10 monclient: shutdown 2026-02-12T18:06:13.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.818+0000 7f1ee87ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:13.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.818+0000 7f1ee87ed640 1 -- 10.20.193.48:0/2804063001 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1ee0096ad0 msgr2=0x7f1ee01b0120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.818+0000 7f1ee87ed640 1 --2- 10.20.193.48:0/2804063001 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1ee0096ad0 0x7f1ee01b0120 secure :-1 s=READY pgs=40 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1edc00a340 tx=0x7f1edc00fc80 comp rx=0 tx=0).stop 2026-02-12T18:06:13.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.818+0000 7f1ee87ed640 1 -- 10.20.193.48:0/2804063001 shutdown_connections 2026-02-12T18:06:13.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.818+0000 7f1ee87ed640 1 --2- 10.20.193.48:0/2804063001 >> v2:10.20.193.111:6812/977811348 conn(0x7f1eb003f800 0x7f1eb005fcb0 unknown :-1 s=CLOSED pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.818+0000 7f1ee87ed640 1 --2- 10.20.193.48:0/2804063001 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1ee0096ad0 0x7f1ee01b0120 unknown :-1 s=CLOSED pgs=40 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.818+0000 7f1ee87ed640 1 --2- 10.20.193.48:0/2804063001 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f1ee0095c80 0x7f1ee01afbe0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.818+0000 7f1ee87ed640 1 --2- 10.20.193.48:0/2804063001 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f1ee00951a0 0x7f1ee01db0d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.818+0000 7f1ee87ed640 1 -- 10.20.193.48:0/2804063001 >> 10.20.193.48:0/2804063001 conn(0x7f1ee00548c0 msgr2=0x7f1ee01b0870 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:13.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.818+0000 7f1ee87ed640 1 -- 10.20.193.48:0/2804063001 shutdown_connections 2026-02-12T18:06:13.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.818+0000 7f1ee87ed640 1 -- 10.20.193.48:0/2804063001 wait complete. 2026-02-12T18:06:13.826 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.2 2026-02-12T18:06:13.826 DEBUG:teuthology.parallel:result is None 2026-02-12T18:06:13.826 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.0 2026-02-12T18:06:13.826 DEBUG:teuthology.parallel:result is None 2026-02-12T18:06:13.855 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.855+0000 7f79eb354640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-12T18:06:13.855 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.855+0000 7f79eb354640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-12T18:06:13.855 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.855+0000 7f79eb354640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:13.855 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.855+0000 7f79eb354640 1 -- 10.20.193.48:0/577247846 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f79e4093850 con 0x7f79e4096ad0 2026-02-12T18:06:13.856 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.855+0000 7f79d1ffb640 1 -- 10.20.193.48:0/577247846 <== mon.4 v2:10.20.193.48:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f79e0018020 con 0x7f79e4096ad0 2026-02-12T18:06:13.856 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.855+0000 7f79d1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2026-02-12T18:06:13.856 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.855+0000 7f79d1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:13.856 INFO:teuthology.orchestra.run.trial048.stdout:47244640261 2026-02-12T18:06:13.858 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.857+0000 7f79eb354640 1 -- 10.20.193.48:0/577247846 >> v2:10.20.193.111:6812/977811348 conn(0x7f79b403f800 msgr2=0x7f79b405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.858 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.857+0000 7f79eb354640 1 --2- 10.20.193.48:0/577247846 >> v2:10.20.193.111:6812/977811348 conn(0x7f79b403f800 0x7f79b405fcb0 secure :-1 s=READY pgs=53 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79d4004740 tx=0x7f79d4008040 comp rx=0 tx=0).stop 2026-02-12T18:06:13.858 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.857+0000 7f79eb354640 10 monclient: shutdown 2026-02-12T18:06:13.858 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.857+0000 7f79eb354640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:13.858 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.857+0000 7f79eb354640 1 -- 10.20.193.48:0/577247846 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f79e4096ad0 msgr2=0x7f79e41b1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.858 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.857+0000 7f79eb354640 1 --2- 10.20.193.48:0/577247846 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f79e4096ad0 0x7f79e41b1230 secure :-1 s=READY pgs=41 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f79e000fb60 tx=0x7f79e000d520 comp rx=0 tx=0).stop 2026-02-12T18:06:13.858 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.857+0000 7f79eb354640 1 -- 10.20.193.48:0/577247846 shutdown_connections 2026-02-12T18:06:13.859 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.857+0000 7f79eb354640 1 --2- 10.20.193.48:0/577247846 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f79e4096ad0 0x7f79e41b1230 unknown :-1 s=CLOSED pgs=41 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.859 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.857+0000 7f79eb354640 1 --2- 10.20.193.48:0/577247846 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f79e4095ab0 0x7f79e41b0cf0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.859 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.857+0000 7f79eb354640 1 --2- 10.20.193.48:0/577247846 >> v2:10.20.193.111:6812/977811348 conn(0x7f79b403f800 0x7f79b405fcb0 unknown :-1 s=CLOSED pgs=53 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.859 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.857+0000 7f79eb354640 1 --2- 10.20.193.48:0/577247846 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f79e40951a0 0x7f79e41dafb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.859 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.857+0000 7f79eb354640 1 -- 10.20.193.48:0/577247846 >> 10.20.193.48:0/577247846 conn(0x7f79e40548c0 msgr2=0x7f79e408f680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:13.859 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.857+0000 7f79eb354640 1 -- 10.20.193.48:0/577247846 shutdown_connections 2026-02-12T18:06:13.859 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.857+0000 7f79eb354640 1 -- 10.20.193.48:0/577247846 wait complete. 2026-02-12T18:06:13.859 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.857+0000 7f49f690c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-12T18:06:13.859 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.857+0000 7f49f690c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-12T18:06:13.859 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.857+0000 7f49f690c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:13.859 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.857+0000 7f49f690c640 1 -- 10.20.193.48:0/2313440493 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f49f0143d20 con 0x7f49f005c950 2026-02-12T18:06:13.860 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.858+0000 7f49ecff9640 1 -- 10.20.193.48:0/2313440493 <== mon.0 v2:10.20.193.48:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f49dc017090 con 0x7f49f005c950 2026-02-12T18:06:13.860 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.858+0000 7f49ecff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2026-02-12T18:06:13.860 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.858+0000 7f49ecff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:13.860 INFO:teuthology.orchestra.run.trial048.stdout:51539607555 2026-02-12T18:06:13.860 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.859+0000 7ff40d1c7640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-12T18:06:13.860 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.859+0000 7ff40d1c7640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-12T18:06:13.860 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.859+0000 7ff40d1c7640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:13.861 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.859+0000 7ff40d1c7640 1 -- 10.20.193.48:0/1281905320 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7ff40808d020 con 0x7ff4080951a0 2026-02-12T18:06:13.861 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.859+0000 7ff3e77fe640 1 -- 10.20.193.48:0/1281905320 <== mon.4 v2:10.20.193.48:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff3fc03c030 con 0x7ff4080951a0 2026-02-12T18:06:13.861 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.859+0000 7ff3e77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2026-02-12T18:06:13.861 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.859+0000 7ff3e77fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:13.861 INFO:teuthology.orchestra.run.trial048.stdout:47244640259 2026-02-12T18:06:13.862 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.860+0000 7f49f690c640 1 -- 10.20.193.48:0/2313440493 >> v2:10.20.193.111:6812/977811348 conn(0x7f49c003f7f0 msgr2=0x7f49c005fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.862 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.860+0000 7f49f690c640 1 --2- 10.20.193.48:0/2313440493 >> v2:10.20.193.111:6812/977811348 conn(0x7f49c003f7f0 0x7f49c005fca0 secure :-1 s=READY pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49e00023d0 tx=0x7f49e0039040 comp rx=0 tx=0).stop 2026-02-12T18:06:13.862 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.860+0000 7f49f690c640 10 monclient: shutdown 2026-02-12T18:06:13.862 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.860+0000 7f49f690c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:13.862 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.860+0000 7f49f690c640 1 -- 10.20.193.48:0/2313440493 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49f005c950 msgr2=0x7f49f01db6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.862 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.860+0000 7f49f690c640 1 --2- 10.20.193.48:0/2313440493 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49f005c950 0x7f49f01db6a0 secure :-1 s=READY pgs=71 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f49dc0094c0 tx=0x7f49dc00ee20 comp rx=0 tx=0).stop 2026-02-12T18:06:13.862 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.860+0000 7f49f690c640 1 -- 10.20.193.48:0/2313440493 shutdown_connections 2026-02-12T18:06:13.862 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.860+0000 7f49f690c640 1 --2- 10.20.193.48:0/2313440493 >> v2:10.20.193.111:6812/977811348 conn(0x7f49c003f7f0 0x7f49c005fca0 unknown :-1 s=CLOSED pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.862 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.860+0000 7f49f690c640 1 --2- 10.20.193.48:0/2313440493 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f49f013db70 0x7f49f008aad0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.862 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.860+0000 7f49f690c640 1 --2- 10.20.193.48:0/2313440493 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49f005e490 0x7f49f01dbbe0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.862 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.860+0000 7f49f690c640 1 --2- 10.20.193.48:0/2313440493 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49f005c950 0x7f49f01db6a0 unknown :-1 s=CLOSED pgs=71 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.862 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.860+0000 7f49f690c640 1 -- 10.20.193.48:0/2313440493 >> 10.20.193.48:0/2313440493 conn(0x7f49f00548a0 msgr2=0x7f49f0141540 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:13.862 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.860+0000 7f49f690c640 1 -- 10.20.193.48:0/2313440493 shutdown_connections 2026-02-12T18:06:13.863 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.860+0000 7f49f690c640 1 -- 10.20.193.48:0/2313440493 wait complete. 2026-02-12T18:06:13.863 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.862+0000 7ff40d1c7640 1 -- 10.20.193.48:0/1281905320 >> v2:10.20.193.111:6812/977811348 conn(0x7ff3d403f800 msgr2=0x7ff3d405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.863 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.862+0000 7ff40d1c7640 1 --2- 10.20.193.48:0/1281905320 >> v2:10.20.193.111:6812/977811348 conn(0x7ff3d403f800 0x7ff3d405fcb0 secure :-1 s=READY pgs=55 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff408091770 tx=0x7ff3f0008040 comp rx=0 tx=0).stop 2026-02-12T18:06:13.863 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.862+0000 7ff40d1c7640 10 monclient: shutdown 2026-02-12T18:06:13.864 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.862+0000 7ff40d1c7640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:13.864 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.862+0000 7ff40d1c7640 1 -- 10.20.193.48:0/1281905320 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff4080951a0 msgr2=0x7ff4081daff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.864 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.862+0000 7ff40d1c7640 1 --2- 10.20.193.48:0/1281905320 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff4080951a0 0x7ff4081daff0 secure :-1 s=READY pgs=42 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff3fc004740 tx=0x7ff3fc004770 comp rx=0 tx=0).stop 2026-02-12T18:06:13.864 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.862+0000 7ff40d1c7640 1 -- 10.20.193.48:0/1281905320 shutdown_connections 2026-02-12T18:06:13.864 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.862+0000 7ff40d1c7640 1 --2- 10.20.193.48:0/1281905320 >> v2:10.20.193.111:6812/977811348 conn(0x7ff3d403f800 0x7ff3d405fcb0 unknown :-1 s=CLOSED pgs=55 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.864 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.862+0000 7ff40d1c7640 1 --2- 10.20.193.48:0/1281905320 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff408096ad0 0x7ff408198b60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.864 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.862+0000 7ff40d1c7640 1 --2- 10.20.193.48:0/1281905320 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff408095ab0 0x7ff4081b0dd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.864 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.862+0000 7ff40d1c7640 1 --2- 10.20.193.48:0/1281905320 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff4080951a0 0x7ff4081daff0 unknown :-1 s=CLOSED pgs=42 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.864 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.862+0000 7ff40d1c7640 1 -- 10.20.193.48:0/1281905320 >> 10.20.193.48:0/1281905320 conn(0x7ff4080548c0 msgr2=0x7ff40808f5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:13.864 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.862+0000 7ff40d1c7640 1 -- 10.20.193.48:0/1281905320 shutdown_connections 2026-02-12T18:06:13.864 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.862+0000 7ff40d1c7640 1 -- 10.20.193.48:0/1281905320 wait complete. 2026-02-12T18:06:13.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.862+0000 7fd24375d640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-12T18:06:13.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.862+0000 7fd24375d640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-12T18:06:13.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.862+0000 7fd24375d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:13.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.862+0000 7fd24375d640 1 -- 10.20.193.48:0/2856865572 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd23c05cd20 con 0x7fd23c05c950 2026-02-12T18:06:13.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.862+0000 7fd229ffb640 1 -- 10.20.193.48:0/2856865572 <== mon.4 v2:10.20.193.48:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd22c021090 con 0x7fd23c05c950 2026-02-12T18:06:13.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.862+0000 7fd229ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2026-02-12T18:06:13.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.862+0000 7fd229ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:13.865 INFO:teuthology.orchestra.run.trial048.stdout:47244640259 2026-02-12T18:06:13.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.865+0000 7fd24375d640 1 -- 10.20.193.48:0/2856865572 >> v2:10.20.193.111:6812/977811348 conn(0x7fd20c03f780 msgr2=0x7fd20c05fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.865+0000 7fd24375d640 1 --2- 10.20.193.48:0/2856865572 >> v2:10.20.193.111:6812/977811348 conn(0x7fd20c03f780 0x7fd20c05fc30 secure :-1 s=READY pgs=56 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd230009820 tx=0x7fd230039040 comp rx=0 tx=0).stop 2026-02-12T18:06:13.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.865+0000 7fd24375d640 10 monclient: shutdown 2026-02-12T18:06:13.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.865+0000 7fd24375d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:13.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.865+0000 7fd24375d640 1 -- 10.20.193.48:0/2856865572 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd23c05c950 msgr2=0x7fd23c12c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.865+0000 7fd24375d640 1 --2- 10.20.193.48:0/2856865572 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd23c05c950 0x7fd23c12c890 secure :-1 s=READY pgs=43 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd22c0093f0 tx=0x7fd22c00ed50 comp rx=0 tx=0).stop 2026-02-12T18:06:13.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.865+0000 7fd24375d640 1 -- 10.20.193.48:0/2856865572 shutdown_connections 2026-02-12T18:06:13.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.865+0000 7fd24375d640 1 --2- 10.20.193.48:0/2856865572 >> v2:10.20.193.111:6812/977811348 conn(0x7fd20c03f780 0x7fd20c05fc30 unknown :-1 s=CLOSED pgs=56 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.865+0000 7fd24375d640 1 --2- 10.20.193.48:0/2856865572 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd23c13db70 0x7fd23c08d820 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.865+0000 7fd24375d640 1 --2- 10.20.193.48:0/2856865572 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd23c05e490 0x7fd23c08d2e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.865+0000 7fd24375d640 1 --2- 10.20.193.48:0/2856865572 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd23c05c950 0x7fd23c12c890 unknown :-1 s=CLOSED pgs=43 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.865+0000 7fd24375d640 1 -- 10.20.193.48:0/2856865572 >> 10.20.193.48:0/2856865572 conn(0x7fd23c0548a0 msgr2=0x7fd23c093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:13.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.865+0000 7fd24375d640 1 -- 10.20.193.48:0/2856865572 shutdown_connections 2026-02-12T18:06:13.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.865+0000 7fd24375d640 1 -- 10.20.193.48:0/2856865572 wait complete. 2026-02-12T18:06:13.867 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640261 for osd.1 2026-02-12T18:06:13.868 DEBUG:teuthology.parallel:result is None 2026-02-12T18:06:13.871 INFO:tasks.ceph.ceph_manager.ceph:need seq 51539607555 got 51539607555 for osd.3 2026-02-12T18:06:13.872 DEBUG:teuthology.parallel:result is None 2026-02-12T18:06:13.872 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.4 2026-02-12T18:06:13.872 DEBUG:teuthology.parallel:result is None 2026-02-12T18:06:13.873 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.5 2026-02-12T18:06:13.873 DEBUG:teuthology.parallel:result is None 2026-02-12T18:06:13.874 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-12T18:06:13.874 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T18:06:13.978 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.977+0000 7f6310fae640 10 monclient: get_monmap_and_config 2026-02-12T18:06:13.978 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.977+0000 7f6310fae640 10 monclient: build_initial_monmap 2026-02-12T18:06:13.978 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.977+0000 7f6310fae640 10 monclient: monmap: 2026-02-12T18:06:13.979 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:13.979 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.979 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:13.978870+0000 2026-02-12T18:06:13.979 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:13.978870+0000 2026-02-12T18:06:13.979 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:13.979 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.979 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:13.979 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:13.979 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:13.979 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:13.979 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:13.979 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:13.980 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:13.980 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:13.980 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:13.980 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:13.980 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:13.980 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6310fae640 1 Processor -- start 2026-02-12T18:06:13.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6310fae640 1 -- start start 2026-02-12T18:06:13.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6310fae640 10 monclient: init 2026-02-12T18:06:13.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6310fae640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:13.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6310fae640 10 monclient: _add_conns ranks=[5,4,7,8,3,9,2,10,6,1,0] 2026-02-12T18:06:13.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6310fae640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f630c05dc20 0x7f630c144660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6310fae640 10 monclient(hunting): picked mon.noname-h con 0x7f630c05dc20 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:13.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6310fae640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f630c05dff0 0x7f630c05e3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6310fae640 10 monclient(hunting): picked mon.noname-c con 0x7f630c05dff0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:06:13.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6310fae640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f630c089df0 0x7f630c08a240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:13.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6310fae640 10 monclient(hunting): picked mon.noname-i con 0x7f630c089df0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:13.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6310fae640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6310fae640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f630c093a30 con 0x7f630c05dff0 2026-02-12T18:06:13.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6310fae640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6310fae640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f630c092200 con 0x7f630c05dc20 2026-02-12T18:06:13.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6310fae640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:13.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6310fae640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f630c08b250 con 0x7f630c089df0 2026-02-12T18:06:13.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6310fae640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:13.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6310fae640 10 monclient(hunting): authenticate will time out at 612.704633s 2026-02-12T18:06:13.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6309d74640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f630c05dff0 0x7f630c05e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6309d74640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f630c05dff0 0x7f630c05e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:52814/0 (socket says 10.20.193.48:52814) 2026-02-12T18:06:13.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6309d74640 1 -- 10.20.193.48:0/2003462625 learned_addr learned my addr 10.20.193.48:0/2003462625 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:13.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6309d74640 10 monclient(hunting): get_auth_request con 0x7f630c05dff0 auth_method 0 2026-02-12T18:06:13.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6309d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6309d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6309d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f630a575640 1 --2- 10.20.193.48:0/2003462625 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f630c05dc20 0x7f630c144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f630ad76640 1 --2- 10.20.193.48:0/2003462625 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f630c089df0 0x7f630c08a240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:13.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f630a575640 10 monclient(hunting): get_auth_request con 0x7f630c05dc20 auth_method 0 2026-02-12T18:06:13.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f630a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f630a575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f630a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f630ad76640 10 monclient(hunting): get_auth_request con 0x7f630c089df0 auth_method 0 2026-02-12T18:06:13.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f630ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:13.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f630ad76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:13.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f630ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:13.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6309d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:13.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6309d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:13.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f6309d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:13.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f630ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:13.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f630ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:13.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f630ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:13.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f630a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:13.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f630a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:13.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.978+0000 7f630a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:13.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.979+0000 7f6309d74640 10 monclient(hunting): handle_auth_done global_id 34240 payload 274 2026-02-12T18:06:13.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.979+0000 7f6309d74640 1 -- 10.20.193.48:0/2003462625 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f630c089df0 msgr2=0x7f630c08a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:13.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.979+0000 7f6309d74640 1 --2- 10.20.193.48:0/2003462625 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f630c089df0 0x7f630c08a240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.979+0000 7f6309d74640 1 -- 10.20.193.48:0/2003462625 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f630c05dc20 msgr2=0x7f630c144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:13.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.979+0000 7f6309d74640 1 --2- 10.20.193.48:0/2003462625 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f630c05dc20 0x7f630c144660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.979+0000 7f6309d74640 10 monclient: _finish_hunting 0 2026-02-12T18:06:13.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.979+0000 7f6309d74640 1 monclient: found mon.noname-c 2026-02-12T18:06:13.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.979+0000 7f6309d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:13.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.979+0000 7f6309d74640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:06:13.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.979+0000 7f6309d74640 1 -- 10.20.193.48:0/2003462625 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f630c060390 con 0x7f630c05dff0 2026-02-12T18:06:13.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.981+0000 7f6309d74640 1 -- 10.20.193.48:0/2003462625 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f630c05dff0 msgr2=0x7f630c05e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:13.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.981+0000 7f6309d74640 1 --2- 10.20.193.48:0/2003462625 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f630c05dff0 0x7f630c05e3c0 secure :-1 s=READY pgs=44 gs=1 cs=0 l=1 c_cookie=11974843944216938397 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62f4009900 tx=0x7f62f402ee90 comp rx=0 tx=0).ready entity=mon.4 client_cookie=a62f311f2fc9c79d server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:13.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.981+0000 7f6309573640 1 -- 10.20.193.48:0/2003462625 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f62f4035340 con 0x7f630c05dff0 2026-02-12T18:06:13.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.981+0000 7f6309573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:13.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.981+0000 7f6309573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:06:13.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.981+0000 7f6309573640 10 monclient: dump: 2026-02-12T18:06:13.994 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:13.994 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.994 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.994 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.994 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:13.995 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.995 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:13.995 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:13.995 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:13.995 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:13.995 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:13.995 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:13.995 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:13.995 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:13.995 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:13.995 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.981+0000 7f6309573640 10 monclient: _finish_auth 0 2026-02-12T18:06:13.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.981+0000 7f6309573640 10 monclient: _check_auth_tickets 2026-02-12T18:06:13.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.981+0000 7f6309573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:13.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.981+0000 7f6309573640 1 -- 10.20.193.48:0/2003462625 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62f40354c0 con 0x7f630c05dff0 2026-02-12T18:06:13.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.981+0000 7f6309573640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:13.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.981+0000 7f6310fae640 5 monclient: authenticate success, global_id 34240 2026-02-12T18:06:13.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.981+0000 7f6309573640 1 -- 10.20.193.48:0/2003462625 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f62f4035af0 con 0x7f630c05dff0 2026-02-12T18:06:13.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.981+0000 7f6310fae640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:13.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.981+0000 7f6310fae640 4 set_mon_vals no callback set 2026-02-12T18:06:13.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.981+0000 7f6309573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:13.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.981+0000 7f6309573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:06:13.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.981+0000 7f6309573640 10 monclient: dump: 2026-02-12T18:06:13.996 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:13.996 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:13.997 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.997 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:13.997 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:13.997 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.997 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:13.997 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:13.997 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:13.997 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:13.997 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:13.997 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:13.997 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:13.997 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:13.998 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:13.998 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:13.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.982+0000 7f6310fae640 10 monclient: shutdown 2026-02-12T18:06:13.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.982+0000 7f6310fae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:13.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.982+0000 7f6310fae640 1 -- 10.20.193.48:0/2003462625 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f630c05dff0 msgr2=0x7f630c05e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:13.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.982+0000 7f6310fae640 1 --2- 10.20.193.48:0/2003462625 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f630c05dff0 0x7f630c05e3c0 secure :-1 s=READY pgs=44 gs=1 cs=0 l=1 c_cookie=11974843944216938397 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62f4009900 tx=0x7f62f402ee90 comp rx=0 tx=0).stop 2026-02-12T18:06:13.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.982+0000 7f6310fae640 1 -- 10.20.193.48:0/2003462625 shutdown_connections 2026-02-12T18:06:13.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.982+0000 7f6310fae640 1 --2- 10.20.193.48:0/2003462625 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f630c089df0 0x7f630c08a240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.982+0000 7f6310fae640 1 --2- 10.20.193.48:0/2003462625 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f630c05dff0 0x7f630c05e3c0 unknown :-1 s=CLOSED pgs=44 gs=1 cs=0 l=1 c_cookie=11974843944216938397 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.982+0000 7f6310fae640 1 --2- 10.20.193.48:0/2003462625 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f630c05dc20 0x7f630c144660 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:13.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.982+0000 7f6310fae640 1 -- 10.20.193.48:0/2003462625 >> 10.20.193.48:0/2003462625 conn(0x7f630c0546d0 msgr2=0x7f630c054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:13.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.982+0000 7f6310fae640 1 -- 10.20.193.48:0/2003462625 shutdown_connections 2026-02-12T18:06:13.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.982+0000 7f6310fae640 1 -- 10.20.193.48:0/2003462625 wait complete. 2026-02-12T18:06:13.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.982+0000 7f6310fae640 10 monclient: build_initial_monmap 2026-02-12T18:06:13.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.982+0000 7f6310fae640 10 monclient: monmap: 2026-02-12T18:06:13.999 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:13.999 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:13.999 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:13.999 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:13.999 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:13.999 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:13.999 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:13.999 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:13.999 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:13.999 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:14.000 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:14.000 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:14.000 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:14.000 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:14.000 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:14.000 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.982+0000 7f6310fae640 1 Processor -- start 2026-02-12T18:06:14.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.982+0000 7f6310fae640 1 -- start start 2026-02-12T18:06:14.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.982+0000 7f6310fae640 10 monclient: init 2026-02-12T18:06:14.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6310fae640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:14.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6310fae640 10 monclient: _add_conns ranks=[8,0,5,7,2,4,6,3,1] 2026-02-12T18:06:14.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6310fae640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f630c05dc20 0x7f630c10db60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6310fae640 10 monclient(hunting): picked mon.noname-e con 0x7f630c05dc20 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:14.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6310fae640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f630c05dff0 0x7f630c10e0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6310fae640 10 monclient(hunting): picked mon.noname-a con 0x7f630c05dff0 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:06:14.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6310fae640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f630c089df0 0x7f630c10e5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6310fae640 10 monclient(hunting): picked mon.noname-h con 0x7f630c089df0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:14.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6310fae640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6310fae640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f630c10f0a0 con 0x7f630c05dff0 2026-02-12T18:06:14.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6310fae640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6310fae640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f630c1237e0 con 0x7f630c089df0 2026-02-12T18:06:14.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6310fae640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6310fae640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f630c1105c0 con 0x7f630c05dc20 2026-02-12T18:06:14.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6310fae640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:14.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6310fae640 10 monclient(hunting): authenticate will time out at 612.709123s 2026-02-12T18:06:14.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6309d74640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f630c05dff0 0x7f630c10e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f630a575640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f630c05dc20 0x7f630c10db60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6309d74640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f630c05dff0 0x7f630c10e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:44512/0 (socket says 10.20.193.48:44512) 2026-02-12T18:06:14.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6309d74640 1 -- 10.20.193.48:0/1626979549 learned_addr learned my addr 10.20.193.48:0/1626979549 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:14.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6309d74640 10 monclient(hunting): get_auth_request con 0x7f630c05dff0 auth_method 0 2026-02-12T18:06:14.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6309d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6309d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6309d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f630a575640 10 monclient(hunting): get_auth_request con 0x7f630c05dc20 auth_method 0 2026-02-12T18:06:14.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f630a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f630a575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f630a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6309d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:14.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6309d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:14.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6309d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:14.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f630ad76640 1 --2- 10.20.193.48:0/1626979549 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f630c089df0 0x7f630c10e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f630ad76640 10 monclient(hunting): get_auth_request con 0x7f630c089df0 auth_method 0 2026-02-12T18:06:14.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f630ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f630ad76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f630ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f630a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:14.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f630a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:14.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f630a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:14.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6309d74640 10 monclient(hunting): handle_auth_done global_id 4410 payload 824 2026-02-12T18:06:14.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6309d74640 1 -- 10.20.193.48:0/1626979549 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f630c05dc20 msgr2=0x7f630c10db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:14.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6309d74640 1 --2- 10.20.193.48:0/1626979549 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f630c05dc20 0x7f630c10db60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6309d74640 1 -- 10.20.193.48:0/1626979549 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f630c089df0 msgr2=0x7f630c10e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:14.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6309d74640 1 --2- 10.20.193.48:0/1626979549 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f630c089df0 0x7f630c10e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6309d74640 10 monclient: _finish_hunting 0 2026-02-12T18:06:14.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6309d74640 1 monclient: found mon.noname-a 2026-02-12T18:06:14.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6309d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:14.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6309d74640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:06:14.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f6309d74640 1 -- 10.20.193.48:0/1626979549 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62f40094f0 con 0x7f630c05dff0 2026-02-12T18:06:14.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.983+0000 7f630ad76640 1 --2- 10.20.193.48:0/1626979549 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f630c089df0 0x7f630c10e5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:06:14.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.985+0000 7f6309d74640 1 -- 10.20.193.48:0/1626979549 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f630c05dff0 msgr2=0x7f630c10e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:14.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.985+0000 7f6309d74640 1 --2- 10.20.193.48:0/1626979549 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f630c05dff0 0x7f630c10e0a0 secure :-1 s=READY pgs=72 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62f4009a30 tx=0x7f62f4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:14.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.985+0000 7f62f2ffd640 1 -- 10.20.193.48:0/1626979549 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f62f4035340 con 0x7f630c05dff0 2026-02-12T18:06:14.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.985+0000 7f62f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:14.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.985+0000 7f62f2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:06:14.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.985+0000 7f62f2ffd640 10 monclient: dump: 2026-02-12T18:06:14.005 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:14.005 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:14.005 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.005 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.005 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:14.005 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.005 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:14.005 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:14.006 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:14.006 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:14.006 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:14.006 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:14.006 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:14.006 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:14.006 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:14.006 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.985+0000 7f62f2ffd640 10 monclient: _finish_auth 0 2026-02-12T18:06:14.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.985+0000 7f62f2ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:06:14.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.985+0000 7f62f2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:14.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.985+0000 7f62f2ffd640 1 -- 10.20.193.48:0/1626979549 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62f4035a50 con 0x7f630c05dff0 2026-02-12T18:06:14.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.985+0000 7f6310fae640 5 monclient: authenticate success, global_id 4410 2026-02-12T18:06:14.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.985+0000 7f6310fae640 10 monclient: _renew_subs 2026-02-12T18:06:14.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.985+0000 7f6310fae640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:14.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.985+0000 7f6310fae640 1 -- 10.20.193.48:0/1626979549 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f630c1108a0 con 0x7f630c05dff0 2026-02-12T18:06:14.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.985+0000 7f62f2ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:14.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.985+0000 7f62f2ffd640 1 -- 10.20.193.48:0/1626979549 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f62f4004500 con 0x7f630c05dff0 2026-02-12T18:06:14.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.985+0000 7f62f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:14.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.985+0000 7f62f2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:14.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.985+0000 7f6308d72640 4 set_mon_vals no callback set 2026-02-12T18:06:14.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.985+0000 7f62f2ffd640 10 monclient: dump: 2026-02-12T18:06:14.007 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:14.008 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:14.008 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.008 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.008 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:14.008 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.008 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:14.008 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:14.008 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:14.008 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:14.008 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:14.008 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:14.009 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:14.009 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:14.009 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:14.009 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.985+0000 7f6310fae640 10 monclient: _renew_subs 2026-02-12T18:06:14.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.985+0000 7f6310fae640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:14.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.985+0000 7f6310fae640 1 -- 10.20.193.48:0/1626979549 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f630c142310 con 0x7f630c05dff0 2026-02-12T18:06:14.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.986+0000 7f6310fae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:14.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.986+0000 7f6310fae640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:14.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.986+0000 7f6310fae640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:14.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.986+0000 7f6310fae640 1 -- 10.20.193.48:0/1626979549 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f630c092510 con 0x7f630c05dff0 2026-02-12T18:06:14.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.986+0000 7f62f2ffd640 1 -- 10.20.193.48:0/1626979549 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f62f4004040 con 0x7f630c05dff0 2026-02-12T18:06:14.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.986+0000 7f62f2ffd640 1 --2- 10.20.193.48:0/1626979549 >> v2:10.20.193.111:6812/977811348 conn(0x7f62d803f800 0x7f62d805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.986+0000 7f62f2ffd640 1 -- 10.20.193.48:0/1626979549 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7f62f4077f10 con 0x7f630c05dff0 2026-02-12T18:06:14.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.986+0000 7f630a575640 1 --2- 10.20.193.48:0/1626979549 >> v2:10.20.193.111:6812/977811348 conn(0x7f62d803f800 0x7f62d805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.986+0000 7f630a575640 10 monclient: get_auth_request con 0x7f62d803f800 auth_method 0 2026-02-12T18:06:14.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.989+0000 7f62f2ffd640 1 -- 10.20.193.48:0/1626979549 <== mon.0 v2:10.20.193.48:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f62f404bdf0 con 0x7f630c05dff0 2026-02-12T18:06:14.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.989+0000 7f62f2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:14.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.989+0000 7f62f2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:14.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:13.989+0000 7f630a575640 1 --2- 10.20.193.48:0/1626979549 >> v2:10.20.193.111:6812/977811348 conn(0x7f62d803f800 0x7f62d805fcb0 secure :-1 s=READY pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6300004740 tx=0x7f6300009210 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:14.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.090+0000 7f6310fae640 1 -- 10.20.193.48:0/1626979549 --> v2:10.20.193.111:6812/977811348 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f630c094a90 con 0x7f62d803f800 2026-02-12T18:06:14.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.091+0000 7f62f2ffd640 1 -- 10.20.193.48:0/1626979549 <== mgr.4123 v2:10.20.193.111:6812/977811348 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34123 (secure 0 0 0) 0x7f6300011e40 con 0x7f62d803f800 2026-02-12T18:06:14.092 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:06:14.093 INFO:teuthology.orchestra.run.trial048.stderr:dumped all 2026-02-12T18:06:14.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.092+0000 7f6310fae640 1 -- 10.20.193.48:0/1626979549 >> v2:10.20.193.111:6812/977811348 conn(0x7f62d803f800 msgr2=0x7f62d805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:14.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.092+0000 7f6310fae640 1 --2- 10.20.193.48:0/1626979549 >> v2:10.20.193.111:6812/977811348 conn(0x7f62d803f800 0x7f62d805fcb0 secure :-1 s=READY pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6300004740 tx=0x7f6300009210 comp rx=0 tx=0).stop 2026-02-12T18:06:14.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.092+0000 7f6310fae640 10 monclient: shutdown 2026-02-12T18:06:14.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.092+0000 7f6310fae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:14.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.092+0000 7f6310fae640 1 -- 10.20.193.48:0/1626979549 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f630c05dff0 msgr2=0x7f630c10e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:14.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.092+0000 7f6310fae640 1 --2- 10.20.193.48:0/1626979549 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f630c05dff0 0x7f630c10e0a0 secure :-1 s=READY pgs=72 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f62f4009a30 tx=0x7f62f4004770 comp rx=0 tx=0).stop 2026-02-12T18:06:14.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.092+0000 7f6310fae640 1 -- 10.20.193.48:0/1626979549 shutdown_connections 2026-02-12T18:06:14.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.092+0000 7f6310fae640 1 --2- 10.20.193.48:0/1626979549 >> v2:10.20.193.111:6812/977811348 conn(0x7f62d803f800 0x7f62d805fcb0 unknown :-1 s=CLOSED pgs=57 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.092+0000 7f6310fae640 1 --2- 10.20.193.48:0/1626979549 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f630c089df0 0x7f630c10e5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.092+0000 7f6310fae640 1 --2- 10.20.193.48:0/1626979549 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f630c05dff0 0x7f630c10e0a0 unknown :-1 s=CLOSED pgs=72 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.092+0000 7f6310fae640 1 --2- 10.20.193.48:0/1626979549 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f630c05dc20 0x7f630c10db60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.092+0000 7f6310fae640 1 -- 10.20.193.48:0/1626979549 >> 10.20.193.48:0/1626979549 conn(0x7f630c0546d0 msgr2=0x7f630c05cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:14.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.092+0000 7f6310fae640 1 -- 10.20.193.48:0/1626979549 shutdown_connections 2026-02-12T18:06:14.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.092+0000 7f6310fae640 1 -- 10.20.193.48:0/1626979549 wait complete. 2026-02-12T18:06:14.100 INFO:teuthology.orchestra.run.trial048.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2026-02-12T18:06:12.386788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163840,"kb_used_data":2080,"kb_used_omap":50,"kb_used_meta":161613,"kb_avail":566067200,"statfs":{"total":579820584960,"available":579652812800,"internally_reserved":0,"allocated":2129920,"data_stored":1478686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":51998,"internal_metadata":165491938},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.107332"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.383670+0000","last_change":"2026-02-12T18:06:11.383740+0000","last_active":"2026-02-12T18:06:11.383670+0000","last_peered":"2026-02-12T18:06:11.383670+0000","last_clean":"2026-02-12T18:06:11.383670+0000","last_became_active":"2026-02-12T18:06:09.281532+0000","last_became_peered":"2026-02-12T18:06:09.281532+0000","last_unstale":"2026-02-12T18:06:11.383670+0000","last_undegraded":"2026-02-12T18:06:11.383670+0000","last_fullsized":"2026-02-12T18:06:11.383670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T20:34:57.876774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027561099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.384892+0000","last_change":"2026-02-12T18:06:11.384892+0000","last_active":"2026-02-12T18:06:11.384892+0000","last_peered":"2026-02-12T18:06:11.384892+0000","last_clean":"2026-02-12T18:06:11.384892+0000","last_became_active":"2026-02-12T18:06:09.283689+0000","last_became_peered":"2026-02-12T18:06:09.283689+0000","last_unstale":"2026-02-12T18:06:11.384892+0000","last_undegraded":"2026-02-12T18:06:11.384892+0000","last_fullsized":"2026-02-12T18:06:11.384892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T00:04:55.700663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046734100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.383588+0000","last_change":"2026-02-12T18:06:11.383662+0000","last_active":"2026-02-12T18:06:11.383588+0000","last_peered":"2026-02-12T18:06:11.383588+0000","last_clean":"2026-02-12T18:06:11.383588+0000","last_became_active":"2026-02-12T18:06:09.281461+0000","last_became_peered":"2026-02-12T18:06:09.281461+0000","last_unstale":"2026-02-12T18:06:11.383588+0000","last_undegraded":"2026-02-12T18:06:11.383588+0000","last_fullsized":"2026-02-12T18:06:11.383588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T21:13:23.141921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00019704400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.384936+0000","last_change":"2026-02-12T18:06:11.384936+0000","last_active":"2026-02-12T18:06:11.384936+0000","last_peered":"2026-02-12T18:06:11.384936+0000","last_clean":"2026-02-12T18:06:11.384936+0000","last_became_active":"2026-02-12T18:06:09.283688+0000","last_became_peered":"2026-02-12T18:06:09.283688+0000","last_unstale":"2026-02-12T18:06:11.384936+0000","last_undegraded":"2026-02-12T18:06:11.384936+0000","last_fullsized":"2026-02-12T18:06:11.384936+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:54:04.914482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047092800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.387972+0000","last_change":"2026-02-12T18:06:11.387479+0000","last_active":"2026-02-12T18:06:11.387972+0000","last_peered":"2026-02-12T18:06:11.387972+0000","last_clean":"2026-02-12T18:06:11.387972+0000","last_became_active":"2026-02-12T18:06:09.283881+0000","last_became_peered":"2026-02-12T18:06:09.283881+0000","last_unstale":"2026-02-12T18:06:11.387972+0000","last_undegraded":"2026-02-12T18:06:11.387972+0000","last_fullsized":"2026-02-12T18:06:11.387972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:14:28.203244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045409299999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.384057+0000","last_change":"2026-02-12T18:06:11.384057+0000","last_active":"2026-02-12T18:06:11.384057+0000","last_peered":"2026-02-12T18:06:11.384057+0000","last_clean":"2026-02-12T18:06:11.384057+0000","last_became_active":"2026-02-12T18:06:09.284036+0000","last_became_peered":"2026-02-12T18:06:09.284036+0000","last_unstale":"2026-02-12T18:06:11.384057+0000","last_undegraded":"2026-02-12T18:06:11.384057+0000","last_fullsized":"2026-02-12T18:06:11.384057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:15:47.166182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028640700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.383576+0000","last_change":"2026-02-12T18:06:11.383648+0000","last_active":"2026-02-12T18:06:11.383576+0000","last_peered":"2026-02-12T18:06:11.383576+0000","last_clean":"2026-02-12T18:06:11.383576+0000","last_became_active":"2026-02-12T18:06:09.283797+0000","last_became_peered":"2026-02-12T18:06:09.283797+0000","last_unstale":"2026-02-12T18:06:11.383576+0000","last_undegraded":"2026-02-12T18:06:11.383576+0000","last_fullsized":"2026-02-12T18:06:11.383576+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:51:24.172618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018461199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.387248+0000","last_change":"2026-02-12T18:06:11.387248+0000","last_active":"2026-02-12T18:06:11.387248+0000","last_peered":"2026-02-12T18:06:11.387248+0000","last_clean":"2026-02-12T18:06:11.387248+0000","last_became_active":"2026-02-12T18:06:09.287509+0000","last_became_peered":"2026-02-12T18:06:09.287509+0000","last_unstale":"2026-02-12T18:06:11.387248+0000","last_undegraded":"2026-02-12T18:06:11.387248+0000","last_fullsized":"2026-02-12T18:06:11.387248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:54:10.505834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020961600000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'112","reported_seq":157,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.383450+0000","last_change":"2026-02-12T18:06:04.371853+0000","last_active":"2026-02-12T18:06:11.383450+0000","last_peered":"2026-02-12T18:06:11.383450+0000","last_clean":"2026-02-12T18:06:11.383450+0000","last_became_active":"2026-02-12T18:06:04.371628+0000","last_became_peered":"2026-02-12T18:06:04.371628+0000","last_unstale":"2026-02-12T18:06:11.383450+0000","last_undegraded":"2026-02-12T18:06:11.383450+0000","last_fullsized":"2026-02-12T18:06:11.383450+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:02.768915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:02.768915+0000","last_clean_scrub_stamp":"2026-02-12T18:06:02.768915+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:16:28.244842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":12,"seq":51539607555,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":732,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":749568,"data_stored":640020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8123,"internal_metadata":27582533},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640259,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":49671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640259,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":49652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":49652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":49671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":732,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":749568,"data_stored":640020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T18:06:14.102 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T18:06:14.168 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.167+0000 7f14230b8640 10 monclient: get_monmap_and_config 2026-02-12T18:06:14.168 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.167+0000 7f14230b8640 10 monclient: build_initial_monmap 2026-02-12T18:06:14.168 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.167+0000 7f14230b8640 10 monclient: monmap: 2026-02-12T18:06:14.168 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:14.168 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:14.169 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:14.168756+0000 2026-02-12T18:06:14.169 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:14.168756+0000 2026-02-12T18:06:14.169 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:14.169 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.169 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:14.169 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:14.169 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:14.169 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:14.169 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:14.169 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:14.169 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:14.169 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:14.170 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:14.170 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:14.170 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:14.170 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f14230b8640 1 Processor -- start 2026-02-12T18:06:14.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f14230b8640 1 -- start start 2026-02-12T18:06:14.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f14230b8640 10 monclient: init 2026-02-12T18:06:14.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f14230b8640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:14.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f14230b8640 10 monclient: _add_conns ranks=[3,8,2,9,0,4,1,10,7,6,5] 2026-02-12T18:06:14.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f14230b8640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f141c05dc20 0x7f141c144660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f14230b8640 10 monclient(hunting): picked mon.noname-g con 0x7f141c05dc20 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:14.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f14230b8640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f141c05dff0 0x7f141c05e3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f14230b8640 10 monclient(hunting): picked mon.noname-e con 0x7f141c05dff0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:14.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f14230b8640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f141c089df0 0x7f141c08a240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f14230b8640 10 monclient(hunting): picked mon.noname-b con 0x7f141c089df0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:14.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f14230b8640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.181 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f14230b8640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f141c093a30 con 0x7f141c089df0 2026-02-12T18:06:14.181 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f14230b8640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.181 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f14230b8640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f141c092200 con 0x7f141c05dc20 2026-02-12T18:06:14.181 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f14230b8640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.181 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f14230b8640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f141c08b250 con 0x7f141c05dff0 2026-02-12T18:06:14.181 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f14230b8640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:14.181 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f14230b8640 10 monclient(hunting): authenticate will time out at 612.894480s 2026-02-12T18:06:14.181 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f142162e640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f141c089df0 0x7f141c08a240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.181 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f1413fff640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f141c05dff0 0x7f141c05e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.181 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f142162e640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f141c089df0 0x7f141c08a240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:60248/0 (socket says 10.20.193.48:60248) 2026-02-12T18:06:14.181 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f142162e640 1 -- 10.20.193.48:0/2997011928 learned_addr learned my addr 10.20.193.48:0/2997011928 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:14.181 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f1413fff640 10 monclient(hunting): get_auth_request con 0x7f141c05dff0 auth_method 0 2026-02-12T18:06:14.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f1413fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f1413fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f1413fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f142162e640 10 monclient(hunting): get_auth_request con 0x7f141c089df0 auth_method 0 2026-02-12T18:06:14.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f142162e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f1420e2d640 1 --2- 10.20.193.48:0/2997011928 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f141c05dc20 0x7f141c144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f142162e640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f142162e640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f1420e2d640 10 monclient(hunting): get_auth_request con 0x7f141c05dc20 auth_method 0 2026-02-12T18:06:14.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f1420e2d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f1420e2d640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f1420e2d640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.183 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f1413fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:14.183 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f1413fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:14.183 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f1413fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:14.183 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f142162e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:14.183 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f142162e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:14.183 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f142162e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:14.183 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f1420e2d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:14.183 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f1420e2d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:14.183 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f1420e2d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:14.183 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f1413fff640 10 monclient(hunting): handle_auth_done global_id 4373 payload 274 2026-02-12T18:06:14.183 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f1413fff640 1 -- 10.20.193.48:0/2997011928 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f141c05dc20 msgr2=0x7f141c144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:14.183 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f1413fff640 1 --2- 10.20.193.48:0/2997011928 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f141c05dc20 0x7f141c144660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.183 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f1413fff640 1 -- 10.20.193.48:0/2997011928 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f141c089df0 msgr2=0x7f141c08a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:14.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f1413fff640 1 --2- 10.20.193.48:0/2997011928 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f141c089df0 0x7f141c08a240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f1413fff640 10 monclient: _finish_hunting 0 2026-02-12T18:06:14.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f1413fff640 1 monclient: found mon.noname-e 2026-02-12T18:06:14.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f1413fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:14.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f1413fff640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:06:14.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f1413fff640 1 -- 10.20.193.48:0/2997011928 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141c060390 con 0x7f141c05dff0 2026-02-12T18:06:14.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.168+0000 7f142162e640 1 --2- 10.20.193.48:0/2997011928 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f141c089df0 0x7f141c08a240 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:06:14.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.171+0000 7f1413fff640 1 -- 10.20.193.48:0/2997011928 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f141c05dff0 msgr2=0x7f141c05e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:14.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.171+0000 7f1413fff640 1 --2- 10.20.193.48:0/2997011928 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f141c05dff0 0x7f141c05e3c0 secure :-1 s=READY pgs=37 gs=2 cs=0 l=1 c_cookie=14687812937994696970 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1404009830 tx=0x7f140402edd0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=cbd5980c388f790a server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:14.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.171+0000 7f14137fe640 1 -- 10.20.193.48:0/2997011928 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1404035340 con 0x7f141c05dff0 2026-02-12T18:06:14.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.171+0000 7f14137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:14.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.171+0000 7f14137fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:06:14.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.171+0000 7f14137fe640 10 monclient: dump: 2026-02-12T18:06:14.185 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:14.185 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:14.185 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.185 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.185 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:14.185 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.185 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:14.185 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:14.185 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:14.185 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:14.186 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:14.186 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:14.186 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:14.186 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:14.186 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:14.186 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.186 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.171+0000 7f14137fe640 10 monclient: _finish_auth 0 2026-02-12T18:06:14.186 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.171+0000 7f14137fe640 10 monclient: _check_auth_tickets 2026-02-12T18:06:14.186 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.171+0000 7f14137fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:14.186 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.171+0000 7f14137fe640 1 -- 10.20.193.48:0/2997011928 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14040354c0 con 0x7f141c05dff0 2026-02-12T18:06:14.186 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.171+0000 7f14230b8640 5 monclient: authenticate success, global_id 4373 2026-02-12T18:06:14.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.171+0000 7f14230b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:14.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.171+0000 7f14137fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:14.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.171+0000 7f14137fe640 1 -- 10.20.193.48:0/2997011928 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1404035af0 con 0x7f141c05dff0 2026-02-12T18:06:14.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.171+0000 7f14137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:14.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.171+0000 7f14137fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:06:14.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.171+0000 7f14137fe640 10 monclient: dump: 2026-02-12T18:06:14.187 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:14.187 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:14.187 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.187 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.187 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:14.187 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.188 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:14.188 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:14.188 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:14.188 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:14.188 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:14.188 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:14.188 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:14.188 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:14.188 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:14.188 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.171+0000 7f14230b8640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:14.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.171+0000 7f14230b8640 4 set_mon_vals no callback set 2026-02-12T18:06:14.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.171+0000 7f14230b8640 10 monclient: shutdown 2026-02-12T18:06:14.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.171+0000 7f14230b8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:14.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.171+0000 7f14230b8640 1 -- 10.20.193.48:0/2997011928 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f141c05dff0 msgr2=0x7f141c05e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:14.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.171+0000 7f14230b8640 1 --2- 10.20.193.48:0/2997011928 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f141c05dff0 0x7f141c05e3c0 secure :-1 s=READY pgs=37 gs=2 cs=0 l=1 c_cookie=14687812937994696970 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1404009830 tx=0x7f140402edd0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.172+0000 7f14230b8640 1 -- 10.20.193.48:0/2997011928 shutdown_connections 2026-02-12T18:06:14.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.172+0000 7f14230b8640 1 --2- 10.20.193.48:0/2997011928 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f141c089df0 0x7f141c08a240 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.172+0000 7f14230b8640 1 --2- 10.20.193.48:0/2997011928 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f141c05dff0 0x7f141c05e3c0 unknown :-1 s=CLOSED pgs=37 gs=2 cs=0 l=1 c_cookie=14687812937994696970 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.172+0000 7f14230b8640 1 --2- 10.20.193.48:0/2997011928 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f141c05dc20 0x7f141c144660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.172+0000 7f14230b8640 1 -- 10.20.193.48:0/2997011928 >> 10.20.193.48:0/2997011928 conn(0x7f141c0546d0 msgr2=0x7f141c054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:14.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.172+0000 7f14230b8640 1 -- 10.20.193.48:0/2997011928 shutdown_connections 2026-02-12T18:06:14.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.172+0000 7f14230b8640 1 -- 10.20.193.48:0/2997011928 wait complete. 2026-02-12T18:06:14.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.172+0000 7f14230b8640 10 monclient: build_initial_monmap 2026-02-12T18:06:14.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.172+0000 7f14230b8640 10 monclient: monmap: 2026-02-12T18:06:14.190 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:14.190 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:14.190 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:14.190 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:14.190 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:14.190 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.190 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:14.191 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:14.191 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:14.191 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:14.191 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:14.191 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:14.191 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:14.191 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:14.191 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:14.191 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.172+0000 7f14230b8640 1 Processor -- start 2026-02-12T18:06:14.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.172+0000 7f14230b8640 1 -- start start 2026-02-12T18:06:14.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.172+0000 7f14230b8640 10 monclient: init 2026-02-12T18:06:14.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f14230b8640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:14.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f14230b8640 10 monclient: _add_conns ranks=[5,4,0,3,6,8,2,7,1] 2026-02-12T18:06:14.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f14230b8640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f141c05dc20 0x7f141c131ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f14230b8640 10 monclient(hunting): picked mon.noname-h con 0x7f141c05dc20 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:14.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f14230b8640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f141c05dff0 0x7f141c10db60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f14230b8640 10 monclient(hunting): picked mon.noname-c con 0x7f141c05dff0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:06:14.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f14230b8640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f141c089df0 0x7f141c10e0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f14230b8640 10 monclient(hunting): picked mon.noname-a con 0x7f141c089df0 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:06:14.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f14230b8640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f14230b8640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f141c110800 con 0x7f141c089df0 2026-02-12T18:06:14.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f14230b8640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f14230b8640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f141c110cc0 con 0x7f141c05dff0 2026-02-12T18:06:14.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f14230b8640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f14230b8640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f141c110fa0 con 0x7f141c05dc20 2026-02-12T18:06:14.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f14230b8640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:14.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f14230b8640 10 monclient(hunting): authenticate will time out at 612.899158s 2026-02-12T18:06:14.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f1413fff640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f141c05dff0 0x7f141c10db60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f142162e640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f141c089df0 0x7f141c10e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f142162e640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f141c089df0 0x7f141c10e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:57058/0 (socket says 10.20.193.48:57058) 2026-02-12T18:06:14.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f142162e640 1 -- 10.20.193.48:0/1981578740 learned_addr learned my addr 10.20.193.48:0/1981578740 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:14.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f1413fff640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f141c05dff0 0x7f141c10db60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:41244/0 (socket says 10.20.193.48:41244) 2026-02-12T18:06:14.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f142162e640 10 monclient(hunting): get_auth_request con 0x7f141c089df0 auth_method 0 2026-02-12T18:06:14.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f142162e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f142162e640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f142162e640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f1413fff640 10 monclient(hunting): get_auth_request con 0x7f141c05dff0 auth_method 0 2026-02-12T18:06:14.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f1413fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f1413fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f1413fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f142162e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:14.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f142162e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:14.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f142162e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:14.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f1413fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:14.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f1413fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:14.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f1413fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:14.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f1420e2d640 1 --2- 10.20.193.48:0/1981578740 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f141c05dc20 0x7f141c131ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f1420e2d640 10 monclient(hunting): get_auth_request con 0x7f141c05dc20 auth_method 0 2026-02-12T18:06:14.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f1420e2d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f1420e2d640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f1420e2d640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f1413fff640 10 monclient(hunting): handle_auth_done global_id 34249 payload 824 2026-02-12T18:06:14.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f1413fff640 1 -- 10.20.193.48:0/1981578740 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f141c05dc20 msgr2=0x7f141c131ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:14.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f1413fff640 1 --2- 10.20.193.48:0/1981578740 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f141c05dc20 0x7f141c131ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f1413fff640 1 -- 10.20.193.48:0/1981578740 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f141c089df0 msgr2=0x7f141c10e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:14.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f1413fff640 1 --2- 10.20.193.48:0/1981578740 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f141c089df0 0x7f141c10e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f1413fff640 10 monclient: _finish_hunting 0 2026-02-12T18:06:14.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f1413fff640 1 monclient: found mon.noname-c 2026-02-12T18:06:14.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f1413fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:14.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f1413fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:06:14.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f1413fff640 1 -- 10.20.193.48:0/1981578740 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141800a5d0 con 0x7f141c05dff0 2026-02-12T18:06:14.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.173+0000 7f142162e640 1 --2- 10.20.193.48:0/1981578740 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f141c089df0 0x7f141c10e0a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:06:14.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.175+0000 7f1413fff640 1 -- 10.20.193.48:0/1981578740 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f141c05dff0 msgr2=0x7f141c10db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:14.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.175+0000 7f1413fff640 1 --2- 10.20.193.48:0/1981578740 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f141c05dff0 0x7f141c10db60 secure :-1 s=READY pgs=45 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f141c08b390 tx=0x7f14040047e0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:14.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.175+0000 7f14117fa640 1 -- 10.20.193.48:0/1981578740 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1404035a50 con 0x7f141c05dff0 2026-02-12T18:06:14.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.175+0000 7f14117fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:14.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.175+0000 7f14117fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:06:14.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.175+0000 7f14117fa640 10 monclient: dump: 2026-02-12T18:06:14.197 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:14.197 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:14.197 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.198 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.198 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:14.198 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.198 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:14.198 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:14.198 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:14.198 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:14.198 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:14.198 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:14.198 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:14.199 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:14.199 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:14.199 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.175+0000 7f14117fa640 10 monclient: _finish_auth 0 2026-02-12T18:06:14.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.175+0000 7f14117fa640 10 monclient: _check_auth_tickets 2026-02-12T18:06:14.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.175+0000 7f14117fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:14.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.175+0000 7f14117fa640 1 -- 10.20.193.48:0/1981578740 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14040044f0 con 0x7f141c05dff0 2026-02-12T18:06:14.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.175+0000 7f14117fa640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:14.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.175+0000 7f14230b8640 5 monclient: authenticate success, global_id 34249 2026-02-12T18:06:14.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.175+0000 7f14117fa640 1 -- 10.20.193.48:0/1981578740 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f14040036d0 con 0x7f141c05dff0 2026-02-12T18:06:14.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.175+0000 7f14117fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:14.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.175+0000 7f1412ffd640 4 set_mon_vals no callback set 2026-02-12T18:06:14.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.175+0000 7f14117fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:06:14.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.175+0000 7f14117fa640 10 monclient: dump: 2026-02-12T18:06:14.200 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:14.200 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:14.200 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.200 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.200 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:14.200 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.200 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:14.200 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:14.201 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:14.201 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:14.201 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:14.201 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:14.201 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:14.201 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:14.201 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:14.201 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.175+0000 7f14230b8640 10 monclient: _renew_subs 2026-02-12T18:06:14.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.175+0000 7f14230b8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:14.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.175+0000 7f14230b8640 1 -- 10.20.193.48:0/1981578740 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1404009420 con 0x7f141c05dff0 2026-02-12T18:06:14.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.175+0000 7f14230b8640 10 monclient: _renew_subs 2026-02-12T18:06:14.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.175+0000 7f14230b8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:14.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.175+0000 7f14230b8640 1 -- 10.20.193.48:0/1981578740 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f141c10ec40 con 0x7f141c05dff0 2026-02-12T18:06:14.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.176+0000 7f14230b8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:14.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.176+0000 7f14230b8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:14.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.176+0000 7f14230b8640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:14.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.176+0000 7f14230b8640 1 -- 10.20.193.48:0/1981578740 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f141c110940 con 0x7f141c05dff0 2026-02-12T18:06:14.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.176+0000 7f14117fa640 1 -- 10.20.193.48:0/1981578740 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f1404004030 con 0x7f141c05dff0 2026-02-12T18:06:14.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.176+0000 7f14117fa640 1 --2- 10.20.193.48:0/1981578740 >> v2:10.20.193.111:6812/977811348 conn(0x7f13ec03f7f0 0x7f13ec05fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.176+0000 7f14117fa640 1 -- 10.20.193.48:0/1981578740 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7f1404077630 con 0x7f141c05dff0 2026-02-12T18:06:14.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.177+0000 7f1420e2d640 1 --2- 10.20.193.48:0/1981578740 >> v2:10.20.193.111:6812/977811348 conn(0x7f13ec03f7f0 0x7f13ec05fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.177+0000 7f1420e2d640 10 monclient: get_auth_request con 0x7f13ec03f7f0 auth_method 0 2026-02-12T18:06:14.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.178+0000 7f14117fa640 1 -- 10.20.193.48:0/1981578740 <== mon.4 v2:10.20.193.48:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f141c110940 con 0x7f141c05dff0 2026-02-12T18:06:14.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.178+0000 7f14117fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:14.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.178+0000 7f14117fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:14.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.179+0000 7f1420e2d640 1 --2- 10.20.193.48:0/1981578740 >> v2:10.20.193.111:6812/977811348 conn(0x7f13ec03f7f0 0x7f13ec05fca0 secure :-1 s=READY pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f140c004740 tx=0x7f140c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:14.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.279+0000 7f14230b8640 1 -- 10.20.193.48:0/1981578740 --> v2:10.20.193.111:6812/977811348 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f141c094a90 con 0x7f13ec03f7f0 2026-02-12T18:06:14.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.279+0000 7f14117fa640 1 -- 10.20.193.48:0/1981578740 <== mgr.4123 v2:10.20.193.111:6812/977811348 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34123 (secure 0 0 0) 0x7f140c0119e0 con 0x7f13ec03f7f0 2026-02-12T18:06:14.280 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:06:14.281 INFO:teuthology.orchestra.run.trial048.stderr:dumped all 2026-02-12T18:06:14.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.280+0000 7f14230b8640 1 -- 10.20.193.48:0/1981578740 >> v2:10.20.193.111:6812/977811348 conn(0x7f13ec03f7f0 msgr2=0x7f13ec05fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:14.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.280+0000 7f14230b8640 1 --2- 10.20.193.48:0/1981578740 >> v2:10.20.193.111:6812/977811348 conn(0x7f13ec03f7f0 0x7f13ec05fca0 secure :-1 s=READY pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f140c004740 tx=0x7f140c008040 comp rx=0 tx=0).stop 2026-02-12T18:06:14.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.280+0000 7f14230b8640 10 monclient: shutdown 2026-02-12T18:06:14.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.280+0000 7f14230b8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:14.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.280+0000 7f14230b8640 1 -- 10.20.193.48:0/1981578740 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f141c05dff0 msgr2=0x7f141c10db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:14.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.280+0000 7f14230b8640 1 --2- 10.20.193.48:0/1981578740 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f141c05dff0 0x7f141c10db60 secure :-1 s=READY pgs=45 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f141c08b390 tx=0x7f14040047e0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.280+0000 7f14230b8640 1 -- 10.20.193.48:0/1981578740 shutdown_connections 2026-02-12T18:06:14.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.280+0000 7f14230b8640 1 --2- 10.20.193.48:0/1981578740 >> v2:10.20.193.111:6812/977811348 conn(0x7f13ec03f7f0 0x7f13ec05fca0 unknown :-1 s=CLOSED pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.280+0000 7f14230b8640 1 --2- 10.20.193.48:0/1981578740 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f141c089df0 0x7f141c10e0a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.280+0000 7f14230b8640 1 --2- 10.20.193.48:0/1981578740 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f141c05dff0 0x7f141c10db60 unknown :-1 s=CLOSED pgs=45 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.280+0000 7f14230b8640 1 --2- 10.20.193.48:0/1981578740 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f141c05dc20 0x7f141c131ca0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.280+0000 7f14230b8640 1 -- 10.20.193.48:0/1981578740 >> 10.20.193.48:0/1981578740 conn(0x7f141c0546d0 msgr2=0x7f141c1439d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:14.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.280+0000 7f14230b8640 1 -- 10.20.193.48:0/1981578740 shutdown_connections 2026-02-12T18:06:14.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.281+0000 7f14230b8640 1 -- 10.20.193.48:0/1981578740 wait complete. 2026-02-12T18:06:14.289 INFO:teuthology.orchestra.run.trial048.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2026-02-12T18:06:12.386788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163840,"kb_used_data":2080,"kb_used_omap":50,"kb_used_meta":161613,"kb_avail":566067200,"statfs":{"total":579820584960,"available":579652812800,"internally_reserved":0,"allocated":2129920,"data_stored":1478686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":51998,"internal_metadata":165491938},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.107332"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.383670+0000","last_change":"2026-02-12T18:06:11.383740+0000","last_active":"2026-02-12T18:06:11.383670+0000","last_peered":"2026-02-12T18:06:11.383670+0000","last_clean":"2026-02-12T18:06:11.383670+0000","last_became_active":"2026-02-12T18:06:09.281532+0000","last_became_peered":"2026-02-12T18:06:09.281532+0000","last_unstale":"2026-02-12T18:06:11.383670+0000","last_undegraded":"2026-02-12T18:06:11.383670+0000","last_fullsized":"2026-02-12T18:06:11.383670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T20:34:57.876774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027561099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.384892+0000","last_change":"2026-02-12T18:06:11.384892+0000","last_active":"2026-02-12T18:06:11.384892+0000","last_peered":"2026-02-12T18:06:11.384892+0000","last_clean":"2026-02-12T18:06:11.384892+0000","last_became_active":"2026-02-12T18:06:09.283689+0000","last_became_peered":"2026-02-12T18:06:09.283689+0000","last_unstale":"2026-02-12T18:06:11.384892+0000","last_undegraded":"2026-02-12T18:06:11.384892+0000","last_fullsized":"2026-02-12T18:06:11.384892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T00:04:55.700663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046734100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.383588+0000","last_change":"2026-02-12T18:06:11.383662+0000","last_active":"2026-02-12T18:06:11.383588+0000","last_peered":"2026-02-12T18:06:11.383588+0000","last_clean":"2026-02-12T18:06:11.383588+0000","last_became_active":"2026-02-12T18:06:09.281461+0000","last_became_peered":"2026-02-12T18:06:09.281461+0000","last_unstale":"2026-02-12T18:06:11.383588+0000","last_undegraded":"2026-02-12T18:06:11.383588+0000","last_fullsized":"2026-02-12T18:06:11.383588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T21:13:23.141921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00019704400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.384936+0000","last_change":"2026-02-12T18:06:11.384936+0000","last_active":"2026-02-12T18:06:11.384936+0000","last_peered":"2026-02-12T18:06:11.384936+0000","last_clean":"2026-02-12T18:06:11.384936+0000","last_became_active":"2026-02-12T18:06:09.283688+0000","last_became_peered":"2026-02-12T18:06:09.283688+0000","last_unstale":"2026-02-12T18:06:11.384936+0000","last_undegraded":"2026-02-12T18:06:11.384936+0000","last_fullsized":"2026-02-12T18:06:11.384936+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:54:04.914482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047092800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.387972+0000","last_change":"2026-02-12T18:06:11.387479+0000","last_active":"2026-02-12T18:06:11.387972+0000","last_peered":"2026-02-12T18:06:11.387972+0000","last_clean":"2026-02-12T18:06:11.387972+0000","last_became_active":"2026-02-12T18:06:09.283881+0000","last_became_peered":"2026-02-12T18:06:09.283881+0000","last_unstale":"2026-02-12T18:06:11.387972+0000","last_undegraded":"2026-02-12T18:06:11.387972+0000","last_fullsized":"2026-02-12T18:06:11.387972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:14:28.203244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045409299999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.384057+0000","last_change":"2026-02-12T18:06:11.384057+0000","last_active":"2026-02-12T18:06:11.384057+0000","last_peered":"2026-02-12T18:06:11.384057+0000","last_clean":"2026-02-12T18:06:11.384057+0000","last_became_active":"2026-02-12T18:06:09.284036+0000","last_became_peered":"2026-02-12T18:06:09.284036+0000","last_unstale":"2026-02-12T18:06:11.384057+0000","last_undegraded":"2026-02-12T18:06:11.384057+0000","last_fullsized":"2026-02-12T18:06:11.384057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:15:47.166182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028640700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.383576+0000","last_change":"2026-02-12T18:06:11.383648+0000","last_active":"2026-02-12T18:06:11.383576+0000","last_peered":"2026-02-12T18:06:11.383576+0000","last_clean":"2026-02-12T18:06:11.383576+0000","last_became_active":"2026-02-12T18:06:09.283797+0000","last_became_peered":"2026-02-12T18:06:09.283797+0000","last_unstale":"2026-02-12T18:06:11.383576+0000","last_undegraded":"2026-02-12T18:06:11.383576+0000","last_fullsized":"2026-02-12T18:06:11.383576+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:51:24.172618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018461199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.387248+0000","last_change":"2026-02-12T18:06:11.387248+0000","last_active":"2026-02-12T18:06:11.387248+0000","last_peered":"2026-02-12T18:06:11.387248+0000","last_clean":"2026-02-12T18:06:11.387248+0000","last_became_active":"2026-02-12T18:06:09.287509+0000","last_became_peered":"2026-02-12T18:06:09.287509+0000","last_unstale":"2026-02-12T18:06:11.387248+0000","last_undegraded":"2026-02-12T18:06:11.387248+0000","last_fullsized":"2026-02-12T18:06:11.387248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:54:10.505834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020961600000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'112","reported_seq":157,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.383450+0000","last_change":"2026-02-12T18:06:04.371853+0000","last_active":"2026-02-12T18:06:11.383450+0000","last_peered":"2026-02-12T18:06:11.383450+0000","last_clean":"2026-02-12T18:06:11.383450+0000","last_became_active":"2026-02-12T18:06:04.371628+0000","last_became_peered":"2026-02-12T18:06:04.371628+0000","last_unstale":"2026-02-12T18:06:11.383450+0000","last_undegraded":"2026-02-12T18:06:11.383450+0000","last_fullsized":"2026-02-12T18:06:11.383450+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:02.768915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:02.768915+0000","last_clean_scrub_stamp":"2026-02-12T18:06:02.768915+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:16:28.244842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":12,"seq":51539607555,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":732,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":749568,"data_stored":640020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8123,"internal_metadata":27582533},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640259,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":49671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640259,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":49652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640261,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":49652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":49671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":732,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":749568,"data_stored":640020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T18:06:14.290 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-12T18:06:14.290 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2026-02-12T18:06:14.290 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2026-02-12T18:06:14.290 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2026-02-12T18:06:14.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.355+0000 7fd5e4e47640 10 monclient: get_monmap_and_config 2026-02-12T18:06:14.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.355+0000 7fd5e4e47640 10 monclient: build_initial_monmap 2026-02-12T18:06:14.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.355+0000 7fd5e4e47640 10 monclient: monmap: 2026-02-12T18:06:14.359 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:14.359 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:14.359 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:14.356600+0000 2026-02-12T18:06:14.359 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:14.356600+0000 2026-02-12T18:06:14.359 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:14.359 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.359 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:14.359 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:14.359 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:14.359 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:14.359 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:14.360 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:14.360 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:14.360 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:14.360 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:14.360 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:14.360 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:14.360 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.355+0000 7fd5e4e47640 1 Processor -- start 2026-02-12T18:06:14.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.355+0000 7fd5e4e47640 1 -- start start 2026-02-12T18:06:14.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.355+0000 7fd5e4e47640 10 monclient: init 2026-02-12T18:06:14.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5e4e47640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:14.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5e4e47640 10 monclient: _add_conns ranks=[10,3,7,5,4,9,0,8,1,6,2] 2026-02-12T18:06:14.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5e4e47640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7fd5e0093ac0 0x7fd5e005d610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5e4e47640 10 monclient(hunting): picked mon.noname-f con 0x7fd5e0093ac0 addr v2:10.20.193.111:3300/0 2026-02-12T18:06:14.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5e4e47640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd5e013e990 0x7fd5e005db50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5e4e47640 10 monclient(hunting): picked mon.noname-g con 0x7fd5e013e990 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:14.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5e4e47640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd5e0141e90 0x7fd5e0142330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5e4e47640 10 monclient(hunting): picked mon.noname-i con 0x7fd5e0141e90 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:14.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5e4e47640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5e4e47640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7fd5e005e090 con 0x7fd5e0093ac0 2026-02-12T18:06:14.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5e4e47640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5e4e47640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e00580a0 con 0x7fd5e013e990 2026-02-12T18:06:14.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5e4e47640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5e4e47640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fd5e005e3f0 con 0x7fd5e0141e90 2026-02-12T18:06:14.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5e4e47640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:14.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5e4e47640 10 monclient(hunting): authenticate will time out at 613.082290s 2026-02-12T18:06:14.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ddd74640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd5e013e990 0x7fd5e005db50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5de575640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7fd5e0093ac0 0x7fd5e005d610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ddd74640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd5e013e990 0x7fd5e005db50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3301/0 says I am v2:10.20.193.48:57994/0 (socket says 10.20.193.48:57994) 2026-02-12T18:06:14.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ded76640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd5e0141e90 0x7fd5e0142330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ddd74640 1 -- 10.20.193.48:0/1283396064 learned_addr learned my addr 10.20.193.48:0/1283396064 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:14.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ddd74640 10 monclient(hunting): get_auth_request con 0x7fd5e013e990 auth_method 0 2026-02-12T18:06:14.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ddd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ddd74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ddd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ded76640 10 monclient(hunting): get_auth_request con 0x7fd5e0141e90 auth_method 0 2026-02-12T18:06:14.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ded76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ded76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ded76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5de575640 10 monclient(hunting): get_auth_request con 0x7fd5e0093ac0 auth_method 0 2026-02-12T18:06:14.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5de575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5de575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5de575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ddd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:14.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ddd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:14.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ddd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:14.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ded76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:14.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ded76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:14.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ded76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:14.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5de575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:14.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5de575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:14.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5de575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:14.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ddd74640 10 monclient(hunting): handle_auth_done global_id 4314 payload 274 2026-02-12T18:06:14.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ddd74640 1 -- 10.20.193.48:0/1283396064 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd5e0141e90 msgr2=0x7fd5e0142330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:14.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ddd74640 1 --2- 10.20.193.48:0/1283396064 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd5e0141e90 0x7fd5e0142330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ddd74640 1 -- 10.20.193.48:0/1283396064 >> v2:10.20.193.111:3300/0 conn(0x7fd5e0093ac0 msgr2=0x7fd5e005d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:14.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ddd74640 1 --2- 10.20.193.48:0/1283396064 >> v2:10.20.193.111:3300/0 conn(0x7fd5e0093ac0 0x7fd5e005d610 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ddd74640 10 monclient: _finish_hunting 0 2026-02-12T18:06:14.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ddd74640 1 monclient: found mon.noname-g 2026-02-12T18:06:14.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ddd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:14.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ddd74640 10 monclient: _send_mon_message to mon.noname-g at v2:10.20.193.111:3301/0 2026-02-12T18:06:14.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.356+0000 7fd5ddd74640 1 -- 10.20.193.48:0/1283396064 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e0060390 con 0x7fd5e013e990 2026-02-12T18:06:14.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5ddd74640 1 -- 10.20.193.48:0/1283396064 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd5e013e990 msgr2=0x7fd5e005db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:14.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5ddd74640 1 --2- 10.20.193.48:0/1283396064 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd5e013e990 0x7fd5e005db50 secure :-1 s=READY pgs=30 gs=2 cs=0 l=1 c_cookie=2875772953060065855 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5c80098d0 tx=0x7fd5c802ede0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=27e8cc43a9d2423f server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:14.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5dd573640 1 -- 10.20.193.48:0/1283396064 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd5c8035340 con 0x7fd5e013e990 2026-02-12T18:06:14.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5dd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:14.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5dd573640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2026-02-12T18:06:14.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5dd573640 10 monclient: dump: 2026-02-12T18:06:14.373 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:14.373 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:14.373 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.373 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.373 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:14.374 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.374 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:14.374 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:14.374 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:14.374 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:14.374 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:14.374 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:14.374 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:14.374 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:14.374 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:14.374 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5dd573640 10 monclient: _finish_auth 0 2026-02-12T18:06:14.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5dd573640 10 monclient: _check_auth_tickets 2026-02-12T18:06:14.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5dd573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:14.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5dd573640 1 -- 10.20.193.48:0/1283396064 <== mon.3 v2:10.20.193.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5c80354c0 con 0x7fd5e013e990 2026-02-12T18:06:14.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5dd573640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:14.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5dd573640 1 -- 10.20.193.48:0/1283396064 <== mon.3 v2:10.20.193.111:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd5c8035b30 con 0x7fd5e013e990 2026-02-12T18:06:14.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5e4e47640 5 monclient: authenticate success, global_id 4314 2026-02-12T18:06:14.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5e4e47640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:14.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5e4e47640 4 set_mon_vals no callback set 2026-02-12T18:06:14.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5dd573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:14.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5dd573640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:06:14.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5dd573640 10 monclient: dump: 2026-02-12T18:06:14.375 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:14.376 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:14.376 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.376 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.376 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:14.376 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.376 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:14.376 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:14.376 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:14.376 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:14.376 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:14.376 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:14.376 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:14.376 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:14.377 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:14.377 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5e4e47640 10 monclient: shutdown 2026-02-12T18:06:14.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5e4e47640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:14.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5e4e47640 1 -- 10.20.193.48:0/1283396064 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd5e013e990 msgr2=0x7fd5e005db50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:14.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5e4e47640 1 --2- 10.20.193.48:0/1283396064 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd5e013e990 0x7fd5e005db50 secure :-1 s=READY pgs=30 gs=2 cs=0 l=1 c_cookie=2875772953060065855 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5c80098d0 tx=0x7fd5c802ede0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5e4e47640 1 -- 10.20.193.48:0/1283396064 shutdown_connections 2026-02-12T18:06:14.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5e4e47640 1 --2- 10.20.193.48:0/1283396064 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd5e0141e90 0x7fd5e0142330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5e4e47640 1 --2- 10.20.193.48:0/1283396064 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd5e013e990 0x7fd5e005db50 unknown :-1 s=CLOSED pgs=30 gs=2 cs=0 l=1 c_cookie=2875772953060065855 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5e4e47640 1 --2- 10.20.193.48:0/1283396064 >> v2:10.20.193.111:3300/0 conn(0x7fd5e0093ac0 0x7fd5e005d610 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5e4e47640 1 -- 10.20.193.48:0/1283396064 >> 10.20.193.48:0/1283396064 conn(0x7fd5e0054b30 msgr2=0x7fd5e0093070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:14.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5e4e47640 1 -- 10.20.193.48:0/1283396064 shutdown_connections 2026-02-12T18:06:14.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.359+0000 7fd5e4e47640 1 -- 10.20.193.48:0/1283396064 wait complete. 2026-02-12T18:06:14.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5e4e47640 10 monclient: build_initial_monmap 2026-02-12T18:06:14.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5e4e47640 10 monclient: monmap: 2026-02-12T18:06:14.378 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:14.378 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:14.378 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:14.378 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:14.378 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:14.378 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.379 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:14.379 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:14.379 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:14.379 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:14.379 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:14.379 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:14.379 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:14.379 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:14.379 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:14.379 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.379 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5e4e47640 1 Processor -- start 2026-02-12T18:06:14.379 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5e4e47640 1 -- start start 2026-02-12T18:06:14.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5e4e47640 10 monclient: init 2026-02-12T18:06:14.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5e4e47640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:14.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5e4e47640 10 monclient: _add_conns ranks=[6,7,3,5,8,4,0,2,1] 2026-02-12T18:06:14.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5e4e47640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd5e0093ac0 0x7fd5e008a5b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5e4e47640 10 monclient(hunting): picked mon.noname-d con 0x7fd5e0093ac0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:06:14.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5e4e47640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd5e013e990 0x7fd5e008aaf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5e4e47640 10 monclient(hunting): picked mon.noname-i con 0x7fd5e013e990 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:14.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5e4e47640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd5e0141e90 0x7fd5e008b030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5e4e47640 10 monclient(hunting): picked mon.noname-g con 0x7fd5e0141e90 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:14.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5e4e47640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5e4e47640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e005c620 con 0x7fd5e0141e90 2026-02-12T18:06:14.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5e4e47640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5e4e47640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fd5e005c900 con 0x7fd5e0093ac0 2026-02-12T18:06:14.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5e4e47640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5e4e47640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fd5e005bb80 con 0x7fd5e013e990 2026-02-12T18:06:14.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5e4e47640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:14.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5e4e47640 10 monclient(hunting): authenticate will time out at 613.086849s 2026-02-12T18:06:14.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5de575640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd5e0093ac0 0x7fd5e008a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5de575640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd5e0093ac0 0x7fd5e008a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:36038/0 (socket says 10.20.193.48:36038) 2026-02-12T18:06:14.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5de575640 1 -- 10.20.193.48:0/2428586987 learned_addr learned my addr 10.20.193.48:0/2428586987 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:14.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5de575640 10 monclient(hunting): get_auth_request con 0x7fd5e0093ac0 auth_method 0 2026-02-12T18:06:14.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5de575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5de575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.360+0000 7fd5de575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.382 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.361+0000 7fd5ded76640 1 --2- 10.20.193.48:0/2428586987 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd5e0141e90 0x7fd5e008b030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.382 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.361+0000 7fd5ded76640 10 monclient(hunting): get_auth_request con 0x7fd5e0141e90 auth_method 0 2026-02-12T18:06:14.382 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.361+0000 7fd5ded76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.382 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.361+0000 7fd5ded76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.382 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.361+0000 7fd5ded76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.382 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.361+0000 7fd5ddd74640 1 --2- 10.20.193.48:0/2428586987 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd5e013e990 0x7fd5e008aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.382 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.361+0000 7fd5de575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:14.382 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.361+0000 7fd5de575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:14.382 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.361+0000 7fd5de575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:14.382 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.361+0000 7fd5ddd74640 10 monclient(hunting): get_auth_request con 0x7fd5e013e990 auth_method 0 2026-02-12T18:06:14.382 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.361+0000 7fd5ddd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.382 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.361+0000 7fd5ddd74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.361+0000 7fd5ddd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.361+0000 7fd5ded76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:14.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.361+0000 7fd5ded76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:14.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.361+0000 7fd5ded76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:14.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.361+0000 7fd5de575640 10 monclient(hunting): handle_auth_done global_id 4362 payload 824 2026-02-12T18:06:14.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.361+0000 7fd5de575640 1 -- 10.20.193.48:0/2428586987 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd5e013e990 msgr2=0x7fd5e008aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:14.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.361+0000 7fd5de575640 1 --2- 10.20.193.48:0/2428586987 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd5e013e990 0x7fd5e008aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.361+0000 7fd5de575640 1 -- 10.20.193.48:0/2428586987 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd5e0141e90 msgr2=0x7fd5e008b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:14.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.361+0000 7fd5de575640 1 --2- 10.20.193.48:0/2428586987 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd5e0141e90 0x7fd5e008b030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.361+0000 7fd5de575640 10 monclient: _finish_hunting 0 2026-02-12T18:06:14.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.361+0000 7fd5de575640 1 monclient: found mon.noname-d 2026-02-12T18:06:14.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.361+0000 7fd5de575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:14.384 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.361+0000 7fd5de575640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:06:14.384 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.361+0000 7fd5de575640 1 -- 10.20.193.48:0/2428586987 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c80094f0 con 0x7fd5e0093ac0 2026-02-12T18:06:14.384 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.363+0000 7fd5de575640 1 -- 10.20.193.48:0/2428586987 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd5e0093ac0 msgr2=0x7fd5e008a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:14.384 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.363+0000 7fd5de575640 1 --2- 10.20.193.48:0/2428586987 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd5e0093ac0 0x7fd5e008a5b0 secure :-1 s=READY pgs=46 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5d40093f0 tx=0x7fd5d400ed50 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:14.384 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.363+0000 7fd5c6ffd640 1 -- 10.20.193.48:0/2428586987 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd5d400cb50 con 0x7fd5e0093ac0 2026-02-12T18:06:14.384 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.363+0000 7fd5c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:14.384 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.363+0000 7fd5c6ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:06:14.384 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.363+0000 7fd5c6ffd640 10 monclient: dump: 2026-02-12T18:06:14.384 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:14.384 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:14.385 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.385 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.385 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:14.385 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.385 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:14.385 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:14.385 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:14.385 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:14.385 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:14.385 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:14.385 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:14.385 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:14.386 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:14.386 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.386 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.363+0000 7fd5c6ffd640 10 monclient: _finish_auth 0 2026-02-12T18:06:14.386 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.363+0000 7fd5c6ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:06:14.386 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.363+0000 7fd5c6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:14.386 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.363+0000 7fd5c6ffd640 1 -- 10.20.193.48:0/2428586987 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5d400ccd0 con 0x7fd5e0093ac0 2026-02-12T18:06:14.386 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.363+0000 7fd5c6ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:14.386 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.363+0000 7fd5c6ffd640 1 -- 10.20.193.48:0/2428586987 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd5d400ce40 con 0x7fd5e0093ac0 2026-02-12T18:06:14.386 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.363+0000 7fd5c6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:14.386 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.363+0000 7fd5c6ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:06:14.386 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.363+0000 7fd5dcd72640 4 set_mon_vals no callback set 2026-02-12T18:06:14.386 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.363+0000 7fd5c6ffd640 10 monclient: dump: 2026-02-12T18:06:14.387 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:14.387 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:14.387 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.387 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.387 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:14.387 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.387 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:14.387 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:14.387 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:14.387 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:14.387 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:14.387 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:14.387 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:14.388 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:14.388 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:14.388 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.388 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.363+0000 7fd5e4e47640 5 monclient: authenticate success, global_id 4362 2026-02-12T18:06:14.388 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.363+0000 7fd5e4e47640 10 monclient: _renew_subs 2026-02-12T18:06:14.388 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.363+0000 7fd5e4e47640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:06:14.388 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.363+0000 7fd5e4e47640 1 -- 10.20.193.48:0/2428586987 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e013db70 con 0x7fd5e0093ac0 2026-02-12T18:06:14.388 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.363+0000 7fd5e4e47640 10 monclient: _renew_subs 2026-02-12T18:06:14.388 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.363+0000 7fd5e4e47640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:06:14.388 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.363+0000 7fd5e4e47640 1 -- 10.20.193.48:0/2428586987 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e005c060 con 0x7fd5e0093ac0 2026-02-12T18:06:14.388 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.364+0000 7fd5e4e47640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:14.388 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.364+0000 7fd5e4e47640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:14.388 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.364+0000 7fd5e4e47640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:06:14.388 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.364+0000 7fd5e4e47640 1 -- 10.20.193.48:0/2428586987 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e005c220 con 0x7fd5e0093ac0 2026-02-12T18:06:14.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.364+0000 7fd5c6ffd640 1 -- 10.20.193.48:0/2428586987 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fd5d4011070 con 0x7fd5e0093ac0 2026-02-12T18:06:14.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.364+0000 7fd5c6ffd640 1 --2- 10.20.193.48:0/2428586987 >> v2:10.20.193.111:6812/977811348 conn(0x7fd5ac03f800 0x7fd5ac05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.364+0000 7fd5c6ffd640 1 -- 10.20.193.48:0/2428586987 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7fd5d4052a00 con 0x7fd5e0093ac0 2026-02-12T18:06:14.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.364+0000 7fd5ddd74640 1 --2- 10.20.193.48:0/2428586987 >> v2:10.20.193.111:6812/977811348 conn(0x7fd5ac03f800 0x7fd5ac05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.364+0000 7fd5ddd74640 10 monclient: get_auth_request con 0x7fd5ac03f800 auth_method 0 2026-02-12T18:06:14.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.366+0000 7fd5c6ffd640 1 -- 10.20.193.48:0/2428586987 <== mon.6 v2:10.20.193.48:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fd5d40063c0 con 0x7fd5e0093ac0 2026-02-12T18:06:14.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.366+0000 7fd5c6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:14.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.366+0000 7fd5c6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:14.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.367+0000 7fd5ddd74640 1 --2- 10.20.193.48:0/2428586987 >> v2:10.20.193.111:6812/977811348 conn(0x7fd5ac03f800 0x7fd5ac05fcb0 secure :-1 s=READY pgs=59 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5c80023d0 tx=0x7fd5c8033000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:14.498 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.497+0000 7fd5e4e47640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2026-02-12T18:06:14.498 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.497+0000 7fd5e4e47640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2026-02-12T18:06:14.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.497+0000 7fd5e4e47640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:06:14.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.497+0000 7fd5e4e47640 1 -- 10.20.193.48:0/2428586987 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd5e008e2e0 con 0x7fd5e0093ac0 2026-02-12T18:06:14.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.497+0000 7fd5c6ffd640 1 -- 10.20.193.48:0/2428586987 <== mon.6 v2:10.20.193.48:3303/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd5d4021040 con 0x7fd5e0093ac0 2026-02-12T18:06:14.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.497+0000 7fd5c6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2026-02-12T18:06:14.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.497+0000 7fd5c6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:14.499 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:06:14.500 INFO:teuthology.orchestra.run.trial048.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2026-02-12T18:06:14.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.498+0000 7fd5e4e47640 1 -- 10.20.193.48:0/2428586987 >> v2:10.20.193.111:6812/977811348 conn(0x7fd5ac03f800 msgr2=0x7fd5ac05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:14.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.498+0000 7fd5e4e47640 1 --2- 10.20.193.48:0/2428586987 >> v2:10.20.193.111:6812/977811348 conn(0x7fd5ac03f800 0x7fd5ac05fcb0 secure :-1 s=READY pgs=59 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5c80023d0 tx=0x7fd5c8033000 comp rx=0 tx=0).stop 2026-02-12T18:06:14.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.498+0000 7fd5e4e47640 10 monclient: shutdown 2026-02-12T18:06:14.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.498+0000 7fd5e4e47640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:14.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.498+0000 7fd5e4e47640 1 -- 10.20.193.48:0/2428586987 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd5e0093ac0 msgr2=0x7fd5e008a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:14.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.498+0000 7fd5e4e47640 1 --2- 10.20.193.48:0/2428586987 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd5e0093ac0 0x7fd5e008a5b0 secure :-1 s=READY pgs=46 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd5d40093f0 tx=0x7fd5d400ed50 comp rx=0 tx=0).stop 2026-02-12T18:06:14.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.499+0000 7fd5e4e47640 1 -- 10.20.193.48:0/2428586987 shutdown_connections 2026-02-12T18:06:14.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.499+0000 7fd5e4e47640 1 --2- 10.20.193.48:0/2428586987 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd5e0141e90 0x7fd5e008b030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.499+0000 7fd5e4e47640 1 --2- 10.20.193.48:0/2428586987 >> v2:10.20.193.111:6812/977811348 conn(0x7fd5ac03f800 0x7fd5ac05fcb0 unknown :-1 s=CLOSED pgs=59 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.499+0000 7fd5e4e47640 1 --2- 10.20.193.48:0/2428586987 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd5e013e990 0x7fd5e008aaf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.499+0000 7fd5e4e47640 1 --2- 10.20.193.48:0/2428586987 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd5e0093ac0 0x7fd5e008a5b0 unknown :-1 s=CLOSED pgs=46 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.499+0000 7fd5e4e47640 1 -- 10.20.193.48:0/2428586987 >> 10.20.193.48:0/2428586987 conn(0x7fd5e0054b30 msgr2=0x7fd5e013d160 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:14.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.499+0000 7fd5e4e47640 1 -- 10.20.193.48:0/2428586987 shutdown_connections 2026-02-12T18:06:14.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.499+0000 7fd5e4e47640 1 -- 10.20.193.48:0/2428586987 wait complete. 2026-02-12T18:06:14.507 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2026-02-12T18:06:14.508 INFO:teuthology.run_tasks:Running task mon_thrash... 2026-02-12T18:06:14.532 INFO:tasks.mon_thrash:Beginning mon_thrash... 2026-02-12T18:06:14.533 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T18:06:14.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.598+0000 7fab3050c640 10 monclient: get_monmap_and_config 2026-02-12T18:06:14.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.598+0000 7fab3050c640 10 monclient: build_initial_monmap 2026-02-12T18:06:14.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.598+0000 7fab3050c640 10 monclient: monmap: 2026-02-12T18:06:14.600 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:14.600 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:14.600 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:14.599920+0000 2026-02-12T18:06:14.600 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:14.599920+0000 2026-02-12T18:06:14.600 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:14.600 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.600 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:14.600 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:14.600 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:14.600 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:14.600 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:14.601 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:14.601 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:14.601 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:14.601 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:14.601 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:14.601 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:14.601 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab3050c640 1 Processor -- start 2026-02-12T18:06:14.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab3050c640 1 -- start start 2026-02-12T18:06:14.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab3050c640 10 monclient: init 2026-02-12T18:06:14.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab3050c640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:14.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab3050c640 10 monclient: _add_conns ranks=[0,1,2,8,7,4,10,5,6,3,9] 2026-02-12T18:06:14.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab3050c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fab2805dc20 addr v1:10.20.193.48:6789/0 2026-02-12T18:06:14.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab3050c640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fab28144660 addr v1:10.20.193.111:6789/0 2026-02-12T18:06:14.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab3050c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fab28186c20 0x7fab281a7000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab3050c640 10 monclient(hunting): picked mon.noname-b con 0x7fab28186c20 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:14.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab3050c640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab28060390 con 0x7fab2805dc20 2026-02-12T18:06:14.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab3050c640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab28092200 con 0x7fab28144660 2026-02-12T18:06:14.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab3050c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab3050c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fab2808b250 con 0x7fab28186c20 2026-02-12T18:06:14.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab3050c640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:14.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab3050c640 10 monclient(hunting): authenticate will time out at 613.325638s 2026-02-12T18:06:14.617 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab2e281640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7fab2805dc20 0x7fab2805dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:34402/0 (socket says 10.20.193.48:34402) 2026-02-12T18:06:14.617 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab2e281640 1 -- 10.20.193.48:0/1071539449 learned_addr learned my addr 10.20.193.48:0/1071539449 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:06:14.617 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab2ea82640 1 --2- 10.20.193.48:0/1071539449 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fab28186c20 0x7fab281a7000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.617 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab2ea82640 10 monclient(hunting): get_auth_request con 0x7fab28186c20 auth_method 0 2026-02-12T18:06:14.617 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab2ea82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.617 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab2ea82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.617 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab2ea82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.617 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab2ea82640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:14.617 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab2ea82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:14.617 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab2ea82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:14.617 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab2ea82640 10 monclient(hunting): handle_auth_done global_id 34256 payload 274 2026-02-12T18:06:14.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab2ea82640 1 -- 10.20.193.48:0/1071539449 >> v1:10.20.193.111:6789/0 conn(0x7fab28144660 legacy=0x7fab28185500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:14.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab2ea82640 1 -- 10.20.193.48:0/1071539449 >> v1:10.20.193.48:6789/0 conn(0x7fab2805dc20 legacy=0x7fab2805dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:14.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab2ea82640 10 monclient: _finish_hunting 0 2026-02-12T18:06:14.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab2ea82640 1 monclient: found mon.noname-b 2026-02-12T18:06:14.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab2ea82640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:14.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab2ea82640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:06:14.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.599+0000 7fab2ea82640 1 -- 10.20.193.48:0/1071539449 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab28144a50 con 0x7fab28186c20 2026-02-12T18:06:14.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab2ea82640 1 -- 10.20.193.48:0/1071539449 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fab28186c20 msgr2=0x7fab281a7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:14.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab2ea82640 1 --2- 10.20.193.48:0/1071539449 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fab28186c20 0x7fab281a7000 secure :-1 s=READY pgs=31 gs=3 cs=0 l=1 c_cookie=5462349559971015475 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab280950d0 tx=0x7fab2402fe80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bce29fbe9156b33 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:14.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab2d27f640 1 -- 10.20.193.48:0/1071539449 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fab24030be0 con 0x7fab28186c20 2026-02-12T18:06:14.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab2d27f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:14.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab2d27f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:06:14.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab2d27f640 10 monclient: dump: 2026-02-12T18:06:14.619 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:14.619 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:14.619 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.619 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.619 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:14.619 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.619 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:14.619 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:14.619 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:14.619 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:14.620 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:14.620 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:14.620 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:14.620 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:14.620 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:14.620 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab2d27f640 10 monclient: _finish_auth 0 2026-02-12T18:06:14.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab2d27f640 10 monclient: _check_auth_tickets 2026-02-12T18:06:14.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab2d27f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:14.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab3050c640 5 monclient: authenticate success, global_id 34256 2026-02-12T18:06:14.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab2d27f640 1 -- 10.20.193.48:0/1071539449 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab24030d60 con 0x7fab28186c20 2026-02-12T18:06:14.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab3050c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:14.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab2d27f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:14.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab2d27f640 1 -- 10.20.193.48:0/1071539449 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fab24036cc0 con 0x7fab28186c20 2026-02-12T18:06:14.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab3050c640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:14.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab3050c640 4 set_mon_vals no callback set 2026-02-12T18:06:14.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab2d27f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:14.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab2d27f640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:06:14.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab2d27f640 10 monclient: dump: 2026-02-12T18:06:14.621 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:14.621 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:14.621 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.621 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.621 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:14.621 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.622 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:14.622 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:14.622 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:14.622 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:14.622 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:14.622 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:14.622 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:14.622 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:14.622 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:14.622 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab3050c640 10 monclient: shutdown 2026-02-12T18:06:14.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab3050c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:14.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab3050c640 1 -- 10.20.193.48:0/1071539449 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fab28186c20 msgr2=0x7fab281a7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:14.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab3050c640 1 --2- 10.20.193.48:0/1071539449 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fab28186c20 0x7fab281a7000 secure :-1 s=READY pgs=31 gs=3 cs=0 l=1 c_cookie=5462349559971015475 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab280950d0 tx=0x7fab2402fe80 comp rx=0 tx=0).stop 2026-02-12T18:06:14.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab3050c640 1 -- 10.20.193.48:0/1071539449 shutdown_connections 2026-02-12T18:06:14.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab3050c640 1 --2- 10.20.193.48:0/1071539449 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fab28186c20 0x7fab281a7000 unknown :-1 s=CLOSED pgs=31 gs=3 cs=0 l=1 c_cookie=5462349559971015475 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab3050c640 1 -- 10.20.193.48:0/1071539449 >> 10.20.193.48:0/1071539449 conn(0x7fab280546d0 msgr2=0x7fab28054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:14.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab3050c640 1 -- 10.20.193.48:0/1071539449 shutdown_connections 2026-02-12T18:06:14.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.602+0000 7fab3050c640 1 -- 10.20.193.48:0/1071539449 wait complete. 2026-02-12T18:06:14.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab3050c640 10 monclient: build_initial_monmap 2026-02-12T18:06:14.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab3050c640 10 monclient: monmap: 2026-02-12T18:06:14.623 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:14.623 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:14.624 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:14.624 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:14.624 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:14.624 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.624 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:14.624 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:14.624 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:14.624 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:14.624 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:14.624 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:14.624 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:14.624 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:14.624 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:14.625 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab3050c640 1 Processor -- start 2026-02-12T18:06:14.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab3050c640 1 -- start start 2026-02-12T18:06:14.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab3050c640 10 monclient: init 2026-02-12T18:06:14.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab3050c640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:14.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab3050c640 10 monclient: _add_conns ranks=[8,1,7,5,4,0,2,6,3] 2026-02-12T18:06:14.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab3050c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fab2805dc20 0x7fab28131340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab3050c640 10 monclient(hunting): picked mon.noname-e con 0x7fab2805dc20 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:14.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab3050c640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fab28144660 0x7fab28131880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab3050c640 10 monclient(hunting): picked mon.noname-f con 0x7fab28144660 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:06:14.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab3050c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fab28186c20 0x7fab2810eb80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab3050c640 10 monclient(hunting): picked mon.noname-i con 0x7fab28186c20 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:14.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab3050c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab3050c640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fab28141bc0 con 0x7fab28144660 2026-02-12T18:06:14.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab3050c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab3050c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fab2808e700 con 0x7fab28186c20 2026-02-12T18:06:14.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab3050c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab3050c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fab281122e0 con 0x7fab2805dc20 2026-02-12T18:06:14.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab3050c640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:14.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab3050c640 10 monclient(hunting): authenticate will time out at 613.329730s 2026-02-12T18:06:14.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab2e281640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fab2805dc20 0x7fab28131340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab2e281640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fab2805dc20 0x7fab28131340 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:53174/0 (socket says 10.20.193.48:53174) 2026-02-12T18:06:14.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab2e281640 1 -- 10.20.193.48:0/3679681855 learned_addr learned my addr 10.20.193.48:0/3679681855 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:14.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab2e281640 10 monclient(hunting): get_auth_request con 0x7fab2805dc20 auth_method 0 2026-02-12T18:06:14.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab2e281640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab2e281640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab2e281640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab2da80640 1 --2- 10.20.193.48:0/3679681855 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fab28144660 0x7fab28131880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab2ea82640 1 --2- 10.20.193.48:0/3679681855 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fab28186c20 0x7fab2810eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab2e281640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:14.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab2e281640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:14.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab2e281640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:14.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab2da80640 10 monclient(hunting): get_auth_request con 0x7fab28144660 auth_method 0 2026-02-12T18:06:14.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab2da80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab2da80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab2da80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab2ea82640 10 monclient(hunting): get_auth_request con 0x7fab28186c20 auth_method 0 2026-02-12T18:06:14.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab2ea82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab2ea82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.603+0000 7fab2ea82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.604+0000 7fab2da80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:14.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.604+0000 7fab2da80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:14.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.604+0000 7fab2da80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:14.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.604+0000 7fab2e281640 10 monclient(hunting): handle_auth_done global_id 4382 payload 824 2026-02-12T18:06:14.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.604+0000 7fab2e281640 1 -- 10.20.193.48:0/3679681855 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fab28186c20 msgr2=0x7fab2810eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:14.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.604+0000 7fab2e281640 1 --2- 10.20.193.48:0/3679681855 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fab28186c20 0x7fab2810eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.604+0000 7fab2e281640 1 -- 10.20.193.48:0/3679681855 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fab28144660 msgr2=0x7fab28131880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:14.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.604+0000 7fab2e281640 1 --2- 10.20.193.48:0/3679681855 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fab28144660 0x7fab28131880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.604+0000 7fab2e281640 10 monclient: _finish_hunting 0 2026-02-12T18:06:14.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.604+0000 7fab2e281640 1 monclient: found mon.noname-e 2026-02-12T18:06:14.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.604+0000 7fab2e281640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:14.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.604+0000 7fab2e281640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:06:14.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.604+0000 7fab2e281640 1 -- 10.20.193.48:0/3679681855 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab2400a500 con 0x7fab2805dc20 2026-02-12T18:06:14.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.606+0000 7fab2e281640 1 -- 10.20.193.48:0/3679681855 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fab2805dc20 msgr2=0x7fab28131340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:14.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.606+0000 7fab2e281640 1 --2- 10.20.193.48:0/3679681855 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fab2805dc20 0x7fab28131340 secure :-1 s=READY pgs=38 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab1800c4d0 tx=0x7fab1800c9a0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:14.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.606+0000 7fab0effd640 1 -- 10.20.193.48:0/3679681855 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fab18005db0 con 0x7fab2805dc20 2026-02-12T18:06:14.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.606+0000 7fab0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:14.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.606+0000 7fab0effd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:06:14.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.606+0000 7fab0effd640 10 monclient: dump: 2026-02-12T18:06:14.629 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:14.629 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:14.630 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.630 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.630 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:14.630 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.630 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:14.630 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:14.630 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:14.630 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:14.630 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:14.630 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:14.631 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:14.631 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:14.631 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:14.631 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.606+0000 7fab0effd640 10 monclient: _finish_auth 0 2026-02-12T18:06:14.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.606+0000 7fab0effd640 10 monclient: _check_auth_tickets 2026-02-12T18:06:14.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.606+0000 7fab0effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:14.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.606+0000 7fab0effd640 1 -- 10.20.193.48:0/3679681855 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab18007530 con 0x7fab2805dc20 2026-02-12T18:06:14.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.606+0000 7fab3050c640 5 monclient: authenticate success, global_id 4382 2026-02-12T18:06:14.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.606+0000 7fab3050c640 10 monclient: _renew_subs 2026-02-12T18:06:14.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.606+0000 7fab3050c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:14.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.606+0000 7fab3050c640 1 -- 10.20.193.48:0/3679681855 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab28112870 con 0x7fab2805dc20 2026-02-12T18:06:14.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.606+0000 7fab0effd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:14.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.606+0000 7fab0effd640 1 -- 10.20.193.48:0/3679681855 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fab180076a0 con 0x7fab2805dc20 2026-02-12T18:06:14.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.606+0000 7fab0effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:14.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.606+0000 7fab2ca7e640 4 set_mon_vals no callback set 2026-02-12T18:06:14.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.606+0000 7fab0effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:06:14.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.606+0000 7fab0effd640 10 monclient: dump: 2026-02-12T18:06:14.632 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:14.632 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:14.632 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.632 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.632 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:14.632 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.632 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:14.632 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:14.632 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:14.633 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:14.633 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:14.633 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:14.633 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:14.633 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:14.633 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:14.633 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.606+0000 7fab3050c640 10 monclient: _renew_subs 2026-02-12T18:06:14.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.606+0000 7fab3050c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:14.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.606+0000 7fab3050c640 1 -- 10.20.193.48:0/3679681855 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fab28111f70 con 0x7fab2805dc20 2026-02-12T18:06:14.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.607+0000 7fab3050c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:14.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.607+0000 7fab3050c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:14.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.607+0000 7fab3050c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:14.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.607+0000 7fab3050c640 1 -- 10.20.193.48:0/3679681855 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab28092510 con 0x7fab2805dc20 2026-02-12T18:06:14.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.607+0000 7fab0effd640 1 -- 10.20.193.48:0/3679681855 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fab18007070 con 0x7fab2805dc20 2026-02-12T18:06:14.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.607+0000 7fab0effd640 1 --2- 10.20.193.48:0/3679681855 >> v2:10.20.193.111:6812/977811348 conn(0x7faaf803f800 0x7faaf805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.607+0000 7fab0effd640 1 -- 10.20.193.48:0/3679681855 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7fab18051f00 con 0x7fab2805dc20 2026-02-12T18:06:14.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.607+0000 7fab2da80640 1 --2- 10.20.193.48:0/3679681855 >> v2:10.20.193.111:6812/977811348 conn(0x7faaf803f800 0x7faaf805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.607+0000 7fab2da80640 10 monclient: get_auth_request con 0x7faaf803f800 auth_method 0 2026-02-12T18:06:14.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.609+0000 7fab0effd640 1 -- 10.20.193.48:0/3679681855 <== mon.8 v2:10.20.193.48:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fab1801bab0 con 0x7fab2805dc20 2026-02-12T18:06:14.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.609+0000 7fab0effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:14.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.609+0000 7fab0effd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:14.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.610+0000 7fab2da80640 1 --2- 10.20.193.48:0/3679681855 >> v2:10.20.193.111:6812/977811348 conn(0x7faaf803f800 0x7faaf805fcb0 secure :-1 s=READY pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab28110b20 tx=0x7fab1c007ec0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:14.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.716+0000 7fab3050c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-12T18:06:14.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.716+0000 7fab3050c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T18:06:14.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.716+0000 7fab3050c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:14.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.716+0000 7fab3050c640 1 -- 10.20.193.48:0/3679681855 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fab2805dff0 con 0x7fab2805dc20 2026-02-12T18:06:14.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.716+0000 7fab0effd640 1 -- 10.20.193.48:0/3679681855 <== mon.8 v2:10.20.193.48:3304/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+10924 (secure 0 0 0) 0x7fab18017020 con 0x7fab2805dc20 2026-02-12T18:06:14.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.716+0000 7fab0effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T18:06:14.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.716+0000 7fab0effd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:14.718 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:06:14.718 INFO:teuthology.orchestra.run.trial048.stdout:{"epoch":18,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","created":"2026-02-12T18:05:56.090643+0000","modified":"2026-02-12T18:06:11.284799+0000","last_up_change":"2026-02-12T18:06:02.768915+0000","last_in_change":"2026-02-12T18:05:57.981781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T18:06:02.611941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-12T18:06:07.373478+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8255145-baf3-4c84-9a14-58a24c915493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6801","nonce":447356640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6803","nonce":447356640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6807","nonce":447356640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6806","nonce":447356640}]},"public_addr":"10.20.193.48:6801/447356640","cluster_addr":"10.20.193.48:6803/447356640","heartbeat_back_addr":"10.20.193.48:6807/447356640","heartbeat_front_addr":"10.20.193.48:6806/447356640","state":["exists","up"]},{"osd":1,"uuid":"4cf3730c-446c-4c4f-baf9-b354e06bf2b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6808","nonce":3694032686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6809","nonce":3694032686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6811","nonce":3694032686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6810","nonce":3694032686}]},"public_addr":"10.20.193.48:6808/3694032686","cluster_addr":"10.20.193.48:6809/3694032686","heartbeat_back_addr":"10.20.193.48:6811/3694032686","heartbeat_front_addr":"10.20.193.48:6810/3694032686","state":["exists","up"]},{"osd":2,"uuid":"4ca2a3bb-4801-48eb-9814-12473a6c12bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6800","nonce":2690693575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6802","nonce":2690693575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6805","nonce":2690693575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6804","nonce":2690693575}]},"public_addr":"10.20.193.48:6800/2690693575","cluster_addr":"10.20.193.48:6802/2690693575","heartbeat_back_addr":"10.20.193.48:6805/2690693575","heartbeat_front_addr":"10.20.193.48:6804/2690693575","state":["exists","up"]},{"osd":3,"uuid":"e64b1a76-9d2c-4c4a-bd2d-7b5b8c1df21e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6800","nonce":449363714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6801","nonce":449363714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6803","nonce":449363714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6802","nonce":449363714}]},"public_addr":"10.20.193.111:6800/449363714","cluster_addr":"10.20.193.111:6801/449363714","heartbeat_back_addr":"10.20.193.111:6803/449363714","heartbeat_front_addr":"10.20.193.111:6802/449363714","state":["exists","up"]},{"osd":4,"uuid":"ad82216b-0e68-44da-a293-d4c97dec6b79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6808","nonce":3554486394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6809","nonce":3554486394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6811","nonce":3554486394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6810","nonce":3554486394}]},"public_addr":"10.20.193.111:6808/3554486394","cluster_addr":"10.20.193.111:6809/3554486394","heartbeat_back_addr":"10.20.193.111:6811/3554486394","heartbeat_front_addr":"10.20.193.111:6810/3554486394","state":["exists","up"]},{"osd":5,"uuid":"accc3f03-6123-444b-8c5a-42e927b0ed23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6804","nonce":1701961573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6805","nonce":1701961573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6807","nonce":1701961573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6806","nonce":1701961573}]},"public_addr":"10.20.193.111:6804/1701961573","cluster_addr":"10.20.193.111:6805/1701961573","heartbeat_back_addr":"10.20.193.111:6807/1701961573","heartbeat_front_addr":"10.20.193.111:6806/1701961573","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T18:05:59.805170+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T18:05:59.787798+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T18:05:59.791881+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T18:06:14.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.718+0000 7fab3050c640 1 -- 10.20.193.48:0/3679681855 >> v2:10.20.193.111:6812/977811348 conn(0x7faaf803f800 msgr2=0x7faaf805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:14.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.718+0000 7fab3050c640 1 --2- 10.20.193.48:0/3679681855 >> v2:10.20.193.111:6812/977811348 conn(0x7faaf803f800 0x7faaf805fcb0 secure :-1 s=READY pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab28110b20 tx=0x7fab1c007ec0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.718+0000 7fab3050c640 10 monclient: shutdown 2026-02-12T18:06:14.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.718+0000 7fab3050c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:14.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.718+0000 7fab3050c640 1 -- 10.20.193.48:0/3679681855 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fab2805dc20 msgr2=0x7fab28131340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:14.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.718+0000 7fab3050c640 1 --2- 10.20.193.48:0/3679681855 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fab2805dc20 0x7fab28131340 secure :-1 s=READY pgs=38 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fab1800c4d0 tx=0x7fab1800c9a0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.718+0000 7fab3050c640 1 -- 10.20.193.48:0/3679681855 shutdown_connections 2026-02-12T18:06:14.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.718+0000 7fab3050c640 1 --2- 10.20.193.48:0/3679681855 >> v2:10.20.193.111:6812/977811348 conn(0x7faaf803f800 0x7faaf805fcb0 unknown :-1 s=CLOSED pgs=60 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.718+0000 7fab3050c640 1 --2- 10.20.193.48:0/3679681855 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fab28186c20 0x7fab2810eb80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.718+0000 7fab3050c640 1 --2- 10.20.193.48:0/3679681855 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fab28144660 0x7fab28131880 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.718+0000 7fab3050c640 1 --2- 10.20.193.48:0/3679681855 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fab2805dc20 0x7fab28131340 unknown :-1 s=CLOSED pgs=38 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.718+0000 7fab3050c640 1 -- 10.20.193.48:0/3679681855 >> 10.20.193.48:0/3679681855 conn(0x7fab280546d0 msgr2=0x7fab2808b480 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:14.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.718+0000 7fab3050c640 1 -- 10.20.193.48:0/3679681855 shutdown_connections 2026-02-12T18:06:14.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.718+0000 7fab3050c640 1 -- 10.20.193.48:0/3679681855 wait complete. 2026-02-12T18:06:14.729 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2026-02-12T18:06:02.611941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2026-02-12T18:06:07.373478+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 18, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'nonprimary_shards': '{}', 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2026-02-12T18:06:14.729 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2026-02-12T18:06:14.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.797+0000 7f916e1d2640 10 monclient: get_monmap_and_config 2026-02-12T18:06:14.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.797+0000 7f916e1d2640 10 monclient: build_initial_monmap 2026-02-12T18:06:14.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.797+0000 7f916e1d2640 10 monclient: monmap: 2026-02-12T18:06:14.801 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:14.801 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:14.801 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:14.798484+0000 2026-02-12T18:06:14.801 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:14.798484+0000 2026-02-12T18:06:14.801 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:14.801 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.801 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:14.801 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:14.801 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:14.801 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:14.801 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:14.802 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:14.802 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:14.802 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:14.802 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:14.802 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:14.802 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:14.802 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.797+0000 7f916e1d2640 1 Processor -- start 2026-02-12T18:06:14.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.797+0000 7f916e1d2640 1 -- start start 2026-02-12T18:06:14.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.797+0000 7f916e1d2640 10 monclient: init 2026-02-12T18:06:14.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f916e1d2640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:14.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f916e1d2640 10 monclient: _add_conns ranks=[9,3,5,10,0,4,2,1,6,8,7] 2026-02-12T18:06:14.803 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f916e1d2640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f9168090070 0x7f916805d630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.803 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f916e1d2640 10 monclient(hunting): picked mon.noname-a con 0x7f9168090070 addr v2:10.20.193.48:3300/0 2026-02-12T18:06:14.803 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f916e1d2640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f916808cf80 0x7f916805db70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.803 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f916e1d2640 10 monclient(hunting): picked mon.noname-g con 0x7f916808cf80 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:14.803 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f916e1d2640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9168141fa0 0x7f9168142440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.803 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f916e1d2640 10 monclient(hunting): picked mon.noname-h con 0x7f9168141fa0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:14.803 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f916e1d2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.803 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f916e1d2640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f9168057de0 con 0x7f9168090070 2026-02-12T18:06:14.803 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f916e1d2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.803 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f916e1d2640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f9168090440 con 0x7f916808cf80 2026-02-12T18:06:14.803 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f916e1d2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f916e1d2640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f916813f130 con 0x7f9168141fa0 2026-02-12T18:06:14.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f916e1d2640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:14.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f916e1d2640 10 monclient(hunting): authenticate will time out at 613.524215s 2026-02-12T18:06:14.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f91677fe640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f9168090070 0x7f916805d630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f91677fe640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f9168090070 0x7f916805d630 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:57074/0 (socket says 10.20.193.48:57074) 2026-02-12T18:06:14.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f91677fe640 1 -- 10.20.193.48:0/4047151647 learned_addr learned my addr 10.20.193.48:0/4047151647 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:14.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f91677fe640 10 monclient(hunting): get_auth_request con 0x7f9168090070 auth_method 0 2026-02-12T18:06:14.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f91677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f91677fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f91677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f91677fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:14.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f91677fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:14.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f9167fff640 1 --2- 10.20.193.48:0/4047151647 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9168141fa0 0x7f9168142440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f91677fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:14.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f9167fff640 10 monclient(hunting): get_auth_request con 0x7f9168141fa0 auth_method 0 2026-02-12T18:06:14.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f9167fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f9167fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f9167fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f9166ffd640 1 --2- 10.20.193.48:0/4047151647 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f916808cf80 0x7f916805db70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f9166ffd640 10 monclient(hunting): get_auth_request con 0x7f916808cf80 auth_method 0 2026-02-12T18:06:14.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f9166ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f9166ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f9166ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f91677fe640 10 monclient(hunting): handle_auth_done global_id 4428 payload 274 2026-02-12T18:06:14.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f91677fe640 1 -- 10.20.193.48:0/4047151647 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9168141fa0 msgr2=0x7f9168142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:14.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f91677fe640 1 --2- 10.20.193.48:0/4047151647 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9168141fa0 0x7f9168142440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f91677fe640 1 -- 10.20.193.48:0/4047151647 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f916808cf80 msgr2=0x7f916805db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:14.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f91677fe640 1 --2- 10.20.193.48:0/4047151647 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f916808cf80 0x7f916805db70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f91677fe640 10 monclient: _finish_hunting 0 2026-02-12T18:06:14.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f91677fe640 1 monclient: found mon.noname-a 2026-02-12T18:06:14.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f91677fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:14.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f91677fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:06:14.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f91677fe640 1 -- 10.20.193.48:0/4047151647 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f916804dc20 con 0x7f9168090070 2026-02-12T18:06:14.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.798+0000 7f9167fff640 1 --2- 10.20.193.48:0/4047151647 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9168141fa0 0x7f9168142440 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:06:14.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f91677fe640 1 -- 10.20.193.48:0/4047151647 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9168090070 msgr2=0x7f916805d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:14.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f91677fe640 1 --2- 10.20.193.48:0/4047151647 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9168090070 0x7f916805d630 secure :-1 s=READY pgs=74 gs=1 cs=0 l=1 c_cookie=5055299909384336578 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9154009060 tx=0x7f915402edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4628087bc3eaf4c2 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:14.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f91667fc640 1 -- 10.20.193.48:0/4047151647 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9154035340 con 0x7f9168090070 2026-02-12T18:06:14.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f91667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:14.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f91667fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:06:14.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f91667fc640 10 monclient: dump: 2026-02-12T18:06:14.814 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:14.814 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:14.814 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.814 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.814 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:14.814 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.814 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:14.814 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:14.814 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:14.815 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:14.815 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:14.815 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:14.815 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:14.815 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:14.815 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:14.815 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f91667fc640 10 monclient: _finish_auth 0 2026-02-12T18:06:14.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f91667fc640 10 monclient: _check_auth_tickets 2026-02-12T18:06:14.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f91667fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:14.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f916e1d2640 5 monclient: authenticate success, global_id 4428 2026-02-12T18:06:14.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f91667fc640 1 -- 10.20.193.48:0/4047151647 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91540354c0 con 0x7f9168090070 2026-02-12T18:06:14.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f91667fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:14.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f91667fc640 1 -- 10.20.193.48:0/4047151647 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9154035af0 con 0x7f9168090070 2026-02-12T18:06:14.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f916e1d2640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:14.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f916e1d2640 4 set_mon_vals no callback set 2026-02-12T18:06:14.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f91667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:14.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f91667fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:14.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f91667fc640 10 monclient: dump: 2026-02-12T18:06:14.816 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:14.816 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:14.816 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.816 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.816 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:14.816 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.817 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:14.817 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:14.817 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:14.817 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:14.817 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:14.817 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:14.817 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:14.817 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:14.817 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:14.817 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f916e1d2640 10 monclient: shutdown 2026-02-12T18:06:14.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f916e1d2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:14.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f916e1d2640 1 -- 10.20.193.48:0/4047151647 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9168090070 msgr2=0x7f916805d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:14.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f916e1d2640 1 --2- 10.20.193.48:0/4047151647 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9168090070 0x7f916805d630 secure :-1 s=READY pgs=74 gs=1 cs=0 l=1 c_cookie=5055299909384336578 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9154009060 tx=0x7f915402edf0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f916e1d2640 1 -- 10.20.193.48:0/4047151647 shutdown_connections 2026-02-12T18:06:14.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f916e1d2640 1 --2- 10.20.193.48:0/4047151647 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9168141fa0 0x7f9168142440 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f916e1d2640 1 --2- 10.20.193.48:0/4047151647 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f916808cf80 0x7f916805db70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f916e1d2640 1 --2- 10.20.193.48:0/4047151647 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9168090070 0x7f916805d630 unknown :-1 s=CLOSED pgs=74 gs=1 cs=0 l=1 c_cookie=5055299909384336578 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f916e1d2640 1 -- 10.20.193.48:0/4047151647 >> 10.20.193.48:0/4047151647 conn(0x7f91680546a0 msgr2=0x7f9168054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:14.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f916e1d2640 1 -- 10.20.193.48:0/4047151647 shutdown_connections 2026-02-12T18:06:14.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.801+0000 7f916e1d2640 1 -- 10.20.193.48:0/4047151647 wait complete. 2026-02-12T18:06:14.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f916e1d2640 10 monclient: build_initial_monmap 2026-02-12T18:06:14.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f916e1d2640 10 monclient: monmap: 2026-02-12T18:06:14.818 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:14.818 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:14.819 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:14.819 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:14.819 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:14.819 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.819 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:14.819 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:14.819 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:14.819 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:14.819 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:14.819 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:14.819 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:14.819 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:14.820 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:14.820 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f916e1d2640 1 Processor -- start 2026-02-12T18:06:14.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f916e1d2640 1 -- start start 2026-02-12T18:06:14.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f916e1d2640 10 monclient: init 2026-02-12T18:06:14.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f916e1d2640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:14.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f916e1d2640 10 monclient: _add_conns ranks=[0,5,3,6,8,2,4,7,1] 2026-02-12T18:06:14.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f916e1d2640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f916808cf80 0x7f9168112960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f916e1d2640 10 monclient(hunting): picked mon.noname-a con 0x7f916808cf80 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:06:14.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f916e1d2640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9168090070 0x7f9168112ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f916e1d2640 10 monclient(hunting): picked mon.noname-h con 0x7f9168090070 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:14.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f916e1d2640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9168141fa0 0x7f91681133e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f916e1d2640 10 monclient(hunting): picked mon.noname-g con 0x7f9168141fa0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:14.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f916e1d2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f916e1d2640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f9168129810 con 0x7f916808cf80 2026-02-12T18:06:14.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f916e1d2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f916e1d2640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f9168129dd0 con 0x7f9168141fa0 2026-02-12T18:06:14.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f916e1d2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f916e1d2640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f91681286e0 con 0x7f9168090070 2026-02-12T18:06:14.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f916e1d2640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:14.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f916e1d2640 10 monclient(hunting): authenticate will time out at 613.528684s 2026-02-12T18:06:14.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f91677fe640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f916808cf80 0x7f9168112960 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f91677fe640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f916808cf80 0x7f9168112960 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:57086/0 (socket says 10.20.193.48:57086) 2026-02-12T18:06:14.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f91677fe640 1 -- 10.20.193.48:0/4062901277 learned_addr learned my addr 10.20.193.48:0/4062901277 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:14.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f91677fe640 10 monclient(hunting): get_auth_request con 0x7f916808cf80 auth_method 0 2026-02-12T18:06:14.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f91677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f91677fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f91677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f91677fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:14.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f91677fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:14.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f91677fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:14.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f9166ffd640 1 --2- 10.20.193.48:0/4062901277 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9168090070 0x7f9168112ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f9166ffd640 10 monclient(hunting): get_auth_request con 0x7f9168090070 auth_method 0 2026-02-12T18:06:14.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f9166ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f9166ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f9166ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f9167fff640 1 --2- 10.20.193.48:0/4062901277 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9168141fa0 0x7f91681133e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f9167fff640 10 monclient(hunting): get_auth_request con 0x7f9168141fa0 auth_method 0 2026-02-12T18:06:14.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f9167fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f9167fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f9167fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f91677fe640 10 monclient(hunting): handle_auth_done global_id 4437 payload 824 2026-02-12T18:06:14.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f91677fe640 1 -- 10.20.193.48:0/4062901277 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9168090070 msgr2=0x7f9168112ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:14.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f91677fe640 1 --2- 10.20.193.48:0/4062901277 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9168090070 0x7f9168112ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f91677fe640 1 -- 10.20.193.48:0/4062901277 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9168141fa0 msgr2=0x7f91681133e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:14.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f91677fe640 1 --2- 10.20.193.48:0/4062901277 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9168141fa0 0x7f91681133e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f91677fe640 10 monclient: _finish_hunting 0 2026-02-12T18:06:14.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f91677fe640 1 monclient: found mon.noname-a 2026-02-12T18:06:14.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f91677fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:14.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f91677fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:06:14.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.802+0000 7f91677fe640 1 -- 10.20.193.48:0/4062901277 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91540094f0 con 0x7f916808cf80 2026-02-12T18:06:14.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.805+0000 7f91677fe640 1 -- 10.20.193.48:0/4062901277 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f916808cf80 msgr2=0x7f9168112960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:14.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.805+0000 7f91677fe640 1 --2- 10.20.193.48:0/4062901277 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f916808cf80 0x7f9168112960 secure :-1 s=READY pgs=75 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9154004740 tx=0x7f9154004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:14.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.805+0000 7f9143fff640 1 -- 10.20.193.48:0/4062901277 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9154035e00 con 0x7f916808cf80 2026-02-12T18:06:14.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.805+0000 7f9143fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:14.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.805+0000 7f9143fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:06:14.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.805+0000 7f9143fff640 10 monclient: dump: 2026-02-12T18:06:14.824 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:14.824 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:14.824 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.824 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.824 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:14.825 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.825 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:14.825 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:14.825 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:14.825 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:14.825 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:14.825 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:14.825 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:14.825 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:14.825 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:14.825 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.805+0000 7f9143fff640 10 monclient: _finish_auth 0 2026-02-12T18:06:14.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.805+0000 7f9143fff640 10 monclient: _check_auth_tickets 2026-02-12T18:06:14.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.805+0000 7f9143fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:14.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.805+0000 7f9143fff640 1 -- 10.20.193.48:0/4062901277 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91540044f0 con 0x7f916808cf80 2026-02-12T18:06:14.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.805+0000 7f916e1d2640 5 monclient: authenticate success, global_id 4437 2026-02-12T18:06:14.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.805+0000 7f916e1d2640 10 monclient: _renew_subs 2026-02-12T18:06:14.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.805+0000 7f916e1d2640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:14.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.805+0000 7f916e1d2640 1 -- 10.20.193.48:0/4062901277 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9168127a70 con 0x7f916808cf80 2026-02-12T18:06:14.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.805+0000 7f9143fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:14.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.805+0000 7f9143fff640 1 -- 10.20.193.48:0/4062901277 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9154003b90 con 0x7f916808cf80 2026-02-12T18:06:14.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.805+0000 7f9143fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:14.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.805+0000 7f9165ffb640 4 set_mon_vals no callback set 2026-02-12T18:06:14.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.805+0000 7f9143fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:14.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.805+0000 7f9143fff640 10 monclient: dump: 2026-02-12T18:06:14.827 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:14.827 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:14.827 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.827 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:14.827 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:14.827 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.827 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:14.827 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:14.827 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:14.827 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:14.827 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:14.827 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:14.827 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:14.828 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:14.828 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:14.828 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.805+0000 7f916e1d2640 10 monclient: _renew_subs 2026-02-12T18:06:14.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.805+0000 7f916e1d2640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:14.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.805+0000 7f916e1d2640 1 -- 10.20.193.48:0/4062901277 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9168128910 con 0x7f916808cf80 2026-02-12T18:06:14.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.806+0000 7f916e1d2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:14.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.806+0000 7f916e1d2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:14.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.806+0000 7f916e1d2640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:14.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.806+0000 7f9143fff640 1 -- 10.20.193.48:0/4062901277 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f9154003cf0 con 0x7f916808cf80 2026-02-12T18:06:14.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.806+0000 7f916e1d2640 1 -- 10.20.193.48:0/4062901277 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f916805d630 con 0x7f916808cf80 2026-02-12T18:06:14.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.806+0000 7f9143fff640 1 --2- 10.20.193.48:0/4062901277 >> v2:10.20.193.111:6812/977811348 conn(0x7f913803f800 0x7f913805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.806+0000 7f9143fff640 1 -- 10.20.193.48:0/4062901277 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7f9154077eb0 con 0x7f916808cf80 2026-02-12T18:06:14.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.806+0000 7f9166ffd640 1 --2- 10.20.193.48:0/4062901277 >> v2:10.20.193.111:6812/977811348 conn(0x7f913803f800 0x7f913805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.806+0000 7f9166ffd640 10 monclient: get_auth_request con 0x7f913803f800 auth_method 0 2026-02-12T18:06:14.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.808+0000 7f9143fff640 1 -- 10.20.193.48:0/4062901277 <== mon.0 v2:10.20.193.48:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f915403fb90 con 0x7f916808cf80 2026-02-12T18:06:14.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.808+0000 7f9143fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:14.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.808+0000 7f9143fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:14.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.808+0000 7f9166ffd640 1 --2- 10.20.193.48:0/4062901277 >> v2:10.20.193.111:6812/977811348 conn(0x7f913803f800 0x7f913805fcb0 secure :-1 s=READY pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9168127870 tx=0x7f9158008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:14.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.912+0000 7f916e1d2640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-12T18:06:14.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.912+0000 7f916e1d2640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-12T18:06:14.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.912+0000 7f916e1d2640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:14.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.912+0000 7f916e1d2640 1 -- 10.20.193.48:0/4062901277 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f916805ccf0 con 0x7f916808cf80 2026-02-12T18:06:14.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.913+0000 7f9143fff640 1 -- 10.20.193.48:0/4062901277 <== mon.0 v2:10.20.193.48:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) ==== 93+0+10 (secure 0 0 0) 0x7f9154074e60 con 0x7f916808cf80 2026-02-12T18:06:14.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.913+0000 7f9143fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2026-02-12T18:06:14.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.913+0000 7f9143fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:14.915 INFO:teuthology.orchestra.run.trial048.stdout:pg_num: 1 2026-02-12T18:06:14.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.914+0000 7f916e1d2640 1 -- 10.20.193.48:0/4062901277 >> v2:10.20.193.111:6812/977811348 conn(0x7f913803f800 msgr2=0x7f913805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:14.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.914+0000 7f916e1d2640 1 --2- 10.20.193.48:0/4062901277 >> v2:10.20.193.111:6812/977811348 conn(0x7f913803f800 0x7f913805fcb0 secure :-1 s=READY pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9168127870 tx=0x7f9158008040 comp rx=0 tx=0).stop 2026-02-12T18:06:14.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.914+0000 7f916e1d2640 10 monclient: shutdown 2026-02-12T18:06:14.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.914+0000 7f916e1d2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:14.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.914+0000 7f916e1d2640 1 -- 10.20.193.48:0/4062901277 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f916808cf80 msgr2=0x7f9168112960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:14.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.914+0000 7f916e1d2640 1 --2- 10.20.193.48:0/4062901277 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f916808cf80 0x7f9168112960 secure :-1 s=READY pgs=75 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9154004740 tx=0x7f9154004770 comp rx=0 tx=0).stop 2026-02-12T18:06:14.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.914+0000 7f916e1d2640 1 -- 10.20.193.48:0/4062901277 shutdown_connections 2026-02-12T18:06:14.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.914+0000 7f916e1d2640 1 --2- 10.20.193.48:0/4062901277 >> v2:10.20.193.111:6812/977811348 conn(0x7f913803f800 0x7f913805fcb0 unknown :-1 s=CLOSED pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.914+0000 7f916e1d2640 1 --2- 10.20.193.48:0/4062901277 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9168141fa0 0x7f91681133e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.914+0000 7f916e1d2640 1 --2- 10.20.193.48:0/4062901277 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9168090070 0x7f9168112ea0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.914+0000 7f916e1d2640 1 --2- 10.20.193.48:0/4062901277 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f916808cf80 0x7f9168112960 unknown :-1 s=CLOSED pgs=75 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.914+0000 7f916e1d2640 1 -- 10.20.193.48:0/4062901277 >> 10.20.193.48:0/4062901277 conn(0x7f91680546a0 msgr2=0x7f916808a680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:14.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.914+0000 7f916e1d2640 1 -- 10.20.193.48:0/4062901277 shutdown_connections 2026-02-12T18:06:14.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.914+0000 7f916e1d2640 1 -- 10.20.193.48:0/4062901277 wait complete. 2026-02-12T18:06:14.923 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2026-02-12T18:06:14.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.987+0000 7faf87283640 10 monclient: get_monmap_and_config 2026-02-12T18:06:14.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.987+0000 7faf87283640 10 monclient: build_initial_monmap 2026-02-12T18:06:14.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.987+0000 7faf87283640 10 monclient: monmap: 2026-02-12T18:06:14.991 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:14.991 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:14.991 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:14.988502+0000 2026-02-12T18:06:14.991 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:14.988502+0000 2026-02-12T18:06:14.991 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:14.991 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:14.991 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:14.991 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:14.992 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:14.992 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:14.992 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:14.992 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:14.992 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:14.992 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:14.992 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:14.992 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:14.992 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:14.992 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:14.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.987+0000 7faf87283640 1 Processor -- start 2026-02-12T18:06:14.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.987+0000 7faf87283640 1 -- start start 2026-02-12T18:06:14.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.987+0000 7faf87283640 10 monclient: init 2026-02-12T18:06:14.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf87283640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:14.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf87283640 10 monclient: _add_conns ranks=[6,9,3,2,7,5,10,8,0,1,4] 2026-02-12T18:06:14.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf87283640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7faf800914d0 0x7faf8005c950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf87283640 10 monclient(hunting): picked mon.noname-d con 0x7faf800914d0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:06:14.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf87283640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7faf8008e210 0x7faf8005ce90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf87283640 10 monclient(hunting): picked mon.noname-a con 0x7faf8008e210 addr v2:10.20.193.48:3300/0 2026-02-12T18:06:14.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf87283640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7faf8005e4b0 0x7faf8005d3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:14.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf87283640 10 monclient(hunting): picked mon.noname-g con 0x7faf8005e4b0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:14.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf87283640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf87283640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7faf80093d70 con 0x7faf8008e210 2026-02-12T18:06:14.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf87283640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf87283640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7faf80092f90 con 0x7faf8005e4b0 2026-02-12T18:06:14.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf87283640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:14.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf87283640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7faf800918a0 con 0x7faf800914d0 2026-02-12T18:06:14.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf87283640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:14.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf87283640 10 monclient(hunting): authenticate will time out at 613.714242s 2026-02-12T18:06:14.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf84ff8640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7faf800914d0 0x7faf8005c950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf77fff640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7faf8008e210 0x7faf8005ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf84ff8640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7faf800914d0 0x7faf8005c950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:36050/0 (socket says 10.20.193.48:36050) 2026-02-12T18:06:14.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf84ff8640 1 -- 10.20.193.48:0/284740740 learned_addr learned my addr 10.20.193.48:0/284740740 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:14.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf84ff8640 10 monclient(hunting): get_auth_request con 0x7faf800914d0 auth_method 0 2026-02-12T18:06:14.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf84ff8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf84ff8640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf84ff8640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf77fff640 10 monclient(hunting): get_auth_request con 0x7faf8008e210 auth_method 0 2026-02-12T18:06:14.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf77fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf77fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf84ff8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:14.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf84ff8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:14.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf84ff8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:14.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf77fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:14.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf77fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:14.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf857f9640 1 --2- 10.20.193.48:0/284740740 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7faf8005e4b0 0x7faf8005d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:14.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf77fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:14.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf857f9640 10 monclient(hunting): get_auth_request con 0x7faf8005e4b0 auth_method 0 2026-02-12T18:06:14.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf857f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:14.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf857f9640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:14.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf857f9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:14.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf77fff640 10 monclient(hunting): handle_auth_done global_id 4446 payload 274 2026-02-12T18:06:14.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf77fff640 1 -- 10.20.193.48:0/284740740 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7faf800914d0 msgr2=0x7faf8005c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:14.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf77fff640 1 --2- 10.20.193.48:0/284740740 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7faf800914d0 0x7faf8005c950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf77fff640 1 -- 10.20.193.48:0/284740740 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7faf8005e4b0 msgr2=0x7faf8005d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:14.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf77fff640 1 --2- 10.20.193.48:0/284740740 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7faf8005e4b0 0x7faf8005d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:14.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf77fff640 10 monclient: _finish_hunting 0 2026-02-12T18:06:14.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf77fff640 1 monclient: found mon.noname-a 2026-02-12T18:06:14.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf77fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:14.997 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf77fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:06:14.997 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf77fff640 1 -- 10.20.193.48:0/284740740 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8004dc20 con 0x7faf8008e210 2026-02-12T18:06:14.997 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf84ff8640 1 --2- 10.20.193.48:0/284740740 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7faf800914d0 0x7faf8005c950 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:06:14.997 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.988+0000 7faf857f9640 1 --2- 10.20.193.48:0/284740740 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7faf8005e4b0 0x7faf8005d3d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:06:15.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.990+0000 7faf77fff640 1 -- 10.20.193.48:0/284740740 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7faf8008e210 msgr2=0x7faf8005ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:15.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.990+0000 7faf77fff640 1 --2- 10.20.193.48:0/284740740 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7faf8008e210 0x7faf8005ce90 secure :-1 s=READY pgs=76 gs=2 cs=0 l=1 c_cookie=2627746290852906748 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf68009800 tx=0x7faf6802ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2477a154422346fc server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:15.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf777fe640 1 -- 10.20.193.48:0/284740740 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7faf6802fe50 con 0x7faf8008e210 2026-02-12T18:06:15.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf777fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:15.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf777fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:06:15.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf777fe640 10 monclient: dump: 2026-02-12T18:06:15.004 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:15.004 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:15.004 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.004 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.004 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:15.004 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.004 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:15.004 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:15.004 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:15.004 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:15.005 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:15.005 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:15.005 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:15.005 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:15.005 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:15.005 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf777fe640 10 monclient: _finish_auth 0 2026-02-12T18:06:15.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf777fe640 10 monclient: _check_auth_tickets 2026-02-12T18:06:15.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf777fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:15.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf777fe640 1 -- 10.20.193.48:0/284740740 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf68035340 con 0x7faf8008e210 2026-02-12T18:06:15.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf777fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:15.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf777fe640 1 -- 10.20.193.48:0/284740740 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7faf68035970 con 0x7faf8008e210 2026-02-12T18:06:15.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf87283640 5 monclient: authenticate success, global_id 4446 2026-02-12T18:06:15.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf87283640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:15.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf87283640 4 set_mon_vals no callback set 2026-02-12T18:06:15.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf777fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:15.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf777fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:15.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf777fe640 10 monclient: dump: 2026-02-12T18:06:15.006 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:15.006 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:15.006 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.006 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.006 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:15.006 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.007 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:15.007 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:15.007 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:15.007 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:15.007 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:15.007 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:15.007 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:15.007 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:15.007 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:15.007 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf87283640 10 monclient: shutdown 2026-02-12T18:06:15.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf87283640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:15.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf87283640 1 -- 10.20.193.48:0/284740740 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7faf8008e210 msgr2=0x7faf8005ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:15.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf87283640 1 --2- 10.20.193.48:0/284740740 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7faf8008e210 0x7faf8005ce90 secure :-1 s=READY pgs=76 gs=2 cs=0 l=1 c_cookie=2627746290852906748 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf68009800 tx=0x7faf6802ed10 comp rx=0 tx=0).stop 2026-02-12T18:06:15.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf87283640 1 -- 10.20.193.48:0/284740740 shutdown_connections 2026-02-12T18:06:15.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf87283640 1 --2- 10.20.193.48:0/284740740 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7faf8005e4b0 0x7faf8005d3d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf87283640 1 --2- 10.20.193.48:0/284740740 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7faf8008e210 0x7faf8005ce90 unknown :-1 s=CLOSED pgs=76 gs=2 cs=0 l=1 c_cookie=2627746290852906748 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf87283640 1 --2- 10.20.193.48:0/284740740 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7faf800914d0 0x7faf8005c950 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf87283640 1 -- 10.20.193.48:0/284740740 >> 10.20.193.48:0/284740740 conn(0x7faf800548a0 msgr2=0x7faf80097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:15.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf87283640 1 -- 10.20.193.48:0/284740740 shutdown_connections 2026-02-12T18:06:15.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.991+0000 7faf87283640 1 -- 10.20.193.48:0/284740740 wait complete. 2026-02-12T18:06:15.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf87283640 10 monclient: build_initial_monmap 2026-02-12T18:06:15.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf87283640 10 monclient: monmap: 2026-02-12T18:06:15.008 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:15.009 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:15.009 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:15.009 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:15.009 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:15.009 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.009 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:15.009 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:15.009 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:15.009 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:15.009 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:15.009 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:15.009 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:15.009 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:15.010 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:15.010 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf87283640 1 Processor -- start 2026-02-12T18:06:15.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf87283640 1 -- start start 2026-02-12T18:06:15.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf87283640 10 monclient: init 2026-02-12T18:06:15.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf87283640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:15.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf87283640 10 monclient: _add_conns ranks=[0,6,2,7,3,1,5,8,4] 2026-02-12T18:06:15.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf87283640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7faf8005e4b0 0x7faf801db070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf87283640 10 monclient(hunting): picked mon.noname-a con 0x7faf8005e4b0 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:06:15.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf87283640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7faf8008e210 0x7faf801b0cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf87283640 10 monclient(hunting): picked mon.noname-d con 0x7faf8008e210 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:06:15.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf87283640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7faf800914d0 0x7faf801b11f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf87283640 10 monclient(hunting): picked mon.noname-b con 0x7faf800914d0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:15.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf87283640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:15.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf87283640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7faf8019c550 con 0x7faf8005e4b0 2026-02-12T18:06:15.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf87283640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:15.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf87283640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7faf8019beb0 con 0x7faf800914d0 2026-02-12T18:06:15.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf87283640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:15.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf87283640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7faf8019b750 con 0x7faf8008e210 2026-02-12T18:06:15.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf87283640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:15.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf87283640 10 monclient(hunting): authenticate will time out at 613.718655s 2026-02-12T18:06:15.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf84ff8640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7faf8005e4b0 0x7faf801db070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf84ff8640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7faf8005e4b0 0x7faf801db070 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:57100/0 (socket says 10.20.193.48:57100) 2026-02-12T18:06:15.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf84ff8640 1 -- 10.20.193.48:0/3842501696 learned_addr learned my addr 10.20.193.48:0/3842501696 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:15.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf84ff8640 10 monclient(hunting): get_auth_request con 0x7faf8005e4b0 auth_method 0 2026-02-12T18:06:15.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf84ff8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:15.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf84ff8640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:15.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf84ff8640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:15.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf77fff640 1 --2- 10.20.193.48:0/3842501696 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7faf8008e210 0x7faf801b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf857f9640 1 --2- 10.20.193.48:0/3842501696 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7faf800914d0 0x7faf801b11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf77fff640 10 monclient(hunting): get_auth_request con 0x7faf8008e210 auth_method 0 2026-02-12T18:06:15.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf77fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:15.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf77fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:15.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf77fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:15.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf857f9640 10 monclient(hunting): get_auth_request con 0x7faf800914d0 auth_method 0 2026-02-12T18:06:15.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf857f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:15.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf857f9640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:15.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf857f9640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:15.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf84ff8640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:15.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf84ff8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:15.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf84ff8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:15.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf77fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:15.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf77fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:15.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf77fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:15.014 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf857f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:15.014 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf857f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:15.014 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf857f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:15.014 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf84ff8640 10 monclient(hunting): handle_auth_done global_id 4455 payload 824 2026-02-12T18:06:15.014 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf84ff8640 1 -- 10.20.193.48:0/3842501696 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7faf8008e210 msgr2=0x7faf801b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:15.014 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf84ff8640 1 --2- 10.20.193.48:0/3842501696 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7faf8008e210 0x7faf801b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.014 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf84ff8640 1 -- 10.20.193.48:0/3842501696 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7faf800914d0 msgr2=0x7faf801b11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:15.014 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf84ff8640 1 --2- 10.20.193.48:0/3842501696 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7faf800914d0 0x7faf801b11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.014 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf84ff8640 10 monclient: _finish_hunting 0 2026-02-12T18:06:15.014 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf84ff8640 1 monclient: found mon.noname-a 2026-02-12T18:06:15.014 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf84ff8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:15.014 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf84ff8640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:06:15.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.992+0000 7faf84ff8640 1 -- 10.20.193.48:0/3842501696 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf700094f0 con 0x7faf8005e4b0 2026-02-12T18:06:15.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf84ff8640 1 -- 10.20.193.48:0/3842501696 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7faf8005e4b0 msgr2=0x7faf801db070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:15.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf84ff8640 1 --2- 10.20.193.48:0/3842501696 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7faf8005e4b0 0x7faf801db070 secure :-1 s=READY pgs=77 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf70004740 tx=0x7faf7000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:15.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf757fa640 1 -- 10.20.193.48:0/3842501696 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7faf7000ce50 con 0x7faf8005e4b0 2026-02-12T18:06:15.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf757fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:15.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf757fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:06:15.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf757fa640 10 monclient: dump: 2026-02-12T18:06:15.015 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:15.015 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:15.015 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.015 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.015 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:15.016 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.016 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:15.016 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:15.016 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:15.016 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:15.016 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:15.016 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:15.016 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:15.016 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:15.016 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:15.016 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf757fa640 10 monclient: _finish_auth 0 2026-02-12T18:06:15.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf757fa640 10 monclient: _check_auth_tickets 2026-02-12T18:06:15.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf757fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:15.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf757fa640 1 -- 10.20.193.48:0/3842501696 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf7000ee90 con 0x7faf8005e4b0 2026-02-12T18:06:15.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf87283640 5 monclient: authenticate success, global_id 4455 2026-02-12T18:06:15.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf87283640 10 monclient: _renew_subs 2026-02-12T18:06:15.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf87283640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:15.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf87283640 1 -- 10.20.193.48:0/3842501696 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf68009420 con 0x7faf8005e4b0 2026-02-12T18:06:15.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf757fa640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:15.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf757fa640 1 -- 10.20.193.48:0/3842501696 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7faf700044f0 con 0x7faf8005e4b0 2026-02-12T18:06:15.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf757fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:15.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf76ffd640 4 set_mon_vals no callback set 2026-02-12T18:06:15.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf757fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:15.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf757fa640 10 monclient: dump: 2026-02-12T18:06:15.018 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:15.018 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:15.018 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.018 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.018 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:15.018 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.018 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:15.018 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:15.018 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:15.018 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:15.018 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:15.018 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:15.019 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:15.019 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:15.019 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:15.019 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf87283640 10 monclient: _renew_subs 2026-02-12T18:06:15.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf87283640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:15.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf87283640 1 -- 10.20.193.48:0/3842501696 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf8019a3f0 con 0x7faf8005e4b0 2026-02-12T18:06:15.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf87283640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:15.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf87283640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:15.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf87283640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:15.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.995+0000 7faf87283640 1 -- 10.20.193.48:0/3842501696 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf8005c950 con 0x7faf8005e4b0 2026-02-12T18:06:15.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.996+0000 7faf757fa640 1 -- 10.20.193.48:0/3842501696 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7faf70011070 con 0x7faf8005e4b0 2026-02-12T18:06:15.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.996+0000 7faf757fa640 1 --2- 10.20.193.48:0/3842501696 >> v2:10.20.193.111:6812/977811348 conn(0x7faf5003f800 0x7faf5005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.996+0000 7faf757fa640 1 -- 10.20.193.48:0/3842501696 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 3559+0+0 (secure 0 0 0) 0x7faf70052cd0 con 0x7faf8005e4b0 2026-02-12T18:06:15.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.996+0000 7faf77fff640 1 --2- 10.20.193.48:0/3842501696 >> v2:10.20.193.111:6812/977811348 conn(0x7faf5003f800 0x7faf5005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.996+0000 7faf77fff640 10 monclient: get_auth_request con 0x7faf5003f800 auth_method 0 2026-02-12T18:06:15.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.998+0000 7faf757fa640 1 -- 10.20.193.48:0/3842501696 <== mon.0 v2:10.20.193.48:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7faf700036d0 con 0x7faf8005e4b0 2026-02-12T18:06:15.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.998+0000 7faf757fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:15.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.998+0000 7faf757fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:15.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:14.999+0000 7faf77fff640 1 --2- 10.20.193.48:0/3842501696 >> v2:10.20.193.111:6812/977811348 conn(0x7faf5003f800 0x7faf5005fcb0 secure :-1 s=READY pgs=62 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf6802ed50 tx=0x7faf68039040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:15.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.101+0000 7faf87283640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-12T18:06:15.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.101+0000 7faf87283640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-12T18:06:15.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.101+0000 7faf87283640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:15.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.101+0000 7faf87283640 1 -- 10.20.193.48:0/3842501696 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) -- 0x7faf8019c090 con 0x7faf8005e4b0 2026-02-12T18:06:15.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.101+0000 7faf757fa640 1 -- 10.20.193.48:0/3842501696 <== mon.0 v2:10.20.193.48:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) ==== 92+0+10 (secure 0 0 0) 0x7faf70020020 con 0x7faf8005e4b0 2026-02-12T18:06:15.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.101+0000 7faf757fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2026-02-12T18:06:15.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.101+0000 7faf757fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:15.103 INFO:teuthology.orchestra.run.trial048.stdout:pg_num: 8 2026-02-12T18:06:15.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.102+0000 7faf87283640 1 -- 10.20.193.48:0/3842501696 >> v2:10.20.193.111:6812/977811348 conn(0x7faf5003f800 msgr2=0x7faf5005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:15.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.102+0000 7faf87283640 1 --2- 10.20.193.48:0/3842501696 >> v2:10.20.193.111:6812/977811348 conn(0x7faf5003f800 0x7faf5005fcb0 secure :-1 s=READY pgs=62 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf6802ed50 tx=0x7faf68039040 comp rx=0 tx=0).stop 2026-02-12T18:06:15.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.102+0000 7faf87283640 10 monclient: shutdown 2026-02-12T18:06:15.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.102+0000 7faf87283640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:15.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.102+0000 7faf87283640 1 -- 10.20.193.48:0/3842501696 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7faf8005e4b0 msgr2=0x7faf801db070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:15.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.102+0000 7faf87283640 1 --2- 10.20.193.48:0/3842501696 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7faf8005e4b0 0x7faf801db070 secure :-1 s=READY pgs=77 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf70004740 tx=0x7faf7000c520 comp rx=0 tx=0).stop 2026-02-12T18:06:15.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.102+0000 7faf87283640 1 -- 10.20.193.48:0/3842501696 shutdown_connections 2026-02-12T18:06:15.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.102+0000 7faf87283640 1 --2- 10.20.193.48:0/3842501696 >> v2:10.20.193.111:6812/977811348 conn(0x7faf5003f800 0x7faf5005fcb0 unknown :-1 s=CLOSED pgs=62 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.102+0000 7faf87283640 1 --2- 10.20.193.48:0/3842501696 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7faf800914d0 0x7faf801b11f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.102+0000 7faf87283640 1 --2- 10.20.193.48:0/3842501696 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7faf8008e210 0x7faf801b0cb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.102+0000 7faf87283640 1 --2- 10.20.193.48:0/3842501696 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7faf8005e4b0 0x7faf801db070 unknown :-1 s=CLOSED pgs=77 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.102+0000 7faf87283640 1 -- 10.20.193.48:0/3842501696 >> 10.20.193.48:0/3842501696 conn(0x7faf800548a0 msgr2=0x7faf800900f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:15.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.102+0000 7faf87283640 1 -- 10.20.193.48:0/3842501696 shutdown_connections 2026-02-12T18:06:15.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.102+0000 7faf87283640 1 -- 10.20.193.48:0/3842501696 wait complete. 2026-02-12T18:06:15.111 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2026-02-12T18:06:15.111 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T18:06:15.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.176+0000 7f95539c2640 10 monclient: get_monmap_and_config 2026-02-12T18:06:15.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.176+0000 7f95539c2640 10 monclient: build_initial_monmap 2026-02-12T18:06:15.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.176+0000 7f95539c2640 10 monclient: monmap: 2026-02-12T18:06:15.177 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:15.177 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:15.177 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:15.177566+0000 2026-02-12T18:06:15.177 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:15.177566+0000 2026-02-12T18:06:15.178 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:15.178 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.178 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:15.178 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:15.178 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:15.178 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:15.178 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:15.178 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:15.178 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:15.178 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:15.178 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:15.178 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:15.178 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:15.179 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.176+0000 7f95539c2640 1 Processor -- start 2026-02-12T18:06:15.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.176+0000 7f95539c2640 1 -- start start 2026-02-12T18:06:15.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.176+0000 7f95539c2640 10 monclient: init 2026-02-12T18:06:15.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f95539c2640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:15.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f95539c2640 10 monclient: _add_conns ranks=[4,2,0,8,1,10,9,5,7,3,6] 2026-02-12T18:06:15.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f95539c2640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f954c05cb90 0x7f954c144130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f95539c2640 10 monclient(hunting): picked mon.noname-c con 0x7f954c05cb90 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:06:15.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f95539c2640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f954c144670 0x7f954c144a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f95539c2640 10 monclient(hunting): picked mon.noname-b con 0x7f954c144670 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:15.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f95539c2640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f954c095890 addr v1:10.20.193.48:6789/0 2026-02-12T18:06:15.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f95539c2640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f954c060390 con 0x7f954c095890 2026-02-12T18:06:15.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f95539c2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:15.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f95539c2640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f954c05e8d0 con 0x7f954c144670 2026-02-12T18:06:15.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f95539c2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:15.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f95539c2640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f954c144fc0 con 0x7f954c05cb90 2026-02-12T18:06:15.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f95539c2640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:15.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f95539c2640 10 monclient(hunting): authenticate will time out at 613.903311s 2026-02-12T18:06:15.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9551737640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f954c05cb90 0x7f954c144130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9551f38640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f954c095890 0x7f954c095d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:34410/0 (socket says 10.20.193.48:34410) 2026-02-12T18:06:15.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9550f36640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f954c144670 0x7f954c144a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9551f38640 1 -- 10.20.193.48:0/1836429946 learned_addr learned my addr 10.20.193.48:0/1836429946 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:06:15.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9550f36640 10 monclient(hunting): get_auth_request con 0x7f954c144670 auth_method 0 2026-02-12T18:06:15.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9550f36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:15.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9550f36640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:15.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9550f36640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:15.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9551737640 10 monclient(hunting): get_auth_request con 0x7f954c05cb90 auth_method 0 2026-02-12T18:06:15.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9551737640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:15.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9551737640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:15.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9551737640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:15.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9550f36640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:15.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9550f36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:15.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9550f36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:15.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9551737640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:15.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9551737640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:15.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9551737640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:15.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9550f36640 10 monclient(hunting): handle_auth_done global_id 34274 payload 274 2026-02-12T18:06:15.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9550f36640 1 -- 10.20.193.48:0/1836429946 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f954c05cb90 msgr2=0x7f954c144130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:15.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9550f36640 1 --2- 10.20.193.48:0/1836429946 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f954c05cb90 0x7f954c144130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9550f36640 1 -- 10.20.193.48:0/1836429946 >> v1:10.20.193.48:6789/0 conn(0x7f954c095890 legacy=0x7f954c095d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:15.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9550f36640 10 monclient: _finish_hunting 0 2026-02-12T18:06:15.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9550f36640 1 monclient: found mon.noname-b 2026-02-12T18:06:15.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9550f36640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:15.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9550f36640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:06:15.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.177+0000 7f9550f36640 1 -- 10.20.193.48:0/1836429946 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f954c092370 con 0x7f954c144670 2026-02-12T18:06:15.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f9550f36640 1 -- 10.20.193.48:0/1836429946 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f954c144670 msgr2=0x7f954c144a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:15.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f9550f36640 1 --2- 10.20.193.48:0/1836429946 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f954c144670 0x7f954c144a80 secure :-1 s=READY pgs=32 gs=3 cs=0 l=1 c_cookie=16161704250354404817 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9540009800 tx=0x7f954002ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e049e863274b8dd1 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:15.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f953bfff640 1 -- 10.20.193.48:0/1836429946 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f954002fe90 con 0x7f954c144670 2026-02-12T18:06:15.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f953bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:15.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f953bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:06:15.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f953bfff640 10 monclient: dump: 2026-02-12T18:06:15.192 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:15.192 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:15.192 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.192 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.192 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:15.192 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.192 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:15.192 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:15.192 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:15.192 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:15.192 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:15.192 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:15.193 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:15.193 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:15.193 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:15.193 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f953bfff640 10 monclient: _finish_auth 0 2026-02-12T18:06:15.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f953bfff640 10 monclient: _check_auth_tickets 2026-02-12T18:06:15.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f953bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:15.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f953bfff640 1 -- 10.20.193.48:0/1836429946 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9540035340 con 0x7f954c144670 2026-02-12T18:06:15.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f95539c2640 5 monclient: authenticate success, global_id 34274 2026-02-12T18:06:15.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f95539c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:15.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f953bfff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:15.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f953bfff640 1 -- 10.20.193.48:0/1836429946 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9540035970 con 0x7f954c144670 2026-02-12T18:06:15.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f953bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:15.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f953bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:06:15.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f953bfff640 10 monclient: dump: 2026-02-12T18:06:15.194 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:15.194 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:15.194 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.194 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.194 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:15.194 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.194 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:15.194 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:15.194 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:15.195 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:15.195 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:15.195 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:15.195 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:15.195 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:15.195 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:15.195 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f95539c2640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:15.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f95539c2640 4 set_mon_vals no callback set 2026-02-12T18:06:15.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f95539c2640 10 monclient: shutdown 2026-02-12T18:06:15.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f95539c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:15.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f95539c2640 1 -- 10.20.193.48:0/1836429946 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f954c144670 msgr2=0x7f954c144a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:15.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f95539c2640 1 --2- 10.20.193.48:0/1836429946 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f954c144670 0x7f954c144a80 secure :-1 s=READY pgs=32 gs=3 cs=0 l=1 c_cookie=16161704250354404817 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9540009800 tx=0x7f954002ed50 comp rx=0 tx=0).stop 2026-02-12T18:06:15.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f95539c2640 1 -- 10.20.193.48:0/1836429946 shutdown_connections 2026-02-12T18:06:15.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f95539c2640 1 --2- 10.20.193.48:0/1836429946 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f954c144670 0x7f954c144a80 unknown :-1 s=CLOSED pgs=32 gs=3 cs=0 l=1 c_cookie=16161704250354404817 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f95539c2640 1 --2- 10.20.193.48:0/1836429946 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f954c05cb90 0x7f954c144130 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f95539c2640 1 -- 10.20.193.48:0/1836429946 >> 10.20.193.48:0/1836429946 conn(0x7f954c0943b0 msgr2=0x7f954c0947b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:15.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f95539c2640 1 -- 10.20.193.48:0/1836429946 shutdown_connections 2026-02-12T18:06:15.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.180+0000 7f95539c2640 1 -- 10.20.193.48:0/1836429946 wait complete. 2026-02-12T18:06:15.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f95539c2640 10 monclient: build_initial_monmap 2026-02-12T18:06:15.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f95539c2640 10 monclient: monmap: 2026-02-12T18:06:15.196 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:15.196 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:15.196 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:15.196 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:15.197 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:15.197 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.197 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:15.197 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:15.197 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:15.197 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:15.197 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:15.197 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:15.197 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:15.197 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:15.197 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:15.197 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f95539c2640 1 Processor -- start 2026-02-12T18:06:15.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f95539c2640 1 -- start start 2026-02-12T18:06:15.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f95539c2640 10 monclient: init 2026-02-12T18:06:15.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f95539c2640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:15.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f95539c2640 10 monclient: _add_conns ranks=[2,5,8,7,3,6,4,0,1] 2026-02-12T18:06:15.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f95539c2640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f954c05cb90 0x7f954c08e910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f95539c2640 10 monclient(hunting): picked mon.noname-b con 0x7f954c05cb90 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:15.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f95539c2640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f954c095890 0x7f954c08ee50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f95539c2640 10 monclient(hunting): picked mon.noname-h con 0x7f954c095890 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:15.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f95539c2640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f954c144670 0x7f954c08f390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f95539c2640 10 monclient(hunting): picked mon.noname-e con 0x7f954c144670 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:15.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f95539c2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:15.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f95539c2640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f954c1260c0 con 0x7f954c05cb90 2026-02-12T18:06:15.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f95539c2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:15.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f95539c2640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f954c091040 con 0x7f954c095890 2026-02-12T18:06:15.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f95539c2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:15.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f95539c2640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f954c08e130 con 0x7f954c144670 2026-02-12T18:06:15.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f95539c2640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:15.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f95539c2640 10 monclient(hunting): authenticate will time out at 613.907702s 2026-02-12T18:06:15.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f9551737640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f954c05cb90 0x7f954c08e910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f9551737640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f954c05cb90 0x7f954c08e910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:60280/0 (socket says 10.20.193.48:60280) 2026-02-12T18:06:15.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f9551737640 1 -- 10.20.193.48:0/1555377165 learned_addr learned my addr 10.20.193.48:0/1555377165 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:15.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f9551737640 10 monclient(hunting): get_auth_request con 0x7f954c05cb90 auth_method 0 2026-02-12T18:06:15.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f9551737640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:15.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f9551737640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:15.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f9551737640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:15.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f9551f38640 1 --2- 10.20.193.48:0/1555377165 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f954c144670 0x7f954c08f390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f9551737640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:15.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f9551737640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:15.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f9551737640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:15.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f9551f38640 10 monclient(hunting): get_auth_request con 0x7f954c144670 auth_method 0 2026-02-12T18:06:15.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f9551f38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:15.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f9551f38640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:15.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f9551f38640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:15.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f9551f38640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:15.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f9551f38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:15.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f9550f36640 1 --2- 10.20.193.48:0/1555377165 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f954c095890 0x7f954c08ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f9551f38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:15.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f9550f36640 10 monclient(hunting): get_auth_request con 0x7f954c095890 auth_method 0 2026-02-12T18:06:15.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f9550f36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:15.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f9550f36640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:15.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f9550f36640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:15.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.181+0000 7f9551737640 10 monclient(hunting): handle_auth_done global_id 34283 payload 824 2026-02-12T18:06:15.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.182+0000 7f9551737640 1 -- 10.20.193.48:0/1555377165 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f954c144670 msgr2=0x7f954c08f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:15.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.182+0000 7f9551737640 1 --2- 10.20.193.48:0/1555377165 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f954c144670 0x7f954c08f390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.182+0000 7f9551737640 1 -- 10.20.193.48:0/1555377165 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f954c095890 msgr2=0x7f954c08ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:15.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.182+0000 7f9551737640 1 --2- 10.20.193.48:0/1555377165 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f954c095890 0x7f954c08ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.182+0000 7f9551737640 10 monclient: _finish_hunting 0 2026-02-12T18:06:15.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.182+0000 7f9551737640 1 monclient: found mon.noname-b 2026-02-12T18:06:15.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.182+0000 7f9551737640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:15.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.182+0000 7f9551737640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:06:15.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.182+0000 7f9551737640 1 -- 10.20.193.48:0/1555377165 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9540009420 con 0x7f954c05cb90 2026-02-12T18:06:15.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.184+0000 7f9551737640 1 -- 10.20.193.48:0/1555377165 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f954c05cb90 msgr2=0x7f954c08e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:15.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.184+0000 7f9551737640 1 --2- 10.20.193.48:0/1555377165 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f954c05cb90 0x7f954c08e910 secure :-1 s=READY pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f953c00e8b0 tx=0x7f953c00ed80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:15.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.184+0000 7f9539ffb640 1 -- 10.20.193.48:0/1555377165 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f953c00cb50 con 0x7f954c05cb90 2026-02-12T18:06:15.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.184+0000 7f9539ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:15.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.184+0000 7f9539ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:06:15.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.184+0000 7f9539ffb640 10 monclient: dump: 2026-02-12T18:06:15.202 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:15.202 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:15.202 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.202 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.202 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:15.203 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.203 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:15.203 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:15.203 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:15.203 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:15.203 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:15.203 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:15.203 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:15.203 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:15.203 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:15.203 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.184+0000 7f9539ffb640 10 monclient: _finish_auth 0 2026-02-12T18:06:15.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.184+0000 7f9539ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:06:15.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.184+0000 7f9539ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:15.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.184+0000 7f9539ffb640 1 -- 10.20.193.48:0/1555377165 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f953c00ccd0 con 0x7f954c05cb90 2026-02-12T18:06:15.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.184+0000 7f9539ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:15.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.184+0000 7f9539ffb640 1 -- 10.20.193.48:0/1555377165 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f953c00ce40 con 0x7f954c05cb90 2026-02-12T18:06:15.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.184+0000 7f9539ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:15.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.184+0000 7f9539ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:06:15.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.184+0000 7f953b7fe640 4 set_mon_vals no callback set 2026-02-12T18:06:15.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.184+0000 7f9539ffb640 10 monclient: dump: 2026-02-12T18:06:15.204 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:15.204 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:15.204 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.204 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.204 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:15.205 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.205 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:15.205 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:15.205 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:15.205 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:15.205 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:15.205 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:15.205 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:15.205 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:15.205 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:15.205 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.184+0000 7f95539c2640 5 monclient: authenticate success, global_id 34283 2026-02-12T18:06:15.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.184+0000 7f95539c2640 10 monclient: _renew_subs 2026-02-12T18:06:15.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.184+0000 7f95539c2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:15.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.184+0000 7f95539c2640 1 -- 10.20.193.48:0/1555377165 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f954c08a710 con 0x7f954c05cb90 2026-02-12T18:06:15.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.184+0000 7f95539c2640 10 monclient: _renew_subs 2026-02-12T18:06:15.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.184+0000 7f95539c2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:15.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.184+0000 7f95539c2640 1 -- 10.20.193.48:0/1555377165 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f954c122c70 con 0x7f954c05cb90 2026-02-12T18:06:15.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.185+0000 7f9539ffb640 1 -- 10.20.193.48:0/1555377165 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f953c011070 con 0x7f954c05cb90 2026-02-12T18:06:15.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.185+0000 7f95539c2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:15.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.185+0000 7f95539c2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:15.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.185+0000 7f95539c2640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:15.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.185+0000 7f95539c2640 1 -- 10.20.193.48:0/1555377165 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f954c056260 con 0x7f954c05cb90 2026-02-12T18:06:15.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.185+0000 7f9539ffb640 1 --2- 10.20.193.48:0/1555377165 >> v2:10.20.193.111:6812/977811348 conn(0x7f951c03f800 0x7f951c05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.185+0000 7f9539ffb640 1 -- 10.20.193.48:0/1555377165 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (secure 0 0 0) 0x7f953c052a80 con 0x7f954c05cb90 2026-02-12T18:06:15.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.185+0000 7f9550f36640 1 --2- 10.20.193.48:0/1555377165 >> v2:10.20.193.111:6812/977811348 conn(0x7f951c03f800 0x7f951c05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.185+0000 7f9550f36640 10 monclient: get_auth_request con 0x7f951c03f800 auth_method 0 2026-02-12T18:06:15.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.187+0000 7f9539ffb640 1 -- 10.20.193.48:0/1555377165 <== mon.2 v2:10.20.193.48:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f954c056260 con 0x7f954c05cb90 2026-02-12T18:06:15.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.187+0000 7f9539ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:15.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.187+0000 7f9539ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:15.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.187+0000 7f9550f36640 1 --2- 10.20.193.48:0/1555377165 >> v2:10.20.193.111:6812/977811348 conn(0x7f951c03f800 0x7f951c05fcb0 secure :-1 s=READY pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9540004740 tx=0x7f9540039040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:15.290 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.289+0000 7f95539c2640 1 -- 10.20.193.48:0/1555377165 --> v2:10.20.193.111:6812/977811348 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f954c0939d0 con 0x7f951c03f800 2026-02-12T18:06:15.291 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.290+0000 7f9539ffb640 1 -- 10.20.193.48:0/1555377165 <== mgr.4123 v2:10.20.193.111:6812/977811348 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34123 (secure 0 0 0) 0x7f9540047090 con 0x7f951c03f800 2026-02-12T18:06:15.292 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:06:15.293 INFO:teuthology.orchestra.run.trial048.stderr:dumped all 2026-02-12T18:06:15.293 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.291+0000 7f95539c2640 1 -- 10.20.193.48:0/1555377165 >> v2:10.20.193.111:6812/977811348 conn(0x7f951c03f800 msgr2=0x7f951c05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:15.293 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.291+0000 7f95539c2640 1 --2- 10.20.193.48:0/1555377165 >> v2:10.20.193.111:6812/977811348 conn(0x7f951c03f800 0x7f951c05fcb0 secure :-1 s=READY pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9540004740 tx=0x7f9540039040 comp rx=0 tx=0).stop 2026-02-12T18:06:15.293 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.291+0000 7f95539c2640 10 monclient: shutdown 2026-02-12T18:06:15.293 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.291+0000 7f95539c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:15.293 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.291+0000 7f95539c2640 1 -- 10.20.193.48:0/1555377165 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f954c05cb90 msgr2=0x7f954c08e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:15.293 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.291+0000 7f95539c2640 1 --2- 10.20.193.48:0/1555377165 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f954c05cb90 0x7f954c08e910 secure :-1 s=READY pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f953c00e8b0 tx=0x7f953c00ed80 comp rx=0 tx=0).stop 2026-02-12T18:06:15.293 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.291+0000 7f95539c2640 1 -- 10.20.193.48:0/1555377165 shutdown_connections 2026-02-12T18:06:15.294 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.291+0000 7f95539c2640 1 --2- 10.20.193.48:0/1555377165 >> v2:10.20.193.111:6812/977811348 conn(0x7f951c03f800 0x7f951c05fcb0 unknown :-1 s=CLOSED pgs=63 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.294 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.291+0000 7f95539c2640 1 --2- 10.20.193.48:0/1555377165 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f954c144670 0x7f954c08f390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.294 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.291+0000 7f95539c2640 1 --2- 10.20.193.48:0/1555377165 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f954c095890 0x7f954c08ee50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.294 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.291+0000 7f95539c2640 1 --2- 10.20.193.48:0/1555377165 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f954c05cb90 0x7f954c08e910 unknown :-1 s=CLOSED pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.294 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.291+0000 7f95539c2640 1 -- 10.20.193.48:0/1555377165 >> 10.20.193.48:0/1555377165 conn(0x7f954c0943b0 msgr2=0x7f954c123ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:15.294 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.291+0000 7f95539c2640 1 -- 10.20.193.48:0/1555377165 shutdown_connections 2026-02-12T18:06:15.294 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.291+0000 7f95539c2640 1 -- 10.20.193.48:0/1555377165 wait complete. 2026-02-12T18:06:15.300 INFO:teuthology.orchestra.run.trial048.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2026-02-12T18:06:15.171310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163840,"kb_used_data":2080,"kb_used_omap":50,"kb_used_meta":161613,"kb_avail":566067200,"statfs":{"total":579820584960,"available":579652812800,"internally_reserved":0,"allocated":2129920,"data_stored":1478686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":51998,"internal_metadata":165491938},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.891854"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.383670+0000","last_change":"2026-02-12T18:06:11.383740+0000","last_active":"2026-02-12T18:06:11.383670+0000","last_peered":"2026-02-12T18:06:11.383670+0000","last_clean":"2026-02-12T18:06:11.383670+0000","last_became_active":"2026-02-12T18:06:09.281532+0000","last_became_peered":"2026-02-12T18:06:09.281532+0000","last_unstale":"2026-02-12T18:06:11.383670+0000","last_undegraded":"2026-02-12T18:06:11.383670+0000","last_fullsized":"2026-02-12T18:06:11.383670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T20:34:57.876774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027561099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.384892+0000","last_change":"2026-02-12T18:06:11.384892+0000","last_active":"2026-02-12T18:06:11.384892+0000","last_peered":"2026-02-12T18:06:11.384892+0000","last_clean":"2026-02-12T18:06:11.384892+0000","last_became_active":"2026-02-12T18:06:09.283689+0000","last_became_peered":"2026-02-12T18:06:09.283689+0000","last_unstale":"2026-02-12T18:06:11.384892+0000","last_undegraded":"2026-02-12T18:06:11.384892+0000","last_fullsized":"2026-02-12T18:06:11.384892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T00:04:55.700663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046734100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.383588+0000","last_change":"2026-02-12T18:06:11.383662+0000","last_active":"2026-02-12T18:06:11.383588+0000","last_peered":"2026-02-12T18:06:11.383588+0000","last_clean":"2026-02-12T18:06:11.383588+0000","last_became_active":"2026-02-12T18:06:09.281461+0000","last_became_peered":"2026-02-12T18:06:09.281461+0000","last_unstale":"2026-02-12T18:06:11.383588+0000","last_undegraded":"2026-02-12T18:06:11.383588+0000","last_fullsized":"2026-02-12T18:06:11.383588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T21:13:23.141921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00019704400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.384936+0000","last_change":"2026-02-12T18:06:11.384936+0000","last_active":"2026-02-12T18:06:11.384936+0000","last_peered":"2026-02-12T18:06:11.384936+0000","last_clean":"2026-02-12T18:06:11.384936+0000","last_became_active":"2026-02-12T18:06:09.283688+0000","last_became_peered":"2026-02-12T18:06:09.283688+0000","last_unstale":"2026-02-12T18:06:11.384936+0000","last_undegraded":"2026-02-12T18:06:11.384936+0000","last_fullsized":"2026-02-12T18:06:11.384936+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:54:04.914482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047092800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.387972+0000","last_change":"2026-02-12T18:06:11.387479+0000","last_active":"2026-02-12T18:06:11.387972+0000","last_peered":"2026-02-12T18:06:11.387972+0000","last_clean":"2026-02-12T18:06:11.387972+0000","last_became_active":"2026-02-12T18:06:09.283881+0000","last_became_peered":"2026-02-12T18:06:09.283881+0000","last_unstale":"2026-02-12T18:06:11.387972+0000","last_undegraded":"2026-02-12T18:06:11.387972+0000","last_fullsized":"2026-02-12T18:06:11.387972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:14:28.203244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045409299999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.384057+0000","last_change":"2026-02-12T18:06:11.384057+0000","last_active":"2026-02-12T18:06:11.384057+0000","last_peered":"2026-02-12T18:06:11.384057+0000","last_clean":"2026-02-12T18:06:11.384057+0000","last_became_active":"2026-02-12T18:06:09.284036+0000","last_became_peered":"2026-02-12T18:06:09.284036+0000","last_unstale":"2026-02-12T18:06:11.384057+0000","last_undegraded":"2026-02-12T18:06:11.384057+0000","last_fullsized":"2026-02-12T18:06:11.384057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:15:47.166182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028640700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.383576+0000","last_change":"2026-02-12T18:06:11.383648+0000","last_active":"2026-02-12T18:06:11.383576+0000","last_peered":"2026-02-12T18:06:11.383576+0000","last_clean":"2026-02-12T18:06:11.383576+0000","last_became_active":"2026-02-12T18:06:09.283797+0000","last_became_peered":"2026-02-12T18:06:09.283797+0000","last_unstale":"2026-02-12T18:06:11.383576+0000","last_undegraded":"2026-02-12T18:06:11.383576+0000","last_fullsized":"2026-02-12T18:06:11.383576+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:51:24.172618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018461199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.387248+0000","last_change":"2026-02-12T18:06:11.387248+0000","last_active":"2026-02-12T18:06:11.387248+0000","last_peered":"2026-02-12T18:06:11.387248+0000","last_clean":"2026-02-12T18:06:11.387248+0000","last_became_active":"2026-02-12T18:06:09.287509+0000","last_became_peered":"2026-02-12T18:06:09.287509+0000","last_unstale":"2026-02-12T18:06:11.387248+0000","last_undegraded":"2026-02-12T18:06:11.387248+0000","last_fullsized":"2026-02-12T18:06:11.387248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:54:10.505834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020961600000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'112","reported_seq":157,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.383450+0000","last_change":"2026-02-12T18:06:04.371853+0000","last_active":"2026-02-12T18:06:11.383450+0000","last_peered":"2026-02-12T18:06:11.383450+0000","last_clean":"2026-02-12T18:06:11.383450+0000","last_became_active":"2026-02-12T18:06:04.371628+0000","last_became_peered":"2026-02-12T18:06:04.371628+0000","last_unstale":"2026-02-12T18:06:11.383450+0000","last_undegraded":"2026-02-12T18:06:11.383450+0000","last_fullsized":"2026-02-12T18:06:11.383450+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:02.768915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:02.768915+0000","last_clean_scrub_stamp":"2026-02-12T18:06:02.768915+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:16:28.244842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":12,"seq":51539607556,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":732,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":749568,"data_stored":640020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8123,"internal_metadata":27582533},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":49671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":49652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640262,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":49652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":49671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":732,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":749568,"data_stored":640020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T18:06:15.302 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T18:06:15.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.368+0000 7f5149acc640 10 monclient: get_monmap_and_config 2026-02-12T18:06:15.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.368+0000 7f5149acc640 10 monclient: build_initial_monmap 2026-02-12T18:06:15.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.368+0000 7f5149acc640 10 monclient: monmap: 2026-02-12T18:06:15.369 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:15.369 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:15.370 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:15.369362+0000 2026-02-12T18:06:15.370 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:15.369362+0000 2026-02-12T18:06:15.370 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:15.370 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.370 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:15.370 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:15.370 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:15.370 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:15.370 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:15.370 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:15.370 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:15.370 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:15.370 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:15.371 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:15.371 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:15.371 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.368+0000 7f5149acc640 1 Processor -- start 2026-02-12T18:06:15.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.368+0000 7f5149acc640 1 -- start start 2026-02-12T18:06:15.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.368+0000 7f5149acc640 10 monclient: init 2026-02-12T18:06:15.379 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5149acc640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:15.379 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5149acc640 10 monclient: _add_conns ranks=[1,6,4,2,3,7,8,0,10,9,5] 2026-02-12T18:06:15.379 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5149acc640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f5144093ac0 addr v1:10.20.193.111:6789/0 2026-02-12T18:06:15.379 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5149acc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f514413e990 0x7f51441831b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.379 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5149acc640 10 monclient(hunting): picked mon.noname-d con 0x7f514413e990 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:06:15.379 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5149acc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f514405dd20 0x7f51441a3700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5149acc640 10 monclient(hunting): picked mon.noname-c con 0x7f514405dd20 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:06:15.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5149acc640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5144060390 con 0x7f5144093ac0 2026-02-12T18:06:15.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5149acc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:15.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5149acc640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f51440580a0 con 0x7f514405dd20 2026-02-12T18:06:15.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5149acc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:15.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5149acc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f514405e3f0 con 0x7f514413e990 2026-02-12T18:06:15.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5149acc640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:15.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5149acc640 10 monclient(hunting): authenticate will time out at 614.095073s 2026-02-12T18:06:15.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5142ffd640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f514413e990 0x7f51441831b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5142ffd640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f514413e990 0x7f51441831b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:36056/0 (socket says 10.20.193.48:36056) 2026-02-12T18:06:15.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5142ffd640 1 -- 10.20.193.48:0/39156926 learned_addr learned my addr 10.20.193.48:0/39156926 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:15.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5142ffd640 10 monclient(hunting): get_auth_request con 0x7f514413e990 auth_method 0 2026-02-12T18:06:15.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5142ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:15.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5142ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:15.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5142ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:15.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5143fff640 1 --2- 10.20.193.48:0/39156926 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f514405dd20 0x7f51441a3700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5143fff640 10 monclient(hunting): get_auth_request con 0x7f514405dd20 auth_method 0 2026-02-12T18:06:15.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5143fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:15.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5143fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:15.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5143fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:15.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5142ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:15.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5142ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:15.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5142ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:15.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5143fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:15.382 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5143fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:15.382 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5143fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:15.382 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5142ffd640 10 monclient(hunting): handle_auth_done global_id 4389 payload 274 2026-02-12T18:06:15.382 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5142ffd640 1 -- 10.20.193.48:0/39156926 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f514405dd20 msgr2=0x7f51441a3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:15.382 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5142ffd640 1 --2- 10.20.193.48:0/39156926 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f514405dd20 0x7f51441a3700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.382 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5142ffd640 1 -- 10.20.193.48:0/39156926 >> v1:10.20.193.111:6789/0 conn(0x7f5144093ac0 legacy=0x7f514405d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:15.382 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5142ffd640 10 monclient: _finish_hunting 0 2026-02-12T18:06:15.382 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5142ffd640 1 monclient: found mon.noname-d 2026-02-12T18:06:15.382 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5142ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:15.382 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5142ffd640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:06:15.382 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5142ffd640 1 -- 10.20.193.48:0/39156926 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5144093e90 con 0x7f514413e990 2026-02-12T18:06:15.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.369+0000 7f5143fff640 1 --2- 10.20.193.48:0/39156926 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f514405dd20 0x7f51441a3700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:06:15.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.371+0000 7f5142ffd640 1 -- 10.20.193.48:0/39156926 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f514413e990 msgr2=0x7f51441831b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:15.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.371+0000 7f5142ffd640 1 --2- 10.20.193.48:0/39156926 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f514413e990 0x7f51441831b0 secure :-1 s=READY pgs=47 gs=3 cs=0 l=1 c_cookie=12297231836177126305 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5134009900 tx=0x7f513402edb0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=aaa88b3393f653a1 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:15.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f51427fc640 1 -- 10.20.193.48:0/39156926 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5134035340 con 0x7f514413e990 2026-02-12T18:06:15.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f51427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:15.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f51427fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:06:15.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f51427fc640 10 monclient: dump: 2026-02-12T18:06:15.383 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:15.383 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:15.383 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.383 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.383 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:15.383 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.384 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:15.384 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:15.384 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:15.384 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:15.384 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:15.384 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:15.384 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:15.384 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:15.384 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:15.384 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.384 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f51427fc640 10 monclient: _finish_auth 0 2026-02-12T18:06:15.384 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f51427fc640 10 monclient: _check_auth_tickets 2026-02-12T18:06:15.385 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f51427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:15.385 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f51427fc640 1 -- 10.20.193.48:0/39156926 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51340354c0 con 0x7f514413e990 2026-02-12T18:06:15.385 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f5149acc640 5 monclient: authenticate success, global_id 4389 2026-02-12T18:06:15.385 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f5149acc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:15.385 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f51427fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:15.385 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f51427fc640 1 -- 10.20.193.48:0/39156926 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5134035af0 con 0x7f514413e990 2026-02-12T18:06:15.385 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f5149acc640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:15.385 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f5149acc640 4 set_mon_vals no callback set 2026-02-12T18:06:15.385 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f51427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:15.385 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f51427fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:06:15.385 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f51427fc640 10 monclient: dump: 2026-02-12T18:06:15.385 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:15.386 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:15.386 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.386 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.386 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:15.386 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.386 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:15.386 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:15.386 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:15.386 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:15.386 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:15.386 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:15.386 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:15.386 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:15.387 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:15.387 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.387 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f5149acc640 10 monclient: shutdown 2026-02-12T18:06:15.387 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f5149acc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:15.387 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f5149acc640 1 -- 10.20.193.48:0/39156926 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f514413e990 msgr2=0x7f51441831b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:15.387 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f5149acc640 1 --2- 10.20.193.48:0/39156926 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f514413e990 0x7f51441831b0 secure :-1 s=READY pgs=47 gs=3 cs=0 l=1 c_cookie=12297231836177126305 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5134009900 tx=0x7f513402edb0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.387 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f5149acc640 1 -- 10.20.193.48:0/39156926 shutdown_connections 2026-02-12T18:06:15.387 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f5149acc640 1 --2- 10.20.193.48:0/39156926 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f514405dd20 0x7f51441a3700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.387 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f5149acc640 1 --2- 10.20.193.48:0/39156926 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f514413e990 0x7f51441831b0 unknown :-1 s=CLOSED pgs=47 gs=3 cs=0 l=1 c_cookie=12297231836177126305 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.387 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f5149acc640 1 -- 10.20.193.48:0/39156926 >> 10.20.193.48:0/39156926 conn(0x7f5144054b30 msgr2=0x7f5144093070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:15.387 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f5149acc640 1 -- 10.20.193.48:0/39156926 shutdown_connections 2026-02-12T18:06:15.388 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f5149acc640 1 -- 10.20.193.48:0/39156926 wait complete. 2026-02-12T18:06:15.388 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f5149acc640 10 monclient: build_initial_monmap 2026-02-12T18:06:15.388 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.372+0000 7f5149acc640 10 monclient: monmap: 2026-02-12T18:06:15.388 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:15.388 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:15.388 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:15.388 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:15.388 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:15.388 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.388 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:15.388 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:15.388 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:15.388 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:15.389 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:15.389 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:15.389 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:15.389 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:15.389 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:15.389 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5149acc640 1 Processor -- start 2026-02-12T18:06:15.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5149acc640 1 -- start start 2026-02-12T18:06:15.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5149acc640 10 monclient: init 2026-02-12T18:06:15.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5149acc640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:15.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5149acc640 10 monclient: _add_conns ranks=[8,5,4,2,6,3,1,0,7] 2026-02-12T18:06:15.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5149acc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f514405dd20 0x7f51441096c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.389 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5149acc640 10 monclient(hunting): picked mon.noname-e con 0x7f514405dd20 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:15.390 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5149acc640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f5144093ac0 0x7f514412ced0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.390 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5149acc640 10 monclient(hunting): picked mon.noname-h con 0x7f5144093ac0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:15.390 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5149acc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f514413e990 0x7f514412d410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.390 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5149acc640 10 monclient(hunting): picked mon.noname-c con 0x7f514413e990 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:06:15.390 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5149acc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:15.390 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5149acc640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f514413d910 con 0x7f514413e990 2026-02-12T18:06:15.390 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5149acc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:15.390 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5149acc640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f514405c040 con 0x7f5144093ac0 2026-02-12T18:06:15.390 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5149acc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:15.390 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5149acc640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f514405ab50 con 0x7f514405dd20 2026-02-12T18:06:15.390 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5149acc640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:15.390 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5149acc640 10 monclient(hunting): authenticate will time out at 614.099478s 2026-02-12T18:06:15.390 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5143fff640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f514413e990 0x7f514412d410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.391 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f51437fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f514405dd20 0x7f51441096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.391 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5143fff640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f514413e990 0x7f514412d410 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:41272/0 (socket says 10.20.193.48:41272) 2026-02-12T18:06:15.391 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5143fff640 1 -- 10.20.193.48:0/2523693642 learned_addr learned my addr 10.20.193.48:0/2523693642 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:15.391 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5143fff640 10 monclient(hunting): get_auth_request con 0x7f514413e990 auth_method 0 2026-02-12T18:06:15.391 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5143fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:15.391 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5143fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:15.391 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5143fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:15.391 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f51437fe640 10 monclient(hunting): get_auth_request con 0x7f514405dd20 auth_method 0 2026-02-12T18:06:15.391 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f51437fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:15.391 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f51437fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:15.391 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f51437fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:15.391 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5143fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:15.392 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5143fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:15.392 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5143fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:15.392 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f51437fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:15.392 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f51437fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:15.392 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f51437fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:15.392 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5142ffd640 1 --2- 10.20.193.48:0/2523693642 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f5144093ac0 0x7f514412ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.392 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5143fff640 10 monclient(hunting): handle_auth_done global_id 34276 payload 824 2026-02-12T18:06:15.392 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5143fff640 1 -- 10.20.193.48:0/2523693642 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f514405dd20 msgr2=0x7f51441096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:15.392 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5143fff640 1 --2- 10.20.193.48:0/2523693642 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f514405dd20 0x7f51441096c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.392 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5143fff640 1 -- 10.20.193.48:0/2523693642 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f5144093ac0 msgr2=0x7f514412ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:15.392 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5143fff640 1 --2- 10.20.193.48:0/2523693642 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f5144093ac0 0x7f514412ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.392 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5143fff640 10 monclient: _finish_hunting 0 2026-02-12T18:06:15.393 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5143fff640 1 monclient: found mon.noname-c 2026-02-12T18:06:15.393 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5143fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:15.393 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5143fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:06:15.393 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.373+0000 7f5143fff640 1 -- 10.20.193.48:0/2523693642 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513800a500 con 0x7f514413e990 2026-02-12T18:06:15.393 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.375+0000 7f5143fff640 1 -- 10.20.193.48:0/2523693642 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f514413e990 msgr2=0x7f514412d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:15.393 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.375+0000 7f5143fff640 1 --2- 10.20.193.48:0/2523693642 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f514413e990 0x7f514412d410 secure :-1 s=READY pgs=46 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f513800fb30 tx=0x7f513800af20 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:15.393 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.376+0000 7f511ffff640 1 -- 10.20.193.48:0/2523693642 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f513800dce0 con 0x7f514413e990 2026-02-12T18:06:15.393 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.376+0000 7f511ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:15.393 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.376+0000 7f511ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:06:15.393 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.376+0000 7f511ffff640 10 monclient: dump: 2026-02-12T18:06:15.393 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:15.393 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:15.394 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.394 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.394 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:15.394 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.394 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:15.394 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:15.394 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:15.394 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:15.394 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:15.394 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:15.394 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:15.394 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:15.394 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:15.394 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.395 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.376+0000 7f511ffff640 10 monclient: _finish_auth 0 2026-02-12T18:06:15.395 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.376+0000 7f511ffff640 10 monclient: _check_auth_tickets 2026-02-12T18:06:15.395 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.376+0000 7f511ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:15.395 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.376+0000 7f511ffff640 1 -- 10.20.193.48:0/2523693642 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f513800de80 con 0x7f514413e990 2026-02-12T18:06:15.395 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.376+0000 7f511ffff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:15.395 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.376+0000 7f511ffff640 1 -- 10.20.193.48:0/2523693642 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f51380054f0 con 0x7f514413e990 2026-02-12T18:06:15.395 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.376+0000 7f511ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:15.395 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.376+0000 7f511ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:06:15.395 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.376+0000 7f511ffff640 10 monclient: dump: 2026-02-12T18:06:15.395 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:15.395 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:15.395 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.396 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.396 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:15.396 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.396 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:15.396 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:15.396 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:15.396 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:15.396 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:15.396 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:15.396 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:15.396 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:15.396 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:15.396 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.397 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.376+0000 7f5149acc640 5 monclient: authenticate success, global_id 34276 2026-02-12T18:06:15.397 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.376+0000 7f5149acc640 10 monclient: _renew_subs 2026-02-12T18:06:15.397 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.376+0000 7f5141ffb640 4 set_mon_vals no callback set 2026-02-12T18:06:15.397 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.376+0000 7f5149acc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:15.397 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.376+0000 7f5149acc640 1 -- 10.20.193.48:0/2523693642 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51340094f0 con 0x7f514413e990 2026-02-12T18:06:15.397 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.376+0000 7f5149acc640 10 monclient: _renew_subs 2026-02-12T18:06:15.397 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.376+0000 7f5149acc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:15.397 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.376+0000 7f5149acc640 1 -- 10.20.193.48:0/2523693642 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f514405c610 con 0x7f514413e990 2026-02-12T18:06:15.397 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.376+0000 7f5149acc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:15.397 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.376+0000 7f5149acc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:15.397 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.376+0000 7f5149acc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:15.397 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.376+0000 7f5149acc640 1 -- 10.20.193.48:0/2523693642 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51040050f0 con 0x7f514413e990 2026-02-12T18:06:15.397 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.376+0000 7f511ffff640 1 -- 10.20.193.48:0/2523693642 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f5138012070 con 0x7f514413e990 2026-02-12T18:06:15.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.377+0000 7f511ffff640 1 --2- 10.20.193.48:0/2523693642 >> v2:10.20.193.111:6812/977811348 conn(0x7f511403f800 0x7f511405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.377+0000 7f511ffff640 1 -- 10.20.193.48:0/2523693642 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (secure 0 0 0) 0x7f5138053d80 con 0x7f514413e990 2026-02-12T18:06:15.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.377+0000 7f51437fe640 1 --2- 10.20.193.48:0/2523693642 >> v2:10.20.193.111:6812/977811348 conn(0x7f511403f800 0x7f511405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.377+0000 7f51437fe640 10 monclient: get_auth_request con 0x7f511403f800 auth_method 0 2026-02-12T18:06:15.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.379+0000 7f511ffff640 1 -- 10.20.193.48:0/2523693642 <== mon.4 v2:10.20.193.48:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f5138004b90 con 0x7f514413e990 2026-02-12T18:06:15.399 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.379+0000 7f511ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:15.399 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.379+0000 7f511ffff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:15.399 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.380+0000 7f51437fe640 1 --2- 10.20.193.48:0/2523693642 >> v2:10.20.193.111:6812/977811348 conn(0x7f511403f800 0x7f511405fcb0 secure :-1 s=READY pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5130007fd0 tx=0x7f5130007ec0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:15.480 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.480+0000 7f5149acc640 1 -- 10.20.193.48:0/2523693642 --> v2:10.20.193.111:6812/977811348 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5104002bb0 con 0x7f511403f800 2026-02-12T18:06:15.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.480+0000 7f511ffff640 1 -- 10.20.193.48:0/2523693642 <== mgr.4123 v2:10.20.193.111:6812/977811348 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34123 (secure 0 0 0) 0x7f5104002bb0 con 0x7f511403f800 2026-02-12T18:06:15.482 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:06:15.483 INFO:teuthology.orchestra.run.trial048.stderr:dumped all 2026-02-12T18:06:15.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.481+0000 7f5149acc640 1 -- 10.20.193.48:0/2523693642 >> v2:10.20.193.111:6812/977811348 conn(0x7f511403f800 msgr2=0x7f511405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:15.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.481+0000 7f5149acc640 1 --2- 10.20.193.48:0/2523693642 >> v2:10.20.193.111:6812/977811348 conn(0x7f511403f800 0x7f511405fcb0 secure :-1 s=READY pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5130007fd0 tx=0x7f5130007ec0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.481+0000 7f5149acc640 10 monclient: shutdown 2026-02-12T18:06:15.484 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.481+0000 7f5149acc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:15.484 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.481+0000 7f5149acc640 1 -- 10.20.193.48:0/2523693642 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f514413e990 msgr2=0x7f514412d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:15.484 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.481+0000 7f5149acc640 1 --2- 10.20.193.48:0/2523693642 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f514413e990 0x7f514412d410 secure :-1 s=READY pgs=46 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f513800fb30 tx=0x7f513800af20 comp rx=0 tx=0).stop 2026-02-12T18:06:15.484 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.482+0000 7f5149acc640 1 -- 10.20.193.48:0/2523693642 shutdown_connections 2026-02-12T18:06:15.484 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.482+0000 7f5149acc640 1 --2- 10.20.193.48:0/2523693642 >> v2:10.20.193.111:6812/977811348 conn(0x7f511403f800 0x7f511405fcb0 unknown :-1 s=CLOSED pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.484 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.482+0000 7f5149acc640 1 --2- 10.20.193.48:0/2523693642 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f514413e990 0x7f514412d410 unknown :-1 s=CLOSED pgs=46 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.484 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.482+0000 7f5149acc640 1 --2- 10.20.193.48:0/2523693642 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f5144093ac0 0x7f514412ced0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.484 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.482+0000 7f5149acc640 1 --2- 10.20.193.48:0/2523693642 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f514405dd20 0x7f51441096c0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.484 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.482+0000 7f5149acc640 1 -- 10.20.193.48:0/2523693642 >> 10.20.193.48:0/2523693642 conn(0x7f5144054b30 msgr2=0x7f514411e080 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:15.484 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.482+0000 7f5149acc640 1 -- 10.20.193.48:0/2523693642 shutdown_connections 2026-02-12T18:06:15.484 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.482+0000 7f5149acc640 1 -- 10.20.193.48:0/2523693642 wait complete. 2026-02-12T18:06:15.490 INFO:teuthology.orchestra.run.trial048.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2026-02-12T18:06:15.171310+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163840,"kb_used_data":2080,"kb_used_omap":50,"kb_used_meta":161613,"kb_avail":566067200,"statfs":{"total":579820584960,"available":579652812800,"internally_reserved":0,"allocated":2129920,"data_stored":1478686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":51998,"internal_metadata":165491938},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.891854"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.383670+0000","last_change":"2026-02-12T18:06:11.383740+0000","last_active":"2026-02-12T18:06:11.383670+0000","last_peered":"2026-02-12T18:06:11.383670+0000","last_clean":"2026-02-12T18:06:11.383670+0000","last_became_active":"2026-02-12T18:06:09.281532+0000","last_became_peered":"2026-02-12T18:06:09.281532+0000","last_unstale":"2026-02-12T18:06:11.383670+0000","last_undegraded":"2026-02-12T18:06:11.383670+0000","last_fullsized":"2026-02-12T18:06:11.383670+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T20:34:57.876774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027561099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.384892+0000","last_change":"2026-02-12T18:06:11.384892+0000","last_active":"2026-02-12T18:06:11.384892+0000","last_peered":"2026-02-12T18:06:11.384892+0000","last_clean":"2026-02-12T18:06:11.384892+0000","last_became_active":"2026-02-12T18:06:09.283689+0000","last_became_peered":"2026-02-12T18:06:09.283689+0000","last_unstale":"2026-02-12T18:06:11.384892+0000","last_undegraded":"2026-02-12T18:06:11.384892+0000","last_fullsized":"2026-02-12T18:06:11.384892+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T00:04:55.700663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046734100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.383588+0000","last_change":"2026-02-12T18:06:11.383662+0000","last_active":"2026-02-12T18:06:11.383588+0000","last_peered":"2026-02-12T18:06:11.383588+0000","last_clean":"2026-02-12T18:06:11.383588+0000","last_became_active":"2026-02-12T18:06:09.281461+0000","last_became_peered":"2026-02-12T18:06:09.281461+0000","last_unstale":"2026-02-12T18:06:11.383588+0000","last_undegraded":"2026-02-12T18:06:11.383588+0000","last_fullsized":"2026-02-12T18:06:11.383588+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T21:13:23.141921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00019704400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.384936+0000","last_change":"2026-02-12T18:06:11.384936+0000","last_active":"2026-02-12T18:06:11.384936+0000","last_peered":"2026-02-12T18:06:11.384936+0000","last_clean":"2026-02-12T18:06:11.384936+0000","last_became_active":"2026-02-12T18:06:09.283688+0000","last_became_peered":"2026-02-12T18:06:09.283688+0000","last_unstale":"2026-02-12T18:06:11.384936+0000","last_undegraded":"2026-02-12T18:06:11.384936+0000","last_fullsized":"2026-02-12T18:06:11.384936+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:54:04.914482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047092800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"18'2","reported_seq":22,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.387972+0000","last_change":"2026-02-12T18:06:11.387479+0000","last_active":"2026-02-12T18:06:11.387972+0000","last_peered":"2026-02-12T18:06:11.387972+0000","last_clean":"2026-02-12T18:06:11.387972+0000","last_became_active":"2026-02-12T18:06:09.283881+0000","last_became_peered":"2026-02-12T18:06:09.283881+0000","last_unstale":"2026-02-12T18:06:11.387972+0000","last_undegraded":"2026-02-12T18:06:11.387972+0000","last_fullsized":"2026-02-12T18:06:11.387972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:14:28.203244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045409299999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.384057+0000","last_change":"2026-02-12T18:06:11.384057+0000","last_active":"2026-02-12T18:06:11.384057+0000","last_peered":"2026-02-12T18:06:11.384057+0000","last_clean":"2026-02-12T18:06:11.384057+0000","last_became_active":"2026-02-12T18:06:09.284036+0000","last_became_peered":"2026-02-12T18:06:09.284036+0000","last_unstale":"2026-02-12T18:06:11.384057+0000","last_undegraded":"2026-02-12T18:06:11.384057+0000","last_fullsized":"2026-02-12T18:06:11.384057+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:15:47.166182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028640700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.383576+0000","last_change":"2026-02-12T18:06:11.383648+0000","last_active":"2026-02-12T18:06:11.383576+0000","last_peered":"2026-02-12T18:06:11.383576+0000","last_clean":"2026-02-12T18:06:11.383576+0000","last_became_active":"2026-02-12T18:06:09.283797+0000","last_became_peered":"2026-02-12T18:06:09.283797+0000","last_unstale":"2026-02-12T18:06:11.383576+0000","last_undegraded":"2026-02-12T18:06:11.383576+0000","last_fullsized":"2026-02-12T18:06:11.383576+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:51:24.172618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018461199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"16'1","reported_seq":21,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.387248+0000","last_change":"2026-02-12T18:06:11.387248+0000","last_active":"2026-02-12T18:06:11.387248+0000","last_peered":"2026-02-12T18:06:11.387248+0000","last_clean":"2026-02-12T18:06:11.387248+0000","last_became_active":"2026-02-12T18:06:09.287509+0000","last_became_peered":"2026-02-12T18:06:09.287509+0000","last_unstale":"2026-02-12T18:06:11.387248+0000","last_undegraded":"2026-02-12T18:06:11.387248+0000","last_fullsized":"2026-02-12T18:06:11.387248+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:54:10.505834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020961600000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"13'112","reported_seq":157,"reported_epoch":18,"state":"active+clean","last_fresh":"2026-02-12T18:06:11.383450+0000","last_change":"2026-02-12T18:06:04.371853+0000","last_active":"2026-02-12T18:06:11.383450+0000","last_peered":"2026-02-12T18:06:11.383450+0000","last_clean":"2026-02-12T18:06:11.383450+0000","last_became_active":"2026-02-12T18:06:04.371628+0000","last_became_peered":"2026-02-12T18:06:04.371628+0000","last_unstale":"2026-02-12T18:06:11.383450+0000","last_undegraded":"2026-02-12T18:06:11.383450+0000","last_fullsized":"2026-02-12T18:06:11.383450+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:02.768915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:02.768915+0000","last_clean_scrub_stamp":"2026-02-12T18:06:02.768915+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:16:28.244842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":12,"seq":51539607556,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":732,"kb_used_omap":7,"kb_used_meta":26936,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":749568,"data_stored":640020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8123,"internal_metadata":27582533},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":49671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":49652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640262,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27112,"kb_used_data":152,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344728,"statfs":{"total":96636764160,"available":96609001472,"internally_reserved":0,"allocated":155648,"data_stored":49652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640261,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27116,"kb_used_data":156,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344724,"statfs":{"total":96636764160,"available":96608997376,"internally_reserved":0,"allocated":159744,"data_stored":49671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640261,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27692,"kb_used_data":732,"kb_used_omap":8,"kb_used_meta":26935,"kb_avail":94344148,"statfs":{"total":96636764160,"available":96608407552,"internally_reserved":0,"allocated":749568,"data_stored":640020,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8775,"internal_metadata":27581881},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T18:06:15.492 INFO:tasks.mon_thrash.ceph_manager:clean! 2026-02-12T18:06:15.492 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_netsplit_grace_period 30 2026-02-12T18:06:15.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.558+0000 7fcb697d2640 10 monclient: get_monmap_and_config 2026-02-12T18:06:15.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.558+0000 7fcb697d2640 10 monclient: build_initial_monmap 2026-02-12T18:06:15.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.558+0000 7fcb697d2640 10 monclient: monmap: 2026-02-12T18:06:15.560 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:15.560 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:15.560 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:15.560009+0000 2026-02-12T18:06:15.560 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:15.560009+0000 2026-02-12T18:06:15.560 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:15.560 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.560 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:15.560 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:15.560 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:15.560 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:15.561 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:15.561 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:15.561 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:15.561 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:15.561 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:15.561 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:15.561 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:15.561 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.559+0000 7fcb697d2640 1 Processor -- start 2026-02-12T18:06:15.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.559+0000 7fcb697d2640 1 -- start start 2026-02-12T18:06:15.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.559+0000 7fcb697d2640 10 monclient: init 2026-02-12T18:06:15.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.559+0000 7fcb697d2640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:15.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.559+0000 7fcb697d2640 10 monclient: _add_conns ranks=[2,6,1,5,7,9,8,3,4,10,0] 2026-02-12T18:06:15.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.559+0000 7fcb697d2640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fcb64090070 0x7fcb6405d630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.559+0000 7fcb697d2640 10 monclient(hunting): picked mon.noname-b con 0x7fcb64090070 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:15.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.559+0000 7fcb697d2640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcb6408cf80 0x7fcb6405db70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.559+0000 7fcb697d2640 10 monclient(hunting): picked mon.noname-d con 0x7fcb6408cf80 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:06:15.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.559+0000 7fcb697d2640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fcb64141fa0 addr v1:10.20.193.111:6789/0 2026-02-12T18:06:15.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.559+0000 7fcb697d2640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb6404dc20 con 0x7fcb64141fa0 2026-02-12T18:06:15.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.559+0000 7fcb697d2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:15.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.559+0000 7fcb697d2640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fcb64057de0 con 0x7fcb64090070 2026-02-12T18:06:15.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.559+0000 7fcb697d2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:15.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.559+0000 7fcb697d2640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fcb64090440 con 0x7fcb6408cf80 2026-02-12T18:06:15.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.559+0000 7fcb697d2640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:15.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.559+0000 7fcb697d2640 10 monclient(hunting): authenticate will time out at 614.285862s 2026-02-12T18:06:15.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.559+0000 7fcb627fc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcb6408cf80 0x7fcb6405db70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.559+0000 7fcb627fc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcb6408cf80 0x7fcb6405db70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:36070/0 (socket says 10.20.193.48:36070) 2026-02-12T18:06:15.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.559+0000 7fcb627fc640 1 -- 10.20.193.48:0/2358106072 learned_addr learned my addr 10.20.193.48:0/2358106072 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:15.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.559+0000 7fcb627fc640 10 monclient(hunting): get_auth_request con 0x7fcb6408cf80 auth_method 0 2026-02-12T18:06:15.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.559+0000 7fcb627fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:15.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.559+0000 7fcb627fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:15.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.559+0000 7fcb627fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:15.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.559+0000 7fcb62ffd640 1 --2- 10.20.193.48:0/2358106072 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fcb64090070 0x7fcb6405d630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.560+0000 7fcb627fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:15.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.560+0000 7fcb627fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:15.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.560+0000 7fcb627fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:15.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.560+0000 7fcb62ffd640 10 monclient(hunting): get_auth_request con 0x7fcb64090070 auth_method 0 2026-02-12T18:06:15.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.560+0000 7fcb62ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:15.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.560+0000 7fcb62ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:15.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.560+0000 7fcb62ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:15.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.560+0000 7fcb627fc640 10 monclient(hunting): handle_auth_done global_id 4398 payload 274 2026-02-12T18:06:15.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.560+0000 7fcb627fc640 1 -- 10.20.193.48:0/2358106072 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fcb64090070 msgr2=0x7fcb6405d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:15.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.560+0000 7fcb627fc640 1 --2- 10.20.193.48:0/2358106072 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fcb64090070 0x7fcb6405d630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.560+0000 7fcb627fc640 1 -- 10.20.193.48:0/2358106072 >> v1:10.20.193.111:6789/0 conn(0x7fcb64141fa0 legacy=0x7fcb64142420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:15.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.560+0000 7fcb627fc640 10 monclient: _finish_hunting 0 2026-02-12T18:06:15.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.560+0000 7fcb627fc640 1 monclient: found mon.noname-d 2026-02-12T18:06:15.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.560+0000 7fcb627fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:15.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.560+0000 7fcb627fc640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:06:15.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.560+0000 7fcb627fc640 1 -- 10.20.193.48:0/2358106072 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6413f130 con 0x7fcb6408cf80 2026-02-12T18:06:15.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.560+0000 7fcb62ffd640 1 --2- 10.20.193.48:0/2358106072 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fcb64090070 0x7fcb6405d630 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:06:15.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.562+0000 7fcb627fc640 1 -- 10.20.193.48:0/2358106072 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcb6408cf80 msgr2=0x7fcb6405db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:15.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.562+0000 7fcb627fc640 1 --2- 10.20.193.48:0/2358106072 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcb6408cf80 0x7fcb6405db70 secure :-1 s=READY pgs=50 gs=2 cs=0 l=1 c_cookie=7377344483435410968 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb4c0098d0 tx=0x7fcb4c02ee20 comp rx=0 tx=0).ready entity=mon.6 client_cookie=666197b888daf618 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:15.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.562+0000 7fcb61ffb640 1 -- 10.20.193.48:0/2358106072 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcb4c035340 con 0x7fcb6408cf80 2026-02-12T18:06:15.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.562+0000 7fcb61ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:15.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.562+0000 7fcb61ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:06:15.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.562+0000 7fcb61ffb640 10 monclient: dump: 2026-02-12T18:06:15.574 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:15.574 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:15.574 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.574 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.574 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:15.574 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.574 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:15.574 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:15.575 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:15.575 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:15.575 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:15.575 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:15.575 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:15.575 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:15.575 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:15.575 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.575 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.562+0000 7fcb61ffb640 10 monclient: _finish_auth 0 2026-02-12T18:06:15.575 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.562+0000 7fcb61ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:06:15.575 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.562+0000 7fcb61ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:15.575 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.562+0000 7fcb61ffb640 1 -- 10.20.193.48:0/2358106072 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb4c0354c0 con 0x7fcb6408cf80 2026-02-12T18:06:15.576 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.562+0000 7fcb61ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:15.576 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.562+0000 7fcb697d2640 5 monclient: authenticate success, global_id 4398 2026-02-12T18:06:15.576 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.562+0000 7fcb697d2640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:15.576 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.562+0000 7fcb697d2640 4 set_mon_vals no callback set 2026-02-12T18:06:15.576 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.562+0000 7fcb61ffb640 1 -- 10.20.193.48:0/2358106072 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcb4c035630 con 0x7fcb6408cf80 2026-02-12T18:06:15.576 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.562+0000 7fcb61ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:15.576 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.562+0000 7fcb61ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:06:15.576 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.562+0000 7fcb61ffb640 10 monclient: dump: 2026-02-12T18:06:15.576 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:15.576 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:15.576 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.576 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.577 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:15.577 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.577 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:15.577 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:15.577 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:15.577 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:15.577 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:15.577 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:15.577 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:15.577 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:15.577 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:15.577 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 10 monclient: shutdown 2026-02-12T18:06:15.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:15.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 1 -- 10.20.193.48:0/2358106072 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcb6408cf80 msgr2=0x7fcb6405db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:15.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 1 --2- 10.20.193.48:0/2358106072 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcb6408cf80 0x7fcb6405db70 secure :-1 s=READY pgs=50 gs=2 cs=0 l=1 c_cookie=7377344483435410968 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb4c0098d0 tx=0x7fcb4c02ee20 comp rx=0 tx=0).stop 2026-02-12T18:06:15.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 1 -- 10.20.193.48:0/2358106072 shutdown_connections 2026-02-12T18:06:15.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 1 --2- 10.20.193.48:0/2358106072 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcb6408cf80 0x7fcb6405db70 unknown :-1 s=CLOSED pgs=50 gs=2 cs=0 l=1 c_cookie=7377344483435410968 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 1 --2- 10.20.193.48:0/2358106072 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fcb64090070 0x7fcb6405d630 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 1 -- 10.20.193.48:0/2358106072 >> 10.20.193.48:0/2358106072 conn(0x7fcb640546a0 msgr2=0x7fcb64054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:15.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 1 -- 10.20.193.48:0/2358106072 shutdown_connections 2026-02-12T18:06:15.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 1 -- 10.20.193.48:0/2358106072 wait complete. 2026-02-12T18:06:15.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 10 monclient: build_initial_monmap 2026-02-12T18:06:15.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 10 monclient: monmap: 2026-02-12T18:06:15.578 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:15.579 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:15.579 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:15.579 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:15.579 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:15.579 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.579 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:15.579 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:15.579 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:15.579 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:15.579 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:15.579 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:15.579 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:15.579 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:15.580 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:15.580 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 1 Processor -- start 2026-02-12T18:06:15.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 1 -- start start 2026-02-12T18:06:15.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 10 monclient: init 2026-02-12T18:06:15.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:15.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 10 monclient: _add_conns ranks=[1,4,0,5,7,2,8,6,3] 2026-02-12T18:06:15.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fcb6408cf80 0x7fcb6408a680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 10 monclient(hunting): picked mon.noname-f con 0x7fcb6408cf80 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:06:15.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcb64090070 0x7fcb6408abc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 10 monclient(hunting): picked mon.noname-c con 0x7fcb64090070 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:06:15.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fcb64141fa0 0x7fcb6408b100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 10 monclient(hunting): picked mon.noname-a con 0x7fcb64141fa0 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:06:15.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:15.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6408b720 con 0x7fcb64141fa0 2026-02-12T18:06:15.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:15.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fcb6408b910 con 0x7fcb6408cf80 2026-02-12T18:06:15.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:15.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fcb6413d9a0 con 0x7fcb64090070 2026-02-12T18:06:15.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:15.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.563+0000 7fcb697d2640 10 monclient(hunting): authenticate will time out at 614.289985s 2026-02-12T18:06:15.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb637fe640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fcb64141fa0 0x7fcb6408b100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb627fc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcb64090070 0x7fcb6408abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb637fe640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fcb64141fa0 0x7fcb6408b100 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:57114/0 (socket says 10.20.193.48:57114) 2026-02-12T18:06:15.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb637fe640 1 -- 10.20.193.48:0/3506408317 learned_addr learned my addr 10.20.193.48:0/3506408317 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:15.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb637fe640 10 monclient(hunting): get_auth_request con 0x7fcb64141fa0 auth_method 0 2026-02-12T18:06:15.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb637fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:15.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb637fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:15.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb637fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:15.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb627fc640 10 monclient(hunting): get_auth_request con 0x7fcb64090070 auth_method 0 2026-02-12T18:06:15.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb627fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:15.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb627fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:15.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb627fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:15.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb637fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:15.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb637fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:15.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb637fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:15.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb627fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:15.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb627fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:15.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb627fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:15.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb62ffd640 1 --2- 10.20.193.48:0/3506408317 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fcb6408cf80 0x7fcb6408a680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb62ffd640 10 monclient(hunting): get_auth_request con 0x7fcb6408cf80 auth_method 0 2026-02-12T18:06:15.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb62ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:15.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb62ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:15.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb62ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:15.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb637fe640 10 monclient(hunting): handle_auth_done global_id 4464 payload 824 2026-02-12T18:06:15.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb637fe640 1 -- 10.20.193.48:0/3506408317 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcb64090070 msgr2=0x7fcb6408abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:15.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb637fe640 1 --2- 10.20.193.48:0/3506408317 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcb64090070 0x7fcb6408abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb637fe640 1 -- 10.20.193.48:0/3506408317 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fcb6408cf80 msgr2=0x7fcb6408a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:15.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb637fe640 1 --2- 10.20.193.48:0/3506408317 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fcb6408cf80 0x7fcb6408a680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb637fe640 10 monclient: _finish_hunting 0 2026-02-12T18:06:15.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb637fe640 1 monclient: found mon.noname-a 2026-02-12T18:06:15.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:15.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb637fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:06:15.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.564+0000 7fcb637fe640 1 -- 10.20.193.48:0/3506408317 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb4c0094f0 con 0x7fcb64141fa0 2026-02-12T18:06:15.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.566+0000 7fcb637fe640 1 -- 10.20.193.48:0/3506408317 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fcb64141fa0 msgr2=0x7fcb6408b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:15.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.566+0000 7fcb637fe640 1 --2- 10.20.193.48:0/3506408317 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fcb64141fa0 0x7fcb6408b100 secure :-1 s=READY pgs=79 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb5400d520 tx=0x7fcb5400d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:15.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.566+0000 7fcb437fe640 1 -- 10.20.193.48:0/3506408317 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcb540064f0 con 0x7fcb64141fa0 2026-02-12T18:06:15.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.566+0000 7fcb437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:15.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.566+0000 7fcb437fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:06:15.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.566+0000 7fcb437fe640 10 monclient: dump: 2026-02-12T18:06:15.584 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:15.585 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:15.585 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.585 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.585 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:15.585 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.585 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:15.585 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:15.585 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:15.585 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:15.585 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:15.585 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:15.585 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:15.585 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:15.586 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:15.586 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.566+0000 7fcb437fe640 10 monclient: _finish_auth 0 2026-02-12T18:06:15.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.566+0000 7fcb437fe640 10 monclient: _check_auth_tickets 2026-02-12T18:06:15.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.566+0000 7fcb437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:15.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.566+0000 7fcb437fe640 1 -- 10.20.193.48:0/3506408317 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb54013840 con 0x7fcb64141fa0 2026-02-12T18:06:15.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.566+0000 7fcb697d2640 5 monclient: authenticate success, global_id 4464 2026-02-12T18:06:15.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.566+0000 7fcb697d2640 10 monclient: _renew_subs 2026-02-12T18:06:15.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.566+0000 7fcb697d2640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:15.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.566+0000 7fcb697d2640 1 -- 10.20.193.48:0/3506408317 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb6413d450 con 0x7fcb64141fa0 2026-02-12T18:06:15.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.566+0000 7fcb437fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:15.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.566+0000 7fcb437fe640 1 -- 10.20.193.48:0/3506408317 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcb54006690 con 0x7fcb64141fa0 2026-02-12T18:06:15.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.566+0000 7fcb437fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:15.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.566+0000 7fcb437fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:15.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.566+0000 7fcb617fa640 4 set_mon_vals no callback set 2026-02-12T18:06:15.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.566+0000 7fcb437fe640 10 monclient: dump: 2026-02-12T18:06:15.587 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:15.587 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:15.587 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.587 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.587 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:15.587 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.587 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:15.587 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:15.587 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:15.587 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:15.588 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:15.588 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:15.588 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:15.588 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:15.588 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:15.588 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.566+0000 7fcb697d2640 10 monclient: _renew_subs 2026-02-12T18:06:15.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.566+0000 7fcb697d2640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:15.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.566+0000 7fcb697d2640 1 -- 10.20.193.48:0/3506408317 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb6408c660 con 0x7fcb64141fa0 2026-02-12T18:06:15.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.567+0000 7fcb697d2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:15.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.567+0000 7fcb697d2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:15.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.567+0000 7fcb697d2640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:15.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.567+0000 7fcb697d2640 1 -- 10.20.193.48:0/3506408317 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb6405d630 con 0x7fcb64141fa0 2026-02-12T18:06:15.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.567+0000 7fcb437fe640 1 -- 10.20.193.48:0/3506408317 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fcb54006030 con 0x7fcb64141fa0 2026-02-12T18:06:15.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.567+0000 7fcb437fe640 1 --2- 10.20.193.48:0/3506408317 >> v2:10.20.193.111:6812/977811348 conn(0x7fcb3003f800 0x7fcb3005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.567+0000 7fcb437fe640 1 -- 10.20.193.48:0/3506408317 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (secure 0 0 0) 0x7fcb540532b0 con 0x7fcb64141fa0 2026-02-12T18:06:15.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.567+0000 7fcb62ffd640 1 --2- 10.20.193.48:0/3506408317 >> v2:10.20.193.111:6812/977811348 conn(0x7fcb3003f800 0x7fcb3005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.568+0000 7fcb62ffd640 10 monclient: get_auth_request con 0x7fcb3003f800 auth_method 0 2026-02-12T18:06:15.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.569+0000 7fcb437fe640 1 -- 10.20.193.48:0/3506408317 <== mon.0 v2:10.20.193.48:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fcb54011760 con 0x7fcb64141fa0 2026-02-12T18:06:15.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.569+0000 7fcb437fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:15.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.569+0000 7fcb437fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:15.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.570+0000 7fcb62ffd640 1 --2- 10.20.193.48:0/3506408317 >> v2:10.20.193.111:6812/977811348 conn(0x7fcb3003f800 0x7fcb3005fcb0 secure :-1 s=READY pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb58004740 tx=0x7fcb58008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:15.673 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.672+0000 7fcb697d2640 10 start_mon_command cmd=[{"prefix": "config set", "who": "mon", "name": "mon_netsplit_grace_period", "value": "30"}] 2026-02-12T18:06:15.673 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.672+0000 7fcb697d2640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "mon", "name": "mon_netsplit_grace_period", "value": "30"}] 2026-02-12T18:06:15.673 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.672+0000 7fcb697d2640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:15.673 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.672+0000 7fcb697d2640 1 -- 10.20.193.48:0/3506408317 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command([{prefix=config set, name=mon_netsplit_grace_period}] v 0) -- 0x7fcb640637c0 con 0x7fcb64141fa0 2026-02-12T18:06:15.675 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.674+0000 7fcb437fe640 1 -- 10.20.193.48:0/3506408317 <== mon.0 v2:10.20.193.48:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_netsplit_grace_period}]=0 v2)=0 v2) ==== 124+0+0 (secure 0 0 0) 0x7fcb54017030 con 0x7fcb64141fa0 2026-02-12T18:06:15.675 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.675+0000 7fcb437fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "mon", "name": "mon_netsplit_grace_period", "value": "30"}] 2026-02-12T18:06:15.675 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.675+0000 7fcb437fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:15.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.677+0000 7fcb697d2640 1 -- 10.20.193.48:0/3506408317 >> v2:10.20.193.111:6812/977811348 conn(0x7fcb3003f800 msgr2=0x7fcb3005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:15.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.677+0000 7fcb697d2640 1 --2- 10.20.193.48:0/3506408317 >> v2:10.20.193.111:6812/977811348 conn(0x7fcb3003f800 0x7fcb3005fcb0 secure :-1 s=READY pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb58004740 tx=0x7fcb58008040 comp rx=0 tx=0).stop 2026-02-12T18:06:15.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.677+0000 7fcb697d2640 10 monclient: shutdown 2026-02-12T18:06:15.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.677+0000 7fcb697d2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:15.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.677+0000 7fcb697d2640 1 -- 10.20.193.48:0/3506408317 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fcb64141fa0 msgr2=0x7fcb6408b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:15.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.677+0000 7fcb697d2640 1 --2- 10.20.193.48:0/3506408317 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fcb64141fa0 0x7fcb6408b100 secure :-1 s=READY pgs=79 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcb5400d520 tx=0x7fcb5400d9f0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.677+0000 7fcb697d2640 1 -- 10.20.193.48:0/3506408317 shutdown_connections 2026-02-12T18:06:15.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.677+0000 7fcb697d2640 1 --2- 10.20.193.48:0/3506408317 >> v2:10.20.193.111:6812/977811348 conn(0x7fcb3003f800 0x7fcb3005fcb0 unknown :-1 s=CLOSED pgs=65 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.677+0000 7fcb697d2640 1 --2- 10.20.193.48:0/3506408317 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fcb64141fa0 0x7fcb6408b100 unknown :-1 s=CLOSED pgs=79 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.677+0000 7fcb697d2640 1 --2- 10.20.193.48:0/3506408317 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fcb64090070 0x7fcb6408abc0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.677+0000 7fcb697d2640 1 --2- 10.20.193.48:0/3506408317 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fcb6408cf80 0x7fcb6408a680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.677+0000 7fcb697d2640 1 -- 10.20.193.48:0/3506408317 >> 10.20.193.48:0/3506408317 conn(0x7fcb640546a0 msgr2=0x7fcb64121010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:15.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.677+0000 7fcb697d2640 1 -- 10.20.193.48:0/3506408317 shutdown_connections 2026-02-12T18:06:15.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.677+0000 7fcb697d2640 1 -- 10.20.193.48:0/3506408317 wait complete. 2026-02-12T18:06:15.687 DEBUG:tasks.mon_thrash:Yielding 2026-02-12T18:06:15.687 INFO:teuthology.run_tasks:Running task exec... 2026-02-12T18:06:15.704 INFO:teuthology.task.exec:Executing custom commands... 2026-02-12T18:06:15.705 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@trial111.front.sepia.ceph.com 2026-02-12T18:06:15.705 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:06:15.705 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2026-02-12T18:06:15.706 INFO:tasks.mon_thrash.mon_thrasher:seed: 1770919575, revive delay: 90.0, thrash delay: 1.0 thrash many: True, maintain quorum: True store thrash: True, probability: 50 freeze mon: prob 10.0 duration 15.0 2026-02-12T18:06:15.706 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2026-02-12T18:06:15.706 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T18:06:15.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.770+0000 7fb8df65b640 10 monclient: get_monmap_and_config 2026-02-12T18:06:15.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.770+0000 7fb8df65b640 10 monclient: build_initial_monmap 2026-02-12T18:06:15.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.770+0000 7fb8df65b640 10 monclient: monmap: 2026-02-12T18:06:15.771 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:15.771 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:15.771 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:15.771550+0000 2026-02-12T18:06:15.772 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:15.771550+0000 2026-02-12T18:06:15.772 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:15.772 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.772 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:15.772 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:15.772 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:15.772 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:15.772 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:15.772 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:15.772 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:15.772 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:15.772 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:15.773 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:15.773 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:15.773 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.770+0000 7fb8df65b640 1 Processor -- start 2026-02-12T18:06:15.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8df65b640 1 -- start start 2026-02-12T18:06:15.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8df65b640 10 monclient: init 2026-02-12T18:06:15.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8df65b640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:15.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8df65b640 10 monclient: _add_conns ranks=[7,10,8,0,2,9,3,4,6,1,5] 2026-02-12T18:06:15.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8df65b640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb8d8057db0 0x7fb8d8144700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8df65b640 10 monclient(hunting): picked mon.noname-i con 0x7fb8d8057db0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:15.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8df65b640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7fb8d8090cb0 0x7fb8d80910a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8df65b640 10 monclient(hunting): picked mon.noname-f con 0x7fb8d8090cb0 addr v2:10.20.193.111:3300/0 2026-02-12T18:06:15.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8df65b640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb8d8140cd0 0x7fb8d8141140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8df65b640 10 monclient(hunting): picked mon.noname-e con 0x7fb8d8140cd0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:15.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8df65b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:15.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8df65b640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7fb8d8058180 con 0x7fb8d8090cb0 2026-02-12T18:06:15.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8df65b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:15.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8df65b640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fb8d8091ad0 con 0x7fb8d8057db0 2026-02-12T18:06:15.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8df65b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:15.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8df65b640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fb8d8056ff0 con 0x7fb8d8140cd0 2026-02-12T18:06:15.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8df65b640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:15.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8df65b640 10 monclient(hunting): authenticate will time out at 614.497400s 2026-02-12T18:06:15.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8ddbd1640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb8d8140cd0 0x7fb8d8141140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8ddbd1640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb8d8140cd0 0x7fb8d8141140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:53204/0 (socket says 10.20.193.48:53204) 2026-02-12T18:06:15.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8ddbd1640 1 -- 10.20.193.48:0/1827320552 learned_addr learned my addr 10.20.193.48:0/1827320552 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:15.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8ddbd1640 10 monclient(hunting): get_auth_request con 0x7fb8d8140cd0 auth_method 0 2026-02-12T18:06:15.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8ddbd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:15.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8ddbd1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:15.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8ddbd1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:15.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8dd3d0640 1 --2- 10.20.193.48:0/1827320552 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb8d8057db0 0x7fb8d8144700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8dd3d0640 10 monclient(hunting): get_auth_request con 0x7fb8d8057db0 auth_method 0 2026-02-12T18:06:15.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8dd3d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:15.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8dd3d0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:15.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8dd3d0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:15.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8ddbd1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:15.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8ddbd1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:15.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8ddbd1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:15.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8dcbcf640 1 --2- 10.20.193.48:0/1827320552 >> v2:10.20.193.111:3300/0 conn(0x7fb8d8090cb0 0x7fb8d80910a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8dcbcf640 10 monclient(hunting): get_auth_request con 0x7fb8d8090cb0 auth_method 0 2026-02-12T18:06:15.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8dcbcf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:15.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8dcbcf640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:15.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8dcbcf640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:15.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8ddbd1640 10 monclient(hunting): handle_auth_done global_id 4427 payload 274 2026-02-12T18:06:15.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8ddbd1640 1 -- 10.20.193.48:0/1827320552 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb8d8057db0 msgr2=0x7fb8d8144700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:15.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8ddbd1640 1 --2- 10.20.193.48:0/1827320552 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb8d8057db0 0x7fb8d8144700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8ddbd1640 1 -- 10.20.193.48:0/1827320552 >> v2:10.20.193.111:3300/0 conn(0x7fb8d8090cb0 msgr2=0x7fb8d80910a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:15.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8ddbd1640 1 --2- 10.20.193.48:0/1827320552 >> v2:10.20.193.111:3300/0 conn(0x7fb8d8090cb0 0x7fb8d80910a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8ddbd1640 10 monclient: _finish_hunting 0 2026-02-12T18:06:15.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8ddbd1640 1 monclient: found mon.noname-e 2026-02-12T18:06:15.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8ddbd1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:15.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8ddbd1640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:06:15.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.771+0000 7fb8ddbd1640 1 -- 10.20.193.48:0/1827320552 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d8060390 con 0x7fb8d8140cd0 2026-02-12T18:06:15.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8ddbd1640 1 -- 10.20.193.48:0/1827320552 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb8d8140cd0 msgr2=0x7fb8d8141140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:15.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8ddbd1640 1 --2- 10.20.193.48:0/1827320552 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb8d8140cd0 0x7fb8d8141140 secure :-1 s=READY pgs=39 gs=1 cs=0 l=1 c_cookie=11557613717689617339 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8d400a140 tx=0x7fb8d402fed0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=a064e470fe124bbb server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:15.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8c7fff640 1 -- 10.20.193.48:0/1827320552 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb8d4030b50 con 0x7fb8d8140cd0 2026-02-12T18:06:15.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:15.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8c7fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:06:15.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8c7fff640 10 monclient: dump: 2026-02-12T18:06:15.787 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:15.787 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:15.787 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.787 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.787 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:15.787 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.787 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:15.788 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:15.788 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:15.788 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:15.788 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:15.788 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:15.788 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:15.788 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:15.788 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:15.788 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8c7fff640 10 monclient: _finish_auth 0 2026-02-12T18:06:15.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8c7fff640 10 monclient: _check_auth_tickets 2026-02-12T18:06:15.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8c7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:15.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8c7fff640 1 -- 10.20.193.48:0/1827320552 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8d4030cd0 con 0x7fb8d8140cd0 2026-02-12T18:06:15.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8df65b640 5 monclient: authenticate success, global_id 4427 2026-02-12T18:06:15.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8df65b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:15.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8c7fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:15.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8c7fff640 1 -- 10.20.193.48:0/1827320552 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb8d4030e40 con 0x7fb8d8140cd0 2026-02-12T18:06:15.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8df65b640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:15.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8df65b640 4 set_mon_vals no callback set 2026-02-12T18:06:15.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:15.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8c7fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:06:15.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8c7fff640 10 monclient: dump: 2026-02-12T18:06:15.789 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:15.789 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:15.789 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.790 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.790 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:15.790 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.790 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:15.790 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:15.790 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:15.790 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:15.790 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:15.790 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:15.790 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:15.790 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:15.790 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:15.790 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8df65b640 10 monclient: shutdown 2026-02-12T18:06:15.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8df65b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:15.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8df65b640 1 -- 10.20.193.48:0/1827320552 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb8d8140cd0 msgr2=0x7fb8d8141140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:15.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8df65b640 1 --2- 10.20.193.48:0/1827320552 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb8d8140cd0 0x7fb8d8141140 secure :-1 s=READY pgs=39 gs=1 cs=0 l=1 c_cookie=11557613717689617339 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8d400a140 tx=0x7fb8d402fed0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8df65b640 1 -- 10.20.193.48:0/1827320552 shutdown_connections 2026-02-12T18:06:15.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8df65b640 1 --2- 10.20.193.48:0/1827320552 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb8d8140cd0 0x7fb8d8141140 unknown :-1 s=CLOSED pgs=39 gs=1 cs=0 l=1 c_cookie=11557613717689617339 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8df65b640 1 --2- 10.20.193.48:0/1827320552 >> v2:10.20.193.111:3300/0 conn(0x7fb8d8090cb0 0x7fb8d80910a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8df65b640 1 --2- 10.20.193.48:0/1827320552 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb8d8057db0 0x7fb8d8144700 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8df65b640 1 -- 10.20.193.48:0/1827320552 >> 10.20.193.48:0/1827320552 conn(0x7fb8d8054d90 msgr2=0x7fb8d80952a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:15.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8df65b640 1 -- 10.20.193.48:0/1827320552 shutdown_connections 2026-02-12T18:06:15.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.774+0000 7fb8df65b640 1 -- 10.20.193.48:0/1827320552 wait complete. 2026-02-12T18:06:15.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8df65b640 10 monclient: build_initial_monmap 2026-02-12T18:06:15.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8df65b640 10 monclient: monmap: 2026-02-12T18:06:15.792 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:15.792 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:15.792 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:15.792 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:15.792 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:15.792 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.792 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:15.792 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:15.792 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:15.792 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:15.792 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:15.793 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:15.793 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:15.793 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:15.793 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:15.793 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8df65b640 1 Processor -- start 2026-02-12T18:06:15.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8df65b640 1 -- start start 2026-02-12T18:06:15.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8df65b640 10 monclient: init 2026-02-12T18:06:15.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8df65b640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:15.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8df65b640 10 monclient: _add_conns ranks=[1,5,4,6,0,8,2,3,7] 2026-02-12T18:06:15.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8df65b640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb8d8057db0 0x7fb8d810dd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8df65b640 10 monclient(hunting): picked mon.noname-f con 0x7fb8d8057db0 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:06:15.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8df65b640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb8d8090cb0 0x7fb8d812be90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8df65b640 10 monclient(hunting): picked mon.noname-h con 0x7fb8d8090cb0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:15.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8df65b640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb8d8140cd0 0x7fb8d813e2e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8df65b640 10 monclient(hunting): picked mon.noname-c con 0x7fb8d8140cd0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:06:15.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8df65b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:15.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8df65b640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb8d810d230 con 0x7fb8d8057db0 2026-02-12T18:06:15.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8df65b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:15.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8df65b640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fb8d810ecf0 con 0x7fb8d8140cd0 2026-02-12T18:06:15.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8df65b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:15.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8df65b640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fb8d810efd0 con 0x7fb8d8090cb0 2026-02-12T18:06:15.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8df65b640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:15.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8df65b640 10 monclient(hunting): authenticate will time out at 614.501716s 2026-02-12T18:06:15.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8ddbd1640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb8d8140cd0 0x7fb8d813e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8ddbd1640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb8d8140cd0 0x7fb8d813e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:41284/0 (socket says 10.20.193.48:41284) 2026-02-12T18:06:15.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8ddbd1640 1 -- 10.20.193.48:0/2439342621 learned_addr learned my addr 10.20.193.48:0/2439342621 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:15.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8ddbd1640 10 monclient(hunting): get_auth_request con 0x7fb8d8140cd0 auth_method 0 2026-02-12T18:06:15.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8ddbd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:15.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8ddbd1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:15.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8ddbd1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:15.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8ddbd1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:15.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8ddbd1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:15.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8ddbd1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:15.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8dcbcf640 1 --2- 10.20.193.48:0/2439342621 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb8d8090cb0 0x7fb8d812be90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8dcbcf640 10 monclient(hunting): get_auth_request con 0x7fb8d8090cb0 auth_method 0 2026-02-12T18:06:15.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8dcbcf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:15.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8dcbcf640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:15.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8dcbcf640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:15.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8dd3d0640 1 --2- 10.20.193.48:0/2439342621 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb8d8057db0 0x7fb8d810dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8dd3d0640 10 monclient(hunting): get_auth_request con 0x7fb8d8057db0 auth_method 0 2026-02-12T18:06:15.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8dd3d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:15.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8dd3d0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:15.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.775+0000 7fb8dd3d0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:15.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.776+0000 7fb8ddbd1640 10 monclient(hunting): handle_auth_done global_id 34303 payload 824 2026-02-12T18:06:15.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.776+0000 7fb8ddbd1640 1 -- 10.20.193.48:0/2439342621 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb8d8090cb0 msgr2=0x7fb8d812be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:15.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.776+0000 7fb8ddbd1640 1 --2- 10.20.193.48:0/2439342621 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb8d8090cb0 0x7fb8d812be90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.776+0000 7fb8ddbd1640 1 -- 10.20.193.48:0/2439342621 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb8d8057db0 msgr2=0x7fb8d810dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:15.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.776+0000 7fb8ddbd1640 1 --2- 10.20.193.48:0/2439342621 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb8d8057db0 0x7fb8d810dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.776+0000 7fb8ddbd1640 10 monclient: _finish_hunting 0 2026-02-12T18:06:15.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.776+0000 7fb8ddbd1640 1 monclient: found mon.noname-c 2026-02-12T18:06:15.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.776+0000 7fb8ddbd1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:15.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.776+0000 7fb8ddbd1640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:06:15.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.776+0000 7fb8ddbd1640 1 -- 10.20.193.48:0/2439342621 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8d400a5d0 con 0x7fb8d8140cd0 2026-02-12T18:06:15.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.778+0000 7fb8ddbd1640 1 -- 10.20.193.48:0/2439342621 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb8d8140cd0 msgr2=0x7fb8d813e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:15.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.778+0000 7fb8ddbd1640 1 --2- 10.20.193.48:0/2439342621 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb8d8140cd0 0x7fb8d813e2e0 secure :-1 s=READY pgs=47 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8d400a900 tx=0x7fb8d4005850 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:15.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.778+0000 7fb8c5ffb640 1 -- 10.20.193.48:0/2439342621 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb8d4030b50 con 0x7fb8d8140cd0 2026-02-12T18:06:15.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.778+0000 7fb8c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:15.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.778+0000 7fb8c5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:06:15.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.778+0000 7fb8c5ffb640 10 monclient: dump: 2026-02-12T18:06:15.797 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:15.798 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:15.798 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.798 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.798 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:15.798 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.798 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:15.798 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:15.798 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:15.798 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:15.798 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:15.798 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:15.798 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:15.798 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:15.799 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:15.799 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.778+0000 7fb8c5ffb640 10 monclient: _finish_auth 0 2026-02-12T18:06:15.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.778+0000 7fb8c5ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:06:15.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.778+0000 7fb8c5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:15.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.778+0000 7fb8df65b640 5 monclient: authenticate success, global_id 34303 2026-02-12T18:06:15.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.778+0000 7fb8c5ffb640 1 -- 10.20.193.48:0/2439342621 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8d40056c0 con 0x7fb8d8140cd0 2026-02-12T18:06:15.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.778+0000 7fb8c5ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:15.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.778+0000 7fb8c5ffb640 1 -- 10.20.193.48:0/2439342621 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb8d4038dc0 con 0x7fb8d8140cd0 2026-02-12T18:06:15.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.778+0000 7fb8df65b640 10 monclient: _renew_subs 2026-02-12T18:06:15.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.778+0000 7fb8df65b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:15.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.778+0000 7fb8df65b640 1 -- 10.20.193.48:0/2439342621 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8d8056430 con 0x7fb8d8140cd0 2026-02-12T18:06:15.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.778+0000 7fb8c77fe640 4 set_mon_vals no callback set 2026-02-12T18:06:15.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.778+0000 7fb8c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:15.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.778+0000 7fb8c5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:06:15.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.778+0000 7fb8c5ffb640 10 monclient: dump: 2026-02-12T18:06:15.800 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:15.800 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:15.800 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.800 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:15.800 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:15.800 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:15.800 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:15.800 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:15.801 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:15.801 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:15.801 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:15.801 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:15.801 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:15.801 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:15.801 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:15.801 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:15.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.778+0000 7fb8df65b640 10 monclient: _renew_subs 2026-02-12T18:06:15.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.778+0000 7fb8df65b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:15.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.778+0000 7fb8df65b640 1 -- 10.20.193.48:0/2439342621 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8d812c570 con 0x7fb8d8140cd0 2026-02-12T18:06:15.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.779+0000 7fb8df65b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:15.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.779+0000 7fb8df65b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:15.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.779+0000 7fb8df65b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:15.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.779+0000 7fb8c5ffb640 1 -- 10.20.193.48:0/2439342621 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fb8d4048020 con 0x7fb8d8140cd0 2026-02-12T18:06:15.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.779+0000 7fb8df65b640 1 -- 10.20.193.48:0/2439342621 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8d8094410 con 0x7fb8d8140cd0 2026-02-12T18:06:15.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.779+0000 7fb8c5ffb640 1 --2- 10.20.193.48:0/2439342621 >> v2:10.20.193.111:6812/977811348 conn(0x7fb8a803f800 0x7fb8a805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:15.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.779+0000 7fb8c5ffb640 1 -- 10.20.193.48:0/2439342621 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (secure 0 0 0) 0x7fb8d4030e40 con 0x7fb8d8140cd0 2026-02-12T18:06:15.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.779+0000 7fb8dd3d0640 1 --2- 10.20.193.48:0/2439342621 >> v2:10.20.193.111:6812/977811348 conn(0x7fb8a803f800 0x7fb8a805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:15.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.779+0000 7fb8dd3d0640 10 monclient: get_auth_request con 0x7fb8a803f800 auth_method 0 2026-02-12T18:06:15.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.781+0000 7fb8c5ffb640 1 -- 10.20.193.48:0/2439342621 <== mon.4 v2:10.20.193.48:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fb8d4041420 con 0x7fb8d8140cd0 2026-02-12T18:06:15.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.781+0000 7fb8c5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:15.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.781+0000 7fb8c5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:15.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.782+0000 7fb8dd3d0640 1 --2- 10.20.193.48:0/2439342621 >> v2:10.20.193.111:6812/977811348 conn(0x7fb8a803f800 0x7fb8a805fcb0 secure :-1 s=READY pgs=68 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8c8004740 tx=0x7fb8c8008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:15.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.925+0000 7fb8df65b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T18:06:15.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.925+0000 7fb8df65b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T18:06:15.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.925+0000 7fb8df65b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:15.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.925+0000 7fb8df65b640 1 -- 10.20.193.48:0/2439342621 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb8d810ee30 con 0x7fb8d8140cd0 2026-02-12T18:06:15.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.925+0000 7fb8c5ffb640 1 -- 10.20.193.48:0/2439342621 <== mon.4 v2:10.20.193.48:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3661 (secure 0 0 0) 0x7fb8d810ee30 con 0x7fb8d8140cd0 2026-02-12T18:06:15.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.925+0000 7fb8c5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T18:06:15.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.925+0000 7fb8c5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:15.927 INFO:teuthology.orchestra.run.trial048.stdout:{"election_epoch":12,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","modified":"2026-02-12T18:05:32.850777Z","created":"2026-02-12T18:05:32.850777Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3300","nonce":0},{"type":"v1","addr":"10.20.193.48:6789","nonce":0}]},"addr":"10.20.193.48:6789/0","public_addr":"10.20.193.48:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850827+0000","crush_location":[]},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3300","nonce":0},{"type":"v1","addr":"10.20.193.111:6789","nonce":0}]},"addr":"10.20.193.111:6789/0","public_addr":"10.20.193.111:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850829+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3301","nonce":0},{"type":"v1","addr":"10.20.193.48:6790","nonce":0}]},"addr":"10.20.193.48:6790/0","public_addr":"10.20.193.48:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850830+0000","crush_location":[]},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3301","nonce":0},{"type":"v1","addr":"10.20.193.111:6790","nonce":0}]},"addr":"10.20.193.111:6790/0","public_addr":"10.20.193.111:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850833+0000","crush_location":[]},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3302","nonce":0},{"type":"v1","addr":"10.20.193.48:6791","nonce":0}]},"addr":"10.20.193.48:6791/0","public_addr":"10.20.193.48:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3302","nonce":0},{"type":"v1","addr":"10.20.193.111:6791","nonce":0}]},"addr":"10.20.193.111:6791/0","public_addr":"10.20.193.111:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850834+0000","crush_location":[]},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3303","nonce":0},{"type":"v1","addr":"10.20.193.48:6792","nonce":0}]},"addr":"10.20.193.48:6792/0","public_addr":"10.20.193.48:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3303","nonce":0},{"type":"v1","addr":"10.20.193.111:6792","nonce":0}]},"addr":"10.20.193.111:6792/0","public_addr":"10.20.193.111:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850835+0000","crush_location":[]},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3304","nonce":0},{"type":"v1","addr":"10.20.193.48:6793","nonce":0}]},"addr":"10.20.193.48:6793/0","public_addr":"10.20.193.48:6793/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850832+0000","crush_location":[]}]}} 2026-02-12T18:06:15.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.928+0000 7fb8df65b640 1 -- 10.20.193.48:0/2439342621 >> v2:10.20.193.111:6812/977811348 conn(0x7fb8a803f800 msgr2=0x7fb8a805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:15.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.928+0000 7fb8df65b640 1 --2- 10.20.193.48:0/2439342621 >> v2:10.20.193.111:6812/977811348 conn(0x7fb8a803f800 0x7fb8a805fcb0 secure :-1 s=READY pgs=68 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8c8004740 tx=0x7fb8c8008040 comp rx=0 tx=0).stop 2026-02-12T18:06:15.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.928+0000 7fb8df65b640 10 monclient: shutdown 2026-02-12T18:06:15.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.928+0000 7fb8df65b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:15.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.928+0000 7fb8df65b640 1 -- 10.20.193.48:0/2439342621 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb8d8140cd0 msgr2=0x7fb8d813e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:15.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.928+0000 7fb8df65b640 1 --2- 10.20.193.48:0/2439342621 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb8d8140cd0 0x7fb8d813e2e0 secure :-1 s=READY pgs=47 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb8d400a900 tx=0x7fb8d4005850 comp rx=0 tx=0).stop 2026-02-12T18:06:15.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.928+0000 7fb8df65b640 1 -- 10.20.193.48:0/2439342621 shutdown_connections 2026-02-12T18:06:15.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.928+0000 7fb8df65b640 1 --2- 10.20.193.48:0/2439342621 >> v2:10.20.193.111:6812/977811348 conn(0x7fb8a803f800 0x7fb8a805fcb0 unknown :-1 s=CLOSED pgs=68 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.928+0000 7fb8df65b640 1 --2- 10.20.193.48:0/2439342621 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb8d8140cd0 0x7fb8d813e2e0 unknown :-1 s=CLOSED pgs=47 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.928+0000 7fb8df65b640 1 --2- 10.20.193.48:0/2439342621 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb8d8090cb0 0x7fb8d812be90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.928+0000 7fb8df65b640 1 --2- 10.20.193.48:0/2439342621 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb8d8057db0 0x7fb8d810dd90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:15.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.928+0000 7fb8df65b640 1 -- 10.20.193.48:0/2439342621 >> 10.20.193.48:0/2439342621 conn(0x7fb8d8054d90 msgr2=0x7fb8d808aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:15.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.928+0000 7fb8df65b640 1 -- 10.20.193.48:0/2439342621 shutdown_connections 2026-02-12T18:06:15.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:15.928+0000 7fb8df65b640 1 -- 10.20.193.48:0/2439342621 wait complete. 2026-02-12T18:06:15.938 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2026-02-12T18:06:15.938 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-12T18:06:15.938 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2026-02-12T18:06:15.938 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T18:06:16.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.004+0000 7f7501e5b640 10 monclient: get_monmap_and_config 2026-02-12T18:06:16.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.004+0000 7f7501e5b640 10 monclient: build_initial_monmap 2026-02-12T18:06:16.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.004+0000 7f7501e5b640 10 monclient: monmap: 2026-02-12T18:06:16.005 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:16.005 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.005 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:16.005488+0000 2026-02-12T18:06:16.005 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:16.005488+0000 2026-02-12T18:06:16.005 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:16.005 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.006 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:16.006 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:16.006 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:16.006 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:16.006 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:16.006 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:16.006 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:16.006 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:16.006 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:16.006 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:16.006 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:16.006 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.004+0000 7f7501e5b640 1 Processor -- start 2026-02-12T18:06:16.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.004+0000 7f7501e5b640 1 -- start start 2026-02-12T18:06:16.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.004+0000 7f7501e5b640 10 monclient: init 2026-02-12T18:06:16.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f7501e5b640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:16.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f7501e5b640 10 monclient: _add_conns ranks=[0,6,9,7,10,8,2,4,5,3,1] 2026-02-12T18:06:16.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f7501e5b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f74fc05d550 addr v1:10.20.193.48:6789/0 2026-02-12T18:06:16.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f7501e5b640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f74fc13ef60 0x7f74fc183320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f7501e5b640 10 monclient(hunting): picked mon.noname-d con 0x7f74fc13ef60 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:06:16.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f7501e5b640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f74fc183860 0x7f74fc1a3c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f7501e5b640 10 monclient(hunting): picked mon.noname-a con 0x7f74fc183860 addr v2:10.20.193.48:3300/0 2026-02-12T18:06:16.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f7501e5b640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74fc04dc20 con 0x7f74fc05d550 2026-02-12T18:06:16.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f7501e5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f7501e5b640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f74fc08d390 con 0x7f74fc183860 2026-02-12T18:06:16.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f7501e5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f7501e5b640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f74fc08d5a0 con 0x7f74fc13ef60 2026-02-12T18:06:16.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f7501e5b640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:16.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f7501e5b640 10 monclient(hunting): authenticate will time out at 614.731192s 2026-02-12T18:06:16.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74faffd640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f74fc13ef60 0x7f74fc183320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74faffd640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f74fc13ef60 0x7f74fc183320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:36080/0 (socket says 10.20.193.48:36080) 2026-02-12T18:06:16.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74faffd640 1 -- 10.20.193.48:0/1769275739 learned_addr learned my addr 10.20.193.48:0/1769275739 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:16.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74faffd640 10 monclient(hunting): get_auth_request con 0x7f74fc13ef60 auth_method 0 2026-02-12T18:06:16.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74faffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74faffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74faffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74fbfff640 1 --2- 10.20.193.48:0/1769275739 >> v2:10.20.193.48:3300/0 conn(0x7f74fc183860 0x7f74fc1a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74fbfff640 10 monclient(hunting): get_auth_request con 0x7f74fc183860 auth_method 0 2026-02-12T18:06:16.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74faffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74faffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74faffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74fbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74fbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74fbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74faffd640 10 monclient(hunting): handle_auth_done global_id 4407 payload 274 2026-02-12T18:06:16.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74faffd640 1 -- 10.20.193.48:0/1769275739 >> v2:10.20.193.48:3300/0 conn(0x7f74fc183860 msgr2=0x7f74fc1a3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:16.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74faffd640 1 --2- 10.20.193.48:0/1769275739 >> v2:10.20.193.48:3300/0 conn(0x7f74fc183860 0x7f74fc1a3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74faffd640 1 -- 10.20.193.48:0/1769275739 >> v1:10.20.193.48:6789/0 conn(0x7f74fc05d550 legacy=0x7f74fc05d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:16.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74faffd640 10 monclient: _finish_hunting 0 2026-02-12T18:06:16.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74faffd640 1 monclient: found mon.noname-d 2026-02-12T18:06:16.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74faffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:16.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74faffd640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:06:16.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.005+0000 7f74faffd640 1 -- 10.20.193.48:0/1769275739 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74fc0580e0 con 0x7f74fc13ef60 2026-02-12T18:06:16.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.007+0000 7f74faffd640 1 -- 10.20.193.48:0/1769275739 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f74fc13ef60 msgr2=0x7f74fc183320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.007+0000 7f74faffd640 1 --2- 10.20.193.48:0/1769275739 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f74fc13ef60 0x7f74fc183320 secure :-1 s=READY pgs=51 gs=3 cs=0 l=1 c_cookie=16103967289764156130 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74ec009060 tx=0x7f74ec02edf0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=df7cc8ed74e712e2 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f74fa7fc640 1 -- 10.20.193.48:0/1769275739 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f74ec035340 con 0x7f74fc13ef60 2026-02-12T18:06:16.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f74fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f74fa7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:06:16.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f74fa7fc640 10 monclient: dump: 2026-02-12T18:06:16.022 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.022 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.022 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.022 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.022 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.022 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.022 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.022 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.023 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.023 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.023 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.023 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.023 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.023 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.023 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.023 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f74fa7fc640 10 monclient: _finish_auth 0 2026-02-12T18:06:16.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f74fa7fc640 10 monclient: _check_auth_tickets 2026-02-12T18:06:16.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f74fa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:16.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f74fa7fc640 1 -- 10.20.193.48:0/1769275739 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74ec0354c0 con 0x7f74fc13ef60 2026-02-12T18:06:16.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f7501e5b640 5 monclient: authenticate success, global_id 4407 2026-02-12T18:06:16.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f7501e5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:16.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f74fa7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:16.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f74fa7fc640 1 -- 10.20.193.48:0/1769275739 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f74ec035af0 con 0x7f74fc13ef60 2026-02-12T18:06:16.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f7501e5b640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:16.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f7501e5b640 4 set_mon_vals no callback set 2026-02-12T18:06:16.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f74fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f74fa7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:06:16.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f74fa7fc640 10 monclient: dump: 2026-02-12T18:06:16.024 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.024 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.024 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.025 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.025 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.025 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.025 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.025 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.025 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.025 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.025 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.025 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.025 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.025 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.025 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.025 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f7501e5b640 10 monclient: shutdown 2026-02-12T18:06:16.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f7501e5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:16.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f7501e5b640 1 -- 10.20.193.48:0/1769275739 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f74fc13ef60 msgr2=0x7f74fc183320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f7501e5b640 1 --2- 10.20.193.48:0/1769275739 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f74fc13ef60 0x7f74fc183320 secure :-1 s=READY pgs=51 gs=3 cs=0 l=1 c_cookie=16103967289764156130 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74ec009060 tx=0x7f74ec02edf0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f7501e5b640 1 -- 10.20.193.48:0/1769275739 shutdown_connections 2026-02-12T18:06:16.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f7501e5b640 1 --2- 10.20.193.48:0/1769275739 >> v2:10.20.193.48:3300/0 conn(0x7f74fc183860 0x7f74fc1a3c40 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f7501e5b640 1 --2- 10.20.193.48:0/1769275739 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f74fc13ef60 0x7f74fc183320 unknown :-1 s=CLOSED pgs=51 gs=3 cs=0 l=1 c_cookie=16103967289764156130 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f7501e5b640 1 -- 10.20.193.48:0/1769275739 >> 10.20.193.48:0/1769275739 conn(0x7f74fc0546a0 msgr2=0x7f74fc054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:16.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f7501e5b640 1 -- 10.20.193.48:0/1769275739 shutdown_connections 2026-02-12T18:06:16.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f7501e5b640 1 -- 10.20.193.48:0/1769275739 wait complete. 2026-02-12T18:06:16.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f7501e5b640 10 monclient: build_initial_monmap 2026-02-12T18:06:16.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.008+0000 7f7501e5b640 10 monclient: monmap: 2026-02-12T18:06:16.027 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:16.027 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:16.027 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:16.027 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:16.027 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:16.027 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.027 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:16.027 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:16.027 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:16.027 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:16.027 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:16.027 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:16.028 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:16.028 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:16.028 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:16.028 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f7501e5b640 1 Processor -- start 2026-02-12T18:06:16.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f7501e5b640 1 -- start start 2026-02-12T18:06:16.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f7501e5b640 10 monclient: init 2026-02-12T18:06:16.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f7501e5b640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:16.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f7501e5b640 10 monclient: _add_conns ranks=[7,0,5,6,1,8,2,4,3] 2026-02-12T18:06:16.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f7501e5b640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f74fc05d550 0x7f74fc08a700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f7501e5b640 10 monclient(hunting): picked mon.noname-i con 0x7f74fc05d550 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:16.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f7501e5b640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f74fc13ef60 0x7f74fc08ac40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f7501e5b640 10 monclient(hunting): picked mon.noname-a con 0x7f74fc13ef60 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:06:16.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f7501e5b640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f74fc183860 0x7f74fc08b180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f7501e5b640 10 monclient(hunting): picked mon.noname-h con 0x7f74fc183860 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:16.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f7501e5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f7501e5b640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc08bf90 con 0x7f74fc13ef60 2026-02-12T18:06:16.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f7501e5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f7501e5b640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f74fc13abc0 con 0x7f74fc183860 2026-02-12T18:06:16.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f7501e5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f7501e5b640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f74fc05d190 con 0x7f74fc05d550 2026-02-12T18:06:16.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f7501e5b640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:16.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f7501e5b640 10 monclient(hunting): authenticate will time out at 614.735396s 2026-02-12T18:06:16.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74faffd640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f74fc13ef60 0x7f74fc08ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74faffd640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f74fc13ef60 0x7f74fc08ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:57124/0 (socket says 10.20.193.48:57124) 2026-02-12T18:06:16.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74faffd640 1 -- 10.20.193.48:0/1185699915 learned_addr learned my addr 10.20.193.48:0/1185699915 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:16.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74faffd640 10 monclient(hunting): get_auth_request con 0x7f74fc13ef60 auth_method 0 2026-02-12T18:06:16.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74faffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74faffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74faffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74faffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74faffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74faffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74fbfff640 1 --2- 10.20.193.48:0/1185699915 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f74fc183860 0x7f74fc08b180 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74fb7fe640 1 --2- 10.20.193.48:0/1185699915 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f74fc05d550 0x7f74fc08a700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74fbfff640 10 monclient(hunting): get_auth_request con 0x7f74fc183860 auth_method 0 2026-02-12T18:06:16.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74fb7fe640 10 monclient(hunting): get_auth_request con 0x7f74fc05d550 auth_method 0 2026-02-12T18:06:16.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74fb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74fb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74fbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74fbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74fbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74faffd640 10 monclient(hunting): handle_auth_done global_id 4500 payload 824 2026-02-12T18:06:16.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74faffd640 1 -- 10.20.193.48:0/1185699915 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f74fc05d550 msgr2=0x7f74fc08a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74faffd640 1 --2- 10.20.193.48:0/1185699915 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f74fc05d550 0x7f74fc08a700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74faffd640 1 -- 10.20.193.48:0/1185699915 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f74fc183860 msgr2=0x7f74fc08b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74faffd640 1 --2- 10.20.193.48:0/1185699915 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f74fc183860 0x7f74fc08b180 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74faffd640 10 monclient: _finish_hunting 0 2026-02-12T18:06:16.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74faffd640 1 monclient: found mon.noname-a 2026-02-12T18:06:16.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74faffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:16.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74faffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:06:16.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.009+0000 7f74faffd640 1 -- 10.20.193.48:0/1185699915 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74ec0094f0 con 0x7f74fc13ef60 2026-02-12T18:06:16.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.011+0000 7f74faffd640 1 -- 10.20.193.48:0/1185699915 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f74fc13ef60 msgr2=0x7f74fc08ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.011+0000 7f74faffd640 1 --2- 10.20.193.48:0/1185699915 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f74fc13ef60 0x7f74fc08ac40 secure :-1 s=READY pgs=86 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74ec004740 tx=0x7f74ec004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f74d7fff640 1 -- 10.20.193.48:0/1185699915 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f74ec035e00 con 0x7f74fc13ef60 2026-02-12T18:06:16.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f74d7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f74d7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:06:16.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f74d7fff640 10 monclient: dump: 2026-02-12T18:06:16.033 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.033 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.033 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.033 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.033 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.033 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.033 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.033 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.033 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.034 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.034 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.034 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.034 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.034 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.034 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.034 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f74d7fff640 10 monclient: _finish_auth 0 2026-02-12T18:06:16.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f74d7fff640 10 monclient: _check_auth_tickets 2026-02-12T18:06:16.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f74d7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:16.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f74d7fff640 1 -- 10.20.193.48:0/1185699915 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74ec037900 con 0x7f74fc13ef60 2026-02-12T18:06:16.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f7501e5b640 5 monclient: authenticate success, global_id 4500 2026-02-12T18:06:16.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f7501e5b640 10 monclient: _renew_subs 2026-02-12T18:06:16.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f7501e5b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:16.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f7501e5b640 1 -- 10.20.193.48:0/1185699915 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74fc08e660 con 0x7f74fc13ef60 2026-02-12T18:06:16.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f74d7fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:16.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f74d7fff640 1 -- 10.20.193.48:0/1185699915 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f74ec040410 con 0x7f74fc13ef60 2026-02-12T18:06:16.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f74d7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f74f9ffb640 4 set_mon_vals no callback set 2026-02-12T18:06:16.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f74d7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:16.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f74d7fff640 10 monclient: dump: 2026-02-12T18:06:16.035 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.035 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.035 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.035 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.036 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.036 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.036 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.036 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.036 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.036 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.036 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.036 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.036 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.036 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.036 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.036 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f7501e5b640 10 monclient: _renew_subs 2026-02-12T18:06:16.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f7501e5b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:16.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f7501e5b640 1 -- 10.20.193.48:0/1185699915 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74fc12be40 con 0x7f74fc13ef60 2026-02-12T18:06:16.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f7501e5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:16.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f7501e5b640 1 --2- 10.20.193.48:0/1185699915 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f74fc091010 0x7f74fc0599e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f7501e5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f7501e5b640 1 -- 10.20.193.48:0/1185699915 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc05f140 con 0x7f74fc091010 2026-02-12T18:06:16.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f74fb7fe640 1 --2- 10.20.193.48:0/1185699915 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f74fc091010 0x7f74fc0599e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f74fb7fe640 10 monclient: get_auth_request con 0x7f74fc091010 auth_method 0 2026-02-12T18:06:16.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f74fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f74fb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f74fb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f74fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f74fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f74fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.012+0000 7f74d7fff640 1 -- 10.20.193.48:0/1185699915 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f74ec046020 con 0x7f74fc13ef60 2026-02-12T18:06:16.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.013+0000 7f74fb7fe640 10 monclient(hunting): handle_auth_done global_id 4509 payload 824 2026-02-12T18:06:16.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.013+0000 7f74fb7fe640 1 -- 10.20.193.48:0/1185699915 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f74fc05e030 con 0x7f74fc091010 2026-02-12T18:06:16.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.013+0000 7f74d7fff640 1 --2- 10.20.193.48:0/1185699915 >> v2:10.20.193.111:6812/977811348 conn(0x7f74cc03f800 0x7f74cc05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.013+0000 7f74d7fff640 1 -- 10.20.193.48:0/1185699915 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (secure 0 0 0) 0x7f74ec077c60 con 0x7f74fc13ef60 2026-02-12T18:06:16.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.013+0000 7f74fbfff640 1 --2- 10.20.193.48:0/1185699915 >> v2:10.20.193.111:6812/977811348 conn(0x7f74cc03f800 0x7f74cc05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.013+0000 7f74fbfff640 10 monclient: get_auth_request con 0x7f74cc03f800 auth_method 0 2026-02-12T18:06:16.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.015+0000 7f74fb7fe640 1 -- 10.20.193.48:0/1185699915 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f74fc091010 msgr2=0x7f74fc0599e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.015+0000 7f74fb7fe640 1 --2- 10.20.193.48:0/1185699915 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f74fc091010 0x7f74fc0599e0 secure :-1 s=READY pgs=87 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74e800e4d0 tx=0x7f74e800e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.015+0000 7f74d7fff640 1 -- 10.20.193.48:0/1185699915 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f74e8006cb0 con 0x7f74fc091010 2026-02-12T18:06:16.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.015+0000 7f74d7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.015+0000 7f74d7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:16.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.015+0000 7f74d7fff640 10 monclient: dump: 2026-02-12T18:06:16.039 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.039 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.039 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.039 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.039 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.039 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.039 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.039 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.039 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.039 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.039 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.039 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.040 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.040 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.040 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.040 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.015+0000 7f74d7fff640 1 -- 10.20.193.48:0/1185699915 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f74e8006e10 con 0x7f74fc091010 2026-02-12T18:06:16.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.015+0000 7f74d7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:16.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.015+0000 7f74d7fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:16.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.015+0000 7f74d7fff640 1 -- 10.20.193.48:0/1185699915 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f74fc091010 msgr2=0x7f74fc0599e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.015+0000 7f74d7fff640 1 --2- 10.20.193.48:0/1185699915 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f74fc091010 0x7f74fc0599e0 secure :-1 s=READY pgs=87 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74e800e4d0 tx=0x7f74e800e9a0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.015+0000 7f74d7fff640 1 -- 10.20.193.48:0/1185699915 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f74fc091010 msgr2=0x7f74fc0599e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:16.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.015+0000 7f74d7fff640 1 --2- 10.20.193.48:0/1185699915 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f74fc091010 0x7f74fc0599e0 secure :-1 s=CLOSED pgs=87 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74e800e4d0 tx=0x7f74e800e9a0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.015+0000 7f74fbfff640 1 --2- 10.20.193.48:0/1185699915 >> v2:10.20.193.111:6812/977811348 conn(0x7f74cc03f800 0x7f74cc05fcb0 secure :-1 s=READY pgs=69 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74fc08cad0 tx=0x7f74f000a2d0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.018+0000 7f7501e5b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:06:16.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.018+0000 7f7501e5b640 1 --2- 10.20.193.48:0/1185699915 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f74fc059f20 0x7f74fc05a320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.018+0000 7f7501e5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.018+0000 7f7501e5b640 1 -- 10.20.193.48:0/1185699915 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f74fc05fd90 con 0x7f74fc059f20 2026-02-12T18:06:16.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.019+0000 7f74fb7fe640 1 --2- 10.20.193.48:0/1185699915 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f74fc059f20 0x7f74fc05a320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.019+0000 7f74fb7fe640 10 monclient: get_auth_request con 0x7f74fc059f20 auth_method 0 2026-02-12T18:06:16.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.019+0000 7f74fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.019+0000 7f74fb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.019+0000 7f74fb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.019+0000 7f74fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.019+0000 7f74fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.019+0000 7f74fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.019+0000 7f74fb7fe640 10 monclient(hunting): handle_auth_done global_id 4518 payload 824 2026-02-12T18:06:16.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.019+0000 7f74fb7fe640 1 -- 10.20.193.48:0/1185699915 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f74fc057e00 con 0x7f74fc059f20 2026-02-12T18:06:16.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.021+0000 7f74fb7fe640 1 -- 10.20.193.48:0/1185699915 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f74fc059f20 msgr2=0x7f74fc05a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.021+0000 7f74fb7fe640 1 --2- 10.20.193.48:0/1185699915 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f74fc059f20 0x7f74fc05a320 secure :-1 s=READY pgs=88 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74e8015000 tx=0x7f74e8003810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.021+0000 7f74d7fff640 1 -- 10.20.193.48:0/1185699915 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f74e80075e0 con 0x7f74fc059f20 2026-02-12T18:06:16.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.021+0000 7f74d7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.021+0000 7f74d7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:16.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.021+0000 7f74d7fff640 10 monclient: dump: 2026-02-12T18:06:16.044 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.044 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.044 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.044 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.044 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.044 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.044 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.044 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.044 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.044 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.044 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.044 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.045 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.045 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.045 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.045 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.045 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.021+0000 7f74d7fff640 1 -- 10.20.193.48:0/1185699915 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10184 (secure 0 0 0) 0x7f74e8007740 con 0x7f74fc059f20 2026-02-12T18:06:16.045 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.021+0000 7f74d7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:06:16.045 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.021+0000 7f74d7fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:16.045 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.021+0000 7f74d7fff640 1 -- 10.20.193.48:0/1185699915 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f74fc059f20 msgr2=0x7f74fc05a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.045 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.021+0000 7f74d7fff640 1 --2- 10.20.193.48:0/1185699915 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f74fc059f20 0x7f74fc05a320 secure :-1 s=READY pgs=88 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74e8015000 tx=0x7f74e8003810 comp rx=0 tx=0).stop 2026-02-12T18:06:16.045 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:06:16.045 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:06:16.046 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:06:16.046 INFO:teuthology.orchestra.run.trial048.stdout: "state": "leader", 2026-02-12T18:06:16.046 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 12, 2026-02-12T18:06:16.046 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 30856, 2026-02-12T18:06:16.046 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:06:16.046 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:06:16.046 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:06:16.046 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:06:16.046 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:06:16.046 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:06:16.046 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:06:16.046 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:06:16.046 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:06:16.046 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:06:16.047 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.047 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 18, 2026-02-12T18:06:16.047 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:16.047 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:06:16.047 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:06:16.047 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.047 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.047 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.047 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.047 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.047 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.047 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.047 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.047 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.047 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.047 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.048 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.048 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.048 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.048 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:06:16.048 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:06:16.048 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.048 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.048 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.048 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.048 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.048 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.048 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.048 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.048 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.048 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.048 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.048 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.049 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.049 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.049 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.049 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:06:16.049 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:06:16.049 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:06:16.049 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:06:16.049 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:06:16.049 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:06:16.049 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:16.049 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:16.049 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:06:16.049 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:06:16.049 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:06:16.049 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:06:16.049 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:06:16.050 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:06:16.050 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:06:16.050 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:16.050 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:06:16.050 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.050 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.050 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.050 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.050 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.050 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.050 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.050 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.050 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.050 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.050 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.050 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.050 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.050 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.051 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:06:16.051 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.051 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:06:16.051 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.051 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:06:16.051 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:06:16.051 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.051 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.051 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.051 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.051 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:06:16.051 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.051 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.051 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.051 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.051 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:06:16.051 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.051 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.051 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.052 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.052 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:06:16.052 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:06:16.052 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.052 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.052 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:06:16.052 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.052 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.052 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.052 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:06:16.052 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:06:16.052 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.052 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.052 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.052 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.052 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:06:16.052 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.052 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.053 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.053 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.053 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:06:16.053 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.053 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.053 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.053 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.053 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:06:16.053 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:06:16.053 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.053 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.053 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:06:16.053 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.053 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.053 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.053 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:06:16.053 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:06:16.053 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.053 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.053 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.054 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.054 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:06:16.054 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.054 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.054 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.054 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.054 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:06:16.054 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.054 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.054 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.054 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.054 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:06:16.054 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:06:16.054 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.054 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.054 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:06:16.054 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.054 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.054 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.054 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:06:16.055 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:06:16.055 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.055 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.055 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.055 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.055 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:06:16.055 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.055 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.055 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.055 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.055 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:06:16.055 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.055 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.055 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.055 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.055 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:06:16.055 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:06:16.055 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.055 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.055 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:06:16.056 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.056 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.056 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.056 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:06:16.056 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:06:16.056 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.056 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.056 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.056 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.056 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:06:16.056 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.056 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.056 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.056 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.056 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:06:16.056 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.056 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.056 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.056 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.056 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:06:16.056 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:06:16.057 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.057 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.057 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:16.057 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.057 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.057 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.057 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:06:16.057 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:06:16.057 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.057 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.057 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.057 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.057 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:06:16.057 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.057 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.057 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.057 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.057 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:06:16.057 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.057 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.057 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.057 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.058 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:06:16.058 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:06:16.058 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.058 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.058 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:06:16.058 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.058 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.058 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.058 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:06:16.058 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:06:16.058 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.058 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.058 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.058 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.058 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:06:16.058 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.058 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.058 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.058 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.058 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:06:16.058 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.058 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.059 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.059 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.059 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:06:16.059 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:06:16.059 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.059 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.059 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:16.059 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.059 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.059 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.059 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:06:16.059 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:06:16.059 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.059 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.059 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.059 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.059 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:06:16.059 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.059 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.059 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.059 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.060 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:06:16.060 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.060 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.060 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.060 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.060 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:06:16.060 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:06:16.060 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.060 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.060 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:06:16.060 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.060 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.060 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.060 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:06:16.060 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:06:16.060 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.060 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.060 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.060 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.060 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:06:16.060 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.060 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.061 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.061 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.061 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:06:16.061 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.061 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.061 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.061 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.061 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:06:16.061 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:06:16.061 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.061 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.061 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:06:16.061 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.061 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.061 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.061 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.061 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:06:16.061 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:06:16.061 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.061 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:16.061 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:16.061 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:16.061 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.061 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.062 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:06:16.062 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.062 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:16.062 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:16.062 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:16.062 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.062 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.062 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:06:16.062 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.062 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:16.062 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:16.062 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:06:16.062 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.062 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.062 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.062 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:06:16.062 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:06:16.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.021+0000 7f74d7fff640 1 -- 10.20.193.48:0/1185699915 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f74fc059f20 msgr2=0x7f74fc05a320 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:16.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.021+0000 7f74d7fff640 1 --2- 10.20.193.48:0/1185699915 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f74fc059f20 0x7f74fc05a320 secure :-1 s=CLOSED pgs=88 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74e8015000 tx=0x7f74e8003810 comp rx=0 tx=0).stop 2026-02-12T18:06:16.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.022+0000 7f7501e5b640 1 -- 10.20.193.48:0/1185699915 >> v2:10.20.193.111:6812/977811348 conn(0x7f74cc03f800 msgr2=0x7f74cc05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.022+0000 7f7501e5b640 1 --2- 10.20.193.48:0/1185699915 >> v2:10.20.193.111:6812/977811348 conn(0x7f74cc03f800 0x7f74cc05fcb0 secure :-1 s=READY pgs=69 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74fc08cad0 tx=0x7f74f000a2d0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.022+0000 7f7501e5b640 10 monclient: shutdown 2026-02-12T18:06:16.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.022+0000 7f7501e5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:16.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.022+0000 7f7501e5b640 1 -- 10.20.193.48:0/1185699915 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f74fc13ef60 msgr2=0x7f74fc08ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.022+0000 7f7501e5b640 1 --2- 10.20.193.48:0/1185699915 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f74fc13ef60 0x7f74fc08ac40 secure :-1 s=READY pgs=86 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f74ec004740 tx=0x7f74ec004770 comp rx=0 tx=0).stop 2026-02-12T18:06:16.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.022+0000 7f74fbfff640 1 -- 10.20.193.48:0/1185699915 reap_dead start 2026-02-12T18:06:16.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.022+0000 7f7501e5b640 1 -- 10.20.193.48:0/1185699915 shutdown_connections 2026-02-12T18:06:16.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.022+0000 7f7501e5b640 1 --2- 10.20.193.48:0/1185699915 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f74fc13ef60 0x7f74fc08ac40 unknown :-1 s=CLOSED pgs=86 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.022+0000 7f7501e5b640 1 -- 10.20.193.48:0/1185699915 >> 10.20.193.48:0/1185699915 conn(0x7f74fc0546a0 msgr2=0x7f74fc13d190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:16.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.022+0000 7f7501e5b640 1 -- 10.20.193.48:0/1185699915 shutdown_connections 2026-02-12T18:06:16.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.022+0000 7f7501e5b640 1 -- 10.20.193.48:0/1185699915 wait complete. 2026-02-12T18:06:16.064 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:06:16.064 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2026-02-12T18:06:16.064 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T18:06:16.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.127+0000 7f2d7c4cc640 10 monclient: get_monmap_and_config 2026-02-12T18:06:16.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.127+0000 7f2d7c4cc640 10 monclient: build_initial_monmap 2026-02-12T18:06:16.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.128+0000 7f2d7c4cc640 10 monclient: monmap: 2026-02-12T18:06:16.128 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:16.129 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.129 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:16.129049+0000 2026-02-12T18:06:16.129 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:16.129049+0000 2026-02-12T18:06:16.129 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:16.129 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.129 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:16.129 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:16.129 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:16.129 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:16.129 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:16.129 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:16.129 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:16.129 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:16.130 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:16.130 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:16.130 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:16.130 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.128+0000 7f2d7c4cc640 1 Processor -- start 2026-02-12T18:06:16.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.128+0000 7f2d7c4cc640 1 -- start start 2026-02-12T18:06:16.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.128+0000 7f2d7c4cc640 10 monclient: init 2026-02-12T18:06:16.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.128+0000 7f2d7c4cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:16.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.128+0000 7f2d7c4cc640 10 monclient: _add_conns ranks=[1,10,8,6,9,5,7,3,4,2,0] 2026-02-12T18:06:16.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.128+0000 7f2d7c4cc640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f2d7408ff60 addr v1:10.20.193.111:6789/0 2026-02-12T18:06:16.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.128+0000 7f2d7c4cc640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f2d74090330 0x7f2d74090700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.128+0000 7f2d7c4cc640 10 monclient(hunting): picked mon.noname-f con 0x7f2d74090330 addr v2:10.20.193.111:3300/0 2026-02-12T18:06:16.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.128+0000 7f2d7c4cc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2d74185590 0x7f2d741a5970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.128+0000 7f2d7c4cc640 10 monclient(hunting): picked mon.noname-e con 0x7f2d74185590 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:16.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.128+0000 7f2d7c4cc640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d7404dc20 con 0x7f2d7408ff60 2026-02-12T18:06:16.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.128+0000 7f2d7c4cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.128+0000 7f2d7c4cc640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f2d7405d4a0 con 0x7f2d74090330 2026-02-12T18:06:16.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.128+0000 7f2d7c4cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.128+0000 7f2d7c4cc640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f2d7405eb90 con 0x7f2d74185590 2026-02-12T18:06:16.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.128+0000 7f2d7c4cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:16.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.128+0000 7f2d7c4cc640 10 monclient(hunting): authenticate will time out at 614.854792s 2026-02-12T18:06:16.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.128+0000 7f2d7aa42640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2d74185590 0x7f2d741a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.128+0000 7f2d7aa42640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2d74185590 0x7f2d741a5970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:53214/0 (socket says 10.20.193.48:53214) 2026-02-12T18:06:16.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.128+0000 7f2d7aa42640 1 -- 10.20.193.48:0/3673160153 learned_addr learned my addr 10.20.193.48:0/3673160153 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:16.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.128+0000 7f2d7aa42640 10 monclient(hunting): get_auth_request con 0x7f2d74185590 auth_method 0 2026-02-12T18:06:16.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.128+0000 7f2d7aa42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.128+0000 7f2d7aa42640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.128+0000 7f2d7aa42640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.128+0000 7f2d79a40640 1 --2- 10.20.193.48:0/3673160153 >> v2:10.20.193.111:3300/0 conn(0x7f2d74090330 0x7f2d74090700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.129+0000 7f2d79a40640 10 monclient(hunting): get_auth_request con 0x7f2d74090330 auth_method 0 2026-02-12T18:06:16.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.129+0000 7f2d79a40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.129+0000 7f2d79a40640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.129+0000 7f2d79a40640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.129+0000 7f2d7aa42640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.129+0000 7f2d7aa42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.129+0000 7f2d7aa42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.129+0000 7f2d79a40640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.129+0000 7f2d79a40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.129+0000 7f2d79a40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.129+0000 7f2d7aa42640 10 monclient(hunting): handle_auth_done global_id 4436 payload 274 2026-02-12T18:06:16.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.129+0000 7f2d7aa42640 1 -- 10.20.193.48:0/3673160153 >> v2:10.20.193.111:3300/0 conn(0x7f2d74090330 msgr2=0x7f2d74090700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:16.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.129+0000 7f2d7aa42640 1 --2- 10.20.193.48:0/3673160153 >> v2:10.20.193.111:3300/0 conn(0x7f2d74090330 0x7f2d74090700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.129+0000 7f2d7aa42640 1 -- 10.20.193.48:0/3673160153 >> v1:10.20.193.111:6789/0 conn(0x7f2d7408ff60 legacy=0x7f2d74140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:16.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.129+0000 7f2d7aa42640 10 monclient: _finish_hunting 0 2026-02-12T18:06:16.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.129+0000 7f2d7aa42640 1 monclient: found mon.noname-e 2026-02-12T18:06:16.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.129+0000 7f2d7aa42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:16.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.129+0000 7f2d7aa42640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:06:16.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.129+0000 7f2d7aa42640 1 -- 10.20.193.48:0/3673160153 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d74141620 con 0x7f2d74185590 2026-02-12T18:06:16.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.131+0000 7f2d7aa42640 1 -- 10.20.193.48:0/3673160153 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2d74185590 msgr2=0x7f2d741a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.131+0000 7f2d7aa42640 1 --2- 10.20.193.48:0/3673160153 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2d74185590 0x7f2d741a5970 secure :-1 s=READY pgs=40 gs=2 cs=0 l=1 c_cookie=1628663881942363022 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d7000a9b0 tx=0x7f2d7002feb0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=169a2d2bedaeeb8e server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.131+0000 7f2d7923f640 1 -- 10.20.193.48:0/3673160153 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2d70036340 con 0x7f2d74185590 2026-02-12T18:06:16.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.131+0000 7f2d7923f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7923f640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:06:16.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7923f640 10 monclient: dump: 2026-02-12T18:06:16.141 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.142 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.142 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.142 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.142 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.142 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.142 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.142 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.142 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.142 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.142 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.142 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.142 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.142 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.142 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.142 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7923f640 10 monclient: _finish_auth 0 2026-02-12T18:06:16.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7923f640 10 monclient: _check_auth_tickets 2026-02-12T18:06:16.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7923f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:16.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7923f640 1 -- 10.20.193.48:0/3673160153 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d700364c0 con 0x7f2d74185590 2026-02-12T18:06:16.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7c4cc640 5 monclient: authenticate success, global_id 4436 2026-02-12T18:06:16.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7c4cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:16.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7923f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:16.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7923f640 1 -- 10.20.193.48:0/3673160153 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2d70036af0 con 0x7f2d74185590 2026-02-12T18:06:16.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7c4cc640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:16.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7c4cc640 4 set_mon_vals no callback set 2026-02-12T18:06:16.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7923f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7923f640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:06:16.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7923f640 10 monclient: dump: 2026-02-12T18:06:16.143 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.144 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.144 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.144 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.144 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.144 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.144 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.144 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.144 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.144 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.144 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.144 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.144 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.144 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.144 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.144 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.144 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7c4cc640 10 monclient: shutdown 2026-02-12T18:06:16.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7c4cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:16.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7c4cc640 1 -- 10.20.193.48:0/3673160153 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2d74185590 msgr2=0x7f2d741a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7c4cc640 1 --2- 10.20.193.48:0/3673160153 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2d74185590 0x7f2d741a5970 secure :-1 s=READY pgs=40 gs=2 cs=0 l=1 c_cookie=1628663881942363022 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d7000a9b0 tx=0x7f2d7002feb0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7c4cc640 1 -- 10.20.193.48:0/3673160153 shutdown_connections 2026-02-12T18:06:16.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7c4cc640 1 --2- 10.20.193.48:0/3673160153 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2d74185590 0x7f2d741a5970 unknown :-1 s=CLOSED pgs=40 gs=2 cs=0 l=1 c_cookie=1628663881942363022 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7c4cc640 1 --2- 10.20.193.48:0/3673160153 >> v2:10.20.193.111:3300/0 conn(0x7f2d74090330 0x7f2d74090700 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7c4cc640 1 -- 10.20.193.48:0/3673160153 >> 10.20.193.48:0/3673160153 conn(0x7f2d74094420 msgr2=0x7f2d74094820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:16.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7c4cc640 1 -- 10.20.193.48:0/3673160153 shutdown_connections 2026-02-12T18:06:16.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7c4cc640 1 -- 10.20.193.48:0/3673160153 wait complete. 2026-02-12T18:06:16.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7c4cc640 10 monclient: build_initial_monmap 2026-02-12T18:06:16.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.132+0000 7f2d7c4cc640 10 monclient: monmap: 2026-02-12T18:06:16.145 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:16.145 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:16.145 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:16.145 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:16.146 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:16.146 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.146 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:16.146 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:16.146 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:16.146 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:16.146 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:16.146 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:16.146 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:16.146 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:16.146 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:16.146 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7c4cc640 1 Processor -- start 2026-02-12T18:06:16.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7c4cc640 1 -- start start 2026-02-12T18:06:16.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7c4cc640 10 monclient: init 2026-02-12T18:06:16.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7c4cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:16.147 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7c4cc640 10 monclient: _add_conns ranks=[3,4,1,8,6,5,2,0,7] 2026-02-12T18:06:16.147 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7c4cc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2d7408ff60 0x7f2d741545e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.147 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7c4cc640 10 monclient(hunting): picked mon.noname-g con 0x7f2d7408ff60 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:16.147 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7c4cc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f2d74090330 0x7f2d7413dc60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.147 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7c4cc640 10 monclient(hunting): picked mon.noname-c con 0x7f2d74090330 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:06:16.147 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7c4cc640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2d74185590 0x7f2d7413e1a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.147 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7c4cc640 10 monclient(hunting): picked mon.noname-f con 0x7f2d74185590 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:06:16.147 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7c4cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.147 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7c4cc640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2d741553f0 con 0x7f2d74185590 2026-02-12T18:06:16.147 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7c4cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.147 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7c4cc640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2d740909e0 con 0x7f2d7408ff60 2026-02-12T18:06:16.147 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7c4cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.147 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7c4cc640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f2d74154b20 con 0x7f2d74090330 2026-02-12T18:06:16.147 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7c4cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:16.147 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7c4cc640 10 monclient(hunting): authenticate will time out at 614.859467s 2026-02-12T18:06:16.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d79a40640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f2d74090330 0x7f2d7413dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d79a40640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f2d74090330 0x7f2d7413dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:41294/0 (socket says 10.20.193.48:41294) 2026-02-12T18:06:16.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d79a40640 1 -- 10.20.193.48:0/4165075203 learned_addr learned my addr 10.20.193.48:0/4165075203 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:16.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d79a40640 10 monclient(hunting): get_auth_request con 0x7f2d74090330 auth_method 0 2026-02-12T18:06:16.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d79a40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d79a40640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d79a40640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d79a40640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d79a40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d79a40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7aa42640 1 --2- 10.20.193.48:0/4165075203 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2d74185590 0x7f2d7413e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7aa42640 10 monclient(hunting): get_auth_request con 0x7f2d74185590 auth_method 0 2026-02-12T18:06:16.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7aa42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7aa42640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7aa42640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7a241640 1 --2- 10.20.193.48:0/4165075203 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2d7408ff60 0x7f2d741545e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7aa42640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7aa42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7aa42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7a241640 10 monclient(hunting): get_auth_request con 0x7f2d7408ff60 auth_method 0 2026-02-12T18:06:16.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7a241640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7a241640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d7a241640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d79a40640 10 monclient(hunting): handle_auth_done global_id 34312 payload 824 2026-02-12T18:06:16.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d79a40640 1 -- 10.20.193.48:0/4165075203 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2d7408ff60 msgr2=0x7f2d741545e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d79a40640 1 --2- 10.20.193.48:0/4165075203 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2d7408ff60 0x7f2d741545e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d79a40640 1 -- 10.20.193.48:0/4165075203 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2d74185590 msgr2=0x7f2d7413e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d79a40640 1 --2- 10.20.193.48:0/4165075203 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2d74185590 0x7f2d7413e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d79a40640 10 monclient: _finish_hunting 0 2026-02-12T18:06:16.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d79a40640 1 monclient: found mon.noname-c 2026-02-12T18:06:16.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d79a40640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:16.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d79a40640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:06:16.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.133+0000 7f2d79a40640 1 -- 10.20.193.48:0/4165075203 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d7000a5d0 con 0x7f2d74090330 2026-02-12T18:06:16.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d79a40640 1 -- 10.20.193.48:0/4165075203 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f2d74090330 msgr2=0x7f2d7413dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d79a40640 1 --2- 10.20.193.48:0/4165075203 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f2d74090330 0x7f2d7413dc60 secure :-1 s=READY pgs=48 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d680093f0 tx=0x7f2d6800ed50 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d5affd640 1 -- 10.20.193.48:0/4165075203 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2d6800cb50 con 0x7f2d74090330 2026-02-12T18:06:16.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d5affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d5affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:06:16.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d5affd640 10 monclient: dump: 2026-02-12T18:06:16.150 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.150 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.150 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.150 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.150 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.150 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.150 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.151 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.151 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.151 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.151 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.151 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.151 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.151 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.151 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.151 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d5affd640 10 monclient: _finish_auth 0 2026-02-12T18:06:16.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d5affd640 10 monclient: _check_auth_tickets 2026-02-12T18:06:16.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d5affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:16.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d7c4cc640 5 monclient: authenticate success, global_id 34312 2026-02-12T18:06:16.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d5affd640 1 -- 10.20.193.48:0/4165075203 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d6800ccd0 con 0x7f2d74090330 2026-02-12T18:06:16.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d5affd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:16.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d5affd640 1 -- 10.20.193.48:0/4165075203 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2d6800ce40 con 0x7f2d74090330 2026-02-12T18:06:16.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d5affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d78a3e640 4 set_mon_vals no callback set 2026-02-12T18:06:16.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d5affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:06:16.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d5affd640 10 monclient: dump: 2026-02-12T18:06:16.152 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.152 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.152 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.152 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.152 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.152 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.152 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.152 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.152 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.152 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.153 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.153 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.153 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.153 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.153 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.153 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.153 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d7c4cc640 10 monclient: _renew_subs 2026-02-12T18:06:16.153 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d7c4cc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:16.153 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d7c4cc640 1 -- 10.20.193.48:0/4165075203 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d74054740 con 0x7f2d74090330 2026-02-12T18:06:16.153 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d7c4cc640 10 monclient: _renew_subs 2026-02-12T18:06:16.153 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d7c4cc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:16.153 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d7c4cc640 1 -- 10.20.193.48:0/4165075203 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d7413e6e0 con 0x7f2d74090330 2026-02-12T18:06:16.153 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d7c4cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:16.153 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d7c4cc640 1 --2- 10.20.193.48:0/4165075203 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2d7412ba60 0x7f2d7412be30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.153 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d7c4cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.153 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d7c4cc640 1 -- 10.20.193.48:0/4165075203 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f2d74056980 con 0x7f2d7412ba60 2026-02-12T18:06:16.154 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d7a241640 1 --2- 10.20.193.48:0/4165075203 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2d7412ba60 0x7f2d7412be30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.154 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d7a241640 10 monclient: get_auth_request con 0x7f2d7412ba60 auth_method 0 2026-02-12T18:06:16.154 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d7a241640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.154 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d7a241640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.154 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d7a241640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.154 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d7a241640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.154 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d7a241640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.154 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d7a241640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.154 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.136+0000 7f2d5affd640 1 -- 10.20.193.48:0/4165075203 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f2d68011070 con 0x7f2d74090330 2026-02-12T18:06:16.154 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.137+0000 7f2d7a241640 10 monclient(hunting): handle_auth_done global_id 34301 payload 824 2026-02-12T18:06:16.154 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.137+0000 7f2d7a241640 1 -- 10.20.193.48:0/4165075203 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2d740545c0 con 0x7f2d7412ba60 2026-02-12T18:06:16.154 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.137+0000 7f2d5affd640 1 --2- 10.20.193.48:0/4165075203 >> v2:10.20.193.111:6812/977811348 conn(0x7f2d4403f800 0x7f2d4405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.154 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.137+0000 7f2d5affd640 1 -- 10.20.193.48:0/4165075203 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (secure 0 0 0) 0x7f2d68052db0 con 0x7f2d74090330 2026-02-12T18:06:16.154 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.137+0000 7f2d7aa42640 1 --2- 10.20.193.48:0/4165075203 >> v2:10.20.193.111:6812/977811348 conn(0x7f2d4403f800 0x7f2d4405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.154 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.137+0000 7f2d7aa42640 10 monclient: get_auth_request con 0x7f2d4403f800 auth_method 0 2026-02-12T18:06:16.155 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.139+0000 7f2d7a241640 1 -- 10.20.193.48:0/4165075203 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2d7412ba60 msgr2=0x7f2d7412be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.155 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.139+0000 7f2d7a241640 1 --2- 10.20.193.48:0/4165075203 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2d7412ba60 0x7f2d7412be30 secure :-1 s=READY pgs=34 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d6400e4d0 tx=0x7f2d6400e9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.155 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.139+0000 7f2d5affd640 1 -- 10.20.193.48:0/4165075203 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2d64006cb0 con 0x7f2d7412ba60 2026-02-12T18:06:16.155 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.139+0000 7f2d5affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.155 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.139+0000 7f2d5affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:06:16.155 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.139+0000 7f2d5affd640 10 monclient: dump: 2026-02-12T18:06:16.155 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.155 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.155 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.155 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.155 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.155 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.155 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.155 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.155 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.155 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.156 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.156 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.156 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.156 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.156 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.156 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.139+0000 7f2d5affd640 1 -- 10.20.193.48:0/4165075203 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f2d64006e10 con 0x7f2d7412ba60 2026-02-12T18:06:16.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.139+0000 7f2d5affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:16.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.139+0000 7f2d5affd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:16.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.139+0000 7f2d5affd640 1 -- 10.20.193.48:0/4165075203 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2d7412ba60 msgr2=0x7f2d7412be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.139+0000 7f2d5affd640 1 --2- 10.20.193.48:0/4165075203 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2d7412ba60 0x7f2d7412be30 secure :-1 s=READY pgs=34 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d6400e4d0 tx=0x7f2d6400e9a0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.139+0000 7f2d5affd640 1 -- 10.20.193.48:0/4165075203 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2d7412ba60 msgr2=0x7f2d7412be30 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:16.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.139+0000 7f2d5affd640 1 --2- 10.20.193.48:0/4165075203 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2d7412ba60 0x7f2d7412be30 secure :-1 s=CLOSED pgs=34 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d6400e4d0 tx=0x7f2d6400e9a0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.139+0000 7f2d7aa42640 1 --2- 10.20.193.48:0/4165075203 >> v2:10.20.193.111:6812/977811348 conn(0x7f2d4403f800 0x7f2d4405fcb0 secure :-1 s=READY pgs=70 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d7000a140 tx=0x7f2d70007f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.142+0000 7f2d7c4cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:06:16.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.142+0000 7f2d7c4cc640 1 --2- 10.20.193.48:0/4165075203 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2d7412c370 0x7f2d7408b690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.142+0000 7f2d7c4cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.142+0000 7f2d7c4cc640 1 -- 10.20.193.48:0/4165075203 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f2d74050410 con 0x7f2d7412c370 2026-02-12T18:06:16.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.143+0000 7f2d7a241640 1 --2- 10.20.193.48:0/4165075203 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2d7412c370 0x7f2d7408b690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.143+0000 7f2d7a241640 10 monclient: get_auth_request con 0x7f2d7412c370 auth_method 0 2026-02-12T18:06:16.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.143+0000 7f2d7a241640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.143+0000 7f2d7a241640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.143+0000 7f2d7a241640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.143+0000 7f2d7a241640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.143+0000 7f2d7a241640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.143+0000 7f2d7a241640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.143+0000 7f2d7a241640 10 monclient(hunting): handle_auth_done global_id 34310 payload 824 2026-02-12T18:06:16.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.143+0000 7f2d7a241640 1 -- 10.20.193.48:0/4165075203 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2d7405e820 con 0x7f2d7412c370 2026-02-12T18:06:16.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.145+0000 7f2d7a241640 1 -- 10.20.193.48:0/4165075203 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2d7412c370 msgr2=0x7f2d7408b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.145+0000 7f2d7a241640 1 --2- 10.20.193.48:0/4165075203 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2d7412c370 0x7f2d7408b690 secure :-1 s=READY pgs=35 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d64015000 tx=0x7f2d64003810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.145+0000 7f2d5affd640 1 -- 10.20.193.48:0/4165075203 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2d640075e0 con 0x7f2d7412c370 2026-02-12T18:06:16.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.145+0000 7f2d5affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.145+0000 7f2d5affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:06:16.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.145+0000 7f2d5affd640 10 monclient: dump: 2026-02-12T18:06:16.160 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.160 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.160 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.160 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.160 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.160 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.160 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.160 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.160 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.160 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.160 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.160 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.160 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.160 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.160 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.160 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.160 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.145+0000 7f2d5affd640 1 -- 10.20.193.48:0/4165075203 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10015 (secure 0 0 0) 0x7f2d64007740 con 0x7f2d7412c370 2026-02-12T18:06:16.160 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.145+0000 7f2d5affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:06:16.161 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.145+0000 7f2d5affd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:16.161 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.145+0000 7f2d5affd640 1 -- 10.20.193.48:0/4165075203 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2d7412c370 msgr2=0x7f2d7408b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.161 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.145+0000 7f2d5affd640 1 --2- 10.20.193.48:0/4165075203 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2d7412c370 0x7f2d7408b690 secure :-1 s=READY pgs=35 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d64015000 tx=0x7f2d64003810 comp rx=0 tx=0).stop 2026-02-12T18:06:16.161 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.145+0000 7f2d5affd640 1 -- 10.20.193.48:0/4165075203 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2d7412c370 msgr2=0x7f2d7408b690 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:16.161 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.145+0000 7f2d5affd640 1 --2- 10.20.193.48:0/4165075203 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2d7412c370 0x7f2d7408b690 secure :-1 s=CLOSED pgs=35 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d64015000 tx=0x7f2d64003810 comp rx=0 tx=0).stop 2026-02-12T18:06:16.161 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:06:16.161 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:06:16.161 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:06:16.161 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:06:16.161 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 12, 2026-02-12T18:06:16.161 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 30979, 2026-02-12T18:06:16.161 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:06:16.162 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:06:16.162 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:06:16.162 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:06:16.162 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:06:16.162 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:06:16.162 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:06:16.162 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:06:16.162 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:06:16.162 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:06:16.162 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.162 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 19, 2026-02-12T18:06:16.162 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:16.162 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:06:16.162 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:06:16.162 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.162 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.162 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.162 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.163 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.163 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.163 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.163 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.163 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.163 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.163 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.163 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.163 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.163 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.163 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:06:16.163 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:06:16.163 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.163 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.163 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.163 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.163 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.163 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.163 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.163 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.164 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.164 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.164 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.164 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.164 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.164 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.164 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.164 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:06:16.164 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:06:16.164 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:06:16.164 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:06:16.164 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:06:16.164 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:06:16.164 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:16.164 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:16.164 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:06:16.164 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:06:16.164 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:06:16.164 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:06:16.165 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:06:16.165 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:06:16.165 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:06:16.165 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:16.165 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:06:16.165 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.165 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.165 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.165 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.165 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.165 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.165 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.165 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.165 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.165 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.165 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.165 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.165 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.165 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.165 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:06:16.165 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.166 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:06:16.166 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.166 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:06:16.166 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:06:16.166 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.166 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.166 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.166 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.166 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:06:16.166 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.166 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.166 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.166 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.166 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:06:16.166 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.166 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.166 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.166 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.166 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:06:16.166 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:06:16.167 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.167 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.167 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:06:16.167 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.167 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.167 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.167 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:06:16.167 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:06:16.167 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.167 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.167 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.167 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.167 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:06:16.167 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.167 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.167 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.167 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.167 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:06:16.167 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.167 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.167 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.168 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.168 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:06:16.168 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:06:16.168 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.168 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.168 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:06:16.168 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.168 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.168 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.168 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:06:16.168 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:06:16.168 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.168 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.168 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.168 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.168 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:06:16.168 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.168 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.168 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.168 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.168 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:06:16.169 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.169 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.169 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.169 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.169 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:06:16.169 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:06:16.169 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.169 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.169 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:06:16.169 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.169 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.169 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.169 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:06:16.169 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:06:16.169 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.169 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.169 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.169 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.169 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:06:16.169 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.169 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.169 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.169 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.170 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:06:16.170 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.170 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.170 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.170 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.170 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:06:16.170 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:06:16.170 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.170 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.170 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:06:16.170 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.170 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.170 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.170 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:06:16.170 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:06:16.170 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.170 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.170 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.170 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.170 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:06:16.170 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.170 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.170 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.171 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.171 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:06:16.171 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.171 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.171 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.171 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.171 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:06:16.171 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:06:16.171 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.171 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.171 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:16.171 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.171 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.171 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.171 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:06:16.171 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:06:16.171 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.171 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.171 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.171 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.171 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:06:16.171 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.171 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.171 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.172 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.172 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:06:16.172 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.172 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.172 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.172 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.172 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:06:16.172 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:06:16.172 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.172 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.172 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:06:16.172 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.172 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.172 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.172 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:06:16.172 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:06:16.172 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.172 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.172 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.172 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.172 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:06:16.172 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.172 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.172 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.172 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.173 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:06:16.173 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.173 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.173 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.173 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.173 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:06:16.173 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:06:16.173 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.173 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.173 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:16.173 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.173 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.173 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.173 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:06:16.173 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:06:16.173 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.173 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.173 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.173 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.173 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:06:16.173 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.173 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.173 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.173 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.174 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:06:16.174 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.174 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.174 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.174 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.174 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:06:16.174 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:06:16.174 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.174 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.174 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:06:16.174 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.174 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.174 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.174 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:06:16.174 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:06:16.174 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.174 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.174 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.174 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.174 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:06:16.174 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.174 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.174 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.174 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.175 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:06:16.175 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.175 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.175 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.175 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.175 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:06:16.175 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:06:16.175 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.175 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.175 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:06:16.175 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.175 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.175 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.175 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.175 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:06:16.175 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:06:16.175 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.175 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:16.175 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:16.175 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:16.175 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.175 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.175 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:06:16.175 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.175 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:16.176 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:16.176 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:16.176 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.176 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.176 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.176 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:06:16.176 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:06:16.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.145+0000 7f2d7c4cc640 1 -- 10.20.193.48:0/4165075203 >> v2:10.20.193.111:6812/977811348 conn(0x7f2d4403f800 msgr2=0x7f2d4405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.145+0000 7f2d7c4cc640 1 --2- 10.20.193.48:0/4165075203 >> v2:10.20.193.111:6812/977811348 conn(0x7f2d4403f800 0x7f2d4405fcb0 secure :-1 s=READY pgs=70 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d7000a140 tx=0x7f2d70007f90 comp rx=0 tx=0).stop 2026-02-12T18:06:16.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.145+0000 7f2d7c4cc640 10 monclient: shutdown 2026-02-12T18:06:16.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.145+0000 7f2d7c4cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:16.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.145+0000 7f2d7c4cc640 1 -- 10.20.193.48:0/4165075203 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f2d74090330 msgr2=0x7f2d7413dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.145+0000 7f2d7c4cc640 1 --2- 10.20.193.48:0/4165075203 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f2d74090330 0x7f2d7413dc60 secure :-1 s=READY pgs=48 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2d680093f0 tx=0x7f2d6800ed50 comp rx=0 tx=0).stop 2026-02-12T18:06:16.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.145+0000 7f2d7aa42640 1 -- 10.20.193.48:0/4165075203 reap_dead start 2026-02-12T18:06:16.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.146+0000 7f2d7c4cc640 1 -- 10.20.193.48:0/4165075203 shutdown_connections 2026-02-12T18:06:16.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.146+0000 7f2d7c4cc640 1 --2- 10.20.193.48:0/4165075203 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f2d74090330 0x7f2d7413dc60 unknown :-1 s=CLOSED pgs=48 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.146+0000 7f2d7c4cc640 1 -- 10.20.193.48:0/4165075203 >> 10.20.193.48:0/4165075203 conn(0x7f2d74094420 msgr2=0x7f2d7413ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:16.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.146+0000 7f2d7c4cc640 1 -- 10.20.193.48:0/4165075203 shutdown_connections 2026-02-12T18:06:16.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.146+0000 7f2d7c4cc640 1 -- 10.20.193.48:0/4165075203 wait complete. 2026-02-12T18:06:16.177 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:06:16.178 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2026-02-12T18:06:16.178 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T18:06:16.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.242+0000 7f635a70c640 10 monclient: get_monmap_and_config 2026-02-12T18:06:16.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.242+0000 7f635a70c640 10 monclient: build_initial_monmap 2026-02-12T18:06:16.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.242+0000 7f635a70c640 10 monclient: monmap: 2026-02-12T18:06:16.243 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:16.243 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.243 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:16.243762+0000 2026-02-12T18:06:16.243 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:16.243762+0000 2026-02-12T18:06:16.243 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:16.243 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.243 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:16.243 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:16.243 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:16.244 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:16.244 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:16.244 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:16.244 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:16.244 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:16.244 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:16.244 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:16.244 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:16.244 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f635a70c640 1 Processor -- start 2026-02-12T18:06:16.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f635a70c640 1 -- start start 2026-02-12T18:06:16.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f635a70c640 10 monclient: init 2026-02-12T18:06:16.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f635a70c640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:16.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f635a70c640 10 monclient: _add_conns ranks=[1,8,2,6,5,0,10,9,7,4,3] 2026-02-12T18:06:16.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f635a70c640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f635405c950 addr v1:10.20.193.111:6789/0 2026-02-12T18:06:16.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f635a70c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f635405e490 0x7f63541857b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f635a70c640 10 monclient(hunting): picked mon.noname-e con 0x7f635405e490 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:16.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f635a70c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f635405d430 0x7f63541a5d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f635a70c640 10 monclient(hunting): picked mon.noname-b con 0x7f635405d430 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:16.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f635a70c640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f635404dc20 con 0x7f635405c950 2026-02-12T18:06:16.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f635a70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f635a70c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f635405ddd0 con 0x7f635405d430 2026-02-12T18:06:16.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f635a70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f635a70c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f6354092990 con 0x7f635405e490 2026-02-12T18:06:16.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f635a70c640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:16.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f635a70c640 10 monclient(hunting): authenticate will time out at 614.969483s 2026-02-12T18:06:16.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f6358c82640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f635405d430 0x7f63541a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f6358c82640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f635405d430 0x7f63541a5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:60316/0 (socket says 10.20.193.48:60316) 2026-02-12T18:06:16.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f63537fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f635405e490 0x7f63541857b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f6358c82640 1 -- 10.20.193.48:0/3361190785 learned_addr learned my addr 10.20.193.48:0/3361190785 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:16.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f6358c82640 10 monclient(hunting): get_auth_request con 0x7f635405d430 auth_method 0 2026-02-12T18:06:16.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f6358c82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f6358c82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f6358c82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f63537fe640 10 monclient(hunting): get_auth_request con 0x7f635405e490 auth_method 0 2026-02-12T18:06:16.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f63537fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f63537fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f63537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f6358c82640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f6358c82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f6358c82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f63537fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f63537fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f63537fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f6358c82640 10 monclient(hunting): handle_auth_done global_id 34319 payload 274 2026-02-12T18:06:16.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f6358c82640 1 -- 10.20.193.48:0/3361190785 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f635405e490 msgr2=0x7f63541857b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:16.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f6358c82640 1 --2- 10.20.193.48:0/3361190785 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f635405e490 0x7f63541857b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f6358c82640 1 -- 10.20.193.48:0/3361190785 >> v1:10.20.193.111:6789/0 conn(0x7f635405c950 legacy=0x7f635405cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:16.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f6358c82640 10 monclient: _finish_hunting 0 2026-02-12T18:06:16.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f6358c82640 1 monclient: found mon.noname-b 2026-02-12T18:06:16.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f6358c82640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:16.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f6358c82640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:06:16.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.243+0000 7f6358c82640 1 -- 10.20.193.48:0/3361190785 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6354092c70 con 0x7f635405d430 2026-02-12T18:06:16.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f6358c82640 1 -- 10.20.193.48:0/3361190785 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f635405d430 msgr2=0x7f63541a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f6358c82640 1 --2- 10.20.193.48:0/3361190785 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f635405d430 0x7f63541a5d00 secure :-1 s=READY pgs=36 gs=3 cs=0 l=1 c_cookie=1638141507969689269 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f634800a9b0 tx=0x7f634802fef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16bbd905b25b26b5 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f6352ffd640 1 -- 10.20.193.48:0/3361190785 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6348030b70 con 0x7f635405d430 2026-02-12T18:06:16.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f6352ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f6352ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:06:16.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f6352ffd640 10 monclient: dump: 2026-02-12T18:06:16.255 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.255 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.255 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.255 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.255 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.255 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.255 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.255 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.255 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.255 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.255 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.255 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.255 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.255 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.256 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.256 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f6352ffd640 10 monclient: _finish_auth 0 2026-02-12T18:06:16.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f6352ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:06:16.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f6352ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:16.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f6352ffd640 1 -- 10.20.193.48:0/3361190785 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6348030cf0 con 0x7f635405d430 2026-02-12T18:06:16.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f635a70c640 5 monclient: authenticate success, global_id 34319 2026-02-12T18:06:16.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f635a70c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:16.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f6352ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:16.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f6352ffd640 1 -- 10.20.193.48:0/3361190785 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6348030e60 con 0x7f635405d430 2026-02-12T18:06:16.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f635a70c640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:16.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f635a70c640 4 set_mon_vals no callback set 2026-02-12T18:06:16.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f6352ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f6352ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:06:16.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f6352ffd640 10 monclient: dump: 2026-02-12T18:06:16.256 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.256 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.257 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.257 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.257 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.257 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.257 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.257 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.257 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.257 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.257 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.257 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.257 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.257 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.257 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.257 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.257 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f635a70c640 10 monclient: shutdown 2026-02-12T18:06:16.257 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f635a70c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:16.257 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f635a70c640 1 -- 10.20.193.48:0/3361190785 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f635405d430 msgr2=0x7f63541a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.257 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f635a70c640 1 --2- 10.20.193.48:0/3361190785 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f635405d430 0x7f63541a5d00 secure :-1 s=READY pgs=36 gs=3 cs=0 l=1 c_cookie=1638141507969689269 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f634800a9b0 tx=0x7f634802fef0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f635a70c640 1 -- 10.20.193.48:0/3361190785 shutdown_connections 2026-02-12T18:06:16.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f635a70c640 1 --2- 10.20.193.48:0/3361190785 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f635405e490 0x7f63541857b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f635a70c640 1 --2- 10.20.193.48:0/3361190785 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f635405d430 0x7f63541a5d00 unknown :-1 s=CLOSED pgs=36 gs=3 cs=0 l=1 c_cookie=1638141507969689269 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f635a70c640 1 -- 10.20.193.48:0/3361190785 >> 10.20.193.48:0/3361190785 conn(0x7f63540548a0 msgr2=0x7f6354097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:16.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f635a70c640 1 -- 10.20.193.48:0/3361190785 shutdown_connections 2026-02-12T18:06:16.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.246+0000 7f635a70c640 1 -- 10.20.193.48:0/3361190785 wait complete. 2026-02-12T18:06:16.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.247+0000 7f635a70c640 10 monclient: build_initial_monmap 2026-02-12T18:06:16.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.247+0000 7f635a70c640 10 monclient: monmap: 2026-02-12T18:06:16.258 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:16.258 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:16.258 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:16.258 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:16.258 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:16.258 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.258 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:16.258 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:16.259 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:16.259 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:16.259 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:16.259 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:16.259 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:16.259 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:16.259 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:16.259 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.247+0000 7f635a70c640 1 Processor -- start 2026-02-12T18:06:16.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.247+0000 7f635a70c640 1 -- start start 2026-02-12T18:06:16.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.247+0000 7f635a70c640 10 monclient: init 2026-02-12T18:06:16.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.247+0000 7f635a70c640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:16.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.247+0000 7f635a70c640 10 monclient: _add_conns ranks=[5,2,1,3,8,4,7,6,0] 2026-02-12T18:06:16.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.247+0000 7f635a70c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f635405c950 0x7f635408d830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.247+0000 7f635a70c640 10 monclient(hunting): picked mon.noname-h con 0x7f635405c950 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:16.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.247+0000 7f635a70c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f635405d430 0x7f63541a55b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.247+0000 7f635a70c640 10 monclient(hunting): picked mon.noname-b con 0x7f635405d430 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:16.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.247+0000 7f635a70c640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f635405e490 0x7f63541a5af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.247+0000 7f635a70c640 10 monclient(hunting): picked mon.noname-f con 0x7f635405e490 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:06:16.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.247+0000 7f635a70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.247+0000 7f635a70c640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f635408a880 con 0x7f635405e490 2026-02-12T18:06:16.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.247+0000 7f635a70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.247+0000 7f635a70c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f635408bda0 con 0x7f635405d430 2026-02-12T18:06:16.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.247+0000 7f635a70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.247+0000 7f635a70c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f635408c080 con 0x7f635405c950 2026-02-12T18:06:16.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.247+0000 7f635a70c640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:16.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.247+0000 7f635a70c640 10 monclient(hunting): authenticate will time out at 614.973974s 2026-02-12T18:06:16.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.248+0000 7f63537fe640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f635405d430 0x7f63541a55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.248+0000 7f63537fe640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f635405d430 0x7f63541a55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:60320/0 (socket says 10.20.193.48:60320) 2026-02-12T18:06:16.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.248+0000 7f63537fe640 1 -- 10.20.193.48:0/3800325372 learned_addr learned my addr 10.20.193.48:0/3800325372 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:16.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.248+0000 7f63537fe640 10 monclient(hunting): get_auth_request con 0x7f635405d430 auth_method 0 2026-02-12T18:06:16.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.248+0000 7f63537fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.248+0000 7f63537fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.248+0000 7f63537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.248+0000 7f63537fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.248+0000 7f63537fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.248+0000 7f63537fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.248+0000 7f6358c82640 1 --2- 10.20.193.48:0/3800325372 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f635405e490 0x7f63541a5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.248+0000 7f6358c82640 10 monclient(hunting): get_auth_request con 0x7f635405e490 auth_method 0 2026-02-12T18:06:16.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.248+0000 7f6358c82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.248+0000 7f6358c82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.248+0000 7f6358c82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.248+0000 7f6353fff640 1 --2- 10.20.193.48:0/3800325372 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f635405c950 0x7f635408d830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.248+0000 7f63537fe640 10 monclient(hunting): handle_auth_done global_id 34328 payload 824 2026-02-12T18:06:16.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.248+0000 7f63537fe640 1 -- 10.20.193.48:0/3800325372 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f635405c950 msgr2=0x7f635408d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.248+0000 7f63537fe640 1 --2- 10.20.193.48:0/3800325372 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f635405c950 0x7f635408d830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.248+0000 7f63537fe640 1 -- 10.20.193.48:0/3800325372 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f635405e490 msgr2=0x7f63541a5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.248+0000 7f63537fe640 1 --2- 10.20.193.48:0/3800325372 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f635405e490 0x7f63541a5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.248+0000 7f63537fe640 10 monclient: _finish_hunting 0 2026-02-12T18:06:16.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.248+0000 7f63537fe640 1 monclient: found mon.noname-b 2026-02-12T18:06:16.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.248+0000 7f63537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:16.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.248+0000 7f63537fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:06:16.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.248+0000 7f63537fe640 1 -- 10.20.193.48:0/3800325372 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634800a5d0 con 0x7f635405d430 2026-02-12T18:06:16.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.250+0000 7f63537fe640 1 -- 10.20.193.48:0/3800325372 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f635405d430 msgr2=0x7f63541a55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.250+0000 7f63537fe640 1 --2- 10.20.193.48:0/3800325372 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f635405d430 0x7f63541a55b0 secure :-1 s=READY pgs=37 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63440093f0 tx=0x7f634400ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.250+0000 7f6350ff9640 1 -- 10.20.193.48:0/3800325372 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f634400cb50 con 0x7f635405d430 2026-02-12T18:06:16.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.250+0000 7f6350ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.250+0000 7f6350ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:06:16.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.250+0000 7f6350ff9640 10 monclient: dump: 2026-02-12T18:06:16.262 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.262 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.262 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.262 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.262 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.262 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.262 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.262 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.262 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.263 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.263 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.263 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.263 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.263 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.263 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.263 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.250+0000 7f6350ff9640 10 monclient: _finish_auth 0 2026-02-12T18:06:16.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.250+0000 7f6350ff9640 10 monclient: _check_auth_tickets 2026-02-12T18:06:16.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.250+0000 7f6350ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:16.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.250+0000 7f6350ff9640 1 -- 10.20.193.48:0/3800325372 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f634400ccd0 con 0x7f635405d430 2026-02-12T18:06:16.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.250+0000 7f6350ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:16.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.250+0000 7f6350ff9640 1 -- 10.20.193.48:0/3800325372 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f634400ce40 con 0x7f635405d430 2026-02-12T18:06:16.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.250+0000 7f6350ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.250+0000 7f6350ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:06:16.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.250+0000 7f63527fc640 4 set_mon_vals no callback set 2026-02-12T18:06:16.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.250+0000 7f6350ff9640 10 monclient: dump: 2026-02-12T18:06:16.263 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.264 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.264 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.264 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.264 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.264 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.264 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.264 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.264 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.264 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.264 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.264 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.264 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.264 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.264 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.264 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.264 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.250+0000 7f635a70c640 5 monclient: authenticate success, global_id 34328 2026-02-12T18:06:16.264 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.250+0000 7f635a70c640 10 monclient: _renew_subs 2026-02-12T18:06:16.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.250+0000 7f635a70c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:16.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.250+0000 7f635a70c640 1 -- 10.20.193.48:0/3800325372 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6354142e40 con 0x7f635405d430 2026-02-12T18:06:16.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.250+0000 7f635a70c640 10 monclient: _renew_subs 2026-02-12T18:06:16.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.250+0000 7f635a70c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:16.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.250+0000 7f635a70c640 1 -- 10.20.193.48:0/3800325372 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f63541419e0 con 0x7f635405d430 2026-02-12T18:06:16.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.251+0000 7f635a70c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:16.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.251+0000 7f635a70c640 1 --2- 10.20.193.48:0/3800325372 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6354090010 0x7f63540903e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.251+0000 7f635a70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.251+0000 7f635a70c640 1 -- 10.20.193.48:0/3800325372 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f635405f140 con 0x7f6354090010 2026-02-12T18:06:16.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.251+0000 7f6353fff640 1 --2- 10.20.193.48:0/3800325372 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6354090010 0x7f63540903e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.251+0000 7f6353fff640 10 monclient: get_auth_request con 0x7f6354090010 auth_method 0 2026-02-12T18:06:16.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.251+0000 7f6353fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.251+0000 7f6353fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.251+0000 7f6353fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.251+0000 7f6353fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.251+0000 7f6353fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.251+0000 7f6353fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.251+0000 7f6350ff9640 1 -- 10.20.193.48:0/3800325372 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f6344011070 con 0x7f635405d430 2026-02-12T18:06:16.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.251+0000 7f6353fff640 10 monclient(hunting): handle_auth_done global_id 34321 payload 824 2026-02-12T18:06:16.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.251+0000 7f6353fff640 1 -- 10.20.193.48:0/3800325372 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f635408abe0 con 0x7f6354090010 2026-02-12T18:06:16.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.251+0000 7f6350ff9640 1 --2- 10.20.193.48:0/3800325372 >> v2:10.20.193.111:6812/977811348 conn(0x7f632403f800 0x7f632405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.251+0000 7f6350ff9640 1 -- 10.20.193.48:0/3800325372 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (secure 0 0 0) 0x7f6344052a50 con 0x7f635405d430 2026-02-12T18:06:16.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.251+0000 7f6358c82640 1 --2- 10.20.193.48:0/3800325372 >> v2:10.20.193.111:6812/977811348 conn(0x7f632403f800 0x7f632405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.251+0000 7f6358c82640 10 monclient: get_auth_request con 0x7f632403f800 auth_method 0 2026-02-12T18:06:16.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.253+0000 7f6353fff640 1 -- 10.20.193.48:0/3800325372 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6354090010 msgr2=0x7f63540903e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.253+0000 7f6353fff640 1 --2- 10.20.193.48:0/3800325372 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6354090010 0x7f63540903e0 secure :-1 s=READY pgs=49 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63400046b0 tx=0x7f634000d890 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.253+0000 7f6350ff9640 1 -- 10.20.193.48:0/3800325372 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6340012d90 con 0x7f6354090010 2026-02-12T18:06:16.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.253+0000 7f6350ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.253+0000 7f6350ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:06:16.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.253+0000 7f6350ff9640 10 monclient: dump: 2026-02-12T18:06:16.266 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.266 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.266 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.267 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.267 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.267 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.267 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.267 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.267 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.267 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.267 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.267 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.267 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.267 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.267 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.267 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.253+0000 7f6350ff9640 1 -- 10.20.193.48:0/3800325372 <== mon.4 v2:10.20.193.48:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f63400128d0 con 0x7f6354090010 2026-02-12T18:06:16.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.253+0000 7f6350ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:16.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.253+0000 7f6350ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:16.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.253+0000 7f6350ff9640 1 -- 10.20.193.48:0/3800325372 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6354090010 msgr2=0x7f63540903e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.253+0000 7f6350ff9640 1 --2- 10.20.193.48:0/3800325372 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6354090010 0x7f63540903e0 secure :-1 s=READY pgs=49 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63400046b0 tx=0x7f634000d890 comp rx=0 tx=0).stop 2026-02-12T18:06:16.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.253+0000 7f6350ff9640 1 -- 10.20.193.48:0/3800325372 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6354090010 msgr2=0x7f63540903e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:16.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.253+0000 7f6350ff9640 1 --2- 10.20.193.48:0/3800325372 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6354090010 0x7f63540903e0 secure :-1 s=CLOSED pgs=49 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63400046b0 tx=0x7f634000d890 comp rx=0 tx=0).stop 2026-02-12T18:06:16.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.254+0000 7f6358c82640 1 --2- 10.20.193.48:0/3800325372 >> v2:10.20.193.111:6812/977811348 conn(0x7f632403f800 0x7f632405fcb0 secure :-1 s=READY pgs=71 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f634800a140 tx=0x7f6348007f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.257+0000 7f635a70c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:06:16.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.257+0000 7f635a70c640 1 --2- 10.20.193.48:0/3800325372 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6354090920 0x7f635412e230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.257+0000 7f635a70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.257+0000 7f635a70c640 1 -- 10.20.193.48:0/3800325372 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f6354050410 con 0x7f6354090920 2026-02-12T18:06:16.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.257+0000 7f6353fff640 1 --2- 10.20.193.48:0/3800325372 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6354090920 0x7f635412e230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.257+0000 7f6353fff640 10 monclient: get_auth_request con 0x7f6354090920 auth_method 0 2026-02-12T18:06:16.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.257+0000 7f6353fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.257+0000 7f6353fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.257+0000 7f6353fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.257+0000 7f6353fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.257+0000 7f6353fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.257+0000 7f6353fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.257+0000 7f6353fff640 10 monclient(hunting): handle_auth_done global_id 34330 payload 824 2026-02-12T18:06:16.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.257+0000 7f6353fff640 1 -- 10.20.193.48:0/3800325372 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f635405cd20 con 0x7f6354090920 2026-02-12T18:06:16.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.259+0000 7f6353fff640 1 -- 10.20.193.48:0/3800325372 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6354090920 msgr2=0x7f635412e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.259+0000 7f6353fff640 1 --2- 10.20.193.48:0/3800325372 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6354090920 0x7f635412e230 secure :-1 s=READY pgs=50 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63400046b0 tx=0x7f6340003810 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.260+0000 7f6350ff9640 1 -- 10.20.193.48:0/3800325372 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6340029070 con 0x7f6354090920 2026-02-12T18:06:16.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.260+0000 7f6350ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.260+0000 7f6350ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:06:16.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.260+0000 7f6350ff9640 10 monclient: dump: 2026-02-12T18:06:16.271 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.271 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.271 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.271 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.271 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.271 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.271 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.271 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.271 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.271 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.271 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.271 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.271 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.271 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.271 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.271 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.260+0000 7f6350ff9640 1 -- 10.20.193.48:0/3800325372 <== mon.4 v2:10.20.193.48:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10015 (secure 0 0 0) 0x7f6340021040 con 0x7f6354090920 2026-02-12T18:06:16.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.260+0000 7f6350ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:06:16.272 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.260+0000 7f6350ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:16.272 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.260+0000 7f6350ff9640 1 -- 10.20.193.48:0/3800325372 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6354090920 msgr2=0x7f635412e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.272 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.260+0000 7f6350ff9640 1 --2- 10.20.193.48:0/3800325372 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6354090920 0x7f635412e230 secure :-1 s=READY pgs=50 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63400046b0 tx=0x7f6340003810 comp rx=0 tx=0).stop 2026-02-12T18:06:16.272 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.260+0000 7f6350ff9640 1 -- 10.20.193.48:0/3800325372 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6354090920 msgr2=0x7f635412e230 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:16.272 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.260+0000 7f6350ff9640 1 --2- 10.20.193.48:0/3800325372 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6354090920 0x7f635412e230 secure :-1 s=CLOSED pgs=50 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63400046b0 tx=0x7f6340003810 comp rx=0 tx=0).stop 2026-02-12T18:06:16.272 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:06:16.272 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:06:16.272 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:06:16.272 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:06:16.272 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 12, 2026-02-12T18:06:16.272 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 31088, 2026-02-12T18:06:16.272 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:06:16.272 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:06:16.273 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:06:16.273 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:06:16.273 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:06:16.273 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:06:16.273 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:06:16.273 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:06:16.273 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:06:16.273 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:06:16.273 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.273 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 19, 2026-02-12T18:06:16.273 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:16.273 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:06:16.273 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:06:16.273 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.273 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.273 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.273 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.273 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.274 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.274 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.274 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.274 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.274 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.274 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.274 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.274 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.274 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.274 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:06:16.274 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:06:16.274 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.274 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.274 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.274 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.274 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.274 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.274 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.275 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.275 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.275 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.275 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.275 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.275 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.275 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.275 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.275 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:06:16.275 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:06:16.275 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:06:16.275 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:06:16.275 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:06:16.275 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:06:16.275 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:16.275 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:16.275 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:06:16.275 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:06:16.276 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:06:16.276 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:06:16.276 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:06:16.276 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:06:16.276 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:06:16.276 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:16.276 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:06:16.276 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.276 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.276 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.276 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.276 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.276 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.276 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.276 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.276 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.276 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.276 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.276 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.277 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.277 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.277 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:06:16.277 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.277 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:06:16.277 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.277 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:06:16.277 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:06:16.277 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.277 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.277 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.277 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.277 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:06:16.277 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.277 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.277 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.277 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.277 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:06:16.277 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.278 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.278 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.278 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.278 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:06:16.278 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:06:16.278 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.278 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.278 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:06:16.278 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.278 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.278 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.278 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:06:16.278 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:06:16.278 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.278 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.278 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.278 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.278 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:06:16.278 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.278 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.278 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.279 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.279 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:06:16.279 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.279 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.279 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.279 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.279 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:06:16.279 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:06:16.279 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.279 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.279 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:06:16.279 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.279 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.279 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.279 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:06:16.279 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:06:16.279 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.279 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.279 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.279 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.279 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:06:16.280 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.280 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.280 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.280 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.280 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:06:16.280 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.280 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.280 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.280 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.280 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:06:16.280 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:06:16.280 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.280 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.280 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:06:16.280 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.280 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.280 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.280 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:06:16.280 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:06:16.280 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.280 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.280 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.281 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.281 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:06:16.281 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.281 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.281 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.281 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.281 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:06:16.281 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.281 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.281 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.281 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.281 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:06:16.281 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:06:16.281 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.281 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.281 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:06:16.281 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.281 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.281 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.281 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:06:16.281 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:06:16.281 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.282 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.282 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.282 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.282 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:06:16.282 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.282 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.282 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.282 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.282 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:06:16.282 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.282 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.282 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.282 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.282 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:06:16.282 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:06:16.282 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.282 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.282 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:16.282 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.282 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.282 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.282 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:06:16.282 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:06:16.283 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.283 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.283 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.283 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.283 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:06:16.283 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.283 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.283 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.283 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.283 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:06:16.283 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.283 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.283 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.283 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.283 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:06:16.283 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:06:16.283 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.283 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.283 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:06:16.283 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.283 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.283 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.283 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:06:16.284 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:06:16.284 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.284 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.284 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.284 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.284 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:06:16.284 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.284 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.284 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.284 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.284 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:06:16.284 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.284 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.284 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.284 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.284 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:06:16.284 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:06:16.284 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.284 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.284 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:16.284 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.284 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.284 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.284 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:06:16.284 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:06:16.285 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.285 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.285 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.285 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.285 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:06:16.285 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.285 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.285 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.285 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.285 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:06:16.285 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.285 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.285 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.285 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.285 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:06:16.285 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:06:16.285 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.285 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.285 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:06:16.285 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.285 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.285 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.285 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:06:16.285 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:06:16.286 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.286 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.286 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.286 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.286 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:06:16.286 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.286 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.286 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.286 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.286 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:06:16.286 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.286 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.286 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.286 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.286 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:06:16.286 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:06:16.286 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.286 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.286 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:06:16.286 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.286 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.286 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.286 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.286 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:06:16.286 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:06:16.286 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.287 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:16.287 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:16.287 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:16.287 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.287 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.287 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:06:16.287 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.287 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:16.287 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:16.287 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:16.287 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.287 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.287 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.287 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:06:16.287 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:06:16.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.260+0000 7f635a70c640 1 -- 10.20.193.48:0/3800325372 >> v2:10.20.193.111:6812/977811348 conn(0x7f632403f800 msgr2=0x7f632405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.260+0000 7f635a70c640 1 --2- 10.20.193.48:0/3800325372 >> v2:10.20.193.111:6812/977811348 conn(0x7f632403f800 0x7f632405fcb0 secure :-1 s=READY pgs=71 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f634800a140 tx=0x7f6348007f90 comp rx=0 tx=0).stop 2026-02-12T18:06:16.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.260+0000 7f635a70c640 10 monclient: shutdown 2026-02-12T18:06:16.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.260+0000 7f635a70c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:16.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.260+0000 7f635a70c640 1 -- 10.20.193.48:0/3800325372 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f635405d430 msgr2=0x7f63541a55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.260+0000 7f635a70c640 1 --2- 10.20.193.48:0/3800325372 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f635405d430 0x7f63541a55b0 secure :-1 s=READY pgs=37 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f63440093f0 tx=0x7f634400ed30 comp rx=0 tx=0).stop 2026-02-12T18:06:16.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.260+0000 7f6358c82640 1 -- 10.20.193.48:0/3800325372 reap_dead start 2026-02-12T18:06:16.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.260+0000 7f6358c82640 1 -- 10.20.193.48:0/3800325372 reap_dead start 2026-02-12T18:06:16.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.260+0000 7f635a70c640 1 -- 10.20.193.48:0/3800325372 shutdown_connections 2026-02-12T18:06:16.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.260+0000 7f635a70c640 1 -- 10.20.193.48:0/3800325372 >> 10.20.193.48:0/3800325372 conn(0x7f63540548a0 msgr2=0x7f6354122e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:16.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.260+0000 7f635a70c640 1 -- 10.20.193.48:0/3800325372 shutdown_connections 2026-02-12T18:06:16.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.260+0000 7f635a70c640 1 -- 10.20.193.48:0/3800325372 wait complete. 2026-02-12T18:06:16.289 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:06:16.289 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2026-02-12T18:06:16.289 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2026-02-12T18:06:16.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.354+0000 7fe82b61b640 10 monclient: get_monmap_and_config 2026-02-12T18:06:16.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.354+0000 7fe82b61b640 10 monclient: build_initial_monmap 2026-02-12T18:06:16.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.354+0000 7fe82b61b640 10 monclient: monmap: 2026-02-12T18:06:16.355 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:16.355 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.355 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:16.355631+0000 2026-02-12T18:06:16.355 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:16.355631+0000 2026-02-12T18:06:16.355 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:16.355 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.355 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:16.355 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:16.356 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:16.356 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:16.356 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:16.356 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:16.356 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:16.356 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:16.356 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:16.356 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:16.356 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:16.356 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.354+0000 7fe82b61b640 1 Processor -- start 2026-02-12T18:06:16.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe82b61b640 1 -- start start 2026-02-12T18:06:16.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe82b61b640 10 monclient: init 2026-02-12T18:06:16.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe82b61b640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:16.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe82b61b640 10 monclient: _add_conns ranks=[7,0,2,3,6,10,8,1,4,5,9] 2026-02-12T18:06:16.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe82b61b640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe82405c950 0x7fe82405cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe82b61b640 10 monclient(hunting): picked mon.noname-i con 0x7fe82405c950 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:16.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe82b61b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe82405e490 addr v1:10.20.193.48:6789/0 2026-02-12T18:06:16.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe82b61b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe82405d260 0x7fe82413e280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe82b61b640 10 monclient(hunting): picked mon.noname-b con 0x7fe82405d260 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:16.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe82b61b640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe82404dc20 con 0x7fe82405e490 2026-02-12T18:06:16.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe82b61b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe82b61b640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fe82405ddd0 con 0x7fe82405d260 2026-02-12T18:06:16.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe82b61b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe82b61b640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fe824092990 con 0x7fe82405c950 2026-02-12T18:06:16.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe82b61b640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:16.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe82b61b640 10 monclient(hunting): authenticate will time out at 615.081363s 2026-02-12T18:06:16.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe829b91640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe82405d260 0x7fe82413e280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe828b8f640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7fe82405e490 0x7fe82413db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:34436/0 (socket says 10.20.193.48:34436) 2026-02-12T18:06:16.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe828b8f640 1 -- 10.20.193.48:0/3059511689 learned_addr learned my addr 10.20.193.48:0/3059511689 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:06:16.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe829b91640 10 monclient(hunting): get_auth_request con 0x7fe82405d260 auth_method 0 2026-02-12T18:06:16.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe829b91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe829b91640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe829b91640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe829b91640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe829b91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe829b91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe829b91640 10 monclient(hunting): handle_auth_done global_id 34337 payload 274 2026-02-12T18:06:16.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe829b91640 1 -- 10.20.193.48:0/3059511689 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe82405c950 msgr2=0x7fe82405cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:16.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe829b91640 1 --2- 10.20.193.48:0/3059511689 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe82405c950 0x7fe82405cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe829b91640 1 -- 10.20.193.48:0/3059511689 >> v1:10.20.193.48:6789/0 conn(0x7fe82405e490 legacy=0x7fe82413db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:16.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe829b91640 10 monclient: _finish_hunting 0 2026-02-12T18:06:16.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe829b91640 1 monclient: found mon.noname-b 2026-02-12T18:06:16.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe829b91640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:16.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe829b91640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:06:16.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.355+0000 7fe829b91640 1 -- 10.20.193.48:0/3059511689 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe824092c70 con 0x7fe82405d260 2026-02-12T18:06:16.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe829b91640 1 -- 10.20.193.48:0/3059511689 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe82405d260 msgr2=0x7fe82413e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe829b91640 1 --2- 10.20.193.48:0/3059511689 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe82405d260 0x7fe82413e280 secure :-1 s=READY pgs=38 gs=2 cs=0 l=1 c_cookie=2338943755484378912 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe82000a8e0 tx=0x7fe82002fe20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=207598f40f43b720 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe813fff640 1 -- 10.20.193.48:0/3059511689 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe820030b80 con 0x7fe82405d260 2026-02-12T18:06:16.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe813fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe813fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:06:16.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe813fff640 10 monclient: dump: 2026-02-12T18:06:16.364 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.364 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.365 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.365 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.365 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.365 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.365 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.365 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.365 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.365 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.365 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.365 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.365 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.365 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.365 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.365 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe813fff640 10 monclient: _finish_auth 0 2026-02-12T18:06:16.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe813fff640 10 monclient: _check_auth_tickets 2026-02-12T18:06:16.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe813fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:16.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe813fff640 1 -- 10.20.193.48:0/3059511689 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe820030d00 con 0x7fe82405d260 2026-02-12T18:06:16.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe82b61b640 5 monclient: authenticate success, global_id 34337 2026-02-12T18:06:16.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe82b61b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:16.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe813fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:16.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe813fff640 1 -- 10.20.193.48:0/3059511689 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe820030e70 con 0x7fe82405d260 2026-02-12T18:06:16.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe813fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe813fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:06:16.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe813fff640 10 monclient: dump: 2026-02-12T18:06:16.366 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.366 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.366 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.366 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.366 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.366 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.366 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.366 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.366 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.366 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.366 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.367 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.367 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.367 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.367 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.367 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe82b61b640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:16.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe82b61b640 4 set_mon_vals no callback set 2026-02-12T18:06:16.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe82b61b640 10 monclient: shutdown 2026-02-12T18:06:16.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe82b61b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:16.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe82b61b640 1 -- 10.20.193.48:0/3059511689 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe82405d260 msgr2=0x7fe82413e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe82b61b640 1 --2- 10.20.193.48:0/3059511689 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe82405d260 0x7fe82413e280 secure :-1 s=READY pgs=38 gs=2 cs=0 l=1 c_cookie=2338943755484378912 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe82000a8e0 tx=0x7fe82002fe20 comp rx=0 tx=0).stop 2026-02-12T18:06:16.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe82b61b640 1 -- 10.20.193.48:0/3059511689 shutdown_connections 2026-02-12T18:06:16.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe82b61b640 1 --2- 10.20.193.48:0/3059511689 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe82405d260 0x7fe82413e280 unknown :-1 s=CLOSED pgs=38 gs=2 cs=0 l=1 c_cookie=2338943755484378912 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe82b61b640 1 --2- 10.20.193.48:0/3059511689 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe82405c950 0x7fe82405cd20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe82b61b640 1 -- 10.20.193.48:0/3059511689 >> 10.20.193.48:0/3059511689 conn(0x7fe8240548a0 msgr2=0x7fe824097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:16.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe82b61b640 1 -- 10.20.193.48:0/3059511689 shutdown_connections 2026-02-12T18:06:16.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.358+0000 7fe82b61b640 1 -- 10.20.193.48:0/3059511689 wait complete. 2026-02-12T18:06:16.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe82b61b640 10 monclient: build_initial_monmap 2026-02-12T18:06:16.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe82b61b640 10 monclient: monmap: 2026-02-12T18:06:16.368 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:16.368 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:16.368 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:16.368 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:16.368 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:16.368 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.368 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:16.368 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:16.368 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:16.368 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:16.368 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:16.368 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:16.368 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:16.368 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:16.368 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:16.368 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe82b61b640 1 Processor -- start 2026-02-12T18:06:16.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe82b61b640 1 -- start start 2026-02-12T18:06:16.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe82b61b640 10 monclient: init 2026-02-12T18:06:16.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe82b61b640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:16.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe82b61b640 10 monclient: _add_conns ranks=[0,3,1,2,8,4,6,5,7] 2026-02-12T18:06:16.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe82b61b640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fe82405c950 0x7fe82408ffd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe82b61b640 10 monclient(hunting): picked mon.noname-a con 0x7fe82405c950 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:06:16.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe82b61b640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe82405d260 0x7fe824090510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe82b61b640 10 monclient(hunting): picked mon.noname-g con 0x7fe82405d260 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:16.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe82b61b640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe82405e490 0x7fe824090a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe82b61b640 10 monclient(hunting): picked mon.noname-f con 0x7fe82405e490 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:06:16.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe82b61b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe82b61b640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fe82408aa20 con 0x7fe82405c950 2026-02-12T18:06:16.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe82b61b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe82b61b640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe82408bf40 con 0x7fe82405e490 2026-02-12T18:06:16.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe82b61b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe82b61b640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe824143100 con 0x7fe82405d260 2026-02-12T18:06:16.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe82b61b640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:16.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe82b61b640 10 monclient(hunting): authenticate will time out at 615.085699s 2026-02-12T18:06:16.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe829390640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fe82405c950 0x7fe82408ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe829390640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fe82405c950 0x7fe82408ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:57152/0 (socket says 10.20.193.48:57152) 2026-02-12T18:06:16.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe829390640 1 -- 10.20.193.48:0/1394574133 learned_addr learned my addr 10.20.193.48:0/1394574133 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:16.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe829390640 10 monclient(hunting): get_auth_request con 0x7fe82405c950 auth_method 0 2026-02-12T18:06:16.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe829390640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe829390640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe829390640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe829390640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe829390640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe829b91640 1 --2- 10.20.193.48:0/1394574133 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe82405e490 0x7fe824090a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe829390640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe829b91640 10 monclient(hunting): get_auth_request con 0x7fe82405e490 auth_method 0 2026-02-12T18:06:16.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe829b91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe829b91640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.359+0000 7fe829b91640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.360+0000 7fe828b8f640 1 --2- 10.20.193.48:0/1394574133 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe82405d260 0x7fe824090510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.360+0000 7fe828b8f640 10 monclient(hunting): get_auth_request con 0x7fe82405d260 auth_method 0 2026-02-12T18:06:16.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.360+0000 7fe828b8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.360+0000 7fe828b8f640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.360+0000 7fe828b8f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.360+0000 7fe829b91640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.360+0000 7fe829b91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.360+0000 7fe829b91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.360+0000 7fe829390640 10 monclient(hunting): handle_auth_done global_id 4527 payload 824 2026-02-12T18:06:16.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.360+0000 7fe829390640 1 -- 10.20.193.48:0/1394574133 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe82405d260 msgr2=0x7fe824090510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.360+0000 7fe829390640 1 --2- 10.20.193.48:0/1394574133 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe82405d260 0x7fe824090510 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.360+0000 7fe829390640 1 -- 10.20.193.48:0/1394574133 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe82405e490 msgr2=0x7fe824090a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.360+0000 7fe829390640 1 --2- 10.20.193.48:0/1394574133 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe82405e490 0x7fe824090a50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.360+0000 7fe829390640 10 monclient: _finish_hunting 0 2026-02-12T18:06:16.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.360+0000 7fe829390640 1 monclient: found mon.noname-a 2026-02-12T18:06:16.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.360+0000 7fe829390640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:16.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.360+0000 7fe829390640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:06:16.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.360+0000 7fe829390640 1 -- 10.20.193.48:0/1394574133 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82000a500 con 0x7fe82405c950 2026-02-12T18:06:16.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.362+0000 7fe829390640 1 -- 10.20.193.48:0/1394574133 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fe82405c950 msgr2=0x7fe82408ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.362+0000 7fe829390640 1 --2- 10.20.193.48:0/1394574133 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fe82405c950 0x7fe82408ffd0 secure :-1 s=READY pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe81400b500 tx=0x7fe81400b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.362+0000 7fe811ffb640 1 -- 10.20.193.48:0/1394574133 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe814004490 con 0x7fe82405c950 2026-02-12T18:06:16.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.362+0000 7fe811ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.362+0000 7fe811ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:06:16.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.362+0000 7fe811ffb640 10 monclient: dump: 2026-02-12T18:06:16.372 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.372 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.372 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.372 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.372 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.372 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.372 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.372 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.372 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.372 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.372 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.372 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.372 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.372 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.372 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.372 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.362+0000 7fe811ffb640 10 monclient: _finish_auth 0 2026-02-12T18:06:16.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.362+0000 7fe811ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:06:16.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.362+0000 7fe811ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:16.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.362+0000 7fe811ffb640 1 -- 10.20.193.48:0/1394574133 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe814002b60 con 0x7fe82405c950 2026-02-12T18:06:16.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.362+0000 7fe811ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:16.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.362+0000 7fe811ffb640 1 -- 10.20.193.48:0/1394574133 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe814002cd0 con 0x7fe82405c950 2026-02-12T18:06:16.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.362+0000 7fe811ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.362+0000 7fe8137fe640 4 set_mon_vals no callback set 2026-02-12T18:06:16.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.362+0000 7fe811ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:16.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.362+0000 7fe811ffb640 10 monclient: dump: 2026-02-12T18:06:16.373 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.373 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.373 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.373 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.373 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.373 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.373 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.373 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.373 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.373 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.374 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.374 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.374 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.374 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.374 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.374 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.362+0000 7fe82b61b640 5 monclient: authenticate success, global_id 4527 2026-02-12T18:06:16.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.362+0000 7fe82b61b640 10 monclient: _renew_subs 2026-02-12T18:06:16.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.362+0000 7fe82b61b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:16.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.362+0000 7fe82b61b640 1 -- 10.20.193.48:0/1394574133 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe824142bf0 con 0x7fe82405c950 2026-02-12T18:06:16.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.362+0000 7fe82b61b640 10 monclient: _renew_subs 2026-02-12T18:06:16.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.362+0000 7fe82b61b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:16.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.362+0000 7fe82b61b640 1 -- 10.20.193.48:0/1394574133 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe82408bc60 con 0x7fe82405c950 2026-02-12T18:06:16.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.363+0000 7fe82b61b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:16.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.363+0000 7fe82b61b640 1 --2- 10.20.193.48:0/1394574133 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe82413ed30 0x7fe82413f100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.363+0000 7fe82b61b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.363+0000 7fe82b61b640 1 -- 10.20.193.48:0/1394574133 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fe82405f140 con 0x7fe82413ed30 2026-02-12T18:06:16.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.363+0000 7fe828b8f640 1 --2- 10.20.193.48:0/1394574133 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe82413ed30 0x7fe82413f100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.363+0000 7fe811ffb640 1 -- 10.20.193.48:0/1394574133 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fe8140026a0 con 0x7fe82405c950 2026-02-12T18:06:16.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.363+0000 7fe828b8f640 10 monclient: get_auth_request con 0x7fe82413ed30 auth_method 0 2026-02-12T18:06:16.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.363+0000 7fe828b8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.363+0000 7fe828b8f640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.363+0000 7fe828b8f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.363+0000 7fe828b8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.363+0000 7fe828b8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.363+0000 7fe828b8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.363+0000 7fe811ffb640 1 --2- 10.20.193.48:0/1394574133 >> v2:10.20.193.111:6812/977811348 conn(0x7fe7f403f800 0x7fe7f405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.363+0000 7fe811ffb640 1 -- 10.20.193.48:0/1394574133 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (secure 0 0 0) 0x7fe814052530 con 0x7fe82405c950 2026-02-12T18:06:16.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.363+0000 7fe828b8f640 10 monclient(hunting): handle_auth_done global_id 4416 payload 824 2026-02-12T18:06:16.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.363+0000 7fe828b8f640 1 -- 10.20.193.48:0/1394574133 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe824097de0 con 0x7fe82413ed30 2026-02-12T18:06:16.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.363+0000 7fe829b91640 1 --2- 10.20.193.48:0/1394574133 >> v2:10.20.193.111:6812/977811348 conn(0x7fe7f403f800 0x7fe7f405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.363+0000 7fe829b91640 10 monclient: get_auth_request con 0x7fe7f403f800 auth_method 0 2026-02-12T18:06:16.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.365+0000 7fe828b8f640 1 -- 10.20.193.48:0/1394574133 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe82413ed30 msgr2=0x7fe82413f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.365+0000 7fe828b8f640 1 --2- 10.20.193.48:0/1394574133 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe82413ed30 0x7fe82413f100 secure :-1 s=READY pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe818004930 tx=0x7fe81800e970 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.365+0000 7fe811ffb640 1 -- 10.20.193.48:0/1394574133 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe818006590 con 0x7fe82413ed30 2026-02-12T18:06:16.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.365+0000 7fe811ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.365+0000 7fe811ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:06:16.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.365+0000 7fe811ffb640 10 monclient: dump: 2026-02-12T18:06:16.378 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.378 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.378 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.378 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.378 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.378 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.378 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.378 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.378 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.378 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.378 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.378 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.378 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.378 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.378 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.378 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.379 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.366+0000 7fe811ffb640 1 -- 10.20.193.48:0/1394574133 <== mon.6 v2:10.20.193.48:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fe8180066f0 con 0x7fe82413ed30 2026-02-12T18:06:16.379 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.366+0000 7fe811ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:16.379 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.366+0000 7fe811ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:16.379 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.366+0000 7fe811ffb640 1 -- 10.20.193.48:0/1394574133 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe82413ed30 msgr2=0x7fe82413f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.379 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.366+0000 7fe811ffb640 1 --2- 10.20.193.48:0/1394574133 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe82413ed30 0x7fe82413f100 secure :-1 s=READY pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe818004930 tx=0x7fe81800e970 comp rx=0 tx=0).stop 2026-02-12T18:06:16.379 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.366+0000 7fe811ffb640 1 -- 10.20.193.48:0/1394574133 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe82413ed30 msgr2=0x7fe82413f100 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:16.379 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.366+0000 7fe811ffb640 1 --2- 10.20.193.48:0/1394574133 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe82413ed30 0x7fe82413f100 secure :-1 s=CLOSED pgs=52 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe818004930 tx=0x7fe81800e970 comp rx=0 tx=0).stop 2026-02-12T18:06:16.379 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.366+0000 7fe829b91640 1 --2- 10.20.193.48:0/1394574133 >> v2:10.20.193.111:6812/977811348 conn(0x7fe7f403f800 0x7fe7f405fcb0 secure :-1 s=READY pgs=72 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe82002fe60 tx=0x7fe820034000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.379 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.369+0000 7fe82b61b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:06:16.379 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.369+0000 7fe82b61b640 1 --2- 10.20.193.48:0/1394574133 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe8241236d0 0x7fe824123aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.379 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.369+0000 7fe82b61b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.379 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.369+0000 7fe82b61b640 1 -- 10.20.193.48:0/1394574133 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fe82405fd90 con 0x7fe8241236d0 2026-02-12T18:06:16.379 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.369+0000 7fe828b8f640 1 --2- 10.20.193.48:0/1394574133 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe8241236d0 0x7fe824123aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.379 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.369+0000 7fe828b8f640 10 monclient: get_auth_request con 0x7fe8241236d0 auth_method 0 2026-02-12T18:06:16.379 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.369+0000 7fe828b8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.379 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.369+0000 7fe828b8f640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.379 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.369+0000 7fe828b8f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.369+0000 7fe828b8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.369+0000 7fe828b8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.369+0000 7fe828b8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.369+0000 7fe828b8f640 10 monclient(hunting): handle_auth_done global_id 4425 payload 824 2026-02-12T18:06:16.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.369+0000 7fe828b8f640 1 -- 10.20.193.48:0/1394574133 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe82413fe00 con 0x7fe8241236d0 2026-02-12T18:06:16.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.371+0000 7fe828b8f640 1 -- 10.20.193.48:0/1394574133 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe8241236d0 msgr2=0x7fe824123aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.371+0000 7fe828b8f640 1 --2- 10.20.193.48:0/1394574133 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe8241236d0 0x7fe824123aa0 secure :-1 s=READY pgs=53 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe81800e9b0 tx=0x7fe818004a00 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.371+0000 7fe811ffb640 1 -- 10.20.193.48:0/1394574133 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe818022070 con 0x7fe8241236d0 2026-02-12T18:06:16.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.371+0000 7fe811ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.371+0000 7fe811ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:06:16.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.371+0000 7fe811ffb640 10 monclient: dump: 2026-02-12T18:06:16.380 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.380 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.380 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.380 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.380 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.380 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.380 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.380 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.381 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.381 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.381 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.381 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.381 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.381 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.381 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.381 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.372+0000 7fe811ffb640 1 -- 10.20.193.48:0/1394574133 <== mon.6 v2:10.20.193.48:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10182 (secure 0 0 0) 0x7fe818013420 con 0x7fe8241236d0 2026-02-12T18:06:16.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.372+0000 7fe811ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:06:16.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.372+0000 7fe811ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:16.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.372+0000 7fe811ffb640 1 -- 10.20.193.48:0/1394574133 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe8241236d0 msgr2=0x7fe824123aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.372+0000 7fe811ffb640 1 --2- 10.20.193.48:0/1394574133 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe8241236d0 0x7fe824123aa0 secure :-1 s=READY pgs=53 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe81800e9b0 tx=0x7fe818004a00 comp rx=0 tx=0).stop 2026-02-12T18:06:16.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.372+0000 7fe811ffb640 1 -- 10.20.193.48:0/1394574133 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe8241236d0 msgr2=0x7fe824123aa0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:16.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.372+0000 7fe811ffb640 1 --2- 10.20.193.48:0/1394574133 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe8241236d0 0x7fe824123aa0 secure :-1 s=CLOSED pgs=53 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe81800e9b0 tx=0x7fe818004a00 comp rx=0 tx=0).stop 2026-02-12T18:06:16.382 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:06:16.382 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:06:16.382 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:06:16.382 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:06:16.382 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 12, 2026-02-12T18:06:16.382 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 31198, 2026-02-12T18:06:16.382 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:06:16.382 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:06:16.382 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:06:16.382 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:06:16.382 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:06:16.382 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:06:16.382 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:06:16.382 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:06:16.382 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:06:16.382 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:06:16.383 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.383 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 19, 2026-02-12T18:06:16.383 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:16.383 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:06:16.383 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:06:16.383 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.383 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.383 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.383 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.383 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.383 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.383 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.383 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.383 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.383 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.383 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.383 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.383 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.384 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.384 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:06:16.384 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:06:16.384 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.384 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.384 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.384 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.384 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.384 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.384 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.384 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.384 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.384 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.384 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.384 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.384 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.384 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.384 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.385 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:06:16.385 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:06:16.385 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:06:16.385 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:06:16.385 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:06:16.385 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:06:16.385 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:16.385 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:16.385 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:06:16.385 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:06:16.385 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:06:16.385 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:06:16.385 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:06:16.385 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:06:16.385 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:06:16.385 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:16.385 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:06:16.385 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.385 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.386 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.386 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.386 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.386 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.386 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.386 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.386 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.386 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.386 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.386 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.386 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.386 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.386 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:06:16.386 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.386 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:06:16.386 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.386 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:06:16.386 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:06:16.386 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.386 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.386 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.387 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.387 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:06:16.387 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.387 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.387 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.387 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.387 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:06:16.387 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.387 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.387 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.387 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.387 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:06:16.387 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:06:16.387 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.387 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.387 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:06:16.387 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.387 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.387 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.387 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:06:16.388 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:06:16.388 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.388 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.388 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.388 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.388 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:06:16.388 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.388 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.388 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.388 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.388 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:06:16.388 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.388 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.388 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.388 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.388 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:06:16.388 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:06:16.388 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.388 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.388 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:06:16.388 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.389 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.389 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.389 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:06:16.389 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:06:16.389 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.389 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.389 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.389 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.389 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:06:16.389 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.389 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.389 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.389 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.389 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:06:16.389 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.389 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.389 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.389 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.389 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:06:16.389 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:06:16.389 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.389 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.390 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:06:16.390 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.390 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.390 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.390 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:06:16.390 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:06:16.390 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.390 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.390 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.390 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.390 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:06:16.390 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.390 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.390 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.390 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.390 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:06:16.390 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.390 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.390 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.390 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.390 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:06:16.390 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:06:16.391 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.391 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.391 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:06:16.391 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.391 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.391 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.391 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:06:16.391 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:06:16.391 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.391 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.391 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.391 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.391 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:06:16.391 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.391 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.391 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.391 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.391 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:06:16.391 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.391 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.391 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.392 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.392 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:06:16.392 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:06:16.392 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.392 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.392 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:16.392 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.392 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.392 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.392 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:06:16.392 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:06:16.392 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.392 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.392 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.392 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.392 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:06:16.392 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.392 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.392 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.392 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.392 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:06:16.392 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.392 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.392 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.393 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.393 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:06:16.393 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:06:16.393 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.393 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.393 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:06:16.393 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.393 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.393 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.393 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:06:16.393 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:06:16.393 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.393 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.393 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.393 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.393 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:06:16.393 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.393 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.393 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.393 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.393 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:06:16.393 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.393 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.393 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.394 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.394 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:06:16.394 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:06:16.394 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.394 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.394 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:16.394 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.394 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.394 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.394 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:06:16.394 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:06:16.394 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.394 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.394 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.394 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.394 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:06:16.394 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.394 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.394 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.394 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.394 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:06:16.394 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.394 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.395 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.395 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.395 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:06:16.395 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:06:16.395 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.395 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.395 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:06:16.395 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.395 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.395 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.395 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:06:16.395 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:06:16.395 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.395 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.395 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.395 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.395 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:06:16.395 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.395 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.395 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.395 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.395 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:06:16.395 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.395 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.395 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.396 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.396 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:06:16.396 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:06:16.396 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.396 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.396 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:06:16.396 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.396 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.396 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.396 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.396 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:06:16.396 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:06:16.396 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.396 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:16.396 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:16.396 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:16.396 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.396 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.396 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:06:16.396 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.396 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:16.396 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:16.396 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:16.396 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.396 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.397 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:06:16.397 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.397 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:16.397 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:16.397 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:06:16.397 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.397 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.397 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.397 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:06:16.397 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:06:16.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.372+0000 7fe82b61b640 1 -- 10.20.193.48:0/1394574133 >> v2:10.20.193.111:6812/977811348 conn(0x7fe7f403f800 msgr2=0x7fe7f405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.372+0000 7fe82b61b640 1 --2- 10.20.193.48:0/1394574133 >> v2:10.20.193.111:6812/977811348 conn(0x7fe7f403f800 0x7fe7f405fcb0 secure :-1 s=READY pgs=72 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe82002fe60 tx=0x7fe820034000 comp rx=0 tx=0).stop 2026-02-12T18:06:16.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.372+0000 7fe82b61b640 10 monclient: shutdown 2026-02-12T18:06:16.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.372+0000 7fe82b61b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:16.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.372+0000 7fe82b61b640 1 -- 10.20.193.48:0/1394574133 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fe82405c950 msgr2=0x7fe82408ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.372+0000 7fe82b61b640 1 --2- 10.20.193.48:0/1394574133 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fe82405c950 0x7fe82408ffd0 secure :-1 s=READY pgs=90 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe81400b500 tx=0x7fe81400b9d0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.372+0000 7fe829b91640 1 -- 10.20.193.48:0/1394574133 reap_dead start 2026-02-12T18:06:16.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.372+0000 7fe829b91640 1 -- 10.20.193.48:0/1394574133 reap_dead start 2026-02-12T18:06:16.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.372+0000 7fe82b61b640 1 -- 10.20.193.48:0/1394574133 shutdown_connections 2026-02-12T18:06:16.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.372+0000 7fe82b61b640 1 -- 10.20.193.48:0/1394574133 >> 10.20.193.48:0/1394574133 conn(0x7fe8240548a0 msgr2=0x7fe824122fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:16.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.372+0000 7fe82b61b640 1 -- 10.20.193.48:0/1394574133 shutdown_connections 2026-02-12T18:06:16.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.372+0000 7fe82b61b640 1 -- 10.20.193.48:0/1394574133 wait complete. 2026-02-12T18:06:16.398 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:06:16.399 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2026-02-12T18:06:16.399 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2026-02-12T18:06:16.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.462+0000 7f4fcbf0c640 10 monclient: get_monmap_and_config 2026-02-12T18:06:16.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.462+0000 7f4fcbf0c640 10 monclient: build_initial_monmap 2026-02-12T18:06:16.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.462+0000 7f4fcbf0c640 10 monclient: monmap: 2026-02-12T18:06:16.463 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:16.463 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.463 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:16.463968+0000 2026-02-12T18:06:16.463 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:16.463968+0000 2026-02-12T18:06:16.463 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:16.463 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.463 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:16.463 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:16.463 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:16.464 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:16.464 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:16.464 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:16.464 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:16.464 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:16.464 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:16.464 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:16.464 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:16.464 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fcbf0c640 1 Processor -- start 2026-02-12T18:06:16.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fcbf0c640 1 -- start start 2026-02-12T18:06:16.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fcbf0c640 10 monclient: init 2026-02-12T18:06:16.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fcbf0c640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:16.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fcbf0c640 10 monclient: _add_conns ranks=[0,7,10,6,2,5,9,8,1,3,4] 2026-02-12T18:06:16.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fcbf0c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4fc405c950 addr v1:10.20.193.48:6789/0 2026-02-12T18:06:16.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fcbf0c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f4fc405e490 0x7f4fc41857b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fcbf0c640 10 monclient(hunting): picked mon.noname-i con 0x7f4fc405e490 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:16.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fcbf0c640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f4fc405d430 0x7f4fc41a5d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fcbf0c640 10 monclient(hunting): picked mon.noname-f con 0x7f4fc405d430 addr v2:10.20.193.111:3300/0 2026-02-12T18:06:16.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fcbf0c640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fc404dc20 con 0x7f4fc405c950 2026-02-12T18:06:16.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fcbf0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fcbf0c640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f4fc405ddd0 con 0x7f4fc405d430 2026-02-12T18:06:16.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fcbf0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fcbf0c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f4fc4092990 con 0x7f4fc405e490 2026-02-12T18:06:16.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fcbf0c640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:16.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fcbf0c640 10 monclient(hunting): authenticate will time out at 615.189684s 2026-02-12T18:06:16.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fc9c81640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f4fc405c950 0x7f4fc405cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:34438/0 (socket says 10.20.193.48:34438) 2026-02-12T18:06:16.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fc9c81640 1 -- 10.20.193.48:0/2701216454 learned_addr learned my addr 10.20.193.48:0/2701216454 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:06:16.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fc9480640 1 --2- 10.20.193.48:0/2701216454 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f4fc405e490 0x7f4fc41857b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fca482640 1 --2- 10.20.193.48:0/2701216454 >> v2:10.20.193.111:3300/0 conn(0x7f4fc405d430 0x7f4fc41a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fca482640 10 monclient(hunting): get_auth_request con 0x7f4fc405d430 auth_method 0 2026-02-12T18:06:16.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fca482640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fca482640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fca482640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fc9480640 10 monclient(hunting): get_auth_request con 0x7f4fc405e490 auth_method 0 2026-02-12T18:06:16.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fc9480640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fc9480640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.463+0000 7f4fc9480640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.464+0000 7f4fca482640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.464+0000 7f4fca482640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.464+0000 7f4fca482640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.464+0000 7f4fc9480640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.464+0000 7f4fc9480640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.464+0000 7f4fc9480640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.464+0000 7f4fca482640 10 monclient(hunting): handle_auth_done global_id 4402 payload 274 2026-02-12T18:06:16.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.464+0000 7f4fca482640 1 -- 10.20.193.48:0/2701216454 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f4fc405e490 msgr2=0x7f4fc41857b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:16.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.464+0000 7f4fca482640 1 --2- 10.20.193.48:0/2701216454 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f4fc405e490 0x7f4fc41857b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.464+0000 7f4fca482640 1 -- 10.20.193.48:0/2701216454 >> v1:10.20.193.48:6789/0 conn(0x7f4fc405c950 legacy=0x7f4fc405cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:16.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.464+0000 7f4fca482640 10 monclient: _finish_hunting 0 2026-02-12T18:06:16.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.464+0000 7f4fca482640 1 monclient: found mon.noname-f 2026-02-12T18:06:16.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.464+0000 7f4fca482640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:16.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.464+0000 7f4fca482640 10 monclient: _send_mon_message to mon.noname-f at v2:10.20.193.111:3300/0 2026-02-12T18:06:16.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.464+0000 7f4fca482640 1 -- 10.20.193.48:0/2701216454 --> v2:10.20.193.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc4092c70 con 0x7f4fc405d430 2026-02-12T18:06:16.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.466+0000 7f4fca482640 1 -- 10.20.193.48:0/2701216454 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f4fc405d430 msgr2=0x7f4fc41a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.466+0000 7f4fca482640 1 --2- 10.20.193.48:0/2701216454 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f4fc405d430 0x7f4fc41a5d00 secure :-1 s=READY pgs=48 gs=2 cs=0 l=1 c_cookie=14974201876128959128 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fc0005820 tx=0x7f4fc002fdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfcf0d4505a78a98 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.466+0000 7f4fc8c7f640 1 -- 10.20.193.48:0/2701216454 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4fc0036340 con 0x7f4fc405d430 2026-02-12T18:06:16.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fc8c7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fc8c7f640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2026-02-12T18:06:16.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fc8c7f640 10 monclient: dump: 2026-02-12T18:06:16.471 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.471 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.471 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.471 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.471 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.471 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.471 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.471 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.471 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.471 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.471 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.471 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.471 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.471 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.471 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.471 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fc8c7f640 10 monclient: _finish_auth 0 2026-02-12T18:06:16.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fc8c7f640 10 monclient: _check_auth_tickets 2026-02-12T18:06:16.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fc8c7f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:16.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fc8c7f640 1 -- 10.20.193.48:0/2701216454 <== mon.1 v2:10.20.193.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc00364c0 con 0x7f4fc405d430 2026-02-12T18:06:16.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fcbf0c640 5 monclient: authenticate success, global_id 4402 2026-02-12T18:06:16.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fcbf0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:16.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fc8c7f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:16.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fc8c7f640 1 -- 10.20.193.48:0/2701216454 <== mon.1 v2:10.20.193.111:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4fc0036af0 con 0x7f4fc405d430 2026-02-12T18:06:16.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fc8c7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fc8c7f640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:06:16.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fc8c7f640 10 monclient: dump: 2026-02-12T18:06:16.472 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.472 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.472 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.472 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.472 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.472 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.472 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.472 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.472 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.472 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.473 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.473 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.473 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.473 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.473 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.473 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fcbf0c640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:16.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fcbf0c640 4 set_mon_vals no callback set 2026-02-12T18:06:16.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fcbf0c640 10 monclient: shutdown 2026-02-12T18:06:16.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fcbf0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:16.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fcbf0c640 1 -- 10.20.193.48:0/2701216454 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f4fc405d430 msgr2=0x7f4fc41a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fcbf0c640 1 --2- 10.20.193.48:0/2701216454 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f4fc405d430 0x7f4fc41a5d00 secure :-1 s=READY pgs=48 gs=2 cs=0 l=1 c_cookie=14974201876128959128 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fc0005820 tx=0x7f4fc002fdf0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fcbf0c640 1 -- 10.20.193.48:0/2701216454 shutdown_connections 2026-02-12T18:06:16.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fcbf0c640 1 --2- 10.20.193.48:0/2701216454 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f4fc405d430 0x7f4fc41a5d00 unknown :-1 s=CLOSED pgs=48 gs=2 cs=0 l=1 c_cookie=14974201876128959128 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fcbf0c640 1 --2- 10.20.193.48:0/2701216454 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f4fc405e490 0x7f4fc41857b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fcbf0c640 1 -- 10.20.193.48:0/2701216454 >> 10.20.193.48:0/2701216454 conn(0x7f4fc40548a0 msgr2=0x7f4fc4097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:16.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fcbf0c640 1 -- 10.20.193.48:0/2701216454 shutdown_connections 2026-02-12T18:06:16.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fcbf0c640 1 -- 10.20.193.48:0/2701216454 wait complete. 2026-02-12T18:06:16.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fcbf0c640 10 monclient: build_initial_monmap 2026-02-12T18:06:16.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.467+0000 7f4fcbf0c640 10 monclient: monmap: 2026-02-12T18:06:16.474 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:16.474 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:16.474 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:16.474 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:16.474 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:16.474 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.474 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:16.474 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:16.474 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:16.474 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:16.474 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:16.474 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:16.474 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:16.474 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:16.474 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:16.474 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fcbf0c640 1 Processor -- start 2026-02-12T18:06:16.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fcbf0c640 1 -- start start 2026-02-12T18:06:16.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fcbf0c640 10 monclient: init 2026-02-12T18:06:16.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fcbf0c640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:16.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fcbf0c640 10 monclient: _add_conns ranks=[8,1,4,7,5,3,0,2,6] 2026-02-12T18:06:16.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fcbf0c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4fc405c950 0x7f4fc412d950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fcbf0c640 10 monclient(hunting): picked mon.noname-e con 0x7f4fc405c950 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:16.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fcbf0c640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f4fc405d430 0x7f4fc408d540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fcbf0c640 10 monclient(hunting): picked mon.noname-f con 0x7f4fc405d430 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:06:16.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fcbf0c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4fc405e490 0x7f4fc41a55b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fcbf0c640 10 monclient(hunting): picked mon.noname-c con 0x7f4fc405e490 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:06:16.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fcbf0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fcbf0c640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f4fc4141950 con 0x7f4fc405d430 2026-02-12T18:06:16.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fcbf0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fcbf0c640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f4fc408bae0 con 0x7f4fc405e490 2026-02-12T18:06:16.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fcbf0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fcbf0c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f4fc408c010 con 0x7f4fc405c950 2026-02-12T18:06:16.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fcbf0c640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:16.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fcbf0c640 10 monclient(hunting): authenticate will time out at 615.194512s 2026-02-12T18:06:16.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fc9c81640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4fc405c950 0x7f4fc412d950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fca482640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4fc405e490 0x7f4fc41a55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fca482640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4fc405e490 0x7f4fc41a55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:41312/0 (socket says 10.20.193.48:41312) 2026-02-12T18:06:16.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fca482640 1 -- 10.20.193.48:0/2095796475 learned_addr learned my addr 10.20.193.48:0/2095796475 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:16.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fca482640 10 monclient(hunting): get_auth_request con 0x7f4fc405e490 auth_method 0 2026-02-12T18:06:16.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fca482640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fca482640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fca482640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fc9c81640 10 monclient(hunting): get_auth_request con 0x7f4fc405c950 auth_method 0 2026-02-12T18:06:16.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fc9c81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fc9c81640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fc9c81640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fc9480640 1 --2- 10.20.193.48:0/2095796475 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f4fc405d430 0x7f4fc408d540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fca482640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fca482640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fca482640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fc9480640 10 monclient(hunting): get_auth_request con 0x7f4fc405d430 auth_method 0 2026-02-12T18:06:16.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fc9480640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fc9480640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fc9480640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fc9c81640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fc9c81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fc9c81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fca482640 10 monclient(hunting): handle_auth_done global_id 34339 payload 824 2026-02-12T18:06:16.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fca482640 1 -- 10.20.193.48:0/2095796475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4fc405c950 msgr2=0x7f4fc412d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fca482640 1 --2- 10.20.193.48:0/2095796475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4fc405c950 0x7f4fc412d950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fca482640 1 -- 10.20.193.48:0/2095796475 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f4fc405d430 msgr2=0x7f4fc408d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fca482640 1 --2- 10.20.193.48:0/2095796475 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f4fc405d430 0x7f4fc408d540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fca482640 10 monclient: _finish_hunting 0 2026-02-12T18:06:16.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fca482640 1 monclient: found mon.noname-c 2026-02-12T18:06:16.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fca482640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:16.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fca482640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:06:16.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.468+0000 7f4fca482640 1 -- 10.20.193.48:0/2095796475 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc000a500 con 0x7f4fc405e490 2026-02-12T18:06:16.479 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fca482640 1 -- 10.20.193.48:0/2095796475 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4fc405e490 msgr2=0x7f4fc41a55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.480 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fca482640 1 --2- 10.20.193.48:0/2095796475 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4fc405e490 0x7f4fc41a55b0 secure :-1 s=READY pgs=51 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fc000a830 tx=0x7f4fc0005850 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.480 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fb27fc640 1 -- 10.20.193.48:0/2095796475 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4fc0036a50 con 0x7f4fc405e490 2026-02-12T18:06:16.480 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fb27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.480 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fb27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:06:16.480 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fb27fc640 10 monclient: dump: 2026-02-12T18:06:16.480 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.480 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.480 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.480 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.480 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.480 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.480 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.480 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.480 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.480 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.480 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.480 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.480 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.481 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.481 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.481 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fb27fc640 10 monclient: _finish_auth 0 2026-02-12T18:06:16.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fb27fc640 10 monclient: _check_auth_tickets 2026-02-12T18:06:16.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fb27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:16.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fb27fc640 1 -- 10.20.193.48:0/2095796475 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fc0038900 con 0x7f4fc405e490 2026-02-12T18:06:16.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fcbf0c640 5 monclient: authenticate success, global_id 34339 2026-02-12T18:06:16.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fcbf0c640 10 monclient: _renew_subs 2026-02-12T18:06:16.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fcbf0c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:16.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fcbf0c640 1 -- 10.20.193.48:0/2095796475 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc408ac50 con 0x7f4fc405e490 2026-02-12T18:06:16.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fb27fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:16.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fb27fc640 1 -- 10.20.193.48:0/2095796475 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4fc0038440 con 0x7f4fc405e490 2026-02-12T18:06:16.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fb27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fb27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:06:16.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fb3fff640 4 set_mon_vals no callback set 2026-02-12T18:06:16.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fb27fc640 10 monclient: dump: 2026-02-12T18:06:16.481 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.481 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.481 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.481 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.482 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.482 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.482 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.482 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.482 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.482 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.482 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.482 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.482 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.482 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.482 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.482 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.482 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fcbf0c640 10 monclient: _renew_subs 2026-02-12T18:06:16.482 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fcbf0c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:16.482 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fcbf0c640 1 -- 10.20.193.48:0/2095796475 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fc408a990 con 0x7f4fc405e490 2026-02-12T18:06:16.482 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fcbf0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:16.482 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fcbf0c640 1 --2- 10.20.193.48:0/2095796475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4fc41a5af0 0x7f4fc413dd80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.482 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fcbf0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.482 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fcbf0c640 1 -- 10.20.193.48:0/2095796475 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f4fc4063180 con 0x7f4fc41a5af0 2026-02-12T18:06:16.482 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fc9c81640 1 --2- 10.20.193.48:0/2095796475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4fc41a5af0 0x7f4fc413dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fc9c81640 10 monclient: get_auth_request con 0x7f4fc41a5af0 auth_method 0 2026-02-12T18:06:16.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fc9c81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fc9c81640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fc9c81640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fb27fc640 1 -- 10.20.193.48:0/2095796475 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f4fc0047020 con 0x7f4fc405e490 2026-02-12T18:06:16.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fc9c81640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fc9c81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fc9c81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fc9c81640 10 monclient(hunting): handle_auth_done global_id 4463 payload 824 2026-02-12T18:06:16.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fc9c81640 1 -- 10.20.193.48:0/2095796475 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4fc408bc50 con 0x7f4fc41a5af0 2026-02-12T18:06:16.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fb27fc640 1 --2- 10.20.193.48:0/2095796475 >> v2:10.20.193.111:6812/977811348 conn(0x7f4f9403f7f0 0x7f4f9405fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.471+0000 7f4fb27fc640 1 -- 10.20.193.48:0/2095796475 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (secure 0 0 0) 0x7f4fc0078d70 con 0x7f4fc405e490 2026-02-12T18:06:16.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.472+0000 7f4fc9480640 1 --2- 10.20.193.48:0/2095796475 >> v2:10.20.193.111:6812/977811348 conn(0x7f4f9403f7f0 0x7f4f9405fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.472+0000 7f4fc9480640 10 monclient: get_auth_request con 0x7f4f9403f7f0 auth_method 0 2026-02-12T18:06:16.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.474+0000 7f4fc9c81640 1 -- 10.20.193.48:0/2095796475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4fc41a5af0 msgr2=0x7f4fc413dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.474+0000 7f4fc9c81640 1 --2- 10.20.193.48:0/2095796475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4fc41a5af0 0x7f4fc413dd80 secure :-1 s=READY pgs=41 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fb400cad0 tx=0x7f4fb4007860 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.474+0000 7f4fb27fc640 1 -- 10.20.193.48:0/2095796475 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4fb400eca0 con 0x7f4fc41a5af0 2026-02-12T18:06:16.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.474+0000 7f4fb27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.474+0000 7f4fb27fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:06:16.484 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.474+0000 7f4fb27fc640 10 monclient: dump: 2026-02-12T18:06:16.484 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.484 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.484 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.484 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.484 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.484 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.484 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.484 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.484 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.484 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.484 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.484 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.484 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.484 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.484 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.484 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.484 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.474+0000 7f4fb27fc640 1 -- 10.20.193.48:0/2095796475 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f4fb400ee00 con 0x7f4fc41a5af0 2026-02-12T18:06:16.484 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.474+0000 7f4fb27fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:16.484 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.474+0000 7f4fb27fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:16.484 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.474+0000 7f4fb27fc640 1 -- 10.20.193.48:0/2095796475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4fc41a5af0 msgr2=0x7f4fc413dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.474+0000 7f4fb27fc640 1 --2- 10.20.193.48:0/2095796475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4fc41a5af0 0x7f4fc413dd80 secure :-1 s=READY pgs=41 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fb400cad0 tx=0x7f4fb4007860 comp rx=0 tx=0).stop 2026-02-12T18:06:16.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.474+0000 7f4fb27fc640 1 -- 10.20.193.48:0/2095796475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4fc41a5af0 msgr2=0x7f4fc413dd80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:16.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.474+0000 7f4fb27fc640 1 --2- 10.20.193.48:0/2095796475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4fc41a5af0 0x7f4fc413dd80 secure :-1 s=CLOSED pgs=41 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fb400cad0 tx=0x7f4fb4007860 comp rx=0 tx=0).stop 2026-02-12T18:06:16.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.474+0000 7f4fc9480640 1 --2- 10.20.193.48:0/2095796475 >> v2:10.20.193.111:6812/977811348 conn(0x7f4f9403f7f0 0x7f4f9405fca0 secure :-1 s=READY pgs=73 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fc4091680 tx=0x7f4fb8008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.477+0000 7f4fcbf0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:06:16.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.477+0000 7f4fcbf0c640 1 --2- 10.20.193.48:0/2095796475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4fc41a5ec0 0x7f4fc413e2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.477+0000 7f4fcbf0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.477+0000 7f4fcbf0c640 1 -- 10.20.193.48:0/2095796475 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f4fc4050410 con 0x7f4fc41a5ec0 2026-02-12T18:06:16.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.477+0000 7f4fc9c81640 1 --2- 10.20.193.48:0/2095796475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4fc41a5ec0 0x7f4fc413e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.477+0000 7f4fc9c81640 10 monclient: get_auth_request con 0x7f4fc41a5ec0 auth_method 0 2026-02-12T18:06:16.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.477+0000 7f4fc9c81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.477+0000 7f4fc9c81640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.477+0000 7f4fc9c81640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.477+0000 7f4fc9c81640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.477+0000 7f4fc9c81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.477+0000 7f4fc9c81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.477+0000 7f4fc9c81640 10 monclient(hunting): handle_auth_done global_id 4472 payload 824 2026-02-12T18:06:16.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.477+0000 7f4fc9c81640 1 -- 10.20.193.48:0/2095796475 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4fc405cd20 con 0x7f4fc41a5ec0 2026-02-12T18:06:16.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.479+0000 7f4fc9c81640 1 -- 10.20.193.48:0/2095796475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4fc41a5ec0 msgr2=0x7f4fc413e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.479+0000 7f4fc9c81640 1 --2- 10.20.193.48:0/2095796475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4fc41a5ec0 0x7f4fc413e2c0 secure :-1 s=READY pgs=42 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fb4016040 tx=0x7f4fb4004a00 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.480+0000 7f4fb27fc640 1 -- 10.20.193.48:0/2095796475 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4fb40034f0 con 0x7f4fc41a5ec0 2026-02-12T18:06:16.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.480+0000 7f4fb27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.480+0000 7f4fb27fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:06:16.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.480+0000 7f4fb27fc640 10 monclient: dump: 2026-02-12T18:06:16.487 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.487 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.487 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.487 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.487 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.487 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.487 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.487 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.487 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.487 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.487 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.487 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.487 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.487 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.487 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.487 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.480+0000 7f4fb27fc640 1 -- 10.20.193.48:0/2095796475 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10015 (secure 0 0 0) 0x7f4fb4003030 con 0x7f4fc41a5ec0 2026-02-12T18:06:16.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.480+0000 7f4fb27fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:06:16.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.480+0000 7f4fb27fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:16.488 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.480+0000 7f4fb27fc640 1 -- 10.20.193.48:0/2095796475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4fc41a5ec0 msgr2=0x7f4fc413e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.488 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.480+0000 7f4fb27fc640 1 --2- 10.20.193.48:0/2095796475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4fc41a5ec0 0x7f4fc413e2c0 secure :-1 s=READY pgs=42 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fb4016040 tx=0x7f4fb4004a00 comp rx=0 tx=0).stop 2026-02-12T18:06:16.488 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.480+0000 7f4fb27fc640 1 -- 10.20.193.48:0/2095796475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4fc41a5ec0 msgr2=0x7f4fc413e2c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:16.488 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.480+0000 7f4fb27fc640 1 --2- 10.20.193.48:0/2095796475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4fc41a5ec0 0x7f4fc413e2c0 secure :-1 s=CLOSED pgs=42 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fb4016040 tx=0x7f4fb4004a00 comp rx=0 tx=0).stop 2026-02-12T18:06:16.488 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:06:16.488 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:06:16.488 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:06:16.488 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:06:16.488 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 12, 2026-02-12T18:06:16.488 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 31307, 2026-02-12T18:06:16.488 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:06:16.488 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:06:16.488 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:06:16.488 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:06:16.488 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:06:16.489 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:06:16.489 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:06:16.489 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:06:16.489 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:06:16.489 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:06:16.489 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.489 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 19, 2026-02-12T18:06:16.489 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:16.489 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:06:16.489 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:06:16.489 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.489 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.489 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.489 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.489 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.489 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.489 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.489 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.489 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.490 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.490 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.490 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.490 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.490 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.490 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:06:16.490 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:06:16.490 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.490 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.490 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.490 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.490 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.490 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.490 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.490 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.490 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.490 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.490 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.490 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.490 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.490 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.491 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.491 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:06:16.491 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:06:16.491 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:06:16.491 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:06:16.491 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:06:16.491 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:06:16.491 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:16.491 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:16.491 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:06:16.491 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:06:16.491 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:06:16.491 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:06:16.491 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:06:16.491 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:06:16.491 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:06:16.491 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:16.491 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:06:16.491 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.492 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.492 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.492 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.492 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.492 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.492 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.492 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.492 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.492 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.492 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.492 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.492 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.492 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.492 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:06:16.492 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.492 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:06:16.492 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.492 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:06:16.492 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:06:16.492 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.492 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.493 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.493 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.493 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:06:16.493 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.493 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.493 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.493 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.493 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:06:16.493 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.493 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.493 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.493 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.493 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:06:16.493 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:06:16.493 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.493 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.493 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:06:16.493 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.493 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.493 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.493 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:06:16.493 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:06:16.494 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.494 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.494 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.494 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.494 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:06:16.494 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.494 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.494 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.494 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.494 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:06:16.494 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.494 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.494 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.494 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.494 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:06:16.494 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:06:16.494 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.494 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.494 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:06:16.494 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.494 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.494 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.495 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:06:16.495 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:06:16.495 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.495 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.495 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.495 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.495 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:06:16.495 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.495 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.495 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.495 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.495 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:06:16.495 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.495 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.495 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.495 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.495 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:06:16.495 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:06:16.495 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.495 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.495 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:06:16.495 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.496 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.496 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.496 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:06:16.496 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:06:16.496 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.496 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.496 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.496 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.496 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:06:16.496 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.496 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.496 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.496 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.496 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:06:16.496 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.496 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.496 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.496 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.496 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:06:16.496 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:06:16.496 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.496 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.497 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:06:16.497 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.497 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.497 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.497 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:06:16.497 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:06:16.497 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.497 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.497 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.497 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.497 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:06:16.497 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.497 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.497 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.497 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.497 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:06:16.497 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.497 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.497 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.497 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.497 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:06:16.497 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:06:16.497 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.498 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.498 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:16.498 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.498 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.498 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.498 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:06:16.498 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:06:16.498 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.498 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.498 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.498 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.498 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:06:16.498 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.498 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.498 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.498 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.498 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:06:16.498 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.498 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.498 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.498 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.498 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:06:16.498 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:06:16.499 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.499 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.499 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:06:16.499 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.499 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.499 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.499 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:06:16.499 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:06:16.499 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.499 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.499 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.499 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.499 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:06:16.499 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.499 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.499 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.499 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.499 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:06:16.499 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.499 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.499 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.499 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.499 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:06:16.499 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:06:16.499 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.500 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.500 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:16.500 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.500 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.500 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.500 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:06:16.500 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:06:16.500 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.500 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.500 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.500 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.500 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:06:16.500 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.500 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.500 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.500 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.500 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:06:16.500 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.500 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.500 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.500 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.500 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:06:16.500 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:06:16.500 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.501 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.501 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:06:16.501 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.501 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.501 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.501 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:06:16.501 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:06:16.501 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.501 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.501 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.501 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.501 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:06:16.501 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.501 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.501 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.501 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.501 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:06:16.501 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.501 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.501 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.501 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.501 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:06:16.501 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:06:16.501 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.501 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.502 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:06:16.502 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.502 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.502 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.502 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.502 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:06:16.502 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:06:16.502 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.502 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:16.502 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:16.502 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:16.502 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.502 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.502 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:06:16.502 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.502 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:16.502 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:16.502 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:16.502 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.502 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.502 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.502 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:06:16.502 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:06:16.503 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.480+0000 7f4fcbf0c640 1 -- 10.20.193.48:0/2095796475 >> v2:10.20.193.111:6812/977811348 conn(0x7f4f9403f7f0 msgr2=0x7f4f9405fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.503 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.480+0000 7f4fcbf0c640 1 --2- 10.20.193.48:0/2095796475 >> v2:10.20.193.111:6812/977811348 conn(0x7f4f9403f7f0 0x7f4f9405fca0 secure :-1 s=READY pgs=73 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fc4091680 tx=0x7f4fb8008040 comp rx=0 tx=0).stop 2026-02-12T18:06:16.503 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.480+0000 7f4fcbf0c640 10 monclient: shutdown 2026-02-12T18:06:16.503 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.480+0000 7f4fcbf0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:16.503 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.480+0000 7f4fcbf0c640 1 -- 10.20.193.48:0/2095796475 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4fc405e490 msgr2=0x7f4fc41a55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.503 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.480+0000 7f4fca482640 1 -- 10.20.193.48:0/2095796475 reap_dead start 2026-02-12T18:06:16.503 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.480+0000 7f4fcbf0c640 1 --2- 10.20.193.48:0/2095796475 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4fc405e490 0x7f4fc41a55b0 secure :-1 s=READY pgs=51 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4fc000a830 tx=0x7f4fc0005850 comp rx=0 tx=0).stop 2026-02-12T18:06:16.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.480+0000 7f4fcbf0c640 1 -- 10.20.193.48:0/2095796475 shutdown_connections 2026-02-12T18:06:16.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.480+0000 7f4fcbf0c640 1 --2- 10.20.193.48:0/2095796475 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4fc405e490 0x7f4fc41a55b0 unknown :-1 s=CLOSED pgs=51 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.480+0000 7f4fcbf0c640 1 -- 10.20.193.48:0/2095796475 >> 10.20.193.48:0/2095796475 conn(0x7f4fc40548a0 msgr2=0x7f4fc413f120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:16.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.480+0000 7f4fcbf0c640 1 -- 10.20.193.48:0/2095796475 shutdown_connections 2026-02-12T18:06:16.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.480+0000 7f4fcbf0c640 1 -- 10.20.193.48:0/2095796475 wait complete. 2026-02-12T18:06:16.504 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:06:16.504 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2026-02-12T18:06:16.504 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2026-02-12T18:06:16.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.570+0000 7fbd41df6640 10 monclient: get_monmap_and_config 2026-02-12T18:06:16.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.570+0000 7fbd41df6640 10 monclient: build_initial_monmap 2026-02-12T18:06:16.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.570+0000 7fbd41df6640 10 monclient: monmap: 2026-02-12T18:06:16.571 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:16.571 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.571 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:16.571381+0000 2026-02-12T18:06:16.571 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:16.571381+0000 2026-02-12T18:06:16.571 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:16.571 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.571 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:16.571 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:16.571 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:16.571 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:16.571 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:16.571 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:16.571 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:16.571 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:16.571 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:16.571 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:16.571 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:16.571 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.570+0000 7fbd41df6640 1 Processor -- start 2026-02-12T18:06:16.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.570+0000 7fbd41df6640 1 -- start start 2026-02-12T18:06:16.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.570+0000 7fbd41df6640 10 monclient: init 2026-02-12T18:06:16.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd41df6640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:16.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd41df6640 10 monclient: _add_conns ranks=[8,4,1,10,6,2,5,9,0,7,3] 2026-02-12T18:06:16.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd41df6640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbd3c0951a0 0x7fbd3c093850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd41df6640 10 monclient(hunting): picked mon.noname-e con 0x7fbd3c0951a0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:16.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd41df6640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fbd3c096ad0 0x7fbd3c095570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd41df6640 10 monclient(hunting): picked mon.noname-c con 0x7fbd3c096ad0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:06:16.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd41df6640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fbd3c095ab0 addr v1:10.20.193.111:6789/0 2026-02-12T18:06:16.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd41df6640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd3c04dc20 con 0x7fbd3c095ab0 2026-02-12T18:06:16.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd41df6640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd41df6640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fbd3c096900 con 0x7fbd3c096ad0 2026-02-12T18:06:16.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd41df6640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd41df6640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fbd3c092260 con 0x7fbd3c0951a0 2026-02-12T18:06:16.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd41df6640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:16.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd41df6640 10 monclient(hunting): authenticate will time out at 615.297387s 2026-02-12T18:06:16.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd3affd640 1 -- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fbd3c096ad0 msgr2=0x7fbd3c095570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:06:16.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd3affd640 1 -- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fbd3c096ad0 msgr2=0x7fbd3c095570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:06:16.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd3b7fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbd3c0951a0 0x7fbd3c093850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd3affd640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fbd3c096ad0 0x7fbd3c095570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner read peer banner failed r=-1 ((1) Operation not permitted) 2026-02-12T18:06:16.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd3affd640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fbd3c096ad0 0x7fbd3c095570 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:06:16.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd3b7fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbd3c0951a0 0x7fbd3c093850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:53254/0 (socket says 10.20.193.48:53254) 2026-02-12T18:06:16.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd3b7fe640 1 -- 10.20.193.48:0/3597979667 learned_addr learned my addr 10.20.193.48:0/3597979667 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:16.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd3b7fe640 10 monclient(hunting): get_auth_request con 0x7fbd3c0951a0 auth_method 0 2026-02-12T18:06:16.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd3b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd3b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd3b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd3b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd3b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd3b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd3b7fe640 1 -- 10.20.193.48:0/3597979667 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbd3c0951a0 msgr2=0x7fbd3c093850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:06:16.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd3b7fe640 1 -- 10.20.193.48:0/3597979667 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbd3c0951a0 msgr2=0x7fbd3c093850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:06:16.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd3b7fe640 1 --2- 10.20.193.48:0/3597979667 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbd3c0951a0 0x7fbd3c093850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:06:16.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.571+0000 7fbd3b7fe640 1 --2- 10.20.193.48:0/3597979667 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbd3c0951a0 0x7fbd3c093850 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:06:16.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.573+0000 7fbd3bfff640 1 -- 10.20.193.48:0/3597979667 >> v1:10.20.193.111:6789/0 conn(0x7fbd3c095ab0 legacy=0x7fbd3c1a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 1 -- 10.20.193.48:0/3597979667 <== mon.1 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2411123241 0 0) 0x7fbd3c04dc20 con 0x7fbd3c095ab0 2026-02-12T18:06:16.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 10 monclient(hunting): _negotiate 2026-02-12T18:06:16.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 10 monclient(hunting): my global_id is 4420 2026-02-12T18:06:16.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 1 -- 10.20.193.48:0/3597979667 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd200035e0 con 0x7fbd3c095ab0 2026-02-12T18:06:16.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 1 -- 10.20.193.48:0/3597979667 <== mon.1 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4123289929 0 0) 0x7fbd200035e0 con 0x7fbd3c095ab0 2026-02-12T18:06:16.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 1 -- 10.20.193.48:0/3597979667 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbd3c0951a0 msgr2=0x7fbd3c093850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:06:16.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 1 --2- 10.20.193.48:0/3597979667 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbd3c0951a0 0x7fbd3c093850 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 1 -- 10.20.193.48:0/3597979667 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fbd3c096ad0 msgr2=0x7fbd3c095570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:06:16.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 1 --2- 10.20.193.48:0/3597979667 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fbd3c096ad0 0x7fbd3c095570 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 10 monclient: _finish_hunting 0 2026-02-12T18:06:16.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 1 monclient: found mon.noname-f-legacy 2026-02-12T18:06:16.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:16.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 10 monclient: _send_mon_message to mon.noname-f-legacy at v1:10.20.193.111:6789/0 2026-02-12T18:06:16.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 1 -- 10.20.193.48:0/3597979667 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3c093070 con 0x7fbd3c095ab0 2026-02-12T18:06:16.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 10 monclient: _finish_auth 0 2026-02-12T18:06:16.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 10 monclient: _check_auth_tickets 2026-02-12T18:06:16.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:16.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 1 -- 10.20.193.48:0/3597979667 <== mon.1 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (unknown 3750814960 0 0) 0x7fbd30004510 con 0x7fbd3c095ab0 2026-02-12T18:06:16.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 10 monclient: got monmap 1 from mon.noname-f-legacy (according to old e1) 2026-02-12T18:06:16.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 10 monclient: dump: 2026-02-12T18:06:16.578 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.578 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.578 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.578 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.578 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.578 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.578 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.578 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.578 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.578 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.578 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.578 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.578 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.578 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.579 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.579 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 1 monclient: mon.f has (v2) addrs [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] but i'm connected to v1:10.20.193.111:6789/0, reconnecting 2026-02-12T18:06:16.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:16.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 1 -- 10.20.193.48:0/3597979667 >> v1:10.20.193.111:6789/0 conn(0x7fbd3c095ab0 legacy=0x7fbd3c1a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 10 monclient: _add_conns ranks=[7,4,0,6,3,8,5,2,1] 2026-02-12T18:06:16.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 1 --2- 10.20.193.48:0/3597979667 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fbd20004350 0x7fbd20004850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 10 monclient(hunting): picked mon.i con 0x7fbd20004350 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:16.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 1 --2- 10.20.193.48:0/3597979667 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fbd3c096ad0 0x7fbd20004f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 10 monclient(hunting): picked mon.c con 0x7fbd3c096ad0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:06:16.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 1 --2- 10.20.193.48:0/3597979667 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbd20045a00 0x7fbd20065de0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 10 monclient(hunting): picked mon.a con 0x7fbd20045a00 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:06:16.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 1 -- 10.20.193.48:0/3597979667 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c096900 con 0x7fbd20045a00 2026-02-12T18:06:16.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 1 -- 10.20.193.48:0/3597979667 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fbd3c092260 con 0x7fbd3c096ad0 2026-02-12T18:06:16.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 1 -- 10.20.193.48:0/3597979667 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fbd200664e0 con 0x7fbd20004350 2026-02-12T18:06:16.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:16.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3a7fc640 10 monclient(hunting): _finish_auth 0 2026-02-12T18:06:16.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3affd640 1 --2- 10.20.193.48:0/3597979667 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fbd3c096ad0 0x7fbd20004f00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3bfff640 1 --2- 10.20.193.48:0/3597979667 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbd20045a00 0x7fbd20065de0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3affd640 10 monclient(hunting): get_auth_request con 0x7fbd3c096ad0 auth_method 0 2026-02-12T18:06:16.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3affd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:06:16.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3bfff640 10 monclient(hunting): get_auth_request con 0x7fbd20045a00 auth_method 0 2026-02-12T18:06:16.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3bfff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:06:16.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3affd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:06:16.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3bfff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:06:16.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3b7fe640 1 --2- 10.20.193.48:0/3597979667 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fbd20004350 0x7fbd20004850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=8 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3affd640 10 monclient(hunting): handle_auth_done global_id 4420 payload 293 2026-02-12T18:06:16.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3affd640 1 -- 10.20.193.48:0/3597979667 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fbd20004350 msgr2=0x7fbd20004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:16.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3affd640 1 --2- 10.20.193.48:0/3597979667 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fbd20004350 0x7fbd20004850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=8 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3affd640 1 -- 10.20.193.48:0/3597979667 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbd20045a00 msgr2=0x7fbd20065de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:16.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3affd640 1 --2- 10.20.193.48:0/3597979667 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbd20045a00 0x7fbd20065de0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=7 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3affd640 10 monclient: _finish_hunting 0 2026-02-12T18:06:16.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3affd640 1 monclient: found mon.c 2026-02-12T18:06:16.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:16.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3affd640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:06:16.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3affd640 1 -- 10.20.193.48:0/3597979667 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd200035e0 con 0x7fbd3c096ad0 2026-02-12T18:06:16.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3affd640 10 monclient: _finish_auth 0 2026-02-12T18:06:16.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3affd640 10 monclient: _check_auth_tickets 2026-02-12T18:06:16.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:16.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd41df6640 5 monclient: authenticate success, global_id 4420 2026-02-12T18:06:16.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd41df6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:16.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.574+0000 7fbd3bfff640 1 --2- 10.20.193.48:0/3597979667 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbd20045a00 0x7fbd20065de0 unknown :-1 s=CLOSED pgs=0 gs=7 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:06:16.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.577+0000 7fbd3affd640 1 -- 10.20.193.48:0/3597979667 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fbd3c096ad0 msgr2=0x7fbd20004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.577+0000 7fbd3affd640 1 --2- 10.20.193.48:0/3597979667 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fbd3c096ad0 0x7fbd20004f00 secure :-1 s=READY pgs=52 gs=6 cs=0 l=1 c_cookie=11459758470051763471 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd2c006fd0 tx=0x7fbd2c02ecc0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=9f093d9cb335950f server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.577+0000 7fbd3a7fc640 1 -- 10.20.193.48:0/3597979667 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fbd2c02fbf0 con 0x7fbd3c096ad0 2026-02-12T18:06:16.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.577+0000 7fbd3a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.577+0000 7fbd3a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:06:16.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.577+0000 7fbd3a7fc640 10 monclient: dump: 2026-02-12T18:06:16.585 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.585 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.585 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.585 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.585 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.586 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.586 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.586 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.586 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.586 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.586 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.586 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.586 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.586 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.586 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.586 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.577+0000 7fbd41df6640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:16.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.577+0000 7fbd3a7fc640 1 -- 10.20.193.48:0/3597979667 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd2c02fd50 con 0x7fbd3c096ad0 2026-02-12T18:06:16.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.577+0000 7fbd3a7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:16.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.577+0000 7fbd3a7fc640 1 -- 10.20.193.48:0/3597979667 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fbd2c035340 con 0x7fbd3c096ad0 2026-02-12T18:06:16.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.577+0000 7fbd3a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.577+0000 7fbd3a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:06:16.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.577+0000 7fbd3a7fc640 10 monclient: dump: 2026-02-12T18:06:16.586 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.586 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.586 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.586 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.587 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.587 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.587 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.587 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.587 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.587 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.587 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.587 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.587 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.587 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.587 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.587 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.577+0000 7fbd41df6640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:16.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.577+0000 7fbd41df6640 4 set_mon_vals no callback set 2026-02-12T18:06:16.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.577+0000 7fbd41df6640 10 monclient: shutdown 2026-02-12T18:06:16.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.577+0000 7fbd41df6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:16.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.577+0000 7fbd41df6640 1 -- 10.20.193.48:0/3597979667 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fbd3c096ad0 msgr2=0x7fbd20004f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.577+0000 7fbd41df6640 1 --2- 10.20.193.48:0/3597979667 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fbd3c096ad0 0x7fbd20004f00 secure :-1 s=READY pgs=52 gs=6 cs=0 l=1 c_cookie=11459758470051763471 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd2c006fd0 tx=0x7fbd2c02ecc0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.578+0000 7fbd3bfff640 1 -- 10.20.193.48:0/3597979667 reap_dead start 2026-02-12T18:06:16.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.578+0000 7fbd41df6640 1 -- 10.20.193.48:0/3597979667 shutdown_connections 2026-02-12T18:06:16.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.578+0000 7fbd41df6640 1 -- 10.20.193.48:0/3597979667 >> 10.20.193.48:0/3597979667 conn(0x7fbd3c0548c0 msgr2=0x7fbd3c0973a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:16.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.578+0000 7fbd41df6640 1 -- 10.20.193.48:0/3597979667 shutdown_connections 2026-02-12T18:06:16.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.578+0000 7fbd41df6640 1 -- 10.20.193.48:0/3597979667 wait complete. 2026-02-12T18:06:16.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.578+0000 7fbd41df6640 10 monclient: build_initial_monmap 2026-02-12T18:06:16.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.578+0000 7fbd41df6640 10 monclient: monmap: 2026-02-12T18:06:16.588 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:16.588 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:16.588 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:16.588 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:16.588 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:16.588 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.588 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:16.588 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:16.588 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:16.588 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:16.588 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:16.588 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:16.588 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:16.588 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:16.588 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:16.588 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.578+0000 7fbd41df6640 1 Processor -- start 2026-02-12T18:06:16.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.578+0000 7fbd41df6640 1 -- start start 2026-02-12T18:06:16.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.578+0000 7fbd41df6640 10 monclient: init 2026-02-12T18:06:16.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.578+0000 7fbd41df6640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:16.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.578+0000 7fbd41df6640 10 monclient: _add_conns ranks=[6,3,0,4,1,2,7,8,5] 2026-02-12T18:06:16.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.578+0000 7fbd41df6640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fbd3c1d7be0 0x7fbd3c1b0ea0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.578+0000 7fbd41df6640 10 monclient(hunting): picked mon.noname-d con 0x7fbd3c1d7be0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:06:16.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.578+0000 7fbd41df6640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fbd3c19b040 0x7fbd3c1db140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.578+0000 7fbd41df6640 10 monclient(hunting): picked mon.noname-g con 0x7fbd3c19b040 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:16.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.578+0000 7fbd41df6640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbd3c1b13e0 0x7fbd3c1db680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.578+0000 7fbd41df6640 10 monclient(hunting): picked mon.noname-a con 0x7fbd3c1b13e0 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:06:16.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.578+0000 7fbd41df6640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.578+0000 7fbd41df6640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c19a200 con 0x7fbd3c1b13e0 2026-02-12T18:06:16.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.578+0000 7fbd41df6640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.578+0000 7fbd41df6640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fbd3c0944f0 con 0x7fbd3c19b040 2026-02-12T18:06:16.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd41df6640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd41df6640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fbd3c1d7fb0 con 0x7fbd3c1d7be0 2026-02-12T18:06:16.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd41df6640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:16.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd41df6640 10 monclient(hunting): authenticate will time out at 615.305006s 2026-02-12T18:06:16.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3bfff640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbd3c1b13e0 0x7fbd3c1db680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3b7fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fbd3c1d7be0 0x7fbd3c1b0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3bfff640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbd3c1b13e0 0x7fbd3c1db680 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:57176/0 (socket says 10.20.193.48:57176) 2026-02-12T18:06:16.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3bfff640 1 -- 10.20.193.48:0/3151323794 learned_addr learned my addr 10.20.193.48:0/3151323794 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:16.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3bfff640 10 monclient(hunting): get_auth_request con 0x7fbd3c1b13e0 auth_method 0 2026-02-12T18:06:16.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3b7fe640 10 monclient(hunting): get_auth_request con 0x7fbd3c1d7be0 auth_method 0 2026-02-12T18:06:16.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3bfff640 10 monclient(hunting): handle_auth_done global_id 4536 payload 824 2026-02-12T18:06:16.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3bfff640 1 -- 10.20.193.48:0/3151323794 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fbd3c1d7be0 msgr2=0x7fbd3c1b0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3bfff640 1 --2- 10.20.193.48:0/3151323794 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fbd3c1d7be0 0x7fbd3c1b0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3bfff640 1 -- 10.20.193.48:0/3151323794 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fbd3c19b040 msgr2=0x7fbd3c1db140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3bfff640 1 --2- 10.20.193.48:0/3151323794 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fbd3c19b040 0x7fbd3c1db140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3bfff640 10 monclient: _finish_hunting 0 2026-02-12T18:06:16.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3bfff640 1 monclient: found mon.noname-a 2026-02-12T18:06:16.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:16.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:06:16.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.579+0000 7fbd3bfff640 1 -- 10.20.193.48:0/3151323794 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd3c19bfa0 con 0x7fbd3c1b13e0 2026-02-12T18:06:16.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.581+0000 7fbd3bfff640 1 -- 10.20.193.48:0/3151323794 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbd3c1b13e0 msgr2=0x7fbd3c1db680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.581+0000 7fbd3bfff640 1 --2- 10.20.193.48:0/3151323794 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbd3c1b13e0 0x7fbd3c1db680 secure :-1 s=READY pgs=92 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd3c0982f0 tx=0x7fbd300096b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.581+0000 7fbd17fff640 1 -- 10.20.193.48:0/3151323794 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fbd30013b90 con 0x7fbd3c1b13e0 2026-02-12T18:06:16.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.581+0000 7fbd17fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.581+0000 7fbd17fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:06:16.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.581+0000 7fbd17fff640 10 monclient: dump: 2026-02-12T18:06:16.591 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.591 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.591 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.591 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.591 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.591 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.591 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.591 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.591 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.591 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.591 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.591 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.591 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.591 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.591 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.592 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.581+0000 7fbd17fff640 10 monclient: _finish_auth 0 2026-02-12T18:06:16.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.581+0000 7fbd17fff640 10 monclient: _check_auth_tickets 2026-02-12T18:06:16.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.581+0000 7fbd17fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:16.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.581+0000 7fbd41df6640 5 monclient: authenticate success, global_id 4536 2026-02-12T18:06:16.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.581+0000 7fbd17fff640 1 -- 10.20.193.48:0/3151323794 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd30013cf0 con 0x7fbd3c1b13e0 2026-02-12T18:06:16.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.581+0000 7fbd17fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:16.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.581+0000 7fbd17fff640 1 -- 10.20.193.48:0/3151323794 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fbd30013e60 con 0x7fbd3c1b13e0 2026-02-12T18:06:16.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.581+0000 7fbd17fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.581+0000 7fbd39ffb640 4 set_mon_vals no callback set 2026-02-12T18:06:16.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.581+0000 7fbd17fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:16.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.581+0000 7fbd17fff640 10 monclient: dump: 2026-02-12T18:06:16.592 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.592 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.592 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.592 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.592 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.592 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.592 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.592 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.592 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.592 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.593 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.593 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.593 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.593 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.593 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.593 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.581+0000 7fbd41df6640 10 monclient: _renew_subs 2026-02-12T18:06:16.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.581+0000 7fbd41df6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:16.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.581+0000 7fbd41df6640 1 -- 10.20.193.48:0/3151323794 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd3c19c280 con 0x7fbd3c1b13e0 2026-02-12T18:06:16.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.581+0000 7fbd41df6640 10 monclient: _renew_subs 2026-02-12T18:06:16.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.581+0000 7fbd41df6640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:16.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.581+0000 7fbd41df6640 1 -- 10.20.193.48:0/3151323794 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd3c19a5f0 con 0x7fbd3c1b13e0 2026-02-12T18:06:16.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.582+0000 7fbd41df6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:16.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.582+0000 7fbd41df6640 1 --2- 10.20.193.48:0/3151323794 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fbd3c1dbbc0 0x7fbd3c194640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.582+0000 7fbd41df6640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.582+0000 7fbd41df6640 1 -- 10.20.193.48:0/3151323794 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c063a20 con 0x7fbd3c1dbbc0 2026-02-12T18:06:16.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.582+0000 7fbd17fff640 1 -- 10.20.193.48:0/3151323794 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fbd30014070 con 0x7fbd3c1b13e0 2026-02-12T18:06:16.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.582+0000 7fbd3b7fe640 1 --2- 10.20.193.48:0/3151323794 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fbd3c1dbbc0 0x7fbd3c194640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.582+0000 7fbd3b7fe640 10 monclient: get_auth_request con 0x7fbd3c1dbbc0 auth_method 0 2026-02-12T18:06:16.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.582+0000 7fbd3b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.582+0000 7fbd3b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.582+0000 7fbd3b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.582+0000 7fbd17fff640 1 --2- 10.20.193.48:0/3151323794 >> v2:10.20.193.111:6812/977811348 conn(0x7fbd0c03f800 0x7fbd0c05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.582+0000 7fbd17fff640 1 -- 10.20.193.48:0/3151323794 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (secure 0 0 0) 0x7fbd30052cd0 con 0x7fbd3c1b13e0 2026-02-12T18:06:16.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.582+0000 7fbd3b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.582+0000 7fbd3b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.582+0000 7fbd3affd640 1 --2- 10.20.193.48:0/3151323794 >> v2:10.20.193.111:6812/977811348 conn(0x7fbd0c03f800 0x7fbd0c05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.582+0000 7fbd3b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.582+0000 7fbd3affd640 10 monclient: get_auth_request con 0x7fbd0c03f800 auth_method 0 2026-02-12T18:06:16.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.582+0000 7fbd3b7fe640 10 monclient(hunting): handle_auth_done global_id 4429 payload 824 2026-02-12T18:06:16.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.582+0000 7fbd3b7fe640 1 -- 10.20.193.48:0/3151323794 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd3c095f00 con 0x7fbd3c1dbbc0 2026-02-12T18:06:16.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.585+0000 7fbd3affd640 1 --2- 10.20.193.48:0/3151323794 >> v2:10.20.193.111:6812/977811348 conn(0x7fbd0c03f800 0x7fbd0c05fcb0 secure :-1 s=READY pgs=74 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd2c02ed00 tx=0x7fbd2c039040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.585+0000 7fbd3b7fe640 1 -- 10.20.193.48:0/3151323794 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fbd3c1dbbc0 msgr2=0x7fbd3c194640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.585+0000 7fbd3b7fe640 1 --2- 10.20.193.48:0/3151323794 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fbd3c1dbbc0 0x7fbd3c194640 secure :-1 s=READY pgs=50 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd28006fd0 tx=0x7fbd28013d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.585+0000 7fbd17fff640 1 -- 10.20.193.48:0/3151323794 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fbd28011ca0 con 0x7fbd3c1dbbc0 2026-02-12T18:06:16.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.585+0000 7fbd17fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.585+0000 7fbd17fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:06:16.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.585+0000 7fbd17fff640 10 monclient: dump: 2026-02-12T18:06:16.596 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.596 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.596 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.596 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.596 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.596 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.596 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.596 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.596 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.596 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.596 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.596 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.596 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.596 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.597 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.597 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.585+0000 7fbd17fff640 1 -- 10.20.193.48:0/3151323794 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fbd28011e00 con 0x7fbd3c1dbbc0 2026-02-12T18:06:16.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.585+0000 7fbd17fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:16.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.585+0000 7fbd17fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:16.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.585+0000 7fbd17fff640 1 -- 10.20.193.48:0/3151323794 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fbd3c1dbbc0 msgr2=0x7fbd3c194640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.585+0000 7fbd17fff640 1 --2- 10.20.193.48:0/3151323794 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fbd3c1dbbc0 0x7fbd3c194640 secure :-1 s=READY pgs=50 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd28006fd0 tx=0x7fbd28013d20 comp rx=0 tx=0).stop 2026-02-12T18:06:16.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.585+0000 7fbd17fff640 1 -- 10.20.193.48:0/3151323794 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fbd3c1dbbc0 msgr2=0x7fbd3c194640 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:16.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.585+0000 7fbd17fff640 1 --2- 10.20.193.48:0/3151323794 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fbd3c1dbbc0 0x7fbd3c194640 secure :-1 s=CLOSED pgs=50 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd28006fd0 tx=0x7fbd28013d20 comp rx=0 tx=0).stop 2026-02-12T18:06:16.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.589+0000 7fbd41df6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:06:16.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.589+0000 7fbd41df6640 1 --2- 10.20.193.48:0/3151323794 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fbd3c194b80 0x7fbd3c194f50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.589+0000 7fbd41df6640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.589+0000 7fbd41df6640 1 -- 10.20.193.48:0/3151323794 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fbd3c19c410 con 0x7fbd3c194b80 2026-02-12T18:06:16.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.589+0000 7fbd3b7fe640 1 --2- 10.20.193.48:0/3151323794 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fbd3c194b80 0x7fbd3c194f50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.589+0000 7fbd3b7fe640 10 monclient: get_auth_request con 0x7fbd3c194b80 auth_method 0 2026-02-12T18:06:16.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.589+0000 7fbd3b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.589+0000 7fbd3b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.589+0000 7fbd3b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.589+0000 7fbd3b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.589+0000 7fbd3b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.589+0000 7fbd3b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.589+0000 7fbd3b7fe640 10 monclient(hunting): handle_auth_done global_id 4438 payload 824 2026-02-12T18:06:16.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.589+0000 7fbd3b7fe640 1 -- 10.20.193.48:0/3151323794 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbd3c05dc10 con 0x7fbd3c194b80 2026-02-12T18:06:16.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.592+0000 7fbd3b7fe640 1 -- 10.20.193.48:0/3151323794 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fbd3c194b80 msgr2=0x7fbd3c194f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.592+0000 7fbd3b7fe640 1 --2- 10.20.193.48:0/3151323794 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fbd3c194b80 0x7fbd3c194f50 secure :-1 s=READY pgs=51 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd2801a000 tx=0x7fbd280047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.592+0000 7fbd17fff640 1 -- 10.20.193.48:0/3151323794 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fbd280034f0 con 0x7fbd3c194b80 2026-02-12T18:06:16.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.592+0000 7fbd17fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.592+0000 7fbd17fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:06:16.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.592+0000 7fbd17fff640 10 monclient: dump: 2026-02-12T18:06:16.598 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.598 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.598 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.598 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.598 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.598 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.598 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.598 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.598 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.598 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.598 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.598 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.598 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.598 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.599 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.599 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.592+0000 7fbd17fff640 1 -- 10.20.193.48:0/3151323794 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10182 (secure 0 0 0) 0x7fbd28025040 con 0x7fbd3c194b80 2026-02-12T18:06:16.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.592+0000 7fbd17fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:06:16.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.592+0000 7fbd17fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:16.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.592+0000 7fbd17fff640 1 -- 10.20.193.48:0/3151323794 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fbd3c194b80 msgr2=0x7fbd3c194f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.592+0000 7fbd17fff640 1 --2- 10.20.193.48:0/3151323794 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fbd3c194b80 0x7fbd3c194f50 secure :-1 s=READY pgs=51 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd2801a000 tx=0x7fbd280047e0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.592+0000 7fbd17fff640 1 -- 10.20.193.48:0/3151323794 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fbd3c194b80 msgr2=0x7fbd3c194f50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:16.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.592+0000 7fbd17fff640 1 --2- 10.20.193.48:0/3151323794 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fbd3c194b80 0x7fbd3c194f50 secure :-1 s=CLOSED pgs=51 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd2801a000 tx=0x7fbd280047e0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.599 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:06:16.599 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:06:16.599 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:06:16.599 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:06:16.599 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 12, 2026-02-12T18:06:16.599 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 31389, 2026-02-12T18:06:16.600 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:06:16.600 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:06:16.600 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:06:16.600 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:06:16.600 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:06:16.600 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:06:16.600 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:06:16.600 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:06:16.600 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:06:16.600 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:06:16.600 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.600 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 19, 2026-02-12T18:06:16.600 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:16.600 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:06:16.600 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:06:16.600 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.600 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.600 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.600 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.600 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.600 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.601 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.601 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.601 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.601 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.601 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.601 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.601 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.601 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.601 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:06:16.601 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:06:16.601 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.601 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.601 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.601 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.601 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.601 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.601 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.601 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.601 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.601 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.601 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.601 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.601 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.602 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.602 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.602 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:06:16.602 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:06:16.602 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:06:16.602 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:06:16.602 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:06:16.602 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:06:16.602 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:16.602 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:16.602 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:06:16.602 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:06:16.602 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:06:16.602 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:06:16.602 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:06:16.602 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:06:16.602 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:06:16.602 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:16.602 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:06:16.602 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.602 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.602 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.602 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.603 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.603 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.603 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.603 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.603 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.603 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.603 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.603 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.603 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.603 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.603 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:06:16.603 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.603 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:06:16.603 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.603 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:06:16.603 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:06:16.603 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.603 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.603 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.603 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.603 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:06:16.603 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.603 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.604 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.604 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.604 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:06:16.604 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.604 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.604 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.604 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.604 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:06:16.604 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:06:16.604 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.604 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.604 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:06:16.604 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.604 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.604 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.604 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:06:16.604 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:06:16.604 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.604 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.604 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.604 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.604 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:06:16.604 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.604 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.605 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.605 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.605 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:06:16.605 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.605 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.605 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.605 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.605 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:06:16.605 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:06:16.605 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.605 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.605 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:06:16.605 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.605 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.605 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.605 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:06:16.605 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:06:16.605 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.605 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.605 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.605 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.605 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:06:16.605 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.605 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.605 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.605 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.606 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:06:16.606 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.606 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.606 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.606 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.606 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:06:16.606 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:06:16.606 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.606 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.606 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:06:16.606 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.606 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.606 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.606 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:06:16.606 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:06:16.606 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.606 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.606 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.606 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.606 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:06:16.606 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.606 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.606 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.606 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.606 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:06:16.607 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.607 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.607 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.607 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.607 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:06:16.607 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:06:16.607 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.607 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.607 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:06:16.607 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.607 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.607 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.607 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:06:16.607 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:06:16.607 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.607 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.607 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.607 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.607 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:06:16.607 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.607 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.607 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.607 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.607 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:06:16.607 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.607 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.608 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.609 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.610 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:06:16.611 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.612 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:16.612 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:16.612 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:16.612 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.612 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.612 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:06:16.612 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.612 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:16.612 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:16.612 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:06:16.612 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.612 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.612 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:06:16.612 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.612 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:16.612 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:16.612 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:06:16.612 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.612 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.612 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.612 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:06:16.612 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:06:16.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.592+0000 7fbd41df6640 1 -- 10.20.193.48:0/3151323794 >> v2:10.20.193.111:6812/977811348 conn(0x7fbd0c03f800 msgr2=0x7fbd0c05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.592+0000 7fbd41df6640 1 --2- 10.20.193.48:0/3151323794 >> v2:10.20.193.111:6812/977811348 conn(0x7fbd0c03f800 0x7fbd0c05fcb0 secure :-1 s=READY pgs=74 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd2c02ed00 tx=0x7fbd2c039040 comp rx=0 tx=0).stop 2026-02-12T18:06:16.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.592+0000 7fbd41df6640 10 monclient: shutdown 2026-02-12T18:06:16.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.592+0000 7fbd41df6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:16.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.592+0000 7fbd41df6640 1 -- 10.20.193.48:0/3151323794 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbd3c1b13e0 msgr2=0x7fbd3c1db680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.592+0000 7fbd41df6640 1 --2- 10.20.193.48:0/3151323794 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbd3c1b13e0 0x7fbd3c1db680 secure :-1 s=READY pgs=92 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbd3c0982f0 tx=0x7fbd300096b0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.592+0000 7fbd3bfff640 1 -- 10.20.193.48:0/3151323794 reap_dead start 2026-02-12T18:06:16.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.592+0000 7fbd41df6640 1 -- 10.20.193.48:0/3151323794 shutdown_connections 2026-02-12T18:06:16.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.592+0000 7fbd41df6640 1 --2- 10.20.193.48:0/3151323794 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbd3c1b13e0 0x7fbd3c1db680 unknown :-1 s=CLOSED pgs=92 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.592+0000 7fbd41df6640 1 -- 10.20.193.48:0/3151323794 >> 10.20.193.48:0/3151323794 conn(0x7fbd3c0548c0 msgr2=0x7fbd3c08d880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:16.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.592+0000 7fbd41df6640 1 -- 10.20.193.48:0/3151323794 shutdown_connections 2026-02-12T18:06:16.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.592+0000 7fbd41df6640 1 -- 10.20.193.48:0/3151323794 wait complete. 2026-02-12T18:06:16.614 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:06:16.614 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2026-02-12T18:06:16.614 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2026-02-12T18:06:16.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.678+0000 7fd224a52640 10 monclient: get_monmap_and_config 2026-02-12T18:06:16.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.678+0000 7fd224a52640 10 monclient: build_initial_monmap 2026-02-12T18:06:16.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.678+0000 7fd224a52640 10 monclient: monmap: 2026-02-12T18:06:16.679 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:16.679 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.679 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:16.679860+0000 2026-02-12T18:06:16.679 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:16.679860+0000 2026-02-12T18:06:16.679 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:16.679 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.679 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:16.679 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:16.679 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:16.679 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:16.679 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:16.679 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:16.679 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:16.679 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:16.679 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:16.680 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:16.680 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:16.680 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd224a52640 1 Processor -- start 2026-02-12T18:06:16.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd224a52640 1 -- start start 2026-02-12T18:06:16.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd224a52640 10 monclient: init 2026-02-12T18:06:16.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd224a52640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:16.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd224a52640 10 monclient: _add_conns ranks=[0,3,10,5,6,1,4,2,7,9,8] 2026-02-12T18:06:16.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd224a52640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd22005c950 addr v1:10.20.193.48:6789/0 2026-02-12T18:06:16.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd224a52640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22005e490 0x7fd2201857b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd224a52640 10 monclient(hunting): picked mon.noname-g con 0x7fd22005e490 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:16.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd224a52640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7fd22005d430 0x7fd2201a5d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd224a52640 10 monclient(hunting): picked mon.noname-f con 0x7fd22005d430 addr v2:10.20.193.111:3300/0 2026-02-12T18:06:16.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd224a52640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd22004dc20 con 0x7fd22005c950 2026-02-12T18:06:16.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd224a52640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd224a52640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7fd22005ddd0 con 0x7fd22005d430 2026-02-12T18:06:16.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd224a52640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd224a52640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd220092990 con 0x7fd22005e490 2026-02-12T18:06:16.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd224a52640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:16.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd224a52640 10 monclient(hunting): authenticate will time out at 615.405598s 2026-02-12T18:06:16.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd21e575640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7fd22005c950 0x7fd22005cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:34442/0 (socket says 10.20.193.48:34442) 2026-02-12T18:06:16.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd21e575640 1 -- 10.20.193.48:0/1206786695 learned_addr learned my addr 10.20.193.48:0/1206786695 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:06:16.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd21dd74640 1 --2- 10.20.193.48:0/1206786695 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22005e490 0x7fd2201857b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd21ed76640 1 --2- 10.20.193.48:0/1206786695 >> v2:10.20.193.111:3300/0 conn(0x7fd22005d430 0x7fd2201a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd21dd74640 10 monclient(hunting): get_auth_request con 0x7fd22005e490 auth_method 0 2026-02-12T18:06:16.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd21dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd21dd74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd21dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd21ed76640 10 monclient(hunting): get_auth_request con 0x7fd22005d430 auth_method 0 2026-02-12T18:06:16.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd21ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd21ed76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd21ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd21dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd21dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.679+0000 7fd21dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.680+0000 7fd21ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.680+0000 7fd21ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.680+0000 7fd21ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.680+0000 7fd21dd74640 10 monclient(hunting): handle_auth_done global_id 4386 payload 274 2026-02-12T18:06:16.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.680+0000 7fd21dd74640 1 -- 10.20.193.48:0/1206786695 >> v2:10.20.193.111:3300/0 conn(0x7fd22005d430 msgr2=0x7fd2201a5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:16.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.680+0000 7fd21dd74640 1 --2- 10.20.193.48:0/1206786695 >> v2:10.20.193.111:3300/0 conn(0x7fd22005d430 0x7fd2201a5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.680+0000 7fd21dd74640 1 -- 10.20.193.48:0/1206786695 >> v1:10.20.193.48:6789/0 conn(0x7fd22005c950 legacy=0x7fd22005cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:16.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.680+0000 7fd21dd74640 10 monclient: _finish_hunting 0 2026-02-12T18:06:16.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.680+0000 7fd21dd74640 1 monclient: found mon.noname-g 2026-02-12T18:06:16.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.680+0000 7fd21dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:16.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.680+0000 7fd21dd74640 10 monclient: _send_mon_message to mon.noname-g at v2:10.20.193.111:3301/0 2026-02-12T18:06:16.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.680+0000 7fd21dd74640 1 -- 10.20.193.48:0/1206786695 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd220092c70 con 0x7fd22005e490 2026-02-12T18:06:16.683 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.682+0000 7fd21dd74640 1 -- 10.20.193.48:0/1206786695 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22005e490 msgr2=0x7fd2201857b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.683 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.682+0000 7fd21dd74640 1 --2- 10.20.193.48:0/1206786695 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22005e490 0x7fd2201857b0 secure :-1 s=READY pgs=34 gs=2 cs=0 l=1 c_cookie=75338724714291660 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd208004740 tx=0x7fd20802ed10 comp rx=0 tx=0).ready entity=mon.3 client_cookie=10ba82bc46d21cc server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.683 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.682+0000 7fd21d573640 1 -- 10.20.193.48:0/1206786695 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd20802fe50 con 0x7fd22005e490 2026-02-12T18:06:16.683 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.682+0000 7fd21d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.682+0000 7fd21d573640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.682+0000 7fd21d573640 10 monclient: dump: 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.682+0000 7fd21d573640 10 monclient: _finish_auth 0 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.682+0000 7fd21d573640 10 monclient: _check_auth_tickets 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.682+0000 7fd21d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.682+0000 7fd21d573640 1 -- 10.20.193.48:0/1206786695 <== mon.3 v2:10.20.193.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd208035340 con 0x7fd22005e490 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.682+0000 7fd224a52640 5 monclient: authenticate success, global_id 4386 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.682+0000 7fd224a52640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.682+0000 7fd21d573640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.682+0000 7fd21d573640 1 -- 10.20.193.48:0/1206786695 <== mon.3 v2:10.20.193.111:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd208035970 con 0x7fd22005e490 2026-02-12T18:06:16.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.682+0000 7fd224a52640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.682+0000 7fd224a52640 4 set_mon_vals no callback set 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.682+0000 7fd21d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.682+0000 7fd21d573640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.682+0000 7fd21d573640 10 monclient: dump: 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.683+0000 7fd224a52640 10 monclient: shutdown 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.683+0000 7fd224a52640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.683+0000 7fd224a52640 1 -- 10.20.193.48:0/1206786695 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22005e490 msgr2=0x7fd2201857b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.683+0000 7fd224a52640 1 --2- 10.20.193.48:0/1206786695 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22005e490 0x7fd2201857b0 secure :-1 s=READY pgs=34 gs=2 cs=0 l=1 c_cookie=75338724714291660 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd208004740 tx=0x7fd20802ed10 comp rx=0 tx=0).stop 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.683+0000 7fd224a52640 1 -- 10.20.193.48:0/1206786695 shutdown_connections 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.683+0000 7fd224a52640 1 --2- 10.20.193.48:0/1206786695 >> v2:10.20.193.111:3300/0 conn(0x7fd22005d430 0x7fd2201a5d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.683+0000 7fd224a52640 1 --2- 10.20.193.48:0/1206786695 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22005e490 0x7fd2201857b0 unknown :-1 s=CLOSED pgs=34 gs=2 cs=0 l=1 c_cookie=75338724714291660 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.683+0000 7fd224a52640 1 -- 10.20.193.48:0/1206786695 >> 10.20.193.48:0/1206786695 conn(0x7fd2200548a0 msgr2=0x7fd220097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:16.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.683+0000 7fd224a52640 1 -- 10.20.193.48:0/1206786695 shutdown_connections 2026-02-12T18:06:16.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.683+0000 7fd224a52640 1 -- 10.20.193.48:0/1206786695 wait complete. 2026-02-12T18:06:16.688 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.683+0000 7fd224a52640 10 monclient: build_initial_monmap 2026-02-12T18:06:16.688 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.683+0000 7fd224a52640 10 monclient: monmap: 2026-02-12T18:06:16.688 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:16.688 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:16.688 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:16.688 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.683+0000 7fd224a52640 1 Processor -- start 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.683+0000 7fd224a52640 1 -- start start 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.683+0000 7fd224a52640 10 monclient: init 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd224a52640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd224a52640 10 monclient: _add_conns ranks=[3,6,7,0,4,8,1,5,2] 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd224a52640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22005c950 0x7fd22008d390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd224a52640 10 monclient(hunting): picked mon.noname-g con 0x7fd22005c950 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd224a52640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd22005d430 0x7fd2201a55b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd224a52640 10 monclient(hunting): picked mon.noname-d con 0x7fd22005d430 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd224a52640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd22005e490 0x7fd2201a5af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd224a52640 10 monclient(hunting): picked mon.noname-i con 0x7fd22005e490 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd224a52640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd224a52640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd22008b6c0 con 0x7fd22005c950 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd224a52640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd224a52640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fd220091410 con 0x7fd22005d430 2026-02-12T18:06:16.689 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd224a52640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd224a52640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fd220141930 con 0x7fd22005e490 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd224a52640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd224a52640 10 monclient(hunting): authenticate will time out at 615.410232s 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21dd74640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd22005d430 0x7fd2201a55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21dd74640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd22005d430 0x7fd2201a55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:36106/0 (socket says 10.20.193.48:36106) 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21dd74640 1 -- 10.20.193.48:0/396201619 learned_addr learned my addr 10.20.193.48:0/396201619 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21dd74640 10 monclient(hunting): get_auth_request con 0x7fd22005d430 auth_method 0 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21dd74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21ed76640 1 --2- 10.20.193.48:0/396201619 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd22005e490 0x7fd2201a5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21ed76640 10 monclient(hunting): get_auth_request con 0x7fd22005e490 auth_method 0 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21ed76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21e575640 1 --2- 10.20.193.48:0/396201619 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22005c950 0x7fd22008d390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21e575640 10 monclient(hunting): get_auth_request con 0x7fd22005c950 auth_method 0 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21e575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21dd74640 10 monclient(hunting): handle_auth_done global_id 4443 payload 824 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21dd74640 1 -- 10.20.193.48:0/396201619 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd22005e490 msgr2=0x7fd2201a5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21dd74640 1 --2- 10.20.193.48:0/396201619 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd22005e490 0x7fd2201a5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21dd74640 1 -- 10.20.193.48:0/396201619 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22005c950 msgr2=0x7fd22008d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21dd74640 1 --2- 10.20.193.48:0/396201619 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22005c950 0x7fd22008d390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21dd74640 10 monclient: _finish_hunting 0 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21dd74640 1 monclient: found mon.noname-d 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21dd74640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21dd74640 1 -- 10.20.193.48:0/396201619 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd208009420 con 0x7fd22005d430 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.684+0000 7fd21e575640 1 --2- 10.20.193.48:0/396201619 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22005c950 0x7fd22008d390 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.686+0000 7fd21dd74640 1 -- 10.20.193.48:0/396201619 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd22005d430 msgr2=0x7fd2201a55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.686+0000 7fd21dd74640 1 --2- 10.20.193.48:0/396201619 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd22005d430 0x7fd2201a55b0 secure :-1 s=READY pgs=54 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd208009750 tx=0x7fd208004770 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.686+0000 7fd206ffd640 1 -- 10.20.193.48:0/396201619 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd208035950 con 0x7fd22005d430 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.686+0000 7fd206ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.686+0000 7fd206ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.686+0000 7fd206ffd640 10 monclient: dump: 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.691 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.686+0000 7fd206ffd640 10 monclient: _finish_auth 0 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.686+0000 7fd206ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.686+0000 7fd206ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.686+0000 7fd206ffd640 1 -- 10.20.193.48:0/396201619 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd20802fdb0 con 0x7fd22005d430 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.686+0000 7fd224a52640 5 monclient: authenticate success, global_id 4443 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.686+0000 7fd224a52640 10 monclient: _renew_subs 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.686+0000 7fd224a52640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.686+0000 7fd224a52640 1 -- 10.20.193.48:0/396201619 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd22008a590 con 0x7fd22005d430 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.686+0000 7fd206ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.686+0000 7fd206ffd640 1 -- 10.20.193.48:0/396201619 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd208004500 con 0x7fd22005d430 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.686+0000 7fd206ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.686+0000 7fd206ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.686+0000 7fd21cd72640 4 set_mon_vals no callback set 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.686+0000 7fd206ffd640 10 monclient: dump: 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.692 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.693 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.693 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.686+0000 7fd224a52640 10 monclient: _renew_subs 2026-02-12T18:06:16.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.686+0000 7fd224a52640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:06:16.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.686+0000 7fd224a52640 1 -- 10.20.193.48:0/396201619 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fd220142890 con 0x7fd22005d430 2026-02-12T18:06:16.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.687+0000 7fd224a52640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:16.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.687+0000 7fd224a52640 1 --2- 10.20.193.48:0/396201619 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22008d8d0 0x7fd22008bbe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.687+0000 7fd224a52640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.687+0000 7fd224a52640 1 -- 10.20.193.48:0/396201619 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd22005f140 con 0x7fd22008d8d0 2026-02-12T18:06:16.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.687+0000 7fd21e575640 1 --2- 10.20.193.48:0/396201619 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22008d8d0 0x7fd22008bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.687+0000 7fd206ffd640 1 -- 10.20.193.48:0/396201619 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fd208004040 con 0x7fd22005d430 2026-02-12T18:06:16.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.687+0000 7fd21e575640 10 monclient: get_auth_request con 0x7fd22008d8d0 auth_method 0 2026-02-12T18:06:16.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.687+0000 7fd21e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.687+0000 7fd21e575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.687+0000 7fd21e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.687+0000 7fd206ffd640 1 --2- 10.20.193.48:0/396201619 >> v2:10.20.193.111:6812/977811348 conn(0x7fd1ec03f800 0x7fd1ec05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.687+0000 7fd206ffd640 1 -- 10.20.193.48:0/396201619 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(19..19 src has 1..19) ==== 3531+0+0 (secure 0 0 0) 0x7fd208077fe0 con 0x7fd22005d430 2026-02-12T18:06:16.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.687+0000 7fd21e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.687+0000 7fd21e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.687+0000 7fd21e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.687+0000 7fd21ed76640 1 --2- 10.20.193.48:0/396201619 >> v2:10.20.193.111:6812/977811348 conn(0x7fd1ec03f800 0x7fd1ec05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.687+0000 7fd21ed76640 10 monclient: get_auth_request con 0x7fd1ec03f800 auth_method 0 2026-02-12T18:06:16.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.688+0000 7fd21e575640 10 monclient(hunting): handle_auth_done global_id 4404 payload 824 2026-02-12T18:06:16.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.688+0000 7fd21e575640 1 -- 10.20.193.48:0/396201619 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd22008b440 con 0x7fd22008d8d0 2026-02-12T18:06:16.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.690+0000 7fd21ed76640 1 --2- 10.20.193.48:0/396201619 >> v2:10.20.193.111:6812/977811348 conn(0x7fd1ec03f800 0x7fd1ec05fcb0 secure :-1 s=READY pgs=75 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd210005820 tx=0x7fd210009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.690+0000 7fd21e575640 1 -- 10.20.193.48:0/396201619 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22008d8d0 msgr2=0x7fd22008bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.690+0000 7fd21e575640 1 --2- 10.20.193.48:0/396201619 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22008d8d0 0x7fd22008bbe0 secure :-1 s=READY pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd21400e700 tx=0x7fd21400ebd0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.690+0000 7fd206ffd640 1 -- 10.20.193.48:0/396201619 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd21400cbf0 con 0x7fd22008d8d0 2026-02-12T18:06:16.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.690+0000 7fd206ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.690+0000 7fd206ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:06:16.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.690+0000 7fd206ffd640 10 monclient: dump: 2026-02-12T18:06:16.694 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.694 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.694 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.694 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.694 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.694 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.694 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.694 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.694 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.695 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.695 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.695 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.695 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.695 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.695 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.695 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.690+0000 7fd206ffd640 1 -- 10.20.193.48:0/396201619 <== mon.3 v2:10.20.193.111:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fd21400cd50 con 0x7fd22008d8d0 2026-02-12T18:06:16.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.690+0000 7fd206ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:16.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.690+0000 7fd206ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:16.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.690+0000 7fd206ffd640 1 -- 10.20.193.48:0/396201619 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22008d8d0 msgr2=0x7fd22008bbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.690+0000 7fd206ffd640 1 --2- 10.20.193.48:0/396201619 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22008d8d0 0x7fd22008bbe0 secure :-1 s=READY pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd21400e700 tx=0x7fd21400ebd0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.690+0000 7fd206ffd640 1 -- 10.20.193.48:0/396201619 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22008d8d0 msgr2=0x7fd22008bbe0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:16.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.690+0000 7fd206ffd640 1 --2- 10.20.193.48:0/396201619 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22008d8d0 0x7fd22008bbe0 secure :-1 s=CLOSED pgs=35 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd21400e700 tx=0x7fd21400ebd0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.694+0000 7fd224a52640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:06:16.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.694+0000 7fd224a52640 1 --2- 10.20.193.48:0/396201619 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22013dda0 0x7fd22013e1a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.694+0000 7fd224a52640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.694+0000 7fd224a52640 1 -- 10.20.193.48:0/396201619 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd22005fd90 con 0x7fd22013dda0 2026-02-12T18:06:16.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.694+0000 7fd21e575640 1 --2- 10.20.193.48:0/396201619 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22013dda0 0x7fd22013e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.694+0000 7fd21e575640 10 monclient: get_auth_request con 0x7fd22013dda0 auth_method 0 2026-02-12T18:06:16.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.694+0000 7fd21e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.694+0000 7fd21e575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.694+0000 7fd21e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.694+0000 7fd21e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.694+0000 7fd21e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.694+0000 7fd21e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.694+0000 7fd21e575640 10 monclient(hunting): handle_auth_done global_id 4413 payload 824 2026-02-12T18:06:16.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.694+0000 7fd21e575640 1 -- 10.20.193.48:0/396201619 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd22005cd20 con 0x7fd22013dda0 2026-02-12T18:06:16.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.697+0000 7fd21e575640 1 -- 10.20.193.48:0/396201619 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22013dda0 msgr2=0x7fd22013e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.697+0000 7fd21e575640 1 --2- 10.20.193.48:0/396201619 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22013dda0 0x7fd22013e1a0 secure :-1 s=READY pgs=36 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd214014000 tx=0x7fd214004a00 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.697+0000 7fd206ffd640 1 -- 10.20.193.48:0/396201619 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd214022070 con 0x7fd22013dda0 2026-02-12T18:06:16.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.697+0000 7fd206ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.697+0000 7fd206ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:06:16.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.697+0000 7fd206ffd640 10 monclient: dump: 2026-02-12T18:06:16.698 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.698 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.698 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.698 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.698 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.698 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.698 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.698 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.698 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.698 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.699 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.699 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.699 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.699 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.699 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.699 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.697+0000 7fd206ffd640 1 -- 10.20.193.48:0/396201619 <== mon.3 v2:10.20.193.111:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10015 (secure 0 0 0) 0x7fd21401d690 con 0x7fd22013dda0 2026-02-12T18:06:16.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.697+0000 7fd206ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:06:16.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.697+0000 7fd206ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:16.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.697+0000 7fd206ffd640 1 -- 10.20.193.48:0/396201619 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22013dda0 msgr2=0x7fd22013e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.697+0000 7fd206ffd640 1 --2- 10.20.193.48:0/396201619 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22013dda0 0x7fd22013e1a0 secure :-1 s=READY pgs=36 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd214014000 tx=0x7fd214004a00 comp rx=0 tx=0).stop 2026-02-12T18:06:16.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.697+0000 7fd206ffd640 1 -- 10.20.193.48:0/396201619 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22013dda0 msgr2=0x7fd22013e1a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:16.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.697+0000 7fd206ffd640 1 --2- 10.20.193.48:0/396201619 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd22013dda0 0x7fd22013e1a0 secure :-1 s=CLOSED pgs=36 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd214014000 tx=0x7fd214004a00 comp rx=0 tx=0).stop 2026-02-12T18:06:16.699 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:06:16.699 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:06:16.699 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:06:16.699 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:06:16.699 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 12, 2026-02-12T18:06:16.699 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 31493, 2026-02-12T18:06:16.700 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:06:16.700 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:06:16.700 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:06:16.700 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:06:16.700 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:06:16.700 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:06:16.700 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:06:16.700 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:06:16.700 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:06:16.700 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:06:16.700 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.700 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 19, 2026-02-12T18:06:16.700 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:16.700 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:06:16.700 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:06:16.700 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.700 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.700 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.700 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.700 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.700 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.700 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.700 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.700 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.701 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.701 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.701 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.701 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.701 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.701 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:06:16.701 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:06:16.701 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.701 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.701 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.701 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.701 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.701 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.701 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.701 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.701 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.701 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.701 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.701 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.701 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.701 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.701 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.701 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:06:16.701 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:06:16.702 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:06:16.702 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:06:16.702 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:06:16.702 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:06:16.702 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:16.702 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:16.702 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:06:16.702 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:06:16.702 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:06:16.702 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:06:16.702 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:06:16.702 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:06:16.702 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:06:16.702 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:16.702 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:06:16.702 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.702 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.702 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.702 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.702 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.702 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.702 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.702 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.702 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.702 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.703 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.703 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.703 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.703 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.703 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:06:16.703 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.703 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:06:16.703 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.703 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:06:16.703 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:06:16.703 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.703 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.703 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.703 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.703 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:06:16.703 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.703 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.703 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.703 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.703 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:06:16.703 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.703 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.703 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.703 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.703 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:06:16.704 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:06:16.704 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.704 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.704 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:06:16.704 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.704 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.704 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.704 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:06:16.704 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:06:16.704 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.704 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.704 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.704 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.704 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:06:16.704 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.704 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.704 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.704 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.704 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:06:16.704 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.704 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.704 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.704 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.704 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:06:16.705 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:06:16.705 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.705 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.705 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:06:16.705 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.705 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.705 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.705 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:06:16.705 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:06:16.705 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.705 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.705 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.705 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.705 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:06:16.705 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.705 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.705 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.705 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.705 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:06:16.705 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.705 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.705 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.705 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.705 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:06:16.705 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:06:16.706 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.706 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.706 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:06:16.706 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.706 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.706 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.706 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:06:16.706 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:06:16.706 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.706 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.706 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.706 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.706 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:06:16.706 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.706 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.706 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.706 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.706 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:06:16.706 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.706 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.706 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.706 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.706 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:06:16.706 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:06:16.707 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.707 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.707 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:06:16.707 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.707 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.707 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.707 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:06:16.707 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:06:16.707 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.707 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.707 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.707 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.707 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:06:16.707 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.707 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.707 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.707 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.707 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:06:16.707 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.707 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.707 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.707 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.707 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:06:16.707 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:06:16.707 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.708 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.708 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:16.708 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.708 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.708 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.708 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:06:16.708 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:06:16.708 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.708 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.708 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.708 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.708 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:06:16.708 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.708 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.708 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.708 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.708 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:06:16.708 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.708 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.708 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.708 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.708 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:06:16.708 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:06:16.708 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.708 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.709 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:06:16.709 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.709 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.709 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.709 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:06:16.709 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:06:16.709 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.709 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.709 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.709 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.709 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:06:16.709 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.709 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.709 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.709 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.709 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:06:16.709 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.709 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.709 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.709 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.709 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:06:16.709 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:06:16.709 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.709 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.710 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:16.710 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.710 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.710 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.710 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:06:16.710 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:06:16.710 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.710 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.710 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.710 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.710 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:06:16.710 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.710 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.710 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.710 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.710 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:06:16.710 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.710 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.710 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.710 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.710 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:06:16.710 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:06:16.710 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.710 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.711 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:06:16.711 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.711 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.711 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.711 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:06:16.711 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:06:16.711 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.711 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.711 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.711 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.711 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:06:16.711 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.711 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.711 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.711 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.711 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:06:16.711 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.711 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.711 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.711 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.711 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:06:16.711 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:06:16.711 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.711 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.711 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:06:16.711 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.712 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.712 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.712 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.712 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:06:16.712 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:06:16.712 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.712 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:16.712 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:16.712 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:16.712 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.712 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.712 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:06:16.712 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.712 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:16.712 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:16.712 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:06:16.712 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.712 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.712 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.712 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:06:16.712 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:06:16.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.698+0000 7fd224a52640 1 -- 10.20.193.48:0/396201619 >> v2:10.20.193.111:6812/977811348 conn(0x7fd1ec03f800 msgr2=0x7fd1ec05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.698+0000 7fd224a52640 1 --2- 10.20.193.48:0/396201619 >> v2:10.20.193.111:6812/977811348 conn(0x7fd1ec03f800 0x7fd1ec05fcb0 secure :-1 s=READY pgs=75 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd210005820 tx=0x7fd210009040 comp rx=0 tx=0).stop 2026-02-12T18:06:16.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.698+0000 7fd224a52640 10 monclient: shutdown 2026-02-12T18:06:16.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.698+0000 7fd21ed76640 1 -- 10.20.193.48:0/396201619 reap_dead start 2026-02-12T18:06:16.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.698+0000 7fd224a52640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:16.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.698+0000 7fd224a52640 1 -- 10.20.193.48:0/396201619 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd22005d430 msgr2=0x7fd2201a55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.698+0000 7fd224a52640 1 --2- 10.20.193.48:0/396201619 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd22005d430 0x7fd2201a55b0 secure :-1 s=READY pgs=54 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd208009750 tx=0x7fd208004770 comp rx=0 tx=0).stop 2026-02-12T18:06:16.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.698+0000 7fd224a52640 1 -- 10.20.193.48:0/396201619 shutdown_connections 2026-02-12T18:06:16.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.698+0000 7fd224a52640 1 --2- 10.20.193.48:0/396201619 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd22005d430 0x7fd2201a55b0 unknown :-1 s=CLOSED pgs=54 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.698+0000 7fd224a52640 1 -- 10.20.193.48:0/396201619 >> 10.20.193.48:0/396201619 conn(0x7fd2200548a0 msgr2=0x7fd220093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:16.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.698+0000 7fd224a52640 1 -- 10.20.193.48:0/396201619 shutdown_connections 2026-02-12T18:06:16.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.698+0000 7fd224a52640 1 -- 10.20.193.48:0/396201619 wait complete. 2026-02-12T18:06:16.714 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:06:16.714 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2026-02-12T18:06:16.714 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2026-02-12T18:06:16.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.780+0000 7f639f25b640 10 monclient: get_monmap_and_config 2026-02-12T18:06:16.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.780+0000 7f639f25b640 10 monclient: build_initial_monmap 2026-02-12T18:06:16.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.780+0000 7f639f25b640 10 monclient: monmap: 2026-02-12T18:06:16.781 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:16.781 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.781 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:16.781298+0000 2026-02-12T18:06:16.781 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:16.781298+0000 2026-02-12T18:06:16.781 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:16.781 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.781 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:16.781 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:16.781 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:16.781 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:16.781 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:16.781 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:16.781 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:16.781 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:16.781 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:16.781 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:16.781 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:16.781 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.780+0000 7f639f25b640 1 Processor -- start 2026-02-12T18:06:16.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.780+0000 7f639f25b640 1 -- start start 2026-02-12T18:06:16.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.780+0000 7f639f25b640 10 monclient: init 2026-02-12T18:06:16.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639f25b640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:16.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639f25b640 10 monclient: _add_conns ranks=[0,3,5,2,10,4,9,6,7,1,8] 2026-02-12T18:06:16.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639f25b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6398090140 addr v1:10.20.193.48:6789/0 2026-02-12T18:06:16.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639f25b640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6398144270 0x7f63981855f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639f25b640 10 monclient(hunting): picked mon.noname-g con 0x7f6398144270 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:16.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639f25b640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6398144680 0x7f63981a5b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639f25b640 10 monclient(hunting): picked mon.noname-h con 0x7f6398144680 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:16.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639f25b640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f639804dc20 con 0x7f6398090140 2026-02-12T18:06:16.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639f25b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639f25b640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f63981451d0 con 0x7f6398144270 2026-02-12T18:06:16.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639f25b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639f25b640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f6398054f00 con 0x7f6398144680 2026-02-12T18:06:16.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639f25b640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:16.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639f25b640 10 monclient(hunting): authenticate will time out at 615.507140s 2026-02-12T18:06:16.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639cfd0640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f6398090140 0x7f6398090510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:34452/0 (socket says 10.20.193.48:34452) 2026-02-12T18:06:16.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639cfd0640 1 -- 10.20.193.48:0/566154439 learned_addr learned my addr 10.20.193.48:0/566154439 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:06:16.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f638ffff640 1 --2- 10.20.193.48:0/566154439 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6398144270 0x7f63981855f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639d7d1640 1 --2- 10.20.193.48:0/566154439 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6398144680 0x7f63981a5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f638ffff640 10 monclient(hunting): get_auth_request con 0x7f6398144270 auth_method 0 2026-02-12T18:06:16.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f638ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f638ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f638ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639d7d1640 10 monclient(hunting): get_auth_request con 0x7f6398144680 auth_method 0 2026-02-12T18:06:16.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639d7d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639d7d1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639d7d1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639d7d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639d7d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639d7d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f638ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f638ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f638ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639d7d1640 10 monclient(hunting): handle_auth_done global_id 4442 payload 274 2026-02-12T18:06:16.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639d7d1640 1 -- 10.20.193.48:0/566154439 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6398144270 msgr2=0x7f63981855f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:16.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639d7d1640 1 --2- 10.20.193.48:0/566154439 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6398144270 0x7f63981855f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639d7d1640 1 -- 10.20.193.48:0/566154439 >> v1:10.20.193.48:6789/0 conn(0x7f6398090140 legacy=0x7f6398090510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:16.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639d7d1640 10 monclient: _finish_hunting 0 2026-02-12T18:06:16.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639d7d1640 1 monclient: found mon.noname-h 2026-02-12T18:06:16.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639d7d1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:16.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639d7d1640 10 monclient: _send_mon_message to mon.noname-h at v2:10.20.193.111:3302/0 2026-02-12T18:06:16.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.781+0000 7f639d7d1640 1 -- 10.20.193.48:0/566154439 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f639808ac30 con 0x7f6398144680 2026-02-12T18:06:16.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f639d7d1640 1 -- 10.20.193.48:0/566154439 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6398144680 msgr2=0x7f63981a5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f639d7d1640 1 --2- 10.20.193.48:0/566154439 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6398144680 0x7f63981a5b40 secure :-1 s=READY pgs=45 gs=2 cs=0 l=1 c_cookie=6173773819324481859 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f639400a8e0 tx=0x7f639402fe20 comp rx=0 tx=0).ready entity=mon.5 client_cookie=55ada69420714143 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f638f7fe640 1 -- 10.20.193.48:0/566154439 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6394036340 con 0x7f6398144680 2026-02-12T18:06:16.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f638f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f638f7fe640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2026-02-12T18:06:16.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f638f7fe640 10 monclient: dump: 2026-02-12T18:06:16.787 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.787 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.787 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.787 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.787 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.787 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.787 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.787 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.787 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.788 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.788 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.788 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.788 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.788 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.788 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.788 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f638f7fe640 10 monclient: _finish_auth 0 2026-02-12T18:06:16.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f638f7fe640 10 monclient: _check_auth_tickets 2026-02-12T18:06:16.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f638f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:16.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f638f7fe640 1 -- 10.20.193.48:0/566154439 <== mon.5 v2:10.20.193.111:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63940364c0 con 0x7f6398144680 2026-02-12T18:06:16.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f639f25b640 5 monclient: authenticate success, global_id 4442 2026-02-12T18:06:16.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f639f25b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:16.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f638f7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:16.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f638f7fe640 1 -- 10.20.193.48:0/566154439 <== mon.5 v2:10.20.193.111:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6394036af0 con 0x7f6398144680 2026-02-12T18:06:16.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f639f25b640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:16.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f639f25b640 4 set_mon_vals no callback set 2026-02-12T18:06:16.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f638f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f638f7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:06:16.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f638f7fe640 10 monclient: dump: 2026-02-12T18:06:16.788 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.788 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.788 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.788 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.789 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.789 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.789 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.789 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.789 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.789 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.789 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.789 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.789 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.789 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.789 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.789 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f639f25b640 10 monclient: shutdown 2026-02-12T18:06:16.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f639f25b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:16.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f639f25b640 1 -- 10.20.193.48:0/566154439 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6398144680 msgr2=0x7f63981a5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f639f25b640 1 --2- 10.20.193.48:0/566154439 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6398144680 0x7f63981a5b40 secure :-1 s=READY pgs=45 gs=2 cs=0 l=1 c_cookie=6173773819324481859 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f639400a8e0 tx=0x7f639402fe20 comp rx=0 tx=0).stop 2026-02-12T18:06:16.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f639f25b640 1 -- 10.20.193.48:0/566154439 shutdown_connections 2026-02-12T18:06:16.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f639f25b640 1 --2- 10.20.193.48:0/566154439 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6398144680 0x7f63981a5b40 unknown :-1 s=CLOSED pgs=45 gs=2 cs=0 l=1 c_cookie=6173773819324481859 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f639f25b640 1 --2- 10.20.193.48:0/566154439 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6398144270 0x7f63981855f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f639f25b640 1 -- 10.20.193.48:0/566154439 >> 10.20.193.48:0/566154439 conn(0x7f6398094e80 msgr2=0x7f6398090c90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:16.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f639f25b640 1 -- 10.20.193.48:0/566154439 shutdown_connections 2026-02-12T18:06:16.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.784+0000 7f639f25b640 1 -- 10.20.193.48:0/566154439 wait complete. 2026-02-12T18:06:16.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639f25b640 10 monclient: build_initial_monmap 2026-02-12T18:06:16.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639f25b640 10 monclient: monmap: 2026-02-12T18:06:16.790 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:16.790 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:16.790 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:16.790 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:16.790 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:16.790 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.790 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:16.790 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:16.790 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:16.790 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:16.790 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:16.790 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:16.790 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:16.790 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:16.790 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:16.790 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639f25b640 1 Processor -- start 2026-02-12T18:06:16.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639f25b640 1 -- start start 2026-02-12T18:06:16.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639f25b640 10 monclient: init 2026-02-12T18:06:16.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639f25b640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:16.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639f25b640 10 monclient: _add_conns ranks=[8,1,3,7,5,2,0,4,6] 2026-02-12T18:06:16.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639f25b640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6398090140 0x7f639810f3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639f25b640 10 monclient(hunting): picked mon.noname-e con 0x7f6398090140 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:16.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639f25b640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f6398144270 0x7f63981a5340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639f25b640 10 monclient(hunting): picked mon.noname-f con 0x7f6398144270 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:06:16.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639f25b640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6398144680 0x7f63981a5880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639f25b640 10 monclient(hunting): picked mon.noname-g con 0x7f6398144680 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:16.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639f25b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639f25b640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f639810e650 con 0x7f6398144270 2026-02-12T18:06:16.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639f25b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639f25b640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f639810cb90 con 0x7f6398144680 2026-02-12T18:06:16.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639f25b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639f25b640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f6398090920 con 0x7f6398090140 2026-02-12T18:06:16.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639f25b640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:16.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639f25b640 10 monclient(hunting): authenticate will time out at 615.511692s 2026-02-12T18:06:16.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639cfd0640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6398090140 0x7f639810f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639cfd0640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6398090140 0x7f639810f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:53284/0 (socket says 10.20.193.48:53284) 2026-02-12T18:06:16.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639cfd0640 1 -- 10.20.193.48:0/3729513519 learned_addr learned my addr 10.20.193.48:0/3729513519 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:16.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639cfd0640 10 monclient(hunting): get_auth_request con 0x7f6398090140 auth_method 0 2026-02-12T18:06:16.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639cfd0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639cfd0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639cfd0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639d7d1640 1 --2- 10.20.193.48:0/3729513519 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6398144680 0x7f63981a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639cfd0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639cfd0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639cfd0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639d7d1640 10 monclient(hunting): get_auth_request con 0x7f6398144680 auth_method 0 2026-02-12T18:06:16.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639d7d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639d7d1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639d7d1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f638ffff640 1 --2- 10.20.193.48:0/3729513519 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f6398144270 0x7f63981a5340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f638ffff640 10 monclient(hunting): get_auth_request con 0x7f6398144270 auth_method 0 2026-02-12T18:06:16.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f638ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f638ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f638ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639d7d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639d7d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.785+0000 7f639d7d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.786+0000 7f638ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.786+0000 7f638ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.786+0000 7f638ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.786+0000 7f639cfd0640 10 monclient(hunting): handle_auth_done global_id 4490 payload 824 2026-02-12T18:06:16.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.786+0000 7f639cfd0640 1 -- 10.20.193.48:0/3729513519 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6398144680 msgr2=0x7f63981a5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.786+0000 7f639cfd0640 1 --2- 10.20.193.48:0/3729513519 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6398144680 0x7f63981a5880 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.786+0000 7f639cfd0640 1 -- 10.20.193.48:0/3729513519 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f6398144270 msgr2=0x7f63981a5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.786+0000 7f639cfd0640 1 --2- 10.20.193.48:0/3729513519 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f6398144270 0x7f63981a5340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.786+0000 7f639cfd0640 10 monclient: _finish_hunting 0 2026-02-12T18:06:16.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.786+0000 7f639cfd0640 1 monclient: found mon.noname-e 2026-02-12T18:06:16.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.786+0000 7f639cfd0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:16.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.786+0000 7f639cfd0640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:06:16.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.786+0000 7f639cfd0640 1 -- 10.20.193.48:0/3729513519 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f639400a500 con 0x7f6398090140 2026-02-12T18:06:16.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f639cfd0640 1 -- 10.20.193.48:0/3729513519 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6398090140 msgr2=0x7f639810f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f639cfd0640 1 --2- 10.20.193.48:0/3729513519 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6398090140 0x7f639810f3f0 secure :-1 s=READY pgs=47 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f638800c4d0 tx=0x7f638800c9a0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f638d7fa640 1 -- 10.20.193.48:0/3729513519 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6388005db0 con 0x7f6398090140 2026-02-12T18:06:16.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f638d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f638d7fa640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:06:16.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f638d7fa640 10 monclient: dump: 2026-02-12T18:06:16.795 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.795 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.795 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.795 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.795 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.795 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.795 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.795 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.795 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.795 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.795 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.795 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.795 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.795 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.795 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.795 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f638d7fa640 10 monclient: _finish_auth 0 2026-02-12T18:06:16.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f638d7fa640 10 monclient: _check_auth_tickets 2026-02-12T18:06:16.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f638d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:16.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f639f25b640 5 monclient: authenticate success, global_id 4490 2026-02-12T18:06:16.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f638d7fa640 1 -- 10.20.193.48:0/3729513519 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6388007530 con 0x7f6398090140 2026-02-12T18:06:16.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f638d7fa640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:16.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f638d7fa640 1 -- 10.20.193.48:0/3729513519 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f63880076a0 con 0x7f6398090140 2026-02-12T18:06:16.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f638d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f638effd640 4 set_mon_vals no callback set 2026-02-12T18:06:16.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f638d7fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:06:16.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f638d7fa640 10 monclient: dump: 2026-02-12T18:06:16.796 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.796 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.796 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.796 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.796 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.796 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.796 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.796 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.796 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.796 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.796 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.796 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.796 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.796 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.796 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.796 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f639f25b640 10 monclient: _renew_subs 2026-02-12T18:06:16.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f639f25b640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:16.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f639f25b640 1 -- 10.20.193.48:0/3729513519 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f639810e080 con 0x7f6398090140 2026-02-12T18:06:16.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f639f25b640 10 monclient: _renew_subs 2026-02-12T18:06:16.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f639f25b640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:16.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f639f25b640 1 -- 10.20.193.48:0/3729513519 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f63981a5dc0 con 0x7f6398090140 2026-02-12T18:06:16.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f639f25b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:16.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f639f25b640 1 --2- 10.20.193.48:0/3729513519 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f639812e430 0x7f639810b270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f639f25b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.788+0000 7f639f25b640 1 -- 10.20.193.48:0/3729513519 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f63980632e0 con 0x7f639812e430 2026-02-12T18:06:16.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.789+0000 7f638d7fa640 1 -- 10.20.193.48:0/3729513519 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f6388007070 con 0x7f6398090140 2026-02-12T18:06:16.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.789+0000 7f638ffff640 1 --2- 10.20.193.48:0/3729513519 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f639812e430 0x7f639810b270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.789+0000 7f638ffff640 10 monclient: get_auth_request con 0x7f639812e430 auth_method 0 2026-02-12T18:06:16.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.789+0000 7f638ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.789+0000 7f638ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.789+0000 7f638ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.789+0000 7f638ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.789+0000 7f638ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.789+0000 7f638ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.789+0000 7f638d7fa640 1 --2- 10.20.193.48:0/3729513519 >> v2:10.20.193.111:6812/977811348 conn(0x7f636803f7f0 0x7f636805fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.789+0000 7f638d7fa640 1 -- 10.20.193.48:0/3729513519 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(20..20 src has 1..20) ==== 3897+0+0 (secure 0 0 0) 0x7f6388052050 con 0x7f6398090140 2026-02-12T18:06:16.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.789+0000 7f639d7d1640 1 --2- 10.20.193.48:0/3729513519 >> v2:10.20.193.111:6812/977811348 conn(0x7f636803f7f0 0x7f636805fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.789+0000 7f639d7d1640 10 monclient: get_auth_request con 0x7f636803f7f0 auth_method 0 2026-02-12T18:06:16.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.789+0000 7f638ffff640 10 monclient(hunting): handle_auth_done global_id 4451 payload 824 2026-02-12T18:06:16.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.789+0000 7f638ffff640 1 -- 10.20.193.48:0/3729513519 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f63980545f0 con 0x7f639812e430 2026-02-12T18:06:16.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.791+0000 7f638ffff640 1 -- 10.20.193.48:0/3729513519 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f639812e430 msgr2=0x7f639810b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.791+0000 7f638ffff640 1 --2- 10.20.193.48:0/3729513519 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f639812e430 0x7f639810b270 secure :-1 s=READY pgs=46 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f639808e850 tx=0x7f6380011e40 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.791+0000 7f639d7d1640 1 --2- 10.20.193.48:0/3729513519 >> v2:10.20.193.111:6812/977811348 conn(0x7f636803f7f0 0x7f636805fca0 secure :-1 s=READY pgs=76 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f639402fe60 tx=0x7f639403a040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.791+0000 7f638d7fa640 1 -- 10.20.193.48:0/3729513519 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f638000fec0 con 0x7f639812e430 2026-02-12T18:06:16.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.791+0000 7f638d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.791+0000 7f638d7fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:06:16.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.791+0000 7f638d7fa640 10 monclient: dump: 2026-02-12T18:06:16.798 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.798 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.798 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.798 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.798 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.798 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.798 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.798 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.798 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.798 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.798 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.798 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.798 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.798 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.798 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.798 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.792+0000 7f638d7fa640 1 -- 10.20.193.48:0/3729513519 <== mon.5 v2:10.20.193.111:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f6380014440 con 0x7f639812e430 2026-02-12T18:06:16.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.792+0000 7f638d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:16.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.792+0000 7f638d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:16.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.792+0000 7f638d7fa640 1 -- 10.20.193.48:0/3729513519 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f639812e430 msgr2=0x7f639810b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.792+0000 7f638d7fa640 1 --2- 10.20.193.48:0/3729513519 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f639812e430 0x7f639810b270 secure :-1 s=READY pgs=46 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f639808e850 tx=0x7f6380011e40 comp rx=0 tx=0).stop 2026-02-12T18:06:16.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.792+0000 7f638d7fa640 1 -- 10.20.193.48:0/3729513519 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f639812e430 msgr2=0x7f639810b270 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:16.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.792+0000 7f638d7fa640 1 --2- 10.20.193.48:0/3729513519 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f639812e430 0x7f639810b270 secure :-1 s=CLOSED pgs=46 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f639808e850 tx=0x7f6380011e40 comp rx=0 tx=0).stop 2026-02-12T18:06:16.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.795+0000 7f639f25b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:06:16.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.795+0000 7f639f25b640 1 --2- 10.20.193.48:0/3729513519 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f639812e800 0x7f639810b7b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.795+0000 7f639f25b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.795+0000 7f639f25b640 1 -- 10.20.193.48:0/3729513519 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f6398050410 con 0x7f639812e800 2026-02-12T18:06:16.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.795+0000 7f638ffff640 1 --2- 10.20.193.48:0/3729513519 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f639812e800 0x7f639810b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.795+0000 7f638ffff640 10 monclient: get_auth_request con 0x7f639812e800 auth_method 0 2026-02-12T18:06:16.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.795+0000 7f638ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.795+0000 7f638ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.795+0000 7f638ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.795+0000 7f638ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.795+0000 7f638ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.795+0000 7f638ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.796+0000 7f638ffff640 10 monclient(hunting): handle_auth_done global_id 4460 payload 824 2026-02-12T18:06:16.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.796+0000 7f638ffff640 1 -- 10.20.193.48:0/3729513519 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6398054b60 con 0x7f639812e800 2026-02-12T18:06:16.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.798+0000 7f638ffff640 1 -- 10.20.193.48:0/3729513519 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f639812e800 msgr2=0x7f639810b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.798+0000 7f638ffff640 1 --2- 10.20.193.48:0/3729513519 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f639812e800 0x7f639810b7b0 secure :-1 s=READY pgs=47 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6380019000 tx=0x7f6380004770 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.798+0000 7f638d7fa640 1 -- 10.20.193.48:0/3729513519 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6380022890 con 0x7f639812e800 2026-02-12T18:06:16.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.798+0000 7f638d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.798+0000 7f638d7fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:06:16.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.798+0000 7f638d7fa640 10 monclient: dump: 2026-02-12T18:06:16.801 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.801 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.801 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.801 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.801 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.801 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.801 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.801 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.801 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.801 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.801 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.801 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.801 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.801 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.801 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.801 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.798+0000 7f638d7fa640 1 -- 10.20.193.48:0/3729513519 <== mon.5 v2:10.20.193.111:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10182 (secure 0 0 0) 0x7f6380003030 con 0x7f639812e800 2026-02-12T18:06:16.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.798+0000 7f638d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:06:16.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.798+0000 7f638d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:16.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.798+0000 7f638d7fa640 1 -- 10.20.193.48:0/3729513519 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f639812e800 msgr2=0x7f639810b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.798+0000 7f638d7fa640 1 --2- 10.20.193.48:0/3729513519 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f639812e800 0x7f639810b7b0 secure :-1 s=READY pgs=47 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6380019000 tx=0x7f6380004770 comp rx=0 tx=0).stop 2026-02-12T18:06:16.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.798+0000 7f638d7fa640 1 -- 10.20.193.48:0/3729513519 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f639812e800 msgr2=0x7f639810b7b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:16.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.798+0000 7f638d7fa640 1 --2- 10.20.193.48:0/3729513519 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f639812e800 0x7f639810b7b0 secure :-1 s=CLOSED pgs=47 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6380019000 tx=0x7f6380004770 comp rx=0 tx=0).stop 2026-02-12T18:06:16.802 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:06:16.802 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:06:16.802 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:06:16.802 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:06:16.802 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 12, 2026-02-12T18:06:16.802 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 31592, 2026-02-12T18:06:16.802 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:06:16.802 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:06:16.802 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:06:16.802 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:06:16.802 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:06:16.802 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:06:16.802 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:06:16.802 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:06:16.802 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:06:16.802 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:06:16.802 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.802 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 19, 2026-02-12T18:06:16.802 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:16.802 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:06:16.803 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:06:16.803 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.803 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.803 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.803 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.803 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.803 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.803 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.803 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.803 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.803 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.803 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.803 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.803 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.803 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.803 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:06:16.803 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:06:16.803 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.803 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.803 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.803 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.803 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.803 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.803 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.803 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.804 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.804 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.804 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.804 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.804 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.804 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.804 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.804 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:06:16.804 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:06:16.804 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:06:16.804 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:06:16.804 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:06:16.804 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:06:16.804 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:16.804 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:16.804 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:06:16.804 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:06:16.804 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:06:16.804 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:06:16.804 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:06:16.804 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:06:16.804 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:06:16.804 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:16.804 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:06:16.804 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.805 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.805 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.805 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.805 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.805 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.805 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.805 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.805 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.805 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.805 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.805 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.805 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.805 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.805 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:06:16.805 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.805 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:06:16.805 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.805 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:06:16.805 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:06:16.805 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.805 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.805 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.805 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.805 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:06:16.806 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.806 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.806 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.806 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.806 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:06:16.806 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.806 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.806 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.806 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.806 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:06:16.806 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:06:16.806 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.806 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.806 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:06:16.806 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.806 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.806 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.806 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:06:16.806 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:06:16.806 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.806 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.806 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.806 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.806 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:06:16.806 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.807 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.807 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.807 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.807 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:06:16.807 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.807 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.807 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.807 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.807 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:06:16.807 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:06:16.807 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.807 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.807 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:06:16.807 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.807 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.807 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.807 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:06:16.807 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:06:16.807 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.807 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.807 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.807 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.807 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:06:16.807 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.807 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.808 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.808 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.808 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:06:16.808 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.808 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.808 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.808 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.808 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:06:16.808 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:06:16.808 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.808 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.808 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:06:16.808 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.808 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.808 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.808 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:06:16.808 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:06:16.808 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.808 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.808 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.808 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.808 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:06:16.808 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.808 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.808 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.809 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.809 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:06:16.809 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.809 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.809 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.809 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.809 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:06:16.809 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:06:16.809 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.809 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.809 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:06:16.809 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.809 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.809 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.809 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:06:16.809 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:06:16.809 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.809 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.809 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.809 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.809 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:06:16.809 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.809 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.809 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.809 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.810 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:06:16.810 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.810 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.810 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.810 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.810 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:06:16.810 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:06:16.810 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.810 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.810 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:16.810 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.810 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.810 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.810 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:06:16.810 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:06:16.810 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.810 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.810 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.810 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.810 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:06:16.810 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.810 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.810 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.810 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.810 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.811 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.812 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.812 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:06:16.812 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:06:16.812 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.812 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.812 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:16.812 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.812 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.812 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.812 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:06:16.812 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:06:16.812 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.812 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.812 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.812 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.812 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:06:16.812 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.812 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.812 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.812 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.812 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:06:16.812 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.812 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.812 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.812 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.812 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.813 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.814 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:06:16.814 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.814 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.814 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.814 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.814 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:06:16.814 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:06:16.814 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.814 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:16.814 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:16.814 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:16.814 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.814 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.814 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:06:16.814 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.814 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:16.814 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:16.814 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:06:16.814 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.814 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.814 INFO:teuthology.orchestra.run.trial048.stdout: "mgr": [ 2026-02-12T18:06:16.814 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.814 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:16.814 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:16.814 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:16.814 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.815 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.815 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.815 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:06:16.815 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:06:16.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.798+0000 7f639f25b640 1 -- 10.20.193.48:0/3729513519 >> v2:10.20.193.111:6812/977811348 conn(0x7f636803f7f0 msgr2=0x7f636805fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.798+0000 7f639f25b640 1 --2- 10.20.193.48:0/3729513519 >> v2:10.20.193.111:6812/977811348 conn(0x7f636803f7f0 0x7f636805fca0 secure :-1 s=READY pgs=76 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f639402fe60 tx=0x7f639403a040 comp rx=0 tx=0).stop 2026-02-12T18:06:16.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.798+0000 7f639f25b640 10 monclient: shutdown 2026-02-12T18:06:16.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.798+0000 7f639f25b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:16.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.798+0000 7f639f25b640 1 -- 10.20.193.48:0/3729513519 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6398090140 msgr2=0x7f639810f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.798+0000 7f639f25b640 1 --2- 10.20.193.48:0/3729513519 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6398090140 0x7f639810f3f0 secure :-1 s=READY pgs=47 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f638800c4d0 tx=0x7f638800c9a0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.798+0000 7f639d7d1640 1 -- 10.20.193.48:0/3729513519 reap_dead start 2026-02-12T18:06:16.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.798+0000 7f639d7d1640 1 -- 10.20.193.48:0/3729513519 reap_dead start 2026-02-12T18:06:16.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.799+0000 7f639f25b640 1 -- 10.20.193.48:0/3729513519 shutdown_connections 2026-02-12T18:06:16.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.799+0000 7f639f25b640 1 -- 10.20.193.48:0/3729513519 >> 10.20.193.48:0/3729513519 conn(0x7f6398094e80 msgr2=0x7f639813ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:16.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.799+0000 7f639f25b640 1 -- 10.20.193.48:0/3729513519 shutdown_connections 2026-02-12T18:06:16.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.799+0000 7f639f25b640 1 -- 10.20.193.48:0/3729513519 wait complete. 2026-02-12T18:06:16.816 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:06:16.816 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2026-02-12T18:06:16.816 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2026-02-12T18:06:16.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.881+0000 7f57e05a5640 10 monclient: get_monmap_and_config 2026-02-12T18:06:16.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.881+0000 7f57e05a5640 10 monclient: build_initial_monmap 2026-02-12T18:06:16.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.881+0000 7f57e05a5640 10 monclient: monmap: 2026-02-12T18:06:16.882 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:16.882 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.882 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:16.882715+0000 2026-02-12T18:06:16.882 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:16.882715+0000 2026-02-12T18:06:16.882 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:16.882 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.882 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:16.882 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:16.882 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:16.882 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:16.882 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:16.882 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:16.882 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:16.882 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:16.882 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:16.882 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:16.882 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:16.882 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57e05a5640 1 Processor -- start 2026-02-12T18:06:16.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57e05a5640 1 -- start start 2026-02-12T18:06:16.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57e05a5640 10 monclient: init 2026-02-12T18:06:16.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57e05a5640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:16.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57e05a5640 10 monclient: _add_conns ranks=[2,3,6,10,9,7,0,8,1,5,4] 2026-02-12T18:06:16.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57e05a5640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f57d805c950 0x7f57d805cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57e05a5640 10 monclient(hunting): picked mon.noname-b con 0x7f57d805c950 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:16.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57e05a5640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f57d805e490 0x7f57d805d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57e05a5640 10 monclient(hunting): picked mon.noname-g con 0x7f57d805e490 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:16.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57e05a5640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f57d813db70 0x7f57d813dfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57e05a5640 10 monclient(hunting): picked mon.noname-d con 0x7f57d813db70 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:06:16.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57e05a5640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57e05a5640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f57d805ddd0 con 0x7f57d805c950 2026-02-12T18:06:16.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57e05a5640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57e05a5640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f57d805d7a0 con 0x7f57d805e490 2026-02-12T18:06:16.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57e05a5640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57e05a5640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f57d8092990 con 0x7f57d813db70 2026-02-12T18:06:16.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57e05a5640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:16.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57e05a5640 10 monclient(hunting): authenticate will time out at 615.608446s 2026-02-12T18:06:16.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57deb1b640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f57d813db70 0x7f57d813dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57de31a640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f57d805c950 0x7f57d805cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57deb1b640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f57d813db70 0x7f57d813dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:36114/0 (socket says 10.20.193.48:36114) 2026-02-12T18:06:16.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57deb1b640 1 -- 10.20.193.48:0/1800438202 learned_addr learned my addr 10.20.193.48:0/1800438202 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:16.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57deb1b640 10 monclient(hunting): get_auth_request con 0x7f57d813db70 auth_method 0 2026-02-12T18:06:16.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57deb1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57deb1b640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57deb1b640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57de31a640 10 monclient(hunting): get_auth_request con 0x7f57d805c950 auth_method 0 2026-02-12T18:06:16.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57de31a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57de31a640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57de31a640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57ddb19640 1 --2- 10.20.193.48:0/1800438202 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f57d805e490 0x7f57d805d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57de31a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57de31a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57de31a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57deb1b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57deb1b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57deb1b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57ddb19640 10 monclient(hunting): get_auth_request con 0x7f57d805e490 auth_method 0 2026-02-12T18:06:16.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57ddb19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57ddb19640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57ddb19640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57de31a640 10 monclient(hunting): handle_auth_done global_id 34346 payload 274 2026-02-12T18:06:16.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57de31a640 1 -- 10.20.193.48:0/1800438202 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f57d813db70 msgr2=0x7f57d813dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:16.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57de31a640 1 --2- 10.20.193.48:0/1800438202 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f57d813db70 0x7f57d813dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57de31a640 1 -- 10.20.193.48:0/1800438202 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f57d805e490 msgr2=0x7f57d805d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:16.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57de31a640 1 --2- 10.20.193.48:0/1800438202 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f57d805e490 0x7f57d805d260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57de31a640 10 monclient: _finish_hunting 0 2026-02-12T18:06:16.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57de31a640 1 monclient: found mon.noname-b 2026-02-12T18:06:16.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57de31a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:16.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57de31a640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:06:16.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.882+0000 7f57de31a640 1 -- 10.20.193.48:0/1800438202 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57d804dc20 con 0x7f57d805c950 2026-02-12T18:06:16.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57de31a640 1 -- 10.20.193.48:0/1800438202 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f57d805c950 msgr2=0x7f57d805cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57de31a640 1 --2- 10.20.193.48:0/1800438202 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f57d805c950 0x7f57d805cd20 secure :-1 s=READY pgs=39 gs=1 cs=0 l=1 c_cookie=14942142020106693425 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57c8009800 tx=0x7f57c802ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf5d27001be5ab31 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57dd318640 1 -- 10.20.193.48:0/1800438202 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f57c802fe90 con 0x7f57d805c950 2026-02-12T18:06:16.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57dd318640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57dd318640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:06:16.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57dd318640 10 monclient: dump: 2026-02-12T18:06:16.889 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.889 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.889 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.889 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.889 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.889 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.889 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.889 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.889 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.889 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.889 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.889 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.889 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.889 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.889 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.889 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57dd318640 10 monclient: _finish_auth 0 2026-02-12T18:06:16.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57dd318640 10 monclient: _check_auth_tickets 2026-02-12T18:06:16.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57dd318640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:16.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57dd318640 1 -- 10.20.193.48:0/1800438202 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57c8035340 con 0x7f57d805c950 2026-02-12T18:06:16.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57e05a5640 5 monclient: authenticate success, global_id 34346 2026-02-12T18:06:16.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57e05a5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:16.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57dd318640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:16.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57dd318640 1 -- 10.20.193.48:0/1800438202 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f57c8035970 con 0x7f57d805c950 2026-02-12T18:06:16.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57e05a5640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:16.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57e05a5640 4 set_mon_vals no callback set 2026-02-12T18:06:16.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57dd318640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57dd318640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:06:16.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57dd318640 10 monclient: dump: 2026-02-12T18:06:16.890 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.890 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.890 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.890 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.890 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.890 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.890 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.890 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.890 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.890 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.890 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.890 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.890 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.890 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.890 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.890 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57e05a5640 10 monclient: shutdown 2026-02-12T18:06:16.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57e05a5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:16.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57e05a5640 1 -- 10.20.193.48:0/1800438202 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f57d805c950 msgr2=0x7f57d805cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57e05a5640 1 --2- 10.20.193.48:0/1800438202 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f57d805c950 0x7f57d805cd20 secure :-1 s=READY pgs=39 gs=1 cs=0 l=1 c_cookie=14942142020106693425 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57c8009800 tx=0x7f57c802ed50 comp rx=0 tx=0).stop 2026-02-12T18:06:16.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57e05a5640 1 -- 10.20.193.48:0/1800438202 shutdown_connections 2026-02-12T18:06:16.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57e05a5640 1 --2- 10.20.193.48:0/1800438202 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f57d813db70 0x7f57d813dfc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57e05a5640 1 --2- 10.20.193.48:0/1800438202 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f57d805e490 0x7f57d805d260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57e05a5640 1 --2- 10.20.193.48:0/1800438202 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f57d805c950 0x7f57d805cd20 unknown :-1 s=CLOSED pgs=39 gs=1 cs=0 l=1 c_cookie=14942142020106693425 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57e05a5640 1 -- 10.20.193.48:0/1800438202 >> 10.20.193.48:0/1800438202 conn(0x7f57d80548a0 msgr2=0x7f57d8097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:16.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57e05a5640 1 -- 10.20.193.48:0/1800438202 shutdown_connections 2026-02-12T18:06:16.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.885+0000 7f57e05a5640 1 -- 10.20.193.48:0/1800438202 wait complete. 2026-02-12T18:06:16.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57e05a5640 10 monclient: build_initial_monmap 2026-02-12T18:06:16.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57e05a5640 10 monclient: monmap: 2026-02-12T18:06:16.891 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:16.891 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:16.891 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:16.891 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:16.891 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:16.891 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.891 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:16.891 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:16.891 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:16.891 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:16.891 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:16.891 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:16.892 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:16.892 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:16.892 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:16.892 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57e05a5640 1 Processor -- start 2026-02-12T18:06:16.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57e05a5640 1 -- start start 2026-02-12T18:06:16.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57e05a5640 10 monclient: init 2026-02-12T18:06:16.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57e05a5640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:16.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57e05a5640 10 monclient: _add_conns ranks=[6,3,1,0,8,7,2,4,5] 2026-02-12T18:06:16.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57e05a5640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f57d805c950 0x7f57d81db730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57e05a5640 10 monclient(hunting): picked mon.noname-d con 0x7f57d805c950 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:06:16.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57e05a5640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f57d805e490 0x7f57d81dbc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57e05a5640 10 monclient(hunting): picked mon.noname-g con 0x7f57d805e490 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:16.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57e05a5640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f57d813db70 0x7f57d808a980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57e05a5640 10 monclient(hunting): picked mon.noname-f con 0x7f57d813db70 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:06:16.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57e05a5640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57e05a5640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f57d813d400 con 0x7f57d813db70 2026-02-12T18:06:16.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57e05a5640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57e05a5640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f57d813e7c0 con 0x7f57d805e490 2026-02-12T18:06:16.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57e05a5640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57e05a5640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f57d813e470 con 0x7f57d805c950 2026-02-12T18:06:16.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57e05a5640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:16.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57e05a5640 10 monclient(hunting): authenticate will time out at 615.612840s 2026-02-12T18:06:16.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57de31a640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f57d805c950 0x7f57d81db730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57de31a640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f57d805c950 0x7f57d81db730 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:36130/0 (socket says 10.20.193.48:36130) 2026-02-12T18:06:16.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57de31a640 1 -- 10.20.193.48:0/961300342 learned_addr learned my addr 10.20.193.48:0/961300342 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:16.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57de31a640 10 monclient(hunting): get_auth_request con 0x7f57d805c950 auth_method 0 2026-02-12T18:06:16.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57de31a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57de31a640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57de31a640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57de31a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.886+0000 7f57de31a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.887+0000 7f57de31a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.887+0000 7f57ddb19640 1 --2- 10.20.193.48:0/961300342 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f57d805e490 0x7f57d81dbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.887+0000 7f57ddb19640 10 monclient(hunting): get_auth_request con 0x7f57d805e490 auth_method 0 2026-02-12T18:06:16.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.887+0000 7f57ddb19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.887+0000 7f57ddb19640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.887+0000 7f57ddb19640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.887+0000 7f57deb1b640 1 --2- 10.20.193.48:0/961300342 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f57d813db70 0x7f57d808a980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.887+0000 7f57deb1b640 10 monclient(hunting): get_auth_request con 0x7f57d813db70 auth_method 0 2026-02-12T18:06:16.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.887+0000 7f57deb1b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.887+0000 7f57deb1b640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.887+0000 7f57deb1b640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.887+0000 7f57ddb19640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.887+0000 7f57ddb19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.887+0000 7f57ddb19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.887+0000 7f57de31a640 10 monclient(hunting): handle_auth_done global_id 4461 payload 824 2026-02-12T18:06:16.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.887+0000 7f57de31a640 1 -- 10.20.193.48:0/961300342 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f57d805e490 msgr2=0x7f57d81dbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.887+0000 7f57de31a640 1 --2- 10.20.193.48:0/961300342 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f57d805e490 0x7f57d81dbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.887+0000 7f57de31a640 1 -- 10.20.193.48:0/961300342 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f57d813db70 msgr2=0x7f57d808a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.887+0000 7f57de31a640 1 --2- 10.20.193.48:0/961300342 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f57d813db70 0x7f57d808a980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.887+0000 7f57de31a640 10 monclient: _finish_hunting 0 2026-02-12T18:06:16.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.887+0000 7f57de31a640 1 monclient: found mon.noname-d 2026-02-12T18:06:16.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.887+0000 7f57de31a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:16.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.887+0000 7f57de31a640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:06:16.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.887+0000 7f57de31a640 1 -- 10.20.193.48:0/961300342 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57c8009420 con 0x7f57d805c950 2026-02-12T18:06:16.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.889+0000 7f57de31a640 1 -- 10.20.193.48:0/961300342 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f57d805c950 msgr2=0x7f57d81db730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.889+0000 7f57de31a640 1 --2- 10.20.193.48:0/961300342 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f57d805c950 0x7f57d81db730 secure :-1 s=READY pgs=55 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57c8009900 tx=0x7f57c80047e0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.889+0000 7f57beffd640 1 -- 10.20.193.48:0/961300342 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f57c80044f0 con 0x7f57d805c950 2026-02-12T18:06:16.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.889+0000 7f57beffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.889+0000 7f57beffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:06:16.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.889+0000 7f57beffd640 10 monclient: dump: 2026-02-12T18:06:16.896 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.896 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.896 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.896 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.896 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.896 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.896 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.896 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.896 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.896 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.896 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.896 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.896 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.896 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.896 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.896 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.889+0000 7f57beffd640 10 monclient: _finish_auth 0 2026-02-12T18:06:16.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.889+0000 7f57beffd640 10 monclient: _check_auth_tickets 2026-02-12T18:06:16.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.889+0000 7f57beffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:16.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.889+0000 7f57e05a5640 5 monclient: authenticate success, global_id 4461 2026-02-12T18:06:16.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.889+0000 7f57beffd640 1 -- 10.20.193.48:0/961300342 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f57c8035cc0 con 0x7f57d805c950 2026-02-12T18:06:16.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.889+0000 7f57e05a5640 10 monclient: _renew_subs 2026-02-12T18:06:16.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.889+0000 7f57e05a5640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:06:16.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.889+0000 7f57e05a5640 1 -- 10.20.193.48:0/961300342 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57d8143b20 con 0x7f57d805c950 2026-02-12T18:06:16.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.889+0000 7f57beffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:16.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.889+0000 7f57beffd640 1 -- 10.20.193.48:0/961300342 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f57c8035e30 con 0x7f57d805c950 2026-02-12T18:06:16.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.889+0000 7f57beffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.889+0000 7f57dcb17640 4 set_mon_vals no callback set 2026-02-12T18:06:16.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.889+0000 7f57beffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:06:16.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.889+0000 7f57beffd640 10 monclient: dump: 2026-02-12T18:06:16.897 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.897 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.897 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.897 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.897 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.897 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.897 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.897 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.897 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.897 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.897 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.898 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.898 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.898 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.898 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.898 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.889+0000 7f57e05a5640 10 monclient: _renew_subs 2026-02-12T18:06:16.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.889+0000 7f57e05a5640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:06:16.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.889+0000 7f57e05a5640 1 -- 10.20.193.48:0/961300342 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f57d812e2d0 con 0x7f57d805c950 2026-02-12T18:06:16.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.890+0000 7f57e05a5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:16.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.890+0000 7f57e05a5640 1 --2- 10.20.193.48:0/961300342 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f57d808aec0 0x7f57d808b290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.890+0000 7f57e05a5640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.890+0000 7f57e05a5640 1 -- 10.20.193.48:0/961300342 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f57d8063180 con 0x7f57d808aec0 2026-02-12T18:06:16.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.890+0000 7f57de31a640 1 --2- 10.20.193.48:0/961300342 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f57d805c950 0x7f57d81db730 secure :-1 s=READY pgs=55 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57c8009900 tx=0x7f57c80047e0 comp rx=0 tx=0).queue_received will delay after 1.77092e+09 on 0x7f57c80778b0 osd_map(20..20 src has 1..20) 2026-02-12T18:06:16.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.890+0000 7f57beffd640 1 -- 10.20.193.48:0/961300342 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f57c8004030 con 0x7f57d805c950 2026-02-12T18:06:16.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.890+0000 7f57ddb19640 1 --2- 10.20.193.48:0/961300342 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f57d808aec0 0x7f57d808b290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.890+0000 7f57ddb19640 10 monclient: get_auth_request con 0x7f57d808aec0 auth_method 0 2026-02-12T18:06:16.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.890+0000 7f57ddb19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.890+0000 7f57ddb19640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.890+0000 7f57ddb19640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.890+0000 7f57beffd640 1 --2- 10.20.193.48:0/961300342 >> v2:10.20.193.111:6812/977811348 conn(0x7f57a803f7f0 0x7f57a805fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.890+0000 7f57ddb19640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.890+0000 7f57ddb19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.890+0000 7f57ddb19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.890+0000 7f57deb1b640 1 --2- 10.20.193.48:0/961300342 >> v2:10.20.193.111:6812/977811348 conn(0x7f57a803f7f0 0x7f57a805fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.890+0000 7f57deb1b640 10 monclient: get_auth_request con 0x7f57a803f7f0 auth_method 0 2026-02-12T18:06:16.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.890+0000 7f57ddb19640 10 monclient(hunting): handle_auth_done global_id 4480 payload 824 2026-02-12T18:06:16.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.890+0000 7f57ddb19640 1 -- 10.20.193.48:0/961300342 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f57d8097de0 con 0x7f57d808aec0 2026-02-12T18:06:16.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.893+0000 7f57deb1b640 1 --2- 10.20.193.48:0/961300342 >> v2:10.20.193.111:6812/977811348 conn(0x7f57a803f7f0 0x7f57a805fca0 secure :-1 s=READY pgs=77 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57d80982a0 tx=0x7f57d4009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.893+0000 7f57ddb19640 1 -- 10.20.193.48:0/961300342 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f57d808aec0 msgr2=0x7f57d808b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.893+0000 7f57ddb19640 1 --2- 10.20.193.48:0/961300342 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f57d808aec0 0x7f57d808b290 secure :-1 s=READY pgs=42 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57d808c9a0 tx=0x7f57cc011ca0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.893+0000 7f57beffd640 1 -- 10.20.193.48:0/961300342 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f57cc00c070 con 0x7f57d808aec0 2026-02-12T18:06:16.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.893+0000 7f57beffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.893+0000 7f57beffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:06:16.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.893+0000 7f57beffd640 10 monclient: dump: 2026-02-12T18:06:16.899 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.899 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.899 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.899 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.899 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.899 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.899 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.899 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.899 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.899 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.899 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.899 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.899 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.899 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.899 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.900 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.893+0000 7f57beffd640 1 -- 10.20.193.48:0/961300342 <== mon.7 v2:10.20.193.111:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f57cc00fa10 con 0x7f57d808aec0 2026-02-12T18:06:16.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.893+0000 7f57beffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:16.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.893+0000 7f57beffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:16.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.893+0000 7f57beffd640 1 -- 10.20.193.48:0/961300342 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f57d808aec0 msgr2=0x7f57d808b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.893+0000 7f57beffd640 1 --2- 10.20.193.48:0/961300342 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f57d808aec0 0x7f57d808b290 secure :-1 s=READY pgs=42 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57d808c9a0 tx=0x7f57cc011ca0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.893+0000 7f57beffd640 1 -- 10.20.193.48:0/961300342 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f57d808aec0 msgr2=0x7f57d808b290 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:16.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.893+0000 7f57beffd640 1 --2- 10.20.193.48:0/961300342 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f57d808aec0 0x7f57d808b290 secure :-1 s=CLOSED pgs=42 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57d808c9a0 tx=0x7f57cc011ca0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.897+0000 7f57e05a5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:06:16.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.897+0000 7f57e05a5640 1 --2- 10.20.193.48:0/961300342 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f57d808b7d0 0x7f57d813ec80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:16.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.897+0000 7f57e05a5640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:16.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.897+0000 7f57e05a5640 1 -- 10.20.193.48:0/961300342 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f57d805f140 con 0x7f57d808b7d0 2026-02-12T18:06:16.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.897+0000 7f57ddb19640 1 --2- 10.20.193.48:0/961300342 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f57d808b7d0 0x7f57d813ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:16.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.897+0000 7f57ddb19640 10 monclient: get_auth_request con 0x7f57d808b7d0 auth_method 0 2026-02-12T18:06:16.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.897+0000 7f57ddb19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:16.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.897+0000 7f57ddb19640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:16.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.897+0000 7f57ddb19640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:16.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.897+0000 7f57ddb19640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:16.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.897+0000 7f57ddb19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:16.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.897+0000 7f57ddb19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:16.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.897+0000 7f57ddb19640 10 monclient(hunting): handle_auth_done global_id 4489 payload 824 2026-02-12T18:06:16.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.897+0000 7f57ddb19640 1 -- 10.20.193.48:0/961300342 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f57d805cd20 con 0x7f57d808b7d0 2026-02-12T18:06:16.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.900+0000 7f57ddb19640 1 -- 10.20.193.48:0/961300342 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f57d808b7d0 msgr2=0x7f57d813ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:16.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.900+0000 7f57ddb19640 1 --2- 10.20.193.48:0/961300342 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f57d808b7d0 0x7f57d813ec80 secure :-1 s=READY pgs=43 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57cc011ce0 tx=0x7f57cc004770 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:16.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.900+0000 7f57beffd640 1 -- 10.20.193.48:0/961300342 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f57cc015460 con 0x7f57d808b7d0 2026-02-12T18:06:16.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.900+0000 7f57beffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:16.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.900+0000 7f57beffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:06:16.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.900+0000 7f57beffd640 10 monclient: dump: 2026-02-12T18:06:16.902 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:16.902 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:16.902 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.902 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:16.902 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:16.902 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:16.902 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:16.902 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:16.902 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:16.902 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:16.902 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:16.902 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:16.902 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:16.902 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:16.902 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:16.902 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:16.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.900+0000 7f57beffd640 1 -- 10.20.193.48:0/961300342 <== mon.7 v2:10.20.193.111:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10182 (secure 0 0 0) 0x7f57cc003af0 con 0x7f57d808b7d0 2026-02-12T18:06:16.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.900+0000 7f57beffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:06:16.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.900+0000 7f57beffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:16.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.900+0000 7f57beffd640 1 -- 10.20.193.48:0/961300342 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f57d808b7d0 msgr2=0x7f57d813ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.900+0000 7f57beffd640 1 --2- 10.20.193.48:0/961300342 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f57d808b7d0 0x7f57d813ec80 secure :-1 s=READY pgs=43 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57cc011ce0 tx=0x7f57cc004770 comp rx=0 tx=0).stop 2026-02-12T18:06:16.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.900+0000 7f57beffd640 1 -- 10.20.193.48:0/961300342 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f57d808b7d0 msgr2=0x7f57d813ec80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:16.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.900+0000 7f57beffd640 1 --2- 10.20.193.48:0/961300342 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f57d808b7d0 0x7f57d813ec80 secure :-1 s=CLOSED pgs=43 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57cc011ce0 tx=0x7f57cc004770 comp rx=0 tx=0).stop 2026-02-12T18:06:16.903 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:06:16.903 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:06:16.903 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:06:16.903 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:06:16.903 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 12, 2026-02-12T18:06:16.903 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 31689, 2026-02-12T18:06:16.903 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:06:16.903 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:06:16.903 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:06:16.903 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:06:16.903 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:06:16.903 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:06:16.903 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:06:16.903 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:06:16.903 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:06:16.903 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:06:16.903 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.904 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 19, 2026-02-12T18:06:16.904 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:16.904 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:06:16.904 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:06:16.904 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.904 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.904 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.904 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.904 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.904 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.904 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.904 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.904 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.904 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.904 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.904 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.904 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.904 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.904 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:06:16.904 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:06:16.904 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.904 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.904 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.905 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.905 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.905 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.905 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.905 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.905 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.905 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.905 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.905 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.905 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.905 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.905 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.905 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:06:16.905 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:06:16.905 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:06:16.905 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:06:16.905 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:06:16.905 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:06:16.905 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:16.905 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:16.905 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:06:16.905 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:06:16.905 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:06:16.905 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:06:16.906 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:06:16.906 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:06:16.906 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:06:16.906 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:16.906 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:06:16.906 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:16.906 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:16.906 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:16.906 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:16.906 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:16.906 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:16.906 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:16.906 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:16.906 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:16.906 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:16.906 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:16.906 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:16.906 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:16.906 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.906 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:06:16.906 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.906 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:06:16.906 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.906 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:06:16.906 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:06:16.907 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.907 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.907 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.907 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.907 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:06:16.907 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.907 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.907 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.907 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.907 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:06:16.907 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.907 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.907 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.907 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.907 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:06:16.907 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:06:16.907 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.907 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.907 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:06:16.907 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.907 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.907 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.907 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:06:16.907 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:06:16.908 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.908 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.908 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.908 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.908 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:06:16.908 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.908 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.908 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.908 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.908 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:06:16.908 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.908 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.908 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.908 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.908 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:06:16.908 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:06:16.908 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.908 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.908 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:06:16.908 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.908 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.908 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.908 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:06:16.908 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:06:16.908 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.909 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.909 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.909 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.909 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:06:16.909 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.909 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.909 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.909 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.909 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:06:16.909 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.909 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.909 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.909 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.909 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:06:16.909 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:06:16.909 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.909 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.909 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:06:16.909 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.909 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.909 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.909 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:06:16.909 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:06:16.909 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.909 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.910 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.910 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.910 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:06:16.910 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.910 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.910 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.910 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.910 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:06:16.910 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.910 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.910 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.910 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.910 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:06:16.910 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:06:16.910 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.910 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.910 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:06:16.910 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.910 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.910 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.910 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:06:16.910 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:06:16.910 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.910 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.910 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.911 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.911 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:06:16.911 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.911 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.911 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.911 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.911 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:06:16.911 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.911 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.911 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.911 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.911 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:06:16.911 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:06:16.911 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.911 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.911 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:16.911 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.911 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.911 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.911 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:06:16.911 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:06:16.911 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.911 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.911 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.911 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.912 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:06:16.912 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.912 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.912 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.912 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.912 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:06:16.912 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.912 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.912 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.912 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.912 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:06:16.912 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:06:16.912 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.912 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.912 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:06:16.912 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.912 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.912 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.912 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:06:16.912 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:06:16.912 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.912 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.912 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.912 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.912 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:06:16.913 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.913 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.913 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.913 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.913 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:06:16.913 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.913 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.913 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.913 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.913 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:06:16.913 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:06:16.913 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.913 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.913 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:16.913 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.913 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.913 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.913 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:06:16.913 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:06:16.913 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.913 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.913 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.913 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.913 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:06:16.913 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.913 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:16.914 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:16.915 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.916 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:16.916 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:06:16.916 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:16.916 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:16.916 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:16.916 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:06:16.916 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:16.916 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:16.916 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:16.916 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:06:16.916 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:06:16.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.900+0000 7f57e05a5640 1 -- 10.20.193.48:0/961300342 >> v2:10.20.193.111:6812/977811348 conn(0x7f57a803f7f0 msgr2=0x7f57a805fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.900+0000 7f57e05a5640 1 --2- 10.20.193.48:0/961300342 >> v2:10.20.193.111:6812/977811348 conn(0x7f57a803f7f0 0x7f57a805fca0 secure :-1 s=READY pgs=77 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57d80982a0 tx=0x7f57d4009040 comp rx=0 tx=0).stop 2026-02-12T18:06:16.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.900+0000 7f57e05a5640 10 monclient: shutdown 2026-02-12T18:06:16.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.900+0000 7f57e05a5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:16.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.900+0000 7f57e05a5640 1 -- 10.20.193.48:0/961300342 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f57d805c950 msgr2=0x7f57d81db730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:16.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.900+0000 7f57deb1b640 1 -- 10.20.193.48:0/961300342 reap_dead start 2026-02-12T18:06:16.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.900+0000 7f57e05a5640 1 --2- 10.20.193.48:0/961300342 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f57d805c950 0x7f57d81db730 secure :-1 s=READY pgs=55 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f57c8009900 tx=0x7f57c80047e0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.900+0000 7f57beffd640 1 -- 10.20.193.48:0/961300342 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(20..20 src has 1..20) ==== 3897+0+0 (unknown 0 0 0) 0x7f57c80778b0 con 0x7f57d805c950 2026-02-12T18:06:16.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.900+0000 7f57e05a5640 1 -- 10.20.193.48:0/961300342 shutdown_connections 2026-02-12T18:06:16.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.900+0000 7f57e05a5640 1 --2- 10.20.193.48:0/961300342 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f57d805c950 0x7f57d81db730 unknown :-1 s=CLOSED pgs=55 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:16.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.900+0000 7f57e05a5640 1 -- 10.20.193.48:0/961300342 >> 10.20.193.48:0/961300342 conn(0x7f57d80548a0 msgr2=0x7f57d8091210 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:16.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.900+0000 7f57e05a5640 1 -- 10.20.193.48:0/961300342 shutdown_connections 2026-02-12T18:06:16.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:16.900+0000 7f57e05a5640 1 -- 10.20.193.48:0/961300342 wait complete. 2026-02-12T18:06:16.918 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:06:16.918 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c', 'i'] 2026-02-12T18:06:16.918 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['b', 'd'] 2026-02-12T18:06:16.918 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-12T18:06:16.918 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-12T18:06:16.918 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-12T18:06:16.918 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:06:16.926 INFO:tasks.ceph.mon.c:Stopped 2026-02-12T18:06:16.927 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.i 2026-02-12T18:06:16.927 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.i store 2026-02-12T18:06:16.927 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i sync_force --yes-i-really-mean-it 2026-02-12T18:06:17.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.032+0000 7f6d94d7e640 10 monclient: get_monmap_and_config 2026-02-12T18:06:17.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.032+0000 7f6d94d7e640 10 monclient: build_initial_monmap 2026-02-12T18:06:17.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.032+0000 7f6d94d7e640 10 monclient: monmap: 2026-02-12T18:06:17.033 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:17.033 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:17.033 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:17.033563+0000 2026-02-12T18:06:17.033 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:17.033563+0000 2026-02-12T18:06:17.033 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:17.033 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:17.033 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:17.033 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:17.033 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:17.034 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:17.034 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:17.034 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:17.034 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:17.034 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:17.034 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:17.034 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:17.034 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:17.034 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:17.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.032+0000 7f6d94d7e640 1 Processor -- start 2026-02-12T18:06:17.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.032+0000 7f6d94d7e640 1 -- start start 2026-02-12T18:06:17.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.032+0000 7f6d94d7e640 10 monclient: init 2026-02-12T18:06:17.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d94d7e640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:17.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d94d7e640 10 monclient: _add_conns ranks=[3,10,7,8,0,9,5,4,2,1,6] 2026-02-12T18:06:17.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d94d7e640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6d900914d0 0x7f6d9005c950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:17.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d94d7e640 10 monclient(hunting): picked mon.noname-g con 0x7f6d900914d0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:17.045 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d94d7e640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f6d9008e210 0x7f6d9005ce90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:17.045 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d94d7e640 10 monclient(hunting): picked mon.noname-f con 0x7f6d9008e210 addr v2:10.20.193.111:3300/0 2026-02-12T18:06:17.045 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d94d7e640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d9005e4b0 0x7f6d9005d3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:17.045 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d94d7e640 10 monclient(hunting): picked mon.noname-i con 0x7f6d9005e4b0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:17.045 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d94d7e640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:17.045 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d94d7e640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f6d90093d70 con 0x7f6d9008e210 2026-02-12T18:06:17.045 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d94d7e640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:17.045 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d94d7e640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6d90092f90 con 0x7f6d900914d0 2026-02-12T18:06:17.045 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d94d7e640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:17.045 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d94d7e640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f6d900918a0 con 0x7f6d9005e4b0 2026-02-12T18:06:17.045 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d94d7e640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:17.045 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d94d7e640 10 monclient(hunting): authenticate will time out at 615.759418s 2026-02-12T18:06:17.045 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8ed76640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d9005e4b0 0x7f6d9005d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:17.046 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8dd74640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f6d9008e210 0x7f6d9005ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:17.046 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8ed76640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d9005e4b0 0x7f6d9005d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3303/0 says I am v2:10.20.193.48:42538/0 (socket says 10.20.193.48:42538) 2026-02-12T18:06:17.046 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8ed76640 1 -- 10.20.193.48:0/2147585510 learned_addr learned my addr 10.20.193.48:0/2147585510 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:17.046 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8ed76640 10 monclient(hunting): get_auth_request con 0x7f6d9005e4b0 auth_method 0 2026-02-12T18:06:17.046 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:17.046 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8ed76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:17.046 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:17.046 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8dd74640 10 monclient(hunting): get_auth_request con 0x7f6d9008e210 auth_method 0 2026-02-12T18:06:17.046 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:17.046 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8dd74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:17.046 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:17.046 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8e575640 1 --2- 10.20.193.48:0/2147585510 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6d900914d0 0x7f6d9005c950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:17.047 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8e575640 10 monclient(hunting): get_auth_request con 0x7f6d900914d0 auth_method 0 2026-02-12T18:06:17.047 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:17.047 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8e575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:17.047 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:17.047 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:17.047 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:17.047 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:17.047 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:17.047 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:17.047 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:17.047 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:17.047 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:17.047 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:17.047 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8ed76640 10 monclient(hunting): handle_auth_done global_id 4498 payload 274 2026-02-12T18:06:17.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8ed76640 1 -- 10.20.193.48:0/2147585510 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6d900914d0 msgr2=0x7f6d9005c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:17.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8ed76640 1 --2- 10.20.193.48:0/2147585510 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6d900914d0 0x7f6d9005c950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:17.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8ed76640 1 -- 10.20.193.48:0/2147585510 >> v2:10.20.193.111:3300/0 conn(0x7f6d9008e210 msgr2=0x7f6d9005ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:17.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8ed76640 1 --2- 10.20.193.48:0/2147585510 >> v2:10.20.193.111:3300/0 conn(0x7f6d9008e210 0x7f6d9005ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:17.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8ed76640 10 monclient: _finish_hunting 0 2026-02-12T18:06:17.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8ed76640 1 monclient: found mon.noname-i 2026-02-12T18:06:17.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8ed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:17.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8ed76640 10 monclient: _send_mon_message to mon.noname-i at v2:10.20.193.111:3303/0 2026-02-12T18:06:17.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.033+0000 7f6d8ed76640 1 -- 10.20.193.48:0/2147585510 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d9004dc20 con 0x7f6d9005e4b0 2026-02-12T18:06:17.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.036+0000 7f6d8ed76640 1 -- 10.20.193.48:0/2147585510 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d9005e4b0 msgr2=0x7f6d9005d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:17.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.036+0000 7f6d8ed76640 1 --2- 10.20.193.48:0/2147585510 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d9005e4b0 0x7f6d9005d3d0 secure :-1 s=READY pgs=44 gs=1 cs=0 l=1 c_cookie=6309069614219973036 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d8000a140 tx=0x7f6d8002fed0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=578e516322cad1ac server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:17.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.036+0000 7f6d8d573640 1 -- 10.20.193.48:0/2147585510 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6d80030b50 con 0x7f6d9005e4b0 2026-02-12T18:06:17.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.036+0000 7f6d8d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:17.049 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.036+0000 7f6d8d573640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2026-02-12T18:06:17.049 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.036+0000 7f6d8d573640 10 monclient: dump: 2026-02-12T18:06:17.049 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:17.049 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:17.049 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:17.049 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:17.049 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:17.049 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:17.049 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:17.049 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:17.049 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:17.049 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:17.049 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:17.050 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:17.050 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:17.050 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:17.050 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:17.050 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:17.050 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.036+0000 7f6d8d573640 10 monclient: _finish_auth 0 2026-02-12T18:06:17.050 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.036+0000 7f6d8d573640 10 monclient: _check_auth_tickets 2026-02-12T18:06:17.050 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.036+0000 7f6d8d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:17.050 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.036+0000 7f6d94d7e640 5 monclient: authenticate success, global_id 4498 2026-02-12T18:06:17.050 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.036+0000 7f6d8d573640 1 -- 10.20.193.48:0/2147585510 <== mon.7 v2:10.20.193.111:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d80030cd0 con 0x7f6d9005e4b0 2026-02-12T18:06:17.050 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.036+0000 7f6d8d573640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:17.050 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.036+0000 7f6d94d7e640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:17.050 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.036+0000 7f6d94d7e640 4 set_mon_vals no callback set 2026-02-12T18:06:17.051 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.036+0000 7f6d8d573640 1 -- 10.20.193.48:0/2147585510 <== mon.7 v2:10.20.193.111:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6d80030e40 con 0x7f6d9005e4b0 2026-02-12T18:06:17.051 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.036+0000 7f6d8d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:17.051 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.036+0000 7f6d8d573640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:06:17.051 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.036+0000 7f6d8d573640 10 monclient: dump: 2026-02-12T18:06:17.051 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:17.051 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:17.051 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:17.051 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:17.051 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:17.051 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:17.051 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:17.051 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:17.051 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:17.051 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:17.052 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:17.052 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:17.052 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:17.052 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:17.052 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:17.052 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:17.052 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.037+0000 7f6d94d7e640 10 monclient: shutdown 2026-02-12T18:06:17.052 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.037+0000 7f6d94d7e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:17.052 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.037+0000 7f6d94d7e640 1 -- 10.20.193.48:0/2147585510 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d9005e4b0 msgr2=0x7f6d9005d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:17.052 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.037+0000 7f6d94d7e640 1 --2- 10.20.193.48:0/2147585510 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d9005e4b0 0x7f6d9005d3d0 secure :-1 s=READY pgs=44 gs=1 cs=0 l=1 c_cookie=6309069614219973036 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d8000a140 tx=0x7f6d8002fed0 comp rx=0 tx=0).stop 2026-02-12T18:06:17.052 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.037+0000 7f6d94d7e640 1 -- 10.20.193.48:0/2147585510 shutdown_connections 2026-02-12T18:06:17.052 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.037+0000 7f6d94d7e640 1 --2- 10.20.193.48:0/2147585510 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d9005e4b0 0x7f6d9005d3d0 unknown :-1 s=CLOSED pgs=44 gs=1 cs=0 l=1 c_cookie=6309069614219973036 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:17.052 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.037+0000 7f6d94d7e640 1 --2- 10.20.193.48:0/2147585510 >> v2:10.20.193.111:3300/0 conn(0x7f6d9008e210 0x7f6d9005ce90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:17.052 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.037+0000 7f6d94d7e640 1 --2- 10.20.193.48:0/2147585510 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6d900914d0 0x7f6d9005c950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:17.053 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.037+0000 7f6d94d7e640 1 -- 10.20.193.48:0/2147585510 >> 10.20.193.48:0/2147585510 conn(0x7f6d900548a0 msgr2=0x7f6d90097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:17.053 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.037+0000 7f6d94d7e640 1 -- 10.20.193.48:0/2147585510 shutdown_connections 2026-02-12T18:06:17.053 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.037+0000 7f6d94d7e640 1 -- 10.20.193.48:0/2147585510 wait complete. 2026-02-12T18:06:17.053 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.037+0000 7f6d94d7e640 10 monclient: build_initial_monmap 2026-02-12T18:06:17.053 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.037+0000 7f6d94d7e640 10 monclient: monmap: 2026-02-12T18:06:17.053 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:17.053 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:17.053 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:17.053 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:17.053 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:17.053 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:17.053 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:17.053 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:17.054 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:17.054 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:17.054 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:17.054 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:17.054 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:17.054 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:17.054 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:17.054 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:17.054 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.037+0000 7f6d94d7e640 1 Processor -- start 2026-02-12T18:06:17.054 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.037+0000 7f6d94d7e640 1 -- start start 2026-02-12T18:06:17.054 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.037+0000 7f6d94d7e640 10 monclient: init 2026-02-12T18:06:17.054 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d94d7e640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:17.054 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d94d7e640 10 monclient: _add_conns ranks=[8,5,2,3,6,7,0,4,1] 2026-02-12T18:06:17.054 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d94d7e640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6d9005e4b0 0x7f6d901ab9b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:17.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d94d7e640 10 monclient(hunting): picked mon.noname-e con 0x7f6d9005e4b0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:17.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d94d7e640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6d9008e210 0x7f6d90195440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:17.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d94d7e640 10 monclient(hunting): picked mon.noname-h con 0x7f6d9008e210 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:17.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d94d7e640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6d900914d0 0x7f6d90195980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:17.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d94d7e640 10 monclient(hunting): picked mon.noname-b con 0x7f6d900914d0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:17.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d94d7e640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:17.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d94d7e640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f6d901dbfe0 con 0x7f6d900914d0 2026-02-12T18:06:17.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d94d7e640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:17.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d94d7e640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f6d90196db0 con 0x7f6d9008e210 2026-02-12T18:06:17.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d94d7e640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:17.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d94d7e640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f6d90094430 con 0x7f6d9005e4b0 2026-02-12T18:06:17.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d94d7e640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:17.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d94d7e640 10 monclient(hunting): authenticate will time out at 615.764124s 2026-02-12T18:06:17.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8ed76640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6d900914d0 0x7f6d90195980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:17.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8e575640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6d9005e4b0 0x7f6d901ab9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:17.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8ed76640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6d900914d0 0x7f6d90195980 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:60364/0 (socket says 10.20.193.48:60364) 2026-02-12T18:06:17.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8ed76640 1 -- 10.20.193.48:0/1532710858 learned_addr learned my addr 10.20.193.48:0/1532710858 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:17.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8ed76640 10 monclient(hunting): get_auth_request con 0x7f6d900914d0 auth_method 0 2026-02-12T18:06:17.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:17.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8ed76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:17.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:17.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8e575640 10 monclient(hunting): get_auth_request con 0x7f6d9005e4b0 auth_method 0 2026-02-12T18:06:17.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:17.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8e575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:17.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:17.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8dd74640 1 --2- 10.20.193.48:0/1532710858 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6d9008e210 0x7f6d90195440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:17.057 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:17.057 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:17.057 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:17.057 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:17.057 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:17.057 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:17.057 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8dd74640 10 monclient(hunting): get_auth_request con 0x7f6d9008e210 auth_method 0 2026-02-12T18:06:17.057 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:17.057 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8dd74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:17.057 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:17.057 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:17.057 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:17.057 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:17.057 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8e575640 10 monclient(hunting): handle_auth_done global_id 4499 payload 824 2026-02-12T18:06:17.058 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8e575640 1 -- 10.20.193.48:0/1532710858 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6d9008e210 msgr2=0x7f6d90195440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:17.058 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8e575640 1 --2- 10.20.193.48:0/1532710858 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6d9008e210 0x7f6d90195440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:17.058 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8e575640 1 -- 10.20.193.48:0/1532710858 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6d900914d0 msgr2=0x7f6d90195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:17.058 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8e575640 1 --2- 10.20.193.48:0/1532710858 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6d900914d0 0x7f6d90195980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:17.058 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8e575640 10 monclient: _finish_hunting 0 2026-02-12T18:06:17.058 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8e575640 1 monclient: found mon.noname-e 2026-02-12T18:06:17.058 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8e575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:17.058 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8e575640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:06:17.058 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8e575640 1 -- 10.20.193.48:0/1532710858 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d8000a5d0 con 0x7f6d9005e4b0 2026-02-12T18:06:17.058 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.038+0000 7f6d8ed76640 1 --2- 10.20.193.48:0/1532710858 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6d900914d0 0x7f6d90195980 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:06:17.058 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.040+0000 7f6d8e575640 1 -- 10.20.193.48:0/1532710858 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6d9005e4b0 msgr2=0x7f6d901ab9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:17.058 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.040+0000 7f6d8e575640 1 --2- 10.20.193.48:0/1532710858 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6d9005e4b0 0x7f6d901ab9b0 secure :-1 s=READY pgs=48 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d8400e7c0 tx=0x7f6d8400ec90 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:17.058 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.040+0000 7f6d76ffd640 1 -- 10.20.193.48:0/1532710858 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6d8400cb50 con 0x7f6d9005e4b0 2026-02-12T18:06:17.059 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.040+0000 7f6d76ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:17.059 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.040+0000 7f6d76ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:06:17.059 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.040+0000 7f6d76ffd640 10 monclient: dump: 2026-02-12T18:06:17.059 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:17.059 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:17.059 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:17.059 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:17.059 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:17.059 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:17.059 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:17.059 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:17.059 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:17.059 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:17.059 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:17.060 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:17.060 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:17.060 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:17.060 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:17.060 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:17.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.040+0000 7f6d76ffd640 10 monclient: _finish_auth 0 2026-02-12T18:06:17.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.040+0000 7f6d76ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:06:17.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.040+0000 7f6d76ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:17.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.040+0000 7f6d76ffd640 1 -- 10.20.193.48:0/1532710858 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d8400ccf0 con 0x7f6d9005e4b0 2026-02-12T18:06:17.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.040+0000 7f6d94d7e640 5 monclient: authenticate success, global_id 4499 2026-02-12T18:06:17.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.040+0000 7f6d76ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:17.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.040+0000 7f6d76ffd640 1 -- 10.20.193.48:0/1532710858 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6d8400ce60 con 0x7f6d9005e4b0 2026-02-12T18:06:17.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.040+0000 7f6d94d7e640 10 monclient: _renew_subs 2026-02-12T18:06:17.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.040+0000 7f6d8cd72640 4 set_mon_vals no callback set 2026-02-12T18:06:17.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.040+0000 7f6d94d7e640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:17.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.040+0000 7f6d94d7e640 1 -- 10.20.193.48:0/1532710858 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d90198870 con 0x7f6d9005e4b0 2026-02-12T18:06:17.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.040+0000 7f6d76ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:17.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.040+0000 7f6d76ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:06:17.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.040+0000 7f6d76ffd640 10 monclient: dump: 2026-02-12T18:06:17.061 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:17.061 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:17.061 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:17.061 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:17.061 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:17.061 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:17.061 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:17.061 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:17.062 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:17.062 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:17.062 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:17.062 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:17.062 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:17.062 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:17.062 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:17.062 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:17.062 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.040+0000 7f6d94d7e640 10 monclient: _renew_subs 2026-02-12T18:06:17.062 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.040+0000 7f6d94d7e640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:17.062 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.040+0000 7f6d94d7e640 1 -- 10.20.193.48:0/1532710858 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d901d04b0 con 0x7f6d9005e4b0 2026-02-12T18:06:17.062 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.041+0000 7f6d94d7e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:17.062 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.041+0000 7f6d94d7e640 1 --2- 10.20.193.48:0/1532710858 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d901abef0 0x7f6d90195ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:17.062 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.041+0000 7f6d94d7e640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:17.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.041+0000 7f6d94d7e640 1 -- 10.20.193.48:0/1532710858 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f6d900630f0 con 0x7f6d901abef0 2026-02-12T18:06:17.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.041+0000 7f6d8dd74640 1 --2- 10.20.193.48:0/1532710858 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d901abef0 0x7f6d90195ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:17.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.041+0000 7f6d8dd74640 10 monclient: get_auth_request con 0x7f6d901abef0 auth_method 0 2026-02-12T18:06:17.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.041+0000 7f6d8dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:17.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.041+0000 7f6d8dd74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:17.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.041+0000 7f6d8dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:17.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.041+0000 7f6d76ffd640 1 -- 10.20.193.48:0/1532710858 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f6d84011070 con 0x7f6d9005e4b0 2026-02-12T18:06:17.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.041+0000 7f6d8dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:17.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.041+0000 7f6d8dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:17.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.041+0000 7f6d8dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:17.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.041+0000 7f6d76ffd640 1 --2- 10.20.193.48:0/1532710858 >> v2:10.20.193.111:6812/977811348 conn(0x7f6d5c03f800 0x7f6d5c05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:17.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.041+0000 7f6d76ffd640 1 -- 10.20.193.48:0/1532710858 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(20..20 src has 1..20) ==== 3897+0+0 (secure 0 0 0) 0x7f6d84052ce0 con 0x7f6d9005e4b0 2026-02-12T18:06:17.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.041+0000 7f6d8dd74640 10 monclient(hunting): handle_auth_done global_id 4507 payload 824 2026-02-12T18:06:17.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.041+0000 7f6d8dd74640 1 -- 10.20.193.48:0/1532710858 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6d900929d0 con 0x7f6d901abef0 2026-02-12T18:06:17.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.041+0000 7f6d8ed76640 1 --2- 10.20.193.48:0/1532710858 >> v2:10.20.193.111:6812/977811348 conn(0x7f6d5c03f800 0x7f6d5c05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:17.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.041+0000 7f6d8ed76640 10 monclient: get_auth_request con 0x7f6d5c03f800 auth_method 0 2026-02-12T18:06:17.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.044+0000 7f6d8dd74640 1 -- 10.20.193.48:0/1532710858 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d901abef0 msgr2=0x7f6d90195ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:17.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.044+0000 7f6d8dd74640 1 --2- 10.20.193.48:0/1532710858 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d901abef0 0x7f6d90195ec0 secure :-1 s=READY pgs=45 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d90197420 tx=0x7f6d78011e40 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:17.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.044+0000 7f6d76ffd640 1 -- 10.20.193.48:0/1532710858 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6d7800fdc0 con 0x7f6d901abef0 2026-02-12T18:06:17.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.044+0000 7f6d76ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:17.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.044+0000 7f6d76ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:06:17.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.044+0000 7f6d76ffd640 10 monclient: dump: 2026-02-12T18:06:17.067 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:17.067 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:17.067 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:17.067 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:17.067 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:17.067 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:17.067 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:17.067 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:17.067 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:17.067 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:17.067 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:17.067 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:17.067 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:17.067 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:17.067 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:17.068 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:17.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.044+0000 7f6d8ed76640 1 --2- 10.20.193.48:0/1532710858 >> v2:10.20.193.111:6812/977811348 conn(0x7f6d5c03f800 0x7f6d5c05fcb0 secure :-1 s=READY pgs=78 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d901aff60 tx=0x7f6d8003a040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:17.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.044+0000 7f6d76ffd640 1 -- 10.20.193.48:0/1532710858 <== mon.7 v2:10.20.193.111:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f6d7800f900 con 0x7f6d901abef0 2026-02-12T18:06:17.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.044+0000 7f6d76ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:17.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.044+0000 7f6d76ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:17.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.044+0000 7f6d76ffd640 1 -- 10.20.193.48:0/1532710858 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d901abef0 msgr2=0x7f6d90195ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:17.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.044+0000 7f6d76ffd640 1 --2- 10.20.193.48:0/1532710858 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d901abef0 0x7f6d90195ec0 secure :-1 s=READY pgs=45 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d90197420 tx=0x7f6d78011e40 comp rx=0 tx=0).stop 2026-02-12T18:06:17.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.044+0000 7f6d76ffd640 1 -- 10.20.193.48:0/1532710858 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d901abef0 msgr2=0x7f6d90195ec0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:17.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.044+0000 7f6d76ffd640 1 --2- 10.20.193.48:0/1532710858 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d901abef0 0x7f6d90195ec0 secure :-1 s=CLOSED pgs=45 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d90197420 tx=0x7f6d78011e40 comp rx=0 tx=0).stop 2026-02-12T18:06:17.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.048+0000 7f6d94d7e640 10 start_mon_command cmd=[{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2026-02-12T18:06:17.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.048+0000 7f6d94d7e640 1 --2- 10.20.193.48:0/1532710858 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d901ac610 0x7f6d90196400 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:17.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.048+0000 7f6d94d7e640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:17.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.048+0000 7f6d94d7e640 1 -- 10.20.193.48:0/1532710858 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f6d9005f140 con 0x7f6d901ac610 2026-02-12T18:06:17.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.048+0000 7f6d8dd74640 1 --2- 10.20.193.48:0/1532710858 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d901ac610 0x7f6d90196400 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:17.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.048+0000 7f6d8dd74640 10 monclient: get_auth_request con 0x7f6d901ac610 auth_method 0 2026-02-12T18:06:17.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.048+0000 7f6d8dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:17.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.048+0000 7f6d8dd74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:17.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.048+0000 7f6d8dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:17.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.048+0000 7f6d8dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:17.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.048+0000 7f6d8dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:17.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.048+0000 7f6d8dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:17.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.049+0000 7f6d8dd74640 10 monclient(hunting): handle_auth_done global_id 4516 payload 824 2026-02-12T18:06:17.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.049+0000 7f6d8dd74640 1 -- 10.20.193.48:0/1532710858 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- command(tid 2: {"prefix": "sync_force", "yes_i_really_mean_it": true}) -- 0x7f6d9005de10 con 0x7f6d901ac610 2026-02-12T18:06:17.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.051+0000 7f6d8dd74640 1 -- 10.20.193.48:0/1532710858 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d901ac610 msgr2=0x7f6d90196400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:17.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.051+0000 7f6d8dd74640 1 --2- 10.20.193.48:0/1532710858 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d901ac610 0x7f6d90196400 secure :-1 s=READY pgs=46 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d90196ba0 tx=0x7f6d78004770 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:17.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.051+0000 7f6d76ffd640 1 -- 10.20.193.48:0/1532710858 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6d7801ed30 con 0x7f6d901ac610 2026-02-12T18:06:17.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.051+0000 7f6d76ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:17.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.051+0000 7f6d76ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:06:17.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.051+0000 7f6d76ffd640 10 monclient: dump: 2026-02-12T18:06:17.069 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:17.069 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:17.069 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:17.070 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:17.070 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:17.070 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:17.070 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:17.070 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:17.070 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:17.070 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:17.070 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:17.070 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:17.070 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:17.070 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:17.070 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:17.070 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:17.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.051+0000 7f6d76ffd640 1 -- 10.20.193.48:0/1532710858 <== mon.7 v2:10.20.193.111:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+83 (secure 0 0 0) 0x7f6d7801ee90 con 0x7f6d901ac610 2026-02-12T18:06:17.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.051+0000 7f6d76ffd640 10 monclient: handle_command_reply 2 [{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2026-02-12T18:06:17.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.051+0000 7f6d76ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:17.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.051+0000 7f6d76ffd640 1 -- 10.20.193.48:0/1532710858 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d901ac610 msgr2=0x7f6d90196400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:17.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.051+0000 7f6d76ffd640 1 --2- 10.20.193.48:0/1532710858 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d901ac610 0x7f6d90196400 secure :-1 s=READY pgs=46 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d90196ba0 tx=0x7f6d78004770 comp rx=0 tx=0).stop 2026-02-12T18:06:17.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.051+0000 7f6d76ffd640 1 -- 10.20.193.48:0/1532710858 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d901ac610 msgr2=0x7f6d90196400 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:17.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.051+0000 7f6d76ffd640 1 --2- 10.20.193.48:0/1532710858 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d901ac610 0x7f6d90196400 secure :-1 s=CLOSED pgs=46 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d90196ba0 tx=0x7f6d78004770 comp rx=0 tx=0).stop 2026-02-12T18:06:17.071 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:06:17.071 INFO:teuthology.orchestra.run.trial048.stdout: "ret": 0, 2026-02-12T18:06:17.071 INFO:teuthology.orchestra.run.trial048.stdout: "msg": "forcing store sync the next time the monitor starts" 2026-02-12T18:06:17.071 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:06:17.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.052+0000 7f6d94d7e640 1 -- 10.20.193.48:0/1532710858 >> v2:10.20.193.111:6812/977811348 conn(0x7f6d5c03f800 msgr2=0x7f6d5c05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:17.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.052+0000 7f6d94d7e640 1 --2- 10.20.193.48:0/1532710858 >> v2:10.20.193.111:6812/977811348 conn(0x7f6d5c03f800 0x7f6d5c05fcb0 secure :-1 s=READY pgs=78 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d901aff60 tx=0x7f6d8003a040 comp rx=0 tx=0).stop 2026-02-12T18:06:17.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.052+0000 7f6d94d7e640 10 monclient: shutdown 2026-02-12T18:06:17.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.052+0000 7f6d94d7e640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:17.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.052+0000 7f6d94d7e640 1 -- 10.20.193.48:0/1532710858 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6d9005e4b0 msgr2=0x7f6d901ab9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:17.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.052+0000 7f6d94d7e640 1 --2- 10.20.193.48:0/1532710858 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6d9005e4b0 0x7f6d901ab9b0 secure :-1 s=READY pgs=48 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d8400e7c0 tx=0x7f6d8400ec90 comp rx=0 tx=0).stop 2026-02-12T18:06:17.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.052+0000 7f6d8ed76640 1 -- 10.20.193.48:0/1532710858 reap_dead start 2026-02-12T18:06:17.073 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.052+0000 7f6d94d7e640 1 -- 10.20.193.48:0/1532710858 shutdown_connections 2026-02-12T18:06:17.073 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.052+0000 7f6d94d7e640 1 --2- 10.20.193.48:0/1532710858 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6d9005e4b0 0x7f6d901ab9b0 unknown :-1 s=CLOSED pgs=48 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:17.073 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.052+0000 7f6d94d7e640 1 -- 10.20.193.48:0/1532710858 >> 10.20.193.48:0/1532710858 conn(0x7f6d900548a0 msgr2=0x7f6d9008f900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:17.073 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.052+0000 7f6d94d7e640 1 -- 10.20.193.48:0/1532710858 shutdown_connections 2026-02-12T18:06:17.073 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:17.052+0000 7f6d94d7e640 1 -- 10.20.193.48:0/1532710858 wait complete. 2026-02-12T18:06:17.073 INFO:tasks.mon_thrash.mon_thrasher:killing mon.i 2026-02-12T18:06:17.073 DEBUG:tasks.ceph.mon.i:waiting for process to exit 2026-02-12T18:06:17.073 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:06:17.082 INFO:tasks.ceph.mon.i:Stopped 2026-02-12T18:06:17.082 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.b 2026-02-12T18:06:17.083 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-12T18:06:17.083 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-12T18:06:17.083 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.d 2026-02-12T18:06:17.083 INFO:tasks.mon_thrash:Sending STOP to mon d 2026-02-12T18:06:17.083 INFO:tasks.ceph.mon.d:Sent signal 19 2026-02-12T18:06:17.083 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-12T18:06:32.084 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.b 2026-02-12T18:06:32.084 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-12T18:06:32.084 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-12T18:06:32.084 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.d 2026-02-12T18:06:32.085 INFO:tasks.mon_thrash:Sending CONT to mon d 2026-02-12T18:06:32.085 INFO:tasks.ceph.mon.d:Sent signal 18 2026-02-12T18:06:32.085 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 7 2026-02-12T18:06:32.085 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T18:06:32.154 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb16d012640 10 monclient: get_monmap_and_config 2026-02-12T18:06:32.154 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb16d012640 10 monclient: build_initial_monmap 2026-02-12T18:06:32.155 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb16d012640 10 monclient: monmap: 2026-02-12T18:06:32.155 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:32.155 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:32.155 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:32.153131+0000 2026-02-12T18:06:32.155 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:32.153131+0000 2026-02-12T18:06:32.155 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:32.155 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:32.155 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:32.155 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:32.155 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:32.156 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:32.156 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:32.156 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:32.156 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:32.156 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:32.156 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:32.156 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:32.156 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:32.156 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:32.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb16d012640 1 Processor -- start 2026-02-12T18:06:32.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb16d012640 1 -- start start 2026-02-12T18:06:32.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb16d012640 10 monclient: init 2026-02-12T18:06:32.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb16d012640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:32.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb16d012640 10 monclient: _add_conns ranks=[6,10,0,3,5,8,7,9,2,1,4] 2026-02-12T18:06:32.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb16d012640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb168144600 0x7fb1681449d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:32.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb16d012640 10 monclient(hunting): picked mon.noname-d con 0x7fb168144600 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:06:32.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb16d012640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7fb168144210 0x7fb168089df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:32.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb16d012640 10 monclient(hunting): picked mon.noname-f con 0x7fb168144210 addr v2:10.20.193.111:3300/0 2026-02-12T18:06:32.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb16d012640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb168144f10 addr v1:10.20.193.48:6789/0 2026-02-12T18:06:32.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb16d012640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb168060390 con 0x7fb168144f10 2026-02-12T18:06:32.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb16d012640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:32.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb16d012640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7fb168092be0 con 0x7fb168144210 2026-02-12T18:06:32.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb16d012640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:32.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb16d012640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fb16808b230 con 0x7fb168144600 2026-02-12T18:06:32.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb16d012640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:32.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb16d012640 10 monclient(hunting): authenticate will time out at 630.878823s 2026-02-12T18:06:32.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb167577640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7fb168144f10 0x7fb16808a330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:58576/0 (socket says 10.20.193.48:58576) 2026-02-12T18:06:32.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb166d76640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb168144600 0x7fb1681449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:32.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb167577640 1 -- 10.20.193.48:0/180607918 learned_addr learned my addr 10.20.193.48:0/180607918 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:06:32.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb166d76640 10 monclient(hunting): get_auth_request con 0x7fb168144600 auth_method 0 2026-02-12T18:06:32.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb166d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:32.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb166d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:32.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.152+0000 7fb166d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:32.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.153+0000 7fb166575640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.111:3300/0 conn(0x7fb168144210 0x7fb168089df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:32.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.153+0000 7fb166d76640 1 -- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb168144600 msgr2=0x7fb1681449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:06:32.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.153+0000 7fb166d76640 1 -- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb168144600 msgr2=0x7fb1681449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:06:32.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.153+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb168144600 0x7fb1681449d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:06:32.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.153+0000 7fb166575640 10 monclient(hunting): get_auth_request con 0x7fb168144210 auth_method 0 2026-02-12T18:06:32.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.153+0000 7fb166575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:32.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.153+0000 7fb166575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:32.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.153+0000 7fb166575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:32.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.153+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb168144600 0x7fb1681449d0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:06:32.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.153+0000 7fb166575640 1 -- 10.20.193.48:0/180607918 >> v2:10.20.193.111:3300/0 conn(0x7fb168144210 msgr2=0x7fb168089df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:06:32.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.153+0000 7fb166575640 1 -- 10.20.193.48:0/180607918 >> v2:10.20.193.111:3300/0 conn(0x7fb168144210 msgr2=0x7fb168089df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:06:32.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.153+0000 7fb166575640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.111:3300/0 conn(0x7fb168144210 0x7fb168089df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:06:32.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.153+0000 7fb166575640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.111:3300/0 conn(0x7fb168144210 0x7fb168089df0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:06:32.160 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.155+0000 7fb167577640 1 -- 10.20.193.48:0/180607918 >> v1:10.20.193.48:6789/0 conn(0x7fb168144f10 legacy=0x7fb16808a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:32.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.354+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb168144600 0x7fb1681449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:32.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.354+0000 7fb166d76640 10 monclient(hunting): get_auth_request con 0x7fb168144600 auth_method 0 2026-02-12T18:06:32.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.354+0000 7fb166d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:32.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.354+0000 7fb166d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:32.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.354+0000 7fb166d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:06:32.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.354+0000 7fb166d76640 1 -- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb168144600 msgr2=0x7fb1681449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:06:32.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.354+0000 7fb166d76640 1 -- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb168144600 msgr2=0x7fb1681449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:06:32.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.354+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb168144600 0x7fb1681449d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:06:32.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.354+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb168144600 0x7fb1681449d0 unknown :-1 s=START_CONNECT pgs=0 gs=7 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:06:32.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.354+0000 7fb166575640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.111:3300/0 conn(0x7fb168144210 0x7fb168089df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=8 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:32.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.354+0000 7fb166575640 10 monclient(hunting): get_auth_request con 0x7fb168144210 auth_method 0 2026-02-12T18:06:32.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.354+0000 7fb166575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:32.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.354+0000 7fb166575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:32.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.354+0000 7fb166575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:06:32.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.354+0000 7fb166575640 1 -- 10.20.193.48:0/180607918 >> v2:10.20.193.111:3300/0 conn(0x7fb168144210 msgr2=0x7fb168089df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:06:32.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.354+0000 7fb166575640 1 -- 10.20.193.48:0/180607918 >> v2:10.20.193.111:3300/0 conn(0x7fb168144210 msgr2=0x7fb168089df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:06:32.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.354+0000 7fb166575640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.111:3300/0 conn(0x7fb168144210 0x7fb168089df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=8 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:06:32.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.354+0000 7fb166575640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.111:3300/0 conn(0x7fb168144210 0x7fb168089df0 unknown :-1 s=START_CONNECT pgs=0 gs=9 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:06:32.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.755+0000 7fb166575640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.111:3300/0 conn(0x7fb168144210 0x7fb168089df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=10 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:32.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.755+0000 7fb166575640 10 monclient(hunting): get_auth_request con 0x7fb168144210 auth_method 0 2026-02-12T18:06:32.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.755+0000 7fb166575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:32.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.755+0000 7fb166575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:32.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.755+0000 7fb166575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:06:32.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.755+0000 7fb166575640 1 -- 10.20.193.48:0/180607918 >> v2:10.20.193.111:3300/0 conn(0x7fb168144210 msgr2=0x7fb168089df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:06:32.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.755+0000 7fb166575640 1 -- 10.20.193.48:0/180607918 >> v2:10.20.193.111:3300/0 conn(0x7fb168144210 msgr2=0x7fb168089df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:06:32.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.755+0000 7fb166575640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.111:3300/0 conn(0x7fb168144210 0x7fb168089df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=10 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:06:32.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.755+0000 7fb166575640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.111:3300/0 conn(0x7fb168144210 0x7fb168089df0 unknown :-1 s=START_CONNECT pgs=0 gs=11 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:06:32.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.755+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb168144600 0x7fb1681449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=12 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:32.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.755+0000 7fb166d76640 10 monclient(hunting): get_auth_request con 0x7fb168144600 auth_method 0 2026-02-12T18:06:32.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.755+0000 7fb166d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:32.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.755+0000 7fb166d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:32.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.755+0000 7fb166d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:06:32.758 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.755+0000 7fb166d76640 1 -- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb168144600 msgr2=0x7fb1681449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:06:32.758 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.755+0000 7fb166d76640 1 -- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb168144600 msgr2=0x7fb1681449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:06:32.758 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.755+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb168144600 0x7fb1681449d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=12 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:06:32.758 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:32.755+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb168144600 0x7fb1681449d0 unknown :-1 s=START_CONNECT pgs=0 gs=13 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:06:33.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:33.556+0000 7fb166575640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.111:3300/0 conn(0x7fb168144210 0x7fb168089df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=14 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:33.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:33.556+0000 7fb166575640 10 monclient(hunting): get_auth_request con 0x7fb168144210 auth_method 0 2026-02-12T18:06:33.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:33.556+0000 7fb166575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:33.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:33.556+0000 7fb166575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:33.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:33.556+0000 7fb166575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:06:33.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:33.557+0000 7fb166575640 1 -- 10.20.193.48:0/180607918 >> v2:10.20.193.111:3300/0 conn(0x7fb168144210 msgr2=0x7fb168089df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:06:33.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:33.557+0000 7fb166575640 1 -- 10.20.193.48:0/180607918 >> v2:10.20.193.111:3300/0 conn(0x7fb168144210 msgr2=0x7fb168089df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:06:33.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:33.557+0000 7fb166575640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.111:3300/0 conn(0x7fb168144210 0x7fb168089df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=14 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:06:33.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:33.557+0000 7fb166575640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.111:3300/0 conn(0x7fb168144210 0x7fb168089df0 unknown :-1 s=START_CONNECT pgs=0 gs=15 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:06:33.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:33.557+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb168144600 0x7fb1681449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=16 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:33.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:33.557+0000 7fb166d76640 10 monclient(hunting): get_auth_request con 0x7fb168144600 auth_method 0 2026-02-12T18:06:33.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:33.557+0000 7fb166d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:33.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:33.557+0000 7fb166d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:33.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:33.557+0000 7fb166d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:06:33.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:33.557+0000 7fb166d76640 1 -- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb168144600 msgr2=0x7fb1681449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:06:33.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:33.557+0000 7fb166d76640 1 -- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb168144600 msgr2=0x7fb1681449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:06:33.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:33.557+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb168144600 0x7fb1681449d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=16 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:06:33.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:33.557+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb168144600 0x7fb1681449d0 unknown :-1 s=START_CONNECT pgs=0 gs=17 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:06:35.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.152+0000 7fb164d72640 10 monclient(hunting): tick 2026-02-12T18:06:35.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.152+0000 7fb164d72640 10 monclient(hunting): _check_auth_tickets 2026-02-12T18:06:35.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.152+0000 7fb164d72640 1 monclient(hunting): continuing hunt 2026-02-12T18:06:35.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.152+0000 7fb164d72640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T18:06:35.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.152+0000 7fb164d72640 1 -- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb168144600 msgr2=0x7fb1681449d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:06:35.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.152+0000 7fb164d72640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb168144600 0x7fb1681449d0 unknown :-1 s=START_CONNECT pgs=0 gs=17 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:35.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.152+0000 7fb164d72640 1 -- 10.20.193.48:0/180607918 >> v2:10.20.193.111:3300/0 conn(0x7fb168144210 msgr2=0x7fb168089df0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:06:35.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.152+0000 7fb164d72640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.111:3300/0 conn(0x7fb168144210 0x7fb168089df0 unknown :-1 s=START_CONNECT pgs=0 gs=15 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:35.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.152+0000 7fb164d72640 1 -- 10.20.193.48:0/180607918 >> v1:10.20.193.48:6789/0 conn(0x7fb168144f10 legacy=0x7fb16808a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:35.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.152+0000 7fb164d72640 10 monclient: _add_conns ranks=[5,1,9,4,3,2,8,7] 2026-02-12T18:06:35.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.152+0000 7fb164d72640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb14c003970 0x7fb14c023d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:35.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.152+0000 7fb164d72640 10 monclient(hunting): picked mon.noname-h con 0x7fb14c003970 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:35.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.152+0000 7fb164d72640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fb14c024320 addr v1:10.20.193.111:6789/0 2026-02-12T18:06:35.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.152+0000 7fb164d72640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.48:3300/0 conn(0x7fb14c046040 0x7fb14c0664f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:35.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.152+0000 7fb164d72640 10 monclient(hunting): picked mon.noname-a con 0x7fb14c046040 addr v2:10.20.193.48:3300/0 2026-02-12T18:06:35.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.152+0000 7fb164d72640 1 -- 10.20.193.48:0/180607918 --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb168092370 con 0x7fb14c024320 2026-02-12T18:06:35.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.152+0000 7fb164d72640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:35.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.152+0000 7fb164d72640 1 -- 10.20.193.48:0/180607918 --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7fb168092be0 con 0x7fb14c046040 2026-02-12T18:06:35.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.152+0000 7fb164d72640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:35.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.152+0000 7fb164d72640 1 -- 10.20.193.48:0/180607918 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fb16808b230 con 0x7fb14c003970 2026-02-12T18:06:35.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.152+0000 7fb164d72640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:35.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.153+0000 7fb167577640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.48:3300/0 conn(0x7fb14c046040 0x7fb14c0664f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=20 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:35.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.153+0000 7fb167577640 10 monclient(hunting): get_auth_request con 0x7fb14c046040 auth_method 0 2026-02-12T18:06:35.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.153+0000 7fb167577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:35.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.153+0000 7fb167577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:35.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.153+0000 7fb167577640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:35.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.153+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb14c003970 0x7fb14c023d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=19 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:35.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.153+0000 7fb166d76640 10 monclient(hunting): get_auth_request con 0x7fb14c003970 auth_method 0 2026-02-12T18:06:35.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.153+0000 7fb166d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:35.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.153+0000 7fb166d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:35.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.153+0000 7fb166d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:35.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.153+0000 7fb167577640 1 -- 10.20.193.48:0/180607918 >> v2:10.20.193.48:3300/0 conn(0x7fb14c046040 msgr2=0x7fb14c0664f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-12T18:06:35.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.153+0000 7fb167577640 1 -- 10.20.193.48:0/180607918 >> v2:10.20.193.48:3300/0 conn(0x7fb14c046040 msgr2=0x7fb14c0664f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:06:35.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.153+0000 7fb167577640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.48:3300/0 conn(0x7fb14c046040 0x7fb14c0664f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=20 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:06:35.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.153+0000 7fb167577640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.48:3300/0 conn(0x7fb14c046040 0x7fb14c0664f0 unknown :-1 s=START_CONNECT pgs=0 gs=21 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:06:35.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.153+0000 7fb166d76640 1 -- 10.20.193.48:0/180607918 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb14c003970 msgr2=0x7fb14c023d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:06:35.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.153+0000 7fb166d76640 1 -- 10.20.193.48:0/180607918 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb14c003970 msgr2=0x7fb14c023d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:06:35.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.153+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb14c003970 0x7fb14c023d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=19 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:06:35.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.153+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb14c003970 0x7fb14c023d90 unknown :-1 s=START_CONNECT pgs=0 gs=22 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:06:35.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.155+0000 7fb166575640 1 -- 10.20.193.48:0/180607918 >> v1:10.20.193.111:6789/0 conn(0x7fb14c024320 legacy=0x7fb14c0447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:35.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.354+0000 7fb167577640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.48:3300/0 conn(0x7fb14c046040 0x7fb14c0664f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=23 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:35.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.354+0000 7fb167577640 10 monclient(hunting): get_auth_request con 0x7fb14c046040 auth_method 0 2026-02-12T18:06:35.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.354+0000 7fb167577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:35.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.354+0000 7fb167577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:35.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.354+0000 7fb167577640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:06:35.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.354+0000 7fb167577640 1 -- 10.20.193.48:0/180607918 >> v2:10.20.193.48:3300/0 conn(0x7fb14c046040 msgr2=0x7fb14c0664f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:06:35.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.354+0000 7fb167577640 1 -- 10.20.193.48:0/180607918 >> v2:10.20.193.48:3300/0 conn(0x7fb14c046040 msgr2=0x7fb14c0664f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:06:35.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.354+0000 7fb167577640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.48:3300/0 conn(0x7fb14c046040 0x7fb14c0664f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=23 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:06:35.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.354+0000 7fb167577640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.48:3300/0 conn(0x7fb14c046040 0x7fb14c0664f0 unknown :-1 s=START_CONNECT pgs=0 gs=25 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:06:35.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.354+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb14c003970 0x7fb14c023d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=24 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:35.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.354+0000 7fb166d76640 10 monclient(hunting): get_auth_request con 0x7fb14c003970 auth_method 0 2026-02-12T18:06:35.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.354+0000 7fb166d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:35.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.354+0000 7fb166d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:35.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.354+0000 7fb166d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:06:35.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.354+0000 7fb166d76640 1 -- 10.20.193.48:0/180607918 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb14c003970 msgr2=0x7fb14c023d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-12T18:06:35.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.354+0000 7fb166d76640 1 -- 10.20.193.48:0/180607918 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb14c003970 msgr2=0x7fb14c023d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:06:35.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.354+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb14c003970 0x7fb14c023d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=24 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:06:35.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.355+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb14c003970 0x7fb14c023d90 unknown :-1 s=START_CONNECT pgs=0 gs=26 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:06:35.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.755+0000 7fb167577640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.48:3300/0 conn(0x7fb14c046040 0x7fb14c0664f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=27 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:35.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.755+0000 7fb167577640 10 monclient(hunting): get_auth_request con 0x7fb14c046040 auth_method 0 2026-02-12T18:06:35.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.755+0000 7fb167577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:35.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.755+0000 7fb167577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:35.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.755+0000 7fb167577640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:06:35.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.755+0000 7fb167577640 1 -- 10.20.193.48:0/180607918 >> v2:10.20.193.48:3300/0 conn(0x7fb14c046040 msgr2=0x7fb14c0664f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:06:35.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.755+0000 7fb167577640 1 -- 10.20.193.48:0/180607918 >> v2:10.20.193.48:3300/0 conn(0x7fb14c046040 msgr2=0x7fb14c0664f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:06:35.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.755+0000 7fb167577640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.48:3300/0 conn(0x7fb14c046040 0x7fb14c0664f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=27 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:06:35.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.755+0000 7fb167577640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.48:3300/0 conn(0x7fb14c046040 0x7fb14c0664f0 unknown :-1 s=START_CONNECT pgs=0 gs=28 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:06:35.758 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.756+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb14c003970 0x7fb14c023d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=29 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:35.758 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.756+0000 7fb166d76640 10 monclient(hunting): get_auth_request con 0x7fb14c003970 auth_method 0 2026-02-12T18:06:35.758 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.756+0000 7fb166d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:35.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.756+0000 7fb166d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:35.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.756+0000 7fb166d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:06:35.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.756+0000 7fb166d76640 1 -- 10.20.193.48:0/180607918 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb14c003970 msgr2=0x7fb14c023d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:06:35.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.756+0000 7fb166d76640 1 -- 10.20.193.48:0/180607918 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb14c003970 msgr2=0x7fb14c023d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:06:35.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.756+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb14c003970 0x7fb14c023d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=29 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:06:35.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:35.756+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb14c003970 0x7fb14c023d90 unknown :-1 s=START_CONNECT pgs=0 gs=30 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:06:36.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:36.556+0000 7fb167577640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.48:3300/0 conn(0x7fb14c046040 0x7fb14c0664f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=31 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:36.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:36.556+0000 7fb167577640 10 monclient(hunting): get_auth_request con 0x7fb14c046040 auth_method 0 2026-02-12T18:06:36.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:36.556+0000 7fb167577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:36.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:36.556+0000 7fb167577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:36.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:36.556+0000 7fb167577640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:06:36.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:36.556+0000 7fb167577640 1 -- 10.20.193.48:0/180607918 >> v2:10.20.193.48:3300/0 conn(0x7fb14c046040 msgr2=0x7fb14c0664f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:06:36.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:36.556+0000 7fb167577640 1 -- 10.20.193.48:0/180607918 >> v2:10.20.193.48:3300/0 conn(0x7fb14c046040 msgr2=0x7fb14c0664f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:06:36.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:36.556+0000 7fb167577640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.48:3300/0 conn(0x7fb14c046040 0x7fb14c0664f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=31 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:06:36.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:36.556+0000 7fb167577640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.48:3300/0 conn(0x7fb14c046040 0x7fb14c0664f0 unknown :-1 s=START_CONNECT pgs=0 gs=32 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:06:36.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:36.557+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb14c003970 0x7fb14c023d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=33 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:36.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:36.557+0000 7fb166d76640 10 monclient(hunting): get_auth_request con 0x7fb14c003970 auth_method 0 2026-02-12T18:06:36.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:36.557+0000 7fb166d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:36.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:36.557+0000 7fb166d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:36.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:36.557+0000 7fb166d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:06:36.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:36.558+0000 7fb166d76640 1 -- 10.20.193.48:0/180607918 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb14c003970 msgr2=0x7fb14c023d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:06:36.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:36.558+0000 7fb166d76640 1 -- 10.20.193.48:0/180607918 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb14c003970 msgr2=0x7fb14c023d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:06:36.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:36.558+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb14c003970 0x7fb14c023d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=33 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:06:36.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:36.558+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb14c003970 0x7fb14c023d90 unknown :-1 s=START_CONNECT pgs=0 gs=34 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:06:37.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 1 -- 10.20.193.48:0/180607918 <== mon.1 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2382147446 0 0) 0x7fb168092370 con 0x7fb14c024320 2026-02-12T18:06:37.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 10 monclient(hunting): _negotiate 2026-02-12T18:06:37.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 10 monclient(hunting): my global_id is 4483 2026-02-12T18:06:37.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 1 -- 10.20.193.48:0/180607918 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1540035e0 con 0x7fb14c024320 2026-02-12T18:06:37.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 1 -- 10.20.193.48:0/180607918 <== mon.1 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2562875566 0 0) 0x7fb1540035e0 con 0x7fb14c024320 2026-02-12T18:06:37.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 1 -- 10.20.193.48:0/180607918 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb14c003970 msgr2=0x7fb14c023d90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:06:37.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb14c003970 0x7fb14c023d90 unknown :-1 s=START_CONNECT pgs=0 gs=34 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 1 -- 10.20.193.48:0/180607918 >> v2:10.20.193.48:3300/0 conn(0x7fb14c046040 msgr2=0x7fb14c0664f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:06:37.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 1 --2- 10.20.193.48:0/180607918 >> v2:10.20.193.48:3300/0 conn(0x7fb14c046040 0x7fb14c0664f0 unknown :-1 s=START_CONNECT pgs=0 gs=32 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 10 monclient: _finish_hunting 0 2026-02-12T18:06:37.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 1 monclient: found mon.noname-f-legacy 2026-02-12T18:06:37.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb167577640 1 -- 10.20.193.48:0/180607918 reap_dead start 2026-02-12T18:06:37.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:37.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 10 monclient: _send_mon_message to mon.noname-f-legacy at v1:10.20.193.111:6789/0 2026-02-12T18:06:37.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 1 -- 10.20.193.48:0/180607918 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14c067dc0 con 0x7fb14c024320 2026-02-12T18:06:37.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 10 monclient: _finish_auth 0 2026-02-12T18:06:37.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 10 monclient: _check_auth_tickets 2026-02-12T18:06:37.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:37.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 1 -- 10.20.193.48:0/180607918 <== mon.1 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (unknown 3750814960 0 0) 0x7fb15000ca40 con 0x7fb14c024320 2026-02-12T18:06:37.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 10 monclient: got monmap 1 from mon.noname-f-legacy (according to old e1) 2026-02-12T18:06:37.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 10 monclient: dump: 2026-02-12T18:06:37.105 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.105 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.105 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.105 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.105 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.105 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.105 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.105 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.105 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.106 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.106 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.106 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.106 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.106 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.106 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.106 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 1 monclient: mon.f has (v2) addrs [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] but i'm connected to v1:10.20.193.111:6789/0, reconnecting 2026-02-12T18:06:37.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:37.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 1 -- 10.20.193.48:0/180607918 >> v1:10.20.193.111:6789/0 conn(0x7fb14c024320 legacy=0x7fb14c0447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 10 monclient: _add_conns ranks=[8,2,6,1,4,7,0,5,3] 2026-02-12T18:06:37.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb154004280 0x7fb154004850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 10 monclient(hunting): picked mon.e con 0x7fb154004280 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:37.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb154004eb0 0x7fb154005320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 10 monclient(hunting): picked mon.b con 0x7fb154004eb0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:37.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb154045c40 0x7fb1540660a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 10 monclient(hunting): picked mon.d con 0x7fb154045c40 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:06:37.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 1 -- 10.20.193.48:0/180607918 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fb168092be0 con 0x7fb154004eb0 2026-02-12T18:06:37.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 1 -- 10.20.193.48:0/180607918 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fb16808b230 con 0x7fb154045c40 2026-02-12T18:06:37.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 1 -- 10.20.193.48:0/180607918 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fb1540669b0 con 0x7fb154004280 2026-02-12T18:06:37.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:37.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb165d74640 10 monclient(hunting): _finish_auth 0 2026-02-12T18:06:37.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.091+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb154004280 0x7fb154004850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=35 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166575640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb154004eb0 0x7fb154005320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=36 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166d76640 10 monclient(hunting): get_auth_request con 0x7fb154004280 auth_method 0 2026-02-12T18:06:37.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166d76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:06:37.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb167577640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb154045c40 0x7fb1540660a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=37 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166575640 10 monclient(hunting): get_auth_request con 0x7fb154004eb0 auth_method 0 2026-02-12T18:06:37.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:06:37.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb167577640 10 monclient(hunting): get_auth_request con 0x7fb154045c40 auth_method 0 2026-02-12T18:06:37.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb167577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb167577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb167577640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:06:37.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166d76640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:06:37.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166575640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:06:37.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb167577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb167577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb167577640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:06:37.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166d76640 10 monclient(hunting): handle_auth_done global_id 4483 payload 293 2026-02-12T18:06:37.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166d76640 1 -- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb154045c40 msgr2=0x7fb1540660a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:37.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb154045c40 0x7fb1540660a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=37 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166d76640 1 -- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb154004eb0 msgr2=0x7fb154005320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:37.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb154004eb0 0x7fb154005320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=36 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166d76640 10 monclient: _finish_hunting 0 2026-02-12T18:06:37.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166d76640 1 monclient: found mon.e 2026-02-12T18:06:37.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:37.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166d76640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:37.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166d76640 1 -- 10.20.193.48:0/180607918 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1540035e0 con 0x7fb154004280 2026-02-12T18:06:37.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166d76640 10 monclient: _finish_auth 0 2026-02-12T18:06:37.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166d76640 10 monclient: _check_auth_tickets 2026-02-12T18:06:37.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb166d76640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:37.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb16d012640 5 monclient: authenticate success, global_id 4483 2026-02-12T18:06:37.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.092+0000 7fb16d012640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:37.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.094+0000 7fb166d76640 1 -- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb154004280 msgr2=0x7fb154004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:37.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.094+0000 7fb166d76640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb154004280 0x7fb154004850 secure :-1 s=READY pgs=64 gs=35 cs=0 l=1 c_cookie=10693491148703663858 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb15c004740 tx=0x7fb15c030b50 comp rx=0 tx=0).ready entity=mon.8 client_cookie=9466e98b0f4406f2 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.094+0000 7fb165d74640 1 -- 10.20.193.48:0/180607918 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb15c035a00 con 0x7fb154004280 2026-02-12T18:06:37.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.094+0000 7fb165d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.094+0000 7fb165d74640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:06:37.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.094+0000 7fb165d74640 10 monclient: dump: 2026-02-12T18:06:37.111 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.112 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.112 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.112 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.112 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.112 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.112 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.112 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.112 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.112 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.112 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.112 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.112 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.112 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.113 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.113 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.094+0000 7fb16d012640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:37.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.094+0000 7fb165d74640 1 -- 10.20.193.48:0/180607918 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb15c00c040 con 0x7fb154004280 2026-02-12T18:06:37.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.094+0000 7fb165d74640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:37.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.094+0000 7fb165d74640 1 -- 10.20.193.48:0/180607918 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb15c035b60 con 0x7fb154004280 2026-02-12T18:06:37.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.094+0000 7fb16d012640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:37.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.094+0000 7fb16d012640 4 set_mon_vals no callback set 2026-02-12T18:06:37.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.094+0000 7fb165d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.094+0000 7fb165d74640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:06:37.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.094+0000 7fb165d74640 10 monclient: dump: 2026-02-12T18:06:37.114 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.114 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.114 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.114 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.114 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.114 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.114 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.114 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.114 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.115 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.115 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.115 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.115 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.115 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.115 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.115 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.095+0000 7fb16d012640 10 monclient: shutdown 2026-02-12T18:06:37.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.095+0000 7fb16d012640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:37.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.095+0000 7fb16d012640 1 -- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb154004280 msgr2=0x7fb154004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.095+0000 7fb16d012640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb154004280 0x7fb154004850 secure :-1 s=READY pgs=64 gs=35 cs=0 l=1 c_cookie=10693491148703663858 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb15c004740 tx=0x7fb15c030b50 comp rx=0 tx=0).stop 2026-02-12T18:06:37.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.095+0000 7fb16d012640 1 -- 10.20.193.48:0/180607918 shutdown_connections 2026-02-12T18:06:37.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.095+0000 7fb16d012640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb154045c40 0x7fb1540660a0 unknown :-1 s=CLOSED pgs=0 gs=37 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.095+0000 7fb16d012640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb154004280 0x7fb154004850 unknown :-1 s=CLOSED pgs=64 gs=35 cs=0 l=1 c_cookie=10693491148703663858 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.095+0000 7fb16d012640 1 --2- 10.20.193.48:0/180607918 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb154004eb0 0x7fb154005320 unknown :-1 s=CLOSED pgs=0 gs=36 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.095+0000 7fb16d012640 1 -- 10.20.193.48:0/180607918 >> 10.20.193.48:0/180607918 conn(0x7fb1680546d0 msgr2=0x7fb168054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:37.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.095+0000 7fb16d012640 1 -- 10.20.193.48:0/180607918 shutdown_connections 2026-02-12T18:06:37.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.095+0000 7fb16d012640 1 -- 10.20.193.48:0/180607918 wait complete. 2026-02-12T18:06:37.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.096+0000 7fb16d012640 10 monclient: build_initial_monmap 2026-02-12T18:06:37.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.096+0000 7fb16d012640 10 monclient: monmap: 2026-02-12T18:06:37.116 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:37.116 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:37.116 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:37.117 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:37.117 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:37.117 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.117 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:37.117 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:37.117 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:37.117 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:37.117 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:37.117 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:37.117 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:37.117 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:37.117 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:37.117 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.096+0000 7fb16d012640 1 Processor -- start 2026-02-12T18:06:37.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.096+0000 7fb16d012640 1 -- start start 2026-02-12T18:06:37.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.096+0000 7fb16d012640 10 monclient: init 2026-02-12T18:06:37.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.096+0000 7fb16d012640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:37.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.096+0000 7fb16d012640 10 monclient: _add_conns ranks=[8,4,5,7,0,3,2,1,6] 2026-02-12T18:06:37.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.096+0000 7fb16d012640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb14c024320 0x7fb1681db2a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.096+0000 7fb16d012640 10 monclient(hunting): picked mon.noname-e con 0x7fb14c024320 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:37.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.096+0000 7fb16d012640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb154004280 0x7fb1681db7e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.096+0000 7fb16d012640 10 monclient(hunting): picked mon.noname-c con 0x7fb154004280 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:06:37.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.096+0000 7fb16d012640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb154004eb0 0x7fb16812e950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.096+0000 7fb16d012640 10 monclient(hunting): picked mon.noname-h con 0x7fb154004eb0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:37.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.096+0000 7fb16d012640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.096+0000 7fb16d012640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fb168132610 con 0x7fb154004280 2026-02-12T18:06:37.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.096+0000 7fb16d012640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.096+0000 7fb16d012640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fb1681423f0 con 0x7fb154004eb0 2026-02-12T18:06:37.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.096+0000 7fb16d012640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.096+0000 7fb16d012640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fb168130750 con 0x7fb14c024320 2026-02-12T18:06:37.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.096+0000 7fb16d012640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:37.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.096+0000 7fb16d012640 10 monclient(hunting): authenticate will time out at 635.822917s 2026-02-12T18:06:37.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.096+0000 7fb166575640 1 -- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb154004280 msgr2=0x7fb1681db7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.48:3302/0 2026-02-12T18:06:37.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.096+0000 7fb166575640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb154004280 0x7fb1681db7e0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:06:37.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.096+0000 7fb166d76640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb14c024320 0x7fb1681db2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb166d76640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb14c024320 0x7fb1681db2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:58052/0 (socket says 10.20.193.48:58052) 2026-02-12T18:06:37.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb166d76640 1 -- 10.20.193.48:0/3827088355 learned_addr learned my addr 10.20.193.48:0/3827088355 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:37.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb166d76640 10 monclient(hunting): get_auth_request con 0x7fb14c024320 auth_method 0 2026-02-12T18:06:37.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb166d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb166d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb166d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb166d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb166d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb166d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb167577640 1 --2- 10.20.193.48:0/3827088355 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb154004eb0 0x7fb16812e950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb167577640 10 monclient(hunting): get_auth_request con 0x7fb154004eb0 auth_method 0 2026-02-12T18:06:37.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb167577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb167577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb167577640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb167577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb167577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb167577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb166d76640 10 monclient(hunting): handle_auth_done global_id 4508 payload 824 2026-02-12T18:06:37.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb166d76640 1 -- 10.20.193.48:0/3827088355 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb154004eb0 msgr2=0x7fb16812e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb166d76640 1 --2- 10.20.193.48:0/3827088355 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb154004eb0 0x7fb16812e950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb166d76640 1 -- 10.20.193.48:0/3827088355 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb154004280 msgr2=0x7fb1681db7e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:06:37.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb166d76640 1 --2- 10.20.193.48:0/3827088355 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb154004280 0x7fb1681db7e0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb166d76640 10 monclient: _finish_hunting 0 2026-02-12T18:06:37.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb166d76640 1 monclient: found mon.noname-e 2026-02-12T18:06:37.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb166d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:37.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb166d76640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:06:37.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.097+0000 7fb166d76640 1 -- 10.20.193.48:0/3827088355 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb168132330 con 0x7fb14c024320 2026-02-12T18:06:37.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.099+0000 7fb166d76640 1 -- 10.20.193.48:0/3827088355 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb14c024320 msgr2=0x7fb1681db2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:37.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.099+0000 7fb166d76640 1 --2- 10.20.193.48:0/3827088355 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb14c024320 0x7fb1681db2a0 secure :-1 s=READY pgs=65 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb15c019450 tx=0x7fb15c0047e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.099+0000 7fb1477fe640 1 -- 10.20.193.48:0/3827088355 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb15c042040 con 0x7fb14c024320 2026-02-12T18:06:37.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.099+0000 7fb1477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.099+0000 7fb1477fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:06:37.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.099+0000 7fb1477fe640 10 monclient: dump: 2026-02-12T18:06:37.122 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.122 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.122 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.122 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.123 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.123 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.123 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.123 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.123 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.123 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.123 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.123 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.123 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.123 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.124 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.124 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.099+0000 7fb1477fe640 10 monclient: _finish_auth 0 2026-02-12T18:06:37.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.099+0000 7fb1477fe640 10 monclient: _check_auth_tickets 2026-02-12T18:06:37.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.099+0000 7fb1477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:37.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.099+0000 7fb1477fe640 1 -- 10.20.193.48:0/3827088355 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb15c035e40 con 0x7fb14c024320 2026-02-12T18:06:37.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.099+0000 7fb16d012640 5 monclient: authenticate success, global_id 4508 2026-02-12T18:06:37.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.099+0000 7fb16d012640 10 monclient: _renew_subs 2026-02-12T18:06:37.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.099+0000 7fb16d012640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:37.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.099+0000 7fb16d012640 1 -- 10.20.193.48:0/3827088355 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb168142010 con 0x7fb14c024320 2026-02-12T18:06:37.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.099+0000 7fb1477fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:37.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.099+0000 7fb1477fe640 1 -- 10.20.193.48:0/3827088355 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb15c006cc0 con 0x7fb14c024320 2026-02-12T18:06:37.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.099+0000 7fb1477fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.099+0000 7fb165573640 4 set_mon_vals no callback set 2026-02-12T18:06:37.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.099+0000 7fb1477fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:06:37.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.099+0000 7fb1477fe640 10 monclient: dump: 2026-02-12T18:06:37.125 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.125 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.125 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.125 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.125 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.125 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.125 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.126 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.126 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.126 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.126 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.126 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.126 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.126 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.126 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.126 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.099+0000 7fb16d012640 10 monclient: _renew_subs 2026-02-12T18:06:37.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.099+0000 7fb16d012640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:37.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.099+0000 7fb16d012640 1 -- 10.20.193.48:0/3827088355 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fb168131d70 con 0x7fb14c024320 2026-02-12T18:06:37.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.100+0000 7fb16d012640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:37.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.100+0000 7fb16d012640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:37.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.100+0000 7fb16d012640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:37.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.100+0000 7fb16d012640 1 -- 10.20.193.48:0/3827088355 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb168130750 con 0x7fb14c024320 2026-02-12T18:06:37.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.100+0000 7fb1477fe640 1 -- 10.20.193.48:0/3827088355 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fb15c03d820 con 0x7fb14c024320 2026-02-12T18:06:37.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.100+0000 7fb1477fe640 1 --2- 10.20.193.48:0/3827088355 >> v2:10.20.193.111:6812/977811348 conn(0x7fb13403f7c0 0x7fb13405fc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.100+0000 7fb1477fe640 1 -- 10.20.193.48:0/3827088355 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(20..20 src has 1..20) ==== 3897+0+0 (secure 0 0 0) 0x7fb15c079a80 con 0x7fb14c024320 2026-02-12T18:06:37.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.100+0000 7fb166575640 1 --2- 10.20.193.48:0/3827088355 >> v2:10.20.193.111:6812/977811348 conn(0x7fb13403f7c0 0x7fb13405fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.100+0000 7fb166575640 10 monclient: get_auth_request con 0x7fb13403f7c0 auth_method 0 2026-02-12T18:06:37.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.103+0000 7fb1477fe640 1 -- 10.20.193.48:0/3827088355 <== mon.8 v2:10.20.193.48:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fb15c00f040 con 0x7fb14c024320 2026-02-12T18:06:37.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.103+0000 7fb1477fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:37.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.103+0000 7fb1477fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:37.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.103+0000 7fb166575640 1 --2- 10.20.193.48:0/3827088355 >> v2:10.20.193.111:6812/977811348 conn(0x7fb13403f7c0 0x7fb13405fc70 secure :-1 s=READY pgs=79 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb150004740 tx=0x7fb150008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.206 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[26687]: starting. 2026-02-12T18:06:37.206 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[26687]: creating pool ceph_test_rados_delete_pools_parallel.trial111-26686 2026-02-12T18:06:37.206 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[26687]: created object 0... 2026-02-12T18:06:37.206 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[26687]: created object 25... 2026-02-12T18:06:37.206 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[26687]: created object 49... 2026-02-12T18:06:37.207 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[26687]: finishing. 2026-02-12T18:06:37.207 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[26687]: shutting down. 2026-02-12T18:06:37.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.254+0000 7fb16d012640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T18:06:37.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.254+0000 7fb16d012640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T18:06:37.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.254+0000 7fb16d012640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:37.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.254+0000 7fb16d012640 1 -- 10.20.193.48:0/3827088355 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb1680637d0 con 0x7fb14c024320 2026-02-12T18:06:37.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.255+0000 7fb1477fe640 1 -- 10.20.193.48:0/3827088355 <== mon.8 v2:10.20.193.48:3304/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3648 (secure 0 0 0) 0x7fb15c039070 con 0x7fb14c024320 2026-02-12T18:06:37.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.255+0000 7fb1477fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T18:06:37.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.255+0000 7fb1477fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:37.257 INFO:teuthology.orchestra.run.trial048.stdout:{"election_epoch":18,"quorum":[0,1,2,3,5,6,8],"quorum_names":["a","f","b","g","h","d","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","modified":"2026-02-12T18:05:32.850777Z","created":"2026-02-12T18:05:32.850777Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3300","nonce":0},{"type":"v1","addr":"10.20.193.48:6789","nonce":0}]},"addr":"10.20.193.48:6789/0","public_addr":"10.20.193.48:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850827+0000","crush_location":[]},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3300","nonce":0},{"type":"v1","addr":"10.20.193.111:6789","nonce":0}]},"addr":"10.20.193.111:6789/0","public_addr":"10.20.193.111:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850829+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3301","nonce":0},{"type":"v1","addr":"10.20.193.48:6790","nonce":0}]},"addr":"10.20.193.48:6790/0","public_addr":"10.20.193.48:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850830+0000","crush_location":[]},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3301","nonce":0},{"type":"v1","addr":"10.20.193.111:6790","nonce":0}]},"addr":"10.20.193.111:6790/0","public_addr":"10.20.193.111:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850833+0000","crush_location":[]},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3302","nonce":0},{"type":"v1","addr":"10.20.193.48:6791","nonce":0}]},"addr":"10.20.193.48:6791/0","public_addr":"10.20.193.48:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3302","nonce":0},{"type":"v1","addr":"10.20.193.111:6791","nonce":0}]},"addr":"10.20.193.111:6791/0","public_addr":"10.20.193.111:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850834+0000","crush_location":[]},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3303","nonce":0},{"type":"v1","addr":"10.20.193.48:6792","nonce":0}]},"addr":"10.20.193.48:6792/0","public_addr":"10.20.193.48:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3303","nonce":0},{"type":"v1","addr":"10.20.193.111:6792","nonce":0}]},"addr":"10.20.193.111:6792/0","public_addr":"10.20.193.111:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850835+0000","crush_location":[]},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3304","nonce":0},{"type":"v1","addr":"10.20.193.48:6793","nonce":0}]},"addr":"10.20.193.48:6793/0","public_addr":"10.20.193.48:6793/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850832+0000","crush_location":[]}]}} 2026-02-12T18:06:37.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.257+0000 7fb16d012640 1 -- 10.20.193.48:0/3827088355 >> v2:10.20.193.111:6812/977811348 conn(0x7fb13403f7c0 msgr2=0x7fb13405fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.257+0000 7fb16d012640 1 --2- 10.20.193.48:0/3827088355 >> v2:10.20.193.111:6812/977811348 conn(0x7fb13403f7c0 0x7fb13405fc70 secure :-1 s=READY pgs=79 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb150004740 tx=0x7fb150008040 comp rx=0 tx=0).stop 2026-02-12T18:06:37.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.257+0000 7fb16d012640 10 monclient: shutdown 2026-02-12T18:06:37.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.257+0000 7fb16d012640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:37.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.257+0000 7fb16d012640 1 -- 10.20.193.48:0/3827088355 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb14c024320 msgr2=0x7fb1681db2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.257+0000 7fb16d012640 1 --2- 10.20.193.48:0/3827088355 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb14c024320 0x7fb1681db2a0 secure :-1 s=READY pgs=65 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb15c019450 tx=0x7fb15c0047e0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.257+0000 7fb16d012640 1 -- 10.20.193.48:0/3827088355 shutdown_connections 2026-02-12T18:06:37.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.257+0000 7fb16d012640 1 --2- 10.20.193.48:0/3827088355 >> v2:10.20.193.111:6812/977811348 conn(0x7fb13403f7c0 0x7fb13405fc70 unknown :-1 s=CLOSED pgs=79 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.257+0000 7fb16d012640 1 --2- 10.20.193.48:0/3827088355 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb154004eb0 0x7fb16812e950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.257+0000 7fb16d012640 1 --2- 10.20.193.48:0/3827088355 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb154004280 0x7fb1681db7e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.257+0000 7fb16d012640 1 --2- 10.20.193.48:0/3827088355 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb14c024320 0x7fb1681db2a0 unknown :-1 s=CLOSED pgs=65 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.257+0000 7fb16d012640 1 -- 10.20.193.48:0/3827088355 >> 10.20.193.48:0/3827088355 conn(0x7fb1680546d0 msgr2=0x7fb168089df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:37.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.257+0000 7fb16d012640 1 -- 10.20.193.48:0/3827088355 shutdown_connections 2026-02-12T18:06:37.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.257+0000 7fb16d012640 1 -- 10.20.193.48:0/3827088355 wait complete. 2026-02-12T18:06:37.267 INFO:tasks.mon_thrash.ceph_manager:quorum is size 7 2026-02-12T18:06:37.268 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon a 2026-02-12T18:06:37.268 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T18:06:37.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.332+0000 7ff8540cc640 10 monclient: get_monmap_and_config 2026-02-12T18:06:37.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.332+0000 7ff8540cc640 10 monclient: build_initial_monmap 2026-02-12T18:06:37.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.332+0000 7ff8540cc640 10 monclient: monmap: 2026-02-12T18:06:37.333 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:37.333 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.333 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:37.333463+0000 2026-02-12T18:06:37.334 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:37.333463+0000 2026-02-12T18:06:37.334 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:37.334 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.334 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:37.334 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:37.334 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:37.334 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:37.334 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:37.334 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:37.334 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:37.334 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:37.334 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:37.335 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:37.335 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:37.335 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.332+0000 7ff8540cc640 1 Processor -- start 2026-02-12T18:06:37.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.332+0000 7ff8540cc640 1 -- start start 2026-02-12T18:06:37.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.332+0000 7ff8540cc640 10 monclient: init 2026-02-12T18:06:37.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff8540cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:37.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff8540cc640 10 monclient: _add_conns ranks=[5,6,2,8,3,9,10,7,4,1,0] 2026-02-12T18:06:37.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff8540cc640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff84c05c950 0x7ff84c05cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff8540cc640 10 monclient(hunting): picked mon.noname-h con 0x7ff84c05c950 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:37.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff8540cc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff84c05e490 0x7ff84c05d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff8540cc640 10 monclient(hunting): picked mon.noname-d con 0x7ff84c05e490 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:06:37.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff8540cc640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff84c13db70 0x7ff84c13dfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff8540cc640 10 monclient(hunting): picked mon.noname-b con 0x7ff84c13db70 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:37.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff8540cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff8540cc640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7ff84c05ddd0 con 0x7ff84c13db70 2026-02-12T18:06:37.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff8540cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff8540cc640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7ff84c05d7a0 con 0x7ff84c05c950 2026-02-12T18:06:37.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff8540cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff8540cc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7ff84c092990 con 0x7ff84c05e490 2026-02-12T18:06:37.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff8540cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:37.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff8540cc640 10 monclient(hunting): authenticate will time out at 636.059243s 2026-02-12T18:06:37.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff852642640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff84c13db70 0x7ff84c13dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff852642640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff84c13db70 0x7ff84c13dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:34222/0 (socket says 10.20.193.48:34222) 2026-02-12T18:06:37.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff852642640 1 -- 10.20.193.48:0/2114055587 learned_addr learned my addr 10.20.193.48:0/2114055587 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:37.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff851640640 1 --2- 10.20.193.48:0/2114055587 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff84c05e490 0x7ff84c05d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff852642640 10 monclient(hunting): get_auth_request con 0x7ff84c13db70 auth_method 0 2026-02-12T18:06:37.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff852642640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff852642640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff852642640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff851640640 10 monclient(hunting): get_auth_request con 0x7ff84c05e490 auth_method 0 2026-02-12T18:06:37.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff851640640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff851640640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff851640640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff852642640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff852642640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff852642640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff851640640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff851640640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff851e41640 1 --2- 10.20.193.48:0/2114055587 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff84c05c950 0x7ff84c05cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff851640640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff851e41640 10 monclient(hunting): get_auth_request con 0x7ff84c05c950 auth_method 0 2026-02-12T18:06:37.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff851e41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff851e41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff851e41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff852642640 10 monclient(hunting): handle_auth_done global_id 34364 payload 274 2026-02-12T18:06:37.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff852642640 1 -- 10.20.193.48:0/2114055587 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff84c05e490 msgr2=0x7ff84c05d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:37.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff852642640 1 --2- 10.20.193.48:0/2114055587 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff84c05e490 0x7ff84c05d260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff852642640 1 -- 10.20.193.48:0/2114055587 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff84c05c950 msgr2=0x7ff84c05cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:37.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff852642640 1 --2- 10.20.193.48:0/2114055587 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff84c05c950 0x7ff84c05cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff852642640 10 monclient: _finish_hunting 0 2026-02-12T18:06:37.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff852642640 1 monclient: found mon.noname-b 2026-02-12T18:06:37.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff852642640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:37.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff852642640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:06:37.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff852642640 1 -- 10.20.193.48:0/2114055587 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff84c04dc20 con 0x7ff84c13db70 2026-02-12T18:06:37.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.333+0000 7ff851640640 1 --2- 10.20.193.48:0/2114055587 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff84c05e490 0x7ff84c05d260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:06:37.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff852642640 1 -- 10.20.193.48:0/2114055587 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff84c13db70 msgr2=0x7ff84c13dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:37.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff852642640 1 --2- 10.20.193.48:0/2114055587 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff84c13db70 0x7ff84c13dfc0 secure :-1 s=READY pgs=51 gs=1 cs=0 l=1 c_cookie=5178623026326036734 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff84800a9b0 tx=0x7ff84802fef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47de2a3475d260fe server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff850e3f640 1 -- 10.20.193.48:0/2114055587 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff848030b70 con 0x7ff84c13db70 2026-02-12T18:06:37.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff850e3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff850e3f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:06:37.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff850e3f640 10 monclient: dump: 2026-02-12T18:06:37.352 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.352 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.352 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.352 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.352 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.352 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.352 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.352 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.352 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.352 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.353 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.353 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.353 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.353 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.353 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.353 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff850e3f640 10 monclient: _finish_auth 0 2026-02-12T18:06:37.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff850e3f640 10 monclient: _check_auth_tickets 2026-02-12T18:06:37.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff850e3f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:37.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff850e3f640 1 -- 10.20.193.48:0/2114055587 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff848030cf0 con 0x7ff84c13db70 2026-02-12T18:06:37.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff850e3f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:37.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff8540cc640 5 monclient: authenticate success, global_id 34364 2026-02-12T18:06:37.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff850e3f640 1 -- 10.20.193.48:0/2114055587 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff848030e60 con 0x7ff84c13db70 2026-02-12T18:06:37.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff8540cc640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:37.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff8540cc640 4 set_mon_vals no callback set 2026-02-12T18:06:37.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff850e3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff850e3f640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:06:37.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff850e3f640 10 monclient: dump: 2026-02-12T18:06:37.354 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.354 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.354 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.354 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.354 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.354 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.355 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.355 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.355 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.355 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.355 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.355 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.355 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.355 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.355 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.355 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff8540cc640 10 monclient: shutdown 2026-02-12T18:06:37.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff8540cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:37.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff8540cc640 1 -- 10.20.193.48:0/2114055587 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff84c13db70 msgr2=0x7ff84c13dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff8540cc640 1 --2- 10.20.193.48:0/2114055587 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff84c13db70 0x7ff84c13dfc0 secure :-1 s=READY pgs=51 gs=1 cs=0 l=1 c_cookie=5178623026326036734 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff84800a9b0 tx=0x7ff84802fef0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff8540cc640 1 -- 10.20.193.48:0/2114055587 shutdown_connections 2026-02-12T18:06:37.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff8540cc640 1 --2- 10.20.193.48:0/2114055587 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff84c13db70 0x7ff84c13dfc0 unknown :-1 s=CLOSED pgs=51 gs=1 cs=0 l=1 c_cookie=5178623026326036734 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff8540cc640 1 --2- 10.20.193.48:0/2114055587 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff84c05e490 0x7ff84c05d260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff8540cc640 1 --2- 10.20.193.48:0/2114055587 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff84c05c950 0x7ff84c05cd20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff8540cc640 1 -- 10.20.193.48:0/2114055587 >> 10.20.193.48:0/2114055587 conn(0x7ff84c0548a0 msgr2=0x7ff84c097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:37.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff8540cc640 1 -- 10.20.193.48:0/2114055587 shutdown_connections 2026-02-12T18:06:37.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.336+0000 7ff8540cc640 1 -- 10.20.193.48:0/2114055587 wait complete. 2026-02-12T18:06:37.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.337+0000 7ff8540cc640 10 monclient: build_initial_monmap 2026-02-12T18:06:37.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.337+0000 7ff8540cc640 10 monclient: monmap: 2026-02-12T18:06:37.356 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:37.356 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:37.357 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:37.357 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:37.357 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:37.357 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.357 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:37.357 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:37.357 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:37.357 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:37.357 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:37.357 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:37.357 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:37.357 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:37.358 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:37.358 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.337+0000 7ff8540cc640 1 Processor -- start 2026-02-12T18:06:37.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.337+0000 7ff8540cc640 1 -- start start 2026-02-12T18:06:37.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.337+0000 7ff8540cc640 10 monclient: init 2026-02-12T18:06:37.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.337+0000 7ff8540cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:37.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff8540cc640 10 monclient: _add_conns ranks=[2,8,3,0,5,4,6,7,1] 2026-02-12T18:06:37.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff8540cc640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff84c05c950 0x7ff84c12c7f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff8540cc640 10 monclient(hunting): picked mon.noname-b con 0x7ff84c05c950 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:37.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff8540cc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff84c05e490 0x7ff84c08d330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff8540cc640 10 monclient(hunting): picked mon.noname-e con 0x7ff84c05e490 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:37.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff8540cc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff84c13db70 0x7ff84c08d870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff8540cc640 10 monclient(hunting): picked mon.noname-g con 0x7ff84c13db70 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:37.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff8540cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff8540cc640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7ff84c08a550 con 0x7ff84c05c950 2026-02-12T18:06:37.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff8540cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff8540cc640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff84c13e920 con 0x7ff84c13db70 2026-02-12T18:06:37.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff8540cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff8540cc640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7ff84c140a40 con 0x7ff84c05e490 2026-02-12T18:06:37.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff8540cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:37.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff8540cc640 10 monclient(hunting): authenticate will time out at 636.064048s 2026-02-12T18:06:37.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851e41640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff84c05c950 0x7ff84c12c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851e41640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff84c05c950 0x7ff84c12c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:34226/0 (socket says 10.20.193.48:34226) 2026-02-12T18:06:37.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851640640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff84c05e490 0x7ff84c08d330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851640640 10 monclient(hunting): get_auth_request con 0x7ff84c05e490 auth_method 0 2026-02-12T18:06:37.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851640640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851640640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851640640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851e41640 1 -- 10.20.193.48:0/2647492019 learned_addr learned my addr 10.20.193.48:0/2647492019 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:37.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851e41640 10 monclient(hunting): get_auth_request con 0x7ff84c05c950 auth_method 0 2026-02-12T18:06:37.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851e41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851e41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851e41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851640640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851640640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851640640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851e41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851e41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851e41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff852642640 1 --2- 10.20.193.48:0/2647492019 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff84c13db70 0x7ff84c08d870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff852642640 10 monclient(hunting): get_auth_request con 0x7ff84c13db70 auth_method 0 2026-02-12T18:06:37.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff852642640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff852642640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff852642640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851640640 10 monclient(hunting): handle_auth_done global_id 4517 payload 824 2026-02-12T18:06:37.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851640640 1 -- 10.20.193.48:0/2647492019 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff84c13db70 msgr2=0x7ff84c08d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851640640 1 --2- 10.20.193.48:0/2647492019 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff84c13db70 0x7ff84c08d870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851640640 1 -- 10.20.193.48:0/2647492019 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff84c05c950 msgr2=0x7ff84c12c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851640640 1 --2- 10.20.193.48:0/2647492019 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff84c05c950 0x7ff84c12c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851640640 10 monclient: _finish_hunting 0 2026-02-12T18:06:37.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851640640 1 monclient: found mon.noname-e 2026-02-12T18:06:37.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851640640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:37.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851640640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:06:37.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.338+0000 7ff851640640 1 -- 10.20.193.48:0/2647492019 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff840009420 con 0x7ff84c05e490 2026-02-12T18:06:37.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.340+0000 7ff851640640 1 -- 10.20.193.48:0/2647492019 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff84c05e490 msgr2=0x7ff84c08d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:37.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.340+0000 7ff851640640 1 --2- 10.20.193.48:0/2647492019 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff84c05e490 0x7ff84c08d330 secure :-1 s=READY pgs=66 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff840004740 tx=0x7ff84000ee20 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.340+0000 7ff83a7fc640 1 -- 10.20.193.48:0/2647492019 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff840004450 con 0x7ff84c05e490 2026-02-12T18:06:37.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.340+0000 7ff83a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.340+0000 7ff83a7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:06:37.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.340+0000 7ff83a7fc640 10 monclient: dump: 2026-02-12T18:06:37.363 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.363 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.363 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.363 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.363 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.363 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.363 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.363 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.363 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.364 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.364 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.364 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.364 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.364 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.364 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.364 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.340+0000 7ff83a7fc640 10 monclient: _finish_auth 0 2026-02-12T18:06:37.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.340+0000 7ff83a7fc640 10 monclient: _check_auth_tickets 2026-02-12T18:06:37.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.340+0000 7ff83a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:37.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.340+0000 7ff83a7fc640 1 -- 10.20.193.48:0/2647492019 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8400045d0 con 0x7ff84c05e490 2026-02-12T18:06:37.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.340+0000 7ff8540cc640 5 monclient: authenticate success, global_id 4517 2026-02-12T18:06:37.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.340+0000 7ff8540cc640 10 monclient: _renew_subs 2026-02-12T18:06:37.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.340+0000 7ff8540cc640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:37.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.340+0000 7ff8540cc640 1 -- 10.20.193.48:0/2647492019 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff84800a5d0 con 0x7ff84c05e490 2026-02-12T18:06:37.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.340+0000 7ff83a7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:37.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.340+0000 7ff83a7fc640 1 -- 10.20.193.48:0/2647492019 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff84000cc80 con 0x7ff84c05e490 2026-02-12T18:06:37.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.340+0000 7ff83a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.340+0000 7ff83bfff640 4 set_mon_vals no callback set 2026-02-12T18:06:37.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.340+0000 7ff83a7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:06:37.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.340+0000 7ff83a7fc640 10 monclient: dump: 2026-02-12T18:06:37.365 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.365 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.366 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.366 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.366 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.366 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.366 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.366 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.366 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.366 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.366 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.366 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.366 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.366 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.366 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.367 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.340+0000 7ff8540cc640 10 monclient: _renew_subs 2026-02-12T18:06:37.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.340+0000 7ff8540cc640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:37.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.340+0000 7ff8540cc640 1 -- 10.20.193.48:0/2647492019 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7ff84c143be0 con 0x7ff84c05e490 2026-02-12T18:06:37.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.341+0000 7ff8540cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:37.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.341+0000 7ff8540cc640 1 --2- 10.20.193.48:0/2647492019 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff84c13cc20 0x7ff84c13cff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.341+0000 7ff8540cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.341+0000 7ff8540cc640 1 -- 10.20.193.48:0/2647492019 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7ff84c05f140 con 0x7ff84c13cc20 2026-02-12T18:06:37.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.341+0000 7ff851e41640 1 --2- 10.20.193.48:0/2647492019 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff84c13cc20 0x7ff84c13cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.341+0000 7ff851e41640 10 monclient: get_auth_request con 0x7ff84c13cc20 auth_method 0 2026-02-12T18:06:37.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.341+0000 7ff851e41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.341+0000 7ff851e41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.341+0000 7ff851e41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.341+0000 7ff851e41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.341+0000 7ff851e41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.341+0000 7ff851e41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.341+0000 7ff83a7fc640 1 -- 10.20.193.48:0/2647492019 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7ff840023020 con 0x7ff84c05e490 2026-02-12T18:06:37.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.341+0000 7ff851e41640 10 monclient(hunting): handle_auth_done global_id 4545 payload 824 2026-02-12T18:06:37.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.341+0000 7ff851e41640 1 -- 10.20.193.48:0/2647492019 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff84c097de0 con 0x7ff84c13cc20 2026-02-12T18:06:37.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.341+0000 7ff83a7fc640 1 --2- 10.20.193.48:0/2647492019 >> v2:10.20.193.111:6812/977811348 conn(0x7ff81c03f800 0x7ff81c05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.341+0000 7ff83a7fc640 1 -- 10.20.193.48:0/2647492019 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(21..21 src has 1..21) ==== 3897+0+0 (secure 0 0 0) 0x7ff840053050 con 0x7ff84c05e490 2026-02-12T18:06:37.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.341+0000 7ff852642640 1 --2- 10.20.193.48:0/2647492019 >> v2:10.20.193.111:6812/977811348 conn(0x7ff81c03f800 0x7ff81c05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.341+0000 7ff852642640 10 monclient: get_auth_request con 0x7ff81c03f800 auth_method 0 2026-02-12T18:06:37.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.343+0000 7ff851e41640 1 -- 10.20.193.48:0/2647492019 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff84c13cc20 msgr2=0x7ff84c13cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:37.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.343+0000 7ff851e41640 1 --2- 10.20.193.48:0/2647492019 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff84c13cc20 0x7ff84c13cff0 secure :-1 s=READY pgs=116 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff83c006f30 tx=0x7ff83c011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.343+0000 7ff83a7fc640 1 -- 10.20.193.48:0/2647492019 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff83c004450 con 0x7ff84c13cc20 2026-02-12T18:06:37.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.343+0000 7ff83a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.343+0000 7ff83a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:37.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.343+0000 7ff83a7fc640 10 monclient: dump: 2026-02-12T18:06:37.369 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.369 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.369 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.369 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.369 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.369 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.369 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.369 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.369 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.369 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.370 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.370 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.370 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.370 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.370 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.370 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.343+0000 7ff83a7fc640 1 -- 10.20.193.48:0/2647492019 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7ff83c0045b0 con 0x7ff84c13cc20 2026-02-12T18:06:37.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.343+0000 7ff83a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:37.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.343+0000 7ff83a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:37.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.343+0000 7ff83a7fc640 1 -- 10.20.193.48:0/2647492019 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff84c13cc20 msgr2=0x7ff84c13cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.343+0000 7ff83a7fc640 1 --2- 10.20.193.48:0/2647492019 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff84c13cc20 0x7ff84c13cff0 secure :-1 s=READY pgs=116 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff83c006f30 tx=0x7ff83c011ca0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.343+0000 7ff83a7fc640 1 -- 10.20.193.48:0/2647492019 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff84c13cc20 msgr2=0x7ff84c13cff0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:37.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.343+0000 7ff83a7fc640 1 --2- 10.20.193.48:0/2647492019 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff84c13cc20 0x7ff84c13cff0 secure :-1 s=CLOSED pgs=116 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff83c006f30 tx=0x7ff83c011ca0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.344+0000 7ff852642640 1 --2- 10.20.193.48:0/2647492019 >> v2:10.20.193.111:6812/977811348 conn(0x7ff81c03f800 0x7ff81c05fcb0 secure :-1 s=READY pgs=80 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff84802ff30 tx=0x7ff848007f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.347+0000 7ff8540cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:06:37.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.347+0000 7ff8540cc640 1 --2- 10.20.193.48:0/2647492019 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff84c13d530 0x7ff84c13f0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.347+0000 7ff8540cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.347+0000 7ff8540cc640 1 -- 10.20.193.48:0/2647492019 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7ff84c05fd90 con 0x7ff84c13d530 2026-02-12T18:06:37.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.347+0000 7ff851e41640 1 --2- 10.20.193.48:0/2647492019 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff84c13d530 0x7ff84c13f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.347+0000 7ff851e41640 10 monclient: get_auth_request con 0x7ff84c13d530 auth_method 0 2026-02-12T18:06:37.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.347+0000 7ff851e41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.347+0000 7ff851e41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.347+0000 7ff851e41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.347+0000 7ff851e41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.347+0000 7ff851e41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.347+0000 7ff851e41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.347+0000 7ff851e41640 10 monclient(hunting): handle_auth_done global_id 4554 payload 824 2026-02-12T18:06:37.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.347+0000 7ff851e41640 1 -- 10.20.193.48:0/2647492019 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff84c05cd20 con 0x7ff84c13d530 2026-02-12T18:06:37.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.349+0000 7ff851e41640 1 -- 10.20.193.48:0/2647492019 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff84c13d530 msgr2=0x7ff84c13f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:37.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.349+0000 7ff851e41640 1 --2- 10.20.193.48:0/2647492019 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff84c13d530 0x7ff84c13f0b0 secure :-1 s=READY pgs=117 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff83c017000 tx=0x7ff83c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.349+0000 7ff83a7fc640 1 -- 10.20.193.48:0/2647492019 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff83c025070 con 0x7ff84c13d530 2026-02-12T18:06:37.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.349+0000 7ff83a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.349+0000 7ff83a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:37.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.349+0000 7ff83a7fc640 10 monclient: dump: 2026-02-12T18:06:37.374 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.374 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.374 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.374 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.374 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.374 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.375 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.375 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.375 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.375 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.375 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.375 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.375 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.375 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.375 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.375 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.350+0000 7ff83a7fc640 1 -- 10.20.193.48:0/2647492019 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10161 (secure 0 0 0) 0x7ff83c020270 con 0x7ff84c13d530 2026-02-12T18:06:37.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.350+0000 7ff83a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:06:37.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.350+0000 7ff83a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:37.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.350+0000 7ff83a7fc640 1 -- 10.20.193.48:0/2647492019 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff84c13d530 msgr2=0x7ff84c13f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.350+0000 7ff83a7fc640 1 --2- 10.20.193.48:0/2647492019 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff84c13d530 0x7ff84c13f0b0 secure :-1 s=READY pgs=117 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff83c017000 tx=0x7ff83c004770 comp rx=0 tx=0).stop 2026-02-12T18:06:37.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.350+0000 7ff83a7fc640 1 -- 10.20.193.48:0/2647492019 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff84c13d530 msgr2=0x7ff84c13f0b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:37.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.350+0000 7ff83a7fc640 1 --2- 10.20.193.48:0/2647492019 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff84c13d530 0x7ff84c13f0b0 secure :-1 s=CLOSED pgs=117 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff83c017000 tx=0x7ff83c004770 comp rx=0 tx=0).stop 2026-02-12T18:06:37.376 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:06:37.376 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:06:37.376 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:06:37.376 INFO:teuthology.orchestra.run.trial048.stdout: "state": "leader", 2026-02-12T18:06:37.376 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 18, 2026-02-12T18:06:37.376 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 52185, 2026-02-12T18:06:37.376 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:06:37.376 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:06:37.376 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:06:37.376 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:06:37.377 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:06:37.377 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:06:37.377 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:06:37.377 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:06:37.377 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.377 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:06:37.377 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:37.377 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:06:37.377 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:06:37.377 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:37.377 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:37.377 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:37.377 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:37.377 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:37.377 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:37.378 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:37.378 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:37.378 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:37.378 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:37.378 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:37.378 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:37.378 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:37.378 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.378 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:06:37.378 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:06:37.378 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:37.378 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:37.378 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:37.378 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:37.378 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:37.378 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:37.378 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:37.379 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:37.379 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:37.379 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:37.379 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:37.379 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:37.379 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:37.379 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.379 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.379 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:06:37.379 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:06:37.379 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:06:37.379 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:06:37.379 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:06:37.379 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:06:37.379 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:37.379 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:37.379 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:06:37.379 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:06:37.379 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:06:37.380 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:06:37.380 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:06:37.380 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:06:37.380 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:06:37.380 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:37.380 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:06:37.380 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:37.380 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:37.380 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:37.380 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:37.380 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:37.380 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:37.380 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:37.380 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:37.380 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:37.381 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:37.381 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:37.381 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:37.381 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:37.381 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.381 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:06:37.381 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.381 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:06:37.381 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.381 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:06:37.381 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:06:37.381 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.381 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.381 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.381 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.381 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:06:37.381 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.381 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.381 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.382 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.382 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:06:37.382 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.382 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.382 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.382 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.382 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:06:37.382 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:06:37.382 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.382 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.382 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:06:37.382 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.382 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.382 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.382 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:06:37.382 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:06:37.382 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.382 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.382 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.382 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.383 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:06:37.383 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.383 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.383 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.383 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.383 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:06:37.383 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.383 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.383 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.383 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.383 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:06:37.383 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:06:37.383 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.383 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.383 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:06:37.383 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.383 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.383 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.383 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:06:37.383 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:06:37.384 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.384 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.384 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.384 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.384 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:06:37.384 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.384 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.384 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.384 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.384 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:06:37.384 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.384 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.384 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.384 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.384 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:06:37.384 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:06:37.384 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.384 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.384 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:06:37.384 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.385 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.385 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.385 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:06:37.385 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:06:37.385 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.385 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.385 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.385 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.385 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:06:37.385 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.385 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.385 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.385 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.385 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:06:37.385 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.385 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.385 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.385 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.385 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:06:37.385 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:06:37.386 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.386 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.386 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:06:37.386 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.386 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.386 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.386 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:06:37.386 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:06:37.386 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.386 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.386 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.386 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.386 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:06:37.386 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.386 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.386 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.386 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.386 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:06:37.386 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.386 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.386 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.387 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.387 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:06:37.387 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:06:37.387 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.387 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.387 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:37.387 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.387 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.387 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.387 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:06:37.387 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:06:37.387 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.387 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.387 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.387 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.387 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:06:37.387 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.387 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.387 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.387 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.387 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:06:37.387 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.388 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.388 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.388 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.388 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:06:37.388 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:06:37.388 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.388 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.388 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:06:37.388 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.388 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.388 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.388 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:06:37.388 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:06:37.388 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.388 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.388 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.388 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.388 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:06:37.388 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.388 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.388 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.388 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.388 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:06:37.389 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.389 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.389 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.389 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.389 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:06:37.389 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:06:37.389 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.389 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.389 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:37.389 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.389 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.389 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.389 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:06:37.389 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:06:37.389 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.389 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.389 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.389 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.389 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:06:37.389 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.389 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.389 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.389 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.390 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:06:37.390 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.390 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.390 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.390 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.390 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:06:37.390 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:06:37.390 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.390 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.390 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:06:37.390 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.390 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.390 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.390 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:06:37.390 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:06:37.390 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.390 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.390 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.390 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.390 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:06:37.390 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.390 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.391 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.391 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.391 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:06:37.391 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.391 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.391 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.391 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.391 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:06:37.391 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:06:37.391 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.391 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.391 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:06:37.391 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.391 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.391 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.391 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.391 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:06:37.391 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:06:37.391 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.391 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:37.391 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:37.391 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:37.392 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.392 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.392 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:06:37.392 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.392 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:37.392 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:37.392 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:37.392 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.392 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.392 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:06:37.392 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.392 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:37.392 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:37.392 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:37.392 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.392 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.392 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.392 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:06:37.392 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:06:37.393 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.350+0000 7ff8540cc640 1 -- 10.20.193.48:0/2647492019 >> v2:10.20.193.111:6812/977811348 conn(0x7ff81c03f800 msgr2=0x7ff81c05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.393 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.350+0000 7ff8540cc640 1 --2- 10.20.193.48:0/2647492019 >> v2:10.20.193.111:6812/977811348 conn(0x7ff81c03f800 0x7ff81c05fcb0 secure :-1 s=READY pgs=80 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff84802ff30 tx=0x7ff848007f90 comp rx=0 tx=0).stop 2026-02-12T18:06:37.393 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.350+0000 7ff8540cc640 10 monclient: shutdown 2026-02-12T18:06:37.393 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.350+0000 7ff8540cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:37.393 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.350+0000 7ff8540cc640 1 -- 10.20.193.48:0/2647492019 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff84c05e490 msgr2=0x7ff84c08d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.393 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.350+0000 7ff8540cc640 1 --2- 10.20.193.48:0/2647492019 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff84c05e490 0x7ff84c08d330 secure :-1 s=READY pgs=66 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff840004740 tx=0x7ff84000ee20 comp rx=0 tx=0).stop 2026-02-12T18:06:37.393 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.350+0000 7ff852642640 1 -- 10.20.193.48:0/2647492019 reap_dead start 2026-02-12T18:06:37.394 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.350+0000 7ff8540cc640 1 -- 10.20.193.48:0/2647492019 shutdown_connections 2026-02-12T18:06:37.394 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.350+0000 7ff8540cc640 1 --2- 10.20.193.48:0/2647492019 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff84c05e490 0x7ff84c08d330 unknown :-1 s=CLOSED pgs=66 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.394 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.350+0000 7ff8540cc640 1 -- 10.20.193.48:0/2647492019 >> 10.20.193.48:0/2647492019 conn(0x7ff84c0548a0 msgr2=0x7ff84c093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:37.394 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.350+0000 7ff8540cc640 1 -- 10.20.193.48:0/2647492019 shutdown_connections 2026-02-12T18:06:37.394 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.350+0000 7ff8540cc640 1 -- 10.20.193.48:0/2647492019 wait complete. 2026-02-12T18:06:37.394 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2026-02-12T18:06:37.394 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon b 2026-02-12T18:06:37.394 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T18:06:37.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.460+0000 7fef0b8cc640 10 monclient: get_monmap_and_config 2026-02-12T18:06:37.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.460+0000 7fef0b8cc640 10 monclient: build_initial_monmap 2026-02-12T18:06:37.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.460+0000 7fef0b8cc640 10 monclient: monmap: 2026-02-12T18:06:37.461 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:37.461 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.462 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:37.461210+0000 2026-02-12T18:06:37.462 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:37.461210+0000 2026-02-12T18:06:37.462 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:37.462 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.462 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:37.462 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:37.462 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:37.462 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:37.462 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:37.462 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:37.462 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:37.463 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:37.463 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:37.463 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:37.463 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:37.463 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.460+0000 7fef0b8cc640 1 Processor -- start 2026-02-12T18:06:37.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.460+0000 7fef0b8cc640 1 -- start start 2026-02-12T18:06:37.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.460+0000 7fef0b8cc640 10 monclient: init 2026-02-12T18:06:37.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.460+0000 7fef0b8cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:37.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.460+0000 7fef0b8cc640 10 monclient: _add_conns ranks=[10,5,2,6,9,7,3,1,4,8,0] 2026-02-12T18:06:37.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.460+0000 7fef0b8cc640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7fef0405d550 0x7fef0405d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.460+0000 7fef0b8cc640 10 monclient(hunting): picked mon.noname-f con 0x7fef0405d550 addr v2:10.20.193.111:3300/0 2026-02-12T18:06:37.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.460+0000 7fef0b8cc640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fef0405de60 0x7fef04141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.460+0000 7fef0b8cc640 10 monclient(hunting): picked mon.noname-h con 0x7fef0405de60 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:37.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.460+0000 7fef0b8cc640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef0413ef60 0x7fef041424e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.460+0000 7fef0b8cc640 10 monclient(hunting): picked mon.noname-b con 0x7fef0413ef60 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:37.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.460+0000 7fef0b8cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.460+0000 7fef0b8cc640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7fef0408d390 con 0x7fef0405d550 2026-02-12T18:06:37.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.460+0000 7fef0b8cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.460+0000 7fef0b8cc640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fef0408d5a0 con 0x7fef0413ef60 2026-02-12T18:06:37.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.460+0000 7fef0b8cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.460+0000 7fef0b8cc640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fef040580e0 con 0x7fef0405de60 2026-02-12T18:06:37.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.460+0000 7fef0b8cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:37.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.460+0000 7fef0b8cc640 10 monclient(hunting): authenticate will time out at 636.186960s 2026-02-12T18:06:37.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09e42640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef0413ef60 0x7fef041424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09e42640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef0413ef60 0x7fef041424e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:34240/0 (socket says 10.20.193.48:34240) 2026-02-12T18:06:37.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09e42640 1 -- 10.20.193.48:0/2235807011 learned_addr learned my addr 10.20.193.48:0/2235807011 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:37.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09e42640 10 monclient(hunting): get_auth_request con 0x7fef0413ef60 auth_method 0 2026-02-12T18:06:37.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09e42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09e42640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09e42640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09641640 1 --2- 10.20.193.48:0/2235807011 >> v2:10.20.193.111:3300/0 conn(0x7fef0405d550 0x7fef0405d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09641640 10 monclient(hunting): get_auth_request con 0x7fef0405d550 auth_method 0 2026-02-12T18:06:37.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef08e40640 1 --2- 10.20.193.48:0/2235807011 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fef0405de60 0x7fef04141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09641640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09641640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09641640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef08e40640 10 monclient(hunting): get_auth_request con 0x7fef0405de60 auth_method 0 2026-02-12T18:06:37.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef08e40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef08e40640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef08e40640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09e42640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09e42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09e42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09641640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09641640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09641640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef08e40640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef08e40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef08e40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09e42640 10 monclient(hunting): handle_auth_done global_id 34382 payload 274 2026-02-12T18:06:37.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09e42640 1 -- 10.20.193.48:0/2235807011 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fef0405de60 msgr2=0x7fef04141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:37.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09e42640 1 --2- 10.20.193.48:0/2235807011 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fef0405de60 0x7fef04141fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09e42640 1 -- 10.20.193.48:0/2235807011 >> v2:10.20.193.111:3300/0 conn(0x7fef0405d550 msgr2=0x7fef0405d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:37.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09e42640 1 --2- 10.20.193.48:0/2235807011 >> v2:10.20.193.111:3300/0 conn(0x7fef0405d550 0x7fef0405d920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09e42640 10 monclient: _finish_hunting 0 2026-02-12T18:06:37.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09e42640 1 monclient: found mon.noname-b 2026-02-12T18:06:37.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09e42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:37.479 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09e42640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:06:37.479 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.461+0000 7fef09e42640 1 -- 10.20.193.48:0/2235807011 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef0404dc20 con 0x7fef0413ef60 2026-02-12T18:06:37.479 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.463+0000 7fef09e42640 1 -- 10.20.193.48:0/2235807011 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef0413ef60 msgr2=0x7fef041424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:37.479 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.463+0000 7fef09e42640 1 --2- 10.20.193.48:0/2235807011 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef0413ef60 0x7fef041424e0 secure :-1 s=READY pgs=52 gs=1 cs=0 l=1 c_cookie=18072920069093889669 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef0000a140 tx=0x7fef0002fed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=facfe90c645e9685 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.479 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7feef3fff640 1 -- 10.20.193.48:0/2235807011 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fef00030b50 con 0x7fef0413ef60 2026-02-12T18:06:37.479 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7feef3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.479 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7feef3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:06:37.479 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7feef3fff640 10 monclient: dump: 2026-02-12T18:06:37.479 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.479 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.479 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.479 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.480 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.480 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.480 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.480 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.480 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.480 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.480 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.480 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.480 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.480 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.480 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.480 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.480 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7feef3fff640 10 monclient: _finish_auth 0 2026-02-12T18:06:37.480 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7feef3fff640 10 monclient: _check_auth_tickets 2026-02-12T18:06:37.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7feef3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:37.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7fef0b8cc640 5 monclient: authenticate success, global_id 34382 2026-02-12T18:06:37.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7fef0b8cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:37.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7feef3fff640 1 -- 10.20.193.48:0/2235807011 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef00030cd0 con 0x7fef0413ef60 2026-02-12T18:06:37.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7feef3fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:37.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7feef3fff640 1 -- 10.20.193.48:0/2235807011 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fef00030e40 con 0x7fef0413ef60 2026-02-12T18:06:37.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7fef0b8cc640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:37.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7fef0b8cc640 4 set_mon_vals no callback set 2026-02-12T18:06:37.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7feef3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7feef3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:06:37.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7feef3fff640 10 monclient: dump: 2026-02-12T18:06:37.481 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.481 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.481 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.482 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.482 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.482 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.482 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.482 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.482 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.482 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.482 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.482 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.482 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.482 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.482 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.482 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.482 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7fef0b8cc640 10 monclient: shutdown 2026-02-12T18:06:37.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7fef0b8cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:37.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7fef0b8cc640 1 -- 10.20.193.48:0/2235807011 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef0413ef60 msgr2=0x7fef041424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7fef0b8cc640 1 --2- 10.20.193.48:0/2235807011 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef0413ef60 0x7fef041424e0 secure :-1 s=READY pgs=52 gs=1 cs=0 l=1 c_cookie=18072920069093889669 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef0000a140 tx=0x7fef0002fed0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7fef0b8cc640 1 -- 10.20.193.48:0/2235807011 shutdown_connections 2026-02-12T18:06:37.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7fef0b8cc640 1 --2- 10.20.193.48:0/2235807011 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef0413ef60 0x7fef041424e0 unknown :-1 s=CLOSED pgs=52 gs=1 cs=0 l=1 c_cookie=18072920069093889669 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7fef0b8cc640 1 --2- 10.20.193.48:0/2235807011 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fef0405de60 0x7fef04141fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7fef0b8cc640 1 --2- 10.20.193.48:0/2235807011 >> v2:10.20.193.111:3300/0 conn(0x7fef0405d550 0x7fef0405d920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7fef0b8cc640 1 -- 10.20.193.48:0/2235807011 >> 10.20.193.48:0/2235807011 conn(0x7fef040546a0 msgr2=0x7fef04054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:37.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7fef0b8cc640 1 -- 10.20.193.48:0/2235807011 shutdown_connections 2026-02-12T18:06:37.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.464+0000 7fef0b8cc640 1 -- 10.20.193.48:0/2235807011 wait complete. 2026-02-12T18:06:37.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef0b8cc640 10 monclient: build_initial_monmap 2026-02-12T18:06:37.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef0b8cc640 10 monclient: monmap: 2026-02-12T18:06:37.483 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:37.484 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:37.484 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:37.484 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:37.484 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:37.484 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.484 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:37.484 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:37.484 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:37.484 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:37.484 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:37.484 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:37.484 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:37.484 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:37.484 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:37.484 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef0b8cc640 1 Processor -- start 2026-02-12T18:06:37.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef0b8cc640 1 -- start start 2026-02-12T18:06:37.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef0b8cc640 10 monclient: init 2026-02-12T18:06:37.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef0b8cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:37.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef0b8cc640 10 monclient: _add_conns ranks=[0,3,2,1,5,7,6,8,4] 2026-02-12T18:06:37.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef0b8cc640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fef0405d550 0x7fef0413c410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef0b8cc640 10 monclient(hunting): picked mon.noname-a con 0x7fef0405d550 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:06:37.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef0b8cc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fef0405de60 0x7fef0408a680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef0b8cc640 10 monclient(hunting): picked mon.noname-g con 0x7fef0405de60 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:37.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef0b8cc640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef0413ef60 0x7fef0408abc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef0b8cc640 10 monclient(hunting): picked mon.noname-b con 0x7fef0413ef60 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:37.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef0b8cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef0b8cc640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fef04120580 con 0x7fef0405d550 2026-02-12T18:06:37.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef0b8cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef0b8cc640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fef041208a0 con 0x7fef0413ef60 2026-02-12T18:06:37.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef0b8cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef0b8cc640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fef0408c650 con 0x7fef0405de60 2026-02-12T18:06:37.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef0b8cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:37.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef0b8cc640 10 monclient(hunting): authenticate will time out at 636.191605s 2026-02-12T18:06:37.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09e42640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef0413ef60 0x7fef0408abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09e42640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef0413ef60 0x7fef0408abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:34246/0 (socket says 10.20.193.48:34246) 2026-02-12T18:06:37.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09e42640 1 -- 10.20.193.48:0/813761595 learned_addr learned my addr 10.20.193.48:0/813761595 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:37.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09e42640 10 monclient(hunting): get_auth_request con 0x7fef0413ef60 auth_method 0 2026-02-12T18:06:37.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09641640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fef0405d550 0x7fef0413c410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.488 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09e42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.488 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09e42640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.488 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09e42640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.488 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09641640 10 monclient(hunting): get_auth_request con 0x7fef0405d550 auth_method 0 2026-02-12T18:06:37.488 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09641640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.488 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09641640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.488 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09641640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09e42640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09e42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09e42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09641640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09641640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09641640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef08e40640 1 --2- 10.20.193.48:0/813761595 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fef0405de60 0x7fef0408a680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef08e40640 10 monclient(hunting): get_auth_request con 0x7fef0405de60 auth_method 0 2026-02-12T18:06:37.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef08e40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef08e40640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef08e40640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09e42640 10 monclient(hunting): handle_auth_done global_id 34391 payload 824 2026-02-12T18:06:37.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09e42640 1 -- 10.20.193.48:0/813761595 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fef0405de60 msgr2=0x7fef0408a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09e42640 1 --2- 10.20.193.48:0/813761595 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fef0405de60 0x7fef0408a680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09e42640 1 -- 10.20.193.48:0/813761595 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fef0405d550 msgr2=0x7fef0413c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09e42640 1 --2- 10.20.193.48:0/813761595 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fef0405d550 0x7fef0413c410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09e42640 10 monclient: _finish_hunting 0 2026-02-12T18:06:37.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09e42640 1 monclient: found mon.noname-b 2026-02-12T18:06:37.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09e42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:37.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09e42640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:06:37.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.465+0000 7fef09e42640 1 -- 10.20.193.48:0/813761595 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef0000a5d0 con 0x7fef0413ef60 2026-02-12T18:06:37.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7fef09e42640 1 -- 10.20.193.48:0/813761595 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef0413ef60 msgr2=0x7fef0408abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:37.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7fef09e42640 1 --2- 10.20.193.48:0/813761595 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef0413ef60 0x7fef0408abc0 secure :-1 s=READY pgs=53 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef00005790 tx=0x7fef00005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7feef1ffb640 1 -- 10.20.193.48:0/813761595 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fef00030b50 con 0x7fef0413ef60 2026-02-12T18:06:37.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7feef1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.492 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7feef1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:06:37.492 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7feef1ffb640 10 monclient: dump: 2026-02-12T18:06:37.492 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.492 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.492 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.492 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.492 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.492 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.493 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.493 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.493 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.493 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.493 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.493 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.493 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.493 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.493 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.494 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7feef1ffb640 10 monclient: _finish_auth 0 2026-02-12T18:06:37.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7feef1ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:06:37.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7feef1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:37.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7fef0b8cc640 5 monclient: authenticate success, global_id 34391 2026-02-12T18:06:37.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7fef0b8cc640 10 monclient: _renew_subs 2026-02-12T18:06:37.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7feef1ffb640 1 -- 10.20.193.48:0/813761595 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef00004bd0 con 0x7fef0413ef60 2026-02-12T18:06:37.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7fef0b8cc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:37.495 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7fef0b8cc640 1 -- 10.20.193.48:0/813761595 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef0413dc40 con 0x7fef0413ef60 2026-02-12T18:06:37.495 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7feef1ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:37.495 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7feef1ffb640 1 -- 10.20.193.48:0/813761595 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fef00038dc0 con 0x7fef0413ef60 2026-02-12T18:06:37.495 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7feef1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.495 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7feef37fe640 4 set_mon_vals no callback set 2026-02-12T18:06:37.495 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7feef1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:06:37.495 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7feef1ffb640 10 monclient: dump: 2026-02-12T18:06:37.495 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.496 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.496 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.496 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.496 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.496 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.496 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.496 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.496 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.496 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.496 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.497 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.497 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.497 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.497 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.497 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.497 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7fef0b8cc640 10 monclient: _renew_subs 2026-02-12T18:06:37.497 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7fef0b8cc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:06:37.497 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7fef0b8cc640 1 -- 10.20.193.48:0/813761595 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fef0408c1d0 con 0x7fef0413ef60 2026-02-12T18:06:37.497 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7fef0b8cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:37.497 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7fef0b8cc640 1 --2- 10.20.193.48:0/813761595 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef04091010 0x7fef0408b100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.498 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7fef0b8cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.498 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7fef0b8cc640 1 -- 10.20.193.48:0/813761595 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fef040631f0 con 0x7fef04091010 2026-02-12T18:06:37.498 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7fef09641640 1 --2- 10.20.193.48:0/813761595 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef04091010 0x7fef0408b100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.498 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7fef09641640 10 monclient: get_auth_request con 0x7fef04091010 auth_method 0 2026-02-12T18:06:37.498 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7fef09641640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.498 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7fef09641640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.498 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7fef09641640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.498 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.468+0000 7feef1ffb640 1 -- 10.20.193.48:0/813761595 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fef00047030 con 0x7fef0413ef60 2026-02-12T18:06:37.498 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.469+0000 7fef09641640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.498 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.469+0000 7fef09641640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.469+0000 7fef09641640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.469+0000 7fef09641640 10 monclient(hunting): handle_auth_done global_id 34400 payload 824 2026-02-12T18:06:37.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.469+0000 7feef1ffb640 1 --2- 10.20.193.48:0/813761595 >> v2:10.20.193.111:6812/977811348 conn(0x7feed403f800 0x7feed405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.469+0000 7fef09641640 1 -- 10.20.193.48:0/813761595 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fef0408d060 con 0x7fef04091010 2026-02-12T18:06:37.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.469+0000 7feef1ffb640 1 -- 10.20.193.48:0/813761595 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(21..21 src has 1..21) ==== 3897+0+0 (secure 0 0 0) 0x7fef00078c80 con 0x7fef0413ef60 2026-02-12T18:06:37.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.469+0000 7fef08e40640 1 --2- 10.20.193.48:0/813761595 >> v2:10.20.193.111:6812/977811348 conn(0x7feed403f800 0x7feed405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.469+0000 7fef08e40640 10 monclient: get_auth_request con 0x7feed403f800 auth_method 0 2026-02-12T18:06:37.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.471+0000 7fef09641640 1 -- 10.20.193.48:0/813761595 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef04091010 msgr2=0x7fef0408b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:37.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.471+0000 7fef09641640 1 --2- 10.20.193.48:0/813761595 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef04091010 0x7fef0408b100 secure :-1 s=READY pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feef40118d0 tx=0x7feef4011da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.471+0000 7feef1ffb640 1 -- 10.20.193.48:0/813761595 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7feef400fd50 con 0x7fef04091010 2026-02-12T18:06:37.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.471+0000 7feef1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.471+0000 7feef1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:06:37.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.471+0000 7feef1ffb640 10 monclient: dump: 2026-02-12T18:06:37.500 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.500 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.500 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.500 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.500 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.500 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.500 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.501 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.501 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.501 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.501 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.501 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.501 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.501 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.501 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.501 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.471+0000 7feef1ffb640 1 -- 10.20.193.48:0/813761595 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7feef400feb0 con 0x7fef04091010 2026-02-12T18:06:37.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.471+0000 7feef1ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:37.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.471+0000 7feef1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:37.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.471+0000 7feef1ffb640 1 -- 10.20.193.48:0/813761595 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef04091010 msgr2=0x7fef0408b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.471+0000 7feef1ffb640 1 --2- 10.20.193.48:0/813761595 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef04091010 0x7fef0408b100 secure :-1 s=READY pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feef40118d0 tx=0x7feef4011da0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.471+0000 7feef1ffb640 1 -- 10.20.193.48:0/813761595 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef04091010 msgr2=0x7fef0408b100 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:37.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.471+0000 7feef1ffb640 1 --2- 10.20.193.48:0/813761595 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef04091010 0x7fef0408b100 unknown :-1 s=CLOSED pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.472+0000 7fef08e40640 1 --2- 10.20.193.48:0/813761595 >> v2:10.20.193.111:6812/977811348 conn(0x7feed403f800 0x7feed405fcb0 secure :-1 s=READY pgs=81 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef0405c6b0 tx=0x7feef8008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.475+0000 7fef0b8cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:06:37.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.475+0000 7fef0b8cc640 1 --2- 10.20.193.48:0/813761595 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef0408b640 0x7fef04058a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.475+0000 7fef0b8cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.475+0000 7fef0b8cc640 1 -- 10.20.193.48:0/813761595 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fef04050410 con 0x7fef0408b640 2026-02-12T18:06:37.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.475+0000 7fef09641640 1 --2- 10.20.193.48:0/813761595 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef0408b640 0x7fef04058a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.475+0000 7fef09641640 10 monclient: get_auth_request con 0x7fef0408b640 auth_method 0 2026-02-12T18:06:37.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.475+0000 7fef09641640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.475+0000 7fef09641640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.475+0000 7fef09641640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.475+0000 7fef09641640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.475+0000 7fef09641640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.475+0000 7fef09641640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.475+0000 7fef09641640 10 monclient(hunting): handle_auth_done global_id 34409 payload 824 2026-02-12T18:06:37.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.475+0000 7fef09641640 1 -- 10.20.193.48:0/813761595 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fef0405e310 con 0x7fef0408b640 2026-02-12T18:06:37.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.477+0000 7fef09641640 1 -- 10.20.193.48:0/813761595 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef0408b640 msgr2=0x7fef04058a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:37.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.477+0000 7fef09641640 1 --2- 10.20.193.48:0/813761595 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef0408b640 0x7fef04058a80 secure :-1 s=READY pgs=55 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feef40093d0 tx=0x7feef4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.477+0000 7feef1ffb640 1 -- 10.20.193.48:0/813761595 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7feef401ed30 con 0x7fef0408b640 2026-02-12T18:06:37.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.477+0000 7feef1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.477+0000 7feef1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:06:37.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.477+0000 7feef1ffb640 10 monclient: dump: 2026-02-12T18:06:37.506 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.506 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.506 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.506 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.506 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.506 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.506 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.506 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.506 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.506 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.506 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.506 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.506 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.507 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.507 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.507 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.477+0000 7feef1ffb640 1 -- 10.20.193.48:0/813761595 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10159 (secure 0 0 0) 0x7feef401ee90 con 0x7fef0408b640 2026-02-12T18:06:37.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.477+0000 7feef1ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:06:37.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.477+0000 7feef1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:37.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.477+0000 7feef1ffb640 1 -- 10.20.193.48:0/813761595 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef0408b640 msgr2=0x7fef04058a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.477+0000 7feef1ffb640 1 --2- 10.20.193.48:0/813761595 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef0408b640 0x7fef04058a80 secure :-1 s=READY pgs=55 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feef40093d0 tx=0x7feef4004770 comp rx=0 tx=0).stop 2026-02-12T18:06:37.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.478+0000 7feef1ffb640 1 -- 10.20.193.48:0/813761595 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef0408b640 msgr2=0x7fef04058a80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:37.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.478+0000 7feef1ffb640 1 --2- 10.20.193.48:0/813761595 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef0408b640 0x7fef04058a80 secure :-1 s=CLOSED pgs=55 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feef40093d0 tx=0x7feef4004770 comp rx=0 tx=0).stop 2026-02-12T18:06:37.508 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:06:37.508 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:06:37.508 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:06:37.508 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:06:37.508 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 18, 2026-02-12T18:06:37.508 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 52311, 2026-02-12T18:06:37.508 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:06:37.508 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:06:37.508 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:06:37.508 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:06:37.508 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:06:37.508 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:06:37.508 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:06:37.508 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:06:37.508 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.508 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:06:37.508 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:37.508 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:06:37.509 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:06:37.509 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:37.509 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:37.509 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:37.509 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:37.509 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:37.509 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:37.509 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:37.509 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:37.509 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:37.509 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:37.509 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:37.509 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:37.509 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:37.509 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.509 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:06:37.509 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:06:37.509 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:37.509 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:37.509 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:37.509 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:37.510 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:37.510 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:37.510 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:37.510 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:37.510 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:37.510 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:37.510 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:37.510 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:37.510 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:37.510 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.510 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.510 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:06:37.510 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:06:37.510 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:06:37.510 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:06:37.510 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:06:37.510 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:06:37.510 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:37.510 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:37.510 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:06:37.510 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:06:37.510 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:06:37.510 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:06:37.511 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:06:37.511 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:06:37.511 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:06:37.511 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:37.511 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:06:37.511 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:37.511 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:37.511 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:37.511 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:37.511 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:37.511 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:37.511 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:37.511 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:37.511 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:37.511 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:37.511 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:37.511 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:37.511 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:37.511 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.511 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:06:37.511 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.511 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:06:37.511 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.512 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:06:37.512 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:06:37.512 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.512 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.512 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.512 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.512 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:06:37.512 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.512 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.512 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.512 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.512 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:06:37.512 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.512 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.512 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.512 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.512 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:06:37.512 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:06:37.512 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.512 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.512 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:06:37.512 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.512 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.513 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.513 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:06:37.513 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:06:37.513 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.513 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.513 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.513 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.513 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:06:37.513 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.513 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.513 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.513 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.513 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:06:37.513 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.513 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.513 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.513 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.513 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:06:37.513 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:06:37.513 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.513 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.513 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:06:37.513 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.513 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.513 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.514 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:06:37.514 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:06:37.514 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.514 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.514 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.514 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.514 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:06:37.514 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.514 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.514 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.514 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.514 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:06:37.514 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.514 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.514 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.514 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.514 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:06:37.514 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:06:37.514 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.514 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.514 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:06:37.514 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.514 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.514 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.514 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:06:37.514 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.515 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:06:37.516 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.517 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.518 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:06:37.518 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.518 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.518 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.518 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.518 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:06:37.518 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:06:37.518 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.518 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.518 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:37.518 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.518 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.518 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.518 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:06:37.518 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:06:37.518 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.518 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.518 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.518 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.518 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:06:37.518 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.518 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.518 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.519 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.520 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:37.521 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:37.521 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:06:37.521 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.521 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.521 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.521 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:06:37.521 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:06:37.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.478+0000 7fef0b8cc640 1 -- 10.20.193.48:0/813761595 >> v2:10.20.193.111:6812/977811348 conn(0x7feed403f800 msgr2=0x7feed405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.478+0000 7fef0b8cc640 1 --2- 10.20.193.48:0/813761595 >> v2:10.20.193.111:6812/977811348 conn(0x7feed403f800 0x7feed405fcb0 secure :-1 s=READY pgs=81 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef0405c6b0 tx=0x7feef8008040 comp rx=0 tx=0).stop 2026-02-12T18:06:37.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.478+0000 7fef0b8cc640 10 monclient: shutdown 2026-02-12T18:06:37.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.478+0000 7fef0b8cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:37.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.478+0000 7fef0b8cc640 1 -- 10.20.193.48:0/813761595 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef0413ef60 msgr2=0x7fef0408abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.478+0000 7fef0b8cc640 1 --2- 10.20.193.48:0/813761595 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fef0413ef60 0x7fef0408abc0 secure :-1 s=READY pgs=53 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef00005790 tx=0x7fef00005850 comp rx=0 tx=0).stop 2026-02-12T18:06:37.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.478+0000 7fef09e42640 1 -- 10.20.193.48:0/813761595 reap_dead start 2026-02-12T18:06:37.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.478+0000 7fef09e42640 1 -- 10.20.193.48:0/813761595 reap_dead start 2026-02-12T18:06:37.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.478+0000 7fef0b8cc640 1 -- 10.20.193.48:0/813761595 shutdown_connections 2026-02-12T18:06:37.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.478+0000 7fef0b8cc640 1 -- 10.20.193.48:0/813761595 >> 10.20.193.48:0/813761595 conn(0x7fef040546a0 msgr2=0x7fef0405cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:37.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.478+0000 7fef0b8cc640 1 -- 10.20.193.48:0/813761595 shutdown_connections 2026-02-12T18:06:37.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.478+0000 7fef0b8cc640 1 -- 10.20.193.48:0/813761595 wait complete. 2026-02-12T18:06:37.522 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2026-02-12T18:06:37.522 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon d 2026-02-12T18:06:37.523 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2026-02-12T18:06:37.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.587+0000 7f8eefb0c640 10 monclient: get_monmap_and_config 2026-02-12T18:06:37.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.587+0000 7f8eefb0c640 10 monclient: build_initial_monmap 2026-02-12T18:06:37.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.587+0000 7f8eefb0c640 10 monclient: monmap: 2026-02-12T18:06:37.589 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:37.589 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.589 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:37.588915+0000 2026-02-12T18:06:37.589 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:37.588915+0000 2026-02-12T18:06:37.589 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:37.589 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.589 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:37.589 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:37.589 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:37.589 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:37.590 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:37.590 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:37.590 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:37.590 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:37.590 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:37.590 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:37.590 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:37.590 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eefb0c640 1 Processor -- start 2026-02-12T18:06:37.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eefb0c640 1 -- start start 2026-02-12T18:06:37.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eefb0c640 10 monclient: init 2026-02-12T18:06:37.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eefb0c640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:37.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eefb0c640 10 monclient: _add_conns ranks=[9,3,1,2,7,0,10,8,6,4,5] 2026-02-12T18:06:37.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eefb0c640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f8ee805c950 0x7f8ee805cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eefb0c640 10 monclient(hunting): picked mon.noname-a con 0x7f8ee805c950 addr v2:10.20.193.48:3300/0 2026-02-12T18:06:37.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eefb0c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f8ee805e490 0x7f8ee805d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eefb0c640 10 monclient(hunting): picked mon.noname-g con 0x7f8ee805e490 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:37.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eefb0c640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f8ee813db70 addr v1:10.20.193.111:6789/0 2026-02-12T18:06:37.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eefb0c640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ee804dc20 con 0x7f8ee813db70 2026-02-12T18:06:37.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eefb0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eefb0c640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f8ee805ddd0 con 0x7f8ee805c950 2026-02-12T18:06:37.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eefb0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eefb0c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f8ee805d7a0 con 0x7f8ee805e490 2026-02-12T18:06:37.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eefb0c640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:37.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eefb0c640 10 monclient(hunting): authenticate will time out at 636.314657s 2026-02-12T18:06:37.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eed881640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f8ee805c950 0x7f8ee805cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eed881640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f8ee805c950 0x7f8ee805cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:56596/0 (socket says 10.20.193.48:56596) 2026-02-12T18:06:37.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eed881640 1 -- 10.20.193.48:0/210138759 learned_addr learned my addr 10.20.193.48:0/210138759 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:37.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eed881640 10 monclient(hunting): get_auth_request con 0x7f8ee805c950 auth_method 0 2026-02-12T18:06:37.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eed881640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eed881640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eed881640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eed080640 1 --2- 10.20.193.48:0/210138759 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f8ee805e490 0x7f8ee805d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eed881640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eed881640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eed881640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eed080640 10 monclient(hunting): get_auth_request con 0x7f8ee805e490 auth_method 0 2026-02-12T18:06:37.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eed080640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eed080640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.588+0000 7f8eed080640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.589+0000 7f8eed881640 10 monclient(hunting): handle_auth_done global_id 4572 payload 274 2026-02-12T18:06:37.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.589+0000 7f8eed881640 1 -- 10.20.193.48:0/210138759 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f8ee805e490 msgr2=0x7f8ee805d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:37.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.589+0000 7f8eed881640 1 --2- 10.20.193.48:0/210138759 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f8ee805e490 0x7f8ee805d260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.589+0000 7f8eed881640 1 -- 10.20.193.48:0/210138759 >> v1:10.20.193.111:6789/0 conn(0x7f8ee813db70 legacy=0x7f8ee813e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:37.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.589+0000 7f8eed881640 10 monclient: _finish_hunting 0 2026-02-12T18:06:37.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.589+0000 7f8eed881640 1 monclient: found mon.noname-a 2026-02-12T18:06:37.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.589+0000 7f8eed881640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:37.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.589+0000 7f8eed881640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:06:37.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.589+0000 7f8eed881640 1 -- 10.20.193.48:0/210138759 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee8092990 con 0x7f8ee805c950 2026-02-12T18:06:37.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.591+0000 7f8eed881640 1 -- 10.20.193.48:0/210138759 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f8ee805c950 msgr2=0x7f8ee805cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:37.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.591+0000 7f8eed881640 1 --2- 10.20.193.48:0/210138759 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f8ee805c950 0x7f8ee805cd20 secure :-1 s=READY pgs=120 gs=2 cs=0 l=1 c_cookie=11264575518999854256 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ed8009060 tx=0x7f8ed802edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c53cfc0938c3cb0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.591+0000 7f8eec87f640 1 -- 10.20.193.48:0/210138759 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8ed8035340 con 0x7f8ee805c950 2026-02-12T18:06:37.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.591+0000 7f8eec87f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.591+0000 7f8eec87f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:06:37.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.591+0000 7f8eec87f640 10 monclient: dump: 2026-02-12T18:06:37.599 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.599 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.599 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.599 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.599 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.599 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.599 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.599 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.599 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.599 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.599 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.599 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.599 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.599 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.599 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.599 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.591+0000 7f8eec87f640 10 monclient: _finish_auth 0 2026-02-12T18:06:37.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.591+0000 7f8eec87f640 10 monclient: _check_auth_tickets 2026-02-12T18:06:37.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.591+0000 7f8eec87f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:37.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.591+0000 7f8eec87f640 1 -- 10.20.193.48:0/210138759 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ed80354c0 con 0x7f8ee805c950 2026-02-12T18:06:37.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.591+0000 7f8eefb0c640 5 monclient: authenticate success, global_id 4572 2026-02-12T18:06:37.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.591+0000 7f8eec87f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:37.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.591+0000 7f8eec87f640 1 -- 10.20.193.48:0/210138759 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8ed8035af0 con 0x7f8ee805c950 2026-02-12T18:06:37.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.591+0000 7f8eec87f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.591+0000 7f8eec87f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:37.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.591+0000 7f8eec87f640 10 monclient: dump: 2026-02-12T18:06:37.600 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.600 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.600 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.600 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.600 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.600 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.600 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.600 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.600 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.600 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.601 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.601 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.601 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.601 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.601 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.601 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.591+0000 7f8eefb0c640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:37.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.591+0000 7f8eefb0c640 4 set_mon_vals no callback set 2026-02-12T18:06:37.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.592+0000 7f8eefb0c640 10 monclient: shutdown 2026-02-12T18:06:37.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.592+0000 7f8eefb0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:37.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.592+0000 7f8eefb0c640 1 -- 10.20.193.48:0/210138759 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f8ee805c950 msgr2=0x7f8ee805cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.592+0000 7f8eefb0c640 1 --2- 10.20.193.48:0/210138759 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f8ee805c950 0x7f8ee805cd20 secure :-1 s=READY pgs=120 gs=2 cs=0 l=1 c_cookie=11264575518999854256 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ed8009060 tx=0x7f8ed802edf0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.592+0000 7f8eefb0c640 1 -- 10.20.193.48:0/210138759 shutdown_connections 2026-02-12T18:06:37.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.592+0000 7f8eefb0c640 1 --2- 10.20.193.48:0/210138759 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f8ee805e490 0x7f8ee805d260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.592+0000 7f8eefb0c640 1 --2- 10.20.193.48:0/210138759 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f8ee805c950 0x7f8ee805cd20 unknown :-1 s=CLOSED pgs=120 gs=2 cs=0 l=1 c_cookie=11264575518999854256 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.592+0000 7f8eefb0c640 1 -- 10.20.193.48:0/210138759 >> 10.20.193.48:0/210138759 conn(0x7f8ee80548a0 msgr2=0x7f8ee8097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:37.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.592+0000 7f8eefb0c640 1 -- 10.20.193.48:0/210138759 shutdown_connections 2026-02-12T18:06:37.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.592+0000 7f8eefb0c640 1 -- 10.20.193.48:0/210138759 wait complete. 2026-02-12T18:06:37.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.592+0000 7f8eefb0c640 10 monclient: build_initial_monmap 2026-02-12T18:06:37.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.592+0000 7f8eefb0c640 10 monclient: monmap: 2026-02-12T18:06:37.602 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:37.602 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:37.602 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:37.602 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:37.602 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:37.602 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.602 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:37.602 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:37.602 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:37.602 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:37.602 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:37.602 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:37.602 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:37.602 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:37.602 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:37.602 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.602 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eefb0c640 1 Processor -- start 2026-02-12T18:06:37.602 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eefb0c640 1 -- start start 2026-02-12T18:06:37.602 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eefb0c640 10 monclient: init 2026-02-12T18:06:37.602 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eefb0c640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:37.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eefb0c640 10 monclient: _add_conns ranks=[5,6,8,7,3,1,0,4,2] 2026-02-12T18:06:37.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eefb0c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f8ee805c950 0x7f8ee808d890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eefb0c640 10 monclient(hunting): picked mon.noname-h con 0x7f8ee805c950 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:37.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eefb0c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8ee805e490 0x7f8ee808eeb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eefb0c640 10 monclient(hunting): picked mon.noname-d con 0x7f8ee805e490 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:06:37.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eefb0c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8ee813db70 0x7f8ee808f3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eefb0c640 10 monclient(hunting): picked mon.noname-e con 0x7f8ee813db70 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:37.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eefb0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eefb0c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f8ee813e840 con 0x7f8ee805c950 2026-02-12T18:06:37.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eefb0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eefb0c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f8ee808a780 con 0x7f8ee805e490 2026-02-12T18:06:37.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eefb0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eefb0c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f8ee813e410 con 0x7f8ee813db70 2026-02-12T18:06:37.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eefb0c640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:37.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eefb0c640 10 monclient(hunting): authenticate will time out at 636.319323s 2026-02-12T18:06:37.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eed080640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8ee805e490 0x7f8ee808eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eee082640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8ee813db70 0x7f8ee808f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eed080640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8ee805e490 0x7f8ee808eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:44838/0 (socket says 10.20.193.48:44838) 2026-02-12T18:06:37.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eed080640 1 -- 10.20.193.48:0/2533338197 learned_addr learned my addr 10.20.193.48:0/2533338197 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:37.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eed080640 10 monclient(hunting): get_auth_request con 0x7f8ee805e490 auth_method 0 2026-02-12T18:06:37.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eed080640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eed080640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eed080640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eee082640 10 monclient(hunting): get_auth_request con 0x7f8ee813db70 auth_method 0 2026-02-12T18:06:37.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eee082640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eee082640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eee082640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eed080640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eed080640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eed080640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eee082640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eee082640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eed881640 1 --2- 10.20.193.48:0/2533338197 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f8ee805c950 0x7f8ee808d890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eee082640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eed881640 10 monclient(hunting): get_auth_request con 0x7f8ee805c950 auth_method 0 2026-02-12T18:06:37.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eed881640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eed881640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eed881640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eed080640 10 monclient(hunting): handle_auth_done global_id 4479 payload 824 2026-02-12T18:06:37.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eed080640 1 -- 10.20.193.48:0/2533338197 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8ee813db70 msgr2=0x7f8ee808f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eed080640 1 --2- 10.20.193.48:0/2533338197 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8ee813db70 0x7f8ee808f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eed080640 1 -- 10.20.193.48:0/2533338197 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f8ee805c950 msgr2=0x7f8ee808d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eed080640 1 --2- 10.20.193.48:0/2533338197 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f8ee805c950 0x7f8ee808d890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eed080640 10 monclient: _finish_hunting 0 2026-02-12T18:06:37.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eed080640 1 monclient: found mon.noname-d 2026-02-12T18:06:37.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eed080640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:37.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eed080640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:06:37.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eed080640 1 -- 10.20.193.48:0/2533338197 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed80094f0 con 0x7f8ee805e490 2026-02-12T18:06:37.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.593+0000 7f8eee082640 1 --2- 10.20.193.48:0/2533338197 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8ee813db70 0x7f8ee808f3f0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:06:37.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.595+0000 7f8eed080640 1 -- 10.20.193.48:0/2533338197 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8ee805e490 msgr2=0x7f8ee808eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:37.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.595+0000 7f8eed080640 1 --2- 10.20.193.48:0/2533338197 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8ee805e490 0x7f8ee808eeb0 secure :-1 s=READY pgs=63 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8edc00e7e0 tx=0x7f8edc00ecb0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.595+0000 7f8ed67fc640 1 -- 10.20.193.48:0/2533338197 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8edc0036d0 con 0x7f8ee805e490 2026-02-12T18:06:37.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.595+0000 7f8ed67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.595+0000 7f8ed67fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:06:37.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.595+0000 7f8ed67fc640 10 monclient: dump: 2026-02-12T18:06:37.605 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.605 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.605 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.605 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.606 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.606 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.606 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.606 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.606 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.606 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.606 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.606 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.606 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.606 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.606 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.606 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.595+0000 7f8ed67fc640 10 monclient: _finish_auth 0 2026-02-12T18:06:37.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.595+0000 7f8ed67fc640 10 monclient: _check_auth_tickets 2026-02-12T18:06:37.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.595+0000 7f8ed67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:37.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.595+0000 7f8eefb0c640 5 monclient: authenticate success, global_id 4479 2026-02-12T18:06:37.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.595+0000 7f8eefb0c640 10 monclient: _renew_subs 2026-02-12T18:06:37.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.595+0000 7f8ed67fc640 1 -- 10.20.193.48:0/2533338197 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8edc003830 con 0x7f8ee805e490 2026-02-12T18:06:37.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.595+0000 7f8eefb0c640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:06:37.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.595+0000 7f8eefb0c640 1 -- 10.20.193.48:0/2533338197 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ee808ad40 con 0x7f8ee805e490 2026-02-12T18:06:37.607 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.595+0000 7f8ed67fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:37.607 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.596+0000 7f8ed67fc640 1 -- 10.20.193.48:0/2533338197 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8edc003e60 con 0x7f8ee805e490 2026-02-12T18:06:37.607 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.596+0000 7f8ed67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.607 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.596+0000 7f8ed7fff640 4 set_mon_vals no callback set 2026-02-12T18:06:37.607 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.596+0000 7f8ed67fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:06:37.607 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.596+0000 7f8ed67fc640 10 monclient: dump: 2026-02-12T18:06:37.607 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.607 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.607 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.607 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.607 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.607 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.607 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.607 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.607 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.607 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.607 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.607 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.607 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.607 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.608 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.608 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.608 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.596+0000 7f8eefb0c640 10 monclient: _renew_subs 2026-02-12T18:06:37.608 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.596+0000 7f8eefb0c640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:06:37.608 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.596+0000 7f8eefb0c640 1 -- 10.20.193.48:0/2533338197 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ee808a1b0 con 0x7f8ee805e490 2026-02-12T18:06:37.608 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.596+0000 7f8eefb0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:37.608 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.596+0000 7f8eefb0c640 1 --2- 10.20.193.48:0/2533338197 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8ee808f930 0x7f8ee808fd00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.608 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.596+0000 7f8eefb0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.608 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.596+0000 7f8eefb0c640 1 -- 10.20.193.48:0/2533338197 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f8ee805f140 con 0x7f8ee808f930 2026-02-12T18:06:37.608 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.596+0000 7f8eed881640 1 --2- 10.20.193.48:0/2533338197 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8ee808f930 0x7f8ee808fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.608 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.596+0000 7f8eed881640 10 monclient: get_auth_request con 0x7f8ee808f930 auth_method 0 2026-02-12T18:06:37.608 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.596+0000 7f8eed881640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.608 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.596+0000 7f8eed881640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.608 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.596+0000 7f8eed881640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.608 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.596+0000 7f8eed881640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.608 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.596+0000 7f8eed881640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.608 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.596+0000 7f8eed881640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.596+0000 7f8ed67fc640 1 -- 10.20.193.48:0/2533338197 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f8edc0039a0 con 0x7f8ee805e490 2026-02-12T18:06:37.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.596+0000 7f8eed881640 10 monclient(hunting): handle_auth_done global_id 4488 payload 824 2026-02-12T18:06:37.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.596+0000 7f8eed881640 1 -- 10.20.193.48:0/2533338197 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ee8097de0 con 0x7f8ee808f930 2026-02-12T18:06:37.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.596+0000 7f8ed67fc640 1 --2- 10.20.193.48:0/2533338197 >> v2:10.20.193.111:6812/977811348 conn(0x7f8eb803f800 0x7f8eb805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.597+0000 7f8ed67fc640 1 -- 10.20.193.48:0/2533338197 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(21..21 src has 1..21) ==== 3897+0+0 (secure 0 0 0) 0x7f8edc052d80 con 0x7f8ee805e490 2026-02-12T18:06:37.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.597+0000 7f8eee082640 1 --2- 10.20.193.48:0/2533338197 >> v2:10.20.193.111:6812/977811348 conn(0x7f8eb803f800 0x7f8eb805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.597+0000 7f8eee082640 10 monclient: get_auth_request con 0x7f8eb803f800 auth_method 0 2026-02-12T18:06:37.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.599+0000 7f8eed881640 1 -- 10.20.193.48:0/2533338197 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8ee808f930 msgr2=0x7f8ee808fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:37.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.599+0000 7f8eed881640 1 --2- 10.20.193.48:0/2533338197 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8ee808f930 0x7f8ee808fd00 secure :-1 s=READY pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ed8009060 tx=0x7f8ed80047e0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.599+0000 7f8ed67fc640 1 -- 10.20.193.48:0/2533338197 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8ed8035ea0 con 0x7f8ee808f930 2026-02-12T18:06:37.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.599+0000 7f8ed67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.599+0000 7f8ed67fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:06:37.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.599+0000 7f8ed67fc640 10 monclient: dump: 2026-02-12T18:06:37.611 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.611 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.611 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.611 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.611 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.611 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.611 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.611 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.612 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.612 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.612 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.612 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.612 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.612 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.612 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.612 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.599+0000 7f8ed67fc640 1 -- 10.20.193.48:0/2533338197 <== mon.6 v2:10.20.193.48:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f8ed804c450 con 0x7f8ee808f930 2026-02-12T18:06:37.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.599+0000 7f8ed67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:37.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.599+0000 7f8ed67fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:37.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.599+0000 7f8ed67fc640 1 -- 10.20.193.48:0/2533338197 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8ee808f930 msgr2=0x7f8ee808fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.599+0000 7f8ed67fc640 1 --2- 10.20.193.48:0/2533338197 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8ee808f930 0x7f8ee808fd00 secure :-1 s=READY pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ed8009060 tx=0x7f8ed80047e0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.599+0000 7f8ed67fc640 1 -- 10.20.193.48:0/2533338197 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8ee808f930 msgr2=0x7f8ee808fd00 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:37.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.599+0000 7f8ed67fc640 1 --2- 10.20.193.48:0/2533338197 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8ee808f930 0x7f8ee808fd00 secure :-1 s=CLOSED pgs=64 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ed8009060 tx=0x7f8ed80047e0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.599+0000 7f8eee082640 1 --2- 10.20.193.48:0/2533338197 >> v2:10.20.193.111:6812/977811348 conn(0x7f8eb803f800 0x7f8eb805fcb0 secure :-1 s=READY pgs=82 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ee4008fd0 tx=0x7f8ee4008f20 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.602+0000 7f8eefb0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:06:37.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.602+0000 7f8eefb0c640 1 --2- 10.20.193.48:0/2533338197 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8ee811fd90 0x7f8ee8120190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.602+0000 7f8eefb0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.602+0000 7f8eefb0c640 1 -- 10.20.193.48:0/2533338197 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f8ee805fd90 con 0x7f8ee811fd90 2026-02-12T18:06:37.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.602+0000 7f8eed881640 1 --2- 10.20.193.48:0/2533338197 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8ee811fd90 0x7f8ee8120190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.602+0000 7f8eed881640 10 monclient: get_auth_request con 0x7f8ee811fd90 auth_method 0 2026-02-12T18:06:37.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.602+0000 7f8eed881640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.602+0000 7f8eed881640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.602+0000 7f8eed881640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.602+0000 7f8eed881640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.602+0000 7f8eed881640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.602+0000 7f8eed881640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.603+0000 7f8eed881640 10 monclient(hunting): handle_auth_done global_id 4497 payload 824 2026-02-12T18:06:37.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.603+0000 7f8eed881640 1 -- 10.20.193.48:0/2533338197 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8ee805cd20 con 0x7f8ee811fd90 2026-02-12T18:06:37.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.605+0000 7f8eed881640 1 -- 10.20.193.48:0/2533338197 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8ee811fd90 msgr2=0x7f8ee8120190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:37.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.605+0000 7f8eed881640 1 --2- 10.20.193.48:0/2533338197 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8ee811fd90 0x7f8ee8120190 secure :-1 s=READY pgs=65 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ed8004820 tx=0x7f8ed8004770 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.605+0000 7f8ed67fc640 1 -- 10.20.193.48:0/2533338197 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8ed8052070 con 0x7f8ee811fd90 2026-02-12T18:06:37.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.605+0000 7f8ed67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.605+0000 7f8ed67fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:06:37.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.605+0000 7f8ed67fc640 10 monclient: dump: 2026-02-12T18:06:37.613 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.613 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.614 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.614 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.614 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.614 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.614 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.614 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.614 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.614 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.614 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.614 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.614 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.614 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.614 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.614 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.605+0000 7f8ed67fc640 1 -- 10.20.193.48:0/2533338197 <== mon.6 v2:10.20.193.48:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10159 (secure 0 0 0) 0x7f8ed8003e50 con 0x7f8ee811fd90 2026-02-12T18:06:37.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.605+0000 7f8ed67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:06:37.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.605+0000 7f8ed67fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:37.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.605+0000 7f8ed67fc640 1 -- 10.20.193.48:0/2533338197 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8ee811fd90 msgr2=0x7f8ee8120190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.605+0000 7f8ed67fc640 1 --2- 10.20.193.48:0/2533338197 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8ee811fd90 0x7f8ee8120190 secure :-1 s=READY pgs=65 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ed8004820 tx=0x7f8ed8004770 comp rx=0 tx=0).stop 2026-02-12T18:06:37.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.605+0000 7f8ed67fc640 1 -- 10.20.193.48:0/2533338197 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8ee811fd90 msgr2=0x7f8ee8120190 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:37.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.605+0000 7f8ed67fc640 1 --2- 10.20.193.48:0/2533338197 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8ee811fd90 0x7f8ee8120190 secure :-1 s=CLOSED pgs=65 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ed8004820 tx=0x7f8ed8004770 comp rx=0 tx=0).stop 2026-02-12T18:06:37.615 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:06:37.615 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:06:37.615 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:06:37.615 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:06:37.615 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 18, 2026-02-12T18:06:37.615 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 52432, 2026-02-12T18:06:37.615 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:06:37.615 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:06:37.615 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:06:37.615 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:06:37.615 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:06:37.615 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:06:37.615 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:06:37.616 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:06:37.616 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.616 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:06:37.616 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:37.616 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:06:37.616 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:06:37.616 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:37.616 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:37.616 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:37.616 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:37.616 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:37.616 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:37.616 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:37.616 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:37.616 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:37.616 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:37.616 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:37.616 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:37.616 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:37.616 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.617 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:06:37.617 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:06:37.617 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:37.617 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:37.617 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:37.617 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:37.617 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:37.617 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:37.617 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:37.617 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:37.617 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:37.617 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:37.617 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:37.617 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:37.617 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:37.617 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.617 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.617 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:06:37.617 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:06:37.617 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:06:37.618 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:06:37.618 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:06:37.618 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:06:37.618 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:37.618 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:37.618 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:06:37.618 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:06:37.618 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:06:37.618 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:06:37.618 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:06:37.618 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:06:37.618 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:06:37.618 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:37.618 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:06:37.618 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:37.618 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:37.618 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:37.618 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:37.618 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:37.618 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:37.619 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:37.619 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:37.619 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:37.619 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:37.619 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:37.619 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:37.619 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:37.619 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.619 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:06:37.619 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.619 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:06:37.619 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.619 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:06:37.619 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:06:37.619 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.619 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.620 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.620 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.620 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:06:37.620 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.620 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.620 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.620 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.620 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:06:37.620 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.620 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.620 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.620 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.620 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:06:37.620 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:06:37.620 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.620 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.620 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:06:37.620 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.620 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.620 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.620 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:06:37.621 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:06:37.621 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.621 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.621 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.621 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.621 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:06:37.621 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.621 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.621 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.621 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.621 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:06:37.621 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.621 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.621 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.621 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.621 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:06:37.621 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:06:37.621 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.621 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.621 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:06:37.621 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.622 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.622 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.622 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:06:37.622 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:06:37.622 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.622 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.622 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.622 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.622 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:06:37.622 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.622 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.622 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.622 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.622 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:06:37.622 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.622 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.622 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.622 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.622 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:06:37.622 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:06:37.622 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.623 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.623 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:06:37.623 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.623 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.623 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.623 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:06:37.623 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:06:37.623 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.623 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.623 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.623 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.623 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:06:37.623 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.623 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.623 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.623 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.623 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:06:37.623 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.623 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.623 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.623 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.623 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:06:37.624 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:06:37.624 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.624 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.624 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:06:37.624 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.624 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.624 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.624 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:06:37.624 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:06:37.624 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.624 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.624 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.624 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.624 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:06:37.624 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.624 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.624 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.624 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.624 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:06:37.624 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.624 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.624 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.624 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.625 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:06:37.625 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:06:37.625 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.625 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.625 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:37.625 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.625 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.625 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.625 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:06:37.625 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:06:37.625 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.625 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.625 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.625 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.625 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:06:37.625 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.625 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.625 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.625 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.625 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:06:37.625 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.625 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.625 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.625 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.626 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:06:37.626 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:06:37.626 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.626 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.626 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:06:37.626 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.626 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.626 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.626 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:06:37.626 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:06:37.626 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.626 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.626 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.626 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.626 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:06:37.626 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.626 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.626 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.626 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.626 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:06:37.626 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.626 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.626 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.626 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.627 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:06:37.627 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:06:37.627 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.627 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.627 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:37.627 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.627 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.627 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.627 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:06:37.627 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:06:37.627 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.627 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.627 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.627 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.627 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:06:37.627 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.627 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.627 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.627 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.627 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:06:37.627 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.627 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.627 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.627 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.627 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:06:37.628 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:06:37.628 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.628 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.628 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:06:37.628 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.628 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.628 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.628 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:06:37.628 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:06:37.628 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.628 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.628 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.628 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.628 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:06:37.628 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.628 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.628 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.628 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.628 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:06:37.628 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.628 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.628 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.628 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.628 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:06:37.629 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:06:37.629 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.629 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.629 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:06:37.629 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.629 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.629 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.629 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.629 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:06:37.629 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:06:37.629 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.629 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:37.629 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:37.629 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:37.629 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.629 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.629 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:06:37.629 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.629 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:37.629 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:37.629 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:37.629 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.630 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.630 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:06:37.630 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.630 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:37.630 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:37.630 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:06:37.630 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.630 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.630 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.630 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:06:37.630 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:06:37.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.605+0000 7f8eefb0c640 1 -- 10.20.193.48:0/2533338197 >> v2:10.20.193.111:6812/977811348 conn(0x7f8eb803f800 msgr2=0x7f8eb805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.605+0000 7f8eefb0c640 1 --2- 10.20.193.48:0/2533338197 >> v2:10.20.193.111:6812/977811348 conn(0x7f8eb803f800 0x7f8eb805fcb0 secure :-1 s=READY pgs=82 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8ee4008fd0 tx=0x7f8ee4008f20 comp rx=0 tx=0).stop 2026-02-12T18:06:37.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.605+0000 7f8eefb0c640 10 monclient: shutdown 2026-02-12T18:06:37.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.605+0000 7f8eefb0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:37.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.605+0000 7f8eefb0c640 1 -- 10.20.193.48:0/2533338197 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8ee805e490 msgr2=0x7f8ee808eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.605+0000 7f8eefb0c640 1 --2- 10.20.193.48:0/2533338197 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8ee805e490 0x7f8ee808eeb0 secure :-1 s=READY pgs=63 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8edc00e7e0 tx=0x7f8edc00ecb0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.605+0000 7f8eee082640 1 -- 10.20.193.48:0/2533338197 reap_dead start 2026-02-12T18:06:37.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.605+0000 7f8eefb0c640 1 -- 10.20.193.48:0/2533338197 shutdown_connections 2026-02-12T18:06:37.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.605+0000 7f8eefb0c640 1 --2- 10.20.193.48:0/2533338197 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8ee805e490 0x7f8ee808eeb0 unknown :-1 s=CLOSED pgs=63 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.605+0000 7f8eefb0c640 1 -- 10.20.193.48:0/2533338197 >> 10.20.193.48:0/2533338197 conn(0x7f8ee80548a0 msgr2=0x7f8ee8093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:37.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.605+0000 7f8eefb0c640 1 -- 10.20.193.48:0/2533338197 shutdown_connections 2026-02-12T18:06:37.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.605+0000 7f8eefb0c640 1 -- 10.20.193.48:0/2533338197 wait complete. 2026-02-12T18:06:37.632 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2026-02-12T18:06:37.632 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon e 2026-02-12T18:06:37.632 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2026-02-12T18:06:37.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.698+0000 7f2aa8c47640 10 monclient: get_monmap_and_config 2026-02-12T18:06:37.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.698+0000 7f2aa8c47640 10 monclient: build_initial_monmap 2026-02-12T18:06:37.699 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.698+0000 7f2aa8c47640 10 monclient: monmap: 2026-02-12T18:06:37.699 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:37.699 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.699 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:37.699176+0000 2026-02-12T18:06:37.699 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:37.699176+0000 2026-02-12T18:06:37.699 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:37.699 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.699 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:37.699 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:37.700 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:37.700 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:37.700 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:37.700 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:37.700 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:37.700 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:37.700 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:37.700 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:37.700 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:37.700 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.698+0000 7f2aa8c47640 1 Processor -- start 2026-02-12T18:06:37.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.698+0000 7f2aa8c47640 1 -- start start 2026-02-12T18:06:37.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.698+0000 7f2aa8c47640 10 monclient: init 2026-02-12T18:06:37.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.698+0000 7f2aa8c47640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:37.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.698+0000 7f2aa8c47640 10 monclient: _add_conns ranks=[8,5,3,1,10,7,0,9,4,6,2] 2026-02-12T18:06:37.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.698+0000 7f2aa8c47640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2aa405d550 0x7f2aa405d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.698+0000 7f2aa8c47640 10 monclient(hunting): picked mon.noname-e con 0x7f2aa405d550 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:37.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.698+0000 7f2aa8c47640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f2aa405de60 0x7f2aa4141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.698+0000 7f2aa8c47640 10 monclient(hunting): picked mon.noname-h con 0x7f2aa405de60 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:37.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.698+0000 7f2aa8c47640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2aa413ef60 0x7f2aa41424e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.698+0000 7f2aa8c47640 10 monclient(hunting): picked mon.noname-g con 0x7f2aa413ef60 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:06:37.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.698+0000 7f2aa8c47640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.698+0000 7f2aa8c47640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2aa408d390 con 0x7f2aa413ef60 2026-02-12T18:06:37.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.698+0000 7f2aa8c47640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.698+0000 7f2aa8c47640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f2aa408d5a0 con 0x7f2aa405de60 2026-02-12T18:06:37.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.698+0000 7f2aa8c47640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.698+0000 7f2aa8c47640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f2aa40580e0 con 0x7f2aa405d550 2026-02-12T18:06:37.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.698+0000 7f2aa8c47640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:37.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.698+0000 7f2aa8c47640 10 monclient(hunting): authenticate will time out at 636.424920s 2026-02-12T18:06:37.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2575640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2aa405d550 0x7f2aa405d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2575640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2aa405d550 0x7f2aa405d920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:58082/0 (socket says 10.20.193.48:58082) 2026-02-12T18:06:37.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2575640 1 -- 10.20.193.48:0/775100308 learned_addr learned my addr 10.20.193.48:0/775100308 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:37.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2575640 10 monclient(hunting): get_auth_request con 0x7f2aa405d550 auth_method 0 2026-02-12T18:06:37.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2d76640 1 --2- 10.20.193.48:0/775100308 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2aa413ef60 0x7f2aa41424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa1d74640 1 --2- 10.20.193.48:0/775100308 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f2aa405de60 0x7f2aa4141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa1d74640 10 monclient(hunting): get_auth_request con 0x7f2aa405de60 auth_method 0 2026-02-12T18:06:37.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa1d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2d76640 10 monclient(hunting): get_auth_request con 0x7f2aa413ef60 auth_method 0 2026-02-12T18:06:37.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2575640 10 monclient(hunting): handle_auth_done global_id 4535 payload 274 2026-02-12T18:06:37.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2575640 1 -- 10.20.193.48:0/775100308 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f2aa405de60 msgr2=0x7f2aa4141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:37.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2575640 1 --2- 10.20.193.48:0/775100308 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f2aa405de60 0x7f2aa4141fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2575640 1 -- 10.20.193.48:0/775100308 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2aa413ef60 msgr2=0x7f2aa41424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:37.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2575640 1 --2- 10.20.193.48:0/775100308 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2aa413ef60 0x7f2aa41424e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2575640 10 monclient: _finish_hunting 0 2026-02-12T18:06:37.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2575640 1 monclient: found mon.noname-e 2026-02-12T18:06:37.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:37.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2575640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:06:37.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.699+0000 7f2aa2575640 1 -- 10.20.193.48:0/775100308 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2aa404dc20 con 0x7f2aa405d550 2026-02-12T18:06:37.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.701+0000 7f2aa2575640 1 -- 10.20.193.48:0/775100308 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2aa405d550 msgr2=0x7f2aa405d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:37.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.701+0000 7f2aa2575640 1 --2- 10.20.193.48:0/775100308 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2aa405d550 0x7f2aa405d920 secure :-1 s=READY pgs=67 gs=1 cs=0 l=1 c_cookie=7084745603208319001 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a980098d0 tx=0x7f2a9802ee20 comp rx=0 tx=0).ready entity=mon.8 client_cookie=62521296eb3e1019 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa1573640 1 -- 10.20.193.48:0/775100308 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2a98035340 con 0x7f2aa405d550 2026-02-12T18:06:37.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa1573640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:06:37.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa1573640 10 monclient: dump: 2026-02-12T18:06:37.708 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.708 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.708 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.708 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.708 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.708 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.708 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.708 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.708 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.708 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.708 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.708 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.708 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.708 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.708 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.709 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa1573640 10 monclient: _finish_auth 0 2026-02-12T18:06:37.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa1573640 10 monclient: _check_auth_tickets 2026-02-12T18:06:37.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:37.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa8c47640 5 monclient: authenticate success, global_id 4535 2026-02-12T18:06:37.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa8c47640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:37.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa1573640 1 -- 10.20.193.48:0/775100308 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a9802faa0 con 0x7f2aa405d550 2026-02-12T18:06:37.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa1573640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:37.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa1573640 1 -- 10.20.193.48:0/775100308 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2a9802fc10 con 0x7f2aa405d550 2026-02-12T18:06:37.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa1573640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:06:37.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa1573640 10 monclient: dump: 2026-02-12T18:06:37.709 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.709 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.709 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.709 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.709 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.709 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.709 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.709 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.709 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.709 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.709 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.710 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.710 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.710 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.710 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.710 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa8c47640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:37.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa8c47640 4 set_mon_vals no callback set 2026-02-12T18:06:37.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa8c47640 10 monclient: shutdown 2026-02-12T18:06:37.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa8c47640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:37.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa8c47640 1 -- 10.20.193.48:0/775100308 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2aa405d550 msgr2=0x7f2aa405d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa8c47640 1 --2- 10.20.193.48:0/775100308 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2aa405d550 0x7f2aa405d920 secure :-1 s=READY pgs=67 gs=1 cs=0 l=1 c_cookie=7084745603208319001 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a980098d0 tx=0x7f2a9802ee20 comp rx=0 tx=0).stop 2026-02-12T18:06:37.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa8c47640 1 -- 10.20.193.48:0/775100308 shutdown_connections 2026-02-12T18:06:37.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa8c47640 1 --2- 10.20.193.48:0/775100308 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2aa413ef60 0x7f2aa41424e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa8c47640 1 --2- 10.20.193.48:0/775100308 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f2aa405de60 0x7f2aa4141fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa8c47640 1 --2- 10.20.193.48:0/775100308 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2aa405d550 0x7f2aa405d920 unknown :-1 s=CLOSED pgs=67 gs=1 cs=0 l=1 c_cookie=7084745603208319001 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa8c47640 1 -- 10.20.193.48:0/775100308 >> 10.20.193.48:0/775100308 conn(0x7f2aa40546a0 msgr2=0x7f2aa4054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:37.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa8c47640 1 -- 10.20.193.48:0/775100308 shutdown_connections 2026-02-12T18:06:37.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.702+0000 7f2aa8c47640 1 -- 10.20.193.48:0/775100308 wait complete. 2026-02-12T18:06:37.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa8c47640 10 monclient: build_initial_monmap 2026-02-12T18:06:37.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa8c47640 10 monclient: monmap: 2026-02-12T18:06:37.710 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:37.710 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:37.710 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:37.711 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:37.711 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:37.711 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.711 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:37.711 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:37.711 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:37.711 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:37.711 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:37.711 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:37.711 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:37.711 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:37.711 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:37.711 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa8c47640 1 Processor -- start 2026-02-12T18:06:37.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa8c47640 1 -- start start 2026-02-12T18:06:37.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa8c47640 10 monclient: init 2026-02-12T18:06:37.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa8c47640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:37.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa8c47640 10 monclient: _add_conns ranks=[7,1,6,5,0,8,2,3,4] 2026-02-12T18:06:37.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa8c47640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2aa405d550 0x7f2aa412f7e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa8c47640 10 monclient(hunting): picked mon.noname-i con 0x7f2aa405d550 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:37.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa8c47640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2aa405de60 0x7f2aa4109760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa8c47640 10 monclient(hunting): picked mon.noname-f con 0x7f2aa405de60 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:06:37.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa8c47640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f2aa413ef60 0x7f2aa4109ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa8c47640 10 monclient(hunting): picked mon.noname-d con 0x7f2aa413ef60 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:06:37.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa8c47640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa8c47640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2aa410c900 con 0x7f2aa405de60 2026-02-12T18:06:37.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa8c47640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa8c47640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f2aa410cec0 con 0x7f2aa413ef60 2026-02-12T18:06:37.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa8c47640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa8c47640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f2aa413dad0 con 0x7f2aa405d550 2026-02-12T18:06:37.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa8c47640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:37.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa8c47640 10 monclient(hunting): authenticate will time out at 636.429566s 2026-02-12T18:06:37.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa2575640 1 -- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2aa405d550 msgr2=0x7f2aa412f7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3303/0 2026-02-12T18:06:37.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa2575640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2aa405d550 0x7f2aa412f7e0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:06:37.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa2d76640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f2aa413ef60 0x7f2aa4109ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa2d76640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f2aa413ef60 0x7f2aa4109ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:44852/0 (socket says 10.20.193.48:44852) 2026-02-12T18:06:37.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa2d76640 1 -- 10.20.193.48:0/1343744214 learned_addr learned my addr 10.20.193.48:0/1343744214 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:37.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa2d76640 10 monclient(hunting): get_auth_request con 0x7f2aa413ef60 auth_method 0 2026-02-12T18:06:37.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa2d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa1d74640 1 --2- 10.20.193.48:0/1343744214 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2aa405de60 0x7f2aa4109760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa1d74640 10 monclient(hunting): get_auth_request con 0x7f2aa405de60 auth_method 0 2026-02-12T18:06:37.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa1d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa2d76640 10 monclient(hunting): handle_auth_done global_id 4506 payload 824 2026-02-12T18:06:37.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa2d76640 1 -- 10.20.193.48:0/1343744214 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2aa405d550 msgr2=0x7f2aa412f7e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:06:37.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa2d76640 1 --2- 10.20.193.48:0/1343744214 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2aa405d550 0x7f2aa412f7e0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa2d76640 1 -- 10.20.193.48:0/1343744214 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2aa405de60 msgr2=0x7f2aa4109760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa2d76640 1 --2- 10.20.193.48:0/1343744214 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2aa405de60 0x7f2aa4109760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa2d76640 10 monclient: _finish_hunting 0 2026-02-12T18:06:37.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa2d76640 1 monclient: found mon.noname-d 2026-02-12T18:06:37.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa2d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:37.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa2d76640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:06:37.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.703+0000 7f2aa2d76640 1 -- 10.20.193.48:0/1343744214 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a980094f0 con 0x7f2aa413ef60 2026-02-12T18:06:37.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2aa2d76640 1 -- 10.20.193.48:0/1343744214 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f2aa413ef60 msgr2=0x7f2aa4109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:37.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2aa2d76640 1 --2- 10.20.193.48:0/1343744214 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f2aa413ef60 0x7f2aa4109ca0 secure :-1 s=READY pgs=66 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a9400f900 tx=0x7f2a9400fdd0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2a8affd640 1 -- 10.20.193.48:0/1343744214 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2a9400dc70 con 0x7f2aa413ef60 2026-02-12T18:06:37.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2a8affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2a8affd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:06:37.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2a8affd640 10 monclient: dump: 2026-02-12T18:06:37.713 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.713 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.713 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.713 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.713 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.713 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.714 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.714 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.714 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.714 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.714 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.714 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.714 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.714 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.714 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.714 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2a8affd640 10 monclient: _finish_auth 0 2026-02-12T18:06:37.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2a8affd640 10 monclient: _check_auth_tickets 2026-02-12T18:06:37.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2a8affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:37.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2a8affd640 1 -- 10.20.193.48:0/1343744214 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a9400ddf0 con 0x7f2aa413ef60 2026-02-12T18:06:37.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2aa8c47640 5 monclient: authenticate success, global_id 4506 2026-02-12T18:06:37.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2aa8c47640 10 monclient: _renew_subs 2026-02-12T18:06:37.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2aa8c47640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:06:37.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2aa8c47640 1 -- 10.20.193.48:0/1343744214 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2aa4120150 con 0x7f2aa413ef60 2026-02-12T18:06:37.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2a8affd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:37.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2a8affd640 1 -- 10.20.193.48:0/1343744214 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2a94014df0 con 0x7f2aa413ef60 2026-02-12T18:06:37.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2a8affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2a8affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:06:37.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2aa0d72640 4 set_mon_vals no callback set 2026-02-12T18:06:37.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2a8affd640 10 monclient: dump: 2026-02-12T18:06:37.714 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.715 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.715 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.715 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.715 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.715 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.715 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.715 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.715 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.715 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.715 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.715 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.715 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.715 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.715 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.715 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2aa8c47640 10 monclient: _renew_subs 2026-02-12T18:06:37.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2aa8c47640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:06:37.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2aa8c47640 1 -- 10.20.193.48:0/1343744214 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f2aa412fd20 con 0x7f2aa413ef60 2026-02-12T18:06:37.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2aa8c47640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:37.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2aa8c47640 1 --2- 10.20.193.48:0/1343744214 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2aa4091010 0x7f2aa410a1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2aa8c47640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2aa8c47640 1 -- 10.20.193.48:0/1343744214 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f2aa40631f0 con 0x7f2aa4091010 2026-02-12T18:06:37.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2aa2575640 1 --2- 10.20.193.48:0/1343744214 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2aa4091010 0x7f2aa410a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2aa2575640 10 monclient: get_auth_request con 0x7f2aa4091010 auth_method 0 2026-02-12T18:06:37.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2aa2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2aa2575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2aa2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2aa2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2aa2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2aa2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2aa2d76640 1 --2- 10.20.193.48:0/1343744214 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f2aa413ef60 0x7f2aa4109ca0 secure :-1 s=READY pgs=66 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a9400f900 tx=0x7f2a9400fdd0 comp rx=0 tx=0).queue_received will delay after 1.77092e+09 on 0x7f2a94054240 osd_map(21..21 src has 1..21) 2026-02-12T18:06:37.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.706+0000 7f2a8affd640 1 -- 10.20.193.48:0/1343744214 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f2a94012070 con 0x7f2aa413ef60 2026-02-12T18:06:37.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.707+0000 7f2aa2575640 10 monclient(hunting): handle_auth_done global_id 4544 payload 824 2026-02-12T18:06:37.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.707+0000 7f2aa2575640 1 -- 10.20.193.48:0/1343744214 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2aa408d060 con 0x7f2aa4091010 2026-02-12T18:06:37.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.707+0000 7f2a8affd640 1 --2- 10.20.193.48:0/1343744214 >> v2:10.20.193.111:6812/977811348 conn(0x7f2a7003f7c0 0x7f2a7005fc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.707+0000 7f2aa1d74640 1 --2- 10.20.193.48:0/1343744214 >> v2:10.20.193.111:6812/977811348 conn(0x7f2a7003f7c0 0x7f2a7005fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.707+0000 7f2aa1d74640 10 monclient: get_auth_request con 0x7f2a7003f7c0 auth_method 0 2026-02-12T18:06:37.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.709+0000 7f2aa2575640 1 -- 10.20.193.48:0/1343744214 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2aa4091010 msgr2=0x7f2aa410a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:37.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.709+0000 7f2aa2575640 1 --2- 10.20.193.48:0/1343744214 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2aa4091010 0x7f2aa410a1e0 secure :-1 s=READY pgs=68 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a98009820 tx=0x7f2a98004770 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.709+0000 7f2a8affd640 1 -- 10.20.193.48:0/1343744214 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2a98037e20 con 0x7f2aa4091010 2026-02-12T18:06:37.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.709+0000 7f2a8affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.709+0000 7f2a8affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:06:37.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.709+0000 7f2a8affd640 10 monclient: dump: 2026-02-12T18:06:37.718 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.718 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.718 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.718 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.718 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.718 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.718 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.718 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.718 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.718 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.718 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.718 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.718 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.718 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.718 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.718 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.709+0000 7f2a8affd640 1 -- 10.20.193.48:0/1343744214 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f2a98006c80 con 0x7f2aa4091010 2026-02-12T18:06:37.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.709+0000 7f2a8affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:37.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.709+0000 7f2a8affd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:37.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.709+0000 7f2a8affd640 1 -- 10.20.193.48:0/1343744214 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2aa4091010 msgr2=0x7f2aa410a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.709+0000 7f2a8affd640 1 --2- 10.20.193.48:0/1343744214 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2aa4091010 0x7f2aa410a1e0 secure :-1 s=READY pgs=68 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a98009820 tx=0x7f2a98004770 comp rx=0 tx=0).stop 2026-02-12T18:06:37.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.709+0000 7f2a8affd640 1 -- 10.20.193.48:0/1343744214 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2aa4091010 msgr2=0x7f2aa410a1e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:37.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.709+0000 7f2a8affd640 1 --2- 10.20.193.48:0/1343744214 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2aa4091010 0x7f2aa410a1e0 secure :-1 s=CLOSED pgs=68 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a98009820 tx=0x7f2a98004770 comp rx=0 tx=0).stop 2026-02-12T18:06:37.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.709+0000 7f2aa1d74640 1 --2- 10.20.193.48:0/1343744214 >> v2:10.20.193.111:6812/977811348 conn(0x7f2a7003f7c0 0x7f2a7005fc70 secure :-1 s=READY pgs=83 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2aa405ca80 tx=0x7f2a8c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.712+0000 7f2aa8c47640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:06:37.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.713+0000 7f2aa8c47640 1 --2- 10.20.193.48:0/1343744214 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2aa410a720 0x7f2aa4058980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.713+0000 7f2aa8c47640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.713+0000 7f2aa8c47640 1 -- 10.20.193.48:0/1343744214 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f2aa4050410 con 0x7f2aa410a720 2026-02-12T18:06:37.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.713+0000 7f2aa2575640 1 --2- 10.20.193.48:0/1343744214 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2aa410a720 0x7f2aa4058980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.713+0000 7f2aa2575640 10 monclient: get_auth_request con 0x7f2aa410a720 auth_method 0 2026-02-12T18:06:37.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.713+0000 7f2aa2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.713+0000 7f2aa2575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.713+0000 7f2aa2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.713+0000 7f2aa2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.713+0000 7f2aa2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.713+0000 7f2aa2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.713+0000 7f2aa2575640 10 monclient(hunting): handle_auth_done global_id 4553 payload 824 2026-02-12T18:06:37.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.713+0000 7f2aa2575640 1 -- 10.20.193.48:0/1343744214 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2aa4057e00 con 0x7f2aa410a720 2026-02-12T18:06:37.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.715+0000 7f2aa2575640 1 -- 10.20.193.48:0/1343744214 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2aa410a720 msgr2=0x7f2aa4058980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:37.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.715+0000 7f2aa2575640 1 --2- 10.20.193.48:0/1343744214 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2aa410a720 0x7f2aa4058980 secure :-1 s=READY pgs=69 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a980098d0 tx=0x7f2a98008030 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.715+0000 7f2a8affd640 1 -- 10.20.193.48:0/1343744214 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2a9804d670 con 0x7f2aa410a720 2026-02-12T18:06:37.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.715+0000 7f2a8affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.715+0000 7f2a8affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:06:37.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.715+0000 7f2a8affd640 10 monclient: dump: 2026-02-12T18:06:37.720 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.720 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.720 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.720 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.720 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.720 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.720 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.720 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.720 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.720 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.720 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.720 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.720 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.720 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.720 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.720 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.715+0000 7f2a8affd640 1 -- 10.20.193.48:0/1343744214 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9992 (secure 0 0 0) 0x7f2a9804d7d0 con 0x7f2aa410a720 2026-02-12T18:06:37.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.715+0000 7f2a8affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:06:37.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.715+0000 7f2a8affd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:37.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.715+0000 7f2a8affd640 1 -- 10.20.193.48:0/1343744214 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2aa410a720 msgr2=0x7f2aa4058980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.715+0000 7f2a8affd640 1 --2- 10.20.193.48:0/1343744214 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2aa410a720 0x7f2aa4058980 secure :-1 s=READY pgs=69 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a980098d0 tx=0x7f2a98008030 comp rx=0 tx=0).stop 2026-02-12T18:06:37.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.715+0000 7f2a8affd640 1 -- 10.20.193.48:0/1343744214 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2aa410a720 msgr2=0x7f2aa4058980 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:37.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.715+0000 7f2a8affd640 1 --2- 10.20.193.48:0/1343744214 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2aa410a720 0x7f2aa4058980 unknown :-1 s=CLOSED pgs=69 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.721 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:06:37.721 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:06:37.721 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:06:37.721 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:06:37.721 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 18, 2026-02-12T18:06:37.721 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 52542, 2026-02-12T18:06:37.721 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:06:37.721 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:06:37.721 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:06:37.721 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:06:37.721 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:06:37.721 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:06:37.721 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:06:37.721 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:06:37.722 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.722 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:06:37.722 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:37.722 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:06:37.722 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:06:37.722 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:37.722 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:37.722 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:37.722 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:37.722 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:37.722 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:37.722 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:37.722 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:37.722 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:37.722 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:37.722 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:37.722 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:37.722 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:37.722 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.722 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:06:37.722 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:06:37.722 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:37.722 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:37.722 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:37.723 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:37.723 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:37.723 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:37.723 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:37.723 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:37.723 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:37.723 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:37.723 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:37.723 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:37.723 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:37.723 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.723 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.723 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:06:37.723 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:06:37.723 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:06:37.723 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:06:37.723 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:06:37.723 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:06:37.723 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:37.723 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:37.723 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:06:37.723 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:06:37.723 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:06:37.723 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:06:37.724 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:06:37.724 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:06:37.724 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:06:37.724 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:37.724 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:06:37.724 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:37.724 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:37.724 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:37.724 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:37.724 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:37.724 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:37.724 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:37.724 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:37.724 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:37.724 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:37.724 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:37.724 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:37.724 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:37.724 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.724 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:06:37.724 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.724 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:06:37.724 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.725 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:06:37.725 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:06:37.725 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.725 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.725 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.725 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.725 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:06:37.725 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.725 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.725 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.725 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.725 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:06:37.725 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.725 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.725 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.725 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.725 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:06:37.725 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:06:37.725 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.725 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.725 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:06:37.725 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.725 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.725 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.725 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:06:37.726 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:06:37.726 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.726 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.726 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.726 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.726 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:06:37.726 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.726 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.726 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.726 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.726 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:06:37.726 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.726 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.726 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.726 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.726 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:06:37.726 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:06:37.726 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.726 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.726 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:06:37.726 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.726 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.726 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.726 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:06:37.727 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:06:37.727 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.727 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.727 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.727 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.727 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:06:37.727 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.727 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.727 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.727 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.727 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:06:37.727 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.727 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.727 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.727 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.727 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:06:37.727 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:06:37.727 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.727 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.727 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:06:37.727 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.727 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.727 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.727 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:06:37.727 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:06:37.728 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.728 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.728 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.728 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.728 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:06:37.728 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.728 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.728 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.728 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.728 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:06:37.728 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.728 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.728 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.728 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.728 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:06:37.728 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:06:37.728 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.728 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.728 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:06:37.728 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.728 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.728 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.728 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:06:37.728 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:06:37.729 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.729 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.729 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.729 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.729 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:06:37.729 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.729 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.729 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.729 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.729 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:06:37.729 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.729 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.729 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.729 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.729 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:06:37.729 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:06:37.729 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.729 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.729 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:37.729 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.729 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.729 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.729 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:06:37.729 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:06:37.730 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.730 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.730 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.730 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.730 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:06:37.730 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.730 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.730 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.730 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.730 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:06:37.730 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.730 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.730 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.730 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.730 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:06:37.730 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:06:37.730 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.730 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.730 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:06:37.730 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.730 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.730 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.730 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:06:37.731 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:06:37.731 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.731 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.731 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.731 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.731 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:06:37.731 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.731 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.731 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.731 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.731 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:06:37.731 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.731 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.731 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.731 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.731 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:06:37.731 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:06:37.731 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.731 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.731 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:37.731 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.731 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.731 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.731 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:06:37.731 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:06:37.731 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.732 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.732 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.732 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.732 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:06:37.732 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.732 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.732 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.732 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.732 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:06:37.732 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.732 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.732 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.732 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.732 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:06:37.732 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:06:37.732 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.732 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.732 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:06:37.732 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.732 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.732 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.732 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:06:37.732 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:06:37.732 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.732 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.733 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.733 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.733 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:06:37.733 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.733 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.733 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.733 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.733 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:06:37.733 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.733 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.733 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.733 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.733 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:06:37.733 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:06:37.733 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.733 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.733 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:06:37.733 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.733 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.733 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.733 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.733 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:06:37.733 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:06:37.733 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.733 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:37.734 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:37.734 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:37.734 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.734 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.734 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:06:37.734 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.734 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:37.734 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:37.734 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:37.734 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.734 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.734 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.734 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:06:37.734 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:06:37.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.716+0000 7f2aa8c47640 1 -- 10.20.193.48:0/1343744214 >> v2:10.20.193.111:6812/977811348 conn(0x7f2a7003f7c0 msgr2=0x7f2a7005fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.716+0000 7f2aa8c47640 1 --2- 10.20.193.48:0/1343744214 >> v2:10.20.193.111:6812/977811348 conn(0x7f2a7003f7c0 0x7f2a7005fc70 secure :-1 s=READY pgs=83 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2aa405ca80 tx=0x7f2a8c008040 comp rx=0 tx=0).stop 2026-02-12T18:06:37.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.716+0000 7f2aa8c47640 10 monclient: shutdown 2026-02-12T18:06:37.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.716+0000 7f2aa8c47640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:37.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.716+0000 7f2aa8c47640 1 -- 10.20.193.48:0/1343744214 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f2aa413ef60 msgr2=0x7f2aa4109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.716+0000 7f2aa8c47640 1 --2- 10.20.193.48:0/1343744214 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f2aa413ef60 0x7f2aa4109ca0 secure :-1 s=READY pgs=66 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2a9400f900 tx=0x7f2a9400fdd0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.716+0000 7f2aa2d76640 1 -- 10.20.193.48:0/1343744214 reap_dead start 2026-02-12T18:06:37.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.716+0000 7f2aa2d76640 1 -- 10.20.193.48:0/1343744214 reap_dead start 2026-02-12T18:06:37.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.716+0000 7f2a8affd640 1 -- 10.20.193.48:0/1343744214 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(21..21 src has 1..21) ==== 3897+0+0 (unknown 0 0 0) 0x7f2a94054240 con 0x7f2aa413ef60 2026-02-12T18:06:37.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.716+0000 7f2aa8c47640 1 -- 10.20.193.48:0/1343744214 shutdown_connections 2026-02-12T18:06:37.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.716+0000 7f2aa8c47640 1 -- 10.20.193.48:0/1343744214 >> 10.20.193.48:0/1343744214 conn(0x7f2aa40546a0 msgr2=0x7f2aa405cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:37.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.716+0000 7f2aa8c47640 1 -- 10.20.193.48:0/1343744214 shutdown_connections 2026-02-12T18:06:37.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.716+0000 7f2aa8c47640 1 -- 10.20.193.48:0/1343744214 wait complete. 2026-02-12T18:06:37.736 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2026-02-12T18:06:37.736 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon f 2026-02-12T18:06:37.736 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2026-02-12T18:06:37.803 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.802+0000 7f983bfed640 10 monclient: get_monmap_and_config 2026-02-12T18:06:37.803 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.802+0000 7f983bfed640 10 monclient: build_initial_monmap 2026-02-12T18:06:37.803 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.802+0000 7f983bfed640 10 monclient: monmap: 2026-02-12T18:06:37.803 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:37.804 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.804 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:37.803755+0000 2026-02-12T18:06:37.804 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:37.803755+0000 2026-02-12T18:06:37.804 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:37.804 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.804 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:37.804 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:37.804 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:37.804 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:37.804 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:37.804 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:37.804 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:37.804 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:37.804 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:37.804 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:37.804 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:37.804 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f983bfed640 1 Processor -- start 2026-02-12T18:06:37.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f983bfed640 1 -- start start 2026-02-12T18:06:37.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f983bfed640 10 monclient: init 2026-02-12T18:06:37.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f983bfed640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:37.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f983bfed640 10 monclient: _add_conns ranks=[1,8,0,5,3,10,4,9,7,2,6] 2026-02-12T18:06:37.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f983bfed640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f983405c950 addr v1:10.20.193.111:6789/0 2026-02-12T18:06:37.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f983bfed640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f983405e490 0x7f98341857b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f983bfed640 10 monclient(hunting): picked mon.noname-e con 0x7f983405e490 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:37.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f983bfed640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f983405d430 addr v1:10.20.193.48:6789/0 2026-02-12T18:06:37.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f983bfed640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f983404dc20 con 0x7f983405d430 2026-02-12T18:06:37.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f983bfed640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f983405ddd0 con 0x7f983405c950 2026-02-12T18:06:37.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f983bfed640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f983bfed640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f9834092990 con 0x7f983405e490 2026-02-12T18:06:37.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f983bfed640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:37.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f983bfed640 10 monclient(hunting): authenticate will time out at 636.529663s 2026-02-12T18:06:37.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f983a563640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f983405d430 0x7f98341a5d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:50722/0 (socket says 10.20.193.48:50722) 2026-02-12T18:06:37.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f983a563640 1 -- 10.20.193.48:0/3761388698 learned_addr learned my addr 10.20.193.48:0/3761388698 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:06:37.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f9839561640 1 --2- 10.20.193.48:0/3761388698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f983405e490 0x7f98341857b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f9839561640 10 monclient(hunting): get_auth_request con 0x7f983405e490 auth_method 0 2026-02-12T18:06:37.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f9839561640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f9839561640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f9839561640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f9839561640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f9839561640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f9839561640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f9839561640 10 monclient(hunting): handle_auth_done global_id 4562 payload 274 2026-02-12T18:06:37.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f9839561640 1 -- 10.20.193.48:0/3761388698 >> v1:10.20.193.111:6789/0 conn(0x7f983405c950 legacy=0x7f983405cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:37.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f9839561640 1 -- 10.20.193.48:0/3761388698 >> v1:10.20.193.48:6789/0 conn(0x7f983405d430 legacy=0x7f98341a5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:37.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f9839561640 10 monclient: _finish_hunting 0 2026-02-12T18:06:37.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f9839561640 1 monclient: found mon.noname-e 2026-02-12T18:06:37.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f9839561640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:37.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f9839561640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:06:37.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.803+0000 7f9839561640 1 -- 10.20.193.48:0/3761388698 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9834092c70 con 0x7f983405e490 2026-02-12T18:06:37.810 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.806+0000 7f9839561640 1 -- 10.20.193.48:0/3761388698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f983405e490 msgr2=0x7f98341857b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:37.810 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.806+0000 7f9839561640 1 --2- 10.20.193.48:0/3761388698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f983405e490 0x7f98341857b0 secure :-1 s=READY pgs=70 gs=3 cs=0 l=1 c_cookie=9095886432669910828 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9828009800 tx=0x7f982802ed50 comp rx=0 tx=0).ready entity=mon.8 client_cookie=7e3b1484b895c72c server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.810 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.806+0000 7f9838d60640 1 -- 10.20.193.48:0/3761388698 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9828035340 con 0x7f983405e490 2026-02-12T18:06:37.811 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.806+0000 7f9838d60640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.811 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.806+0000 7f9838d60640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:06:37.811 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.806+0000 7f9838d60640 10 monclient: dump: 2026-02-12T18:06:37.811 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.811 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.811 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.811 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.811 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.811 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.811 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.811 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.811 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.811 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.811 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.811 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.811 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.811 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.811 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.811 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.811 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.806+0000 7f9838d60640 10 monclient: _finish_auth 0 2026-02-12T18:06:37.811 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.806+0000 7f9838d60640 10 monclient: _check_auth_tickets 2026-02-12T18:06:37.811 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.806+0000 7f9838d60640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:37.811 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.806+0000 7f9838d60640 1 -- 10.20.193.48:0/3761388698 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98280354c0 con 0x7f983405e490 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.806+0000 7f983bfed640 5 monclient: authenticate success, global_id 4562 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.806+0000 7f983bfed640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.806+0000 7f9838d60640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.806+0000 7f9838d60640 1 -- 10.20.193.48:0/3761388698 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9828035af0 con 0x7f983405e490 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.806+0000 7f983bfed640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.806+0000 7f983bfed640 4 set_mon_vals no callback set 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.806+0000 7f9838d60640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.806+0000 7f9838d60640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.806+0000 7f9838d60640 10 monclient: dump: 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.807+0000 7f983bfed640 10 monclient: shutdown 2026-02-12T18:06:37.812 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.807+0000 7f983bfed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.807+0000 7f983bfed640 1 -- 10.20.193.48:0/3761388698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f983405e490 msgr2=0x7f98341857b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.807+0000 7f983bfed640 1 --2- 10.20.193.48:0/3761388698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f983405e490 0x7f98341857b0 secure :-1 s=READY pgs=70 gs=3 cs=0 l=1 c_cookie=9095886432669910828 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9828009800 tx=0x7f982802ed50 comp rx=0 tx=0).stop 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.807+0000 7f983bfed640 1 -- 10.20.193.48:0/3761388698 shutdown_connections 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.807+0000 7f983bfed640 1 --2- 10.20.193.48:0/3761388698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f983405e490 0x7f98341857b0 unknown :-1 s=CLOSED pgs=70 gs=3 cs=0 l=1 c_cookie=9095886432669910828 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.807+0000 7f983bfed640 1 -- 10.20.193.48:0/3761388698 >> 10.20.193.48:0/3761388698 conn(0x7f98340548a0 msgr2=0x7f9834097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.807+0000 7f983bfed640 1 -- 10.20.193.48:0/3761388698 shutdown_connections 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.807+0000 7f983bfed640 1 -- 10.20.193.48:0/3761388698 wait complete. 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.807+0000 7f983bfed640 10 monclient: build_initial_monmap 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.807+0000 7f983bfed640 10 monclient: monmap: 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.807+0000 7f983bfed640 1 Processor -- start 2026-02-12T18:06:37.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.807+0000 7f983bfed640 1 -- start start 2026-02-12T18:06:37.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.807+0000 7f983bfed640 10 monclient: init 2026-02-12T18:06:37.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983bfed640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:37.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983bfed640 10 monclient: _add_conns ranks=[1,5,0,6,8,2,4,3,7] 2026-02-12T18:06:37.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983bfed640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f983405c950 0x7f9834090060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983bfed640 10 monclient(hunting): picked mon.noname-f con 0x7f983405c950 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:06:37.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983bfed640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f983405d430 0x7f98340905a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983bfed640 10 monclient(hunting): picked mon.noname-h con 0x7f983405d430 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:37.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983bfed640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f983405e490 0x7f9834090ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983bfed640 10 monclient(hunting): picked mon.noname-a con 0x7f983405e490 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:06:37.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983bfed640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983bfed640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f983408b920 con 0x7f983405e490 2026-02-12T18:06:37.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983bfed640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983bfed640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f983408ce00 con 0x7f983405c950 2026-02-12T18:06:37.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983bfed640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983bfed640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f98341429f0 con 0x7f983405d430 2026-02-12T18:06:37.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983bfed640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:37.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983bfed640 10 monclient(hunting): authenticate will time out at 636.534064s 2026-02-12T18:06:37.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983a563640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f983405e490 0x7f9834090ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983a563640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f983405e490 0x7f9834090ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:56610/0 (socket says 10.20.193.48:56610) 2026-02-12T18:06:37.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983a563640 1 -- 10.20.193.48:0/1640267938 learned_addr learned my addr 10.20.193.48:0/1640267938 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:37.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983a563640 10 monclient(hunting): get_auth_request con 0x7f983405e490 auth_method 0 2026-02-12T18:06:37.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983a563640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983a563640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983a563640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f9839d62640 1 --2- 10.20.193.48:0/1640267938 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f983405c950 0x7f9834090060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983a563640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983a563640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983a563640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f9839d62640 10 monclient(hunting): get_auth_request con 0x7f983405c950 auth_method 0 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f9839d62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f9839d62640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f9839d62640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f9839561640 1 --2- 10.20.193.48:0/1640267938 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f983405d430 0x7f98340905a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f9839561640 10 monclient(hunting): get_auth_request con 0x7f983405d430 auth_method 0 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f9839561640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f9839561640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f9839561640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f9839d62640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f9839d62640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f9839d62640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f9839561640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f9839561640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f9839561640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983a563640 10 monclient(hunting): handle_auth_done global_id 4581 payload 824 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983a563640 1 -- 10.20.193.48:0/1640267938 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f983405d430 msgr2=0x7f98340905a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983a563640 1 --2- 10.20.193.48:0/1640267938 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f983405d430 0x7f98340905a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983a563640 1 -- 10.20.193.48:0/1640267938 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f983405c950 msgr2=0x7f9834090060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983a563640 1 --2- 10.20.193.48:0/1640267938 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f983405c950 0x7f9834090060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983a563640 10 monclient: _finish_hunting 0 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983a563640 1 monclient: found mon.noname-a 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983a563640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:37.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983a563640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:06:37.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.808+0000 7f983a563640 1 -- 10.20.193.48:0/1640267938 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9828009420 con 0x7f983405e490 2026-02-12T18:06:37.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.810+0000 7f983a563640 1 -- 10.20.193.48:0/1640267938 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f983405e490 msgr2=0x7f9834090ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:37.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.810+0000 7f983a563640 1 --2- 10.20.193.48:0/1640267938 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f983405e490 0x7f9834090ae0 secure :-1 s=READY pgs=122 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f983000d500 tx=0x7f983000d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.810+0000 7f98227fc640 1 -- 10.20.193.48:0/1640267938 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9830006e90 con 0x7f983405e490 2026-02-12T18:06:37.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.810+0000 7f98227fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.810+0000 7f98227fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:06:37.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.810+0000 7f98227fc640 10 monclient: dump: 2026-02-12T18:06:37.817 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.818 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.818 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.818 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.818 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.818 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.818 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.818 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.818 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.818 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.818 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.818 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.818 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.818 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.818 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.818 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.810+0000 7f98227fc640 10 monclient: _finish_auth 0 2026-02-12T18:06:37.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.810+0000 7f98227fc640 10 monclient: _check_auth_tickets 2026-02-12T18:06:37.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.810+0000 7f98227fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:37.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.810+0000 7f98227fc640 1 -- 10.20.193.48:0/1640267938 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9830008530 con 0x7f983405e490 2026-02-12T18:06:37.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.810+0000 7f983bfed640 5 monclient: authenticate success, global_id 4581 2026-02-12T18:06:37.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.810+0000 7f98227fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:37.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.810+0000 7f98227fc640 1 -- 10.20.193.48:0/1640267938 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f98300086a0 con 0x7f983405e490 2026-02-12T18:06:37.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.810+0000 7f983bfed640 10 monclient: _renew_subs 2026-02-12T18:06:37.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.810+0000 7f983bfed640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:37.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.810+0000 7f983bfed640 1 -- 10.20.193.48:0/1640267938 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f983408be70 con 0x7f983405e490 2026-02-12T18:06:37.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.810+0000 7f9823fff640 4 set_mon_vals no callback set 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.810+0000 7f98227fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.810+0000 7f98227fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.810+0000 7f98227fc640 10 monclient: dump: 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.810+0000 7f983bfed640 10 monclient: _renew_subs 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.810+0000 7f983bfed640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.810+0000 7f983bfed640 1 -- 10.20.193.48:0/1640267938 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f983408b2e0 con 0x7f983405e490 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.811+0000 7f983bfed640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.811+0000 7f983bfed640 1 --2- 10.20.193.48:0/1640267938 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f983408ab80 0x7f983413fc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.811+0000 7f983bfed640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.811+0000 7f983bfed640 1 -- 10.20.193.48:0/1640267938 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f983405d2b0 con 0x7f983408ab80 2026-02-12T18:06:37.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.811+0000 7f98227fc640 1 -- 10.20.193.48:0/1640267938 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f9830008070 con 0x7f983405e490 2026-02-12T18:06:37.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.811+0000 7f9839d62640 1 --2- 10.20.193.48:0/1640267938 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f983408ab80 0x7f983413fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.811+0000 7f9839d62640 10 monclient: get_auth_request con 0x7f983408ab80 auth_method 0 2026-02-12T18:06:37.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.811+0000 7f9839d62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.811+0000 7f9839d62640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.811+0000 7f9839d62640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.811+0000 7f98227fc640 1 --2- 10.20.193.48:0/1640267938 >> v2:10.20.193.111:6812/977811348 conn(0x7f980403f800 0x7f980405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.811+0000 7f9839d62640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.811+0000 7f9839d62640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.811+0000 7f9839d62640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.811+0000 7f98227fc640 1 -- 10.20.193.48:0/1640267938 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3897+0+0 (secure 0 0 0) 0x7f9830053110 con 0x7f983405e490 2026-02-12T18:06:37.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.811+0000 7f9839561640 1 --2- 10.20.193.48:0/1640267938 >> v2:10.20.193.111:6812/977811348 conn(0x7f980403f800 0x7f980405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.811+0000 7f9839d62640 10 monclient(hunting): handle_auth_done global_id 4519 payload 824 2026-02-12T18:06:37.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.811+0000 7f9839d62640 1 -- 10.20.193.48:0/1640267938 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f983408ba60 con 0x7f983408ab80 2026-02-12T18:06:37.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.811+0000 7f9839561640 10 monclient: get_auth_request con 0x7f980403f800 auth_method 0 2026-02-12T18:06:37.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.814+0000 7f9839d62640 1 -- 10.20.193.48:0/1640267938 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f983408ab80 msgr2=0x7f983413fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:37.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.814+0000 7f9839d62640 1 --2- 10.20.193.48:0/1640267938 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f983408ab80 0x7f983413fc70 secure :-1 s=READY pgs=70 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9824003770 tx=0x7f982400fc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.814+0000 7f98227fc640 1 -- 10.20.193.48:0/1640267938 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f982400dbc0 con 0x7f983408ab80 2026-02-12T18:06:37.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.814+0000 7f98227fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.814+0000 7f98227fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:06:37.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.814+0000 7f98227fc640 10 monclient: dump: 2026-02-12T18:06:37.820 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.820 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.820 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.820 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.820 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.820 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.821 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.821 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.821 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.821 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.821 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.821 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.821 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.821 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.821 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.821 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.814+0000 7f9839561640 1 --2- 10.20.193.48:0/1640267938 >> v2:10.20.193.111:6812/977811348 conn(0x7f980403f800 0x7f980405fcb0 secure :-1 s=READY pgs=84 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9828009800 tx=0x7f9828039040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.814+0000 7f98227fc640 1 -- 10.20.193.48:0/1640267938 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f982400dd20 con 0x7f983408ab80 2026-02-12T18:06:37.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.814+0000 7f98227fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:37.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.814+0000 7f98227fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:37.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.814+0000 7f98227fc640 1 -- 10.20.193.48:0/1640267938 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f983408ab80 msgr2=0x7f983413fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.814+0000 7f98227fc640 1 --2- 10.20.193.48:0/1640267938 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f983408ab80 0x7f983413fc70 secure :-1 s=READY pgs=70 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9824003770 tx=0x7f982400fc10 comp rx=0 tx=0).stop 2026-02-12T18:06:37.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.814+0000 7f98227fc640 1 -- 10.20.193.48:0/1640267938 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f983408ab80 msgr2=0x7f983413fc70 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:37.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.814+0000 7f98227fc640 1 --2- 10.20.193.48:0/1640267938 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f983408ab80 0x7f983413fc70 secure :-1 s=CLOSED pgs=70 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9824003770 tx=0x7f982400fc10 comp rx=0 tx=0).stop 2026-02-12T18:06:37.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.817+0000 7f983bfed640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:06:37.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.818+0000 7f983bfed640 1 --2- 10.20.193.48:0/1640267938 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f983408d9b0 0x7f98341401b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.818+0000 7f983bfed640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.818+0000 7f983bfed640 1 -- 10.20.193.48:0/1640267938 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9834050410 con 0x7f983408d9b0 2026-02-12T18:06:37.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.818+0000 7f9839d62640 1 --2- 10.20.193.48:0/1640267938 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f983408d9b0 0x7f98341401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.818+0000 7f9839d62640 10 monclient: get_auth_request con 0x7f983408d9b0 auth_method 0 2026-02-12T18:06:37.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.818+0000 7f9839d62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.818+0000 7f9839d62640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.818+0000 7f9839d62640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.818+0000 7f9839d62640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.818+0000 7f9839d62640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.818+0000 7f9839d62640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.818+0000 7f9839d62640 10 monclient(hunting): handle_auth_done global_id 4528 payload 824 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.818+0000 7f9839d62640 1 -- 10.20.193.48:0/1640267938 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f983405cd20 con 0x7f983408d9b0 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.821+0000 7f9839d62640 1 -- 10.20.193.48:0/1640267938 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f983408d9b0 msgr2=0x7f98341401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.821+0000 7f9839d62640 1 --2- 10.20.193.48:0/1640267938 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f983408d9b0 0x7f98341401b0 secure :-1 s=READY pgs=71 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9824016000 tx=0x7f9824003810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.821+0000 7f98227fc640 1 -- 10.20.193.48:0/1640267938 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9824014b90 con 0x7f983408d9b0 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.821+0000 7f98227fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.821+0000 7f98227fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.821+0000 7f98227fc640 10 monclient: dump: 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.821+0000 7f98227fc640 1 -- 10.20.193.48:0/1640267938 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10326 (secure 0 0 0) 0x7f9824014cf0 con 0x7f983408d9b0 2026-02-12T18:06:37.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.821+0000 7f98227fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:06:37.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.821+0000 7f98227fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:37.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.821+0000 7f98227fc640 1 -- 10.20.193.48:0/1640267938 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f983408d9b0 msgr2=0x7f98341401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.821+0000 7f98227fc640 1 --2- 10.20.193.48:0/1640267938 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f983408d9b0 0x7f98341401b0 secure :-1 s=READY pgs=71 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9824016000 tx=0x7f9824003810 comp rx=0 tx=0).stop 2026-02-12T18:06:37.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.821+0000 7f98227fc640 1 -- 10.20.193.48:0/1640267938 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f983408d9b0 msgr2=0x7f98341401b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:37.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.821+0000 7f98227fc640 1 --2- 10.20.193.48:0/1640267938 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f983408d9b0 0x7f98341401b0 secure :-1 s=CLOSED pgs=71 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9824016000 tx=0x7f9824003810 comp rx=0 tx=0).stop 2026-02-12T18:06:37.824 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:06:37.824 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:06:37.824 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:06:37.824 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:06:37.824 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 18, 2026-02-12T18:06:37.824 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 52618, 2026-02-12T18:06:37.824 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:06:37.824 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:06:37.824 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:06:37.824 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:06:37.824 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:06:37.824 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:06:37.824 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:06:37.824 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:06:37.824 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.824 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:06:37.825 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:37.825 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:06:37.825 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:06:37.825 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:37.825 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:37.825 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:37.825 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:37.825 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:37.825 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:37.825 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:37.825 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:37.825 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:37.825 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:37.825 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:37.825 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:37.825 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:37.825 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.825 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:06:37.825 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:06:37.825 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:37.825 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:37.825 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:37.825 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:37.825 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:37.825 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:37.825 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:37.826 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.827 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:06:37.828 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.828 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.828 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.828 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.828 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:06:37.828 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:06:37.828 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.828 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.828 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:06:37.828 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.828 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.828 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.828 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:06:37.828 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:06:37.828 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.828 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.828 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.828 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.828 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:06:37.828 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.828 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.828 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.828 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.828 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:06:37.828 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.828 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:06:37.829 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:06:37.830 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.830 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.830 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:06:37.830 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.830 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.830 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.830 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:06:37.830 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:06:37.830 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.830 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.830 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.830 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.830 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:06:37.830 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.830 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.830 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.830 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.830 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:06:37.830 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.830 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.830 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.830 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.830 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.831 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.832 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:06:37.833 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.834 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.835 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:06:37.835 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.835 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.835 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.835 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.835 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:06:37.835 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.835 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.835 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.835 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.835 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:06:37.835 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:06:37.835 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.835 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.835 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:06:37.835 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.835 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.835 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.835 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.835 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:06:37.835 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:06:37.835 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.835 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:37.835 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:37.835 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:37.835 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.836 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.836 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:06:37.836 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.836 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:37.836 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:37.836 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:06:37.836 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.836 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.836 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:06:37.836 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.836 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:37.836 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:37.836 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:06:37.836 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.836 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.836 INFO:teuthology.orchestra.run.trial048.stdout: "mgr": [ 2026-02-12T18:06:37.836 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.836 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:37.836 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:37.836 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:37.836 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.836 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.836 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.836 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:06:37.836 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:06:37.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.821+0000 7f983bfed640 1 -- 10.20.193.48:0/1640267938 >> v2:10.20.193.111:6812/977811348 conn(0x7f980403f800 msgr2=0x7f980405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.821+0000 7f983bfed640 1 --2- 10.20.193.48:0/1640267938 >> v2:10.20.193.111:6812/977811348 conn(0x7f980403f800 0x7f980405fcb0 secure :-1 s=READY pgs=84 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9828009800 tx=0x7f9828039040 comp rx=0 tx=0).stop 2026-02-12T18:06:37.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.821+0000 7f983bfed640 10 monclient: shutdown 2026-02-12T18:06:37.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.821+0000 7f983bfed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:37.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.821+0000 7f983a563640 1 -- 10.20.193.48:0/1640267938 reap_dead start 2026-02-12T18:06:37.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.821+0000 7f983bfed640 1 -- 10.20.193.48:0/1640267938 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f983405e490 msgr2=0x7f9834090ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.821+0000 7f983bfed640 1 --2- 10.20.193.48:0/1640267938 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f983405e490 0x7f9834090ae0 secure :-1 s=READY pgs=122 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f983000d500 tx=0x7f983000d9d0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.821+0000 7f983bfed640 1 -- 10.20.193.48:0/1640267938 shutdown_connections 2026-02-12T18:06:37.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.821+0000 7f983bfed640 1 --2- 10.20.193.48:0/1640267938 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f983405e490 0x7f9834090ae0 unknown :-1 s=CLOSED pgs=122 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.821+0000 7f983bfed640 1 -- 10.20.193.48:0/1640267938 >> 10.20.193.48:0/1640267938 conn(0x7f98340548a0 msgr2=0x7f983413f020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:37.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.821+0000 7f983bfed640 1 -- 10.20.193.48:0/1640267938 shutdown_connections 2026-02-12T18:06:37.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.821+0000 7f983bfed640 1 -- 10.20.193.48:0/1640267938 wait complete. 2026-02-12T18:06:37.838 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2026-02-12T18:06:37.838 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon g 2026-02-12T18:06:37.838 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2026-02-12T18:06:37.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.903+0000 7fd114d4c640 10 monclient: get_monmap_and_config 2026-02-12T18:06:37.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.903+0000 7fd114d4c640 10 monclient: build_initial_monmap 2026-02-12T18:06:37.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.903+0000 7fd114d4c640 10 monclient: monmap: 2026-02-12T18:06:37.904 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:37.904 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.904 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:37.904633+0000 2026-02-12T18:06:37.904 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:37.904633+0000 2026-02-12T18:06:37.904 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:37.904 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.905 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:37.905 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:37.905 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:37.905 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:37.905 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:37.905 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:37.905 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:37.905 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:37.905 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:37.905 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:37.905 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:37.905 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.906 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.903+0000 7fd114d4c640 1 Processor -- start 2026-02-12T18:06:37.906 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd114d4c640 1 -- start start 2026-02-12T18:06:37.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd114d4c640 10 monclient: init 2026-02-12T18:06:37.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd114d4c640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:37.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd114d4c640 10 monclient: _add_conns ranks=[4,10,2,0,3,6,7,9,5,1,8] 2026-02-12T18:06:37.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd114d4c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd11005d550 0x7fd11005d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd114d4c640 10 monclient(hunting): picked mon.noname-c con 0x7fd11005d550 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:06:37.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd114d4c640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7fd11005de60 0x7fd110141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd114d4c640 10 monclient(hunting): picked mon.noname-f con 0x7fd11005de60 addr v2:10.20.193.111:3300/0 2026-02-12T18:06:37.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd114d4c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd11013ef60 0x7fd1101424e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd114d4c640 10 monclient(hunting): picked mon.noname-b con 0x7fd11013ef60 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:37.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd114d4c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd114d4c640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7fd11008d390 con 0x7fd11005de60 2026-02-12T18:06:37.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd114d4c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd114d4c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fd11008d5a0 con 0x7fd11013ef60 2026-02-12T18:06:37.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd114d4c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd114d4c640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fd1100580e0 con 0x7fd11005d550 2026-02-12T18:06:37.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd114d4c640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:37.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd114d4c640 10 monclient(hunting): authenticate will time out at 636.630339s 2026-02-12T18:06:37.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10e575640 1 -- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd11005d550 msgr2=0x7fd11005d920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.48:3302/0 2026-02-12T18:06:37.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10e575640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd11005d550 0x7fd11005d920 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:06:37.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10ed76640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd11013ef60 0x7fd1101424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10ed76640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd11013ef60 0x7fd1101424e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:34274/0 (socket says 10.20.193.48:34274) 2026-02-12T18:06:37.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10ed76640 1 -- 10.20.193.48:0/4034947705 learned_addr learned my addr 10.20.193.48:0/4034947705 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:37.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10ed76640 10 monclient(hunting): get_auth_request con 0x7fd11013ef60 auth_method 0 2026-02-12T18:06:37.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10ed76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10dd74640 1 --2- 10.20.193.48:0/4034947705 >> v2:10.20.193.111:3300/0 conn(0x7fd11005de60 0x7fd110141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10dd74640 10 monclient(hunting): get_auth_request con 0x7fd11005de60 auth_method 0 2026-02-12T18:06:37.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10dd74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10ed76640 10 monclient(hunting): handle_auth_done global_id 34418 payload 274 2026-02-12T18:06:37.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10ed76640 1 -- 10.20.193.48:0/4034947705 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd11005d550 msgr2=0x7fd11005d920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:06:37.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10ed76640 1 --2- 10.20.193.48:0/4034947705 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd11005d550 0x7fd11005d920 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10ed76640 1 -- 10.20.193.48:0/4034947705 >> v2:10.20.193.111:3300/0 conn(0x7fd11005de60 msgr2=0x7fd110141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:37.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10ed76640 1 --2- 10.20.193.48:0/4034947705 >> v2:10.20.193.111:3300/0 conn(0x7fd11005de60 0x7fd110141fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10ed76640 10 monclient: _finish_hunting 0 2026-02-12T18:06:37.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10ed76640 1 monclient: found mon.noname-b 2026-02-12T18:06:37.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10ed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:37.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10ed76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:06:37.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.904+0000 7fd10ed76640 1 -- 10.20.193.48:0/4034947705 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd11004dc20 con 0x7fd11013ef60 2026-02-12T18:06:37.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd10ed76640 1 -- 10.20.193.48:0/4034947705 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd11013ef60 msgr2=0x7fd1101424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:37.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd10ed76640 1 --2- 10.20.193.48:0/4034947705 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd11013ef60 0x7fd1101424e0 secure :-1 s=READY pgs=56 gs=2 cs=0 l=1 c_cookie=5047261628355730793 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd10000a140 tx=0x7fd10002fef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=460b79b59e9a5d69 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd10d573640 1 -- 10.20.193.48:0/4034947705 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd100030b70 con 0x7fd11013ef60 2026-02-12T18:06:37.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd10d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd10d573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:06:37.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd10d573640 10 monclient: dump: 2026-02-12T18:06:37.911 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.911 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.911 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.911 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.911 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.911 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.911 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.911 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.911 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.911 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.911 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.911 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.911 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.912 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.912 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.912 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd10d573640 10 monclient: _finish_auth 0 2026-02-12T18:06:37.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd10d573640 10 monclient: _check_auth_tickets 2026-02-12T18:06:37.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd10d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:37.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd10d573640 1 -- 10.20.193.48:0/4034947705 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd100030cf0 con 0x7fd11013ef60 2026-02-12T18:06:37.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd114d4c640 5 monclient: authenticate success, global_id 34418 2026-02-12T18:06:37.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd10d573640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:37.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd10d573640 1 -- 10.20.193.48:0/4034947705 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd100030e60 con 0x7fd11013ef60 2026-02-12T18:06:37.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd114d4c640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:37.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd114d4c640 4 set_mon_vals no callback set 2026-02-12T18:06:37.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd10d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd10d573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:06:37.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd10d573640 10 monclient: dump: 2026-02-12T18:06:37.912 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.912 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.912 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.912 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.912 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.912 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.912 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.912 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.912 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.912 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.912 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.913 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.913 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.913 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.913 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.913 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd114d4c640 10 monclient: shutdown 2026-02-12T18:06:37.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd114d4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:37.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd114d4c640 1 -- 10.20.193.48:0/4034947705 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd11013ef60 msgr2=0x7fd1101424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd114d4c640 1 --2- 10.20.193.48:0/4034947705 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd11013ef60 0x7fd1101424e0 secure :-1 s=READY pgs=56 gs=2 cs=0 l=1 c_cookie=5047261628355730793 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd10000a140 tx=0x7fd10002fef0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd114d4c640 1 -- 10.20.193.48:0/4034947705 shutdown_connections 2026-02-12T18:06:37.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd114d4c640 1 --2- 10.20.193.48:0/4034947705 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd11013ef60 0x7fd1101424e0 unknown :-1 s=CLOSED pgs=56 gs=2 cs=0 l=1 c_cookie=5047261628355730793 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd114d4c640 1 --2- 10.20.193.48:0/4034947705 >> v2:10.20.193.111:3300/0 conn(0x7fd11005de60 0x7fd110141fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd114d4c640 1 --2- 10.20.193.48:0/4034947705 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd11005d550 0x7fd11005d920 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd114d4c640 1 -- 10.20.193.48:0/4034947705 >> 10.20.193.48:0/4034947705 conn(0x7fd1100546a0 msgr2=0x7fd110054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:37.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd114d4c640 1 -- 10.20.193.48:0/4034947705 shutdown_connections 2026-02-12T18:06:37.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.907+0000 7fd114d4c640 1 -- 10.20.193.48:0/4034947705 wait complete. 2026-02-12T18:06:37.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.908+0000 7fd114d4c640 10 monclient: build_initial_monmap 2026-02-12T18:06:37.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.908+0000 7fd114d4c640 10 monclient: monmap: 2026-02-12T18:06:37.913 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:37.913 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:37.913 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:37.913 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:37.913 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:37.913 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.913 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:37.913 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:37.914 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:37.914 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:37.914 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:37.914 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:37.914 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:37.914 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:37.914 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:37.914 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.908+0000 7fd114d4c640 1 Processor -- start 2026-02-12T18:06:37.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.908+0000 7fd114d4c640 1 -- start start 2026-02-12T18:06:37.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.908+0000 7fd114d4c640 10 monclient: init 2026-02-12T18:06:37.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.908+0000 7fd114d4c640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:37.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.908+0000 7fd114d4c640 10 monclient: _add_conns ranks=[7,8,5,2,1,6,0,3,4] 2026-02-12T18:06:37.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.908+0000 7fd114d4c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd11005d550 0x7fd11010d330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.908+0000 7fd114d4c640 10 monclient(hunting): picked mon.noname-i con 0x7fd11005d550 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:06:37.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.908+0000 7fd114d4c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd11005de60 0x7fd110109760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.908+0000 7fd114d4c640 10 monclient(hunting): picked mon.noname-e con 0x7fd11005de60 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:06:37.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.908+0000 7fd114d4c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd11013ef60 0x7fd110109ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.908+0000 7fd114d4c640 10 monclient(hunting): picked mon.noname-h con 0x7fd11013ef60 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:37.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.908+0000 7fd114d4c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.908+0000 7fd114d4c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fd11010c180 con 0x7fd11013ef60 2026-02-12T18:06:37.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.908+0000 7fd114d4c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.908+0000 7fd114d4c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fd11010cf40 con 0x7fd11005d550 2026-02-12T18:06:37.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.908+0000 7fd114d4c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.908+0000 7fd114d4c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fd11010c6a0 con 0x7fd11005de60 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.908+0000 7fd114d4c640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.908+0000 7fd114d4c640 10 monclient(hunting): authenticate will time out at 636.634959s 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10dd74640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd11005de60 0x7fd110109760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10e575640 1 -- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd11005d550 msgr2=0x7fd11010d330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3303/0 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10e575640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd11005d550 0x7fd11010d330 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10dd74640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd11005de60 0x7fd110109760 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:58106/0 (socket says 10.20.193.48:58106) 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10dd74640 1 -- 10.20.193.48:0/735631376 learned_addr learned my addr 10.20.193.48:0/735631376 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10dd74640 10 monclient(hunting): get_auth_request con 0x7fd11005de60 auth_method 0 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10dd74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10ed76640 1 --2- 10.20.193.48:0/735631376 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd11013ef60 0x7fd110109ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10ed76640 10 monclient(hunting): get_auth_request con 0x7fd11013ef60 auth_method 0 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10ed76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10dd74640 10 monclient(hunting): handle_auth_done global_id 4571 payload 824 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10dd74640 1 -- 10.20.193.48:0/735631376 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd11005d550 msgr2=0x7fd11010d330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10dd74640 1 --2- 10.20.193.48:0/735631376 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd11005d550 0x7fd11010d330 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10dd74640 1 -- 10.20.193.48:0/735631376 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd11013ef60 msgr2=0x7fd110109ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10dd74640 1 --2- 10.20.193.48:0/735631376 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd11013ef60 0x7fd110109ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10dd74640 10 monclient: _finish_hunting 0 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10dd74640 1 monclient: found mon.noname-e 2026-02-12T18:06:37.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10dd74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:37.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10dd74640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:06:37.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.909+0000 7fd10dd74640 1 -- 10.20.193.48:0/735631376 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd10000a5d0 con 0x7fd11005de60 2026-02-12T18:06:37.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.911+0000 7fd10dd74640 1 -- 10.20.193.48:0/735631376 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd11005de60 msgr2=0x7fd110109760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:37.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.911+0000 7fd10dd74640 1 --2- 10.20.193.48:0/735631376 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd11005de60 0x7fd110109760 secure :-1 s=READY pgs=71 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0f80093f0 tx=0x7fd0f800ed30 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.911+0000 7fd0f6ffd640 1 -- 10.20.193.48:0/735631376 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd0f800cb50 con 0x7fd11005de60 2026-02-12T18:06:37.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.911+0000 7fd0f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.911+0000 7fd0f6ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:06:37.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.911+0000 7fd0f6ffd640 10 monclient: dump: 2026-02-12T18:06:37.917 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.917 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.911+0000 7fd0f6ffd640 10 monclient: _finish_auth 0 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.911+0000 7fd0f6ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.911+0000 7fd0f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.911+0000 7fd0f6ffd640 1 -- 10.20.193.48:0/735631376 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd0f800ccd0 con 0x7fd11005de60 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.911+0000 7fd0f6ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.911+0000 7fd0f6ffd640 1 -- 10.20.193.48:0/735631376 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd0f800ce40 con 0x7fd11005de60 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.911+0000 7fd114d4c640 5 monclient: authenticate success, global_id 4571 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.911+0000 7fd114d4c640 10 monclient: _renew_subs 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.911+0000 7fd114d4c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.911+0000 7fd114d4c640 1 -- 10.20.193.48:0/735631376 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd11010cc30 con 0x7fd11005de60 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.911+0000 7fd10cd72640 4 set_mon_vals no callback set 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.911+0000 7fd0f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.911+0000 7fd0f6ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:06:37.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.911+0000 7fd0f6ffd640 10 monclient: dump: 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.911+0000 7fd114d4c640 10 monclient: _renew_subs 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.911+0000 7fd114d4c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.911+0000 7fd114d4c640 1 -- 10.20.193.48:0/735631376 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fd11010b970 con 0x7fd11005de60 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.912+0000 7fd114d4c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.912+0000 7fd114d4c640 1 --2- 10.20.193.48:0/735631376 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd110091010 0x7fd11010a1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.912+0000 7fd114d4c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.912+0000 7fd114d4c640 1 -- 10.20.193.48:0/735631376 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd11005f140 con 0x7fd110091010 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.912+0000 7fd10e575640 1 --2- 10.20.193.48:0/735631376 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd110091010 0x7fd11010a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.912+0000 7fd0f6ffd640 1 -- 10.20.193.48:0/735631376 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fd0f8011070 con 0x7fd11005de60 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.912+0000 7fd10e575640 10 monclient: get_auth_request con 0x7fd110091010 auth_method 0 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.912+0000 7fd10e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.912+0000 7fd10e575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.912+0000 7fd10e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.912+0000 7fd0f6ffd640 1 --2- 10.20.193.48:0/735631376 >> v2:10.20.193.111:6812/977811348 conn(0x7fd0dc03f7b0 0x7fd0dc05fc60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.912+0000 7fd10e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.912+0000 7fd10e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.912+0000 7fd10e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.912+0000 7fd0f6ffd640 1 -- 10.20.193.48:0/735631376 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(21..21 src has 1..21) ==== 3897+0+0 (secure 0 0 0) 0x7fd0f8052b90 con 0x7fd11005de60 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.912+0000 7fd10ed76640 1 --2- 10.20.193.48:0/735631376 >> v2:10.20.193.111:6812/977811348 conn(0x7fd0dc03f7b0 0x7fd0dc05fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.912+0000 7fd10ed76640 10 monclient: get_auth_request con 0x7fd0dc03f7b0 auth_method 0 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.912+0000 7fd10e575640 10 monclient(hunting): handle_auth_done global_id 4503 payload 824 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.912+0000 7fd10e575640 1 -- 10.20.193.48:0/735631376 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd11010d080 con 0x7fd110091010 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.915+0000 7fd10e575640 1 -- 10.20.193.48:0/735631376 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd110091010 msgr2=0x7fd11010a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.915+0000 7fd10e575640 1 --2- 10.20.193.48:0/735631376 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd110091010 0x7fd11010a1e0 secure :-1 s=READY pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd10400b450 tx=0x7fd10400b920 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.915+0000 7fd10ed76640 1 --2- 10.20.193.48:0/735631376 >> v2:10.20.193.111:6812/977811348 conn(0x7fd0dc03f7b0 0x7fd0dc05fc60 secure :-1 s=READY pgs=85 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd10002ff30 tx=0x7fd100007f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.915+0000 7fd0f6ffd640 1 -- 10.20.193.48:0/735631376 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd104005530 con 0x7fd110091010 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.915+0000 7fd0f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.915+0000 7fd0f6ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.915+0000 7fd0f6ffd640 10 monclient: dump: 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.920 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.921 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.921 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.921 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.921 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.915+0000 7fd0f6ffd640 1 -- 10.20.193.48:0/735631376 <== mon.3 v2:10.20.193.111:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fd104005690 con 0x7fd110091010 2026-02-12T18:06:37.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.915+0000 7fd0f6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:37.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.915+0000 7fd0f6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:37.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.915+0000 7fd0f6ffd640 1 -- 10.20.193.48:0/735631376 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd110091010 msgr2=0x7fd11010a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.915+0000 7fd0f6ffd640 1 --2- 10.20.193.48:0/735631376 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd110091010 0x7fd11010a1e0 secure :-1 s=READY pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd10400b450 tx=0x7fd10400b920 comp rx=0 tx=0).stop 2026-02-12T18:06:37.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.915+0000 7fd0f6ffd640 1 -- 10.20.193.48:0/735631376 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd110091010 msgr2=0x7fd11010a1e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:37.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.915+0000 7fd0f6ffd640 1 --2- 10.20.193.48:0/735631376 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd110091010 0x7fd11010a1e0 secure :-1 s=CLOSED pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd10400b450 tx=0x7fd10400b920 comp rx=0 tx=0).stop 2026-02-12T18:06:37.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.919+0000 7fd114d4c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:06:37.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.919+0000 7fd114d4c640 1 --2- 10.20.193.48:0/735631376 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd11012f230 0x7fd11012f630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:37.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.919+0000 7fd114d4c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:37.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.919+0000 7fd114d4c640 1 -- 10.20.193.48:0/735631376 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd110050410 con 0x7fd11012f230 2026-02-12T18:06:37.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.919+0000 7fd10e575640 1 --2- 10.20.193.48:0/735631376 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd11012f230 0x7fd11012f630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:37.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.919+0000 7fd10e575640 10 monclient: get_auth_request con 0x7fd11012f230 auth_method 0 2026-02-12T18:06:37.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.919+0000 7fd10e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:37.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.919+0000 7fd10e575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:37.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.919+0000 7fd10e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:37.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.919+0000 7fd10e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:37.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.919+0000 7fd10e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:37.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.919+0000 7fd10e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:37.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.919+0000 7fd10e575640 10 monclient(hunting): handle_auth_done global_id 4512 payload 824 2026-02-12T18:06:37.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.919+0000 7fd10e575640 1 -- 10.20.193.48:0/735631376 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd110057e00 con 0x7fd11012f230 2026-02-12T18:06:37.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.921+0000 7fd10e575640 1 -- 10.20.193.48:0/735631376 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd11012f230 msgr2=0x7fd11012f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:37.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.921+0000 7fd10e575640 1 --2- 10.20.193.48:0/735631376 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd11012f230 0x7fd11012f630 secure :-1 s=READY pgs=59 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd10400b450 tx=0x7fd104005a90 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.922+0000 7fd0f6ffd640 1 -- 10.20.193.48:0/735631376 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd10401f070 con 0x7fd11012f230 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.922+0000 7fd0f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.922+0000 7fd0f6ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.922+0000 7fd0f6ffd640 10 monclient: dump: 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.922+0000 7fd0f6ffd640 1 -- 10.20.193.48:0/735631376 <== mon.3 v2:10.20.193.111:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9992 (secure 0 0 0) 0x7fd104010690 con 0x7fd11012f230 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.922+0000 7fd0f6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.922+0000 7fd0f6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.922+0000 7fd0f6ffd640 1 -- 10.20.193.48:0/735631376 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd11012f230 msgr2=0x7fd11012f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.922+0000 7fd0f6ffd640 1 --2- 10.20.193.48:0/735631376 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd11012f230 0x7fd11012f630 secure :-1 s=READY pgs=59 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd10400b450 tx=0x7fd104005a90 comp rx=0 tx=0).stop 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.922+0000 7fd0f6ffd640 1 -- 10.20.193.48:0/735631376 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd11012f230 msgr2=0x7fd11012f630 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:37.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.922+0000 7fd0f6ffd640 1 --2- 10.20.193.48:0/735631376 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd11012f230 0x7fd11012f630 secure :-1 s=CLOSED pgs=59 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd10400b450 tx=0x7fd104005a90 comp rx=0 tx=0).stop 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 18, 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 52718, 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:37.924 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:06:37.925 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.926 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.927 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:06:37.928 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:06:37.929 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:06:37.930 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.931 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:37.932 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:06:37.933 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:37.933 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.933 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.933 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.933 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:06:37.933 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:06:37.933 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.933 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:37.933 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:37.933 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:37.933 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.933 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:37.933 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:06:37.933 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:37.933 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:37.933 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:37.933 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:06:37.933 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:37.933 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:37.933 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:37.933 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:06:37.933 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:06:37.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.922+0000 7fd114d4c640 1 -- 10.20.193.48:0/735631376 >> v2:10.20.193.111:6812/977811348 conn(0x7fd0dc03f7b0 msgr2=0x7fd0dc05fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.922+0000 7fd114d4c640 1 --2- 10.20.193.48:0/735631376 >> v2:10.20.193.111:6812/977811348 conn(0x7fd0dc03f7b0 0x7fd0dc05fc60 secure :-1 s=READY pgs=85 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd10002ff30 tx=0x7fd100007f90 comp rx=0 tx=0).stop 2026-02-12T18:06:37.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.922+0000 7fd114d4c640 10 monclient: shutdown 2026-02-12T18:06:37.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.922+0000 7fd114d4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:37.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.922+0000 7fd114d4c640 1 -- 10.20.193.48:0/735631376 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd11005de60 msgr2=0x7fd110109760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:37.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.922+0000 7fd10ed76640 1 -- 10.20.193.48:0/735631376 reap_dead start 2026-02-12T18:06:37.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.922+0000 7fd114d4c640 1 --2- 10.20.193.48:0/735631376 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd11005de60 0x7fd110109760 secure :-1 s=READY pgs=71 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0f80093f0 tx=0x7fd0f800ed30 comp rx=0 tx=0).stop 2026-02-12T18:06:37.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.922+0000 7fd114d4c640 1 -- 10.20.193.48:0/735631376 shutdown_connections 2026-02-12T18:06:37.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.922+0000 7fd114d4c640 1 --2- 10.20.193.48:0/735631376 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd11005de60 0x7fd110109760 unknown :-1 s=CLOSED pgs=71 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:37.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.922+0000 7fd114d4c640 1 -- 10.20.193.48:0/735631376 >> 10.20.193.48:0/735631376 conn(0x7fd1100546a0 msgr2=0x7fd11013c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:37.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.922+0000 7fd114d4c640 1 -- 10.20.193.48:0/735631376 shutdown_connections 2026-02-12T18:06:37.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.922+0000 7fd114d4c640 1 -- 10.20.193.48:0/735631376 wait complete. 2026-02-12T18:06:37.934 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2026-02-12T18:06:37.934 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon h 2026-02-12T18:06:37.934 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2026-02-12T18:06:38.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.999+0000 7f951b5b9640 10 monclient: get_monmap_and_config 2026-02-12T18:06:38.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.999+0000 7f951b5b9640 10 monclient: build_initial_monmap 2026-02-12T18:06:38.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:37.999+0000 7f951b5b9640 10 monclient: monmap: 2026-02-12T18:06:38.003 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:38.003 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:38.003 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:06:38.000834+0000 2026-02-12T18:06:38.003 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:06:38.000834+0000 2026-02-12T18:06:38.003 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:38.003 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:38.003 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:06:38.003 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:06:38.003 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:38.003 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:38.003 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:38.004 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:38.004 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:38.004 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:38.004 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:38.004 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:06:38.004 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:06:38.004 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:38.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.000+0000 7f951b5b9640 1 Processor -- start 2026-02-12T18:06:38.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.000+0000 7f951b5b9640 1 -- start start 2026-02-12T18:06:38.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.000+0000 7f951b5b9640 10 monclient: init 2026-02-12T18:06:38.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.000+0000 7f951b5b9640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:38.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.000+0000 7f951b5b9640 10 monclient: _add_conns ranks=[10,0,1,6,3,4,7,8,5,9,2] 2026-02-12T18:06:38.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.000+0000 7f951b5b9640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f951405d550 0x7f951405d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:38.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.000+0000 7f951b5b9640 10 monclient(hunting): picked mon.noname-f con 0x7f951405d550 addr v2:10.20.193.111:3300/0 2026-02-12T18:06:38.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.000+0000 7f951b5b9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f951405de60 addr v1:10.20.193.48:6789/0 2026-02-12T18:06:38.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.000+0000 7f951b5b9640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f951413ef60 addr v1:10.20.193.111:6789/0 2026-02-12T18:06:38.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.000+0000 7f951b5b9640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f951404dc20 con 0x7f951405de60 2026-02-12T18:06:38.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.000+0000 7f951b5b9640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f951408d390 con 0x7f951413ef60 2026-02-12T18:06:38.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.000+0000 7f951b5b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:38.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.000+0000 7f951b5b9640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f951408d5a0 con 0x7f951405d550 2026-02-12T18:06:38.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.000+0000 7f951b5b9640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:38.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.000+0000 7f951b5b9640 10 monclient(hunting): authenticate will time out at 636.726578s 2026-02-12T18:06:38.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.000+0000 7f9518b2d640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f951405de60 0x7f9514141fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:50726/0 (socket says 10.20.193.48:50726) 2026-02-12T18:06:38.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.000+0000 7f9518b2d640 1 -- 10.20.193.48:0/924218651 learned_addr learned my addr 10.20.193.48:0/924218651 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:06:38.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.000+0000 7f951932e640 1 --2- 10.20.193.48:0/924218651 >> v2:10.20.193.111:3300/0 conn(0x7f951405d550 0x7f951405d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:38.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.000+0000 7f951932e640 10 monclient(hunting): get_auth_request con 0x7f951405d550 auth_method 0 2026-02-12T18:06:38.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.000+0000 7f951932e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:38.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.000+0000 7f951932e640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:38.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.000+0000 7f951932e640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:38.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.001+0000 7f951932e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:38.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.001+0000 7f951932e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:38.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.001+0000 7f951932e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:38.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.001+0000 7f951932e640 10 monclient(hunting): handle_auth_done global_id 4546 payload 274 2026-02-12T18:06:38.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.001+0000 7f951932e640 1 -- 10.20.193.48:0/924218651 >> v1:10.20.193.111:6789/0 conn(0x7f951413ef60 legacy=0x7f95141426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:38.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.001+0000 7f951932e640 1 -- 10.20.193.48:0/924218651 >> v1:10.20.193.48:6789/0 conn(0x7f951405de60 legacy=0x7f9514141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:06:38.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.001+0000 7f951932e640 10 monclient: _finish_hunting 0 2026-02-12T18:06:38.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.001+0000 7f951932e640 1 monclient: found mon.noname-f 2026-02-12T18:06:38.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.001+0000 7f951932e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:38.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.001+0000 7f951932e640 10 monclient: _send_mon_message to mon.noname-f at v2:10.20.193.111:3300/0 2026-02-12T18:06:38.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.001+0000 7f951932e640 1 -- 10.20.193.48:0/924218651 --> v2:10.20.193.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95140580e0 con 0x7f951405d550 2026-02-12T18:06:38.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.003+0000 7f951932e640 1 -- 10.20.193.48:0/924218651 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f951405d550 msgr2=0x7f951405d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:38.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.003+0000 7f951932e640 1 --2- 10.20.193.48:0/924218651 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f951405d550 0x7f951405d920 secure :-1 s=READY pgs=73 gs=3 cs=0 l=1 c_cookie=9602213313352001551 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9504004740 tx=0x7f950402ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8541ea223fdf680f server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:38.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f9503fff640 1 -- 10.20.193.48:0/924218651 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9504035340 con 0x7f951405d550 2026-02-12T18:06:38.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f9503fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:38.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f9503fff640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2026-02-12T18:06:38.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f9503fff640 10 monclient: dump: 2026-02-12T18:06:38.008 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:38.008 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:38.008 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:38.008 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:38.008 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:38.008 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:38.008 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:38.008 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:38.008 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:38.008 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:38.008 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:38.008 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:38.008 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:38.008 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:38.009 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:38.009 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:38.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f9503fff640 10 monclient: _finish_auth 0 2026-02-12T18:06:38.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f9503fff640 10 monclient: _check_auth_tickets 2026-02-12T18:06:38.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f9503fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:38.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f951b5b9640 5 monclient: authenticate success, global_id 4546 2026-02-12T18:06:38.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f951b5b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:06:38.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f9503fff640 1 -- 10.20.193.48:0/924218651 <== mon.1 v2:10.20.193.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f950402fa70 con 0x7f951405d550 2026-02-12T18:06:38.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f9503fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:38.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f9503fff640 1 -- 10.20.193.48:0/924218651 <== mon.1 v2:10.20.193.111:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f950402fbe0 con 0x7f951405d550 2026-02-12T18:06:38.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f9503fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:38.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f9503fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:06:38.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f9503fff640 10 monclient: dump: 2026-02-12T18:06:38.009 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:38.009 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:38.009 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:38.009 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:38.009 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:38.009 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:38.009 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:38.009 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:38.009 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:38.009 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:38.009 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:38.009 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:38.010 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:38.010 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:38.010 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:38.010 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:38.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f951b5b9640 10 monclient: get_monmap_and_config success 2026-02-12T18:06:38.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f951b5b9640 4 set_mon_vals no callback set 2026-02-12T18:06:38.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f951b5b9640 10 monclient: shutdown 2026-02-12T18:06:38.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f951b5b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:38.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f951b5b9640 1 -- 10.20.193.48:0/924218651 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f951405d550 msgr2=0x7f951405d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:38.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f951b5b9640 1 --2- 10.20.193.48:0/924218651 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f951405d550 0x7f951405d920 secure :-1 s=READY pgs=73 gs=3 cs=0 l=1 c_cookie=9602213313352001551 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9504004740 tx=0x7f950402ed10 comp rx=0 tx=0).stop 2026-02-12T18:06:38.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f951b5b9640 1 -- 10.20.193.48:0/924218651 shutdown_connections 2026-02-12T18:06:38.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f951b5b9640 1 --2- 10.20.193.48:0/924218651 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f951405d550 0x7f951405d920 unknown :-1 s=CLOSED pgs=73 gs=3 cs=0 l=1 c_cookie=9602213313352001551 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:38.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f951b5b9640 1 -- 10.20.193.48:0/924218651 >> 10.20.193.48:0/924218651 conn(0x7f95140546a0 msgr2=0x7f9514054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:38.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f951b5b9640 1 -- 10.20.193.48:0/924218651 shutdown_connections 2026-02-12T18:06:38.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f951b5b9640 1 -- 10.20.193.48:0/924218651 wait complete. 2026-02-12T18:06:38.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f951b5b9640 10 monclient: build_initial_monmap 2026-02-12T18:06:38.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.004+0000 7f951b5b9640 10 monclient: monmap: 2026-02-12T18:06:38.010 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:06:38.010 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:06:38.010 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:06:38.010 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:06:38.010 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:06:38.010 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:38.010 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:06:38.011 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:06:38.011 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:06:38.011 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:06:38.011 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:06:38.011 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:06:38.011 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:06:38.011 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:06:38.011 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:06:38.011 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:38.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951b5b9640 1 Processor -- start 2026-02-12T18:06:38.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951b5b9640 1 -- start start 2026-02-12T18:06:38.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951b5b9640 10 monclient: init 2026-02-12T18:06:38.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951b5b9640 10 monclient: _reopen_session rank -1 2026-02-12T18:06:38.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951b5b9640 10 monclient: _add_conns ranks=[2,5,0,3,8,6,7,4,1] 2026-02-12T18:06:38.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951b5b9640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f951405d550 0x7f9514116830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:38.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951b5b9640 10 monclient(hunting): picked mon.noname-b con 0x7f951405d550 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:06:38.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951b5b9640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f951405de60 0x7f9514116d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:38.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951b5b9640 10 monclient(hunting): picked mon.noname-h con 0x7f951405de60 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:06:38.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951b5b9640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f951413ef60 0x7f95141172b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:38.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951b5b9640 10 monclient(hunting): picked mon.noname-a con 0x7f951413ef60 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:06:38.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951b5b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:38.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951b5b9640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f95141289c0 con 0x7f951413ef60 2026-02-12T18:06:38.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951b5b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:38.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951b5b9640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f951412ad20 con 0x7f951405d550 2026-02-12T18:06:38.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951b5b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:38.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951b5b9640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f9514141fe0 con 0x7f951405de60 2026-02-12T18:06:38.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951b5b9640 10 monclient(hunting): _renew_subs 2026-02-12T18:06:38.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951b5b9640 10 monclient(hunting): authenticate will time out at 636.731359s 2026-02-12T18:06:38.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951932e640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f951405d550 0x7f9514116830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:38.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f9519b2f640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f951413ef60 0x7f95141172b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:38.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951932e640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f951405d550 0x7f9514116830 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:34278/0 (socket says 10.20.193.48:34278) 2026-02-12T18:06:38.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951932e640 1 -- 10.20.193.48:0/2172095426 learned_addr learned my addr 10.20.193.48:0/2172095426 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:06:38.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951932e640 10 monclient(hunting): get_auth_request con 0x7f951405d550 auth_method 0 2026-02-12T18:06:38.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951932e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:38.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951932e640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:38.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951932e640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:38.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f9519b2f640 10 monclient(hunting): get_auth_request con 0x7f951413ef60 auth_method 0 2026-02-12T18:06:38.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f9519b2f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:38.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f9519b2f640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:38.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f9519b2f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:38.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f9518b2d640 1 --2- 10.20.193.48:0/2172095426 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f951405de60 0x7f9514116d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:38.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f9519b2f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:38.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f9519b2f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:38.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f9519b2f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:38.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951932e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:38.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951932e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:38.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951932e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:38.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f9518b2d640 10 monclient(hunting): get_auth_request con 0x7f951405de60 auth_method 0 2026-02-12T18:06:38.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f9518b2d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:38.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f9518b2d640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:38.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f9518b2d640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:38.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f9519b2f640 10 monclient(hunting): handle_auth_done global_id 4590 payload 824 2026-02-12T18:06:38.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f9519b2f640 1 -- 10.20.193.48:0/2172095426 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f951405de60 msgr2=0x7f9514116d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:38.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f9519b2f640 1 --2- 10.20.193.48:0/2172095426 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f951405de60 0x7f9514116d70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:38.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f9519b2f640 1 -- 10.20.193.48:0/2172095426 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f951405d550 msgr2=0x7f9514116830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:38.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f9519b2f640 1 --2- 10.20.193.48:0/2172095426 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f951405d550 0x7f9514116830 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:38.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f9519b2f640 10 monclient: _finish_hunting 0 2026-02-12T18:06:38.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f9519b2f640 1 monclient: found mon.noname-a 2026-02-12T18:06:38.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f9519b2f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:06:38.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f9519b2f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:06:38.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f9519b2f640 1 -- 10.20.193.48:0/2172095426 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9504009420 con 0x7f951413ef60 2026-02-12T18:06:38.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.005+0000 7f951932e640 1 --2- 10.20.193.48:0/2172095426 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f951405d550 0x7f9514116830 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:06:38.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.007+0000 7f9519b2f640 1 -- 10.20.193.48:0/2172095426 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f951413ef60 msgr2=0x7f95141172b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:38.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.007+0000 7f9519b2f640 1 --2- 10.20.193.48:0/2172095426 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f951413ef60 0x7f95141172b0 secure :-1 s=READY pgs=124 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f951000d430 tx=0x7f951000d900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:38.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f9501ffb640 1 -- 10.20.193.48:0/2172095426 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9510007e30 con 0x7f951413ef60 2026-02-12T18:06:38.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f9501ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:38.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f9501ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:06:38.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f9501ffb640 10 monclient: dump: 2026-02-12T18:06:38.015 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:38.016 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:38.016 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:38.016 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:38.016 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:38.016 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:38.016 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:38.016 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:38.016 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:38.016 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:38.016 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:38.016 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:38.016 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:38.016 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:38.016 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:38.016 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:38.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f9501ffb640 10 monclient: _finish_auth 0 2026-02-12T18:06:38.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f9501ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:06:38.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f9501ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:06:38.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f9501ffb640 1 -- 10.20.193.48:0/2172095426 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9510013840 con 0x7f951413ef60 2026-02-12T18:06:38.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f951b5b9640 5 monclient: authenticate success, global_id 4590 2026-02-12T18:06:38.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f951b5b9640 10 monclient: _renew_subs 2026-02-12T18:06:38.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f951b5b9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:38.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f951b5b9640 1 -- 10.20.193.48:0/2172095426 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f951405cda0 con 0x7f951413ef60 2026-02-12T18:06:38.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f9501ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:06:38.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f95037fe640 4 set_mon_vals no callback set 2026-02-12T18:06:38.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f951b5b9640 10 monclient: _renew_subs 2026-02-12T18:06:38.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f951b5b9640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:06:38.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f951b5b9640 1 -- 10.20.193.48:0/2172095426 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f951412aa40 con 0x7f951413ef60 2026-02-12T18:06:38.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f9501ffb640 1 -- 10.20.193.48:0/2172095426 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f95100139b0 con 0x7f951413ef60 2026-02-12T18:06:38.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f9501ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:38.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f9501ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:06:38.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f9501ffb640 10 monclient: dump: 2026-02-12T18:06:38.017 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:38.017 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:38.017 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:38.017 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:38.017 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:38.017 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:38.017 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:38.017 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:38.017 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:38.017 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:38.017 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:38.017 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:38.017 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:38.017 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:38.017 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:38.017 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:38.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f951b5b9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:38.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f951b5b9640 1 --2- 10.20.193.48:0/2172095426 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9514091010 0x7f9514127050 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:38.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f951b5b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:38.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f951b5b9640 1 -- 10.20.193.48:0/2172095426 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f951405f140 con 0x7f9514091010 2026-02-12T18:06:38.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f951932e640 1 --2- 10.20.193.48:0/2172095426 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9514091010 0x7f9514127050 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:38.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f951932e640 10 monclient: get_auth_request con 0x7f9514091010 auth_method 0 2026-02-12T18:06:38.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f951932e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:38.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f951932e640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:38.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f951932e640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:38.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.008+0000 7f9501ffb640 1 -- 10.20.193.48:0/2172095426 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f951001a070 con 0x7f951413ef60 2026-02-12T18:06:38.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.009+0000 7f951932e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:38.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.009+0000 7f951932e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:38.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.009+0000 7f951932e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:38.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.009+0000 7f9501ffb640 1 --2- 10.20.193.48:0/2172095426 >> v2:10.20.193.111:6812/977811348 conn(0x7f94e403f800 0x7f94e405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:38.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.009+0000 7f9501ffb640 1 -- 10.20.193.48:0/2172095426 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3897+0+0 (secure 0 0 0) 0x7f9510053bd0 con 0x7f951413ef60 2026-02-12T18:06:38.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.009+0000 7f951932e640 10 monclient(hunting): handle_auth_done global_id 4550 payload 824 2026-02-12T18:06:38.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.009+0000 7f951932e640 1 -- 10.20.193.48:0/2172095426 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9514142dc0 con 0x7f9514091010 2026-02-12T18:06:38.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.009+0000 7f9518b2d640 1 --2- 10.20.193.48:0/2172095426 >> v2:10.20.193.111:6812/977811348 conn(0x7f94e403f800 0x7f94e405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:38.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.009+0000 7f9518b2d640 10 monclient: get_auth_request con 0x7f94e403f800 auth_method 0 2026-02-12T18:06:38.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.011+0000 7f951932e640 1 -- 10.20.193.48:0/2172095426 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9514091010 msgr2=0x7f9514127050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:38.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.011+0000 7f951932e640 1 --2- 10.20.193.48:0/2172095426 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9514091010 0x7f9514127050 secure :-1 s=READY pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9504009750 tx=0x7f95040047e0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:38.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.011+0000 7f9518b2d640 1 --2- 10.20.193.48:0/2172095426 >> v2:10.20.193.111:6812/977811348 conn(0x7f94e403f800 0x7f94e405fcb0 secure :-1 s=READY pgs=86 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9514129030 tx=0x7f9508009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:38.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.013+0000 7f9501ffb640 1 -- 10.20.193.48:0/2172095426 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9504041410 con 0x7f9514091010 2026-02-12T18:06:38.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.013+0000 7f9501ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:38.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.013+0000 7f9501ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:06:38.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.013+0000 7f9501ffb640 10 monclient: dump: 2026-02-12T18:06:38.019 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:38.019 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:38.019 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:38.019 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:38.019 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:38.019 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:38.019 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:38.019 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:38.019 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:38.019 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:38.019 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:38.019 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:38.019 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:38.019 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:38.019 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:38.019 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:38.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.014+0000 7f9501ffb640 1 -- 10.20.193.48:0/2172095426 <== mon.5 v2:10.20.193.111:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f9504035a10 con 0x7f9514091010 2026-02-12T18:06:38.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.014+0000 7f9501ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:06:38.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.014+0000 7f9501ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:06:38.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.014+0000 7f9501ffb640 1 -- 10.20.193.48:0/2172095426 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9514091010 msgr2=0x7f9514127050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:38.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.014+0000 7f9501ffb640 1 --2- 10.20.193.48:0/2172095426 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9514091010 0x7f9514127050 secure :-1 s=READY pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9504009750 tx=0x7f95040047e0 comp rx=0 tx=0).stop 2026-02-12T18:06:38.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.014+0000 7f9501ffb640 1 -- 10.20.193.48:0/2172095426 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9514091010 msgr2=0x7f9514127050 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:38.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.014+0000 7f9501ffb640 1 --2- 10.20.193.48:0/2172095426 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9514091010 0x7f9514127050 secure :-1 s=CLOSED pgs=58 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9504009750 tx=0x7f95040047e0 comp rx=0 tx=0).stop 2026-02-12T18:06:38.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.017+0000 7f951b5b9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:06:38.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.017+0000 7f951b5b9640 1 --2- 10.20.193.48:0/2172095426 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9514127590 0x7f9514127990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:06:38.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.017+0000 7f951b5b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:06:38.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.017+0000 7f951b5b9640 1 -- 10.20.193.48:0/2172095426 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f951405fd90 con 0x7f9514127590 2026-02-12T18:06:38.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.017+0000 7f951932e640 1 --2- 10.20.193.48:0/2172095426 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9514127590 0x7f9514127990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:06:38.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.017+0000 7f951932e640 10 monclient: get_auth_request con 0x7f9514127590 auth_method 0 2026-02-12T18:06:38.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.017+0000 7f951932e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:06:38.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.017+0000 7f951932e640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:06:38.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.017+0000 7f951932e640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:06:38.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.017+0000 7f951932e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:06:38.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.017+0000 7f951932e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:06:38.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.017+0000 7f951932e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:06:38.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.017+0000 7f951932e640 10 monclient(hunting): handle_auth_done global_id 4559 payload 824 2026-02-12T18:06:38.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.018+0000 7f951932e640 1 -- 10.20.193.48:0/2172095426 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9514057e00 con 0x7f9514127590 2026-02-12T18:06:38.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.020+0000 7f951932e640 1 -- 10.20.193.48:0/2172095426 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9514127590 msgr2=0x7f9514127990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:06:38.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.020+0000 7f951932e640 1 --2- 10.20.193.48:0/2172095426 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9514127590 0x7f9514127990 secure :-1 s=READY pgs=59 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9504008040 tx=0x7f9504004770 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:06:38.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.020+0000 7f9501ffb640 1 -- 10.20.193.48:0/2172095426 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9504041c40 con 0x7f9514127590 2026-02-12T18:06:38.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.020+0000 7f9501ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:06:38.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.020+0000 7f9501ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:06:38.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.020+0000 7f9501ffb640 10 monclient: dump: 2026-02-12T18:06:38.022 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:06:38.022 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:06:38.022 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:38.022 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:06:38.022 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:06:38.022 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:06:38.022 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:06:38.022 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:06:38.022 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:06:38.022 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:06:38.022 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:06:38.022 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:06:38.022 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:06:38.022 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:06:38.022 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:06:38.022 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:06:38.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.020+0000 7f9501ffb640 1 -- 10.20.193.48:0/2172095426 <== mon.5 v2:10.20.193.111:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9992 (secure 0 0 0) 0x7f9504051070 con 0x7f9514127590 2026-02-12T18:06:38.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.020+0000 7f9501ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:06:38.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.020+0000 7f9501ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:06:38.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.020+0000 7f9501ffb640 1 -- 10.20.193.48:0/2172095426 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9514127590 msgr2=0x7f9514127990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:38.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.020+0000 7f9501ffb640 1 --2- 10.20.193.48:0/2172095426 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9514127590 0x7f9514127990 secure :-1 s=READY pgs=59 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9504008040 tx=0x7f9504004770 comp rx=0 tx=0).stop 2026-02-12T18:06:38.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.020+0000 7f9501ffb640 1 -- 10.20.193.48:0/2172095426 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9514127590 msgr2=0x7f9514127990 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:06:38.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.020+0000 7f9501ffb640 1 --2- 10.20.193.48:0/2172095426 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9514127590 0x7f9514127990 secure :-1 s=CLOSED pgs=59 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9504008040 tx=0x7f9504004770 comp rx=0 tx=0).stop 2026-02-12T18:06:38.023 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:06:38.023 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:06:38.023 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:06:38.023 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:06:38.023 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 18, 2026-02-12T18:06:38.023 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 52814, 2026-02-12T18:06:38.023 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:06:38.023 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:06:38.023 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:06:38.023 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:06:38.023 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:06:38.023 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:06:38.023 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:06:38.023 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:06:38.023 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:38.024 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:06:38.024 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:38.024 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:06:38.024 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:06:38.024 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:38.024 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:38.024 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:38.024 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:38.024 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:38.024 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:38.024 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:38.024 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:38.024 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:38.024 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:38.024 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:38.024 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:38.024 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:38.024 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:38.024 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:06:38.024 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:06:38.024 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:38.024 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:38.024 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:38.025 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:38.025 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:38.025 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:38.025 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:38.025 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:38.025 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:38.025 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:38.025 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:38.025 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:38.025 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:38.025 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:38.025 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.025 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:06:38.025 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:06:38.025 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:06:38.025 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:06:38.025 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:06:38.025 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:06:38.025 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:38.025 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:06:38.025 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:06:38.025 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:06:38.025 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:06:38.026 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:06:38.026 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:06:38.026 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:06:38.026 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:06:38.026 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:06:38.026 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:06:38.026 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:06:38.026 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:06:38.026 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:06:38.026 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:06:38.026 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:06:38.026 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:06:38.026 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:06:38.026 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:06:38.026 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:06:38.026 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:06:38.026 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:06:38.026 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:06:38.026 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:06:38.026 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:38.026 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:06:38.026 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.026 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:06:38.026 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.026 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:06:38.027 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:06:38.027 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:38.027 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:38.027 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.027 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:38.027 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:06:38.027 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:38.027 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.027 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.027 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:38.027 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:06:38.027 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:38.027 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:38.027 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:38.027 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.027 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:06:38.027 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:06:38.027 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:38.027 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:38.027 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:06:38.027 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:38.027 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.027 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.027 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:06:38.028 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:06:38.028 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:38.028 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:38.028 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.028 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:38.028 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:06:38.028 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:38.028 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.028 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.028 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:38.028 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:06:38.028 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:38.028 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:38.028 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:38.028 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.028 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:06:38.028 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:06:38.028 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:38.028 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:38.028 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:06:38.028 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:38.028 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.028 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.028 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:06:38.029 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:06:38.029 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:38.029 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:38.029 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.029 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:38.029 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:06:38.029 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:38.029 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.029 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.029 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:38.029 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:06:38.029 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:38.029 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:38.029 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:38.029 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.029 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:06:38.029 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:06:38.029 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:38.029 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:38.029 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:06:38.029 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:38.029 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.029 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.029 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:06:38.030 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:06:38.030 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:38.030 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:38.030 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.030 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:38.030 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:06:38.030 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:38.030 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.030 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.030 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:38.030 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:06:38.030 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:38.030 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:38.030 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:38.030 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.030 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:06:38.030 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:06:38.030 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:38.030 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:38.030 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:06:38.030 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:38.030 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.030 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.030 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:06:38.031 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:06:38.031 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:38.031 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:38.031 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.031 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:38.031 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:06:38.031 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:38.031 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.031 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.031 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:38.031 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:06:38.031 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:38.031 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:38.031 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:38.031 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.031 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:06:38.031 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:06:38.031 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:38.031 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:38.031 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:38.031 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:38.031 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.032 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.032 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:06:38.032 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:06:38.032 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:38.032 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:38.032 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.032 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:38.032 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:06:38.032 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:38.032 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.032 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.032 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:38.032 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:06:38.032 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:38.032 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:38.032 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:38.032 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.032 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:06:38.032 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:06:38.032 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:38.032 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:38.032 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:06:38.032 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:38.032 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.032 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.033 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:06:38.033 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:06:38.033 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:38.033 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:38.033 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.033 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:38.033 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:06:38.033 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:38.033 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.033 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.033 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:38.033 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:06:38.033 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:38.033 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:38.033 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:38.033 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.033 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:06:38.033 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:06:38.033 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:38.033 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:38.033 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:06:38.033 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:38.033 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.033 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.033 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:06:38.033 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:06:38.034 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:38.034 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:38.034 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.034 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:38.034 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:06:38.034 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:38.034 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.034 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.034 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:38.034 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:06:38.034 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:38.034 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:38.034 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:38.034 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.034 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:06:38.034 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:06:38.034 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:38.034 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:38.034 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:06:38.034 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:38.034 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.034 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.034 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:06:38.034 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:06:38.034 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:06:38.035 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:06:38.035 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.035 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:06:38.035 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:06:38.035 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:38.035 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.035 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.035 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:06:38.035 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:06:38.035 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:06:38.035 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:38.035 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:38.035 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.035 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:06:38.035 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:06:38.035 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:06:38.035 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:06:38.035 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:06:38.035 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:06:38.035 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:38.035 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:38.035 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.035 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:06:38.035 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:06:38.035 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.035 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:38.036 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:38.036 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:06:38.036 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:38.036 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:06:38.036 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:06:38.036 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:06:38.036 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:06:38.036 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:06:38.036 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:06:38.036 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:06:38.036 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:06:38.036 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:06:38.036 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:06:38.036 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:06:38.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.020+0000 7f951b5b9640 1 -- 10.20.193.48:0/2172095426 >> v2:10.20.193.111:6812/977811348 conn(0x7f94e403f800 msgr2=0x7f94e405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:38.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.020+0000 7f951b5b9640 1 --2- 10.20.193.48:0/2172095426 >> v2:10.20.193.111:6812/977811348 conn(0x7f94e403f800 0x7f94e405fcb0 secure :-1 s=READY pgs=86 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9514129030 tx=0x7f9508009040 comp rx=0 tx=0).stop 2026-02-12T18:06:38.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.020+0000 7f951b5b9640 10 monclient: shutdown 2026-02-12T18:06:38.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.020+0000 7f951b5b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:06:38.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.020+0000 7f951b5b9640 1 -- 10.20.193.48:0/2172095426 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f951413ef60 msgr2=0x7f95141172b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:06:38.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.020+0000 7f9519b2f640 1 -- 10.20.193.48:0/2172095426 reap_dead start 2026-02-12T18:06:38.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.020+0000 7f951b5b9640 1 --2- 10.20.193.48:0/2172095426 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f951413ef60 0x7f95141172b0 secure :-1 s=READY pgs=124 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f951000d430 tx=0x7f951000d900 comp rx=0 tx=0).stop 2026-02-12T18:06:38.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.021+0000 7f951b5b9640 1 -- 10.20.193.48:0/2172095426 shutdown_connections 2026-02-12T18:06:38.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.021+0000 7f951b5b9640 1 --2- 10.20.193.48:0/2172095426 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f951413ef60 0x7f95141172b0 unknown :-1 s=CLOSED pgs=124 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:06:38.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.021+0000 7f951b5b9640 1 -- 10.20.193.48:0/2172095426 >> 10.20.193.48:0/2172095426 conn(0x7f95140546a0 msgr2=0x7f951413e550 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:06:38.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.021+0000 7f951b5b9640 1 -- 10.20.193.48:0/2172095426 shutdown_connections 2026-02-12T18:06:38.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:06:38.021+0000 7f951b5b9640 1 -- 10.20.193.48:0/2172095426 wait complete. 2026-02-12T18:06:38.038 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2026-02-12T18:06:38.038 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-12T18:06:38.149 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[26688]: starting. 2026-02-12T18:06:38.150 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[26688]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-26686 2026-02-12T18:06:38.150 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[26688]: shutting down. 2026-02-12T18:06:40.213 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:06:40.213 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[26721]: starting. 2026-02-12T18:06:40.213 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[26721]: creating pool ceph_test_rados_delete_pools_parallel.trial111-26686 2026-02-12T18:06:40.213 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[26721]: created object 0... 2026-02-12T18:06:40.214 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[26721]: created object 25... 2026-02-12T18:06:40.214 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[26721]: created object 49... 2026-02-12T18:06:40.214 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[26721]: finishing. 2026-02-12T18:06:40.214 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[26721]: shutting down. 2026-02-12T18:06:40.423 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:06:40.423 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[26723]: starting. 2026-02-12T18:06:40.423 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[26723]: listing objects. 2026-02-12T18:06:40.423 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[26723]: listed object 0... 2026-02-12T18:06:40.423 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[26723]: listed object 25... 2026-02-12T18:06:40.423 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[26723]: saw 50 objects 2026-02-12T18:06:40.424 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[26723]: shutting down. 2026-02-12T18:06:41.158 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:06:41.158 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[26722]: starting. 2026-02-12T18:06:41.158 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[26722]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-26686 2026-02-12T18:06:41.158 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[26722]: shutting down. 2026-02-12T18:06:41.159 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:06:41.159 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:06:41.159 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:06:41.161 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:06:43.329 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[26800]: starting. 2026-02-12T18:06:43.329 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[26800]: creating pool ceph_test_rados_delete_pools_parallel.trial111-26799 2026-02-12T18:06:43.329 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[26800]: created object 0... 2026-02-12T18:06:43.329 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[26800]: created object 25... 2026-02-12T18:06:43.330 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[26800]: created object 49... 2026-02-12T18:06:43.330 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[26800]: finishing. 2026-02-12T18:06:43.330 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[26800]: shutting down. 2026-02-12T18:06:44.176 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[26801]: starting. 2026-02-12T18:06:44.176 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[26801]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-26799 2026-02-12T18:06:44.176 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[26801]: shutting down. 2026-02-12T18:06:46.462 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:06:46.462 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[26834]: starting. 2026-02-12T18:06:46.462 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[26834]: creating pool ceph_test_rados_delete_pools_parallel.trial111-26799 2026-02-12T18:06:46.463 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[26834]: created object 0... 2026-02-12T18:06:46.463 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[26834]: created object 25... 2026-02-12T18:06:46.463 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[26834]: created object 49... 2026-02-12T18:06:46.463 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[26834]: finishing. 2026-02-12T18:06:46.463 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[26834]: shutting down. 2026-02-12T18:06:46.495 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:06:46.495 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[26836]: starting. 2026-02-12T18:06:46.495 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[26836]: listing objects. 2026-02-12T18:06:46.495 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[26836]: listed object 0... 2026-02-12T18:06:46.495 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[26836]: listed object 25... 2026-02-12T18:06:46.495 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[26836]: saw 50 objects 2026-02-12T18:06:46.496 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[26836]: shutting down. 2026-02-12T18:06:47.402 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:06:47.402 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[26835]: starting. 2026-02-12T18:06:47.402 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[26835]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-26799 2026-02-12T18:06:47.402 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[26835]: shutting down. 2026-02-12T18:06:47.403 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:06:47.403 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:06:47.403 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:06:47.405 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:06:49.472 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[26910]: starting. 2026-02-12T18:06:49.472 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[26910]: creating pool ceph_test_rados_delete_pools_parallel.trial111-26909 2026-02-12T18:06:49.472 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[26910]: created object 0... 2026-02-12T18:06:49.472 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[26910]: created object 25... 2026-02-12T18:06:49.472 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[26910]: created object 49... 2026-02-12T18:06:49.473 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[26910]: finishing. 2026-02-12T18:06:49.473 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[26910]: shutting down. 2026-02-12T18:06:50.407 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[26911]: starting. 2026-02-12T18:06:50.407 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[26911]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-26909 2026-02-12T18:06:50.407 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[26911]: shutting down. 2026-02-12T18:06:52.814 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:06:52.814 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[26944]: starting. 2026-02-12T18:06:52.814 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[26944]: creating pool ceph_test_rados_delete_pools_parallel.trial111-26909 2026-02-12T18:06:52.814 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[26944]: created object 0... 2026-02-12T18:06:52.815 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[26944]: created object 25... 2026-02-12T18:06:52.815 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[26944]: created object 49... 2026-02-12T18:06:52.815 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[26944]: finishing. 2026-02-12T18:06:52.815 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[26944]: shutting down. 2026-02-12T18:06:52.847 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:06:52.847 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[26946]: starting. 2026-02-12T18:06:52.847 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[26946]: listing objects. 2026-02-12T18:06:52.847 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[26946]: listed object 0... 2026-02-12T18:06:52.847 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[26946]: listed object 25... 2026-02-12T18:06:52.847 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[26946]: saw 50 objects 2026-02-12T18:06:52.847 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[26946]: shutting down. 2026-02-12T18:06:53.752 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:06:53.752 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[26945]: starting. 2026-02-12T18:06:53.752 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[26945]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-26909 2026-02-12T18:06:53.752 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[26945]: shutting down. 2026-02-12T18:06:53.753 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:06:53.753 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:06:53.753 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:06:53.755 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:06:55.846 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27020]: starting. 2026-02-12T18:06:55.846 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27020]: creating pool ceph_test_rados_delete_pools_parallel.trial111-27019 2026-02-12T18:06:55.846 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27020]: created object 0... 2026-02-12T18:06:55.846 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27020]: created object 25... 2026-02-12T18:06:55.847 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27020]: created object 49... 2026-02-12T18:06:55.847 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27020]: finishing. 2026-02-12T18:06:55.847 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27020]: shutting down. 2026-02-12T18:06:56.779 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27021]: starting. 2026-02-12T18:06:56.779 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27021]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-27019 2026-02-12T18:06:56.780 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27021]: shutting down. 2026-02-12T18:06:58.853 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:06:58.853 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27054]: starting. 2026-02-12T18:06:58.853 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27054]: creating pool ceph_test_rados_delete_pools_parallel.trial111-27019 2026-02-12T18:06:58.853 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27054]: created object 0... 2026-02-12T18:06:58.854 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27054]: created object 25... 2026-02-12T18:06:58.854 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27054]: created object 49... 2026-02-12T18:06:58.854 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27054]: finishing. 2026-02-12T18:06:58.854 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27054]: shutting down. 2026-02-12T18:06:58.886 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:06:58.886 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27056]: starting. 2026-02-12T18:06:58.886 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27056]: listing objects. 2026-02-12T18:06:58.886 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27056]: listed object 0... 2026-02-12T18:06:58.886 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27056]: listed object 25... 2026-02-12T18:06:58.886 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27056]: saw 50 objects 2026-02-12T18:06:58.886 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27056]: shutting down. 2026-02-12T18:06:59.784 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:06:59.784 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27055]: starting. 2026-02-12T18:06:59.784 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27055]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-27019 2026-02-12T18:06:59.784 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27055]: shutting down. 2026-02-12T18:06:59.785 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:06:59.785 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:06:59.785 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:06:59.787 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:07:01.250 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27130]: starting. 2026-02-12T18:07:01.250 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27130]: creating pool ceph_test_rados_delete_pools_parallel.trial111-27129 2026-02-12T18:07:01.250 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27130]: created object 0... 2026-02-12T18:07:01.250 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27130]: created object 25... 2026-02-12T18:07:01.251 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27130]: created object 49... 2026-02-12T18:07:01.251 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27130]: finishing. 2026-02-12T18:07:01.251 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27130]: shutting down. 2026-02-12T18:07:02.261 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27131]: starting. 2026-02-12T18:07:02.262 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27131]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-27129 2026-02-12T18:07:02.262 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27131]: shutting down. 2026-02-12T18:07:04.326 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:04.326 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27164]: starting. 2026-02-12T18:07:04.326 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27164]: creating pool ceph_test_rados_delete_pools_parallel.trial111-27129 2026-02-12T18:07:04.326 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27164]: created object 0... 2026-02-12T18:07:04.326 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27164]: created object 25... 2026-02-12T18:07:04.327 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27164]: created object 49... 2026-02-12T18:07:04.327 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27164]: finishing. 2026-02-12T18:07:04.327 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27164]: shutting down. 2026-02-12T18:07:04.359 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:04.360 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27166]: starting. 2026-02-12T18:07:04.360 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27166]: listing objects. 2026-02-12T18:07:04.360 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27166]: listed object 0... 2026-02-12T18:07:04.360 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27166]: listed object 25... 2026-02-12T18:07:04.360 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27166]: saw 50 objects 2026-02-12T18:07:04.360 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27166]: shutting down. 2026-02-12T18:07:05.180 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:05.180 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27165]: starting. 2026-02-12T18:07:05.181 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27165]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-27129 2026-02-12T18:07:05.181 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27165]: shutting down. 2026-02-12T18:07:05.181 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:05.181 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:05.181 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:07:05.183 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:07:07.240 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27240]: starting. 2026-02-12T18:07:07.240 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27240]: creating pool ceph_test_rados_delete_pools_parallel.trial111-27239 2026-02-12T18:07:07.240 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27240]: created object 0... 2026-02-12T18:07:07.240 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27240]: created object 25... 2026-02-12T18:07:07.240 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27240]: created object 49... 2026-02-12T18:07:07.240 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27240]: finishing. 2026-02-12T18:07:07.240 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27240]: shutting down. 2026-02-12T18:07:08.774 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27241]: starting. 2026-02-12T18:07:08.775 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27241]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-27239 2026-02-12T18:07:08.775 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27241]: shutting down. 2026-02-12T18:07:11.024 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:11.024 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27274]: starting. 2026-02-12T18:07:11.025 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27274]: creating pool ceph_test_rados_delete_pools_parallel.trial111-27239 2026-02-12T18:07:11.025 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27274]: created object 0... 2026-02-12T18:07:11.025 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27274]: created object 25... 2026-02-12T18:07:11.025 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27274]: created object 49... 2026-02-12T18:07:11.025 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27274]: finishing. 2026-02-12T18:07:11.025 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27274]: shutting down. 2026-02-12T18:07:11.058 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:11.058 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27276]: starting. 2026-02-12T18:07:11.058 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27276]: listing objects. 2026-02-12T18:07:11.058 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27276]: listed object 0... 2026-02-12T18:07:11.058 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27276]: listed object 25... 2026-02-12T18:07:11.058 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27276]: saw 50 objects 2026-02-12T18:07:11.058 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27276]: shutting down. 2026-02-12T18:07:11.971 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:11.971 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27275]: starting. 2026-02-12T18:07:11.971 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27275]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-27239 2026-02-12T18:07:11.971 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27275]: shutting down. 2026-02-12T18:07:11.972 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:11.972 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:11.972 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:07:11.974 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:07:14.245 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27350]: starting. 2026-02-12T18:07:14.245 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27350]: creating pool ceph_test_rados_delete_pools_parallel.trial111-27349 2026-02-12T18:07:14.245 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27350]: created object 0... 2026-02-12T18:07:14.245 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27350]: created object 25... 2026-02-12T18:07:14.245 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27350]: created object 49... 2026-02-12T18:07:14.245 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27350]: finishing. 2026-02-12T18:07:14.245 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27350]: shutting down. 2026-02-12T18:07:14.983 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27351]: starting. 2026-02-12T18:07:14.983 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27351]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-27349 2026-02-12T18:07:14.983 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27351]: shutting down. 2026-02-12T18:07:16.255 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:16.255 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27384]: starting. 2026-02-12T18:07:16.255 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27384]: creating pool ceph_test_rados_delete_pools_parallel.trial111-27349 2026-02-12T18:07:16.255 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27384]: created object 0... 2026-02-12T18:07:16.255 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27384]: created object 25... 2026-02-12T18:07:16.255 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27384]: created object 49... 2026-02-12T18:07:16.255 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27384]: finishing. 2026-02-12T18:07:16.255 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27384]: shutting down. 2026-02-12T18:07:16.490 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:16.490 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27386]: starting. 2026-02-12T18:07:16.490 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27386]: listing objects. 2026-02-12T18:07:16.490 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27386]: listed object 0... 2026-02-12T18:07:16.490 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27386]: listed object 25... 2026-02-12T18:07:16.490 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27386]: saw 50 objects 2026-02-12T18:07:16.490 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27386]: shutting down. 2026-02-12T18:07:17.192 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:17.192 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27385]: starting. 2026-02-12T18:07:17.193 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27385]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-27349 2026-02-12T18:07:17.193 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27385]: shutting down. 2026-02-12T18:07:17.194 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:17.194 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:17.194 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:07:17.196 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:07:19.450 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27460]: starting. 2026-02-12T18:07:19.450 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27460]: creating pool ceph_test_rados_delete_pools_parallel.trial111-27459 2026-02-12T18:07:19.451 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27460]: created object 0... 2026-02-12T18:07:19.451 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27460]: created object 25... 2026-02-12T18:07:19.451 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27460]: created object 49... 2026-02-12T18:07:19.451 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27460]: finishing. 2026-02-12T18:07:19.451 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27460]: shutting down. 2026-02-12T18:07:20.397 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27461]: starting. 2026-02-12T18:07:20.398 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27461]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-27459 2026-02-12T18:07:20.398 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27461]: shutting down. 2026-02-12T18:07:22.478 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:22.478 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27494]: starting. 2026-02-12T18:07:22.478 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27494]: creating pool ceph_test_rados_delete_pools_parallel.trial111-27459 2026-02-12T18:07:22.478 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27494]: created object 0... 2026-02-12T18:07:22.478 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27494]: created object 25... 2026-02-12T18:07:22.478 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27494]: created object 49... 2026-02-12T18:07:22.478 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27494]: finishing. 2026-02-12T18:07:22.478 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27494]: shutting down. 2026-02-12T18:07:22.520 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:22.520 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27496]: starting. 2026-02-12T18:07:22.520 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27496]: listing objects. 2026-02-12T18:07:22.521 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27496]: listed object 0... 2026-02-12T18:07:22.521 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27496]: listed object 25... 2026-02-12T18:07:22.521 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27496]: saw 50 objects 2026-02-12T18:07:22.521 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27496]: shutting down. 2026-02-12T18:07:23.993 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:23.994 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27495]: starting. 2026-02-12T18:07:23.994 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27495]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-27459 2026-02-12T18:07:23.994 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27495]: shutting down. 2026-02-12T18:07:23.995 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:23.995 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:23.995 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:07:23.998 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:07:25.260 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27570]: starting. 2026-02-12T18:07:25.260 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27570]: creating pool ceph_test_rados_delete_pools_parallel.trial111-27569 2026-02-12T18:07:25.260 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27570]: created object 0... 2026-02-12T18:07:25.260 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27570]: created object 25... 2026-02-12T18:07:25.261 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27570]: created object 49... 2026-02-12T18:07:25.261 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27570]: finishing. 2026-02-12T18:07:25.261 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27570]: shutting down. 2026-02-12T18:07:26.183 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27571]: starting. 2026-02-12T18:07:26.183 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27571]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-27569 2026-02-12T18:07:26.183 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27571]: shutting down. 2026-02-12T18:07:28.246 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:28.246 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27604]: starting. 2026-02-12T18:07:28.246 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27604]: creating pool ceph_test_rados_delete_pools_parallel.trial111-27569 2026-02-12T18:07:28.246 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27604]: created object 0... 2026-02-12T18:07:28.246 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27604]: created object 25... 2026-02-12T18:07:28.247 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27604]: created object 49... 2026-02-12T18:07:28.247 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27604]: finishing. 2026-02-12T18:07:28.247 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27604]: shutting down. 2026-02-12T18:07:28.279 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:28.279 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27606]: starting. 2026-02-12T18:07:28.279 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27606]: listing objects. 2026-02-12T18:07:28.280 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27606]: listed object 0... 2026-02-12T18:07:28.280 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27606]: listed object 25... 2026-02-12T18:07:28.280 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27606]: saw 50 objects 2026-02-12T18:07:28.280 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27606]: shutting down. 2026-02-12T18:07:29.862 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:29.863 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27605]: starting. 2026-02-12T18:07:29.863 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27605]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-27569 2026-02-12T18:07:29.863 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27605]: shutting down. 2026-02-12T18:07:29.863 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:29.863 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:29.864 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:07:29.866 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:07:31.935 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27680]: starting. 2026-02-12T18:07:31.935 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27680]: creating pool ceph_test_rados_delete_pools_parallel.trial111-27679 2026-02-12T18:07:31.935 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27680]: created object 0... 2026-02-12T18:07:31.936 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27680]: created object 25... 2026-02-12T18:07:31.936 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27680]: created object 49... 2026-02-12T18:07:31.936 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27680]: finishing. 2026-02-12T18:07:31.936 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27680]: shutting down. 2026-02-12T18:07:32.873 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27681]: starting. 2026-02-12T18:07:32.874 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27681]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-27679 2026-02-12T18:07:32.874 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27681]: shutting down. 2026-02-12T18:07:35.835 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:35.836 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27714]: starting. 2026-02-12T18:07:35.836 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27714]: creating pool ceph_test_rados_delete_pools_parallel.trial111-27679 2026-02-12T18:07:35.836 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27714]: created object 0... 2026-02-12T18:07:35.836 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27714]: created object 25... 2026-02-12T18:07:35.836 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27714]: created object 49... 2026-02-12T18:07:35.836 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27714]: finishing. 2026-02-12T18:07:35.836 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27714]: shutting down. 2026-02-12T18:07:36.075 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:36.075 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27716]: starting. 2026-02-12T18:07:36.075 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27716]: listing objects. 2026-02-12T18:07:36.075 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27716]: listed object 0... 2026-02-12T18:07:36.075 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27716]: listed object 25... 2026-02-12T18:07:36.075 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27716]: saw 50 objects 2026-02-12T18:07:36.076 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27716]: shutting down. 2026-02-12T18:07:36.763 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:36.763 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27715]: starting. 2026-02-12T18:07:36.763 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27715]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-27679 2026-02-12T18:07:36.763 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27715]: shutting down. 2026-02-12T18:07:36.764 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:36.764 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:36.764 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:07:36.766 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:07:38.828 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27790]: starting. 2026-02-12T18:07:38.829 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27790]: creating pool ceph_test_rados_delete_pools_parallel.trial111-27789 2026-02-12T18:07:38.829 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27790]: created object 0... 2026-02-12T18:07:38.829 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27790]: created object 25... 2026-02-12T18:07:38.829 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27790]: created object 49... 2026-02-12T18:07:38.829 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27790]: finishing. 2026-02-12T18:07:38.829 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27790]: shutting down. 2026-02-12T18:07:39.978 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27791]: starting. 2026-02-12T18:07:39.978 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27791]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-27789 2026-02-12T18:07:39.978 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27791]: shutting down. 2026-02-12T18:07:41.250 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:41.250 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27824]: starting. 2026-02-12T18:07:41.250 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27824]: creating pool ceph_test_rados_delete_pools_parallel.trial111-27789 2026-02-12T18:07:41.250 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27824]: created object 0... 2026-02-12T18:07:41.250 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27824]: created object 25... 2026-02-12T18:07:41.251 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27824]: created object 49... 2026-02-12T18:07:41.251 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27824]: finishing. 2026-02-12T18:07:41.251 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27824]: shutting down. 2026-02-12T18:07:41.283 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:41.283 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27826]: starting. 2026-02-12T18:07:41.283 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27826]: listing objects. 2026-02-12T18:07:41.283 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27826]: listed object 0... 2026-02-12T18:07:41.283 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27826]: listed object 25... 2026-02-12T18:07:41.283 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27826]: saw 50 objects 2026-02-12T18:07:41.283 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27826]: shutting down. 2026-02-12T18:07:42.188 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:42.188 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27825]: starting. 2026-02-12T18:07:42.188 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27825]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-27789 2026-02-12T18:07:42.188 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27825]: shutting down. 2026-02-12T18:07:42.189 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:42.189 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:42.189 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:07:42.191 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:07:44.832 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27900]: starting. 2026-02-12T18:07:44.833 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27900]: creating pool ceph_test_rados_delete_pools_parallel.trial111-27899 2026-02-12T18:07:44.833 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27900]: created object 0... 2026-02-12T18:07:44.833 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27900]: created object 25... 2026-02-12T18:07:44.833 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27900]: created object 49... 2026-02-12T18:07:44.833 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27900]: finishing. 2026-02-12T18:07:44.833 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[27900]: shutting down. 2026-02-12T18:07:45.772 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27901]: starting. 2026-02-12T18:07:45.773 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27901]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-27899 2026-02-12T18:07:45.773 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[27901]: shutting down. 2026-02-12T18:07:47.849 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:47.850 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27934]: starting. 2026-02-12T18:07:47.850 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27934]: creating pool ceph_test_rados_delete_pools_parallel.trial111-27899 2026-02-12T18:07:47.850 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27934]: created object 0... 2026-02-12T18:07:47.850 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27934]: created object 25... 2026-02-12T18:07:47.850 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27934]: created object 49... 2026-02-12T18:07:47.850 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27934]: finishing. 2026-02-12T18:07:47.850 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[27934]: shutting down. 2026-02-12T18:07:48.083 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:48.083 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27936]: starting. 2026-02-12T18:07:48.084 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27936]: listing objects. 2026-02-12T18:07:48.084 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27936]: listed object 0... 2026-02-12T18:07:48.084 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27936]: listed object 25... 2026-02-12T18:07:48.084 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27936]: saw 50 objects 2026-02-12T18:07:48.084 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[27936]: shutting down. 2026-02-12T18:07:48.785 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:48.786 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27935]: starting. 2026-02-12T18:07:48.786 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27935]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-27899 2026-02-12T18:07:48.786 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[27935]: shutting down. 2026-02-12T18:07:48.787 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:48.787 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:48.787 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:07:48.789 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:07:50.253 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28010]: starting. 2026-02-12T18:07:50.253 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28010]: creating pool ceph_test_rados_delete_pools_parallel.trial111-28009 2026-02-12T18:07:50.253 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28010]: created object 0... 2026-02-12T18:07:50.253 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28010]: created object 25... 2026-02-12T18:07:50.254 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28010]: created object 49... 2026-02-12T18:07:50.254 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28010]: finishing. 2026-02-12T18:07:50.254 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28010]: shutting down. 2026-02-12T18:07:51.190 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28011]: starting. 2026-02-12T18:07:51.190 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28011]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-28009 2026-02-12T18:07:51.190 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28011]: shutting down. 2026-02-12T18:07:54.087 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:54.088 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28044]: starting. 2026-02-12T18:07:54.088 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28044]: creating pool ceph_test_rados_delete_pools_parallel.trial111-28009 2026-02-12T18:07:54.088 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28044]: created object 0... 2026-02-12T18:07:54.088 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28044]: created object 25... 2026-02-12T18:07:54.088 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28044]: created object 49... 2026-02-12T18:07:54.088 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28044]: finishing. 2026-02-12T18:07:54.088 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28044]: shutting down. 2026-02-12T18:07:54.124 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:54.124 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28046]: starting. 2026-02-12T18:07:54.124 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28046]: listing objects. 2026-02-12T18:07:54.124 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28046]: listed object 0... 2026-02-12T18:07:54.124 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28046]: listed object 25... 2026-02-12T18:07:54.125 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28046]: saw 50 objects 2026-02-12T18:07:54.125 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28046]: shutting down. 2026-02-12T18:07:55.035 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:55.035 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28045]: starting. 2026-02-12T18:07:55.035 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28045]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-28009 2026-02-12T18:07:55.035 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28045]: shutting down. 2026-02-12T18:07:55.036 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:55.036 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:07:55.036 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:07:55.038 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:07:57.099 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28120]: starting. 2026-02-12T18:07:57.099 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28120]: creating pool ceph_test_rados_delete_pools_parallel.trial111-28119 2026-02-12T18:07:57.100 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28120]: created object 0... 2026-02-12T18:07:57.100 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28120]: created object 25... 2026-02-12T18:07:57.100 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28120]: created object 49... 2026-02-12T18:07:57.100 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28120]: finishing. 2026-02-12T18:07:57.100 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28120]: shutting down. 2026-02-12T18:07:58.046 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28121]: starting. 2026-02-12T18:07:58.046 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28121]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-28119 2026-02-12T18:07:58.047 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28121]: shutting down. 2026-02-12T18:08:00.112 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:08:00.112 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28154]: starting. 2026-02-12T18:08:00.112 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28154]: creating pool ceph_test_rados_delete_pools_parallel.trial111-28119 2026-02-12T18:08:00.112 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28154]: created object 0... 2026-02-12T18:08:00.113 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28154]: created object 25... 2026-02-12T18:08:00.113 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28154]: created object 49... 2026-02-12T18:08:00.113 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28154]: finishing. 2026-02-12T18:08:00.113 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28154]: shutting down. 2026-02-12T18:08:00.145 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:08:00.145 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28156]: starting. 2026-02-12T18:08:00.145 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28156]: listing objects. 2026-02-12T18:08:00.145 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28156]: listed object 0... 2026-02-12T18:08:00.145 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28156]: listed object 25... 2026-02-12T18:08:00.145 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28156]: saw 50 objects 2026-02-12T18:08:00.145 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28156]: shutting down. 2026-02-12T18:08:00.186 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:08:00.186 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28155]: starting. 2026-02-12T18:08:00.186 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28155]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-28119 2026-02-12T18:08:00.186 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28155]: shutting down. 2026-02-12T18:08:00.187 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:08:00.187 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:08:00.187 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:08:00.189 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:08:02.252 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28230]: starting. 2026-02-12T18:08:02.252 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28230]: creating pool ceph_test_rados_delete_pools_parallel.trial111-28229 2026-02-12T18:08:02.252 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28230]: created object 0... 2026-02-12T18:08:02.252 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28230]: created object 25... 2026-02-12T18:08:02.252 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28230]: created object 49... 2026-02-12T18:08:02.252 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28230]: finishing. 2026-02-12T18:08:02.253 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28230]: shutting down. 2026-02-12T18:08:03.195 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28231]: starting. 2026-02-12T18:08:03.196 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28231]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-28229 2026-02-12T18:08:03.196 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28231]: shutting down. 2026-02-12T18:08:05.312 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:08:05.312 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28265]: starting. 2026-02-12T18:08:05.312 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28265]: creating pool ceph_test_rados_delete_pools_parallel.trial111-28229 2026-02-12T18:08:05.313 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28265]: created object 0... 2026-02-12T18:08:05.313 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28265]: created object 25... 2026-02-12T18:08:05.313 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28265]: created object 49... 2026-02-12T18:08:05.313 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28265]: finishing. 2026-02-12T18:08:05.313 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28265]: shutting down. 2026-02-12T18:08:05.345 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:08:05.345 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28267]: starting. 2026-02-12T18:08:05.345 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28267]: listing objects. 2026-02-12T18:08:05.345 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28267]: listed object 0... 2026-02-12T18:08:05.345 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28267]: listed object 25... 2026-02-12T18:08:05.345 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28267]: saw 50 objects 2026-02-12T18:08:05.346 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28267]: shutting down. 2026-02-12T18:08:06.252 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:08:06.252 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28266]: starting. 2026-02-12T18:08:06.252 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28266]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-28229 2026-02-12T18:08:06.252 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28266]: shutting down. 2026-02-12T18:08:06.253 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:08:06.253 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:08:06.253 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:08:06.256 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:08:08.039 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-12T18:08:08.039 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-12T18:08:08.039 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-12T18:08:08.039 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-12T18:08:08.057 INFO:tasks.ceph.mon.c:Started 2026-02-12T18:08:08.057 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.i 2026-02-12T18:08:08.057 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.i 2026-02-12T18:08:08.057 INFO:tasks.ceph.mon.i:Restarting daemon 2026-02-12T18:08:08.057 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i i 2026-02-12T18:08:08.059 INFO:tasks.ceph.mon.i:Started 2026-02-12T18:08:08.059 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.b 2026-02-12T18:08:08.059 INFO:tasks.mon_thrash:Sending STOP to mon b 2026-02-12T18:08:08.059 INFO:tasks.ceph.mon.b:Sent signal 19 2026-02-12T18:08:08.059 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.d 2026-02-12T18:08:08.059 INFO:tasks.mon_thrash:Sending STOP to mon d 2026-02-12T18:08:08.059 INFO:tasks.ceph.mon.d:Sent signal 19 2026-02-12T18:08:08.059 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-12T18:08:08.120 INFO:tasks.ceph.mon.i.trial111.stderr:2026-02-12T18:08:08.119+0000 7f5a8343bc00 -1 mon.i@-1(???).log v0 log_external_backlog rewinding external_log_to from 19 -> 0 (sync_force? mon rebuild?) 2026-02-12T18:08:23.060 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.b 2026-02-12T18:08:23.061 INFO:tasks.mon_thrash:Sending CONT to mon b 2026-02-12T18:08:23.061 INFO:tasks.ceph.mon.b:Sent signal 18 2026-02-12T18:08:23.061 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.d 2026-02-12T18:08:23.061 INFO:tasks.mon_thrash:Sending CONT to mon d 2026-02-12T18:08:23.061 INFO:tasks.ceph.mon.d:Sent signal 18 2026-02-12T18:08:23.062 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2026-02-12T18:08:23.062 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T18:08:23.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.128+0000 7f6b9d394640 10 monclient: get_monmap_and_config 2026-02-12T18:08:23.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.128+0000 7f6b9d394640 10 monclient: build_initial_monmap 2026-02-12T18:08:23.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.128+0000 7f6b9d394640 10 monclient: monmap: 2026-02-12T18:08:23.130 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:23.130 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.130 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:23.129331+0000 2026-02-12T18:08:23.130 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:23.129331+0000 2026-02-12T18:08:23.130 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:23.130 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.130 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:23.130 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:23.130 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:23.130 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:23.131 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:23.131 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:23.131 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:23.131 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:23.131 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:23.131 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:23.131 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:23.131 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.128+0000 7f6b9d394640 1 Processor -- start 2026-02-12T18:08:23.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.128+0000 7f6b9d394640 1 -- start start 2026-02-12T18:08:23.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.128+0000 7f6b9d394640 10 monclient: init 2026-02-12T18:08:23.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b9d394640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:23.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b9d394640 10 monclient: _add_conns ranks=[3,1,2,8,4,6,5,0,10,9,7] 2026-02-12T18:08:23.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b9d394640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6b9805dc20 0x7f6b98144660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b9d394640 10 monclient(hunting): picked mon.noname-g con 0x7f6b9805dc20 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:08:23.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b9d394640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f6b9805dff0 addr v1:10.20.193.111:6789/0 2026-02-12T18:08:23.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b9d394640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6b9805e3e0 0x7f6b9808a500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b9d394640 10 monclient(hunting): picked mon.noname-b con 0x7f6b9805e3e0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:08:23.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b9d394640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b98060390 con 0x7f6b9805dff0 2026-02-12T18:08:23.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b9d394640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b9d394640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f6b98093a30 con 0x7f6b9805e3e0 2026-02-12T18:08:23.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b9d394640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b9d394640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6b98092200 con 0x7f6b9805dc20 2026-02-12T18:08:23.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b9d394640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:23.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b9d394640 10 monclient(hunting): authenticate will time out at 741.855103s 2026-02-12T18:08:23.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b977fe640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6b9805e3e0 0x7f6b9808a500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b977fe640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6b9805e3e0 0x7f6b9808a500 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:41858/0 (socket says 10.20.193.48:41858) 2026-02-12T18:08:23.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b977fe640 1 -- 10.20.193.48:0/902392946 learned_addr learned my addr 10.20.193.48:0/902392946 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:23.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b977fe640 10 monclient(hunting): get_auth_request con 0x7f6b9805e3e0 auth_method 0 2026-02-12T18:08:23.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b977fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b96ffd640 1 --2- 10.20.193.48:0/902392946 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6b9805dc20 0x7f6b98144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b977fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b977fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b977fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b96ffd640 10 monclient(hunting): get_auth_request con 0x7f6b9805dc20 auth_method 0 2026-02-12T18:08:23.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b96ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b96ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b96ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b96ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b96ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b96ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b977fe640 10 monclient(hunting): handle_auth_done global_id 34913 payload 274 2026-02-12T18:08:23.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b977fe640 1 -- 10.20.193.48:0/902392946 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6b9805dc20 msgr2=0x7f6b98144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:23.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b977fe640 1 --2- 10.20.193.48:0/902392946 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6b9805dc20 0x7f6b98144660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b977fe640 1 -- 10.20.193.48:0/902392946 >> v1:10.20.193.111:6789/0 conn(0x7f6b9805dff0 legacy=0x7f6b98089df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:23.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b977fe640 10 monclient: _finish_hunting 0 2026-02-12T18:08:23.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b977fe640 1 monclient: found mon.noname-b 2026-02-12T18:08:23.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b977fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:23.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b977fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:08:23.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.129+0000 7f6b977fe640 1 -- 10.20.193.48:0/902392946 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9805e830 con 0x7f6b9805e3e0 2026-02-12T18:08:23.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b977fe640 1 -- 10.20.193.48:0/902392946 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6b9805e3e0 msgr2=0x7f6b9808a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:23.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b977fe640 1 --2- 10.20.193.48:0/902392946 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6b9805e3e0 0x7f6b9808a500 secure :-1 s=READY pgs=95 gs=2 cs=0 l=1 c_cookie=13811851780983237787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b8800a9b0 tx=0x7f6b8802ff80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfad8e0437da2c9b server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:23.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b95ffb640 1 -- 10.20.193.48:0/902392946 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6b88030c00 con 0x7f6b9805e3e0 2026-02-12T18:08:23.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b95ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b95ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:08:23.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b95ffb640 10 monclient: dump: 2026-02-12T18:08:23.142 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.142 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.142 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.142 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.142 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.142 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.142 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.142 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.142 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.142 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.143 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.143 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.143 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.143 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.143 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.143 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b95ffb640 10 monclient: _finish_auth 0 2026-02-12T18:08:23.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b95ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:08:23.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b95ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:23.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b95ffb640 1 -- 10.20.193.48:0/902392946 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b88030d80 con 0x7f6b9805e3e0 2026-02-12T18:08:23.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b95ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:23.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b95ffb640 1 -- 10.20.193.48:0/902392946 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6b88036cc0 con 0x7f6b9805e3e0 2026-02-12T18:08:23.144 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b9d394640 5 monclient: authenticate success, global_id 34913 2026-02-12T18:08:23.144 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b9d394640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:23.144 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b9d394640 4 set_mon_vals no callback set 2026-02-12T18:08:23.144 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b95ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.144 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b95ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:08:23.144 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b95ffb640 10 monclient: dump: 2026-02-12T18:08:23.144 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.144 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.144 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.144 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.145 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.145 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.145 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.145 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.145 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.145 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.145 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.145 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.145 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.145 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.145 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.145 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b9d394640 10 monclient: shutdown 2026-02-12T18:08:23.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b9d394640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:23.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b9d394640 1 -- 10.20.193.48:0/902392946 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6b9805e3e0 msgr2=0x7f6b9808a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b9d394640 1 --2- 10.20.193.48:0/902392946 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6b9805e3e0 0x7f6b9808a500 secure :-1 s=READY pgs=95 gs=2 cs=0 l=1 c_cookie=13811851780983237787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b8800a9b0 tx=0x7f6b8802ff80 comp rx=0 tx=0).stop 2026-02-12T18:08:23.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b9d394640 1 -- 10.20.193.48:0/902392946 shutdown_connections 2026-02-12T18:08:23.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b9d394640 1 --2- 10.20.193.48:0/902392946 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6b9805e3e0 0x7f6b9808a500 unknown :-1 s=CLOSED pgs=95 gs=2 cs=0 l=1 c_cookie=13811851780983237787 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b9d394640 1 --2- 10.20.193.48:0/902392946 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6b9805dc20 0x7f6b98144660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b9d394640 1 -- 10.20.193.48:0/902392946 >> 10.20.193.48:0/902392946 conn(0x7f6b980546d0 msgr2=0x7f6b98054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:23.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b9d394640 1 -- 10.20.193.48:0/902392946 shutdown_connections 2026-02-12T18:08:23.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.132+0000 7f6b9d394640 1 -- 10.20.193.48:0/902392946 wait complete. 2026-02-12T18:08:23.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b9d394640 10 monclient: build_initial_monmap 2026-02-12T18:08:23.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b9d394640 10 monclient: monmap: 2026-02-12T18:08:23.147 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:23.147 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:23.147 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:23.147 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:23.147 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:23.147 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.147 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:23.147 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:23.147 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:23.147 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:23.147 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:23.147 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:23.148 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:23.148 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:23.148 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:23.148 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b9d394640 1 Processor -- start 2026-02-12T18:08:23.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b9d394640 1 -- start start 2026-02-12T18:08:23.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b9d394640 10 monclient: init 2026-02-12T18:08:23.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b9d394640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:23.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b9d394640 10 monclient: _add_conns ranks=[6,8,1,0,2,5,7,3,4] 2026-02-12T18:08:23.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b9d394640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6b9805dc20 0x7f6b98112f80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b9d394640 10 monclient(hunting): picked mon.noname-d con 0x7f6b9805dc20 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:08:23.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b9d394640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6b9805dff0 0x7f6b981134c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b9d394640 10 monclient(hunting): picked mon.noname-e con 0x7f6b9805dff0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:08:23.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b9d394640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f6b9805e3e0 0x7f6b98113a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b9d394640 10 monclient(hunting): picked mon.noname-f con 0x7f6b9805e3e0 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:08:23.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b9d394640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b9d394640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6b981422c0 con 0x7f6b9805e3e0 2026-02-12T18:08:23.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b9d394640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b9d394640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f6b981103f0 con 0x7f6b9805dc20 2026-02-12T18:08:23.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b9d394640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b9d394640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f6b981106d0 con 0x7f6b9805dff0 2026-02-12T18:08:23.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b9d394640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:23.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b9d394640 10 monclient(hunting): authenticate will time out at 741.859712s 2026-02-12T18:08:23.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b96ffd640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6b9805dc20 0x7f6b98112f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b96ffd640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6b9805dc20 0x7f6b98112f80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:45136/0 (socket says 10.20.193.48:45136) 2026-02-12T18:08:23.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b967fc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6b9805dff0 0x7f6b981134c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b96ffd640 1 -- 10.20.193.48:0/2571922157 learned_addr learned my addr 10.20.193.48:0/2571922157 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:23.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b96ffd640 10 monclient(hunting): get_auth_request con 0x7f6b9805dc20 auth_method 0 2026-02-12T18:08:23.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b96ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b96ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b96ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b967fc640 10 monclient(hunting): get_auth_request con 0x7f6b9805dff0 auth_method 0 2026-02-12T18:08:23.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b967fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b967fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b967fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b977fe640 1 --2- 10.20.193.48:0/2571922157 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f6b9805e3e0 0x7f6b98113a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b977fe640 10 monclient(hunting): get_auth_request con 0x7f6b9805e3e0 auth_method 0 2026-02-12T18:08:23.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b977fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b977fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b96ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b96ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b96ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b967fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b967fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b967fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b977fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b977fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.133+0000 7f6b977fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.134+0000 7f6b96ffd640 10 monclient(hunting): handle_auth_done global_id 4893 payload 824 2026-02-12T18:08:23.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.134+0000 7f6b96ffd640 1 -- 10.20.193.48:0/2571922157 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6b9805dff0 msgr2=0x7f6b981134c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.134+0000 7f6b96ffd640 1 --2- 10.20.193.48:0/2571922157 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6b9805dff0 0x7f6b981134c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.134+0000 7f6b96ffd640 1 -- 10.20.193.48:0/2571922157 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f6b9805e3e0 msgr2=0x7f6b98113a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.134+0000 7f6b96ffd640 1 --2- 10.20.193.48:0/2571922157 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f6b9805e3e0 0x7f6b98113a00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.134+0000 7f6b96ffd640 10 monclient: _finish_hunting 0 2026-02-12T18:08:23.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.134+0000 7f6b96ffd640 1 monclient: found mon.noname-d 2026-02-12T18:08:23.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.134+0000 7f6b96ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:23.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.134+0000 7f6b96ffd640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:08:23.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.134+0000 7f6b96ffd640 1 -- 10.20.193.48:0/2571922157 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b8800a5d0 con 0x7f6b9805dc20 2026-02-12T18:08:23.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.134+0000 7f6b96ffd640 1 -- 10.20.193.48:0/2571922157 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6b9805dc20 msgr2=0x7f6b98112f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-12T18:08:23.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.134+0000 7f6b96ffd640 1 -- 10.20.193.48:0/2571922157 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6b9805dc20 msgr2=0x7f6b98112f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:08:23.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.134+0000 7f6b96ffd640 1 --2- 10.20.193.48:0/2571922157 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6b9805dc20 0x7f6b98112f80 secure :-1 s=SESSION_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b8c0093f0 tx=0x7f6b8c00ed50 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:08:23.153 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.134+0000 7f6b96ffd640 1 --2- 10.20.193.48:0/2571922157 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6b9805dc20 0x7f6b98112f80 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:08:23.271 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28341]: starting. 2026-02-12T18:08:23.271 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28341]: creating pool ceph_test_rados_delete_pools_parallel.trial111-28340 2026-02-12T18:08:23.271 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28341]: created object 0... 2026-02-12T18:08:23.272 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28341]: created object 25... 2026-02-12T18:08:23.272 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28341]: created object 49... 2026-02-12T18:08:23.272 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28341]: finishing. 2026-02-12T18:08:23.272 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28341]: shutting down. 2026-02-12T18:08:23.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b96ffd640 1 --2- 10.20.193.48:0/2571922157 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6b9805dc20 0x7f6b98112f80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b96ffd640 10 monclient: get_auth_request con 0x7f6b9805dc20 auth_method 0 2026-02-12T18:08:23.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b96ffd640 0 --2- 10.20.193.48:0/2571922157 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6b9805dc20 0x7f6b98112f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2026-02-12T18:08:23.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b96ffd640 1 --2- 10.20.193.48:0/2571922157 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6b9805dc20 0x7f6b98112f80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b777fe640 10 monclient: ms_handle_reset current mon [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:08:23.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b777fe640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:23.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b777fe640 1 -- 10.20.193.48:0/2571922157 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6b9805dc20 msgr2=0x7f6b98112f80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:23.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b777fe640 1 --2- 10.20.193.48:0/2571922157 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6b9805dc20 0x7f6b98112f80 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b777fe640 10 monclient: _add_conns ranks=[2,0,5,7,3,4] 2026-02-12T18:08:23.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b777fe640 1 --2- 10.20.193.48:0/2571922157 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6b64003690 0x7f6b64023ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b777fe640 10 monclient(hunting): picked mon.noname-b con 0x7f6b64003690 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:08:23.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b777fe640 1 --2- 10.20.193.48:0/2571922157 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6b64024670 0x7f6b64044af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b777fe640 10 monclient(hunting): picked mon.noname-a con 0x7f6b64024670 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:08:23.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b777fe640 1 --2- 10.20.193.48:0/2571922157 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6b640456d0 0x7f6b64065b80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b777fe640 10 monclient(hunting): picked mon.noname-h con 0x7f6b640456d0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:08:23.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b777fe640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b777fe640 1 -- 10.20.193.48:0/2571922157 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f6b64066770 con 0x7f6b64024670 2026-02-12T18:08:23.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b777fe640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b777fe640 1 -- 10.20.193.48:0/2571922157 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f6b640668b0 con 0x7f6b64003690 2026-02-12T18:08:23.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b777fe640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b777fe640 1 -- 10.20.193.48:0/2571922157 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f6b64066a70 con 0x7f6b640456d0 2026-02-12T18:08:23.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b777fe640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:23.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b96ffd640 1 --2- 10.20.193.48:0/2571922157 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6b64003690 0x7f6b64023ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b96ffd640 10 monclient(hunting): get_auth_request con 0x7f6b64003690 auth_method 0 2026-02-12T18:08:23.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b96ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b96ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b96ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:08:23.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b967fc640 1 --2- 10.20.193.48:0/2571922157 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6b64024670 0x7f6b64044af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b967fc640 10 monclient(hunting): get_auth_request con 0x7f6b64024670 auth_method 0 2026-02-12T18:08:23.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b967fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b967fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b967fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:08:23.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b96ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b96ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.335+0000 7f6b96ffd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:08:23.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.336+0000 7f6b967fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.336+0000 7f6b967fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.336+0000 7f6b967fc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:08:23.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.336+0000 7f6b977fe640 1 --2- 10.20.193.48:0/2571922157 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6b640456d0 0x7f6b64065b80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.336+0000 7f6b977fe640 10 monclient(hunting): get_auth_request con 0x7f6b640456d0 auth_method 0 2026-02-12T18:08:23.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.336+0000 7f6b977fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.336+0000 7f6b977fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.336+0000 7f6b977fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:08:23.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.336+0000 7f6b96ffd640 10 monclient(hunting): handle_auth_done global_id 4893 payload 293 2026-02-12T18:08:23.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.336+0000 7f6b96ffd640 1 -- 10.20.193.48:0/2571922157 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6b640456d0 msgr2=0x7f6b64065b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.336+0000 7f6b96ffd640 1 --2- 10.20.193.48:0/2571922157 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6b640456d0 0x7f6b64065b80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.336+0000 7f6b96ffd640 1 -- 10.20.193.48:0/2571922157 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6b64024670 msgr2=0x7f6b64044af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.336+0000 7f6b96ffd640 1 --2- 10.20.193.48:0/2571922157 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6b64024670 0x7f6b64044af0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.336+0000 7f6b96ffd640 10 monclient: _finish_hunting 0 2026-02-12T18:08:23.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.336+0000 7f6b96ffd640 1 monclient: found mon.noname-b 2026-02-12T18:08:23.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.336+0000 7f6b977fe640 1 -- 10.20.193.48:0/2571922157 reap_dead start 2026-02-12T18:08:23.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.336+0000 7f6b96ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:23.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.336+0000 7f6b96ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:08:23.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.336+0000 7f6b96ffd640 1 -- 10.20.193.48:0/2571922157 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b64066cf0 con 0x7f6b64003690 2026-02-12T18:08:23.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.338+0000 7f6b96ffd640 1 -- 10.20.193.48:0/2571922157 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6b64003690 msgr2=0x7f6b64023ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:23.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.338+0000 7f6b96ffd640 1 --2- 10.20.193.48:0/2571922157 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6b64003690 0x7f6b64023ad0 secure :-1 s=READY pgs=97 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b8c009710 tx=0x7f6b8c009210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:23.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.338+0000 7f6b777fe640 1 -- 10.20.193.48:0/2571922157 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6b8c00ceb0 con 0x7f6b64003690 2026-02-12T18:08:23.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.338+0000 7f6b777fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.338+0000 7f6b777fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:08:23.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.338+0000 7f6b777fe640 10 monclient: dump: 2026-02-12T18:08:23.347 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.348 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.348 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.348 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.348 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.348 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.348 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.348 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.348 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.348 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.348 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.348 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.349 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.349 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.349 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.349 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.338+0000 7f6b777fe640 10 monclient: _finish_auth 0 2026-02-12T18:08:23.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.338+0000 7f6b777fe640 10 monclient: _check_auth_tickets 2026-02-12T18:08:23.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.338+0000 7f6b777fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:23.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.338+0000 7f6b777fe640 1 -- 10.20.193.48:0/2571922157 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b8c013930 con 0x7f6b64003690 2026-02-12T18:08:23.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.338+0000 7f6b777fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:23.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.338+0000 7f6b777fe640 1 -- 10.20.193.48:0/2571922157 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6b8c01d400 con 0x7f6b64003690 2026-02-12T18:08:23.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.338+0000 7f6b777fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.338+0000 7f6b777fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:08:23.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.338+0000 7f6b957fa640 4 set_mon_vals no callback set 2026-02-12T18:08:23.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.338+0000 7f6b777fe640 10 monclient: dump: 2026-02-12T18:08:23.350 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.350 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.350 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.350 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.350 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.350 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.350 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.350 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.350 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.350 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.350 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.351 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.351 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.351 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.351 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.351 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.338+0000 7f6b9d394640 5 monclient: authenticate success, global_id 4893 2026-02-12T18:08:23.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.338+0000 7f6b9d394640 10 monclient: _renew_subs 2026-02-12T18:08:23.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.338+0000 7f6b9d394640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:08:23.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.338+0000 7f6b9d394640 1 -- 10.20.193.48:0/2571922157 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b98091640 con 0x7f6b64003690 2026-02-12T18:08:23.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.338+0000 7f6b9d394640 10 monclient: _renew_subs 2026-02-12T18:08:23.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.338+0000 7f6b9d394640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:08:23.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.338+0000 7f6b9d394640 1 -- 10.20.193.48:0/2571922157 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b98123960 con 0x7f6b64003690 2026-02-12T18:08:23.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.339+0000 7f6b777fe640 1 -- 10.20.193.48:0/2571922157 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f6b8c011070 con 0x7f6b64003690 2026-02-12T18:08:23.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.339+0000 7f6b9d394640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:23.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.339+0000 7f6b9d394640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:23.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.339+0000 7f6b9d394640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:08:23.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.339+0000 7f6b9d394640 1 -- 10.20.193.48:0/2571922157 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b98110110 con 0x7f6b64003690 2026-02-12T18:08:23.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.339+0000 7f6b777fe640 1 --2- 10.20.193.48:0/2571922157 >> v2:10.20.193.111:6812/977811348 conn(0x7f6b64061090 0x7f6b64061530 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.339+0000 7f6b777fe640 1 -- 10.20.193.48:0/2571922157 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(114..114 src has 1..114) ==== 3897+0+0 (secure 0 0 0) 0x7f6b8c054120 con 0x7f6b64003690 2026-02-12T18:08:23.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.339+0000 7f6b967fc640 1 --2- 10.20.193.48:0/2571922157 >> v2:10.20.193.111:6812/977811348 conn(0x7f6b64061090 0x7f6b64061530 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.339+0000 7f6b967fc640 10 monclient: get_auth_request con 0x7f6b64061090 auth_method 0 2026-02-12T18:08:23.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.341+0000 7f6b777fe640 1 -- 10.20.193.48:0/2571922157 <== mon.2 v2:10.20.193.48:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f6b8c011b60 con 0x7f6b64003690 2026-02-12T18:08:23.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.341+0000 7f6b777fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:23.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.341+0000 7f6b777fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:23.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.342+0000 7f6b967fc640 1 --2- 10.20.193.48:0/2571922157 >> v2:10.20.193.111:6812/977811348 conn(0x7f6b64061090 0x7f6b64061530 secure :-1 s=READY pgs=166 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b640035e0 tx=0x7f6b80007ec0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:23.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.489+0000 7f6b9d394640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T18:08:23.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.489+0000 7f6b9d394640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T18:08:23.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.489+0000 7f6b9d394640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:08:23.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.489+0000 7f6b9d394640 1 -- 10.20.193.48:0/2571922157 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6b98092510 con 0x7f6b64003690 2026-02-12T18:08:23.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.489+0000 7f6b777fe640 1 -- 10.20.193.48:0/2571922157 <== mon.2 v2:10.20.193.48:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3660 (secure 0 0 0) 0x7f6b8c021020 con 0x7f6b64003690 2026-02-12T18:08:23.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.489+0000 7f6b777fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T18:08:23.492 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.489+0000 7f6b777fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:23.492 INFO:teuthology.orchestra.run.trial048.stdout:{"election_epoch":28,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","modified":"2026-02-12T18:05:32.850777Z","created":"2026-02-12T18:05:32.850777Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3300","nonce":0},{"type":"v1","addr":"10.20.193.48:6789","nonce":0}]},"addr":"10.20.193.48:6789/0","public_addr":"10.20.193.48:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850827+0000","crush_location":[]},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3300","nonce":0},{"type":"v1","addr":"10.20.193.111:6789","nonce":0}]},"addr":"10.20.193.111:6789/0","public_addr":"10.20.193.111:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850829+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3301","nonce":0},{"type":"v1","addr":"10.20.193.48:6790","nonce":0}]},"addr":"10.20.193.48:6790/0","public_addr":"10.20.193.48:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850830+0000","crush_location":[]},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3301","nonce":0},{"type":"v1","addr":"10.20.193.111:6790","nonce":0}]},"addr":"10.20.193.111:6790/0","public_addr":"10.20.193.111:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850833+0000","crush_location":[]},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3302","nonce":0},{"type":"v1","addr":"10.20.193.48:6791","nonce":0}]},"addr":"10.20.193.48:6791/0","public_addr":"10.20.193.48:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3302","nonce":0},{"type":"v1","addr":"10.20.193.111:6791","nonce":0}]},"addr":"10.20.193.111:6791/0","public_addr":"10.20.193.111:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850834+0000","crush_location":[]},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3303","nonce":0},{"type":"v1","addr":"10.20.193.48:6792","nonce":0}]},"addr":"10.20.193.48:6792/0","public_addr":"10.20.193.48:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3303","nonce":0},{"type":"v1","addr":"10.20.193.111:6792","nonce":0}]},"addr":"10.20.193.111:6792/0","public_addr":"10.20.193.111:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850835+0000","crush_location":[]},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3304","nonce":0},{"type":"v1","addr":"10.20.193.48:6793","nonce":0}]},"addr":"10.20.193.48:6793/0","public_addr":"10.20.193.48:6793/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850832+0000","crush_location":[]}]}} 2026-02-12T18:08:23.493 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.491+0000 7f6b9d394640 1 -- 10.20.193.48:0/2571922157 >> v2:10.20.193.111:6812/977811348 conn(0x7f6b64061090 msgr2=0x7f6b64061530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.493 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.491+0000 7f6b9d394640 1 --2- 10.20.193.48:0/2571922157 >> v2:10.20.193.111:6812/977811348 conn(0x7f6b64061090 0x7f6b64061530 secure :-1 s=READY pgs=166 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b640035e0 tx=0x7f6b80007ec0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.493 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.491+0000 7f6b9d394640 10 monclient: shutdown 2026-02-12T18:08:23.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.491+0000 7f6b9d394640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:23.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.491+0000 7f6b9d394640 1 -- 10.20.193.48:0/2571922157 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6b64003690 msgr2=0x7f6b64023ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.491+0000 7f6b9d394640 1 --2- 10.20.193.48:0/2571922157 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6b64003690 0x7f6b64023ad0 secure :-1 s=READY pgs=97 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b8c009710 tx=0x7f6b8c009210 comp rx=0 tx=0).stop 2026-02-12T18:08:23.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.491+0000 7f6b9d394640 1 -- 10.20.193.48:0/2571922157 shutdown_connections 2026-02-12T18:08:23.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.491+0000 7f6b9d394640 1 --2- 10.20.193.48:0/2571922157 >> v2:10.20.193.111:6812/977811348 conn(0x7f6b64061090 0x7f6b64061530 unknown :-1 s=CLOSED pgs=166 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.491+0000 7f6b9d394640 1 --2- 10.20.193.48:0/2571922157 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6b64003690 0x7f6b64023ad0 unknown :-1 s=CLOSED pgs=97 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.491+0000 7f6b9d394640 1 -- 10.20.193.48:0/2571922157 >> 10.20.193.48:0/2571922157 conn(0x7f6b980546d0 msgr2=0x7f6b98124e40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:23.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.491+0000 7f6b9d394640 1 -- 10.20.193.48:0/2571922157 shutdown_connections 2026-02-12T18:08:23.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.491+0000 7f6b9d394640 1 -- 10.20.193.48:0/2571922157 wait complete. 2026-02-12T18:08:23.500 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2026-02-12T18:08:23.501 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2026-02-12T18:08:23.501 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T18:08:23.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.565+0000 7fb16470c640 10 monclient: get_monmap_and_config 2026-02-12T18:08:23.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.565+0000 7fb16470c640 10 monclient: build_initial_monmap 2026-02-12T18:08:23.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.565+0000 7fb16470c640 10 monclient: monmap: 2026-02-12T18:08:23.567 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:23.567 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.567 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:23.566231+0000 2026-02-12T18:08:23.567 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:23.566231+0000 2026-02-12T18:08:23.567 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:23.567 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.567 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:23.567 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:23.567 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:23.567 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:23.568 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:23.568 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:23.568 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:23.568 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:23.568 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:23.568 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:23.568 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:23.568 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.565+0000 7fb16470c640 1 Processor -- start 2026-02-12T18:08:23.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.565+0000 7fb16470c640 1 -- start start 2026-02-12T18:08:23.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.565+0000 7fb16470c640 10 monclient: init 2026-02-12T18:08:23.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.565+0000 7fb16470c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:23.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.565+0000 7fb16470c640 10 monclient: _add_conns ranks=[5,0,1,3,6,9,7,4,2,10,8] 2026-02-12T18:08:23.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb16470c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb15c05c950 0x7fb15c05cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb16470c640 10 monclient(hunting): picked mon.noname-h con 0x7fb15c05c950 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:08:23.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb16470c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb15c05e490 addr v1:10.20.193.48:6789/0 2026-02-12T18:08:23.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb16470c640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fb15c05d260 addr v1:10.20.193.111:6789/0 2026-02-12T18:08:23.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb16470c640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb15c04dc20 con 0x7fb15c05e490 2026-02-12T18:08:23.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb16470c640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb15c05ddd0 con 0x7fb15c05d260 2026-02-12T18:08:23.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb16470c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb16470c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fb15c13e990 con 0x7fb15c05c950 2026-02-12T18:08:23.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb16470c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:23.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb16470c640 10 monclient(hunting): authenticate will time out at 742.292080s 2026-02-12T18:08:23.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb161c80640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7fb15c05e490 0x7fb15c13db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:56826/0 (socket says 10.20.193.48:56826) 2026-02-12T18:08:23.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb161c80640 1 -- 10.20.193.48:0/4286798105 learned_addr learned my addr 10.20.193.48:0/4286798105 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:08:23.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb162481640 1 --2- 10.20.193.48:0/4286798105 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb15c05c950 0x7fb15c05cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb162481640 10 monclient(hunting): get_auth_request con 0x7fb15c05c950 auth_method 0 2026-02-12T18:08:23.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb162481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb162481640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb162481640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb162481640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb162481640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb162481640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb162481640 10 monclient(hunting): handle_auth_done global_id 4946 payload 274 2026-02-12T18:08:23.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb162481640 1 -- 10.20.193.48:0/4286798105 >> v1:10.20.193.111:6789/0 conn(0x7fb15c05d260 legacy=0x7fb15c13e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:23.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb162481640 1 -- 10.20.193.48:0/4286798105 >> v1:10.20.193.48:6789/0 conn(0x7fb15c05e490 legacy=0x7fb15c13db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:23.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb162481640 10 monclient: _finish_hunting 0 2026-02-12T18:08:23.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb162481640 1 monclient: found mon.noname-h 2026-02-12T18:08:23.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb162481640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:23.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb162481640 10 monclient: _send_mon_message to mon.noname-h at v2:10.20.193.111:3302/0 2026-02-12T18:08:23.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.566+0000 7fb162481640 1 -- 10.20.193.48:0/4286798105 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb15c092990 con 0x7fb15c05c950 2026-02-12T18:08:23.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb162481640 1 -- 10.20.193.48:0/4286798105 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb15c05c950 msgr2=0x7fb15c05cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:23.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb162481640 1 --2- 10.20.193.48:0/4286798105 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb15c05c950 0x7fb15c05cd20 secure :-1 s=READY pgs=122 gs=3 cs=0 l=1 c_cookie=11583606972979306883 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb14c009800 tx=0x7fb14c02ed50 comp rx=0 tx=0).ready entity=mon.5 client_cookie=a0c13d2b5a2b6183 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:23.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb16147f640 1 -- 10.20.193.48:0/4286798105 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb14c035340 con 0x7fb15c05c950 2026-02-12T18:08:23.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb16147f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb16147f640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2026-02-12T18:08:23.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb16147f640 10 monclient: dump: 2026-02-12T18:08:23.584 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.584 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.584 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.584 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.584 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.584 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.584 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.584 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.584 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.584 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.584 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.584 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.585 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.585 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.585 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.585 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb16147f640 10 monclient: _finish_auth 0 2026-02-12T18:08:23.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb16147f640 10 monclient: _check_auth_tickets 2026-02-12T18:08:23.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb16147f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:23.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb16470c640 5 monclient: authenticate success, global_id 4946 2026-02-12T18:08:23.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb16147f640 1 -- 10.20.193.48:0/4286798105 <== mon.5 v2:10.20.193.111:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb14c0354c0 con 0x7fb15c05c950 2026-02-12T18:08:23.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb16147f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:23.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb16147f640 1 -- 10.20.193.48:0/4286798105 <== mon.5 v2:10.20.193.111:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb14c035af0 con 0x7fb15c05c950 2026-02-12T18:08:23.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb16147f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb16147f640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:08:23.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb16147f640 10 monclient: dump: 2026-02-12T18:08:23.586 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.586 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.586 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.586 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.586 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.586 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.586 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.586 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.586 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.586 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.587 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.587 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.587 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.587 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.587 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.587 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb16470c640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:23.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb16470c640 4 set_mon_vals no callback set 2026-02-12T18:08:23.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb16470c640 10 monclient: shutdown 2026-02-12T18:08:23.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb16470c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:23.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb16470c640 1 -- 10.20.193.48:0/4286798105 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb15c05c950 msgr2=0x7fb15c05cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb16470c640 1 --2- 10.20.193.48:0/4286798105 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb15c05c950 0x7fb15c05cd20 secure :-1 s=READY pgs=122 gs=3 cs=0 l=1 c_cookie=11583606972979306883 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb14c009800 tx=0x7fb14c02ed50 comp rx=0 tx=0).stop 2026-02-12T18:08:23.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb16470c640 1 -- 10.20.193.48:0/4286798105 shutdown_connections 2026-02-12T18:08:23.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb16470c640 1 --2- 10.20.193.48:0/4286798105 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb15c05c950 0x7fb15c05cd20 unknown :-1 s=CLOSED pgs=122 gs=3 cs=0 l=1 c_cookie=11583606972979306883 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb16470c640 1 -- 10.20.193.48:0/4286798105 >> 10.20.193.48:0/4286798105 conn(0x7fb15c0548a0 msgr2=0x7fb15c097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:23.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb16470c640 1 -- 10.20.193.48:0/4286798105 shutdown_connections 2026-02-12T18:08:23.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.569+0000 7fb16470c640 1 -- 10.20.193.48:0/4286798105 wait complete. 2026-02-12T18:08:23.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb16470c640 10 monclient: build_initial_monmap 2026-02-12T18:08:23.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb16470c640 10 monclient: monmap: 2026-02-12T18:08:23.588 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:23.588 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:23.588 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:23.588 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:23.588 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:23.589 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.589 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:23.589 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:23.589 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:23.589 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:23.589 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:23.589 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:23.589 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:23.589 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:23.589 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:23.589 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb16470c640 1 Processor -- start 2026-02-12T18:08:23.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb16470c640 1 -- start start 2026-02-12T18:08:23.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb16470c640 10 monclient: init 2026-02-12T18:08:23.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb16470c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:23.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb16470c640 10 monclient: _add_conns ranks=[1,0,5,6,7,3,2,8,4] 2026-02-12T18:08:23.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb16470c640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb15c05c950 0x7fb15c08d3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb16470c640 10 monclient(hunting): picked mon.noname-f con 0x7fb15c05c950 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:08:23.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb16470c640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb15c05d260 0x7fb15c13db70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb16470c640 10 monclient(hunting): picked mon.noname-a con 0x7fb15c05d260 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:08:23.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb16470c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb15c05e490 0x7fb15c13e0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb16470c640 10 monclient(hunting): picked mon.noname-h con 0x7fb15c05e490 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:08:23.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb16470c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb16470c640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c091610 con 0x7fb15c05d260 2026-02-12T18:08:23.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb16470c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb16470c640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c08be90 con 0x7fb15c05c950 2026-02-12T18:08:23.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb16470c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb16470c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fb15c142e90 con 0x7fb15c05e490 2026-02-12T18:08:23.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb16470c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:23.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb16470c640 10 monclient(hunting): authenticate will time out at 742.296777s 2026-02-12T18:08:23.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb161c80640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb15c05d260 0x7fb15c13db70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb161c80640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb15c05d260 0x7fb15c13db70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:43928/0 (socket says 10.20.193.48:43928) 2026-02-12T18:08:23.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb161c80640 1 -- 10.20.193.48:0/52281841 learned_addr learned my addr 10.20.193.48:0/52281841 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:23.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb161c80640 10 monclient(hunting): get_auth_request con 0x7fb15c05d260 auth_method 0 2026-02-12T18:08:23.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb161c80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb161c80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb161c80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb161c80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb161c80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.570+0000 7fb161c80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.571+0000 7fb162481640 1 --2- 10.20.193.48:0/52281841 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb15c05c950 0x7fb15c08d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.571+0000 7fb162c82640 1 --2- 10.20.193.48:0/52281841 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb15c05e490 0x7fb15c13e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.571+0000 7fb162481640 10 monclient(hunting): get_auth_request con 0x7fb15c05c950 auth_method 0 2026-02-12T18:08:23.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.571+0000 7fb162481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.571+0000 7fb162481640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.571+0000 7fb162481640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.571+0000 7fb162c82640 10 monclient(hunting): get_auth_request con 0x7fb15c05e490 auth_method 0 2026-02-12T18:08:23.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.571+0000 7fb162c82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.571+0000 7fb162c82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.571+0000 7fb162c82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.571+0000 7fb161c80640 10 monclient(hunting): handle_auth_done global_id 5058 payload 824 2026-02-12T18:08:23.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.571+0000 7fb161c80640 1 -- 10.20.193.48:0/52281841 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb15c05e490 msgr2=0x7fb15c13e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.571+0000 7fb161c80640 1 --2- 10.20.193.48:0/52281841 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb15c05e490 0x7fb15c13e0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.571+0000 7fb161c80640 1 -- 10.20.193.48:0/52281841 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb15c05c950 msgr2=0x7fb15c08d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.571+0000 7fb161c80640 1 --2- 10.20.193.48:0/52281841 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb15c05c950 0x7fb15c08d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.571+0000 7fb161c80640 10 monclient: _finish_hunting 0 2026-02-12T18:08:23.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.571+0000 7fb161c80640 1 monclient: found mon.noname-a 2026-02-12T18:08:23.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.571+0000 7fb161c80640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:23.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.571+0000 7fb161c80640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:08:23.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.571+0000 7fb161c80640 1 -- 10.20.193.48:0/52281841 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb14c009420 con 0x7fb15c05d260 2026-02-12T18:08:23.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.573+0000 7fb161c80640 1 -- 10.20.193.48:0/52281841 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb15c05d260 msgr2=0x7fb15c13db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:23.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.573+0000 7fb161c80640 1 --2- 10.20.193.48:0/52281841 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb15c05d260 0x7fb15c13db70 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb15000c520 tx=0x7fb15000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:23.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.573+0000 7fb142ffd640 1 -- 10.20.193.48:0/52281841 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb150005db0 con 0x7fb15c05d260 2026-02-12T18:08:23.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.573+0000 7fb142ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.573+0000 7fb142ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:08:23.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.573+0000 7fb142ffd640 10 monclient: dump: 2026-02-12T18:08:23.594 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.594 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.594 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.594 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.594 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.595 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.595 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.595 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.595 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.595 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.595 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.595 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.595 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.595 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.595 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.595 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.595 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.573+0000 7fb142ffd640 10 monclient: _finish_auth 0 2026-02-12T18:08:23.595 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.573+0000 7fb142ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:08:23.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.573+0000 7fb142ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:23.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.573+0000 7fb142ffd640 1 -- 10.20.193.48:0/52281841 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1500075b0 con 0x7fb15c05d260 2026-02-12T18:08:23.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.573+0000 7fb16470c640 5 monclient: authenticate success, global_id 5058 2026-02-12T18:08:23.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.573+0000 7fb16470c640 10 monclient: _renew_subs 2026-02-12T18:08:23.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.573+0000 7fb16470c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:08:23.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.573+0000 7fb16470c640 1 -- 10.20.193.48:0/52281841 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb15c142940 con 0x7fb15c05d260 2026-02-12T18:08:23.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.573+0000 7fb142ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:23.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.573+0000 7fb142ffd640 1 -- 10.20.193.48:0/52281841 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb150007720 con 0x7fb15c05d260 2026-02-12T18:08:23.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.573+0000 7fb142ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.573+0000 7fb160c7e640 4 set_mon_vals no callback set 2026-02-12T18:08:23.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.573+0000 7fb142ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:08:23.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.573+0000 7fb142ffd640 10 monclient: dump: 2026-02-12T18:08:23.596 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.597 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.597 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.597 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.597 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.597 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.597 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.597 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.597 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.597 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.597 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.597 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.597 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.598 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.598 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.598 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.573+0000 7fb16470c640 10 monclient: _renew_subs 2026-02-12T18:08:23.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.573+0000 7fb16470c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:08:23.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.573+0000 7fb16470c640 1 -- 10.20.193.48:0/52281841 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb15c08a8b0 con 0x7fb15c05d260 2026-02-12T18:08:23.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.573+0000 7fb16470c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:23.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.573+0000 7fb16470c640 1 --2- 10.20.193.48:0/52281841 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb15c08d900 0x7fb15c12a1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.574+0000 7fb16470c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.574+0000 7fb16470c640 1 -- 10.20.193.48:0/52281841 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c144050 con 0x7fb15c08d900 2026-02-12T18:08:23.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.574+0000 7fb162481640 1 --2- 10.20.193.48:0/52281841 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb15c08d900 0x7fb15c12a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.574+0000 7fb162481640 10 monclient: get_auth_request con 0x7fb15c08d900 auth_method 0 2026-02-12T18:08:23.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.574+0000 7fb162481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.574+0000 7fb162481640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.574+0000 7fb162481640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.574+0000 7fb162481640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.574+0000 7fb162481640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.574+0000 7fb162481640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.574+0000 7fb142ffd640 1 -- 10.20.193.48:0/52281841 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fb1500070f0 con 0x7fb15c05d260 2026-02-12T18:08:23.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.574+0000 7fb162481640 10 monclient(hunting): handle_auth_done global_id 5067 payload 824 2026-02-12T18:08:23.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.574+0000 7fb162481640 1 -- 10.20.193.48:0/52281841 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb15c05d700 con 0x7fb15c08d900 2026-02-12T18:08:23.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.574+0000 7fb142ffd640 1 --2- 10.20.193.48:0/52281841 >> v2:10.20.193.111:6812/977811348 conn(0x7fb12c03f800 0x7fb12c05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.574+0000 7fb142ffd640 1 -- 10.20.193.48:0/52281841 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 3897+0+0 (secure 0 0 0) 0x7fb150052110 con 0x7fb15c05d260 2026-02-12T18:08:23.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.574+0000 7fb162c82640 1 --2- 10.20.193.48:0/52281841 >> v2:10.20.193.111:6812/977811348 conn(0x7fb12c03f800 0x7fb12c05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.574+0000 7fb162c82640 10 monclient: get_auth_request con 0x7fb12c03f800 auth_method 0 2026-02-12T18:08:23.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.576+0000 7fb162481640 1 -- 10.20.193.48:0/52281841 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb15c08d900 msgr2=0x7fb15c12a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:23.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.576+0000 7fb162481640 1 --2- 10.20.193.48:0/52281841 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb15c08d900 0x7fb15c12a1c0 secure :-1 s=READY pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb14c0090b0 tx=0x7fb14c0047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:23.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.576+0000 7fb142ffd640 1 -- 10.20.193.48:0/52281841 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb14c004590 con 0x7fb15c08d900 2026-02-12T18:08:23.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.576+0000 7fb142ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.576+0000 7fb142ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:08:23.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.576+0000 7fb142ffd640 10 monclient: dump: 2026-02-12T18:08:23.600 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.600 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.600 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.600 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.600 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.601 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.601 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.601 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.601 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.601 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.601 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.601 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.601 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.601 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.601 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.601 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.576+0000 7fb142ffd640 1 -- 10.20.193.48:0/52281841 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fb14c003af0 con 0x7fb15c08d900 2026-02-12T18:08:23.602 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.576+0000 7fb142ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:23.602 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.576+0000 7fb142ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:23.602 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.576+0000 7fb142ffd640 1 -- 10.20.193.48:0/52281841 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb15c08d900 msgr2=0x7fb15c12a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.602 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.576+0000 7fb142ffd640 1 --2- 10.20.193.48:0/52281841 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb15c08d900 0x7fb15c12a1c0 secure :-1 s=READY pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb14c0090b0 tx=0x7fb14c0047e0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.602 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.576+0000 7fb142ffd640 1 -- 10.20.193.48:0/52281841 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb15c08d900 msgr2=0x7fb15c12a1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:23.602 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.576+0000 7fb142ffd640 1 --2- 10.20.193.48:0/52281841 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb15c08d900 0x7fb15c12a1c0 secure :-1 s=CLOSED pgs=210 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb14c0090b0 tx=0x7fb14c0047e0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.602 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.577+0000 7fb162c82640 1 --2- 10.20.193.48:0/52281841 >> v2:10.20.193.111:6812/977811348 conn(0x7fb12c03f800 0x7fb12c05fcb0 secure :-1 s=READY pgs=167 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb158004850 tx=0x7fb15800a040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:23.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.580+0000 7fb16470c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:08:23.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.580+0000 7fb16470c640 1 --2- 10.20.193.48:0/52281841 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb15c12a700 0x7fb15c12aad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.580+0000 7fb16470c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.580+0000 7fb16470c640 1 -- 10.20.193.48:0/52281841 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fb15c050410 con 0x7fb15c12a700 2026-02-12T18:08:23.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.580+0000 7fb162481640 1 --2- 10.20.193.48:0/52281841 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb15c12a700 0x7fb15c12aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.580+0000 7fb162481640 10 monclient: get_auth_request con 0x7fb15c12a700 auth_method 0 2026-02-12T18:08:23.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.580+0000 7fb162481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.580+0000 7fb162481640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.580+0000 7fb162481640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.580+0000 7fb162481640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.580+0000 7fb162481640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.580+0000 7fb162481640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.580+0000 7fb162481640 10 monclient(hunting): handle_auth_done global_id 5076 payload 824 2026-02-12T18:08:23.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.580+0000 7fb162481640 1 -- 10.20.193.48:0/52281841 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb15c08c000 con 0x7fb15c12a700 2026-02-12T18:08:23.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.582+0000 7fb162481640 1 -- 10.20.193.48:0/52281841 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb15c12a700 msgr2=0x7fb15c12aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:23.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.582+0000 7fb162481640 1 --2- 10.20.193.48:0/52281841 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb15c12a700 0x7fb15c12aad0 secure :-1 s=READY pgs=211 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb14c0023d0 tx=0x7fb14c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:23.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.582+0000 7fb142ffd640 1 -- 10.20.193.48:0/52281841 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb14c003e70 con 0x7fb15c12a700 2026-02-12T18:08:23.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.582+0000 7fb142ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.582+0000 7fb142ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:08:23.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.582+0000 7fb142ffd640 10 monclient: dump: 2026-02-12T18:08:23.606 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.606 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.606 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.606 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.606 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.606 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.606 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.606 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.606 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.606 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.607 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.607 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.607 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.607 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.607 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.607 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.607 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.582+0000 7fb142ffd640 1 -- 10.20.193.48:0/52281841 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10184 (secure 0 0 0) 0x7fb14c035630 con 0x7fb15c12a700 2026-02-12T18:08:23.607 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.582+0000 7fb142ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:08:23.607 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.582+0000 7fb142ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:23.607 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.582+0000 7fb142ffd640 1 -- 10.20.193.48:0/52281841 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb15c12a700 msgr2=0x7fb15c12aad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.607 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.582+0000 7fb142ffd640 1 --2- 10.20.193.48:0/52281841 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb15c12a700 0x7fb15c12aad0 secure :-1 s=READY pgs=211 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb14c0023d0 tx=0x7fb14c004770 comp rx=0 tx=0).stop 2026-02-12T18:08:23.607 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.582+0000 7fb142ffd640 1 -- 10.20.193.48:0/52281841 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb15c12a700 msgr2=0x7fb15c12aad0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:23.607 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.582+0000 7fb142ffd640 1 --2- 10.20.193.48:0/52281841 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb15c12a700 0x7fb15c12aad0 secure :-1 s=CLOSED pgs=211 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb14c0023d0 tx=0x7fb14c004770 comp rx=0 tx=0).stop 2026-02-12T18:08:23.608 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:08:23.608 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:23.608 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:23.608 INFO:teuthology.orchestra.run.trial048.stdout: "state": "leader", 2026-02-12T18:08:23.608 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 28, 2026-02-12T18:08:23.608 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 158417, 2026-02-12T18:08:23.608 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:08:23.608 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:08:23.608 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:08:23.608 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:08:23.608 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:08:23.609 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:08:23.609 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:08:23.609 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:08:23.609 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:08:23.609 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:08:23.609 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:23.609 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:08:23.609 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:23.609 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:08:23.609 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:08:23.609 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:23.609 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:23.609 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:23.609 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:23.609 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:23.610 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:23.610 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:23.610 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:23.610 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:23.610 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:23.610 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:23.610 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:23.610 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:23.610 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:23.610 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:08:23.610 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:08:23.610 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:23.610 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:23.610 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:23.610 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:23.610 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:23.611 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:23.611 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:23.611 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:23.611 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:23.611 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:23.611 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:23.611 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:23.611 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:23.611 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.611 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.611 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:08:23.611 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:08:23.611 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:08:23.611 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:08:23.611 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:08:23.612 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:08:23.612 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:23.612 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:23.612 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:08:23.612 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:08:23.612 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:08:23.612 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:08:23.612 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:08:23.612 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:08:23.612 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:08:23.612 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:23.612 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:08:23.612 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:23.612 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:23.612 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:23.612 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:23.612 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:23.613 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:23.613 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:23.613 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:23.613 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:23.613 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:23.613 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:23.613 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:23.613 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:23.613 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:23.613 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:08:23.613 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.613 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:08:23.613 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.613 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:23.613 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:23.613 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.613 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.613 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.614 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.614 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:08:23.614 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.614 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.614 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.614 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.614 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:08:23.614 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.614 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.614 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.614 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.614 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:08:23.614 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:08:23.614 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.614 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.614 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:08:23.614 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.615 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.615 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.615 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:23.615 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:23.615 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.615 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.615 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.615 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.615 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:08:23.615 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.615 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.615 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.615 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.615 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:08:23.615 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.615 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.615 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.615 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.616 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:08:23.616 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:08:23.616 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.616 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.616 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:08:23.616 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.616 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.616 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.616 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:23.616 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:23.616 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.616 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.616 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.616 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.616 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:08:23.616 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.616 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.617 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.617 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.617 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:08:23.617 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.617 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.617 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.617 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.617 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:08:23.617 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:08:23.617 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.617 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.617 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:08:23.617 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.617 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.617 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.617 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:08:23.617 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:08:23.617 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.618 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.618 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.618 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.618 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:08:23.618 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.618 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.618 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.618 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.618 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:08:23.618 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.618 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.618 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.618 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.618 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:08:23.618 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:08:23.618 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.618 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.618 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:08:23.619 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.619 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.619 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.619 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:08:23.619 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:08:23.619 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.619 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.619 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.619 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.619 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:08:23.619 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.619 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.619 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.619 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.619 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:08:23.619 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.619 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.619 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.619 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.620 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:08:23.620 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:08:23.620 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.620 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.620 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:23.620 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.620 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.620 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.620 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:23.620 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:23.620 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.620 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.620 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.620 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.620 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:08:23.620 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.620 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.620 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.620 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.620 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:08:23.620 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.621 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.621 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.621 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.621 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:08:23.621 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:08:23.621 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.621 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.621 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:08:23.621 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.621 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.621 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.621 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:23.621 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:23.621 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.621 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.621 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.621 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.621 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:08:23.621 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.621 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.621 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.622 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.622 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:08:23.622 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.622 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.622 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.622 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.622 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:08:23.622 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:08:23.622 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.622 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.622 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:23.622 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.622 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.622 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.622 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:23.622 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:23.622 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.622 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.622 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.622 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.623 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:08:23.623 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.623 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.623 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.623 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.623 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:08:23.623 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.623 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.623 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.623 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.623 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:08:23.623 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:08:23.623 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.623 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.623 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:08:23.623 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.623 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.623 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.623 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:08:23.623 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:08:23.623 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.623 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.624 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.624 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.624 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:08:23.624 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.624 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.624 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.624 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.624 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:08:23.624 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.624 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.624 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.624 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.624 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:08:23.624 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:08:23.624 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.624 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.624 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:08:23.624 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.624 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.624 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.624 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.624 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:08:23.625 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:08:23.625 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.625 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:23.625 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:23.625 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:23.625 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.625 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:23.625 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:08:23.625 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.625 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:23.625 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:23.625 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:23.625 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.625 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:23.625 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:08:23.625 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.625 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:23.625 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:23.625 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:08:23.625 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.625 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.625 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.626 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:08:23.626 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:08:23.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.583+0000 7fb16470c640 1 -- 10.20.193.48:0/52281841 >> v2:10.20.193.111:6812/977811348 conn(0x7fb12c03f800 msgr2=0x7fb12c05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.583+0000 7fb16470c640 1 --2- 10.20.193.48:0/52281841 >> v2:10.20.193.111:6812/977811348 conn(0x7fb12c03f800 0x7fb12c05fcb0 secure :-1 s=READY pgs=167 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb158004850 tx=0x7fb15800a040 comp rx=0 tx=0).stop 2026-02-12T18:08:23.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.583+0000 7fb16470c640 10 monclient: shutdown 2026-02-12T18:08:23.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.583+0000 7fb16470c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:23.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.583+0000 7fb16470c640 1 -- 10.20.193.48:0/52281841 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb15c05d260 msgr2=0x7fb15c13db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.583+0000 7fb162c82640 1 -- 10.20.193.48:0/52281841 reap_dead start 2026-02-12T18:08:23.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.583+0000 7fb16470c640 1 --2- 10.20.193.48:0/52281841 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb15c05d260 0x7fb15c13db70 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb15000c520 tx=0x7fb15000c9f0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.583+0000 7fb16470c640 1 -- 10.20.193.48:0/52281841 shutdown_connections 2026-02-12T18:08:23.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.583+0000 7fb16470c640 1 --2- 10.20.193.48:0/52281841 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb15c05d260 0x7fb15c13db70 unknown :-1 s=CLOSED pgs=209 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.583+0000 7fb16470c640 1 -- 10.20.193.48:0/52281841 >> 10.20.193.48:0/52281841 conn(0x7fb15c0548a0 msgr2=0x7fb15c093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:23.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.583+0000 7fb16470c640 1 -- 10.20.193.48:0/52281841 shutdown_connections 2026-02-12T18:08:23.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.583+0000 7fb16470c640 1 -- 10.20.193.48:0/52281841 wait complete. 2026-02-12T18:08:23.627 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:08:23.627 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2026-02-12T18:08:23.628 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T18:08:23.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cde50c640 10 monclient: get_monmap_and_config 2026-02-12T18:08:23.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cde50c640 10 monclient: build_initial_monmap 2026-02-12T18:08:23.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cde50c640 10 monclient: monmap: 2026-02-12T18:08:23.694 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:23.694 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.694 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:23.694100+0000 2026-02-12T18:08:23.694 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:23.694100+0000 2026-02-12T18:08:23.694 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:23.694 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.694 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:23.694 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:23.694 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:23.694 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:23.694 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:23.694 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:23.694 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:23.694 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:23.694 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:23.694 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:23.694 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:23.694 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cde50c640 1 Processor -- start 2026-02-12T18:08:23.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cde50c640 1 -- start start 2026-02-12T18:08:23.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cde50c640 10 monclient: init 2026-02-12T18:08:23.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cde50c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:23.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cde50c640 10 monclient: _add_conns ranks=[7,4,2,0,3,9,1,8,10,6,5] 2026-02-12T18:08:23.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cde50c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f9cd805d550 0x7f9cd805d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cde50c640 10 monclient(hunting): picked mon.noname-i con 0x7f9cd805d550 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:23.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cde50c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9cd805de60 0x7f9cd8141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cde50c640 10 monclient(hunting): picked mon.noname-c con 0x7f9cd805de60 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:08:23.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cde50c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd813ef60 0x7f9cd81424e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cde50c640 10 monclient(hunting): picked mon.noname-b con 0x7f9cd813ef60 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cde50c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cde50c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd808d390 con 0x7f9cd813ef60 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cde50c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cde50c640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f9cd808d5a0 con 0x7f9cd805de60 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cde50c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cde50c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f9cd80580e0 con 0x7f9cd805d550 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cde50c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cde50c640 10 monclient(hunting): authenticate will time out at 742.419774s 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cd77fe640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9cd805de60 0x7f9cd8141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cdca82640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd813ef60 0x7f9cd81424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cd77fe640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9cd805de60 0x7f9cd8141fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:54758/0 (socket says 10.20.193.48:54758) 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cd77fe640 1 -- 10.20.193.48:0/291426209 learned_addr learned my addr 10.20.193.48:0/291426209 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cd77fe640 10 monclient(hunting): get_auth_request con 0x7f9cd805de60 auth_method 0 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cd77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cd77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cd77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cdca82640 10 monclient(hunting): get_auth_request con 0x7f9cd813ef60 auth_method 0 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cdca82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cdca82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cdca82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cd7fff640 1 --2- 10.20.193.48:0/291426209 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f9cd805d550 0x7f9cd805d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cd7fff640 10 monclient(hunting): get_auth_request con 0x7f9cd805d550 auth_method 0 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cd7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.693+0000 7f9cd7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.694+0000 7f9cd7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.694+0000 7f9cdca82640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.694+0000 7f9cdca82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.694+0000 7f9cdca82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.694+0000 7f9cd77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.694+0000 7f9cd77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.694+0000 7f9cd77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.694+0000 7f9cd7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.694+0000 7f9cd7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.694+0000 7f9cd7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.694+0000 7f9cdca82640 10 monclient(hunting): handle_auth_done global_id 34922 payload 274 2026-02-12T18:08:23.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.694+0000 7f9cdca82640 1 -- 10.20.193.48:0/291426209 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f9cd805d550 msgr2=0x7f9cd805d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:23.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.694+0000 7f9cdca82640 1 --2- 10.20.193.48:0/291426209 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f9cd805d550 0x7f9cd805d920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.694+0000 7f9cdca82640 1 -- 10.20.193.48:0/291426209 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9cd805de60 msgr2=0x7f9cd8141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:23.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.694+0000 7f9cdca82640 1 --2- 10.20.193.48:0/291426209 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9cd805de60 0x7f9cd8141fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.694+0000 7f9cdca82640 10 monclient: _finish_hunting 0 2026-02-12T18:08:23.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.694+0000 7f9cdca82640 1 monclient: found mon.noname-b 2026-02-12T18:08:23.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.694+0000 7f9cdca82640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:23.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.694+0000 7f9cdca82640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:08:23.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.694+0000 7f9cdca82640 1 -- 10.20.193.48:0/291426209 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd804dc20 con 0x7f9cd813ef60 2026-02-12T18:08:23.698 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.694+0000 7f9cd77fe640 1 --2- 10.20.193.48:0/291426209 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9cd805de60 0x7f9cd8141fa0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:08:23.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.696+0000 7f9cdca82640 1 -- 10.20.193.48:0/291426209 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd813ef60 msgr2=0x7f9cd81424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:23.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.696+0000 7f9cdca82640 1 --2- 10.20.193.48:0/291426209 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd813ef60 0x7f9cd81424e0 secure :-1 s=READY pgs=98 gs=2 cs=0 l=1 c_cookie=3385955932800791821 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ccc00a8e0 tx=0x7f9ccc02fe20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2efd54fb37b7b50d server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:23.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.696+0000 7f9cd6ffd640 1 -- 10.20.193.48:0/291426209 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9ccc036340 con 0x7f9cd813ef60 2026-02-12T18:08:23.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.696+0000 7f9cd6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.696+0000 7f9cd6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:08:23.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.696+0000 7f9cd6ffd640 10 monclient: dump: 2026-02-12T18:08:23.701 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.701 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.701 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.701 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.701 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.701 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.701 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.701 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.701 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.701 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.701 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.701 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.701 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.701 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.701 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.701 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.696+0000 7f9cd6ffd640 10 monclient: _finish_auth 0 2026-02-12T18:08:23.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.696+0000 7f9cd6ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:08:23.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.696+0000 7f9cd6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.696+0000 7f9cd6ffd640 1 -- 10.20.193.48:0/291426209 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ccc0364c0 con 0x7f9cd813ef60 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.696+0000 7f9cd6ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.696+0000 7f9cde50c640 5 monclient: authenticate success, global_id 34922 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.696+0000 7f9cd6ffd640 1 -- 10.20.193.48:0/291426209 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9ccc036af0 con 0x7f9cd813ef60 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.696+0000 7f9cde50c640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.696+0000 7f9cde50c640 4 set_mon_vals no callback set 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.696+0000 7f9cd6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.696+0000 7f9cd6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.696+0000 7f9cd6ffd640 10 monclient: dump: 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.697+0000 7f9cde50c640 10 monclient: shutdown 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.697+0000 7f9cde50c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:23.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.697+0000 7f9cde50c640 1 -- 10.20.193.48:0/291426209 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd813ef60 msgr2=0x7f9cd81424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.697+0000 7f9cde50c640 1 --2- 10.20.193.48:0/291426209 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd813ef60 0x7f9cd81424e0 secure :-1 s=READY pgs=98 gs=2 cs=0 l=1 c_cookie=3385955932800791821 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ccc00a8e0 tx=0x7f9ccc02fe20 comp rx=0 tx=0).stop 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.697+0000 7f9cde50c640 1 -- 10.20.193.48:0/291426209 shutdown_connections 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.697+0000 7f9cde50c640 1 --2- 10.20.193.48:0/291426209 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd813ef60 0x7f9cd81424e0 unknown :-1 s=CLOSED pgs=98 gs=2 cs=0 l=1 c_cookie=3385955932800791821 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.697+0000 7f9cde50c640 1 --2- 10.20.193.48:0/291426209 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9cd805de60 0x7f9cd8141fa0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.697+0000 7f9cde50c640 1 --2- 10.20.193.48:0/291426209 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f9cd805d550 0x7f9cd805d920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.697+0000 7f9cde50c640 1 -- 10.20.193.48:0/291426209 >> 10.20.193.48:0/291426209 conn(0x7f9cd80546a0 msgr2=0x7f9cd8054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.697+0000 7f9cde50c640 1 -- 10.20.193.48:0/291426209 shutdown_connections 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.697+0000 7f9cde50c640 1 -- 10.20.193.48:0/291426209 wait complete. 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.697+0000 7f9cde50c640 10 monclient: build_initial_monmap 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.697+0000 7f9cde50c640 10 monclient: monmap: 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cde50c640 1 Processor -- start 2026-02-12T18:08:23.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cde50c640 1 -- start start 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cde50c640 10 monclient: init 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cde50c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cde50c640 10 monclient: _add_conns ranks=[2,7,4,8,1,6,3,0,5] 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cde50c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd805d550 0x7f9cd812fb40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cde50c640 10 monclient(hunting): picked mon.noname-b con 0x7f9cd805d550 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cde50c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f9cd805de60 0x7f9cd8109760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cde50c640 10 monclient(hunting): picked mon.noname-i con 0x7f9cd805de60 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cde50c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9cd813ef60 0x7f9cd8109ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cde50c640 10 monclient(hunting): picked mon.noname-c con 0x7f9cd813ef60 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cde50c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cde50c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd810d090 con 0x7f9cd805d550 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cde50c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cde50c640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f9cd8120590 con 0x7f9cd813ef60 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cde50c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cde50c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f9cd81208b0 con 0x7f9cd805de60 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cde50c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cde50c640 10 monclient(hunting): authenticate will time out at 742.424385s 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cd7fff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd805d550 0x7f9cd812fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cdca82640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9cd813ef60 0x7f9cd8109ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cd7fff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd805d550 0x7f9cd812fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:41906/0 (socket says 10.20.193.48:41906) 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cd7fff640 1 -- 10.20.193.48:0/2604676427 learned_addr learned my addr 10.20.193.48:0/2604676427 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cd7fff640 10 monclient(hunting): get_auth_request con 0x7f9cd805d550 auth_method 0 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cd7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cd7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cd7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cdca82640 10 monclient(hunting): get_auth_request con 0x7f9cd813ef60 auth_method 0 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cdca82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cdca82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cdca82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cdca82640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cdca82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cdca82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cd7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cd7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cd7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cd77fe640 1 --2- 10.20.193.48:0/2604676427 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f9cd805de60 0x7f9cd8109760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cd77fe640 10 monclient(hunting): get_auth_request con 0x7f9cd805de60 auth_method 0 2026-02-12T18:08:23.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cd77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cd77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cd77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cdca82640 10 monclient(hunting): handle_auth_done global_id 44113 payload 824 2026-02-12T18:08:23.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cdca82640 1 -- 10.20.193.48:0/2604676427 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f9cd805de60 msgr2=0x7f9cd8109760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cdca82640 1 --2- 10.20.193.48:0/2604676427 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f9cd805de60 0x7f9cd8109760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cdca82640 1 -- 10.20.193.48:0/2604676427 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd805d550 msgr2=0x7f9cd812fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cdca82640 1 --2- 10.20.193.48:0/2604676427 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd805d550 0x7f9cd812fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cdca82640 10 monclient: _finish_hunting 0 2026-02-12T18:08:23.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cdca82640 1 monclient: found mon.noname-c 2026-02-12T18:08:23.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cdca82640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:23.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cdca82640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:08:23.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cdca82640 1 -- 10.20.193.48:0/2604676427 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cc80094f0 con 0x7f9cd813ef60 2026-02-12T18:08:23.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.698+0000 7f9cd7fff640 1 --2- 10.20.193.48:0/2604676427 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd805d550 0x7f9cd812fb40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:08:23.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.700+0000 7f9cdca82640 1 -- 10.20.193.48:0/2604676427 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9cd813ef60 msgr2=0x7f9cd8109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:23.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.700+0000 7f9cdca82640 1 --2- 10.20.193.48:0/2604676427 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9cd813ef60 0x7f9cd8109ca0 secure :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cd8090780 tx=0x7f9ccc005850 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:23.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.700+0000 7f9cd4ff9640 1 -- 10.20.193.48:0/2604676427 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9ccc036d80 con 0x7f9cd813ef60 2026-02-12T18:08:23.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.700+0000 7f9cd4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.700+0000 7f9cd4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:08:23.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.700+0000 7f9cd4ff9640 10 monclient: dump: 2026-02-12T18:08:23.707 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.707 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.707 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.707 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.707 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.707 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.707 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.707 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.707 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.707 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.707 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.707 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cd4ff9640 10 monclient: _finish_auth 0 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cd4ff9640 10 monclient: _check_auth_tickets 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cd4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cd4ff9640 1 -- 10.20.193.48:0/2604676427 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ccc038900 con 0x7f9cd813ef60 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cd4ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cd4ff9640 1 -- 10.20.193.48:0/2604676427 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9ccc041410 con 0x7f9cd813ef60 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cd4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cd4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cd67fc640 4 set_mon_vals no callback set 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cd4ff9640 10 monclient: dump: 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.708 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.709 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.709 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.709 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cde50c640 5 monclient: authenticate success, global_id 44113 2026-02-12T18:08:23.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cde50c640 10 monclient: _renew_subs 2026-02-12T18:08:23.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cde50c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:08:23.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cde50c640 1 -- 10.20.193.48:0/2604676427 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ccc00a500 con 0x7f9cd813ef60 2026-02-12T18:08:23.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cde50c640 10 monclient: _renew_subs 2026-02-12T18:08:23.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cde50c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:08:23.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cde50c640 1 -- 10.20.193.48:0/2604676427 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cd810cad0 con 0x7f9cd813ef60 2026-02-12T18:08:23.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cde50c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:23.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cde50c640 1 --2- 10.20.193.48:0/2604676427 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd8091010 0x7f9cd810a1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cde50c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cde50c640 1 -- 10.20.193.48:0/2604676427 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd805f140 con 0x7f9cd8091010 2026-02-12T18:08:23.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cd4ff9640 1 -- 10.20.193.48:0/2604676427 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f9ccc050020 con 0x7f9cd813ef60 2026-02-12T18:08:23.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cd7fff640 1 --2- 10.20.193.48:0/2604676427 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd8091010 0x7f9cd810a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cd7fff640 10 monclient: get_auth_request con 0x7f9cd8091010 auth_method 0 2026-02-12T18:08:23.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cd7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cd7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cd7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cd7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cd7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cd7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cd4ff9640 1 --2- 10.20.193.48:0/2604676427 >> v2:10.20.193.111:6812/977811348 conn(0x7f9ca803f800 0x7f9ca805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cd4ff9640 1 -- 10.20.193.48:0/2604676427 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(114..114 src has 1..114) ==== 3897+0+0 (secure 0 0 0) 0x7f9ccc078b50 con 0x7f9cd813ef60 2026-02-12T18:08:23.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cd7fff640 10 monclient(hunting): handle_auth_done global_id 34940 payload 824 2026-02-12T18:08:23.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.701+0000 7f9cd7fff640 1 -- 10.20.193.48:0/2604676427 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9cd808d060 con 0x7f9cd8091010 2026-02-12T18:08:23.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.702+0000 7f9cd77fe640 1 --2- 10.20.193.48:0/2604676427 >> v2:10.20.193.111:6812/977811348 conn(0x7f9ca803f800 0x7f9ca805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.702+0000 7f9cd77fe640 10 monclient: get_auth_request con 0x7f9ca803f800 auth_method 0 2026-02-12T18:08:23.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.704+0000 7f9cd7fff640 1 -- 10.20.193.48:0/2604676427 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd8091010 msgr2=0x7f9cd810a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:23.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.704+0000 7f9cd7fff640 1 --2- 10.20.193.48:0/2604676427 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd8091010 0x7f9cd810a1e0 secure :-1 s=READY pgs=99 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cc4006b40 tx=0x7f9cc400f610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:23.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.704+0000 7f9cd4ff9640 1 -- 10.20.193.48:0/2604676427 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9cc400fe50 con 0x7f9cd8091010 2026-02-12T18:08:23.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.704+0000 7f9cd4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.704+0000 7f9cd4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:08:23.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.704+0000 7f9cd4ff9640 10 monclient: dump: 2026-02-12T18:08:23.711 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.711 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.711 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.711 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.711 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.711 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.711 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.711 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.711 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.711 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.711 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.711 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.711 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.712 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.712 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.712 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.704+0000 7f9cd77fe640 1 --2- 10.20.193.48:0/2604676427 >> v2:10.20.193.111:6812/977811348 conn(0x7f9ca803f800 0x7f9ca805fcb0 secure :-1 s=READY pgs=168 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cd810c550 tx=0x7f9cc8008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:23.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.704+0000 7f9cd4ff9640 1 -- 10.20.193.48:0/2604676427 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f9cc4014860 con 0x7f9cd8091010 2026-02-12T18:08:23.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.704+0000 7f9cd4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:23.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.704+0000 7f9cd4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:23.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.704+0000 7f9cd4ff9640 1 -- 10.20.193.48:0/2604676427 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd8091010 msgr2=0x7f9cd810a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.704+0000 7f9cd4ff9640 1 --2- 10.20.193.48:0/2604676427 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd8091010 0x7f9cd810a1e0 secure :-1 s=READY pgs=99 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cc4006b40 tx=0x7f9cc400f610 comp rx=0 tx=0).stop 2026-02-12T18:08:23.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.704+0000 7f9cd4ff9640 1 -- 10.20.193.48:0/2604676427 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd8091010 msgr2=0x7f9cd810a1e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:23.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.704+0000 7f9cd4ff9640 1 --2- 10.20.193.48:0/2604676427 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd8091010 0x7f9cd810a1e0 secure :-1 s=CLOSED pgs=99 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cc4006b40 tx=0x7f9cc400f610 comp rx=0 tx=0).stop 2026-02-12T18:08:23.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.708+0000 7f9cde50c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:08:23.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.708+0000 7f9cde50c640 1 --2- 10.20.193.48:0/2604676427 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd810a720 0x7f9cd80589e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.708+0000 7f9cde50c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.708+0000 7f9cde50c640 1 -- 10.20.193.48:0/2604676427 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f9cd805fd90 con 0x7f9cd810a720 2026-02-12T18:08:23.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.708+0000 7f9cd7fff640 1 --2- 10.20.193.48:0/2604676427 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd810a720 0x7f9cd80589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.708+0000 7f9cd7fff640 10 monclient: get_auth_request con 0x7f9cd810a720 auth_method 0 2026-02-12T18:08:23.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.708+0000 7f9cd7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.708+0000 7f9cd7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.708+0000 7f9cd7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.708+0000 7f9cd7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.708+0000 7f9cd7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.708+0000 7f9cd7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.708+0000 7f9cd7fff640 10 monclient(hunting): handle_auth_done global_id 34949 payload 824 2026-02-12T18:08:23.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.708+0000 7f9cd7fff640 1 -- 10.20.193.48:0/2604676427 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9cd805e310 con 0x7f9cd810a720 2026-02-12T18:08:23.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.710+0000 7f9cd7fff640 1 -- 10.20.193.48:0/2604676427 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd810a720 msgr2=0x7f9cd80589e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:23.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.710+0000 7f9cd7fff640 1 --2- 10.20.193.48:0/2604676427 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd810a720 0x7f9cd80589e0 secure :-1 s=READY pgs=100 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cc4019000 tx=0x7f9cc4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:23.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.710+0000 7f9cd4ff9640 1 -- 10.20.193.48:0/2604676427 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9cc40034f0 con 0x7f9cd810a720 2026-02-12T18:08:23.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.710+0000 7f9cd4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.710+0000 7f9cd4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:08:23.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.710+0000 7f9cd4ff9640 10 monclient: dump: 2026-02-12T18:08:23.715 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.715 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.715 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.716 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.716 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.716 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.716 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.716 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.716 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.716 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.716 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.716 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.716 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.716 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.716 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.716 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.711+0000 7f9cd4ff9640 1 -- 10.20.193.48:0/2604676427 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10182 (secure 0 0 0) 0x7f9cc40225b0 con 0x7f9cd810a720 2026-02-12T18:08:23.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.711+0000 7f9cd4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:08:23.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.711+0000 7f9cd4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:23.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.711+0000 7f9cd4ff9640 1 -- 10.20.193.48:0/2604676427 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd810a720 msgr2=0x7f9cd80589e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.711+0000 7f9cd4ff9640 1 --2- 10.20.193.48:0/2604676427 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd810a720 0x7f9cd80589e0 secure :-1 s=READY pgs=100 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cc4019000 tx=0x7f9cc4004770 comp rx=0 tx=0).stop 2026-02-12T18:08:23.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.711+0000 7f9cd4ff9640 1 -- 10.20.193.48:0/2604676427 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd810a720 msgr2=0x7f9cd80589e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:23.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.711+0000 7f9cd4ff9640 1 --2- 10.20.193.48:0/2604676427 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9cd810a720 0x7f9cd80589e0 secure :-1 s=CLOSED pgs=100 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cc4019000 tx=0x7f9cc4004770 comp rx=0 tx=0).stop 2026-02-12T18:08:23.717 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:08:23.717 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:23.717 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:23.717 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:08:23.717 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 28, 2026-02-12T18:08:23.717 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 158544, 2026-02-12T18:08:23.717 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:08:23.717 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:08:23.718 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:08:23.718 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:08:23.718 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:08:23.718 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:08:23.718 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:08:23.718 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:08:23.718 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:08:23.718 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:08:23.718 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:23.718 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:08:23.718 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:23.718 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:08:23.718 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:08:23.718 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:23.718 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:23.718 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:23.718 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:23.719 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:23.719 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:23.719 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:23.719 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:23.719 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:23.719 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:23.719 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:23.719 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:23.719 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:23.719 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:23.719 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:08:23.719 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:08:23.719 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:23.719 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:23.719 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:23.719 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:23.719 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:23.719 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:23.719 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:23.720 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:23.720 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:23.720 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:23.720 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:23.720 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:23.720 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:23.720 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.720 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.720 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:08:23.720 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:08:23.720 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:08:23.720 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:08:23.720 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:08:23.720 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:08:23.720 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:23.720 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:23.720 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:08:23.720 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:08:23.721 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:08:23.721 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:08:23.721 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:08:23.721 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:08:23.721 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:08:23.721 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:23.721 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:08:23.721 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:23.721 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:23.721 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:23.721 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:23.721 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:23.721 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:23.721 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:23.721 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:23.721 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:23.721 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:23.721 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:23.721 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:23.722 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:23.722 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:23.722 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:08:23.722 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.722 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:08:23.722 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.722 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:23.722 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:23.722 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.722 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.722 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.722 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.722 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:08:23.722 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.722 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.722 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.722 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.722 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:08:23.722 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.722 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.722 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.723 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.723 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:08:23.723 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:08:23.723 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.723 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.723 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:08:23.723 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.723 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.723 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.723 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:23.723 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:23.723 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.723 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.723 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.723 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.723 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:08:23.723 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.723 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.723 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.723 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.723 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:08:23.724 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.724 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.724 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.724 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.724 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:08:23.724 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:08:23.724 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.724 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.724 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:08:23.724 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.724 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.724 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.724 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:23.724 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:23.724 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.724 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.724 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.724 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.724 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:08:23.724 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.724 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.725 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.725 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.725 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:08:23.725 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.725 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.725 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.725 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.725 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:08:23.725 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:08:23.725 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.725 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.725 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:08:23.725 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.725 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.725 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.725 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:08:23.725 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:08:23.725 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.725 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.725 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.725 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.726 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:08:23.726 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.726 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.726 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.726 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.726 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:08:23.726 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.726 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.726 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.726 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.726 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:08:23.726 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:08:23.726 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.726 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.726 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:08:23.726 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.726 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.726 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.726 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:08:23.726 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:08:23.726 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.726 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.726 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.727 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.727 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:08:23.727 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.727 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.727 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.727 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.727 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:08:23.727 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.727 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.727 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.727 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.727 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:08:23.727 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:08:23.727 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.727 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.727 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:23.727 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.727 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.727 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.727 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:23.727 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:23.727 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.727 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.728 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.728 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.728 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:08:23.728 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.728 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.728 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.728 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.728 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:08:23.728 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.728 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.728 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.728 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.728 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:08:23.728 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:08:23.728 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.728 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.728 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:08:23.728 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.728 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.728 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.728 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:23.728 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:23.729 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.729 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.729 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.729 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.729 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:08:23.729 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.729 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.729 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.729 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.729 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:08:23.729 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.729 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.729 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.729 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.729 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:08:23.729 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:08:23.729 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.729 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.729 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:23.729 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.729 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.729 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.729 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:23.729 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:23.730 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.730 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.730 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.730 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.730 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:08:23.730 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.730 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.730 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.730 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.730 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:08:23.730 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.730 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.730 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.730 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.730 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:08:23.730 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:08:23.730 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.730 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.730 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:08:23.730 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.730 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.730 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.730 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:08:23.731 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:08:23.731 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.731 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.731 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.731 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.731 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:08:23.731 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.731 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.731 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.731 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.731 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:08:23.731 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.731 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.731 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.731 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.731 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:08:23.731 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:08:23.731 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.731 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.731 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:08:23.731 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.731 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.731 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.731 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.731 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:08:23.732 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:08:23.732 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.732 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:23.732 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:23.732 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:23.732 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.732 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:23.732 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:08:23.732 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.732 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:23.732 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:23.732 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:23.732 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.732 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:23.732 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:08:23.732 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.732 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:23.732 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:23.732 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:23.732 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.732 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.732 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.732 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:08:23.732 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:08:23.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.711+0000 7f9cde50c640 1 -- 10.20.193.48:0/2604676427 >> v2:10.20.193.111:6812/977811348 conn(0x7f9ca803f800 msgr2=0x7f9ca805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.711+0000 7f9cde50c640 1 --2- 10.20.193.48:0/2604676427 >> v2:10.20.193.111:6812/977811348 conn(0x7f9ca803f800 0x7f9ca805fcb0 secure :-1 s=READY pgs=168 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cd810c550 tx=0x7f9cc8008040 comp rx=0 tx=0).stop 2026-02-12T18:08:23.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.711+0000 7f9cde50c640 10 monclient: shutdown 2026-02-12T18:08:23.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.711+0000 7f9cde50c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:23.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.711+0000 7f9cde50c640 1 -- 10.20.193.48:0/2604676427 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9cd813ef60 msgr2=0x7f9cd8109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.711+0000 7f9cde50c640 1 --2- 10.20.193.48:0/2604676427 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9cd813ef60 0x7f9cd8109ca0 secure :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cd8090780 tx=0x7f9ccc005850 comp rx=0 tx=0).stop 2026-02-12T18:08:23.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.711+0000 7f9cdca82640 1 -- 10.20.193.48:0/2604676427 reap_dead start 2026-02-12T18:08:23.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.711+0000 7f9cde50c640 1 -- 10.20.193.48:0/2604676427 shutdown_connections 2026-02-12T18:08:23.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.711+0000 7f9cde50c640 1 --2- 10.20.193.48:0/2604676427 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9cd813ef60 0x7f9cd8109ca0 unknown :-1 s=CLOSED pgs=15 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.711+0000 7f9cde50c640 1 -- 10.20.193.48:0/2604676427 >> 10.20.193.48:0/2604676427 conn(0x7f9cd80546a0 msgr2=0x7f9cd813c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:23.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.711+0000 7f9cde50c640 1 -- 10.20.193.48:0/2604676427 shutdown_connections 2026-02-12T18:08:23.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.711+0000 7f9cde50c640 1 -- 10.20.193.48:0/2604676427 wait complete. 2026-02-12T18:08:23.734 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:08:23.734 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2026-02-12T18:08:23.734 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T18:08:23.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.800+0000 7f949f194640 10 monclient: get_monmap_and_config 2026-02-12T18:08:23.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.800+0000 7f949f194640 10 monclient: build_initial_monmap 2026-02-12T18:08:23.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949f194640 10 monclient: monmap: 2026-02-12T18:08:23.802 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:23.802 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.802 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:23.802067+0000 2026-02-12T18:08:23.802 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:23.802067+0000 2026-02-12T18:08:23.802 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:23.802 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.802 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:23.802 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:23.802 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:23.802 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:23.803 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:23.803 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:23.803 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:23.803 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:23.803 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:23.803 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:23.803 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:23.803 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949f194640 1 Processor -- start 2026-02-12T18:08:23.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949f194640 1 -- start start 2026-02-12T18:08:23.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949f194640 10 monclient: init 2026-02-12T18:08:23.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949f194640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:23.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949f194640 10 monclient: _add_conns ranks=[9,1,2,4,10,0,8,5,3,6,7] 2026-02-12T18:08:23.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949f194640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f949805c950 0x7f949805cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949f194640 10 monclient(hunting): picked mon.noname-a con 0x7f949805c950 addr v2:10.20.193.48:3300/0 2026-02-12T18:08:23.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949f194640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f949805e490 addr v1:10.20.193.111:6789/0 2026-02-12T18:08:23.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949f194640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f949805d260 0x7f949813e280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949f194640 10 monclient(hunting): picked mon.noname-b con 0x7f949805d260 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:08:23.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949f194640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f949804dc20 con 0x7f949805e490 2026-02-12T18:08:23.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949f194640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949f194640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f949805ddd0 con 0x7f949805c950 2026-02-12T18:08:23.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949f194640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949f194640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f9498092990 con 0x7f949805d260 2026-02-12T18:08:23.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949f194640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:23.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949f194640 10 monclient(hunting): authenticate will time out at 742.527824s 2026-02-12T18:08:23.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949cf09640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f949805c950 0x7f949805cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949d70a640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f949805d260 0x7f949813e280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949cf09640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f949805c950 0x7f949805cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:43946/0 (socket says 10.20.193.48:43946) 2026-02-12T18:08:23.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949cf09640 1 -- 10.20.193.48:0/1625190911 learned_addr learned my addr 10.20.193.48:0/1625190911 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:23.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949d70a640 10 monclient(hunting): get_auth_request con 0x7f949805d260 auth_method 0 2026-02-12T18:08:23.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949d70a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949d70a640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949d70a640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949cf09640 10 monclient(hunting): get_auth_request con 0x7f949805c950 auth_method 0 2026-02-12T18:08:23.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949cf09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949cf09640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.801+0000 7f949cf09640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.802+0000 7f949cf09640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.802+0000 7f949cf09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.802+0000 7f949cf09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.802+0000 7f949d70a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.802+0000 7f949d70a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.802+0000 7f949d70a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.802+0000 7f949d70a640 10 monclient(hunting): handle_auth_done global_id 34958 payload 274 2026-02-12T18:08:23.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.802+0000 7f949d70a640 1 -- 10.20.193.48:0/1625190911 >> v2:10.20.193.48:3300/0 conn(0x7f949805c950 msgr2=0x7f949805cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:23.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.802+0000 7f949d70a640 1 --2- 10.20.193.48:0/1625190911 >> v2:10.20.193.48:3300/0 conn(0x7f949805c950 0x7f949805cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.802+0000 7f949d70a640 1 -- 10.20.193.48:0/1625190911 >> v1:10.20.193.111:6789/0 conn(0x7f949805e490 legacy=0x7f949813db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:23.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.802+0000 7f949d70a640 10 monclient: _finish_hunting 0 2026-02-12T18:08:23.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.802+0000 7f949d70a640 1 monclient: found mon.noname-b 2026-02-12T18:08:23.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.802+0000 7f949d70a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:23.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.802+0000 7f949d70a640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:08:23.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.802+0000 7f949d70a640 1 -- 10.20.193.48:0/1625190911 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9498092c70 con 0x7f949805d260 2026-02-12T18:08:23.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.802+0000 7f949cf09640 1 --2- 10.20.193.48:0/1625190911 >> v2:10.20.193.48:3300/0 conn(0x7f949805c950 0x7f949805cd20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:08:23.811 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.804+0000 7f949d70a640 1 -- 10.20.193.48:0/1625190911 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f949805d260 msgr2=0x7f949813e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:23.811 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.804+0000 7f949d70a640 1 --2- 10.20.193.48:0/1625190911 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f949805d260 0x7f949813e280 secure :-1 s=READY pgs=101 gs=3 cs=0 l=1 c_cookie=16042449665363684730 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9494005820 tx=0x7f949402fdf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dea23af95f162d7a server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:23.811 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.804+0000 7f948f7fe640 1 -- 10.20.193.48:0/1625190911 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9494036340 con 0x7f949805d260 2026-02-12T18:08:23.811 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.804+0000 7f948f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.811 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.804+0000 7f948f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:08:23.811 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.804+0000 7f948f7fe640 10 monclient: dump: 2026-02-12T18:08:23.811 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.812 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.812 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.812 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.812 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.812 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.812 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.812 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.812 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.812 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.812 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.812 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.812 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.812 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.812 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.812 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.812 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.804+0000 7f948f7fe640 10 monclient: _finish_auth 0 2026-02-12T18:08:23.812 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.804+0000 7f948f7fe640 10 monclient: _check_auth_tickets 2026-02-12T18:08:23.812 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.804+0000 7f948f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:23.812 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.804+0000 7f949f194640 5 monclient: authenticate success, global_id 34958 2026-02-12T18:08:23.812 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.804+0000 7f948f7fe640 1 -- 10.20.193.48:0/1625190911 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94940364c0 con 0x7f949805d260 2026-02-12T18:08:23.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.804+0000 7f949f194640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:08:23.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.804+0000 7f948f7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:23.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.804+0000 7f948f7fe640 1 -- 10.20.193.48:0/1625190911 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9494036af0 con 0x7f949805d260 2026-02-12T18:08:23.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.804+0000 7f949f194640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:23.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.804+0000 7f949f194640 4 set_mon_vals no callback set 2026-02-12T18:08:23.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.804+0000 7f948f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.804+0000 7f948f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:08:23.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.804+0000 7f948f7fe640 10 monclient: dump: 2026-02-12T18:08:23.813 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.813 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.813 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.813 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.813 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.813 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.813 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.813 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.813 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.813 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.813 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.813 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.814 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.814 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.814 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.814 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.805+0000 7f949f194640 10 monclient: shutdown 2026-02-12T18:08:23.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.805+0000 7f949f194640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:23.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.805+0000 7f949f194640 1 -- 10.20.193.48:0/1625190911 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f949805d260 msgr2=0x7f949813e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.805+0000 7f949f194640 1 --2- 10.20.193.48:0/1625190911 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f949805d260 0x7f949813e280 secure :-1 s=READY pgs=101 gs=3 cs=0 l=1 c_cookie=16042449665363684730 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9494005820 tx=0x7f949402fdf0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.805+0000 7f949f194640 1 -- 10.20.193.48:0/1625190911 shutdown_connections 2026-02-12T18:08:23.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.805+0000 7f949f194640 1 --2- 10.20.193.48:0/1625190911 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f949805d260 0x7f949813e280 unknown :-1 s=CLOSED pgs=101 gs=3 cs=0 l=1 c_cookie=16042449665363684730 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.805+0000 7f949f194640 1 --2- 10.20.193.48:0/1625190911 >> v2:10.20.193.48:3300/0 conn(0x7f949805c950 0x7f949805cd20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.805+0000 7f949f194640 1 -- 10.20.193.48:0/1625190911 >> 10.20.193.48:0/1625190911 conn(0x7f94980548a0 msgr2=0x7f9498097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:23.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.805+0000 7f949f194640 1 -- 10.20.193.48:0/1625190911 shutdown_connections 2026-02-12T18:08:23.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.805+0000 7f949f194640 1 -- 10.20.193.48:0/1625190911 wait complete. 2026-02-12T18:08:23.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.805+0000 7f949f194640 10 monclient: build_initial_monmap 2026-02-12T18:08:23.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.805+0000 7f949f194640 10 monclient: monmap: 2026-02-12T18:08:23.814 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:23.814 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:23.814 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:23.814 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:23.815 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:23.815 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.815 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:23.815 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:23.815 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:23.815 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:23.815 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:23.815 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:23.815 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:23.815 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:23.815 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:23.815 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.805+0000 7f949f194640 1 Processor -- start 2026-02-12T18:08:23.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.805+0000 7f949f194640 1 -- start start 2026-02-12T18:08:23.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.805+0000 7f949f194640 10 monclient: init 2026-02-12T18:08:23.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949f194640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:23.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949f194640 10 monclient: _add_conns ranks=[4,1,7,6,3,0,8,2,5] 2026-02-12T18:08:23.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949f194640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f949805c950 0x7f949813dfe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949f194640 10 monclient(hunting): picked mon.noname-c con 0x7f949805c950 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:08:23.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949f194640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f949805d260 0x7f949813e520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949f194640 10 monclient(hunting): picked mon.noname-f con 0x7f949805d260 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:08:23.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949f194640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f949805e490 0x7f949812d8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949f194640 10 monclient(hunting): picked mon.noname-i con 0x7f949805e490 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:23.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949f194640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949f194640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9498141ae0 con 0x7f949805d260 2026-02-12T18:08:23.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949f194640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949f194640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f9498143090 con 0x7f949805c950 2026-02-12T18:08:23.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949f194640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949f194640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f949811dfd0 con 0x7f949805e490 2026-02-12T18:08:23.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949f194640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:23.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949f194640 10 monclient(hunting): authenticate will time out at 742.532242s 2026-02-12T18:08:23.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949cf09640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f949805c950 0x7f949813dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949cf09640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f949805c950 0x7f949813dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:54784/0 (socket says 10.20.193.48:54784) 2026-02-12T18:08:23.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949cf09640 1 -- 10.20.193.48:0/1289595584 learned_addr learned my addr 10.20.193.48:0/1289595584 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:23.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949cf09640 10 monclient(hunting): get_auth_request con 0x7f949805c950 auth_method 0 2026-02-12T18:08:23.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949cf09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949cf09640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949cf09640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949cf09640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949cf09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949cf09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f948ffff640 1 --2- 10.20.193.48:0/1289595584 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f949805d260 0x7f949813e520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f948ffff640 10 monclient(hunting): get_auth_request con 0x7f949805d260 auth_method 0 2026-02-12T18:08:23.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f948ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f948ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f948ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949cf09640 10 monclient(hunting): handle_auth_done global_id 44122 payload 824 2026-02-12T18:08:23.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949cf09640 1 -- 10.20.193.48:0/1289595584 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f949805e490 msgr2=0x7f949812d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949cf09640 1 --2- 10.20.193.48:0/1289595584 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f949805e490 0x7f949812d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949cf09640 1 -- 10.20.193.48:0/1289595584 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f949805d260 msgr2=0x7f949813e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949cf09640 1 --2- 10.20.193.48:0/1289595584 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f949805d260 0x7f949813e520 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949cf09640 10 monclient: _finish_hunting 0 2026-02-12T18:08:23.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949cf09640 1 monclient: found mon.noname-c 2026-02-12T18:08:23.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949cf09640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:23.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949cf09640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:08:23.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.806+0000 7f949cf09640 1 -- 10.20.193.48:0/1289595584 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94880094f0 con 0x7f949805c950 2026-02-12T18:08:23.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.808+0000 7f949cf09640 1 -- 10.20.193.48:0/1289595584 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f949805c950 msgr2=0x7f949813dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:23.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.808+0000 7f949cf09640 1 --2- 10.20.193.48:0/1289595584 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f949805c950 0x7f949813dfe0 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9488006f70 tx=0x7f9488009ec0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:23.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.808+0000 7f948d7fa640 1 -- 10.20.193.48:0/1289595584 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f94880044f0 con 0x7f949805c950 2026-02-12T18:08:23.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.808+0000 7f948d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.808+0000 7f948d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:08:23.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.808+0000 7f948d7fa640 10 monclient: dump: 2026-02-12T18:08:23.818 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.818 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.818 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.818 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.818 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.818 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.818 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.818 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.818 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.818 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.818 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.818 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.818 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.818 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.818 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.818 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.808+0000 7f948d7fa640 10 monclient: _finish_auth 0 2026-02-12T18:08:23.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.808+0000 7f948d7fa640 10 monclient: _check_auth_tickets 2026-02-12T18:08:23.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.808+0000 7f948d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:23.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.808+0000 7f948d7fa640 1 -- 10.20.193.48:0/1289595584 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f948800cc40 con 0x7f949805c950 2026-02-12T18:08:23.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.808+0000 7f948d7fa640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:23.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.808+0000 7f948d7fa640 1 -- 10.20.193.48:0/1289595584 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f948800cdb0 con 0x7f949805c950 2026-02-12T18:08:23.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.808+0000 7f949f194640 5 monclient: authenticate success, global_id 44122 2026-02-12T18:08:23.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.808+0000 7f948effd640 4 set_mon_vals no callback set 2026-02-12T18:08:23.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.808+0000 7f949f194640 10 monclient: _renew_subs 2026-02-12T18:08:23.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.808+0000 7f949f194640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:08:23.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.808+0000 7f949f194640 1 -- 10.20.193.48:0/1289595584 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f949400a500 con 0x7f949805c950 2026-02-12T18:08:23.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.808+0000 7f948d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.808+0000 7f948d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:08:23.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.808+0000 7f948d7fa640 10 monclient: dump: 2026-02-12T18:08:23.819 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.819 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.819 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.819 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.819 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.819 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.819 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.819 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.820 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.820 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.820 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.820 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.820 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.820 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.820 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.820 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.808+0000 7f949f194640 10 monclient: _renew_subs 2026-02-12T18:08:23.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.808+0000 7f949f194640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:08:23.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.808+0000 7f949f194640 1 -- 10.20.193.48:0/1289595584 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f94980907f0 con 0x7f949805c950 2026-02-12T18:08:23.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.809+0000 7f949f194640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:23.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.809+0000 7f949f194640 1 --2- 10.20.193.48:0/1289595584 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f949812de10 0x7f949812e1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.809+0000 7f949f194640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.809+0000 7f949f194640 1 -- 10.20.193.48:0/1289595584 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f9498063180 con 0x7f949812de10 2026-02-12T18:08:23.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.809+0000 7f948ffff640 1 --2- 10.20.193.48:0/1289595584 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f949812de10 0x7f949812e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.809+0000 7f948ffff640 10 monclient: get_auth_request con 0x7f949812de10 auth_method 0 2026-02-12T18:08:23.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.809+0000 7f948ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.809+0000 7f948ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.809+0000 7f948ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.809+0000 7f948ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.809+0000 7f948ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.809+0000 7f948ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.809+0000 7f948d7fa640 1 -- 10.20.193.48:0/1289595584 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f9488011070 con 0x7f949805c950 2026-02-12T18:08:23.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.809+0000 7f948ffff640 10 monclient(hunting): handle_auth_done global_id 44131 payload 824 2026-02-12T18:08:23.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.809+0000 7f948ffff640 1 -- 10.20.193.48:0/1289595584 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9498097de0 con 0x7f949812de10 2026-02-12T18:08:23.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.809+0000 7f948d7fa640 1 --2- 10.20.193.48:0/1289595584 >> v2:10.20.193.111:6812/977811348 conn(0x7f946803f800 0x7f946805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.809+0000 7f948d7fa640 1 -- 10.20.193.48:0/1289595584 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(114..114 src has 1..114) ==== 3897+0+0 (secure 0 0 0) 0x7f9488052e20 con 0x7f949805c950 2026-02-12T18:08:23.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.809+0000 7f949d70a640 1 --2- 10.20.193.48:0/1289595584 >> v2:10.20.193.111:6812/977811348 conn(0x7f946803f800 0x7f946805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.809+0000 7f949d70a640 10 monclient: get_auth_request con 0x7f946803f800 auth_method 0 2026-02-12T18:08:23.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.811+0000 7f948ffff640 1 -- 10.20.193.48:0/1289595584 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f949812de10 msgr2=0x7f949812e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:23.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.811+0000 7f948ffff640 1 --2- 10.20.193.48:0/1289595584 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f949812de10 0x7f949812e1e0 secure :-1 s=READY pgs=17 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9480003770 tx=0x7f948000e970 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:23.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.812+0000 7f948d7fa640 1 -- 10.20.193.48:0/1289595584 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9480006cb0 con 0x7f949812de10 2026-02-12T18:08:23.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.812+0000 7f948d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.812+0000 7f948d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:08:23.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.812+0000 7f948d7fa640 10 monclient: dump: 2026-02-12T18:08:23.823 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.823 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.823 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.823 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.824 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.824 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.824 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.824 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.824 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.824 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.824 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.824 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.824 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.824 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.824 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.824 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.812+0000 7f948d7fa640 1 -- 10.20.193.48:0/1289595584 <== mon.4 v2:10.20.193.48:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f9480006e10 con 0x7f949812de10 2026-02-12T18:08:23.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.812+0000 7f948d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:23.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.812+0000 7f948d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:23.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.812+0000 7f948d7fa640 1 -- 10.20.193.48:0/1289595584 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f949812de10 msgr2=0x7f949812e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.812+0000 7f948d7fa640 1 --2- 10.20.193.48:0/1289595584 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f949812de10 0x7f949812e1e0 secure :-1 s=READY pgs=17 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9480003770 tx=0x7f948000e970 comp rx=0 tx=0).stop 2026-02-12T18:08:23.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.812+0000 7f948d7fa640 1 -- 10.20.193.48:0/1289595584 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f949812de10 msgr2=0x7f949812e1e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:23.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.812+0000 7f948d7fa640 1 --2- 10.20.193.48:0/1289595584 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f949812de10 0x7f949812e1e0 unknown :-1 s=CLOSED pgs=17 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.812+0000 7f949d70a640 1 --2- 10.20.193.48:0/1289595584 >> v2:10.20.193.111:6812/977811348 conn(0x7f946803f800 0x7f946805fcb0 secure :-1 s=READY pgs=169 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f949402fe30 tx=0x7f9494032000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:23.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.815+0000 7f949f194640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:08:23.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.815+0000 7f949f194640 1 --2- 10.20.193.48:0/1289595584 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f949813fe70 0x7f9498140270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.815+0000 7f949f194640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.815+0000 7f949f194640 1 -- 10.20.193.48:0/1289595584 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f949805f140 con 0x7f949813fe70 2026-02-12T18:08:23.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.815+0000 7f948ffff640 1 --2- 10.20.193.48:0/1289595584 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f949813fe70 0x7f9498140270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.815+0000 7f948ffff640 10 monclient: get_auth_request con 0x7f949813fe70 auth_method 0 2026-02-12T18:08:23.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.815+0000 7f948ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.815+0000 7f948ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.815+0000 7f948ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.815+0000 7f948ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.815+0000 7f948ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.815+0000 7f948ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.816+0000 7f948ffff640 10 monclient(hunting): handle_auth_done global_id 44140 payload 824 2026-02-12T18:08:23.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.816+0000 7f948ffff640 1 -- 10.20.193.48:0/1289595584 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f949812e720 con 0x7f949813fe70 2026-02-12T18:08:23.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.818+0000 7f948ffff640 1 -- 10.20.193.48:0/1289595584 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f949813fe70 msgr2=0x7f9498140270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:23.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.818+0000 7f948ffff640 1 --2- 10.20.193.48:0/1289595584 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f949813fe70 0x7f9498140270 secure :-1 s=READY pgs=18 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9480015000 tx=0x7f9480003810 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:23.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.818+0000 7f948d7fa640 1 -- 10.20.193.48:0/1289595584 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f94800138e0 con 0x7f949813fe70 2026-02-12T18:08:23.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.818+0000 7f948d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.818+0000 7f948d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:08:23.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.818+0000 7f948d7fa640 10 monclient: dump: 2026-02-12T18:08:23.826 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.826 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.826 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.826 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.826 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.826 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.826 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.826 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.826 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.826 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.826 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.826 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.826 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.826 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.826 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.826 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.818+0000 7f948d7fa640 1 -- 10.20.193.48:0/1289595584 <== mon.4 v2:10.20.193.48:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7f9480013420 con 0x7f949813fe70 2026-02-12T18:08:23.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.818+0000 7f948d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:08:23.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.818+0000 7f948d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:23.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.818+0000 7f948d7fa640 1 -- 10.20.193.48:0/1289595584 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f949813fe70 msgr2=0x7f9498140270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.818+0000 7f948d7fa640 1 --2- 10.20.193.48:0/1289595584 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f949813fe70 0x7f9498140270 secure :-1 s=READY pgs=18 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9480015000 tx=0x7f9480003810 comp rx=0 tx=0).stop 2026-02-12T18:08:23.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.818+0000 7f948d7fa640 1 -- 10.20.193.48:0/1289595584 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f949813fe70 msgr2=0x7f9498140270 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:23.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.818+0000 7f948d7fa640 1 --2- 10.20.193.48:0/1289595584 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f949813fe70 0x7f9498140270 secure :-1 s=CLOSED pgs=18 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9480015000 tx=0x7f9480003810 comp rx=0 tx=0).stop 2026-02-12T18:08:23.827 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:08:23.827 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:08:23.827 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:08:23.827 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:08:23.827 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 28, 2026-02-12T18:08:23.827 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 15703, 2026-02-12T18:08:23.827 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:08:23.827 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:08:23.827 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:08:23.827 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:08:23.828 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:08:23.828 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:08:23.828 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:08:23.828 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:08:23.828 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:08:23.828 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:08:23.828 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:23.828 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:08:23.828 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:23.828 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:08:23.828 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:08:23.828 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:23.828 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:23.828 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:23.828 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:23.828 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:23.828 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:23.828 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:23.828 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:23.829 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:23.829 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:23.829 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:23.829 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:23.829 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:23.829 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:23.829 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:08:23.829 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:08:23.829 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:23.829 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:23.829 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:23.829 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:23.829 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:23.829 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:23.829 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:23.829 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:23.829 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:23.829 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:23.829 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:23.829 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:23.829 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:23.830 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.830 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.830 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:08:23.830 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:08:23.830 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:08:23.830 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:08:23.830 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:08:23.830 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:08:23.830 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:23.830 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:23.830 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:08:23.830 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:08:23.830 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:08:23.830 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:08:23.830 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:08:23.830 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:08:23.830 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:08:23.830 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:23.831 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:08:23.831 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:23.831 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:23.831 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:23.831 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:23.831 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:23.831 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:23.831 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:23.831 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:23.831 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:23.831 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:23.831 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:23.831 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:23.831 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:23.831 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:23.831 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:08:23.831 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.831 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:08:23.831 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.831 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:23.831 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:23.831 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.831 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.832 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.832 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.832 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:08:23.832 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.832 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.832 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.832 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.832 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:08:23.832 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.832 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.832 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.832 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.832 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:08:23.832 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:08:23.832 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.832 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.832 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:08:23.832 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.832 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.832 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.832 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:23.833 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:23.833 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.833 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.833 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.833 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.833 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:08:23.833 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.833 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.833 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.833 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.833 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:08:23.833 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.833 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.833 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.833 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.833 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:08:23.833 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:08:23.833 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.833 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.833 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:08:23.833 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.833 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.834 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.834 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:23.834 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:23.834 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.834 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.834 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.834 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.834 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:08:23.834 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.834 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.834 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.834 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.834 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:08:23.834 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.834 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.834 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.834 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.834 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:08:23.834 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:08:23.834 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.834 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.834 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:08:23.834 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.835 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.835 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.835 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:08:23.835 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:08:23.835 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.835 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.835 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.835 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.835 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:08:23.835 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.835 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.835 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.835 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.835 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:08:23.835 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.835 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.835 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.835 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.835 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:08:23.835 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:08:23.835 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.835 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.835 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:08:23.835 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.836 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.836 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.836 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:08:23.836 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:08:23.836 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.836 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.836 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.836 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.836 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:08:23.836 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.836 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.836 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.836 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.836 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:08:23.836 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.836 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.836 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.836 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.836 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:08:23.836 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:08:23.836 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.836 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.836 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:23.837 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.837 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.837 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.837 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:23.837 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:23.837 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.837 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.837 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.837 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.837 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:08:23.837 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.837 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.837 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.837 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.837 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:08:23.837 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.837 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.837 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.837 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.837 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:08:23.837 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:08:23.837 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.837 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.837 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:08:23.838 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.838 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.838 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.838 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:23.838 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:23.838 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.838 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.838 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.838 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.838 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:08:23.838 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.838 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.838 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.838 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.838 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:08:23.838 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.838 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.838 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.838 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.838 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:08:23.838 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:08:23.838 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.838 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.838 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:23.838 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.839 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.839 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.839 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:23.839 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:23.839 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.839 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.839 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.839 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.839 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:08:23.839 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.839 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.839 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.839 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.839 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:08:23.839 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.839 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.839 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.839 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.839 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:08:23.839 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:08:23.839 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.839 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.840 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:08:23.840 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.840 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.840 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.840 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:08:23.840 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:08:23.840 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.840 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.840 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.840 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.840 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:08:23.840 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.840 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.840 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.840 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.840 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:08:23.840 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.840 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.840 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.840 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.840 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:08:23.840 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:08:23.840 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.840 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.840 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:08:23.840 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.841 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.841 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.841 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.841 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:08:23.841 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:08:23.841 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.841 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:23.841 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:23.841 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:23.841 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.841 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:23.841 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:08:23.841 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.841 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:23.841 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:23.841 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:08:23.841 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.841 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.841 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.841 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:08:23.841 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:08:23.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.818+0000 7f949f194640 1 -- 10.20.193.48:0/1289595584 >> v2:10.20.193.111:6812/977811348 conn(0x7f946803f800 msgr2=0x7f946805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.818+0000 7f949f194640 1 --2- 10.20.193.48:0/1289595584 >> v2:10.20.193.111:6812/977811348 conn(0x7f946803f800 0x7f946805fcb0 secure :-1 s=READY pgs=169 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f949402fe30 tx=0x7f9494032000 comp rx=0 tx=0).stop 2026-02-12T18:08:23.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.818+0000 7f949f194640 10 monclient: shutdown 2026-02-12T18:08:23.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.818+0000 7f949f194640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:23.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.818+0000 7f949f194640 1 -- 10.20.193.48:0/1289595584 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f949805c950 msgr2=0x7f949813dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.818+0000 7f949f194640 1 --2- 10.20.193.48:0/1289595584 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f949805c950 0x7f949813dfe0 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9488006f70 tx=0x7f9488009ec0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.818+0000 7f949d70a640 1 -- 10.20.193.48:0/1289595584 reap_dead start 2026-02-12T18:08:23.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.818+0000 7f949f194640 1 -- 10.20.193.48:0/1289595584 shutdown_connections 2026-02-12T18:08:23.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.818+0000 7f949f194640 1 --2- 10.20.193.48:0/1289595584 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f949805c950 0x7f949813dfe0 unknown :-1 s=CLOSED pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.818+0000 7f949f194640 1 -- 10.20.193.48:0/1289595584 >> 10.20.193.48:0/1289595584 conn(0x7f94980548a0 msgr2=0x7f949813ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:23.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.818+0000 7f949f194640 1 -- 10.20.193.48:0/1289595584 shutdown_connections 2026-02-12T18:08:23.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.819+0000 7f949f194640 1 -- 10.20.193.48:0/1289595584 wait complete. 2026-02-12T18:08:23.843 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:08:23.843 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2026-02-12T18:08:23.843 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2026-02-12T18:08:23.909 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.907+0000 7f601150c640 10 monclient: get_monmap_and_config 2026-02-12T18:08:23.909 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.907+0000 7f601150c640 10 monclient: build_initial_monmap 2026-02-12T18:08:23.909 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.907+0000 7f601150c640 10 monclient: monmap: 2026-02-12T18:08:23.909 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:23.909 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.909 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:23.908877+0000 2026-02-12T18:08:23.909 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:23.908877+0000 2026-02-12T18:08:23.909 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:23.909 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.909 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:23.910 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:23.910 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:23.910 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:23.910 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:23.910 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:23.910 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:23.910 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:23.910 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:23.910 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:23.910 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:23.910 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f601150c640 1 Processor -- start 2026-02-12T18:08:23.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f601150c640 1 -- start start 2026-02-12T18:08:23.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f601150c640 10 monclient: init 2026-02-12T18:08:23.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f601150c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:23.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f601150c640 10 monclient: _add_conns ranks=[5,8,0,4,3,1,7,10,9,2,6] 2026-02-12T18:08:23.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f601150c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f600c090730 0x7f600c08fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f601150c640 10 monclient(hunting): picked mon.noname-h con 0x7f600c090730 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:08:23.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f601150c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f600c090b00 0x7f600c090f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f601150c640 10 monclient(hunting): picked mon.noname-e con 0x7f600c090b00 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:08:23.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f601150c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f600c1442e0 addr v1:10.20.193.48:6789/0 2026-02-12T18:08:23.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f601150c640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f600c04dc20 con 0x7f600c1442e0 2026-02-12T18:08:23.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f601150c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f601150c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f600c091810 con 0x7f600c090730 2026-02-12T18:08:23.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f601150c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f601150c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f600c0914d0 con 0x7f600c090b00 2026-02-12T18:08:23.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f601150c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:23.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f601150c640 10 monclient(hunting): authenticate will time out at 742.634633s 2026-02-12T18:08:23.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600a7fc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f600c090b00 0x7f600c090f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600a7fc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f600c090b00 0x7f600c090f30 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:47876/0 (socket says 10.20.193.48:47876) 2026-02-12T18:08:23.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600a7fc640 1 -- 10.20.193.48:0/2079155273 learned_addr learned my addr 10.20.193.48:0/2079155273 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:23.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600a7fc640 10 monclient(hunting): get_auth_request con 0x7f600c090b00 auth_method 0 2026-02-12T18:08:23.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600b7fe640 1 --1- 10.20.193.48:0/2079155273 >> v1:10.20.193.48:6789/0 conn(0x7f600c1442e0 0x7f600c144750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:56832/0 (socket says 10.20.193.48:56832) 2026-02-12T18:08:23.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600affd640 1 --2- 10.20.193.48:0/2079155273 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f600c090730 0x7f600c08fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600affd640 10 monclient(hunting): get_auth_request con 0x7f600c090730 auth_method 0 2026-02-12T18:08:23.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600a7fc640 10 monclient(hunting): handle_auth_done global_id 4994 payload 274 2026-02-12T18:08:23.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600a7fc640 1 -- 10.20.193.48:0/2079155273 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f600c090730 msgr2=0x7f600c08fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:23.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600a7fc640 1 --2- 10.20.193.48:0/2079155273 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f600c090730 0x7f600c08fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600a7fc640 1 -- 10.20.193.48:0/2079155273 >> v1:10.20.193.48:6789/0 conn(0x7f600c1442e0 legacy=0x7f600c144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:23.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600a7fc640 10 monclient: _finish_hunting 0 2026-02-12T18:08:23.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600a7fc640 1 monclient: found mon.noname-e 2026-02-12T18:08:23.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:23.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600a7fc640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:08:23.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.908+0000 7f600a7fc640 1 -- 10.20.193.48:0/2079155273 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f600c0570c0 con 0x7f600c090b00 2026-02-12T18:08:23.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.911+0000 7f600a7fc640 1 -- 10.20.193.48:0/2079155273 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f600c090b00 msgr2=0x7f600c090f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:23.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.911+0000 7f600a7fc640 1 --2- 10.20.193.48:0/2079155273 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f600c090b00 0x7f600c090f30 secure :-1 s=READY pgs=112 gs=2 cs=0 l=1 c_cookie=15725045542130090020 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ff40098d0 tx=0x7f5ff402edc0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=da3a959b0f810024 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:23.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.911+0000 7f6009ffb640 1 -- 10.20.193.48:0/2079155273 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5ff4035340 con 0x7f600c090b00 2026-02-12T18:08:23.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.911+0000 7f6009ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.911+0000 7f6009ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:08:23.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.911+0000 7f6009ffb640 10 monclient: dump: 2026-02-12T18:08:23.919 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.919 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.919 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.919 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.919 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.919 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.919 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.919 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.919 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.919 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.919 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.919 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.919 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.919 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.919 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.919 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.911+0000 7f6009ffb640 10 monclient: _finish_auth 0 2026-02-12T18:08:23.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.911+0000 7f6009ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:08:23.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.911+0000 7f6009ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:23.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.911+0000 7f6009ffb640 1 -- 10.20.193.48:0/2079155273 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ff40354c0 con 0x7f600c090b00 2026-02-12T18:08:23.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.911+0000 7f6009ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:23.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.911+0000 7f6009ffb640 1 -- 10.20.193.48:0/2079155273 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5ff4035af0 con 0x7f600c090b00 2026-02-12T18:08:23.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.911+0000 7f601150c640 5 monclient: authenticate success, global_id 4994 2026-02-12T18:08:23.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.911+0000 7f601150c640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:23.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.911+0000 7f601150c640 4 set_mon_vals no callback set 2026-02-12T18:08:23.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.911+0000 7f6009ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.911+0000 7f6009ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:08:23.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.911+0000 7f6009ffb640 10 monclient: dump: 2026-02-12T18:08:23.920 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.920 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.920 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.920 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.920 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.920 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.920 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.920 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.920 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.920 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.920 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.921 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.921 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.921 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.921 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.921 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.911+0000 7f601150c640 10 monclient: shutdown 2026-02-12T18:08:23.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.911+0000 7f601150c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:23.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.911+0000 7f601150c640 1 -- 10.20.193.48:0/2079155273 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f600c090b00 msgr2=0x7f600c090f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.911+0000 7f601150c640 1 --2- 10.20.193.48:0/2079155273 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f600c090b00 0x7f600c090f30 secure :-1 s=READY pgs=112 gs=2 cs=0 l=1 c_cookie=15725045542130090020 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ff40098d0 tx=0x7f5ff402edc0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.912+0000 7f601150c640 1 -- 10.20.193.48:0/2079155273 shutdown_connections 2026-02-12T18:08:23.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.912+0000 7f601150c640 1 --2- 10.20.193.48:0/2079155273 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f600c090b00 0x7f600c090f30 unknown :-1 s=CLOSED pgs=112 gs=2 cs=0 l=1 c_cookie=15725045542130090020 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.912+0000 7f601150c640 1 --2- 10.20.193.48:0/2079155273 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f600c090730 0x7f600c08fca0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.912+0000 7f601150c640 1 -- 10.20.193.48:0/2079155273 >> 10.20.193.48:0/2079155273 conn(0x7f600c054e50 msgr2=0x7f600c0952a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:23.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.912+0000 7f601150c640 1 -- 10.20.193.48:0/2079155273 shutdown_connections 2026-02-12T18:08:23.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.912+0000 7f601150c640 1 -- 10.20.193.48:0/2079155273 wait complete. 2026-02-12T18:08:23.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.912+0000 7f601150c640 10 monclient: build_initial_monmap 2026-02-12T18:08:23.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.912+0000 7f601150c640 10 monclient: monmap: 2026-02-12T18:08:23.921 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:23.921 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:23.922 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:23.922 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:23.922 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:23.922 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.922 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:23.922 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:23.922 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:23.922 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:23.922 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:23.922 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:23.922 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:23.922 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:23.922 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:23.922 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.912+0000 7f601150c640 1 Processor -- start 2026-02-12T18:08:23.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.912+0000 7f601150c640 1 -- start start 2026-02-12T18:08:23.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.912+0000 7f601150c640 10 monclient: init 2026-02-12T18:08:23.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.912+0000 7f601150c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:23.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f601150c640 10 monclient: _add_conns ranks=[2,7,4,8,5,0,3,6,1] 2026-02-12T18:08:23.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f601150c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f600c090730 0x7f600c12e3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f601150c640 10 monclient(hunting): picked mon.noname-b con 0x7f600c090730 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:08:23.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f601150c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f600c090b00 0x7f600c13e550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f601150c640 10 monclient(hunting): picked mon.noname-i con 0x7f600c090b00 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:23.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f601150c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f600c1442e0 0x7f600c10bac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f601150c640 10 monclient(hunting): picked mon.noname-c con 0x7f600c1442e0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:08:23.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f601150c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f601150c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f600c12e8f0 con 0x7f600c090730 2026-02-12T18:08:23.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f601150c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f601150c640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f600c10dff0 con 0x7f600c1442e0 2026-02-12T18:08:23.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f601150c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f601150c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f600c10d420 con 0x7f600c090b00 2026-02-12T18:08:23.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f601150c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:23.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f601150c640 10 monclient(hunting): authenticate will time out at 742.639048s 2026-02-12T18:08:23.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600affd640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f600c090730 0x7f600c12e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600b7fe640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f600c1442e0 0x7f600c10bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600affd640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f600c090730 0x7f600c12e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:41936/0 (socket says 10.20.193.48:41936) 2026-02-12T18:08:23.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600affd640 1 -- 10.20.193.48:0/794982895 learned_addr learned my addr 10.20.193.48:0/794982895 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:23.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600affd640 10 monclient(hunting): get_auth_request con 0x7f600c090730 auth_method 0 2026-02-12T18:08:23.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600b7fe640 10 monclient(hunting): get_auth_request con 0x7f600c1442e0 auth_method 0 2026-02-12T18:08:23.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600a7fc640 1 --2- 10.20.193.48:0/794982895 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f600c090b00 0x7f600c13e550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600a7fc640 10 monclient(hunting): get_auth_request con 0x7f600c090b00 auth_method 0 2026-02-12T18:08:23.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600b7fe640 10 monclient(hunting): handle_auth_done global_id 44149 payload 824 2026-02-12T18:08:23.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600b7fe640 1 -- 10.20.193.48:0/794982895 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f600c090b00 msgr2=0x7f600c13e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600b7fe640 1 --2- 10.20.193.48:0/794982895 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f600c090b00 0x7f600c13e550 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600b7fe640 1 -- 10.20.193.48:0/794982895 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f600c090730 msgr2=0x7f600c12e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600b7fe640 1 --2- 10.20.193.48:0/794982895 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f600c090730 0x7f600c12e3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:23.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600b7fe640 10 monclient: _finish_hunting 0 2026-02-12T18:08:23.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600b7fe640 1 monclient: found mon.noname-c 2026-02-12T18:08:23.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:23.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600b7fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:08:23.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600b7fe640 1 -- 10.20.193.48:0/794982895 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff40094f0 con 0x7f600c1442e0 2026-02-12T18:08:23.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.913+0000 7f600affd640 1 --2- 10.20.193.48:0/794982895 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f600c090730 0x7f600c12e3b0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:08:23.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.915+0000 7f600b7fe640 1 -- 10.20.193.48:0/794982895 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f600c1442e0 msgr2=0x7f600c10bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:23.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.915+0000 7f600b7fe640 1 --2- 10.20.193.48:0/794982895 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f600c1442e0 0x7f600c10bac0 secure :-1 s=READY pgs=19 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ffc00d450 tx=0x7f5ffc00d920 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:23.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.915+0000 7f5feb7fe640 1 -- 10.20.193.48:0/794982895 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5ffc006dd0 con 0x7f600c1442e0 2026-02-12T18:08:23.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.915+0000 7f5feb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.915+0000 7f5feb7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:08:23.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.915+0000 7f5feb7fe640 10 monclient: dump: 2026-02-12T18:08:23.925 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.925 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.925 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.925 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.925 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.925 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.926 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.926 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.926 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.926 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.926 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.926 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.926 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.926 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.926 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.926 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.915+0000 7f5feb7fe640 10 monclient: _finish_auth 0 2026-02-12T18:08:23.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.915+0000 7f5feb7fe640 10 monclient: _check_auth_tickets 2026-02-12T18:08:23.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.915+0000 7f5feb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:23.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.915+0000 7f5feb7fe640 1 -- 10.20.193.48:0/794982895 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ffc008530 con 0x7f600c1442e0 2026-02-12T18:08:23.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.915+0000 7f5feb7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:23.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.915+0000 7f5feb7fe640 1 -- 10.20.193.48:0/794982895 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5ffc0086a0 con 0x7f600c1442e0 2026-02-12T18:08:23.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.915+0000 7f5feb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.915+0000 7f5feb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:08:23.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.915+0000 7f60097fa640 4 set_mon_vals no callback set 2026-02-12T18:08:23.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.915+0000 7f5feb7fe640 10 monclient: dump: 2026-02-12T18:08:23.927 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.927 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.927 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.927 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.927 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.927 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.927 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.927 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.927 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.927 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.927 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.927 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.927 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.927 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.927 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.927 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.915+0000 7f601150c640 5 monclient: authenticate success, global_id 44149 2026-02-12T18:08:23.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.915+0000 7f601150c640 10 monclient: _renew_subs 2026-02-12T18:08:23.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.915+0000 7f601150c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:08:23.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.915+0000 7f601150c640 1 -- 10.20.193.48:0/794982895 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f600c10f780 con 0x7f600c1442e0 2026-02-12T18:08:23.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.915+0000 7f601150c640 10 monclient: _renew_subs 2026-02-12T18:08:23.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.915+0000 7f601150c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:08:23.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.915+0000 7f601150c640 1 -- 10.20.193.48:0/794982895 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f600c0925e0 con 0x7f600c1442e0 2026-02-12T18:08:23.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.916+0000 7f601150c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:23.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.916+0000 7f601150c640 1 --2- 10.20.193.48:0/794982895 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f600c08d6b0 0x7f600c08da80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.916+0000 7f601150c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.916+0000 7f601150c640 1 -- 10.20.193.48:0/794982895 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f600c05f140 con 0x7f600c08d6b0 2026-02-12T18:08:23.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.916+0000 7f5feb7fe640 1 -- 10.20.193.48:0/794982895 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f5ffc008070 con 0x7f600c1442e0 2026-02-12T18:08:23.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.916+0000 7f600affd640 1 --2- 10.20.193.48:0/794982895 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f600c08d6b0 0x7f600c08da80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.916+0000 7f600affd640 10 monclient: get_auth_request con 0x7f600c08d6b0 auth_method 0 2026-02-12T18:08:23.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.916+0000 7f600affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.916+0000 7f600affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.916+0000 7f600affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.916+0000 7f600affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.916+0000 7f600affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.916+0000 7f600affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.916+0000 7f5feb7fe640 1 --2- 10.20.193.48:0/794982895 >> v2:10.20.193.111:6812/977811348 conn(0x7f5fd803f800 0x7f5fd805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.916+0000 7f5feb7fe640 1 -- 10.20.193.48:0/794982895 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(114..114 src has 1..114) ==== 3897+0+0 (secure 0 0 0) 0x7f5ffc052fb0 con 0x7f600c1442e0 2026-02-12T18:08:23.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.916+0000 7f600affd640 10 monclient(hunting): handle_auth_done global_id 4902 payload 824 2026-02-12T18:08:23.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.916+0000 7f600affd640 1 -- 10.20.193.48:0/794982895 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f600c0901e0 con 0x7f600c08d6b0 2026-02-12T18:08:23.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.916+0000 7f600a7fc640 1 --2- 10.20.193.48:0/794982895 >> v2:10.20.193.111:6812/977811348 conn(0x7f5fd803f800 0x7f5fd805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.916+0000 7f600a7fc640 10 monclient: get_auth_request con 0x7f5fd803f800 auth_method 0 2026-02-12T18:08:23.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.918+0000 7f600affd640 1 -- 10.20.193.48:0/794982895 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f600c08d6b0 msgr2=0x7f600c08da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:23.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.918+0000 7f600affd640 1 --2- 10.20.193.48:0/794982895 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f600c08d6b0 0x7f600c08da80 secure :-1 s=READY pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f60000093f0 tx=0x7f600000f610 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:23.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.919+0000 7f5feb7fe640 1 -- 10.20.193.48:0/794982895 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6000014d20 con 0x7f600c08d6b0 2026-02-12T18:08:23.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.919+0000 7f5feb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.919+0000 7f5feb7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:08:23.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.919+0000 7f5feb7fe640 10 monclient: dump: 2026-02-12T18:08:23.931 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.931 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.931 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.931 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.931 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.931 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.931 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.931 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.931 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.931 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.931 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.931 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.931 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.931 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.931 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.931 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.919+0000 7f5feb7fe640 1 -- 10.20.193.48:0/794982895 <== mon.6 v2:10.20.193.48:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f6000014e80 con 0x7f600c08d6b0 2026-02-12T18:08:23.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.919+0000 7f5feb7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:23.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.919+0000 7f5feb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:23.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.919+0000 7f5feb7fe640 1 -- 10.20.193.48:0/794982895 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f600c08d6b0 msgr2=0x7f600c08da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.919+0000 7f5feb7fe640 1 --2- 10.20.193.48:0/794982895 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f600c08d6b0 0x7f600c08da80 secure :-1 s=READY pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f60000093f0 tx=0x7f600000f610 comp rx=0 tx=0).stop 2026-02-12T18:08:23.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.919+0000 7f5feb7fe640 1 -- 10.20.193.48:0/794982895 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f600c08d6b0 msgr2=0x7f600c08da80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:23.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.919+0000 7f5feb7fe640 1 --2- 10.20.193.48:0/794982895 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f600c08d6b0 0x7f600c08da80 secure :-1 s=CLOSED pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f60000093f0 tx=0x7f600000f610 comp rx=0 tx=0).stop 2026-02-12T18:08:23.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.919+0000 7f600a7fc640 1 --2- 10.20.193.48:0/794982895 >> v2:10.20.193.111:6812/977811348 conn(0x7f5fd803f800 0x7f5fd805fcb0 secure :-1 s=READY pgs=170 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ff4004740 tx=0x7f5ff4039040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:23.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.922+0000 7f601150c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:08:23.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.922+0000 7f601150c640 1 --2- 10.20.193.48:0/794982895 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f600c08dfc0 0x7f600c08e3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:23.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.922+0000 7f601150c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:23.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.922+0000 7f601150c640 1 -- 10.20.193.48:0/794982895 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f600c05fd90 con 0x7f600c08dfc0 2026-02-12T18:08:23.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.922+0000 7f600affd640 1 --2- 10.20.193.48:0/794982895 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f600c08dfc0 0x7f600c08e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:23.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.922+0000 7f600affd640 10 monclient: get_auth_request con 0x7f600c08dfc0 auth_method 0 2026-02-12T18:08:23.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.922+0000 7f600affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:23.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.922+0000 7f600affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:23.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.922+0000 7f600affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:23.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.923+0000 7f600affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:23.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.923+0000 7f600affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:23.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.923+0000 7f600affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:23.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.923+0000 7f600affd640 10 monclient(hunting): handle_auth_done global_id 4911 payload 824 2026-02-12T18:08:23.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.923+0000 7f600affd640 1 -- 10.20.193.48:0/794982895 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f600c0564d0 con 0x7f600c08dfc0 2026-02-12T18:08:23.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.925+0000 7f600affd640 1 -- 10.20.193.48:0/794982895 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f600c08dfc0 msgr2=0x7f600c08e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:23.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.925+0000 7f600affd640 1 --2- 10.20.193.48:0/794982895 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f600c08dfc0 0x7f600c08e3c0 secure :-1 s=READY pgs=107 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6000019000 tx=0x7f6000004770 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:23.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.925+0000 7f5feb7fe640 1 -- 10.20.193.48:0/794982895 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6000022880 con 0x7f600c08dfc0 2026-02-12T18:08:23.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.925+0000 7f5feb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:23.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.925+0000 7f5feb7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:08:23.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.925+0000 7f5feb7fe640 10 monclient: dump: 2026-02-12T18:08:23.933 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:23.933 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:23.933 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.933 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:23.933 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:23.933 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:23.933 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:23.933 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:23.933 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:23.933 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:23.933 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:23.933 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:23.933 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:23.933 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:23.933 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:23.933 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:23.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.925+0000 7f5feb7fe640 1 -- 10.20.193.48:0/794982895 <== mon.6 v2:10.20.193.48:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10015 (secure 0 0 0) 0x7f6000026070 con 0x7f600c08dfc0 2026-02-12T18:08:23.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.925+0000 7f5feb7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:08:23.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.925+0000 7f5feb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:23.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.925+0000 7f5feb7fe640 1 -- 10.20.193.48:0/794982895 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f600c08dfc0 msgr2=0x7f600c08e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.925+0000 7f5feb7fe640 1 --2- 10.20.193.48:0/794982895 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f600c08dfc0 0x7f600c08e3c0 secure :-1 s=READY pgs=107 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6000019000 tx=0x7f6000004770 comp rx=0 tx=0).stop 2026-02-12T18:08:23.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.925+0000 7f5feb7fe640 1 -- 10.20.193.48:0/794982895 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f600c08dfc0 msgr2=0x7f600c08e3c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:23.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.925+0000 7f5feb7fe640 1 --2- 10.20.193.48:0/794982895 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f600c08dfc0 0x7f600c08e3c0 secure :-1 s=CLOSED pgs=107 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6000019000 tx=0x7f6000004770 comp rx=0 tx=0).stop 2026-02-12T18:08:23.934 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:08:23.934 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:23.934 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:23.934 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:08:23.934 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 28, 2026-02-12T18:08:23.934 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 158752, 2026-02-12T18:08:23.934 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:08:23.934 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:08:23.935 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:08:23.935 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:08:23.935 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:08:23.935 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:08:23.935 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:08:23.935 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:08:23.935 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:08:23.935 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:08:23.935 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:23.935 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:08:23.935 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:23.935 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:08:23.935 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:08:23.935 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:23.935 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:23.935 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:23.935 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:23.935 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:23.935 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:23.935 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:23.936 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:23.936 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:23.936 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:23.936 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:23.936 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:23.936 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:23.936 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:23.936 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:08:23.936 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:08:23.936 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:23.936 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:23.936 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:23.936 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:23.936 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:23.936 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:23.936 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:23.936 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:23.936 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:23.936 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:23.936 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:23.937 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:23.937 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:23.937 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.937 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.937 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:08:23.937 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:08:23.937 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:08:23.937 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:08:23.937 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:08:23.937 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:08:23.937 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:23.937 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:23.937 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:08:23.937 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:08:23.937 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:08:23.937 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:08:23.937 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:08:23.937 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:08:23.937 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:08:23.937 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:23.938 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:08:23.938 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:23.938 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:23.938 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:23.938 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:23.938 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:23.938 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:23.938 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:23.938 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:23.938 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:23.938 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:23.938 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:23.938 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:23.938 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:23.938 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:23.938 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:08:23.938 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.938 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:08:23.938 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.938 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:23.938 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:23.938 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.939 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.939 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.939 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.939 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:08:23.939 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.939 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.939 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.939 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.939 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:08:23.939 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.939 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.939 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.939 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.939 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:08:23.939 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:08:23.939 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.939 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.939 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:08:23.939 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.939 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.939 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.939 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:23.940 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:23.940 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.940 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.940 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.940 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.940 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:08:23.940 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.940 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.940 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.940 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.940 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:08:23.940 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.940 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.940 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.940 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.940 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:08:23.940 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:08:23.940 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.940 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.941 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:08:23.941 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.941 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.941 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.941 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:23.941 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:23.941 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.941 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.941 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.941 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.941 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:08:23.941 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.941 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.941 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.941 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.941 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:08:23.941 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.941 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.941 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.941 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.941 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:08:23.941 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:08:23.941 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.941 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.942 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:08:23.942 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.942 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.942 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.942 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:08:23.942 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:08:23.942 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.942 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.942 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.942 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.942 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:08:23.942 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.942 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.942 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.942 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.942 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:08:23.942 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.942 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.942 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.942 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.942 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:08:23.942 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:08:23.942 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.942 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.943 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:08:23.943 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.943 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.943 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.943 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:08:23.943 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:08:23.943 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.943 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.943 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.943 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.943 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:08:23.943 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.943 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.943 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.943 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.943 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:08:23.943 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.943 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.943 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.943 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.943 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:08:23.943 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:08:23.943 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.943 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.944 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:23.944 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.944 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.944 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.944 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:23.944 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:23.944 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.944 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.944 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.944 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.944 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:08:23.944 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.944 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.944 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.944 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.944 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:08:23.944 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.944 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.944 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.944 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.944 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:08:23.944 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:08:23.944 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.944 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.944 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:08:23.945 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.945 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.945 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.945 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:23.945 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:23.945 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.945 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.945 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.945 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.945 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:08:23.945 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.945 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.945 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.945 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.945 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:08:23.945 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.945 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.945 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.945 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.945 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:08:23.945 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:08:23.945 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.945 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.945 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:23.945 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.946 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.946 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.946 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:23.946 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:23.946 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.946 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.946 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.946 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.946 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:08:23.946 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.946 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.946 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.946 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.946 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:08:23.946 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.946 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.946 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.946 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.946 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:08:23.946 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:08:23.946 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.946 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.946 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:08:23.946 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.947 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.947 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.947 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:08:23.947 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:08:23.947 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:23.947 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:23.947 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.947 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:23.947 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:08:23.947 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.947 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.947 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.947 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:23.947 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:08:23.947 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:23.947 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.947 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.947 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.947 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:08:23.947 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:08:23.947 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:23.947 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:23.947 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:08:23.947 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:23.947 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.947 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.948 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.948 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:08:23.948 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:08:23.948 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.948 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:23.948 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:23.948 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:23.948 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.948 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:23.948 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:08:23.948 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:23.948 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:23.948 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:23.948 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:08:23.948 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:23.948 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:23.948 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:23.948 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:08:23.948 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:08:23.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.925+0000 7f601150c640 1 -- 10.20.193.48:0/794982895 >> v2:10.20.193.111:6812/977811348 conn(0x7f5fd803f800 msgr2=0x7f5fd805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.925+0000 7f601150c640 1 --2- 10.20.193.48:0/794982895 >> v2:10.20.193.111:6812/977811348 conn(0x7f5fd803f800 0x7f5fd805fcb0 secure :-1 s=READY pgs=170 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ff4004740 tx=0x7f5ff4039040 comp rx=0 tx=0).stop 2026-02-12T18:08:23.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.925+0000 7f601150c640 10 monclient: shutdown 2026-02-12T18:08:23.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.925+0000 7f601150c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:23.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.925+0000 7f601150c640 1 -- 10.20.193.48:0/794982895 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f600c1442e0 msgr2=0x7f600c10bac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:23.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.925+0000 7f601150c640 1 --2- 10.20.193.48:0/794982895 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f600c1442e0 0x7f600c10bac0 secure :-1 s=READY pgs=19 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5ffc00d450 tx=0x7f5ffc00d920 comp rx=0 tx=0).stop 2026-02-12T18:08:23.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.925+0000 7f600b7fe640 1 -- 10.20.193.48:0/794982895 reap_dead start 2026-02-12T18:08:23.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.925+0000 7f600b7fe640 1 -- 10.20.193.48:0/794982895 reap_dead start 2026-02-12T18:08:23.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.925+0000 7f601150c640 1 -- 10.20.193.48:0/794982895 shutdown_connections 2026-02-12T18:08:23.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.925+0000 7f601150c640 1 -- 10.20.193.48:0/794982895 >> 10.20.193.48:0/794982895 conn(0x7f600c054e50 msgr2=0x7f600c142ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:23.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.925+0000 7f601150c640 1 -- 10.20.193.48:0/794982895 shutdown_connections 2026-02-12T18:08:23.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:23.925+0000 7f601150c640 1 -- 10.20.193.48:0/794982895 wait complete. 2026-02-12T18:08:23.950 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:08:23.950 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2026-02-12T18:08:23.950 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2026-02-12T18:08:24.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.013+0000 7fdb79d0c640 10 monclient: get_monmap_and_config 2026-02-12T18:08:24.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.013+0000 7fdb79d0c640 10 monclient: build_initial_monmap 2026-02-12T18:08:24.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.013+0000 7fdb79d0c640 10 monclient: monmap: 2026-02-12T18:08:24.015 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:24.015 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.015 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:24.014788+0000 2026-02-12T18:08:24.015 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:24.014788+0000 2026-02-12T18:08:24.015 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:24.015 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.015 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:24.015 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:24.015 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:24.015 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:24.015 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:24.015 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:24.016 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:24.016 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:24.016 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:24.016 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:24.016 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:24.016 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb79d0c640 1 Processor -- start 2026-02-12T18:08:24.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb79d0c640 1 -- start start 2026-02-12T18:08:24.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb79d0c640 10 monclient: init 2026-02-12T18:08:24.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb79d0c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:24.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb79d0c640 10 monclient: _add_conns ranks=[0,7,10,8,1,5,9,3,6,4,2] 2026-02-12T18:08:24.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb79d0c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdb7405c950 addr v1:10.20.193.48:6789/0 2026-02-12T18:08:24.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb79d0c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fdb7405e490 0x7fdb741857b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb79d0c640 10 monclient(hunting): picked mon.noname-i con 0x7fdb7405e490 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:24.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb79d0c640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7fdb7405d430 0x7fdb741a5d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb79d0c640 10 monclient(hunting): picked mon.noname-f con 0x7fdb7405d430 addr v2:10.20.193.111:3300/0 2026-02-12T18:08:24.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb79d0c640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb7404dc20 con 0x7fdb7405c950 2026-02-12T18:08:24.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb79d0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb79d0c640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7fdb7405ddd0 con 0x7fdb7405d430 2026-02-12T18:08:24.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb79d0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb79d0c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fdb74092990 con 0x7fdb7405e490 2026-02-12T18:08:24.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb79d0c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:24.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb79d0c640 10 monclient(hunting): authenticate will time out at 742.740487s 2026-02-12T18:08:24.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb737fe640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7fdb7405c950 0x7fdb7405cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:45720/0 (socket says 10.20.193.48:45720) 2026-02-12T18:08:24.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb737fe640 1 -- 10.20.193.48:0/3954329922 learned_addr learned my addr 10.20.193.48:0/3954329922 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:08:24.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb72ffd640 1 --2- 10.20.193.48:0/3954329922 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fdb7405e490 0x7fdb741857b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb72ffd640 10 monclient(hunting): get_auth_request con 0x7fdb7405e490 auth_method 0 2026-02-12T18:08:24.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb73fff640 1 --2- 10.20.193.48:0/3954329922 >> v2:10.20.193.111:3300/0 conn(0x7fdb7405d430 0x7fdb741a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb72ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb72ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb72ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb73fff640 10 monclient(hunting): get_auth_request con 0x7fdb7405d430 auth_method 0 2026-02-12T18:08:24.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb73fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb73fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb73fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb73fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb73fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb73fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb72ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb72ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.014+0000 7fdb72ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.015+0000 7fdb72ffd640 10 monclient(hunting): handle_auth_done global_id 44134 payload 274 2026-02-12T18:08:24.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.015+0000 7fdb72ffd640 1 -- 10.20.193.48:0/3954329922 >> v2:10.20.193.111:3300/0 conn(0x7fdb7405d430 msgr2=0x7fdb741a5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:24.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.015+0000 7fdb72ffd640 1 --2- 10.20.193.48:0/3954329922 >> v2:10.20.193.111:3300/0 conn(0x7fdb7405d430 0x7fdb741a5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.015+0000 7fdb72ffd640 1 -- 10.20.193.48:0/3954329922 >> v1:10.20.193.48:6789/0 conn(0x7fdb7405c950 legacy=0x7fdb7405cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:24.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.015+0000 7fdb72ffd640 10 monclient: _finish_hunting 0 2026-02-12T18:08:24.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.015+0000 7fdb72ffd640 1 monclient: found mon.noname-i 2026-02-12T18:08:24.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.015+0000 7fdb72ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:24.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.015+0000 7fdb72ffd640 10 monclient: _send_mon_message to mon.noname-i at v2:10.20.193.111:3303/0 2026-02-12T18:08:24.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.015+0000 7fdb72ffd640 1 -- 10.20.193.48:0/3954329922 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb74092c70 con 0x7fdb7405e490 2026-02-12T18:08:24.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.015+0000 7fdb73fff640 1 --2- 10.20.193.48:0/3954329922 >> v2:10.20.193.111:3300/0 conn(0x7fdb7405d430 0x7fdb741a5d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:08:24.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.017+0000 7fdb72ffd640 1 -- 10.20.193.48:0/3954329922 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fdb7405e490 msgr2=0x7fdb741857b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:24.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.017+0000 7fdb72ffd640 1 --2- 10.20.193.48:0/3954329922 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fdb7405e490 0x7fdb741857b0 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=31174074362865923 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb64004740 tx=0x7fdb6402ed30 comp rx=0 tx=0).ready entity=mon.7 client_cookie=6ec0a7cc99a903 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.017+0000 7fdb727fc640 1 -- 10.20.193.48:0/3954329922 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fdb6402fe70 con 0x7fdb7405e490 2026-02-12T18:08:24.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.017+0000 7fdb727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.017+0000 7fdb727fc640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2026-02-12T18:08:24.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.017+0000 7fdb727fc640 10 monclient: dump: 2026-02-12T18:08:24.024 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.024 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.025 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.025 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.025 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.025 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.025 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.025 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.025 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.025 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.025 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.025 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.025 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.025 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.025 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.025 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.017+0000 7fdb727fc640 10 monclient: _finish_auth 0 2026-02-12T18:08:24.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.017+0000 7fdb727fc640 10 monclient: _check_auth_tickets 2026-02-12T18:08:24.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.017+0000 7fdb727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:24.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.017+0000 7fdb727fc640 1 -- 10.20.193.48:0/3954329922 <== mon.7 v2:10.20.193.111:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb64035340 con 0x7fdb7405e490 2026-02-12T18:08:24.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.017+0000 7fdb727fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:24.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.017+0000 7fdb79d0c640 5 monclient: authenticate success, global_id 44134 2026-02-12T18:08:24.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.017+0000 7fdb79d0c640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:24.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.017+0000 7fdb79d0c640 4 set_mon_vals no callback set 2026-02-12T18:08:24.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.017+0000 7fdb727fc640 1 -- 10.20.193.48:0/3954329922 <== mon.7 v2:10.20.193.111:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fdb640354b0 con 0x7fdb7405e490 2026-02-12T18:08:24.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.017+0000 7fdb727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.017+0000 7fdb727fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:08:24.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.017+0000 7fdb727fc640 10 monclient: dump: 2026-02-12T18:08:24.026 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.026 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.026 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.026 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.026 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.026 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.026 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.026 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.026 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.026 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.026 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.026 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.026 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.026 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.026 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.027 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.018+0000 7fdb79d0c640 10 monclient: shutdown 2026-02-12T18:08:24.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.018+0000 7fdb79d0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:24.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.018+0000 7fdb79d0c640 1 -- 10.20.193.48:0/3954329922 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fdb7405e490 msgr2=0x7fdb741857b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.018+0000 7fdb79d0c640 1 --2- 10.20.193.48:0/3954329922 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fdb7405e490 0x7fdb741857b0 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=31174074362865923 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb64004740 tx=0x7fdb6402ed30 comp rx=0 tx=0).stop 2026-02-12T18:08:24.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.018+0000 7fdb79d0c640 1 -- 10.20.193.48:0/3954329922 shutdown_connections 2026-02-12T18:08:24.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.018+0000 7fdb79d0c640 1 --2- 10.20.193.48:0/3954329922 >> v2:10.20.193.111:3300/0 conn(0x7fdb7405d430 0x7fdb741a5d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.018+0000 7fdb79d0c640 1 --2- 10.20.193.48:0/3954329922 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fdb7405e490 0x7fdb741857b0 unknown :-1 s=CLOSED pgs=18 gs=2 cs=0 l=1 c_cookie=31174074362865923 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.018+0000 7fdb79d0c640 1 -- 10.20.193.48:0/3954329922 >> 10.20.193.48:0/3954329922 conn(0x7fdb740548a0 msgr2=0x7fdb74097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:24.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.018+0000 7fdb79d0c640 1 -- 10.20.193.48:0/3954329922 shutdown_connections 2026-02-12T18:08:24.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.018+0000 7fdb79d0c640 1 -- 10.20.193.48:0/3954329922 wait complete. 2026-02-12T18:08:24.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.018+0000 7fdb79d0c640 10 monclient: build_initial_monmap 2026-02-12T18:08:24.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.018+0000 7fdb79d0c640 10 monclient: monmap: 2026-02-12T18:08:24.027 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:24.027 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:24.027 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:24.027 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:24.027 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:24.027 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.028 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:24.028 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:24.028 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:24.028 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:24.028 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:24.028 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:24.028 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:24.028 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:24.028 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:24.028 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.018+0000 7fdb79d0c640 1 Processor -- start 2026-02-12T18:08:24.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.018+0000 7fdb79d0c640 1 -- start start 2026-02-12T18:08:24.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.018+0000 7fdb79d0c640 10 monclient: init 2026-02-12T18:08:24.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb79d0c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:24.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb79d0c640 10 monclient: _add_conns ranks=[0,3,7,8,5,4,1,6,2] 2026-02-12T18:08:24.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb79d0c640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fdb7405c950 0x7fdb74090270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb79d0c640 10 monclient(hunting): picked mon.noname-a con 0x7fdb7405c950 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:08:24.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb79d0c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fdb7405d430 0x7fdb740907b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb79d0c640 10 monclient(hunting): picked mon.noname-g con 0x7fdb7405d430 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:08:24.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb79d0c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fdb7405e490 0x7fdb74090cf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb79d0c640 10 monclient(hunting): picked mon.noname-i con 0x7fdb7405e490 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:24.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb79d0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb79d0c640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fdb7408dc00 con 0x7fdb7405c950 2026-02-12T18:08:24.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb79d0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb79d0c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fdb74141970 con 0x7fdb7405d430 2026-02-12T18:08:24.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb79d0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb79d0c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fdb7408bde0 con 0x7fdb7405e490 2026-02-12T18:08:24.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb79d0c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:24.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb79d0c640 10 monclient(hunting): authenticate will time out at 742.745239s 2026-02-12T18:08:24.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb737fe640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fdb7405c950 0x7fdb74090270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb737fe640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fdb7405c950 0x7fdb74090270 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:38026/0 (socket says 10.20.193.48:38026) 2026-02-12T18:08:24.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb737fe640 1 -- 10.20.193.48:0/1478726014 learned_addr learned my addr 10.20.193.48:0/1478726014 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:24.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb737fe640 10 monclient(hunting): get_auth_request con 0x7fdb7405c950 auth_method 0 2026-02-12T18:08:24.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb737fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb737fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb737fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb737fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb737fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb73fff640 1 --2- 10.20.193.48:0/1478726014 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fdb7405e490 0x7fdb74090cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb73fff640 10 monclient(hunting): get_auth_request con 0x7fdb7405e490 auth_method 0 2026-02-12T18:08:24.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb73fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb73fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb73fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb72ffd640 1 --2- 10.20.193.48:0/1478726014 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fdb7405d430 0x7fdb740907b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb72ffd640 10 monclient(hunting): get_auth_request con 0x7fdb7405d430 auth_method 0 2026-02-12T18:08:24.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb72ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb72ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb72ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb73fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb73fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb73fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb737fe640 10 monclient(hunting): handle_auth_done global_id 5094 payload 824 2026-02-12T18:08:24.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb737fe640 1 -- 10.20.193.48:0/1478726014 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fdb7405e490 msgr2=0x7fdb74090cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb737fe640 1 --2- 10.20.193.48:0/1478726014 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fdb7405e490 0x7fdb74090cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb737fe640 1 -- 10.20.193.48:0/1478726014 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fdb7405d430 msgr2=0x7fdb740907b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb737fe640 1 --2- 10.20.193.48:0/1478726014 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fdb7405d430 0x7fdb740907b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb737fe640 10 monclient: _finish_hunting 0 2026-02-12T18:08:24.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb737fe640 1 monclient: found mon.noname-a 2026-02-12T18:08:24.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:24.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb737fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:08:24.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.019+0000 7fdb737fe640 1 -- 10.20.193.48:0/1478726014 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb6800a500 con 0x7fdb7405c950 2026-02-12T18:08:24.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.021+0000 7fdb737fe640 1 -- 10.20.193.48:0/1478726014 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fdb7405c950 msgr2=0x7fdb74090270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:24.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.021+0000 7fdb737fe640 1 --2- 10.20.193.48:0/1478726014 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fdb7405c950 0x7fdb74090270 secure :-1 s=READY pgs=214 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb60007fd0 tx=0x7fdb6000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.021+0000 7fdb4ffff640 1 -- 10.20.193.48:0/1478726014 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fdb60005db0 con 0x7fdb7405c950 2026-02-12T18:08:24.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.021+0000 7fdb4ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.021+0000 7fdb4ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:08:24.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.021+0000 7fdb4ffff640 10 monclient: dump: 2026-02-12T18:08:24.031 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.031 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.031 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.031 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.031 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.031 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.031 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.031 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.031 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.031 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.031 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.031 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.031 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.032 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.032 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.032 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.021+0000 7fdb4ffff640 10 monclient: _finish_auth 0 2026-02-12T18:08:24.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.021+0000 7fdb4ffff640 10 monclient: _check_auth_tickets 2026-02-12T18:08:24.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.021+0000 7fdb4ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:24.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.021+0000 7fdb4ffff640 1 -- 10.20.193.48:0/1478726014 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb60007530 con 0x7fdb7405c950 2026-02-12T18:08:24.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.021+0000 7fdb79d0c640 5 monclient: authenticate success, global_id 5094 2026-02-12T18:08:24.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.021+0000 7fdb79d0c640 10 monclient: _renew_subs 2026-02-12T18:08:24.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.021+0000 7fdb79d0c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:08:24.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.021+0000 7fdb79d0c640 1 -- 10.20.193.48:0/1478726014 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb64009420 con 0x7fdb7405c950 2026-02-12T18:08:24.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.021+0000 7fdb4ffff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:24.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.021+0000 7fdb4ffff640 1 -- 10.20.193.48:0/1478726014 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fdb600076a0 con 0x7fdb7405c950 2026-02-12T18:08:24.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.021+0000 7fdb4ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.021+0000 7fdb4ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:08:24.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.021+0000 7fdb71ffb640 4 set_mon_vals no callback set 2026-02-12T18:08:24.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.021+0000 7fdb4ffff640 10 monclient: dump: 2026-02-12T18:08:24.032 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.032 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.032 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.033 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.033 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.033 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.033 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.033 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.033 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.033 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.033 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.033 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.033 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.033 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.033 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.033 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.021+0000 7fdb79d0c640 10 monclient: _renew_subs 2026-02-12T18:08:24.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.021+0000 7fdb79d0c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:08:24.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.021+0000 7fdb79d0c640 1 -- 10.20.193.48:0/1478726014 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb7408b530 con 0x7fdb7405c950 2026-02-12T18:08:24.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.022+0000 7fdb79d0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:24.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.022+0000 7fdb79d0c640 1 --2- 10.20.193.48:0/1478726014 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdb741a53f0 0x7fdb741a57c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.022+0000 7fdb79d0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.022+0000 7fdb79d0c640 1 -- 10.20.193.48:0/1478726014 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fdb7405f140 con 0x7fdb741a53f0 2026-02-12T18:08:24.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.022+0000 7fdb72ffd640 1 --2- 10.20.193.48:0/1478726014 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdb741a53f0 0x7fdb741a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.022+0000 7fdb72ffd640 10 monclient: get_auth_request con 0x7fdb741a53f0 auth_method 0 2026-02-12T18:08:24.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.022+0000 7fdb72ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.022+0000 7fdb72ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.022+0000 7fdb72ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.022+0000 7fdb72ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.022+0000 7fdb72ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.022+0000 7fdb72ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.022+0000 7fdb4ffff640 1 -- 10.20.193.48:0/1478726014 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fdb60007070 con 0x7fdb7405c950 2026-02-12T18:08:24.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.022+0000 7fdb72ffd640 10 monclient(hunting): handle_auth_done global_id 5003 payload 824 2026-02-12T18:08:24.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.022+0000 7fdb72ffd640 1 -- 10.20.193.48:0/1478726014 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdb741411e0 con 0x7fdb741a53f0 2026-02-12T18:08:24.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.023+0000 7fdb4ffff640 1 --2- 10.20.193.48:0/1478726014 >> v2:10.20.193.111:6812/977811348 conn(0x7fdb4403f800 0x7fdb4405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.023+0000 7fdb4ffff640 1 -- 10.20.193.48:0/1478726014 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 3897+0+0 (secure 0 0 0) 0x7fdb60051fc0 con 0x7fdb7405c950 2026-02-12T18:08:24.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.023+0000 7fdb73fff640 1 --2- 10.20.193.48:0/1478726014 >> v2:10.20.193.111:6812/977811348 conn(0x7fdb4403f800 0x7fdb4405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.023+0000 7fdb73fff640 10 monclient: get_auth_request con 0x7fdb4403f800 auth_method 0 2026-02-12T18:08:24.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.024+0000 7fdb72ffd640 1 -- 10.20.193.48:0/1478726014 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdb741a53f0 msgr2=0x7fdb741a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:24.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.025+0000 7fdb72ffd640 1 --2- 10.20.193.48:0/1478726014 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdb741a53f0 0x7fdb741a57c0 secure :-1 s=READY pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb640023d0 tx=0x7fdb64004770 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.025+0000 7fdb4ffff640 1 -- 10.20.193.48:0/1478726014 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fdb64003da0 con 0x7fdb741a53f0 2026-02-12T18:08:24.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.025+0000 7fdb4ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.025+0000 7fdb4ffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:08:24.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.025+0000 7fdb4ffff640 10 monclient: dump: 2026-02-12T18:08:24.036 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.037 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.037 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.037 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.037 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.037 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.037 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.037 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.037 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.037 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.037 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.037 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.037 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.037 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.037 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.037 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.025+0000 7fdb4ffff640 1 -- 10.20.193.48:0/1478726014 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fdb640038e0 con 0x7fdb741a53f0 2026-02-12T18:08:24.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.025+0000 7fdb4ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:24.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.025+0000 7fdb4ffff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:24.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.025+0000 7fdb4ffff640 1 -- 10.20.193.48:0/1478726014 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdb741a53f0 msgr2=0x7fdb741a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.025+0000 7fdb4ffff640 1 --2- 10.20.193.48:0/1478726014 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdb741a53f0 0x7fdb741a57c0 secure :-1 s=READY pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb640023d0 tx=0x7fdb64004770 comp rx=0 tx=0).stop 2026-02-12T18:08:24.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.025+0000 7fdb4ffff640 1 -- 10.20.193.48:0/1478726014 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdb741a53f0 msgr2=0x7fdb741a57c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:24.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.025+0000 7fdb4ffff640 1 --2- 10.20.193.48:0/1478726014 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdb741a53f0 0x7fdb741a57c0 secure :-1 s=CLOSED pgs=113 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb640023d0 tx=0x7fdb64004770 comp rx=0 tx=0).stop 2026-02-12T18:08:24.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.025+0000 7fdb73fff640 1 --2- 10.20.193.48:0/1478726014 >> v2:10.20.193.111:6812/977811348 conn(0x7fdb4403f800 0x7fdb4405fcb0 secure :-1 s=READY pgs=171 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb68005820 tx=0x7fdb6800a2d0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.028+0000 7fdb79d0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:08:24.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.028+0000 7fdb79d0c640 1 --2- 10.20.193.48:0/1478726014 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdb741a5d00 0x7fdb7412e190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.028+0000 7fdb79d0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.028+0000 7fdb79d0c640 1 -- 10.20.193.48:0/1478726014 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fdb7405fd90 con 0x7fdb741a5d00 2026-02-12T18:08:24.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.028+0000 7fdb72ffd640 1 --2- 10.20.193.48:0/1478726014 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdb741a5d00 0x7fdb7412e190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.028+0000 7fdb72ffd640 10 monclient: get_auth_request con 0x7fdb741a5d00 auth_method 0 2026-02-12T18:08:24.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.028+0000 7fdb72ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.028+0000 7fdb72ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.028+0000 7fdb72ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.028+0000 7fdb72ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.028+0000 7fdb72ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.028+0000 7fdb72ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.028+0000 7fdb72ffd640 10 monclient(hunting): handle_auth_done global_id 5012 payload 824 2026-02-12T18:08:24.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.028+0000 7fdb72ffd640 1 -- 10.20.193.48:0/1478726014 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdb7405cd20 con 0x7fdb741a5d00 2026-02-12T18:08:24.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.031+0000 7fdb72ffd640 1 -- 10.20.193.48:0/1478726014 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdb741a5d00 msgr2=0x7fdb7412e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:24.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.031+0000 7fdb72ffd640 1 --2- 10.20.193.48:0/1478726014 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdb741a5d00 0x7fdb7412e190 secure :-1 s=READY pgs=114 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb64009750 tx=0x7fdb64009210 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.031+0000 7fdb4ffff640 1 -- 10.20.193.48:0/1478726014 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fdb64051040 con 0x7fdb741a5d00 2026-02-12T18:08:24.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.031+0000 7fdb4ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.031+0000 7fdb4ffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:08:24.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.031+0000 7fdb4ffff640 10 monclient: dump: 2026-02-12T18:08:24.039 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.039 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.039 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.039 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.039 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.039 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.039 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.039 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.039 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.039 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.039 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.039 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.039 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.039 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.039 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.039 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.031+0000 7fdb4ffff640 1 -- 10.20.193.48:0/1478726014 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10015 (secure 0 0 0) 0x7fdb6404c660 con 0x7fdb741a5d00 2026-02-12T18:08:24.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.031+0000 7fdb4ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:08:24.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.031+0000 7fdb4ffff640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:24.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.031+0000 7fdb4ffff640 1 -- 10.20.193.48:0/1478726014 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdb741a5d00 msgr2=0x7fdb7412e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.031+0000 7fdb4ffff640 1 --2- 10.20.193.48:0/1478726014 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdb741a5d00 0x7fdb7412e190 secure :-1 s=READY pgs=114 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb64009750 tx=0x7fdb64009210 comp rx=0 tx=0).stop 2026-02-12T18:08:24.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.031+0000 7fdb4ffff640 1 -- 10.20.193.48:0/1478726014 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdb741a5d00 msgr2=0x7fdb7412e190 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:24.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.031+0000 7fdb4ffff640 1 --2- 10.20.193.48:0/1478726014 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdb741a5d00 0x7fdb7412e190 secure :-1 s=CLOSED pgs=114 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb64009750 tx=0x7fdb64009210 comp rx=0 tx=0).stop 2026-02-12T18:08:24.040 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:08:24.040 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:08:24.040 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:08:24.040 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:08:24.040 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 28, 2026-02-12T18:08:24.040 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 158858, 2026-02-12T18:08:24.041 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:08:24.041 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:08:24.041 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:08:24.041 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:08:24.041 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:08:24.041 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:08:24.041 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:08:24.041 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:08:24.041 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:08:24.041 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:08:24.041 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:24.041 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:08:24.041 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:24.041 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:08:24.041 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:08:24.041 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:24.041 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:24.041 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:24.042 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:24.042 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:24.042 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:24.042 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:24.042 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:24.042 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:24.042 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:24.042 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:24.042 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:24.042 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:24.042 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:24.042 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:08:24.042 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:08:24.042 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:24.042 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:24.042 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:24.042 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:24.042 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:24.042 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:24.042 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:24.042 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:24.043 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:24.043 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:24.043 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:24.043 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:24.043 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:24.043 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.043 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.043 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:08:24.043 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:08:24.043 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:08:24.043 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:08:24.043 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:08:24.043 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:08:24.043 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:24.043 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:24.043 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:08:24.043 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:08:24.043 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:08:24.043 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:08:24.043 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:08:24.044 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:08:24.044 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:08:24.044 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:24.044 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:08:24.044 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:24.044 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:24.044 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:24.044 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:24.044 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:24.044 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:24.044 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:24.044 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:24.044 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:24.044 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:24.044 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:24.044 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:24.044 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:24.044 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:24.044 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:08:24.044 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.044 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:08:24.044 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.045 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:24.045 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:24.045 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.045 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.045 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.045 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.045 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:08:24.045 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.045 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.045 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.045 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.045 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:08:24.045 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.045 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.045 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.045 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.045 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:08:24.045 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:08:24.045 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.045 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.045 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:08:24.045 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.046 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.046 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.046 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:24.046 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:24.046 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.046 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.046 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.046 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.046 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:08:24.046 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.046 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.046 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.046 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.046 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:08:24.046 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.046 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.046 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.046 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.046 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:08:24.046 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:08:24.046 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.046 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.046 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:08:24.047 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.047 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.047 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.047 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:24.047 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:24.047 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.047 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.047 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.047 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.047 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:08:24.047 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.047 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.047 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.047 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.047 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:08:24.047 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.047 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.047 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.047 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.047 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:08:24.047 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:08:24.047 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.047 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.048 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:08:24.048 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.048 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.048 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.048 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:08:24.048 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:08:24.048 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.048 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.048 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.048 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.048 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:08:24.048 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.048 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.048 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.048 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.048 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:08:24.048 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.048 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.048 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.048 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.048 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:08:24.048 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:08:24.049 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.049 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.049 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:08:24.049 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.049 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.049 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.049 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:08:24.049 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:08:24.049 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.049 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.049 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.049 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.049 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:08:24.049 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.049 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.049 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.049 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.049 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:08:24.049 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.049 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.049 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.049 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.050 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:08:24.050 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:08:24.050 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.050 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.050 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:24.050 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.050 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.050 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.050 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:24.050 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:24.050 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.050 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.050 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.050 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.050 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:08:24.050 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.050 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.050 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.050 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.050 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:08:24.050 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.050 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.050 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.050 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.051 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:08:24.051 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:08:24.051 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.051 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.051 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:08:24.051 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.051 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.051 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.051 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:24.051 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:24.051 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.051 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.051 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.051 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.051 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:08:24.051 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.051 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.051 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.051 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.051 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:08:24.051 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.051 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.051 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.051 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.051 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:08:24.052 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:08:24.052 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.052 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.052 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:24.052 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.052 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.052 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.052 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:24.052 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:24.052 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.052 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.052 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.052 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.052 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:08:24.052 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.052 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.052 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.052 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.052 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:08:24.052 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.052 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.052 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.052 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.052 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:08:24.052 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:08:24.053 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.053 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.053 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:08:24.053 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.053 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.053 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.053 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:08:24.053 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:08:24.053 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.053 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.053 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.053 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.053 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:08:24.053 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.053 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.053 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.053 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.053 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:08:24.053 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.053 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.053 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.053 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.053 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:08:24.053 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:08:24.053 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.053 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.054 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:08:24.054 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.054 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.054 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.054 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.054 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:08:24.054 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:08:24.054 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.054 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:24.054 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:24.054 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:24.054 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.054 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:24.054 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:08:24.054 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.054 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:24.054 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:24.054 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:24.054 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.054 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.054 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.054 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:08:24.054 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:08:24.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.031+0000 7fdb79d0c640 1 -- 10.20.193.48:0/1478726014 >> v2:10.20.193.111:6812/977811348 conn(0x7fdb4403f800 msgr2=0x7fdb4405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.031+0000 7fdb79d0c640 1 --2- 10.20.193.48:0/1478726014 >> v2:10.20.193.111:6812/977811348 conn(0x7fdb4403f800 0x7fdb4405fcb0 secure :-1 s=READY pgs=171 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb68005820 tx=0x7fdb6800a2d0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.031+0000 7fdb79d0c640 10 monclient: shutdown 2026-02-12T18:08:24.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.031+0000 7fdb79d0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:24.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.031+0000 7fdb79d0c640 1 -- 10.20.193.48:0/1478726014 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fdb7405c950 msgr2=0x7fdb74090270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.031+0000 7fdb79d0c640 1 --2- 10.20.193.48:0/1478726014 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fdb7405c950 0x7fdb74090270 secure :-1 s=READY pgs=214 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdb60007fd0 tx=0x7fdb6000c970 comp rx=0 tx=0).stop 2026-02-12T18:08:24.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.031+0000 7fdb73fff640 1 -- 10.20.193.48:0/1478726014 reap_dead start 2026-02-12T18:08:24.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.031+0000 7fdb79d0c640 1 -- 10.20.193.48:0/1478726014 shutdown_connections 2026-02-12T18:08:24.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.031+0000 7fdb79d0c640 1 --2- 10.20.193.48:0/1478726014 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fdb7405c950 0x7fdb74090270 unknown :-1 s=CLOSED pgs=214 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.031+0000 7fdb79d0c640 1 -- 10.20.193.48:0/1478726014 >> 10.20.193.48:0/1478726014 conn(0x7fdb740548a0 msgr2=0x7fdb7413f120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:24.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.031+0000 7fdb79d0c640 1 -- 10.20.193.48:0/1478726014 shutdown_connections 2026-02-12T18:08:24.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.031+0000 7fdb79d0c640 1 -- 10.20.193.48:0/1478726014 wait complete. 2026-02-12T18:08:24.056 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:08:24.056 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2026-02-12T18:08:24.056 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2026-02-12T18:08:24.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.120+0000 7f6491836640 10 monclient: get_monmap_and_config 2026-02-12T18:08:24.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.120+0000 7f6491836640 10 monclient: build_initial_monmap 2026-02-12T18:08:24.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.120+0000 7f6491836640 10 monclient: monmap: 2026-02-12T18:08:24.122 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:24.122 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.122 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:24.121478+0000 2026-02-12T18:08:24.122 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:24.121478+0000 2026-02-12T18:08:24.122 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:24.122 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.122 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:24.122 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:24.122 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:24.122 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:24.122 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:24.122 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:24.122 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:24.122 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:24.122 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:24.122 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:24.122 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:24.122 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.120+0000 7f6491836640 1 Processor -- start 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.120+0000 7f6491836640 1 -- start start 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.120+0000 7f6491836640 10 monclient: init 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f6491836640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f6491836640 10 monclient: _add_conns ranks=[2,9,0,5,7,10,3,8,6,4,1] 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f6491836640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f648c05c950 0x7f648c05cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f6491836640 10 monclient(hunting): picked mon.noname-b con 0x7f648c05c950 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f6491836640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f648c05e490 0x7f648c05d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f6491836640 10 monclient(hunting): picked mon.noname-a con 0x7f648c05e490 addr v2:10.20.193.48:3300/0 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f6491836640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f648c13db70 addr v1:10.20.193.48:6789/0 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f6491836640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f648c04dc20 con 0x7f648c13db70 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f6491836640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f6491836640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f648c05ddd0 con 0x7f648c05e490 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f6491836640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f6491836640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f648c05d7a0 con 0x7f648c05c950 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f6491836640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f6491836640 10 monclient(hunting): authenticate will time out at 742.847178s 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648affd640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f648c05c950 0x7f648c05cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648a7fc640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f648c05e490 0x7f648c05d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648a7fc640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f648c05e490 0x7f648c05d260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:38036/0 (socket says 10.20.193.48:38036) 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648affd640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f648c05c950 0x7f648c05cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:52502/0 (socket says 10.20.193.48:52502) 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648affd640 1 -- 10.20.193.48:0/954791924 learned_addr learned my addr 10.20.193.48:0/954791924 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648affd640 10 monclient(hunting): get_auth_request con 0x7f648c05c950 auth_method 0 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648a7fc640 10 monclient(hunting): get_auth_request con 0x7f648c05e490 auth_method 0 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648affd640 10 monclient(hunting): handle_auth_done global_id 34976 payload 274 2026-02-12T18:08:24.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648affd640 1 -- 10.20.193.48:0/954791924 >> v2:10.20.193.48:3300/0 conn(0x7f648c05e490 msgr2=0x7f648c05d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:24.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648affd640 1 --2- 10.20.193.48:0/954791924 >> v2:10.20.193.48:3300/0 conn(0x7f648c05e490 0x7f648c05d260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648affd640 1 -- 10.20.193.48:0/954791924 >> v1:10.20.193.48:6789/0 conn(0x7f648c13db70 legacy=0x7f648c13e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:24.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648affd640 10 monclient: _finish_hunting 0 2026-02-12T18:08:24.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648affd640 1 monclient: found mon.noname-b 2026-02-12T18:08:24.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:24.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648affd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:08:24.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.121+0000 7f648affd640 1 -- 10.20.193.48:0/954791924 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f648c092990 con 0x7f648c05c950 2026-02-12T18:08:24.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f648affd640 1 -- 10.20.193.48:0/954791924 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f648c05c950 msgr2=0x7f648c05cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:24.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f648affd640 1 --2- 10.20.193.48:0/954791924 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f648c05c950 0x7f648c05cd20 secure :-1 s=READY pgs=102 gs=2 cs=0 l=1 c_cookie=14473214078860946331 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6480009060 tx=0x7f648002edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8db2f85b8b06b9b server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f6489ffb640 1 -- 10.20.193.48:0/954791924 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6480035340 con 0x7f648c05c950 2026-02-12T18:08:24.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f6489ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f6489ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:08:24.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f6489ffb640 10 monclient: dump: 2026-02-12T18:08:24.125 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.125 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.125 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.125 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.125 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.125 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.125 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.125 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.125 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.125 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.125 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.125 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.125 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.125 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.125 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.125 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f6489ffb640 10 monclient: _finish_auth 0 2026-02-12T18:08:24.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f6489ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:08:24.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f6489ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:24.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f6489ffb640 1 -- 10.20.193.48:0/954791924 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64800354c0 con 0x7f648c05c950 2026-02-12T18:08:24.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f6489ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:24.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f6489ffb640 1 -- 10.20.193.48:0/954791924 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6480035af0 con 0x7f648c05c950 2026-02-12T18:08:24.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f6491836640 5 monclient: authenticate success, global_id 34976 2026-02-12T18:08:24.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f6491836640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:24.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f6491836640 4 set_mon_vals no callback set 2026-02-12T18:08:24.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f6489ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f6489ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:08:24.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f6489ffb640 10 monclient: dump: 2026-02-12T18:08:24.126 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.126 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.126 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.126 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.126 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.126 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.126 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.126 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.126 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.126 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.126 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.126 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.126 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.126 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.126 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.126 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f6491836640 10 monclient: shutdown 2026-02-12T18:08:24.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f6491836640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:24.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f6491836640 1 -- 10.20.193.48:0/954791924 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f648c05c950 msgr2=0x7f648c05cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f6491836640 1 --2- 10.20.193.48:0/954791924 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f648c05c950 0x7f648c05cd20 secure :-1 s=READY pgs=102 gs=2 cs=0 l=1 c_cookie=14473214078860946331 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6480009060 tx=0x7f648002edf0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f6491836640 1 -- 10.20.193.48:0/954791924 shutdown_connections 2026-02-12T18:08:24.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f6491836640 1 --2- 10.20.193.48:0/954791924 >> v2:10.20.193.48:3300/0 conn(0x7f648c05e490 0x7f648c05d260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f6491836640 1 --2- 10.20.193.48:0/954791924 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f648c05c950 0x7f648c05cd20 unknown :-1 s=CLOSED pgs=102 gs=2 cs=0 l=1 c_cookie=14473214078860946331 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f6491836640 1 -- 10.20.193.48:0/954791924 >> 10.20.193.48:0/954791924 conn(0x7f648c0548a0 msgr2=0x7f648c097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:24.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f6491836640 1 -- 10.20.193.48:0/954791924 shutdown_connections 2026-02-12T18:08:24.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.124+0000 7f6491836640 1 -- 10.20.193.48:0/954791924 wait complete. 2026-02-12T18:08:24.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.125+0000 7f6491836640 10 monclient: build_initial_monmap 2026-02-12T18:08:24.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.125+0000 7f6491836640 10 monclient: monmap: 2026-02-12T18:08:24.127 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:24.127 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:24.127 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:24.127 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.125+0000 7f6491836640 1 Processor -- start 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.125+0000 7f6491836640 1 -- start start 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.125+0000 7f6491836640 10 monclient: init 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.125+0000 7f6491836640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.125+0000 7f6491836640 10 monclient: _add_conns ranks=[6,7,1,3,2,4,0,8,5] 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.125+0000 7f6491836640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f648c05c950 0x7f648c12c940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.125+0000 7f6491836640 10 monclient(hunting): picked mon.noname-d con 0x7f648c05c950 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.125+0000 7f6491836640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f648c05e490 0x7f648c08d450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.125+0000 7f6491836640 10 monclient(hunting): picked mon.noname-i con 0x7f648c05e490 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.125+0000 7f6491836640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f648c13db70 0x7f648c13cd70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.125+0000 7f6491836640 10 monclient(hunting): picked mon.noname-f con 0x7f648c13db70 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.125+0000 7f6491836640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.125+0000 7f6491836640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f648c143ad0 con 0x7f648c13db70 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.125+0000 7f6491836640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.125+0000 7f6491836640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f648c12d3c0 con 0x7f648c05c950 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.125+0000 7f6491836640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.125+0000 7f6491836640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f648c13e3a0 con 0x7f648c05e490 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.125+0000 7f6491836640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.125+0000 7f6491836640 10 monclient(hunting): authenticate will time out at 742.851932s 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.125+0000 7f648affd640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f648c05c950 0x7f648c12c940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.125+0000 7f648affd640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f648c05c950 0x7f648c12c940 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:59554/0 (socket says 10.20.193.48:59554) 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648affd640 1 -- 10.20.193.48:0/3127437150 learned_addr learned my addr 10.20.193.48:0/3127437150 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648affd640 10 monclient(hunting): get_auth_request con 0x7f648c05c950 auth_method 0 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648b7fe640 1 --2- 10.20.193.48:0/3127437150 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f648c13db70 0x7f648c13cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648a7fc640 1 --2- 10.20.193.48:0/3127437150 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f648c05e490 0x7f648c08d450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648b7fe640 10 monclient(hunting): get_auth_request con 0x7f648c13db70 auth_method 0 2026-02-12T18:08:24.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648a7fc640 10 monclient(hunting): get_auth_request con 0x7f648c05e490 auth_method 0 2026-02-12T18:08:24.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648affd640 10 monclient(hunting): handle_auth_done global_id 4920 payload 824 2026-02-12T18:08:24.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648affd640 1 -- 10.20.193.48:0/3127437150 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f648c05e490 msgr2=0x7f648c08d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648affd640 1 --2- 10.20.193.48:0/3127437150 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f648c05e490 0x7f648c08d450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648affd640 1 -- 10.20.193.48:0/3127437150 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f648c13db70 msgr2=0x7f648c13cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648affd640 1 --2- 10.20.193.48:0/3127437150 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f648c13db70 0x7f648c13cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648affd640 10 monclient: _finish_hunting 0 2026-02-12T18:08:24.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648affd640 1 monclient: found mon.noname-d 2026-02-12T18:08:24.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:24.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648affd640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:08:24.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.126+0000 7f648affd640 1 -- 10.20.193.48:0/3127437150 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64800094f0 con 0x7f648c05c950 2026-02-12T18:08:24.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.128+0000 7f648affd640 1 -- 10.20.193.48:0/3127437150 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f648c05c950 msgr2=0x7f648c12c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:24.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.128+0000 7f648affd640 1 --2- 10.20.193.48:0/3127437150 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f648c05c950 0x7f648c12c940 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64800099a0 tx=0x7f6480004770 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.128+0000 7f6463fff640 1 -- 10.20.193.48:0/3127437150 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6480035e30 con 0x7f648c05c950 2026-02-12T18:08:24.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.128+0000 7f6463fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.128+0000 7f6463fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.128+0000 7f6463fff640 10 monclient: dump: 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.128+0000 7f6463fff640 10 monclient: _finish_auth 0 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.128+0000 7f6463fff640 10 monclient: _check_auth_tickets 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.128+0000 7f6463fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.128+0000 7f6463fff640 1 -- 10.20.193.48:0/3127437150 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64800044f0 con 0x7f648c05c950 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.128+0000 7f6463fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.128+0000 7f6463fff640 1 -- 10.20.193.48:0/3127437150 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6480003b90 con 0x7f648c05c950 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.128+0000 7f6463fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.128+0000 7f64897fa640 4 set_mon_vals no callback set 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.128+0000 7f6463fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.128+0000 7f6463fff640 10 monclient: dump: 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.128+0000 7f6491836640 5 monclient: authenticate success, global_id 4920 2026-02-12T18:08:24.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.128+0000 7f6491836640 10 monclient: _renew_subs 2026-02-12T18:08:24.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.128+0000 7f6491836640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:08:24.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.128+0000 7f6491836640 1 -- 10.20.193.48:0/3127437150 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f648c08af10 con 0x7f648c05c950 2026-02-12T18:08:24.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.128+0000 7f6491836640 10 monclient: _renew_subs 2026-02-12T18:08:24.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.128+0000 7f6491836640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:08:24.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.128+0000 7f6491836640 1 -- 10.20.193.48:0/3127437150 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f648c0901c0 con 0x7f648c05c950 2026-02-12T18:08:24.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.129+0000 7f6491836640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:24.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.129+0000 7f6491836640 1 --2- 10.20.193.48:0/3127437150 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f648c08d990 0x7f648c13d2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.129+0000 7f6491836640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.129+0000 7f6491836640 1 -- 10.20.193.48:0/3127437150 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f648c05f140 con 0x7f648c08d990 2026-02-12T18:08:24.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.129+0000 7f6463fff640 1 -- 10.20.193.48:0/3127437150 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f6480003cf0 con 0x7f648c05c950 2026-02-12T18:08:24.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.129+0000 7f6463fff640 1 --2- 10.20.193.48:0/3127437150 >> v2:10.20.193.111:6812/977811348 conn(0x7f645c03f800 0x7f645c05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.129+0000 7f648a7fc640 1 --2- 10.20.193.48:0/3127437150 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f648c08d990 0x7f648c13d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.129+0000 7f648a7fc640 10 monclient: get_auth_request con 0x7f648c08d990 auth_method 0 2026-02-12T18:08:24.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.129+0000 7f648a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.129+0000 7f648a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.129+0000 7f648a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.129+0000 7f6463fff640 1 -- 10.20.193.48:0/3127437150 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(114..114 src has 1..114) ==== 3897+0+0 (secure 0 0 0) 0x7f6480077ef0 con 0x7f648c05c950 2026-02-12T18:08:24.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.129+0000 7f648a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.129+0000 7f648a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.129+0000 7f648a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.129+0000 7f648b7fe640 1 --2- 10.20.193.48:0/3127437150 >> v2:10.20.193.111:6812/977811348 conn(0x7f645c03f800 0x7f645c05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.129+0000 7f648b7fe640 10 monclient: get_auth_request con 0x7f645c03f800 auth_method 0 2026-02-12T18:08:24.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.129+0000 7f648a7fc640 10 monclient(hunting): handle_auth_done global_id 5005 payload 824 2026-02-12T18:08:24.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.129+0000 7f648a7fc640 1 -- 10.20.193.48:0/3127437150 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f648c097de0 con 0x7f648c08d990 2026-02-12T18:08:24.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.132+0000 7f648b7fe640 1 --2- 10.20.193.48:0/3127437150 >> v2:10.20.193.111:6812/977811348 conn(0x7f645c03f800 0x7f645c05fcb0 secure :-1 s=READY pgs=172 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f648c08b400 tx=0x7f647c00a040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.132+0000 7f648a7fc640 1 -- 10.20.193.48:0/3127437150 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f648c08d990 msgr2=0x7f648c13d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:24.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.132+0000 7f648a7fc640 1 --2- 10.20.193.48:0/3127437150 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f648c08d990 0x7f648c13d2b0 secure :-1 s=READY pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f648c08ed20 tx=0x7f6474011ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.132+0000 7f6463fff640 1 -- 10.20.193.48:0/3127437150 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f647400fed0 con 0x7f648c08d990 2026-02-12T18:08:24.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.132+0000 7f6463fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.132+0000 7f6463fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:08:24.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.132+0000 7f6463fff640 10 monclient: dump: 2026-02-12T18:08:24.133 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.133 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.133 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.133 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.133 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.133 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.133 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.133 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.133 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.133 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.133 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.133 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.133 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.133 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.133 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.133 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.132+0000 7f6463fff640 1 -- 10.20.193.48:0/3127437150 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f647400fa10 con 0x7f648c08d990 2026-02-12T18:08:24.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.132+0000 7f6463fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:24.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.132+0000 7f6463fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:24.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.132+0000 7f6463fff640 1 -- 10.20.193.48:0/3127437150 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f648c08d990 msgr2=0x7f648c13d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.132+0000 7f6463fff640 1 --2- 10.20.193.48:0/3127437150 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f648c08d990 0x7f648c13d2b0 secure :-1 s=READY pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f648c08ed20 tx=0x7f6474011ca0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.132+0000 7f6463fff640 1 -- 10.20.193.48:0/3127437150 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f648c08d990 msgr2=0x7f648c13d2b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:24.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.132+0000 7f6463fff640 1 --2- 10.20.193.48:0/3127437150 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f648c08d990 0x7f648c13d2b0 secure :-1 s=CLOSED pgs=171 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f648c08ed20 tx=0x7f6474011ca0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.136+0000 7f6491836640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:08:24.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.136+0000 7f6491836640 1 --2- 10.20.193.48:0/3127437150 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f648c1293c0 0x7f648c1297c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.136+0000 7f6491836640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.136+0000 7f6491836640 1 -- 10.20.193.48:0/3127437150 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f648c05fd90 con 0x7f648c1293c0 2026-02-12T18:08:24.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.136+0000 7f648a7fc640 1 --2- 10.20.193.48:0/3127437150 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f648c1293c0 0x7f648c1297c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.136+0000 7f648a7fc640 10 monclient: get_auth_request con 0x7f648c1293c0 auth_method 0 2026-02-12T18:08:24.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.136+0000 7f648a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.136+0000 7f648a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.136+0000 7f648a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.136+0000 7f648a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.136+0000 7f648a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.136+0000 7f648a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.137+0000 7f648a7fc640 10 monclient(hunting): handle_auth_done global_id 5014 payload 824 2026-02-12T18:08:24.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.137+0000 7f648a7fc640 1 -- 10.20.193.48:0/3127437150 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f648c060760 con 0x7f648c1293c0 2026-02-12T18:08:24.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.139+0000 7f648a7fc640 1 -- 10.20.193.48:0/3127437150 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f648c1293c0 msgr2=0x7f648c1297c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:24.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.139+0000 7f648a7fc640 1 --2- 10.20.193.48:0/3127437150 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f648c1293c0 0x7f648c1297c0 secure :-1 s=READY pgs=172 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6474011ce0 tx=0x7f6474004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.139+0000 7f6463fff640 1 -- 10.20.193.48:0/3127437150 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6474004020 con 0x7f648c1293c0 2026-02-12T18:08:24.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.139+0000 7f6463fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.139+0000 7f6463fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:08:24.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.139+0000 7f6463fff640 10 monclient: dump: 2026-02-12T18:08:24.141 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.141 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.141 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.141 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.141 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.142 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.142 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.142 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.142 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.142 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.142 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.142 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.142 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.142 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.142 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.142 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.139+0000 7f6463fff640 1 -- 10.20.193.48:0/3127437150 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10349 (secure 0 0 0) 0x7f6474022550 con 0x7f648c1293c0 2026-02-12T18:08:24.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.139+0000 7f6463fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:08:24.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.139+0000 7f6463fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:24.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.139+0000 7f6463fff640 1 -- 10.20.193.48:0/3127437150 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f648c1293c0 msgr2=0x7f648c1297c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.139+0000 7f6463fff640 1 --2- 10.20.193.48:0/3127437150 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f648c1293c0 0x7f648c1297c0 secure :-1 s=READY pgs=172 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6474011ce0 tx=0x7f6474004770 comp rx=0 tx=0).stop 2026-02-12T18:08:24.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.139+0000 7f6463fff640 1 -- 10.20.193.48:0/3127437150 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f648c1293c0 msgr2=0x7f648c1297c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:24.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.139+0000 7f6463fff640 1 --2- 10.20.193.48:0/3127437150 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f648c1293c0 0x7f648c1297c0 secure :-1 s=CLOSED pgs=172 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6474011ce0 tx=0x7f6474004770 comp rx=0 tx=0).stop 2026-02-12T18:08:24.143 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:08:24.143 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:24.143 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:24.143 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:08:24.143 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 28, 2026-02-12T18:08:24.143 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 158937, 2026-02-12T18:08:24.143 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:08:24.143 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:08:24.143 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:08:24.143 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:08:24.143 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:08:24.143 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:08:24.144 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:08:24.144 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:08:24.144 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:08:24.144 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:08:24.144 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:24.144 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 1, 2026-02-12T18:08:24.144 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:24.144 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:08:24.144 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:08:24.144 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:24.144 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:24.144 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:24.144 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:24.144 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:24.144 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:24.144 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:24.144 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:24.144 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:24.145 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:24.145 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:24.145 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:24.145 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:24.145 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:24.145 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:08:24.145 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:08:24.145 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:24.145 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:24.145 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:24.145 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:24.145 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:24.145 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:24.145 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:24.145 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:24.145 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:24.145 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:24.145 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:24.145 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:24.145 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:24.146 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.146 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.146 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:08:24.146 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:08:24.146 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:08:24.146 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:08:24.146 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:08:24.146 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:08:24.146 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:24.146 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:24.146 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:08:24.146 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:08:24.146 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:08:24.146 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:08:24.146 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:08:24.146 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:08:24.146 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:08:24.146 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:24.146 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:08:24.147 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:24.147 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:24.147 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:24.147 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:24.147 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:24.147 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:24.147 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:24.147 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:24.147 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:24.147 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:24.147 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:24.147 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:24.147 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:24.147 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:24.147 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:08:24.147 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.147 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:08:24.147 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.147 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:24.147 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:24.147 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.148 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.148 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.148 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.148 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:08:24.148 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.148 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.148 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.148 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.148 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:08:24.148 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.148 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.148 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.148 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.148 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:08:24.148 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:08:24.148 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.148 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.148 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:08:24.148 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.148 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.148 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.149 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:24.149 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:24.149 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.149 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.149 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.149 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.149 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:08:24.149 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.149 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.149 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.149 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.149 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:08:24.149 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.149 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.149 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.149 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.149 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:08:24.149 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:08:24.149 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.149 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.149 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:08:24.150 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.150 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.150 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.150 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:24.150 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:24.150 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.150 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.150 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.150 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.150 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:08:24.150 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.150 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.150 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.150 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.150 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:08:24.150 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.150 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.150 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.150 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.150 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:08:24.150 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:08:24.151 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.151 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.151 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:08:24.151 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.151 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.151 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.151 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:08:24.151 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:08:24.151 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.151 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.151 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.151 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.151 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:08:24.151 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.151 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.151 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.151 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.151 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:08:24.151 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.151 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.151 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.151 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.151 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:08:24.152 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:08:24.152 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.152 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.152 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:08:24.152 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.152 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.152 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.152 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:08:24.152 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:08:24.152 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.152 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.152 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.152 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.152 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:08:24.152 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.152 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.152 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.152 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.152 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:08:24.152 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.152 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.152 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.153 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.153 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:08:24.153 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:08:24.153 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.153 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.153 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:24.153 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.153 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.153 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.153 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:24.153 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:24.153 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.153 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.153 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.153 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.153 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:08:24.153 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.153 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.153 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.153 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.153 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:08:24.153 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.153 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.153 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.153 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.154 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:08:24.154 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:08:24.154 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.154 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.154 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:08:24.154 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.154 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.154 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.154 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:24.154 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:24.154 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.154 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.154 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.154 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.154 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:08:24.154 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.154 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.154 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.154 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.154 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:08:24.154 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.154 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.154 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.154 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.155 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:08:24.155 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:08:24.155 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.155 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.155 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:24.155 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.155 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.155 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.155 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:24.155 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:24.155 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.155 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.155 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.155 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.155 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:08:24.155 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.155 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.155 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.155 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.155 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:08:24.155 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.155 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.155 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.155 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.155 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:08:24.156 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:08:24.156 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.156 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.156 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:08:24.156 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.156 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.156 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.156 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:08:24.156 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:08:24.156 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.156 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.156 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.156 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.156 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:08:24.156 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.156 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.156 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.156 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.156 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:08:24.156 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.156 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.156 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.156 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.156 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:08:24.156 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: "num": 4 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:24.157 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:08:24.158 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.158 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:24.158 INFO:teuthology.orchestra.run.trial048.stdout: "mgr": [ 2026-02-12T18:08:24.158 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.158 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:24.158 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:24.158 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:24.158 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.158 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.158 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.158 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:08:24.158 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:08:24.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.140+0000 7f6491836640 1 -- 10.20.193.48:0/3127437150 >> v2:10.20.193.111:6812/977811348 conn(0x7f645c03f800 msgr2=0x7f645c05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.140+0000 7f6491836640 1 --2- 10.20.193.48:0/3127437150 >> v2:10.20.193.111:6812/977811348 conn(0x7f645c03f800 0x7f645c05fcb0 secure :-1 s=READY pgs=172 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f648c08b400 tx=0x7f647c00a040 comp rx=0 tx=0).stop 2026-02-12T18:08:24.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.140+0000 7f6491836640 10 monclient: shutdown 2026-02-12T18:08:24.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.140+0000 7f6491836640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:24.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.140+0000 7f6491836640 1 -- 10.20.193.48:0/3127437150 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f648c05c950 msgr2=0x7f648c12c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.140+0000 7f6491836640 1 --2- 10.20.193.48:0/3127437150 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f648c05c950 0x7f648c12c940 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f64800099a0 tx=0x7f6480004770 comp rx=0 tx=0).stop 2026-02-12T18:08:24.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.140+0000 7f648b7fe640 1 -- 10.20.193.48:0/3127437150 reap_dead start 2026-02-12T18:08:24.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.140+0000 7f648b7fe640 1 -- 10.20.193.48:0/3127437150 reap_dead start 2026-02-12T18:08:24.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.140+0000 7f6491836640 1 -- 10.20.193.48:0/3127437150 shutdown_connections 2026-02-12T18:08:24.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.140+0000 7f6491836640 1 -- 10.20.193.48:0/3127437150 >> 10.20.193.48:0/3127437150 conn(0x7f648c0548a0 msgr2=0x7f648c093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:24.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.140+0000 7f6491836640 1 -- 10.20.193.48:0/3127437150 shutdown_connections 2026-02-12T18:08:24.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.140+0000 7f6491836640 1 -- 10.20.193.48:0/3127437150 wait complete. 2026-02-12T18:08:24.160 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:08:24.160 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2026-02-12T18:08:24.160 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2026-02-12T18:08:24.206 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28342]: starting. 2026-02-12T18:08:24.206 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28342]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-28340 2026-02-12T18:08:24.206 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28342]: shutting down. 2026-02-12T18:08:24.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.228+0000 7f2dc130c640 10 monclient: get_monmap_and_config 2026-02-12T18:08:24.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.228+0000 7f2dc130c640 10 monclient: build_initial_monmap 2026-02-12T18:08:24.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.228+0000 7f2dc130c640 10 monclient: monmap: 2026-02-12T18:08:24.229 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:24.229 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.229 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:24.229479+0000 2026-02-12T18:08:24.230 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:24.229479+0000 2026-02-12T18:08:24.230 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:24.230 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.230 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:24.230 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:24.230 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:24.230 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:24.230 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:24.230 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:24.230 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:24.230 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:24.230 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:24.230 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:24.230 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:24.230 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.228+0000 7f2dc130c640 1 Processor -- start 2026-02-12T18:08:24.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.228+0000 7f2dc130c640 1 -- start start 2026-02-12T18:08:24.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.228+0000 7f2dc130c640 10 monclient: init 2026-02-12T18:08:24.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dc130c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:24.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dc130c640 10 monclient: _add_conns ranks=[3,7,2,0,9,5,1,8,4,6,10] 2026-02-12T18:08:24.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dc130c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2dbc05d550 0x7f2dbc05d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dc130c640 10 monclient(hunting): picked mon.noname-g con 0x7f2dbc05d550 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:08:24.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dc130c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2dbc05de60 0x7f2dbc141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dc130c640 10 monclient(hunting): picked mon.noname-i con 0x7f2dbc05de60 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:24.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dc130c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2dbc13ef60 0x7f2dbc1424e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dc130c640 10 monclient(hunting): picked mon.noname-b con 0x7f2dbc13ef60 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:08:24.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dc130c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dc130c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f2dbc08d390 con 0x7f2dbc13ef60 2026-02-12T18:08:24.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dc130c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dc130c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2dbc08d5a0 con 0x7f2dbc05d550 2026-02-12T18:08:24.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dc130c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dc130c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f2dbc0580e0 con 0x7f2dbc05de60 2026-02-12T18:08:24.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dc130c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:24.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dc130c640 10 monclient(hunting): authenticate will time out at 742.955194s 2026-02-12T18:08:24.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dbb7fe640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2dbc13ef60 0x7f2dbc1424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dbb7fe640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2dbc13ef60 0x7f2dbc1424e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:52512/0 (socket says 10.20.193.48:52512) 2026-02-12T18:08:24.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dbb7fe640 1 -- 10.20.193.48:0/780480656 learned_addr learned my addr 10.20.193.48:0/780480656 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:24.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dbb7fe640 10 monclient(hunting): get_auth_request con 0x7f2dbc13ef60 auth_method 0 2026-02-12T18:08:24.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dbb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dbb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dbb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dbb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dbb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dbb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dba7fc640 1 --2- 10.20.193.48:0/780480656 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2dbc05de60 0x7f2dbc141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dba7fc640 10 monclient(hunting): get_auth_request con 0x7f2dbc05de60 auth_method 0 2026-02-12T18:08:24.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dba7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dba7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dba7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dbb7fe640 10 monclient(hunting): handle_auth_done global_id 35003 payload 274 2026-02-12T18:08:24.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dbb7fe640 1 -- 10.20.193.48:0/780480656 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2dbc05de60 msgr2=0x7f2dbc141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:24.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dbb7fe640 1 --2- 10.20.193.48:0/780480656 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2dbc05de60 0x7f2dbc141fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dbb7fe640 1 -- 10.20.193.48:0/780480656 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2dbc05d550 msgr2=0x7f2dbc05d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:24.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dbb7fe640 1 --2- 10.20.193.48:0/780480656 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2dbc05d550 0x7f2dbc05d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dbb7fe640 10 monclient: _finish_hunting 0 2026-02-12T18:08:24.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dbb7fe640 1 monclient: found mon.noname-b 2026-02-12T18:08:24.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dbb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:24.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dbb7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:08:24.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.229+0000 7f2dbb7fe640 1 -- 10.20.193.48:0/780480656 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dbc04dc20 con 0x7f2dbc13ef60 2026-02-12T18:08:24.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.231+0000 7f2dbb7fe640 1 -- 10.20.193.48:0/780480656 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2dbc13ef60 msgr2=0x7f2dbc1424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:24.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.231+0000 7f2dbb7fe640 1 --2- 10.20.193.48:0/780480656 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2dbc13ef60 0x7f2dbc1424e0 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=6535997335732666082 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dac00a9b0 tx=0x7f2dac02fef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ab486f2993ebee2 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2db9ffb640 1 -- 10.20.193.48:0/780480656 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2dac030b70 con 0x7f2dbc13ef60 2026-02-12T18:08:24.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2db9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2db9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:08:24.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2db9ffb640 10 monclient: dump: 2026-02-12T18:08:24.239 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.239 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.239 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.239 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.239 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.239 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.240 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.240 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.240 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.240 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.240 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.240 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.240 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.240 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.240 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.240 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2db9ffb640 10 monclient: _finish_auth 0 2026-02-12T18:08:24.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2db9ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:08:24.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2db9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:24.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2dc130c640 5 monclient: authenticate success, global_id 35003 2026-02-12T18:08:24.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2dc130c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:08:24.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2db9ffb640 1 -- 10.20.193.48:0/780480656 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dac030cf0 con 0x7f2dbc13ef60 2026-02-12T18:08:24.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2db9ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:24.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2db9ffb640 1 -- 10.20.193.48:0/780480656 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2dac030e60 con 0x7f2dbc13ef60 2026-02-12T18:08:24.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2dc130c640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:24.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2dc130c640 4 set_mon_vals no callback set 2026-02-12T18:08:24.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2db9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2db9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:08:24.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2db9ffb640 10 monclient: dump: 2026-02-12T18:08:24.241 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.241 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.241 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.241 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.241 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.241 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.241 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.241 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.241 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.241 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.241 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.241 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.241 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.241 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.242 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.242 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2dc130c640 10 monclient: shutdown 2026-02-12T18:08:24.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2dc130c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:24.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2dc130c640 1 -- 10.20.193.48:0/780480656 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2dbc13ef60 msgr2=0x7f2dbc1424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2dc130c640 1 --2- 10.20.193.48:0/780480656 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2dbc13ef60 0x7f2dbc1424e0 secure :-1 s=READY pgs=103 gs=1 cs=0 l=1 c_cookie=6535997335732666082 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dac00a9b0 tx=0x7f2dac02fef0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2dc130c640 1 -- 10.20.193.48:0/780480656 shutdown_connections 2026-02-12T18:08:24.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2dc130c640 1 --2- 10.20.193.48:0/780480656 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2dbc13ef60 0x7f2dbc1424e0 unknown :-1 s=CLOSED pgs=103 gs=1 cs=0 l=1 c_cookie=6535997335732666082 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2dc130c640 1 --2- 10.20.193.48:0/780480656 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2dbc05de60 0x7f2dbc141fa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2dc130c640 1 --2- 10.20.193.48:0/780480656 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2dbc05d550 0x7f2dbc05d920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2dc130c640 1 -- 10.20.193.48:0/780480656 >> 10.20.193.48:0/780480656 conn(0x7f2dbc0546a0 msgr2=0x7f2dbc054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:24.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2dc130c640 1 -- 10.20.193.48:0/780480656 shutdown_connections 2026-02-12T18:08:24.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2dc130c640 1 -- 10.20.193.48:0/780480656 wait complete. 2026-02-12T18:08:24.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2dc130c640 10 monclient: build_initial_monmap 2026-02-12T18:08:24.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.232+0000 7f2dc130c640 10 monclient: monmap: 2026-02-12T18:08:24.242 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:24.242 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:24.242 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:24.243 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:24.243 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:24.243 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.243 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:24.243 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:24.243 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:24.243 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:24.243 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:24.243 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:24.243 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:24.243 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:24.243 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:24.243 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dc130c640 1 Processor -- start 2026-02-12T18:08:24.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dc130c640 1 -- start start 2026-02-12T18:08:24.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dc130c640 10 monclient: init 2026-02-12T18:08:24.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dc130c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:24.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dc130c640 10 monclient: _add_conns ranks=[4,0,7,1,5,6,8,3,2] 2026-02-12T18:08:24.244 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dc130c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f2dbc05d550 0x7f2dbc131250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.244 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dc130c640 10 monclient(hunting): picked mon.noname-c con 0x7f2dbc05d550 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:08:24.244 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dc130c640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f2dbc05de60 0x7f2dbc08a680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.244 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dc130c640 10 monclient(hunting): picked mon.noname-a con 0x7f2dbc05de60 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:08:24.244 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dc130c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2dbc13ef60 0x7f2dbc08abc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.244 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dc130c640 10 monclient(hunting): picked mon.noname-i con 0x7f2dbc13ef60 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:24.244 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dc130c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.244 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dc130c640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f2dbc13dc40 con 0x7f2dbc05de60 2026-02-12T18:08:24.244 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dc130c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.244 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dc130c640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f2dbc08be20 con 0x7f2dbc05d550 2026-02-12T18:08:24.244 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dc130c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.244 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dc130c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f2dbc10ec40 con 0x7f2dbc13ef60 2026-02-12T18:08:24.244 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dc130c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:24.244 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dc130c640 10 monclient(hunting): authenticate will time out at 742.959517s 2026-02-12T18:08:24.244 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dbaffd640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f2dbc05d550 0x7f2dbc131250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.244 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dbaffd640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f2dbc05d550 0x7f2dbc131250 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:42160/0 (socket says 10.20.193.48:42160) 2026-02-12T18:08:24.244 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dbaffd640 1 -- 10.20.193.48:0/2694305230 learned_addr learned my addr 10.20.193.48:0/2694305230 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:24.244 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dbaffd640 10 monclient(hunting): get_auth_request con 0x7f2dbc05d550 auth_method 0 2026-02-12T18:08:24.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dbaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dbaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dbaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dba7fc640 1 --2- 10.20.193.48:0/2694305230 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f2dbc05de60 0x7f2dbc08a680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dba7fc640 10 monclient(hunting): get_auth_request con 0x7f2dbc05de60 auth_method 0 2026-02-12T18:08:24.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dba7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dba7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dba7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dbaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dbaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dbaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dba7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dba7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dba7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dbb7fe640 1 --2- 10.20.193.48:0/2694305230 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2dbc13ef60 0x7f2dbc08abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dbb7fe640 10 monclient(hunting): get_auth_request con 0x7f2dbc13ef60 auth_method 0 2026-02-12T18:08:24.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dbb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dbb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dbb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dbaffd640 10 monclient(hunting): handle_auth_done global_id 44158 payload 824 2026-02-12T18:08:24.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dbaffd640 1 -- 10.20.193.48:0/2694305230 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2dbc13ef60 msgr2=0x7f2dbc08abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dbaffd640 1 --2- 10.20.193.48:0/2694305230 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2dbc13ef60 0x7f2dbc08abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dbaffd640 1 -- 10.20.193.48:0/2694305230 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f2dbc05de60 msgr2=0x7f2dbc08a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dbaffd640 1 --2- 10.20.193.48:0/2694305230 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f2dbc05de60 0x7f2dbc08a680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dbaffd640 10 monclient: _finish_hunting 0 2026-02-12T18:08:24.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dbaffd640 1 monclient: found mon.noname-c 2026-02-12T18:08:24.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dbaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:24.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dbaffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:08:24.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.233+0000 7f2dbaffd640 1 -- 10.20.193.48:0/2694305230 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dac00a5d0 con 0x7f2dbc05d550 2026-02-12T18:08:24.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2dbaffd640 1 -- 10.20.193.48:0/2694305230 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f2dbc05d550 msgr2=0x7f2dbc131250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:24.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2dbaffd640 1 --2- 10.20.193.48:0/2694305230 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f2dbc05d550 0x7f2dbc131250 secure :-1 s=READY pgs=21 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2db000b450 tx=0x7f2db000b920 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2d9b7fe640 1 -- 10.20.193.48:0/2694305230 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2db0004490 con 0x7f2dbc05d550 2026-02-12T18:08:24.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2d9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2d9b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:08:24.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2d9b7fe640 10 monclient: dump: 2026-02-12T18:08:24.246 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.247 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.247 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.247 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.247 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.247 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.247 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.247 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.247 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.247 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.247 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.247 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.247 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.247 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.247 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.247 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2d9b7fe640 10 monclient: _finish_auth 0 2026-02-12T18:08:24.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2d9b7fe640 10 monclient: _check_auth_tickets 2026-02-12T18:08:24.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2d9b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:24.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2dc130c640 5 monclient: authenticate success, global_id 44158 2026-02-12T18:08:24.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2d9b7fe640 1 -- 10.20.193.48:0/2694305230 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2db0002b60 con 0x7f2dbc05d550 2026-02-12T18:08:24.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2d9b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:24.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2d9b7fe640 1 -- 10.20.193.48:0/2694305230 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2db0002cd0 con 0x7f2dbc05d550 2026-02-12T18:08:24.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2d9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2db97fa640 4 set_mon_vals no callback set 2026-02-12T18:08:24.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2d9b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:08:24.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2d9b7fe640 10 monclient: dump: 2026-02-12T18:08:24.248 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.248 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.248 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.248 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.248 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.248 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.248 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.248 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.248 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.248 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.248 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.249 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.249 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.249 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.249 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.249 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.249 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2dc130c640 10 monclient: _renew_subs 2026-02-12T18:08:24.249 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2dc130c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:08:24.249 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2dc130c640 1 -- 10.20.193.48:0/2694305230 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2dbc10ef20 con 0x7f2dbc05d550 2026-02-12T18:08:24.249 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2dc130c640 10 monclient: _renew_subs 2026-02-12T18:08:24.249 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2dc130c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:08:24.249 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2dc130c640 1 -- 10.20.193.48:0/2694305230 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f2dbc10dc70 con 0x7f2dbc05d550 2026-02-12T18:08:24.249 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2dc130c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:24.249 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2dc130c640 1 --2- 10.20.193.48:0/2694305230 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2dbc091010 0x7f2dbc08b100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.249 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2dc130c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.249 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2dc130c640 1 -- 10.20.193.48:0/2694305230 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2dbc05f140 con 0x7f2dbc091010 2026-02-12T18:08:24.249 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2dba7fc640 1 --2- 10.20.193.48:0/2694305230 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2dbc091010 0x7f2dbc08b100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.249 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2d9b7fe640 1 -- 10.20.193.48:0/2694305230 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f2db00026a0 con 0x7f2dbc05d550 2026-02-12T18:08:24.249 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2dba7fc640 10 monclient: get_auth_request con 0x7f2dbc091010 auth_method 0 2026-02-12T18:08:24.249 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2dba7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.250 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2dba7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.250 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.236+0000 7f2dba7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.250 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.237+0000 7f2dba7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.250 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.237+0000 7f2dba7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.250 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.237+0000 7f2dba7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.250 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.237+0000 7f2d9b7fe640 1 --2- 10.20.193.48:0/2694305230 >> v2:10.20.193.111:6812/977811348 conn(0x7f2d8803f800 0x7f2d8805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.250 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.237+0000 7f2d9b7fe640 1 -- 10.20.193.48:0/2694305230 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(115..115 src has 1..115) ==== 3503+0+0 (secure 0 0 0) 0x7f2db00526c0 con 0x7f2dbc05d550 2026-02-12T18:08:24.250 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.237+0000 7f2dba7fc640 10 monclient(hunting): handle_auth_done global_id 4917 payload 824 2026-02-12T18:08:24.250 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.237+0000 7f2dba7fc640 1 -- 10.20.193.48:0/2694305230 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2dbc090330 con 0x7f2dbc091010 2026-02-12T18:08:24.250 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.237+0000 7f2dbb7fe640 1 --2- 10.20.193.48:0/2694305230 >> v2:10.20.193.111:6812/977811348 conn(0x7f2d8803f800 0x7f2d8805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.250 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.237+0000 7f2dbb7fe640 10 monclient: get_auth_request con 0x7f2d8803f800 auth_method 0 2026-02-12T18:08:24.252 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.239+0000 7f2dba7fc640 1 -- 10.20.193.48:0/2694305230 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2dbc091010 msgr2=0x7f2dbc08b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:24.252 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.239+0000 7f2dba7fc640 1 --2- 10.20.193.48:0/2694305230 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2dbc091010 0x7f2dbc08b100 secure :-1 s=READY pgs=124 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dbc08c490 tx=0x7f2da4011ca0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.252 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.239+0000 7f2d9b7fe640 1 -- 10.20.193.48:0/2694305230 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2da4011ec0 con 0x7f2dbc091010 2026-02-12T18:08:24.252 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.239+0000 7f2d9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.252 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.239+0000 7f2d9b7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:08:24.252 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.239+0000 7f2d9b7fe640 10 monclient: dump: 2026-02-12T18:08:24.252 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.252 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.252 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.252 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.253 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.253 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.253 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.253 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.253 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.253 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.253 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.253 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.253 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.253 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.253 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.253 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.253 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.239+0000 7f2dbb7fe640 1 --2- 10.20.193.48:0/2694305230 >> v2:10.20.193.111:6812/977811348 conn(0x7f2d8803f800 0x7f2d8805fcb0 secure :-1 s=READY pgs=176 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dac02ff30 tx=0x7f2dac007f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.253 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.240+0000 7f2d9b7fe640 1 -- 10.20.193.48:0/2694305230 <== mon.3 v2:10.20.193.111:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f2da4004450 con 0x7f2dbc091010 2026-02-12T18:08:24.253 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.240+0000 7f2d9b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:24.253 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.240+0000 7f2d9b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:24.253 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.240+0000 7f2d9b7fe640 1 -- 10.20.193.48:0/2694305230 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2dbc091010 msgr2=0x7f2dbc08b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.253 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.240+0000 7f2d9b7fe640 1 --2- 10.20.193.48:0/2694305230 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2dbc091010 0x7f2dbc08b100 secure :-1 s=READY pgs=124 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dbc08c490 tx=0x7f2da4011ca0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.240+0000 7f2d9b7fe640 1 -- 10.20.193.48:0/2694305230 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2dbc091010 msgr2=0x7f2dbc08b100 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:24.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.240+0000 7f2d9b7fe640 1 --2- 10.20.193.48:0/2694305230 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2dbc091010 0x7f2dbc08b100 unknown :-1 s=CLOSED pgs=124 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.243+0000 7f2dc130c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:08:24.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.243+0000 7f2dc130c640 1 --2- 10.20.193.48:0/2694305230 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2dbc058980 0x7f2dbc058d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.243+0000 7f2dc130c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.243+0000 7f2dc130c640 1 -- 10.20.193.48:0/2694305230 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2dbc05fd90 con 0x7f2dbc058980 2026-02-12T18:08:24.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.243+0000 7f2dba7fc640 1 --2- 10.20.193.48:0/2694305230 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2dbc058980 0x7f2dbc058d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.243+0000 7f2dba7fc640 10 monclient: get_auth_request con 0x7f2dbc058980 auth_method 0 2026-02-12T18:08:24.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.243+0000 7f2dba7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.243+0000 7f2dba7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.243+0000 7f2dba7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.243+0000 7f2dba7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.243+0000 7f2dba7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.243+0000 7f2dba7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.244+0000 7f2dba7fc640 10 monclient(hunting): handle_auth_done global_id 4926 payload 824 2026-02-12T18:08:24.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.244+0000 7f2dba7fc640 1 -- 10.20.193.48:0/2694305230 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2dbc10edb0 con 0x7f2dbc058980 2026-02-12T18:08:24.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.246+0000 7f2dba7fc640 1 -- 10.20.193.48:0/2694305230 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2dbc058980 msgr2=0x7f2dbc058d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:24.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.246+0000 7f2dba7fc640 1 --2- 10.20.193.48:0/2694305230 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2dbc058980 0x7f2dbc058d80 secure :-1 s=READY pgs=125 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2da4017000 tx=0x7f2da4004770 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.246+0000 7f2d9b7fe640 1 -- 10.20.193.48:0/2694305230 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2da4025070 con 0x7f2dbc058980 2026-02-12T18:08:24.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.246+0000 7f2d9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.246+0000 7f2d9b7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:08:24.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.246+0000 7f2d9b7fe640 10 monclient: dump: 2026-02-12T18:08:24.255 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.255 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.255 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.255 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.255 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.255 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.255 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.255 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.255 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.255 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.255 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.255 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.255 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.255 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.255 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.255 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.246+0000 7f2d9b7fe640 1 -- 10.20.193.48:0/2694305230 <== mon.3 v2:10.20.193.111:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10015 (secure 0 0 0) 0x7f2da400fe60 con 0x7f2dbc058980 2026-02-12T18:08:24.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.246+0000 7f2d9b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:08:24.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.246+0000 7f2d9b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:24.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.246+0000 7f2d9b7fe640 1 -- 10.20.193.48:0/2694305230 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2dbc058980 msgr2=0x7f2dbc058d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.246+0000 7f2d9b7fe640 1 --2- 10.20.193.48:0/2694305230 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2dbc058980 0x7f2dbc058d80 secure :-1 s=READY pgs=125 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2da4017000 tx=0x7f2da4004770 comp rx=0 tx=0).stop 2026-02-12T18:08:24.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.246+0000 7f2d9b7fe640 1 -- 10.20.193.48:0/2694305230 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2dbc058980 msgr2=0x7f2dbc058d80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:24.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.246+0000 7f2d9b7fe640 1 --2- 10.20.193.48:0/2694305230 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2dbc058980 0x7f2dbc058d80 secure :-1 s=CLOSED pgs=125 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2da4017000 tx=0x7f2da4004770 comp rx=0 tx=0).stop 2026-02-12T18:08:24.256 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:08:24.256 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:08:24.256 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:08:24.256 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:08:24.256 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 28, 2026-02-12T18:08:24.257 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 159043, 2026-02-12T18:08:24.257 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:08:24.257 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:08:24.257 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:08:24.257 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:08:24.257 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:08:24.257 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:08:24.257 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:08:24.257 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:08:24.257 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:08:24.257 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:08:24.257 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:24.257 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 1, 2026-02-12T18:08:24.257 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:24.257 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:08:24.257 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:08:24.257 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:24.257 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:24.257 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:24.257 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:24.258 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:24.258 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:24.258 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:24.258 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:24.258 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:24.258 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:24.258 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:24.258 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:24.258 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:24.258 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:24.258 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:08:24.258 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:08:24.258 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:24.258 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:24.258 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:24.258 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:24.258 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:24.258 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:24.258 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:24.259 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:24.259 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:24.259 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:24.259 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:24.259 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:24.259 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:24.259 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.259 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.259 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:08:24.259 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:08:24.259 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:08:24.259 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:08:24.259 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:08:24.259 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:08:24.259 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:24.259 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:24.259 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:08:24.259 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:08:24.259 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:08:24.259 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:08:24.259 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:08:24.260 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:08:24.260 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:08:24.260 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:24.260 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:08:24.260 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:24.260 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:24.260 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:24.260 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:24.260 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:24.260 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:24.260 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:24.260 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:24.260 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:24.260 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:24.260 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:24.260 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:24.260 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:24.260 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:24.260 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:08:24.260 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.260 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:08:24.260 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.261 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:24.261 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:24.261 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.261 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.261 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.261 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.261 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:08:24.261 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.261 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.261 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.261 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.261 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:08:24.261 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.261 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.261 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.261 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.261 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:08:24.261 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:08:24.261 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.261 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.261 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:08:24.261 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.262 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.262 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.262 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:24.262 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:24.262 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.262 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.262 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.262 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.262 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:08:24.262 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.262 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.262 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.262 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.262 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:08:24.262 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.262 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.262 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.262 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.262 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:08:24.262 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:08:24.262 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.263 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.263 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:08:24.263 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.263 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.263 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.263 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:24.263 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:24.263 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.263 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.263 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.263 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.263 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:08:24.263 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.263 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.263 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.263 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.263 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:08:24.263 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.263 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.263 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.263 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.263 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:08:24.264 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:08:24.264 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.264 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.264 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:08:24.264 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.264 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.264 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.264 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:08:24.264 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:08:24.264 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.264 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.264 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.264 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.264 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:08:24.264 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.264 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.264 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.264 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.264 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:08:24.264 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.264 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.264 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.264 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.265 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:08:24.265 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:08:24.265 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.265 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.265 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:08:24.265 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.265 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.265 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.265 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:08:24.265 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:08:24.265 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.265 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.265 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.265 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.265 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:08:24.265 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.265 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.265 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.265 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.265 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:08:24.265 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.265 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.265 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.266 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.266 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:08:24.266 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:08:24.266 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.266 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.266 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:24.266 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.266 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.266 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.266 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:24.266 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:24.266 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.266 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.266 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.266 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.266 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:08:24.266 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.266 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.266 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.266 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.266 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:08:24.266 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.266 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.266 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.266 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.267 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:08:24.267 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:08:24.267 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.267 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.267 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:08:24.267 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.267 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.267 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.267 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:24.267 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:24.267 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.267 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.267 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.267 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.267 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:08:24.267 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.267 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.267 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.267 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.267 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:08:24.267 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.267 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.267 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.267 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.267 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:08:24.268 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:08:24.268 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.268 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.268 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:24.268 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.268 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.268 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.268 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:24.268 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:24.268 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.268 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.268 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.268 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.268 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:08:24.268 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.268 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.268 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.268 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.268 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:08:24.268 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.268 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.268 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.268 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.269 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:08:24.269 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:08:24.269 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.269 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.269 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:08:24.269 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.269 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.269 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.269 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:08:24.269 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:08:24.269 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.269 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.269 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.269 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.269 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:08:24.269 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.269 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.269 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.269 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.269 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:08:24.269 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.269 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.269 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.269 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.269 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:08:24.270 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:08:24.270 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.270 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.270 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:08:24.270 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.270 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.270 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.270 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.270 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:08:24.270 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:08:24.270 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.270 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:24.270 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:24.270 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:24.270 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.270 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:24.270 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:08:24.270 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.270 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:24.270 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:24.270 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:08:24.270 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.270 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.270 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.270 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:08:24.271 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:08:24.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.247+0000 7f2dc130c640 1 -- 10.20.193.48:0/2694305230 >> v2:10.20.193.111:6812/977811348 conn(0x7f2d8803f800 msgr2=0x7f2d8805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.247+0000 7f2dc130c640 1 --2- 10.20.193.48:0/2694305230 >> v2:10.20.193.111:6812/977811348 conn(0x7f2d8803f800 0x7f2d8805fcb0 secure :-1 s=READY pgs=176 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2dac02ff30 tx=0x7f2dac007f90 comp rx=0 tx=0).stop 2026-02-12T18:08:24.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.247+0000 7f2dc130c640 10 monclient: shutdown 2026-02-12T18:08:24.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.247+0000 7f2dc130c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:24.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.247+0000 7f2dc130c640 1 -- 10.20.193.48:0/2694305230 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f2dbc05d550 msgr2=0x7f2dbc131250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.247+0000 7f2dbb7fe640 1 -- 10.20.193.48:0/2694305230 reap_dead start 2026-02-12T18:08:24.272 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.247+0000 7f2dc130c640 1 --2- 10.20.193.48:0/2694305230 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f2dbc05d550 0x7f2dbc131250 secure :-1 s=READY pgs=21 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2db000b450 tx=0x7f2db000b920 comp rx=0 tx=0).stop 2026-02-12T18:08:24.272 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.247+0000 7f2dc130c640 1 -- 10.20.193.48:0/2694305230 shutdown_connections 2026-02-12T18:08:24.272 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.247+0000 7f2dc130c640 1 --2- 10.20.193.48:0/2694305230 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f2dbc05d550 0x7f2dbc131250 unknown :-1 s=CLOSED pgs=21 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.272 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.247+0000 7f2dc130c640 1 -- 10.20.193.48:0/2694305230 >> 10.20.193.48:0/2694305230 conn(0x7f2dbc0546a0 msgr2=0x7f2dbc13d190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:24.272 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.247+0000 7f2dc130c640 1 -- 10.20.193.48:0/2694305230 shutdown_connections 2026-02-12T18:08:24.272 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.247+0000 7f2dc130c640 1 -- 10.20.193.48:0/2694305230 wait complete. 2026-02-12T18:08:24.272 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:08:24.272 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2026-02-12T18:08:24.272 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2026-02-12T18:08:24.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.338+0000 7f094d8cc640 10 monclient: get_monmap_and_config 2026-02-12T18:08:24.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.338+0000 7f094d8cc640 10 monclient: build_initial_monmap 2026-02-12T18:08:24.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.338+0000 7f094d8cc640 10 monclient: monmap: 2026-02-12T18:08:24.339 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:24.339 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.340 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:24.339511+0000 2026-02-12T18:08:24.340 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:24.339511+0000 2026-02-12T18:08:24.340 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:24.340 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.340 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:24.340 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:24.340 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:24.340 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:24.340 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:24.340 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:24.340 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:24.340 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:24.340 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:24.340 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:24.340 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:24.340 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.338+0000 7f094d8cc640 1 Processor -- start 2026-02-12T18:08:24.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.338+0000 7f094d8cc640 1 -- start start 2026-02-12T18:08:24.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.338+0000 7f094d8cc640 10 monclient: init 2026-02-12T18:08:24.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f094d8cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:24.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f094d8cc640 10 monclient: _add_conns ranks=[10,6,3,4,9,8,2,7,5,1,0] 2026-02-12T18:08:24.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f094d8cc640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f094805c950 0x7f094805cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f094d8cc640 10 monclient(hunting): picked mon.noname-f con 0x7f094805c950 addr v2:10.20.193.111:3300/0 2026-02-12T18:08:24.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f094d8cc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f094805e490 0x7f094805d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f094d8cc640 10 monclient(hunting): picked mon.noname-d con 0x7f094805e490 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:08:24.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f094d8cc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f094813db70 0x7f094813e010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f094d8cc640 10 monclient(hunting): picked mon.noname-g con 0x7f094813db70 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:08:24.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f094d8cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f094d8cc640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f094805ddd0 con 0x7f094805c950 2026-02-12T18:08:24.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f094d8cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f094d8cc640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f094805d7a0 con 0x7f094813db70 2026-02-12T18:08:24.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f094d8cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f094d8cc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f0948092990 con 0x7f094805e490 2026-02-12T18:08:24.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f094d8cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:24.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f094d8cc640 10 monclient(hunting): authenticate will time out at 743.065193s 2026-02-12T18:08:24.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f09467fc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f094805e490 0x7f094805d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f09467fc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f094805e490 0x7f094805d260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:59566/0 (socket says 10.20.193.48:59566) 2026-02-12T18:08:24.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f09467fc640 1 -- 10.20.193.48:0/2594842001 learned_addr learned my addr 10.20.193.48:0/2594842001 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:24.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f09467fc640 10 monclient(hunting): get_auth_request con 0x7f094805e490 auth_method 0 2026-02-12T18:08:24.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f09467fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f09467fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f09467fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f09467fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f09467fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f09467fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f0946ffd640 1 --2- 10.20.193.48:0/2594842001 >> v2:10.20.193.111:3300/0 conn(0x7f094805c950 0x7f094805cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f0946ffd640 10 monclient(hunting): get_auth_request con 0x7f094805c950 auth_method 0 2026-02-12T18:08:24.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f0946ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f0946ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f0946ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f09467fc640 10 monclient(hunting): handle_auth_done global_id 4929 payload 274 2026-02-12T18:08:24.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f09477fe640 1 --2- 10.20.193.48:0/2594842001 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f094813db70 0x7f094813e010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f09467fc640 1 -- 10.20.193.48:0/2594842001 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f094813db70 msgr2=0x7f094813e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:24.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f09467fc640 1 --2- 10.20.193.48:0/2594842001 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f094813db70 0x7f094813e010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f09467fc640 1 -- 10.20.193.48:0/2594842001 >> v2:10.20.193.111:3300/0 conn(0x7f094805c950 msgr2=0x7f094805cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:24.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f09467fc640 1 --2- 10.20.193.48:0/2594842001 >> v2:10.20.193.111:3300/0 conn(0x7f094805c950 0x7f094805cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f09467fc640 10 monclient: _finish_hunting 0 2026-02-12T18:08:24.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f09467fc640 1 monclient: found mon.noname-d 2026-02-12T18:08:24.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f09467fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:24.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f09467fc640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:08:24.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f09467fc640 1 -- 10.20.193.48:0/2594842001 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f094804dc20 con 0x7f094805e490 2026-02-12T18:08:24.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f09477fe640 10 monclient: get_auth_request con 0x7f094813db70 auth_method 0 2026-02-12T18:08:24.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.339+0000 7f09477fe640 1 --2- 10.20.193.48:0/2594842001 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f094813db70 0x7f094813e010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-12T18:08:24.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.341+0000 7f09467fc640 1 -- 10.20.193.48:0/2594842001 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f094805e490 msgr2=0x7f094805d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:24.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.341+0000 7f09467fc640 1 --2- 10.20.193.48:0/2594842001 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f094805e490 0x7f094805d260 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=17562372733688771846 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0930009060 tx=0x7f093002edf0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=f3ba14f3ac867506 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f0945ffb640 1 -- 10.20.193.48:0/2594842001 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f0930035340 con 0x7f094805e490 2026-02-12T18:08:24.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f0945ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f0945ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:08:24.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f0945ffb640 10 monclient: dump: 2026-02-12T18:08:24.349 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.349 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.349 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.349 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.349 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.349 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.349 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.350 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.350 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.350 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.350 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.350 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.350 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.350 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.350 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.350 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f0945ffb640 10 monclient: _finish_auth 0 2026-02-12T18:08:24.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f0945ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:08:24.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f0945ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:24.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f0945ffb640 1 -- 10.20.193.48:0/2594842001 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09300354c0 con 0x7f094805e490 2026-02-12T18:08:24.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f0945ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:24.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f094d8cc640 5 monclient: authenticate success, global_id 4929 2026-02-12T18:08:24.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f0945ffb640 1 -- 10.20.193.48:0/2594842001 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f0930035af0 con 0x7f094805e490 2026-02-12T18:08:24.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f0945ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f0945ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:08:24.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f0945ffb640 10 monclient: dump: 2026-02-12T18:08:24.351 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.351 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.351 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.351 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.351 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.351 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.351 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.351 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.351 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.351 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.351 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.351 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.351 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.351 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.351 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.351 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f094d8cc640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:24.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f094d8cc640 4 set_mon_vals no callback set 2026-02-12T18:08:24.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f094d8cc640 10 monclient: shutdown 2026-02-12T18:08:24.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f094d8cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:24.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f094d8cc640 1 -- 10.20.193.48:0/2594842001 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f094805e490 msgr2=0x7f094805d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f094d8cc640 1 --2- 10.20.193.48:0/2594842001 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f094805e490 0x7f094805d260 secure :-1 s=READY pgs=112 gs=1 cs=0 l=1 c_cookie=17562372733688771846 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0930009060 tx=0x7f093002edf0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f094d8cc640 1 -- 10.20.193.48:0/2594842001 shutdown_connections 2026-02-12T18:08:24.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f094d8cc640 1 --2- 10.20.193.48:0/2594842001 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f094813db70 0x7f094813e010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f094d8cc640 1 --2- 10.20.193.48:0/2594842001 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f094805e490 0x7f094805d260 unknown :-1 s=CLOSED pgs=112 gs=1 cs=0 l=1 c_cookie=17562372733688771846 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f094d8cc640 1 --2- 10.20.193.48:0/2594842001 >> v2:10.20.193.111:3300/0 conn(0x7f094805c950 0x7f094805cd20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f094d8cc640 1 -- 10.20.193.48:0/2594842001 >> 10.20.193.48:0/2594842001 conn(0x7f09480548a0 msgr2=0x7f0948097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:24.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f094d8cc640 1 -- 10.20.193.48:0/2594842001 shutdown_connections 2026-02-12T18:08:24.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.342+0000 7f094d8cc640 1 -- 10.20.193.48:0/2594842001 wait complete. 2026-02-12T18:08:24.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f094d8cc640 10 monclient: build_initial_monmap 2026-02-12T18:08:24.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f094d8cc640 10 monclient: monmap: 2026-02-12T18:08:24.352 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:24.352 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:24.352 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:24.352 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:24.352 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:24.352 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.352 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:24.352 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:24.352 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:24.353 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:24.353 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:24.353 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:24.353 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:24.353 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:24.353 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:24.353 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f094d8cc640 1 Processor -- start 2026-02-12T18:08:24.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f094d8cc640 1 -- start start 2026-02-12T18:08:24.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f094d8cc640 10 monclient: init 2026-02-12T18:08:24.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f094d8cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:24.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f094d8cc640 10 monclient: _add_conns ranks=[2,8,3,1,0,5,7,6,4] 2026-02-12T18:08:24.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f094d8cc640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f094805c950 0x7f094812c8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f094d8cc640 10 monclient(hunting): picked mon.noname-b con 0x7f094805c950 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:08:24.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f094d8cc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f094805e490 0x7f094808d330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f094d8cc640 10 monclient(hunting): picked mon.noname-e con 0x7f094805e490 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:08:24.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f094d8cc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f094813db70 0x7f094808d870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f094d8cc640 10 monclient(hunting): picked mon.noname-g con 0x7f094813db70 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:08:24.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f094d8cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f094d8cc640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f0948143af0 con 0x7f094805c950 2026-02-12T18:08:24.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f094d8cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f094d8cc640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f094808a5e0 con 0x7f094813db70 2026-02-12T18:08:24.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f094d8cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f094d8cc640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f094812d830 con 0x7f094805e490 2026-02-12T18:08:24.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f094d8cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:24.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f094d8cc640 10 monclient(hunting): authenticate will time out at 743.069585s 2026-02-12T18:08:24.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f0946ffd640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f094805c950 0x7f094812c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f09467fc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f094805e490 0x7f094808d330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f0946ffd640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f094805c950 0x7f094812c8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:52516/0 (socket says 10.20.193.48:52516) 2026-02-12T18:08:24.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f0946ffd640 1 -- 10.20.193.48:0/2027211183 learned_addr learned my addr 10.20.193.48:0/2027211183 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:24.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f0946ffd640 10 monclient(hunting): get_auth_request con 0x7f094805c950 auth_method 0 2026-02-12T18:08:24.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f0946ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f0946ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f0946ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f09467fc640 10 monclient(hunting): get_auth_request con 0x7f094805e490 auth_method 0 2026-02-12T18:08:24.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f09467fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f09467fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f09467fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f0946ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f0946ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f0946ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f09467fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f09467fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f09467fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f09477fe640 1 --2- 10.20.193.48:0/2027211183 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f094813db70 0x7f094808d870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f09477fe640 10 monclient(hunting): get_auth_request con 0x7f094813db70 auth_method 0 2026-02-12T18:08:24.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f09477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f09477fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f09477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f0946ffd640 10 monclient(hunting): handle_auth_done global_id 35012 payload 824 2026-02-12T18:08:24.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f0946ffd640 1 -- 10.20.193.48:0/2027211183 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f094805e490 msgr2=0x7f094808d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f0946ffd640 1 --2- 10.20.193.48:0/2027211183 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f094805e490 0x7f094808d330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f0946ffd640 1 -- 10.20.193.48:0/2027211183 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f094813db70 msgr2=0x7f094808d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f0946ffd640 1 --2- 10.20.193.48:0/2027211183 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f094813db70 0x7f094808d870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f0946ffd640 10 monclient: _finish_hunting 0 2026-02-12T18:08:24.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f0946ffd640 1 monclient: found mon.noname-b 2026-02-12T18:08:24.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f0946ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:24.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f0946ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:08:24.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.343+0000 7f0946ffd640 1 -- 10.20.193.48:0/2027211183 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09300094f0 con 0x7f094805c950 2026-02-12T18:08:24.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f0946ffd640 1 -- 10.20.193.48:0/2027211183 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f094805c950 msgr2=0x7f094812c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:24.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f0946ffd640 1 --2- 10.20.193.48:0/2027211183 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f094805c950 0x7f094812c8f0 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f093c00e730 tx=0x7f093c00ec00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f091ffff640 1 -- 10.20.193.48:0/2027211183 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f093c00ee60 con 0x7f094805c950 2026-02-12T18:08:24.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f091ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f091ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:08:24.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f091ffff640 10 monclient: dump: 2026-02-12T18:08:24.356 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.356 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.356 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.356 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.356 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.356 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.356 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.356 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.356 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.356 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.356 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.356 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.356 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.356 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.356 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.356 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f091ffff640 10 monclient: _finish_auth 0 2026-02-12T18:08:24.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f091ffff640 10 monclient: _check_auth_tickets 2026-02-12T18:08:24.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f091ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:24.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f091ffff640 1 -- 10.20.193.48:0/2027211183 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f093c00cd40 con 0x7f094805c950 2026-02-12T18:08:24.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f091ffff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:24.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f091ffff640 1 -- 10.20.193.48:0/2027211183 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f093c0138d0 con 0x7f094805c950 2026-02-12T18:08:24.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f091ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f09457fa640 4 set_mon_vals no callback set 2026-02-12T18:08:24.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f091ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:08:24.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f091ffff640 10 monclient: dump: 2026-02-12T18:08:24.357 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.357 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.357 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.357 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.357 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.357 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.357 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.357 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.357 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.357 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.358 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.358 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.358 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.358 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.358 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.358 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f094d8cc640 5 monclient: authenticate success, global_id 35012 2026-02-12T18:08:24.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f094d8cc640 10 monclient: _renew_subs 2026-02-12T18:08:24.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f094d8cc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:08:24.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f094d8cc640 1 -- 10.20.193.48:0/2027211183 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f094813e3c0 con 0x7f094805c950 2026-02-12T18:08:24.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f094d8cc640 10 monclient: _renew_subs 2026-02-12T18:08:24.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f094d8cc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:08:24.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f094d8cc640 1 -- 10.20.193.48:0/2027211183 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f094808adf0 con 0x7f094805c950 2026-02-12T18:08:24.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f094d8cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:24.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f094d8cc640 1 --2- 10.20.193.48:0/2027211183 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f094813cd20 0x7f094813d0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f094d8cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.346+0000 7f094d8cc640 1 -- 10.20.193.48:0/2027211183 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f094805f140 con 0x7f094813cd20 2026-02-12T18:08:24.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.347+0000 7f09467fc640 1 --2- 10.20.193.48:0/2027211183 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f094813cd20 0x7f094813d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.347+0000 7f09467fc640 10 monclient: get_auth_request con 0x7f094813cd20 auth_method 0 2026-02-12T18:08:24.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.347+0000 7f09467fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.347+0000 7f09467fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.347+0000 7f09467fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.347+0000 7f091ffff640 1 -- 10.20.193.48:0/2027211183 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f093c013410 con 0x7f094805c950 2026-02-12T18:08:24.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.347+0000 7f09467fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.347+0000 7f09467fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.347+0000 7f09467fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.347+0000 7f091ffff640 1 --2- 10.20.193.48:0/2027211183 >> v2:10.20.193.111:6812/977811348 conn(0x7f091803f800 0x7f091805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.347+0000 7f091ffff640 1 -- 10.20.193.48:0/2027211183 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(115..115 src has 1..115) ==== 3503+0+0 (secure 0 0 0) 0x7f093c052b20 con 0x7f094805c950 2026-02-12T18:08:24.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.347+0000 7f09467fc640 10 monclient(hunting): handle_auth_done global_id 4991 payload 824 2026-02-12T18:08:24.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.347+0000 7f09467fc640 1 -- 10.20.193.48:0/2027211183 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0948144020 con 0x7f094813cd20 2026-02-12T18:08:24.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.347+0000 7f09477fe640 1 --2- 10.20.193.48:0/2027211183 >> v2:10.20.193.111:6812/977811348 conn(0x7f091803f800 0x7f091805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.347+0000 7f09477fe640 10 monclient: get_auth_request con 0x7f091803f800 auth_method 0 2026-02-12T18:08:24.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.349+0000 7f09467fc640 1 -- 10.20.193.48:0/2027211183 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f094813cd20 msgr2=0x7f094813d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:24.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.349+0000 7f09467fc640 1 --2- 10.20.193.48:0/2027211183 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f094813cd20 0x7f094813d0f0 secure :-1 s=READY pgs=124 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0930009060 tx=0x7f09300047e0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.350+0000 7f091ffff640 1 -- 10.20.193.48:0/2027211183 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f0930035ea0 con 0x7f094813cd20 2026-02-12T18:08:24.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.350+0000 7f091ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.350+0000 7f091ffff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:08:24.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.350+0000 7f091ffff640 10 monclient: dump: 2026-02-12T18:08:24.361 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.361 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.361 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.361 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.361 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.361 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.361 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.362 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.362 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.362 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.362 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.362 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.362 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.362 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.362 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.362 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.350+0000 7f091ffff640 1 -- 10.20.193.48:0/2027211183 <== mon.5 v2:10.20.193.111:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f09300413e0 con 0x7f094813cd20 2026-02-12T18:08:24.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.350+0000 7f091ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:24.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.350+0000 7f091ffff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:24.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.350+0000 7f091ffff640 1 -- 10.20.193.48:0/2027211183 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f094813cd20 msgr2=0x7f094813d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.350+0000 7f091ffff640 1 --2- 10.20.193.48:0/2027211183 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f094813cd20 0x7f094813d0f0 secure :-1 s=READY pgs=124 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0930009060 tx=0x7f09300047e0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.350+0000 7f091ffff640 1 -- 10.20.193.48:0/2027211183 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f094813cd20 msgr2=0x7f094813d0f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:24.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.350+0000 7f091ffff640 1 --2- 10.20.193.48:0/2027211183 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f094813cd20 0x7f094813d0f0 secure :-1 s=CLOSED pgs=124 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0930009060 tx=0x7f09300047e0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.350+0000 7f09477fe640 1 --2- 10.20.193.48:0/2027211183 >> v2:10.20.193.111:6812/977811348 conn(0x7f091803f800 0x7f091805fcb0 secure :-1 s=READY pgs=177 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0938005820 tx=0x7f0938009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.353+0000 7f094d8cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:08:24.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.353+0000 7f094d8cc640 1 --2- 10.20.193.48:0/2027211183 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f094813d630 0x7f094813f0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.353+0000 7f094d8cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.353+0000 7f094d8cc640 1 -- 10.20.193.48:0/2027211183 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f094813da30 con 0x7f094813d630 2026-02-12T18:08:24.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.353+0000 7f09467fc640 1 --2- 10.20.193.48:0/2027211183 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f094813d630 0x7f094813f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.353+0000 7f09467fc640 10 monclient: get_auth_request con 0x7f094813d630 auth_method 0 2026-02-12T18:08:24.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.353+0000 7f09467fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.353+0000 7f09467fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.353+0000 7f09467fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.353+0000 7f09467fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.353+0000 7f09467fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.353+0000 7f09467fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.354+0000 7f09467fc640 10 monclient(hunting): handle_auth_done global_id 5000 payload 824 2026-02-12T18:08:24.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.354+0000 7f09467fc640 1 -- 10.20.193.48:0/2027211183 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0948097de0 con 0x7f094813d630 2026-02-12T18:08:24.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.356+0000 7f09467fc640 1 -- 10.20.193.48:0/2027211183 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f094813d630 msgr2=0x7f094813f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:24.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.356+0000 7f09467fc640 1 --2- 10.20.193.48:0/2027211183 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f094813d630 0x7f094813f0b0 secure :-1 s=READY pgs=125 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f094808e5d0 tx=0x7f0930004770 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.356+0000 7f091ffff640 1 -- 10.20.193.48:0/2027211183 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f0930003e50 con 0x7f094813d630 2026-02-12T18:08:24.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.356+0000 7f091ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.356+0000 7f091ffff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:08:24.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.356+0000 7f091ffff640 10 monclient: dump: 2026-02-12T18:08:24.363 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.364 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.364 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.364 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.364 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.364 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.364 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.364 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.364 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.364 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.364 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.364 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.364 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.364 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.364 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.364 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.357+0000 7f091ffff640 1 -- 10.20.193.48:0/2027211183 <== mon.5 v2:10.20.193.111:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10015 (secure 0 0 0) 0x7f093004c630 con 0x7f094813d630 2026-02-12T18:08:24.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.357+0000 7f091ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:08:24.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.357+0000 7f091ffff640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:24.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.357+0000 7f091ffff640 1 -- 10.20.193.48:0/2027211183 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f094813d630 msgr2=0x7f094813f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.357+0000 7f091ffff640 1 --2- 10.20.193.48:0/2027211183 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f094813d630 0x7f094813f0b0 secure :-1 s=READY pgs=125 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f094808e5d0 tx=0x7f0930004770 comp rx=0 tx=0).stop 2026-02-12T18:08:24.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.357+0000 7f091ffff640 1 -- 10.20.193.48:0/2027211183 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f094813d630 msgr2=0x7f094813f0b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:24.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.357+0000 7f091ffff640 1 --2- 10.20.193.48:0/2027211183 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f094813d630 0x7f094813f0b0 secure :-1 s=CLOSED pgs=125 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f094808e5d0 tx=0x7f0930004770 comp rx=0 tx=0).stop 2026-02-12T18:08:24.365 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:08:24.365 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:24.365 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:24.365 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:08:24.365 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 28, 2026-02-12T18:08:24.365 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 159151, 2026-02-12T18:08:24.365 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:08:24.365 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:08:24.365 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:08:24.365 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:08:24.365 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:08:24.365 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:08:24.366 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:08:24.366 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:08:24.366 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:08:24.366 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:08:24.366 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:24.366 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 1, 2026-02-12T18:08:24.366 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:24.366 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:08:24.366 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:08:24.366 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:24.366 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:24.366 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:24.366 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:24.366 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:24.366 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:24.366 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:24.366 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:24.366 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:24.366 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:24.367 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:24.367 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:24.367 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:24.367 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:24.367 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:08:24.367 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:08:24.367 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:24.367 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:24.367 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:24.367 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:24.367 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:24.367 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:24.367 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:24.367 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:24.367 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:24.367 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:24.367 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:24.367 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:24.367 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:24.367 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.368 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.368 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:08:24.368 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:08:24.368 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:08:24.368 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:08:24.368 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:08:24.368 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:08:24.368 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:24.368 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:24.368 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:08:24.368 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:08:24.368 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:08:24.368 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:08:24.368 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:08:24.368 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:08:24.368 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:08:24.368 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:24.368 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:08:24.368 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:24.368 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:24.369 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:24.369 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:24.369 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:24.369 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:24.369 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:24.369 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:24.369 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:24.369 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:24.369 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:24.369 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:24.369 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:24.369 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:24.369 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:08:24.369 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.369 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:08:24.369 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.369 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:24.369 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:24.369 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.369 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.370 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.370 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.370 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:08:24.370 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.370 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.370 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.370 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.370 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:08:24.370 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.370 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.370 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.370 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.370 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:08:24.370 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:08:24.370 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.370 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.370 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:08:24.370 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.370 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.370 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.370 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:24.371 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:24.371 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.371 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.371 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.371 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.371 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:08:24.371 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.371 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.371 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.371 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.371 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:08:24.371 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.371 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.371 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.371 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.371 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:08:24.371 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:08:24.371 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.371 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.371 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:08:24.371 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.371 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.371 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.372 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:24.372 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:24.372 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.372 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.372 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.372 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.372 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:08:24.372 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.372 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.372 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.372 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.372 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:08:24.372 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.372 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.372 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.372 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.372 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:08:24.372 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:08:24.372 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.372 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.372 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:08:24.372 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.372 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.373 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.373 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:08:24.373 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:08:24.373 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.373 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.373 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.373 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.373 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:08:24.373 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.373 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.373 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.373 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.373 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:08:24.373 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.373 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.373 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.373 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.373 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:08:24.373 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:08:24.373 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.373 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.373 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:08:24.373 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.374 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.374 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.374 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:08:24.374 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:08:24.374 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.374 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.374 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.374 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.374 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:08:24.374 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.374 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.374 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.374 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.374 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:08:24.374 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.374 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.374 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.374 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.374 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:08:24.374 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:08:24.374 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.374 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.374 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:24.374 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.375 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.375 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.375 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:24.375 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:24.375 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.375 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.375 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.375 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.375 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:08:24.375 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.375 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.375 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.375 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.375 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:08:24.375 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.375 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.375 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.375 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.375 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:08:24.375 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:08:24.375 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.375 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.375 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:08:24.376 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.376 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.376 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.376 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:24.376 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:24.376 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.376 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.376 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.376 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.376 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:08:24.376 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.376 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.376 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.376 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.376 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:08:24.376 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.376 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.376 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.376 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.376 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:08:24.376 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:08:24.376 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.376 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.376 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:24.376 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.377 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.377 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.377 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:24.377 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:24.377 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.377 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.377 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.377 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.377 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:08:24.377 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.377 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.377 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.377 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.377 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:08:24.377 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.377 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.377 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.377 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.377 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:08:24.377 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:08:24.377 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.377 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.377 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:08:24.378 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.378 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.378 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.378 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:08:24.378 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:08:24.378 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.378 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.378 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.378 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.378 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:08:24.378 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.378 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.378 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.378 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.378 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:08:24.378 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.378 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.378 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.378 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.378 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:08:24.378 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:08:24.378 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.378 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.378 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:08:24.378 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.379 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.379 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.379 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.379 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:08:24.379 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:08:24.379 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.379 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:24.379 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:24.379 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:24.379 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.379 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:24.379 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:08:24.379 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.379 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:24.379 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:24.379 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:08:24.379 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.379 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.379 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.379 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:08:24.379 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:08:24.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.357+0000 7f094d8cc640 1 -- 10.20.193.48:0/2027211183 >> v2:10.20.193.111:6812/977811348 conn(0x7f091803f800 msgr2=0x7f091805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.357+0000 7f094d8cc640 1 --2- 10.20.193.48:0/2027211183 >> v2:10.20.193.111:6812/977811348 conn(0x7f091803f800 0x7f091805fcb0 secure :-1 s=READY pgs=177 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0938005820 tx=0x7f0938009040 comp rx=0 tx=0).stop 2026-02-12T18:08:24.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.357+0000 7f094d8cc640 10 monclient: shutdown 2026-02-12T18:08:24.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.357+0000 7f094d8cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:24.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.357+0000 7f094d8cc640 1 -- 10.20.193.48:0/2027211183 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f094805c950 msgr2=0x7f094812c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.357+0000 7f094d8cc640 1 --2- 10.20.193.48:0/2027211183 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f094805c950 0x7f094812c8f0 secure :-1 s=READY pgs=104 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f093c00e730 tx=0x7f093c00ec00 comp rx=0 tx=0).stop 2026-02-12T18:08:24.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.357+0000 7f09477fe640 1 -- 10.20.193.48:0/2027211183 reap_dead start 2026-02-12T18:08:24.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.357+0000 7f09477fe640 1 -- 10.20.193.48:0/2027211183 reap_dead start 2026-02-12T18:08:24.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.357+0000 7f094d8cc640 1 -- 10.20.193.48:0/2027211183 shutdown_connections 2026-02-12T18:08:24.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.357+0000 7f094d8cc640 1 -- 10.20.193.48:0/2027211183 >> 10.20.193.48:0/2027211183 conn(0x7f09480548a0 msgr2=0x7f0948093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:24.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.357+0000 7f094d8cc640 1 -- 10.20.193.48:0/2027211183 shutdown_connections 2026-02-12T18:08:24.381 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.357+0000 7f094d8cc640 1 -- 10.20.193.48:0/2027211183 wait complete. 2026-02-12T18:08:24.381 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:08:24.381 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2026-02-12T18:08:24.381 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2026-02-12T18:08:24.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.447+0000 7fcac1be5640 10 monclient: get_monmap_and_config 2026-02-12T18:08:24.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.447+0000 7fcac1be5640 10 monclient: build_initial_monmap 2026-02-12T18:08:24.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.447+0000 7fcac1be5640 10 monclient: monmap: 2026-02-12T18:08:24.448 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:24.449 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.449 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:24.448158+0000 2026-02-12T18:08:24.449 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:24.448158+0000 2026-02-12T18:08:24.449 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:24.449 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.449 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:24.449 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:24.449 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:24.449 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:24.449 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:24.449 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:24.450 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:24.450 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:24.450 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:24.450 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:24.450 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:24.450 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.447+0000 7fcac1be5640 1 Processor -- start 2026-02-12T18:08:24.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.447+0000 7fcac1be5640 1 -- start start 2026-02-12T18:08:24.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.447+0000 7fcac1be5640 10 monclient: init 2026-02-12T18:08:24.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.447+0000 7fcac1be5640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:24.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.447+0000 7fcac1be5640 10 monclient: _add_conns ranks=[6,10,2,1,9,5,7,4,3,8,0] 2026-02-12T18:08:24.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.447+0000 7fcac1be5640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcabc05c950 0x7fcabc05cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.447+0000 7fcac1be5640 10 monclient(hunting): picked mon.noname-d con 0x7fcabc05c950 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:08:24.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.447+0000 7fcac1be5640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7fcabc05e490 0x7fcabc05d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.447+0000 7fcac1be5640 10 monclient(hunting): picked mon.noname-f con 0x7fcabc05e490 addr v2:10.20.193.111:3300/0 2026-02-12T18:08:24.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.447+0000 7fcac1be5640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fcabc13db70 0x7fcabc13e010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.447+0000 7fcac1be5640 10 monclient(hunting): picked mon.noname-b con 0x7fcabc13db70 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:08:24.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.447+0000 7fcac1be5640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.447+0000 7fcac1be5640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7fcabc05ddd0 con 0x7fcabc05e490 2026-02-12T18:08:24.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.447+0000 7fcac1be5640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.447+0000 7fcac1be5640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fcabc05d7a0 con 0x7fcabc13db70 2026-02-12T18:08:24.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.447+0000 7fcac1be5640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.447+0000 7fcac1be5640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fcabc092990 con 0x7fcabc05c950 2026-02-12T18:08:24.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.447+0000 7fcac1be5640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:24.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.447+0000 7fcac1be5640 10 monclient(hunting): authenticate will time out at 743.173880s 2026-02-12T18:08:24.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.447+0000 7fcabb7fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcabc05c950 0x7fcabc05cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.447+0000 7fcabbfff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fcabc13db70 0x7fcabc13e010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.447+0000 7fcabb7fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcabc05c950 0x7fcabc05cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:59582/0 (socket says 10.20.193.48:59582) 2026-02-12T18:08:24.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabb7fe640 1 -- 10.20.193.48:0/294607812 learned_addr learned my addr 10.20.193.48:0/294607812 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:24.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabb7fe640 10 monclient(hunting): get_auth_request con 0x7fcabc05c950 auth_method 0 2026-02-12T18:08:24.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabbfff640 10 monclient(hunting): get_auth_request con 0x7fcabc13db70 auth_method 0 2026-02-12T18:08:24.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabaffd640 1 --2- 10.20.193.48:0/294607812 >> v2:10.20.193.111:3300/0 conn(0x7fcabc05e490 0x7fcabc05d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabaffd640 10 monclient(hunting): get_auth_request con 0x7fcabc05e490 auth_method 0 2026-02-12T18:08:24.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabb7fe640 10 monclient(hunting): handle_auth_done global_id 4938 payload 274 2026-02-12T18:08:24.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabb7fe640 1 -- 10.20.193.48:0/294607812 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fcabc13db70 msgr2=0x7fcabc13e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:24.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabb7fe640 1 --2- 10.20.193.48:0/294607812 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fcabc13db70 0x7fcabc13e010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabb7fe640 1 -- 10.20.193.48:0/294607812 >> v2:10.20.193.111:3300/0 conn(0x7fcabc05e490 msgr2=0x7fcabc05d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:24.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabb7fe640 1 --2- 10.20.193.48:0/294607812 >> v2:10.20.193.111:3300/0 conn(0x7fcabc05e490 0x7fcabc05d260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabb7fe640 10 monclient: _finish_hunting 0 2026-02-12T18:08:24.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabb7fe640 1 monclient: found mon.noname-d 2026-02-12T18:08:24.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:24.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabb7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:08:24.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.448+0000 7fcabb7fe640 1 -- 10.20.193.48:0/294607812 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcabc04dc20 con 0x7fcabc05c950 2026-02-12T18:08:24.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.450+0000 7fcabb7fe640 1 -- 10.20.193.48:0/294607812 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcabc05c950 msgr2=0x7fcabc05cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:24.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.450+0000 7fcabb7fe640 1 --2- 10.20.193.48:0/294607812 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcabc05c950 0x7fcabc05cd20 secure :-1 s=READY pgs=113 gs=1 cs=0 l=1 c_cookie=16457135965001714381 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaa8009060 tx=0x7fcaa802edf0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=e4637df76e3b8acd server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.450+0000 7fcaba7fc640 1 -- 10.20.193.48:0/294607812 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcaa8035340 con 0x7fcabc05c950 2026-02-12T18:08:24.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.450+0000 7fcaba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.450+0000 7fcaba7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:08:24.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.450+0000 7fcaba7fc640 10 monclient: dump: 2026-02-12T18:08:24.455 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.455 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.456 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.456 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.456 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.456 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.456 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.456 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.456 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.456 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.456 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.456 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.456 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.456 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.456 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.456 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.450+0000 7fcaba7fc640 10 monclient: _finish_auth 0 2026-02-12T18:08:24.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.450+0000 7fcaba7fc640 10 monclient: _check_auth_tickets 2026-02-12T18:08:24.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.450+0000 7fcaba7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:24.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.450+0000 7fcaba7fc640 1 -- 10.20.193.48:0/294607812 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaa80354c0 con 0x7fcabc05c950 2026-02-12T18:08:24.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.450+0000 7fcac1be5640 5 monclient: authenticate success, global_id 4938 2026-02-12T18:08:24.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.450+0000 7fcac1be5640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:08:24.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.450+0000 7fcaba7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:24.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.450+0000 7fcaba7fc640 1 -- 10.20.193.48:0/294607812 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcaa8035af0 con 0x7fcabc05c950 2026-02-12T18:08:24.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.450+0000 7fcac1be5640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:24.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.450+0000 7fcac1be5640 4 set_mon_vals no callback set 2026-02-12T18:08:24.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.450+0000 7fcaba7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.450+0000 7fcaba7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:08:24.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.450+0000 7fcaba7fc640 10 monclient: dump: 2026-02-12T18:08:24.457 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.457 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.457 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.457 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.457 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.457 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.457 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.457 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.457 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.457 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.457 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.457 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.457 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.457 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.458 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.458 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.451+0000 7fcac1be5640 10 monclient: shutdown 2026-02-12T18:08:24.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.451+0000 7fcac1be5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:24.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.451+0000 7fcac1be5640 1 -- 10.20.193.48:0/294607812 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcabc05c950 msgr2=0x7fcabc05cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.451+0000 7fcac1be5640 1 --2- 10.20.193.48:0/294607812 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcabc05c950 0x7fcabc05cd20 secure :-1 s=READY pgs=113 gs=1 cs=0 l=1 c_cookie=16457135965001714381 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaa8009060 tx=0x7fcaa802edf0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.451+0000 7fcac1be5640 1 -- 10.20.193.48:0/294607812 shutdown_connections 2026-02-12T18:08:24.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.451+0000 7fcac1be5640 1 --2- 10.20.193.48:0/294607812 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fcabc13db70 0x7fcabc13e010 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.451+0000 7fcac1be5640 1 --2- 10.20.193.48:0/294607812 >> v2:10.20.193.111:3300/0 conn(0x7fcabc05e490 0x7fcabc05d260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.451+0000 7fcac1be5640 1 --2- 10.20.193.48:0/294607812 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcabc05c950 0x7fcabc05cd20 unknown :-1 s=CLOSED pgs=113 gs=1 cs=0 l=1 c_cookie=16457135965001714381 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.451+0000 7fcac1be5640 1 -- 10.20.193.48:0/294607812 >> 10.20.193.48:0/294607812 conn(0x7fcabc0548a0 msgr2=0x7fcabc097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:24.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.451+0000 7fcac1be5640 1 -- 10.20.193.48:0/294607812 shutdown_connections 2026-02-12T18:08:24.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.451+0000 7fcac1be5640 1 -- 10.20.193.48:0/294607812 wait complete. 2026-02-12T18:08:24.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.451+0000 7fcac1be5640 10 monclient: build_initial_monmap 2026-02-12T18:08:24.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.451+0000 7fcac1be5640 10 monclient: monmap: 2026-02-12T18:08:24.462 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:24.462 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:24.462 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:24.462 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:24.462 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:24.462 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.462 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:24.462 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:24.462 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:24.462 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:24.462 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:24.462 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:24.463 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:24.463 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:24.463 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:24.463 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.451+0000 7fcac1be5640 1 Processor -- start 2026-02-12T18:08:24.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcac1be5640 1 -- start start 2026-02-12T18:08:24.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcac1be5640 10 monclient: init 2026-02-12T18:08:24.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcac1be5640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:24.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcac1be5640 10 monclient: _add_conns ranks=[6,0,1,5,3,4,7,8,2] 2026-02-12T18:08:24.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcac1be5640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcabc05c950 0x7fcabc12c7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcac1be5640 10 monclient(hunting): picked mon.noname-d con 0x7fcabc05c950 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:08:24.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcac1be5640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fcabc05e490 0x7fcabc08d330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcac1be5640 10 monclient(hunting): picked mon.noname-a con 0x7fcabc05e490 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:08:24.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcac1be5640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fcabc13db70 0x7fcabc08d870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcac1be5640 10 monclient(hunting): picked mon.noname-f con 0x7fcabc13db70 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:08:24.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcac1be5640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcac1be5640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fcabc091170 con 0x7fcabc05e490 2026-02-12T18:08:24.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcac1be5640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcac1be5640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fcabc0907e0 con 0x7fcabc13db70 2026-02-12T18:08:24.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcac1be5640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcac1be5640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fcabc13e7a0 con 0x7fcabc05c950 2026-02-12T18:08:24.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcac1be5640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:24.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcac1be5640 10 monclient(hunting): authenticate will time out at 743.178289s 2026-02-12T18:08:24.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabb7fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcabc05c950 0x7fcabc12c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabb7fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcabc05c950 0x7fcabc12c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:59598/0 (socket says 10.20.193.48:59598) 2026-02-12T18:08:24.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabb7fe640 1 -- 10.20.193.48:0/696597705 learned_addr learned my addr 10.20.193.48:0/696597705 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:24.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabb7fe640 10 monclient(hunting): get_auth_request con 0x7fcabc05c950 auth_method 0 2026-02-12T18:08:24.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabaffd640 1 --2- 10.20.193.48:0/696597705 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fcabc05e490 0x7fcabc08d330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabaffd640 10 monclient(hunting): get_auth_request con 0x7fcabc05e490 auth_method 0 2026-02-12T18:08:24.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabb7fe640 10 monclient(hunting): handle_auth_done global_id 4947 payload 824 2026-02-12T18:08:24.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabb7fe640 1 -- 10.20.193.48:0/696597705 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fcabc13db70 msgr2=0x7fcabc08d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabbfff640 1 --2- 10.20.193.48:0/696597705 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fcabc13db70 0x7fcabc08d870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabb7fe640 1 --2- 10.20.193.48:0/696597705 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fcabc13db70 0x7fcabc08d870 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabb7fe640 1 -- 10.20.193.48:0/696597705 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fcabc05e490 msgr2=0x7fcabc08d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabb7fe640 1 --2- 10.20.193.48:0/696597705 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fcabc05e490 0x7fcabc08d330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabb7fe640 10 monclient: _finish_hunting 0 2026-02-12T18:08:24.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabb7fe640 1 monclient: found mon.noname-d 2026-02-12T18:08:24.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:24.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabb7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:08:24.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabb7fe640 1 -- 10.20.193.48:0/696597705 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaa80094f0 con 0x7fcabc05c950 2026-02-12T18:08:24.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabbfff640 10 monclient: get_auth_request con 0x7fcabc13db70 auth_method 0 2026-02-12T18:08:24.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.452+0000 7fcabbfff640 1 --2- 10.20.193.48:0/696597705 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fcabc13db70 0x7fcabc08d870 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-12T18:08:24.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.454+0000 7fcabb7fe640 1 -- 10.20.193.48:0/696597705 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcabc05c950 msgr2=0x7fcabc12c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:24.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.454+0000 7fcabb7fe640 1 --2- 10.20.193.48:0/696597705 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcabc05c950 0x7fcabc12c7d0 secure :-1 s=READY pgs=114 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaa8004740 tx=0x7fcaa8004770 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.454+0000 7fca97fff640 1 -- 10.20.193.48:0/696597705 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcaa8035340 con 0x7fcabc05c950 2026-02-12T18:08:24.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.454+0000 7fca97fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.454+0000 7fca97fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:08:24.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.454+0000 7fca97fff640 10 monclient: dump: 2026-02-12T18:08:24.466 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.466 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.466 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.466 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.466 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.466 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.466 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.466 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.466 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.466 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.466 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.466 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.466 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.466 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.466 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.466 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.454+0000 7fca97fff640 10 monclient: _finish_auth 0 2026-02-12T18:08:24.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.454+0000 7fca97fff640 10 monclient: _check_auth_tickets 2026-02-12T18:08:24.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.454+0000 7fca97fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:24.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.454+0000 7fca97fff640 1 -- 10.20.193.48:0/696597705 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcaa80044f0 con 0x7fcabc05c950 2026-02-12T18:08:24.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.454+0000 7fca97fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:24.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.454+0000 7fca97fff640 1 -- 10.20.193.48:0/696597705 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcaa8035d80 con 0x7fcabc05c950 2026-02-12T18:08:24.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.454+0000 7fca97fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.454+0000 7fcab9ffb640 4 set_mon_vals no callback set 2026-02-12T18:08:24.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.454+0000 7fca97fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:08:24.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.454+0000 7fca97fff640 10 monclient: dump: 2026-02-12T18:08:24.467 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.467 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.467 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.467 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.467 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.467 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.467 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.467 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.467 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.467 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.467 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.467 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.467 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.467 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.468 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.468 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.454+0000 7fcac1be5640 5 monclient: authenticate success, global_id 4947 2026-02-12T18:08:24.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.454+0000 7fcac1be5640 10 monclient: _renew_subs 2026-02-12T18:08:24.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.454+0000 7fcac1be5640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:08:24.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.454+0000 7fcac1be5640 1 -- 10.20.193.48:0/696597705 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcabc13e3e0 con 0x7fcabc05c950 2026-02-12T18:08:24.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.455+0000 7fcac1be5640 10 monclient: _renew_subs 2026-02-12T18:08:24.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.455+0000 7fcac1be5640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:08:24.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.455+0000 7fcac1be5640 1 -- 10.20.193.48:0/696597705 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fcabc143a80 con 0x7fcabc05c950 2026-02-12T18:08:24.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.455+0000 7fcac1be5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:24.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.455+0000 7fcac1be5640 1 --2- 10.20.193.48:0/696597705 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcabc13cc20 0x7fcabc13cff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.455+0000 7fcac1be5640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.455+0000 7fcac1be5640 1 -- 10.20.193.48:0/696597705 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fcabc05f140 con 0x7fcabc13cc20 2026-02-12T18:08:24.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.455+0000 7fca97fff640 1 -- 10.20.193.48:0/696597705 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fcaa8004030 con 0x7fcabc05c950 2026-02-12T18:08:24.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.455+0000 7fcabaffd640 1 --2- 10.20.193.48:0/696597705 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcabc13cc20 0x7fcabc13cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.455+0000 7fcabaffd640 10 monclient: get_auth_request con 0x7fcabc13cc20 auth_method 0 2026-02-12T18:08:24.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.455+0000 7fcabaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.455+0000 7fcabaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.455+0000 7fcabaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.455+0000 7fca97fff640 1 --2- 10.20.193.48:0/696597705 >> v2:10.20.193.111:6812/977811348 conn(0x7fca8c03f800 0x7fca8c05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.455+0000 7fcabaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.455+0000 7fcabaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.455+0000 7fcabaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.455+0000 7fca97fff640 1 -- 10.20.193.48:0/696597705 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(115..115 src has 1..115) ==== 3503+0+0 (secure 0 0 0) 0x7fcaa8077e80 con 0x7fcabc05c950 2026-02-12T18:08:24.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.456+0000 7fcabbfff640 1 --2- 10.20.193.48:0/696597705 >> v2:10.20.193.111:6812/977811348 conn(0x7fca8c03f800 0x7fca8c05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.456+0000 7fcabbfff640 10 monclient: get_auth_request con 0x7fca8c03f800 auth_method 0 2026-02-12T18:08:24.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.456+0000 7fcabaffd640 10 monclient(hunting): handle_auth_done global_id 44197 payload 824 2026-02-12T18:08:24.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.456+0000 7fcabaffd640 1 -- 10.20.193.48:0/696597705 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcabc097de0 con 0x7fcabc13cc20 2026-02-12T18:08:24.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.458+0000 7fcabbfff640 1 --2- 10.20.193.48:0/696597705 >> v2:10.20.193.111:6812/977811348 conn(0x7fca8c03f800 0x7fca8c05fcb0 secure :-1 s=READY pgs=178 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcabc091430 tx=0x7fcab0009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.458+0000 7fcabaffd640 1 -- 10.20.193.48:0/696597705 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcabc13cc20 msgr2=0x7fcabc13cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:24.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.458+0000 7fcabaffd640 1 --2- 10.20.193.48:0/696597705 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcabc13cc20 0x7fcabc13cff0 secure :-1 s=READY pgs=22 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcabc08ee30 tx=0x7fcaac011ca0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.458+0000 7fca97fff640 1 -- 10.20.193.48:0/696597705 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcaac00c070 con 0x7fcabc13cc20 2026-02-12T18:08:24.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.458+0000 7fca97fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.458+0000 7fca97fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:08:24.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.458+0000 7fca97fff640 10 monclient: dump: 2026-02-12T18:08:24.469 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.469 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.469 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.469 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.469 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.470 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.470 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.470 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.470 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.470 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.470 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.470 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.470 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.470 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.470 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.470 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.458+0000 7fca97fff640 1 -- 10.20.193.48:0/696597705 <== mon.7 v2:10.20.193.111:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fcaac00fa10 con 0x7fcabc13cc20 2026-02-12T18:08:24.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.458+0000 7fca97fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:24.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.458+0000 7fca97fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:24.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.458+0000 7fca97fff640 1 -- 10.20.193.48:0/696597705 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcabc13cc20 msgr2=0x7fcabc13cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.458+0000 7fca97fff640 1 --2- 10.20.193.48:0/696597705 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcabc13cc20 0x7fcabc13cff0 secure :-1 s=READY pgs=22 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcabc08ee30 tx=0x7fcaac011ca0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.458+0000 7fca97fff640 1 -- 10.20.193.48:0/696597705 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcabc13cc20 msgr2=0x7fcabc13cff0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:24.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.458+0000 7fca97fff640 1 --2- 10.20.193.48:0/696597705 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcabc13cc20 0x7fcabc13cff0 secure :-1 s=CLOSED pgs=22 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcabc08ee30 tx=0x7fcaac011ca0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.462+0000 7fcac1be5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:08:24.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.462+0000 7fcac1be5640 1 --2- 10.20.193.48:0/696597705 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcabc13d530 0x7fcabc129250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.462+0000 7fcac1be5640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.462+0000 7fcac1be5640 1 -- 10.20.193.48:0/696597705 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fcabc05fd90 con 0x7fcabc13d530 2026-02-12T18:08:24.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.462+0000 7fcabaffd640 1 --2- 10.20.193.48:0/696597705 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcabc13d530 0x7fcabc129250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.462+0000 7fcabaffd640 10 monclient: get_auth_request con 0x7fcabc13d530 auth_method 0 2026-02-12T18:08:24.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.462+0000 7fcabaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.462+0000 7fcabaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.462+0000 7fcabaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.462+0000 7fcabaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.462+0000 7fcabaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.462+0000 7fcabaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.462+0000 7fcabaffd640 10 monclient(hunting): handle_auth_done global_id 44206 payload 824 2026-02-12T18:08:24.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.462+0000 7fcabaffd640 1 -- 10.20.193.48:0/696597705 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcabc08a890 con 0x7fcabc13d530 2026-02-12T18:08:24.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.465+0000 7fcabaffd640 1 -- 10.20.193.48:0/696597705 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcabc13d530 msgr2=0x7fcabc129250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:24.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.465+0000 7fcabaffd640 1 --2- 10.20.193.48:0/696597705 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcabc13d530 0x7fcabc129250 secure :-1 s=READY pgs=23 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaac006ed0 tx=0x7fcaac004770 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.465+0000 7fca97fff640 1 -- 10.20.193.48:0/696597705 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcaac003cd0 con 0x7fcabc13d530 2026-02-12T18:08:24.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.465+0000 7fca97fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.465+0000 7fca97fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:08:24.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.465+0000 7fca97fff640 10 monclient: dump: 2026-02-12T18:08:24.473 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.473 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.473 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.473 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.473 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.473 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.473 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.473 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.473 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.473 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.473 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.473 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.473 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.473 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.473 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.473 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.465+0000 7fca97fff640 1 -- 10.20.193.48:0/696597705 <== mon.7 v2:10.20.193.111:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7fcaac003e30 con 0x7fcabc13d530 2026-02-12T18:08:24.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.465+0000 7fca97fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:08:24.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.465+0000 7fca97fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:24.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.465+0000 7fca97fff640 1 -- 10.20.193.48:0/696597705 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcabc13d530 msgr2=0x7fcabc129250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.465+0000 7fca97fff640 1 --2- 10.20.193.48:0/696597705 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcabc13d530 0x7fcabc129250 secure :-1 s=READY pgs=23 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaac006ed0 tx=0x7fcaac004770 comp rx=0 tx=0).stop 2026-02-12T18:08:24.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.465+0000 7fca97fff640 1 -- 10.20.193.48:0/696597705 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcabc13d530 msgr2=0x7fcabc129250 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:24.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.465+0000 7fca97fff640 1 --2- 10.20.193.48:0/696597705 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fcabc13d530 0x7fcabc129250 secure :-1 s=CLOSED pgs=23 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaac006ed0 tx=0x7fcaac004770 comp rx=0 tx=0).stop 2026-02-12T18:08:24.474 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:08:24.474 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:24.474 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:24.474 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:08:24.474 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 28, 2026-02-12T18:08:24.474 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 16346, 2026-02-12T18:08:24.474 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:08:24.475 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:08:24.475 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:08:24.475 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:08:24.475 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:08:24.475 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:08:24.475 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:08:24.475 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:08:24.475 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:08:24.475 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:08:24.475 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:24.475 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 1, 2026-02-12T18:08:24.475 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:24.475 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:08:24.475 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:08:24.475 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:24.475 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:24.475 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:24.475 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:24.475 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:24.475 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:24.476 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:24.476 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:24.476 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:24.476 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:24.476 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:24.476 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:24.476 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:24.476 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:24.476 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:08:24.476 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:08:24.476 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:24.476 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:24.476 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:24.476 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:24.476 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:24.476 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:24.476 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:24.476 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:24.476 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:24.476 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:24.477 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:24.477 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:24.477 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:24.477 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.477 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.477 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:08:24.477 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:08:24.477 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:08:24.477 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:08:24.477 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:08:24.477 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:08:24.477 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:24.477 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:24.477 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:08:24.477 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:08:24.477 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:08:24.477 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:08:24.477 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:08:24.477 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:08:24.478 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:08:24.478 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:24.478 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:08:24.478 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:24.478 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:24.478 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:24.478 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:24.478 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:24.478 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:24.478 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:24.478 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:24.478 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:24.478 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:24.478 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:24.478 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:24.478 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:24.478 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:24.478 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:08:24.478 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.478 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:08:24.479 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.479 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:24.479 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:24.479 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.479 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.479 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.479 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.479 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:08:24.479 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.479 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.479 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.479 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.479 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:08:24.479 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.479 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.479 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.479 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.479 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:08:24.479 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:08:24.479 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.479 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.480 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:08:24.480 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.480 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.480 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.480 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:24.480 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:24.480 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.480 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.480 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.480 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.480 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:08:24.480 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.480 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.480 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.480 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.480 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:08:24.480 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.480 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.480 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.480 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.480 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:08:24.480 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:08:24.480 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.481 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.481 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:08:24.481 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.481 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.481 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.481 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:24.481 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:24.481 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.481 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.481 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.481 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.481 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:08:24.481 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.481 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.481 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.481 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.481 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:08:24.481 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.481 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.481 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.481 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.481 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:08:24.481 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:08:24.481 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.482 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.482 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:08:24.482 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.482 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.482 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.482 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:08:24.482 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:08:24.482 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.482 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.482 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.482 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.482 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:08:24.482 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.482 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.482 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.482 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.482 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:08:24.482 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.482 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.482 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.482 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.482 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:08:24.482 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:08:24.482 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.482 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.483 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:08:24.483 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.483 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.483 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.483 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:08:24.483 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:08:24.483 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.483 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.483 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.483 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.483 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:08:24.483 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.483 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.483 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.483 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.483 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:08:24.483 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.483 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.483 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.483 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.483 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:08:24.483 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:08:24.483 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.483 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.483 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:24.483 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.484 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.484 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.484 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:24.484 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:24.484 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.484 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.484 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.484 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.484 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:08:24.484 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.484 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.484 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.484 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.484 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:08:24.484 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.484 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.484 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.484 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.484 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:08:24.484 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:08:24.484 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.484 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.484 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:08:24.484 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.484 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.484 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.485 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:24.485 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:24.485 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.485 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.485 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.485 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.485 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:08:24.485 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.485 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.485 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.485 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.485 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:08:24.485 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.485 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.485 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.485 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.485 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:08:24.485 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:08:24.485 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.485 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.485 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:24.485 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.485 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.485 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.485 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:24.486 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:24.486 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.486 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.486 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.486 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.486 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:08:24.486 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.486 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.486 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.486 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.486 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:08:24.486 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.486 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.486 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.486 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.486 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:08:24.486 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:08:24.486 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.486 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.486 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:08:24.486 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.486 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.486 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.486 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:08:24.487 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:08:24.487 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:24.487 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:24.487 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.487 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:24.487 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:08:24.487 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.487 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.487 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.487 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:24.487 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:08:24.487 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:24.487 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.487 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.487 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.487 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:08:24.487 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:08:24.487 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:24.487 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:24.487 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:08:24.487 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:24.487 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.487 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.487 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.487 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:08:24.487 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:08:24.488 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.488 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:24.488 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:24.488 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:24.488 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.488 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:24.488 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:08:24.488 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:24.488 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:24.488 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:24.488 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:08:24.488 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:24.488 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:24.488 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:24.488 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:08:24.488 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:08:24.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.465+0000 7fcac1be5640 1 -- 10.20.193.48:0/696597705 >> v2:10.20.193.111:6812/977811348 conn(0x7fca8c03f800 msgr2=0x7fca8c05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.465+0000 7fcac1be5640 1 --2- 10.20.193.48:0/696597705 >> v2:10.20.193.111:6812/977811348 conn(0x7fca8c03f800 0x7fca8c05fcb0 secure :-1 s=READY pgs=178 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcabc091430 tx=0x7fcab0009040 comp rx=0 tx=0).stop 2026-02-12T18:08:24.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.465+0000 7fcac1be5640 10 monclient: shutdown 2026-02-12T18:08:24.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.465+0000 7fcac1be5640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:24.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.465+0000 7fcac1be5640 1 -- 10.20.193.48:0/696597705 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcabc05c950 msgr2=0x7fcabc12c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.465+0000 7fcac1be5640 1 --2- 10.20.193.48:0/696597705 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcabc05c950 0x7fcabc12c7d0 secure :-1 s=READY pgs=114 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcaa8004740 tx=0x7fcaa8004770 comp rx=0 tx=0).stop 2026-02-12T18:08:24.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.465+0000 7fcabbfff640 1 -- 10.20.193.48:0/696597705 reap_dead start 2026-02-12T18:08:24.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.465+0000 7fcac1be5640 1 -- 10.20.193.48:0/696597705 shutdown_connections 2026-02-12T18:08:24.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.465+0000 7fcac1be5640 1 --2- 10.20.193.48:0/696597705 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcabc05c950 0x7fcabc12c7d0 unknown :-1 s=CLOSED pgs=114 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.465+0000 7fcac1be5640 1 -- 10.20.193.48:0/696597705 >> 10.20.193.48:0/696597705 conn(0x7fcabc0548a0 msgr2=0x7fcabc093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:24.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.465+0000 7fcac1be5640 1 -- 10.20.193.48:0/696597705 shutdown_connections 2026-02-12T18:08:24.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.465+0000 7fcac1be5640 1 -- 10.20.193.48:0/696597705 wait complete. 2026-02-12T18:08:24.490 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:08:24.490 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-12T18:08:24.490 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-12T18:08:24.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.553+0000 7f473a6cc640 10 monclient: get_monmap_and_config 2026-02-12T18:08:24.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.553+0000 7f473a6cc640 10 monclient: build_initial_monmap 2026-02-12T18:08:24.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.553+0000 7f473a6cc640 10 monclient: monmap: 2026-02-12T18:08:24.555 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:24.555 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.555 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:24.555011+0000 2026-02-12T18:08:24.555 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:24.555011+0000 2026-02-12T18:08:24.555 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:24.555 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.555 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:24.555 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:24.556 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:24.556 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:24.556 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:24.556 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:24.556 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:24.556 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:24.556 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:24.556 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:24.556 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:24.556 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.554+0000 7f473a6cc640 1 Processor -- start 2026-02-12T18:08:24.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.554+0000 7f473a6cc640 1 -- start start 2026-02-12T18:08:24.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.554+0000 7f473a6cc640 10 monclient: init 2026-02-12T18:08:24.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.554+0000 7f473a6cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:24.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.554+0000 7f473a6cc640 10 monclient: _add_conns ranks=[3,6,1,7,9,2,8,4,5,0,10] 2026-02-12T18:08:24.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.554+0000 7f473a6cc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f473405dc20 0x7f4734144660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.554+0000 7f473a6cc640 10 monclient(hunting): picked mon.noname-g con 0x7f473405dc20 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:08:24.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.554+0000 7f473a6cc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f473405dff0 0x7f473405e3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.554+0000 7f473a6cc640 10 monclient(hunting): picked mon.noname-d con 0x7f473405dff0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:08:24.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.554+0000 7f473a6cc640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f4734089df0 addr v1:10.20.193.111:6789/0 2026-02-12T18:08:24.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.554+0000 7f473a6cc640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4734060390 con 0x7f4734089df0 2026-02-12T18:08:24.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.554+0000 7f473a6cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.554+0000 7f473a6cc640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f473408b0d0 con 0x7f473405dc20 2026-02-12T18:08:24.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.554+0000 7f473a6cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.554+0000 7f473a6cc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f4734093a30 con 0x7f473405dff0 2026-02-12T18:08:24.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.554+0000 7f473a6cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:24.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.554+0000 7f473a6cc640 10 monclient(hunting): authenticate will time out at 743.280924s 2026-02-12T18:08:24.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.554+0000 7f47337fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f473405dff0 0x7f473405e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.555+0000 7f47337fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f473405dff0 0x7f473405e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:59604/0 (socket says 10.20.193.48:59604) 2026-02-12T18:08:24.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.555+0000 7f47337fe640 1 -- 10.20.193.48:0/887177264 learned_addr learned my addr 10.20.193.48:0/887177264 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:24.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.555+0000 7f47337fe640 10 monclient(hunting): get_auth_request con 0x7f473405dff0 auth_method 0 2026-02-12T18:08:24.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.555+0000 7f47337fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.555+0000 7f47337fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.555+0000 7f47337fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.555+0000 7f47337fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.555+0000 7f47337fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.555+0000 7f47337fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.555+0000 7f4733fff640 1 --2- 10.20.193.48:0/887177264 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f473405dc20 0x7f4734144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.555+0000 7f4733fff640 10 monclient(hunting): get_auth_request con 0x7f473405dc20 auth_method 0 2026-02-12T18:08:24.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.555+0000 7f4733fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.555+0000 7f4733fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.555+0000 7f4733fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.555+0000 7f47337fe640 10 monclient(hunting): handle_auth_done global_id 4956 payload 274 2026-02-12T18:08:24.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.555+0000 7f47337fe640 1 -- 10.20.193.48:0/887177264 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f473405dc20 msgr2=0x7f4734144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:24.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.555+0000 7f47337fe640 1 --2- 10.20.193.48:0/887177264 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f473405dc20 0x7f4734144660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.555+0000 7f47337fe640 1 -- 10.20.193.48:0/887177264 >> v1:10.20.193.111:6789/0 conn(0x7f4734089df0 legacy=0x7f473408a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:24.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.555+0000 7f47337fe640 10 monclient: _finish_hunting 0 2026-02-12T18:08:24.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.555+0000 7f47337fe640 1 monclient: found mon.noname-d 2026-02-12T18:08:24.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.555+0000 7f47337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:24.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.555+0000 7f47337fe640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:08:24.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.555+0000 7f47337fe640 1 -- 10.20.193.48:0/887177264 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f473408b250 con 0x7f473405dff0 2026-02-12T18:08:24.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.557+0000 7f47337fe640 1 -- 10.20.193.48:0/887177264 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f473405dff0 msgr2=0x7f473405e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:24.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.557+0000 7f47337fe640 1 --2- 10.20.193.48:0/887177264 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f473405dff0 0x7f473405e3c0 secure :-1 s=READY pgs=115 gs=2 cs=0 l=1 c_cookie=15906911024674466954 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47240098d0 tx=0x7f472402eeb0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=dcc0b34c6b776c8a server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.557+0000 7f4732ffd640 1 -- 10.20.193.48:0/887177264 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4724035340 con 0x7f473405dff0 2026-02-12T18:08:24.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.557+0000 7f4732ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.557+0000 7f4732ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:08:24.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.557+0000 7f4732ffd640 10 monclient: dump: 2026-02-12T18:08:24.563 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.563 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.563 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.564 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.564 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.564 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.564 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.564 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.564 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.564 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.564 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.564 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.564 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.564 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.564 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.564 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.564 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.557+0000 7f4732ffd640 10 monclient: _finish_auth 0 2026-02-12T18:08:24.564 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.557+0000 7f4732ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:08:24.564 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.557+0000 7f4732ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:24.564 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.557+0000 7f4732ffd640 1 -- 10.20.193.48:0/887177264 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47240354c0 con 0x7f473405dff0 2026-02-12T18:08:24.564 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.557+0000 7f473a6cc640 5 monclient: authenticate success, global_id 4956 2026-02-12T18:08:24.564 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.557+0000 7f473a6cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:08:24.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.557+0000 7f4732ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:24.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.557+0000 7f4732ffd640 1 -- 10.20.193.48:0/887177264 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4724035af0 con 0x7f473405dff0 2026-02-12T18:08:24.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.557+0000 7f473a6cc640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:24.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.557+0000 7f473a6cc640 4 set_mon_vals no callback set 2026-02-12T18:08:24.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.557+0000 7f4732ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.557+0000 7f4732ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:08:24.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.557+0000 7f4732ffd640 10 monclient: dump: 2026-02-12T18:08:24.565 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.565 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.565 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.565 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.565 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.565 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.565 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.565 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.565 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.565 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.565 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.565 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.565 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.566 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.566 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.566 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.558+0000 7f473a6cc640 10 monclient: shutdown 2026-02-12T18:08:24.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.558+0000 7f473a6cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:24.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.558+0000 7f473a6cc640 1 -- 10.20.193.48:0/887177264 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f473405dff0 msgr2=0x7f473405e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.558+0000 7f473a6cc640 1 --2- 10.20.193.48:0/887177264 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f473405dff0 0x7f473405e3c0 secure :-1 s=READY pgs=115 gs=2 cs=0 l=1 c_cookie=15906911024674466954 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47240098d0 tx=0x7f472402eeb0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.558+0000 7f473a6cc640 1 -- 10.20.193.48:0/887177264 shutdown_connections 2026-02-12T18:08:24.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.558+0000 7f473a6cc640 1 --2- 10.20.193.48:0/887177264 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f473405dff0 0x7f473405e3c0 unknown :-1 s=CLOSED pgs=115 gs=2 cs=0 l=1 c_cookie=15906911024674466954 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.558+0000 7f473a6cc640 1 --2- 10.20.193.48:0/887177264 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f473405dc20 0x7f4734144660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.558+0000 7f473a6cc640 1 -- 10.20.193.48:0/887177264 >> 10.20.193.48:0/887177264 conn(0x7f47340546d0 msgr2=0x7f4734054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:24.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.558+0000 7f473a6cc640 1 -- 10.20.193.48:0/887177264 shutdown_connections 2026-02-12T18:08:24.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.558+0000 7f473a6cc640 1 -- 10.20.193.48:0/887177264 wait complete. 2026-02-12T18:08:24.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.558+0000 7f473a6cc640 10 monclient: build_initial_monmap 2026-02-12T18:08:24.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.558+0000 7f473a6cc640 10 monclient: monmap: 2026-02-12T18:08:24.566 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:24.566 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:24.566 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:24.566 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:24.566 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:24.567 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.567 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:24.567 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:24.567 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:24.567 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:24.567 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:24.567 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:24.567 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:24.567 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:24.567 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:24.567 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.558+0000 7f473a6cc640 1 Processor -- start 2026-02-12T18:08:24.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.558+0000 7f473a6cc640 1 -- start start 2026-02-12T18:08:24.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.558+0000 7f473a6cc640 10 monclient: init 2026-02-12T18:08:24.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f473a6cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:24.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f473a6cc640 10 monclient: _add_conns ranks=[5,3,0,6,4,2,8,1,7] 2026-02-12T18:08:24.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f473a6cc640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f473405dc20 0x7f473410db60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f473a6cc640 10 monclient(hunting): picked mon.noname-h con 0x7f473405dc20 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:08:24.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f473a6cc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f473405dff0 0x7f473410e0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f473a6cc640 10 monclient(hunting): picked mon.noname-g con 0x7f473405dff0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:08:24.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f473a6cc640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f4734089df0 0x7f473410e5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f473a6cc640 10 monclient(hunting): picked mon.noname-a con 0x7f4734089df0 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:08:24.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f473a6cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f473a6cc640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f4734091600 con 0x7f4734089df0 2026-02-12T18:08:24.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f473a6cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f473a6cc640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f47341106a0 con 0x7f473405dff0 2026-02-12T18:08:24.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f473a6cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:24.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f473a6cc640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f473410fe40 con 0x7f473405dc20 2026-02-12T18:08:24.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f473a6cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:24.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f473a6cc640 10 monclient(hunting): authenticate will time out at 743.285117s 2026-02-12T18:08:24.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f4738c42640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f4734089df0 0x7f473410e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f4738c42640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f4734089df0 0x7f473410e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:38068/0 (socket says 10.20.193.48:38068) 2026-02-12T18:08:24.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f4738c42640 1 -- 10.20.193.48:0/2452452283 learned_addr learned my addr 10.20.193.48:0/2452452283 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:24.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f4738c42640 10 monclient(hunting): get_auth_request con 0x7f4734089df0 auth_method 0 2026-02-12T18:08:24.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f4738c42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f4738c42640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f4738c42640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f4738c42640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:24.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f4738c42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:24.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f4738c42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:24.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f4733fff640 1 --2- 10.20.193.48:0/2452452283 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f473405dc20 0x7f473410db60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f4733fff640 10 monclient(hunting): get_auth_request con 0x7f473405dc20 auth_method 0 2026-02-12T18:08:24.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f4733fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:24.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f4733fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:24.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f4733fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:24.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f4738c42640 10 monclient(hunting): handle_auth_done global_id 5148 payload 824 2026-02-12T18:08:24.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f4738c42640 1 -- 10.20.193.48:0/2452452283 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f473405dc20 msgr2=0x7f473410db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f4738c42640 1 --2- 10.20.193.48:0/2452452283 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f473405dc20 0x7f473410db60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f4738c42640 1 -- 10.20.193.48:0/2452452283 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f473405dff0 msgr2=0x7f473410e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f47337fe640 1 --2- 10.20.193.48:0/2452452283 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f473405dff0 0x7f473410e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f4738c42640 1 --2- 10.20.193.48:0/2452452283 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f473405dff0 0x7f473410e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f4738c42640 10 monclient: _finish_hunting 0 2026-02-12T18:08:24.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f4738c42640 1 monclient: found mon.noname-a 2026-02-12T18:08:24.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f4738c42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:24.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f4738c42640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:08:24.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f4738c42640 1 -- 10.20.193.48:0/2452452283 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47240094f0 con 0x7f4734089df0 2026-02-12T18:08:24.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f47337fe640 10 monclient: get_auth_request con 0x7f473405dff0 auth_method 0 2026-02-12T18:08:24.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.559+0000 7f47337fe640 1 --2- 10.20.193.48:0/2452452283 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f473405dff0 0x7f473410e0a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-12T18:08:24.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.561+0000 7f4738c42640 1 -- 10.20.193.48:0/2452452283 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f4734089df0 msgr2=0x7f473410e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:24.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.561+0000 7f4738c42640 1 --2- 10.20.193.48:0/2452452283 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f4734089df0 0x7f473410e5e0 secure :-1 s=READY pgs=217 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f472800d4b0 tx=0x7f472800d980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.561+0000 7f4730ff9640 1 -- 10.20.193.48:0/2452452283 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4728007e30 con 0x7f4734089df0 2026-02-12T18:08:24.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.561+0000 7f4730ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.561+0000 7f4730ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:08:24.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.561+0000 7f4730ff9640 10 monclient: dump: 2026-02-12T18:08:24.570 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.570 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.570 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.570 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.570 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.570 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.570 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.570 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.570 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.570 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.570 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.570 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.570 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.570 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.571 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.571 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.561+0000 7f4730ff9640 10 monclient: _finish_auth 0 2026-02-12T18:08:24.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.561+0000 7f4730ff9640 10 monclient: _check_auth_tickets 2026-02-12T18:08:24.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.561+0000 7f4730ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:24.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.561+0000 7f4730ff9640 1 -- 10.20.193.48:0/2452452283 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4728013840 con 0x7f4734089df0 2026-02-12T18:08:24.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.561+0000 7f4730ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:24.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.561+0000 7f4730ff9640 1 -- 10.20.193.48:0/2452452283 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4728013e70 con 0x7f4734089df0 2026-02-12T18:08:24.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.561+0000 7f4730ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:24.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.561+0000 7f4730ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:08:24.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.561+0000 7f47327fc640 4 set_mon_vals no callback set 2026-02-12T18:08:24.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.561+0000 7f4730ff9640 10 monclient: dump: 2026-02-12T18:08:24.571 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:24.571 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:24.571 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.571 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:24.571 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:24.571 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:24.571 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:24.572 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:24.572 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:24.572 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:24.572 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:24.572 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:24.572 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:24.572 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:24.572 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:24.572 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:24.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.561+0000 7f473a6cc640 5 monclient: authenticate success, global_id 5148 2026-02-12T18:08:24.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.561+0000 7f473a6cc640 10 monclient: _renew_subs 2026-02-12T18:08:24.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.561+0000 7f473a6cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:08:24.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.561+0000 7f473a6cc640 1 -- 10.20.193.48:0/2452452283 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4734142960 con 0x7f4734089df0 2026-02-12T18:08:24.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.561+0000 7f473a6cc640 10 monclient: _renew_subs 2026-02-12T18:08:24.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.561+0000 7f473a6cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:08:24.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.561+0000 7f473a6cc640 1 -- 10.20.193.48:0/2452452283 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47341103c0 con 0x7f4734089df0 2026-02-12T18:08:24.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.562+0000 7f473a6cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:24.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.562+0000 7f473a6cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:24.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.562+0000 7f473a6cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:08:24.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.562+0000 7f473a6cc640 1 -- 10.20.193.48:0/2452452283 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4734092510 con 0x7f4734089df0 2026-02-12T18:08:24.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.562+0000 7f4730ff9640 1 -- 10.20.193.48:0/2452452283 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f472801a070 con 0x7f4734089df0 2026-02-12T18:08:24.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.562+0000 7f4730ff9640 1 --2- 10.20.193.48:0/2452452283 >> v2:10.20.193.111:6812/977811348 conn(0x7f470403f7f0 0x7f470405fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:24.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.563+0000 7f4730ff9640 1 -- 10.20.193.48:0/2452452283 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 3503+0+0 (secure 0 0 0) 0x7f4728053ba0 con 0x7f4734089df0 2026-02-12T18:08:24.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.563+0000 7f4733fff640 1 --2- 10.20.193.48:0/2452452283 >> v2:10.20.193.111:6812/977811348 conn(0x7f470403f7f0 0x7f470405fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:24.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.563+0000 7f4733fff640 10 monclient: get_auth_request con 0x7f470403f7f0 auth_method 0 2026-02-12T18:08:24.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.565+0000 7f4730ff9640 1 -- 10.20.193.48:0/2452452283 <== mon.0 v2:10.20.193.48:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f4728023770 con 0x7f4734089df0 2026-02-12T18:08:24.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.565+0000 7f4730ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:24.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.565+0000 7f4730ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:24.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.565+0000 7f4733fff640 1 --2- 10.20.193.48:0/2452452283 >> v2:10.20.193.111:6812/977811348 conn(0x7f470403f7f0 0x7f470405fca0 secure :-1 s=READY pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4720004740 tx=0x7f4720008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:24.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.709+0000 7f473a6cc640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-12T18:08:24.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.709+0000 7f473a6cc640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-12T18:08:24.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.709+0000 7f473a6cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:08:24.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.709+0000 7f473a6cc640 1 -- 10.20.193.48:0/2452452283 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f4734063770 con 0x7f4734089df0 2026-02-12T18:08:24.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.710+0000 7f4730ff9640 1 -- 10.20.193.48:0/2452452283 <== mon.0 v2:10.20.193.48:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f47280112e0 con 0x7f4734089df0 2026-02-12T18:08:24.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.710+0000 7f4730ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-12T18:08:24.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.710+0000 7f4730ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:24.716 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.716 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=13,kv=12,logm=61} crc {auth=2339382842,config=1618278320,health=2358046931,kv=2857826951,logm=4072660325}) 2026-02-12T18:08:24.717 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=12,config=2,health=13,kv=12,logm=61} crc {auth=1426410682,config=1618278320,health=2358046931,kv=2885551559,logm=1942935988}) 2026-02-12T18:08:24.717 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.717 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=13,kv=12,logm=61} crc {auth=2339382842,config=1618278320,health=2358046931,kv=2857826951,logm=4072660325}) 2026-02-12T18:08:24.717 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=10,config=2,health=13,kv=11,logm=64} crc {auth=4231805940,config=1618278320,health=2358046931,kv=2071964108,logm=2995912671}) 2026-02-12T18:08:24.717 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.717 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=13,kv=12,logm=61} crc {auth=2339382842,config=1618278320,health=2358046931,kv=2857826951,logm=4072660325}) 2026-02-12T18:08:24.717 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=12,config=2,health=13,kv=11,logm=62} crc {auth=1426410682,config=1618278320,health=2358046931,kv=381788265,logm=2513391240}) 2026-02-12T18:08:24.717 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.717 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=13,kv=12,logm=61} crc {auth=2339382842,config=1618278320,health=2358046931,kv=2857826951,logm=4072660325}) 2026-02-12T18:08:24.717 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=11,config=2,health=13,kv=12,logm=62} crc {auth=2262324432,config=1618278320,health=2358046931,kv=2857826951,logm=2129199484}) 2026-02-12T18:08:24.717 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.717 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=13,kv=12,logm=61} crc {auth=2339382842,config=1618278320,health=2358046931,kv=2857826951,logm=4072660325}) 2026-02-12T18:08:24.717 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=12,config=2,health=11,kv=11,logm=64} crc {auth=1426410682,config=1618278320,health=3800237533,kv=84047893,logm=54207488}) 2026-02-12T18:08:24.718 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.718 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=13,kv=12,logm=61} crc {auth=2339382842,config=1618278320,health=2358046931,kv=2857826951,logm=4072660325}) 2026-02-12T18:08:24.718 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=11,config=1,health=13,kv=12,logm=63} crc {auth=581842398,config=2457401934,health=2358046931,kv=2857826951,logm=3511739914}) 2026-02-12T18:08:24.718 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.718 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=13,kv=12,logm=61} crc {auth=2339382842,config=1618278320,health=2358046931,kv=2857826951,logm=4072660325}) 2026-02-12T18:08:24.718 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=12,config=2,health=13,kv=12,logm=61} crc {auth=1426410682,config=1618278320,health=2358046931,kv=2857826951,logm=201845680}) 2026-02-12T18:08:24.718 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.718 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=12,config=2,health=13,kv=12,logm=61} crc {auth=2339382842,config=1618278320,health=2358046931,kv=2857826951,logm=4072660325}) 2026-02-12T18:08:24.718 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=12,config=2,health=13,kv=11,logm=62} crc {auth=1426410682,config=1618278320,health=2358046931,kv=1775932005,logm=3374456146}) 2026-02-12T18:08:24.718 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.718 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2278172827}) 2026-02-12T18:08:24.718 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2103025983}) 2026-02-12T18:08:24.718 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.718 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2278172827}) 2026-02-12T18:08:24.719 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1046015006}) 2026-02-12T18:08:24.719 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.719 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2278172827}) 2026-02-12T18:08:24.719 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3028566528}) 2026-02-12T18:08:24.719 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.719 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2278172827}) 2026-02-12T18:08:24.719 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1397694112}) 2026-02-12T18:08:24.719 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.719 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2278172827}) 2026-02-12T18:08:24.719 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=239595389}) 2026-02-12T18:08:24.719 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.719 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2278172827}) 2026-02-12T18:08:24.719 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3178714213}) 2026-02-12T18:08:24.719 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.719 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2278172827}) 2026-02-12T18:08:24.720 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1040437141}) 2026-02-12T18:08:24.720 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.720 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2278172827}) 2026-02-12T18:08:24.720 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1068757654}) 2026-02-12T18:08:24.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.711+0000 7f473a6cc640 1 -- 10.20.193.48:0/2452452283 >> v2:10.20.193.111:6812/977811348 conn(0x7f470403f7f0 msgr2=0x7f470405fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.711+0000 7f473a6cc640 1 --2- 10.20.193.48:0/2452452283 >> v2:10.20.193.111:6812/977811348 conn(0x7f470403f7f0 0x7f470405fca0 secure :-1 s=READY pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4720004740 tx=0x7f4720008040 comp rx=0 tx=0).stop 2026-02-12T18:08:24.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.712+0000 7f473a6cc640 10 monclient: shutdown 2026-02-12T18:08:24.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.712+0000 7f473a6cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:24.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.712+0000 7f473a6cc640 1 -- 10.20.193.48:0/2452452283 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f4734089df0 msgr2=0x7f473410e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:24.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.712+0000 7f473a6cc640 1 --2- 10.20.193.48:0/2452452283 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f4734089df0 0x7f473410e5e0 secure :-1 s=READY pgs=217 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f472800d4b0 tx=0x7f472800d980 comp rx=0 tx=0).stop 2026-02-12T18:08:24.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.712+0000 7f473a6cc640 1 -- 10.20.193.48:0/2452452283 shutdown_connections 2026-02-12T18:08:24.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.712+0000 7f473a6cc640 1 --2- 10.20.193.48:0/2452452283 >> v2:10.20.193.111:6812/977811348 conn(0x7f470403f7f0 0x7f470405fca0 unknown :-1 s=CLOSED pgs=179 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.712+0000 7f473a6cc640 1 --2- 10.20.193.48:0/2452452283 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f4734089df0 0x7f473410e5e0 unknown :-1 s=CLOSED pgs=217 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.712+0000 7f473a6cc640 1 --2- 10.20.193.48:0/2452452283 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f473405dff0 0x7f473410e0a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.712+0000 7f473a6cc640 1 --2- 10.20.193.48:0/2452452283 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f473405dc20 0x7f473410db60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:24.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.712+0000 7f473a6cc640 1 -- 10.20.193.48:0/2452452283 >> 10.20.193.48:0/2452452283 conn(0x7f47340546d0 msgr2=0x7f47341439d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:24.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.712+0000 7f473a6cc640 1 -- 10.20.193.48:0/2452452283 shutdown_connections 2026-02-12T18:08:24.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:24.712+0000 7f473a6cc640 1 -- 10.20.193.48:0/2452452283 wait complete. 2026-02-12T18:08:24.723 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.712+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.723 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.712+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3680882222}) 2026-02-12T18:08:24.723 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.712+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4265200372}) 2026-02-12T18:08:24.724 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.712+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.724 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.712+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3680882222}) 2026-02-12T18:08:24.724 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.712+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3785444098}) 2026-02-12T18:08:24.724 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.712+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.724 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.712+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3680882222}) 2026-02-12T18:08:24.724 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.712+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3170533481}) 2026-02-12T18:08:24.724 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.712+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.724 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.712+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3680882222}) 2026-02-12T18:08:24.724 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.712+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3696008480}) 2026-02-12T18:08:24.724 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.712+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.724 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.712+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3680882222}) 2026-02-12T18:08:24.724 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.712+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=976962459}) 2026-02-12T18:08:24.724 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.712+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.724 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.712+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3680882222}) 2026-02-12T18:08:24.724 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.713+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1216176677}) 2026-02-12T18:08:24.725 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.713+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.725 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.713+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3680882222}) 2026-02-12T18:08:24.725 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.713+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1443039762}) 2026-02-12T18:08:24.725 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.713+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.725 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.713+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3680882222}) 2026-02-12T18:08:24.725 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.713+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3040134266}) 2026-02-12T18:08:24.726 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-12T18:08:24.997 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.997 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1801685097}) 2026-02-12T18:08:24.997 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3824803577}) 2026-02-12T18:08:24.997 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.997 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1801685097}) 2026-02-12T18:08:24.997 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1028574453}) 2026-02-12T18:08:24.997 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.997 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1801685097}) 2026-02-12T18:08:24.998 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2516122332}) 2026-02-12T18:08:24.998 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.998 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1801685097}) 2026-02-12T18:08:24.998 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2758355987}) 2026-02-12T18:08:24.998 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.998 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1801685097}) 2026-02-12T18:08:24.998 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3176859966}) 2026-02-12T18:08:24.998 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.998 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1801685097}) 2026-02-12T18:08:24.998 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1914517496}) 2026-02-12T18:08:24.998 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.998 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1801685097}) 2026-02-12T18:08:24.999 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3647921099}) 2026-02-12T18:08:24.999 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.999 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1801685097}) 2026-02-12T18:08:24.999 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3324207274}) 2026-02-12T18:08:24.999 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.999 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2040192808}) 2026-02-12T18:08:24.999 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=383627684}) 2026-02-12T18:08:24.999 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.999 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2040192808}) 2026-02-12T18:08:24.999 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=189772053}) 2026-02-12T18:08:24.999 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:24.999 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2040192808}) 2026-02-12T18:08:24.999 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3499750162}) 2026-02-12T18:08:25.000 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.000 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2040192808}) 2026-02-12T18:08:25.000 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3442621118}) 2026-02-12T18:08:25.000 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.000 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2040192808}) 2026-02-12T18:08:25.000 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3201310994}) 2026-02-12T18:08:25.000 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.000 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2040192808}) 2026-02-12T18:08:25.000 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=274467930}) 2026-02-12T18:08:25.000 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.000 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2040192808}) 2026-02-12T18:08:25.000 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2565662154}) 2026-02-12T18:08:25.000 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.001 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2040192808}) 2026-02-12T18:08:25.001 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:24.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3824264201}) 2026-02-12T18:08:25.065 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.062+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.066 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.062+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=465468487}) 2026-02-12T18:08:25.066 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.062+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=88233129}) 2026-02-12T18:08:25.066 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.062+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.066 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.062+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=465468487}) 2026-02-12T18:08:25.066 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.062+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1241760876}) 2026-02-12T18:08:25.066 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.062+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.066 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.062+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=465468487}) 2026-02-12T18:08:25.066 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.062+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3259004056}) 2026-02-12T18:08:25.066 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.062+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.066 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.062+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=465468487}) 2026-02-12T18:08:25.067 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.062+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3728113613}) 2026-02-12T18:08:25.067 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.062+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.067 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.062+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=465468487}) 2026-02-12T18:08:25.067 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.062+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=927140167}) 2026-02-12T18:08:25.067 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.062+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.067 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.062+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=465468487}) 2026-02-12T18:08:25.067 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.062+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1187854219}) 2026-02-12T18:08:25.067 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.062+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.067 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.062+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=465468487}) 2026-02-12T18:08:25.067 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.062+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4101722358}) 2026-02-12T18:08:25.067 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.062+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.067 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.062+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=465468487}) 2026-02-12T18:08:25.068 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.062+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1764550499}) 2026-02-12T18:08:25.070 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.070 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=199009491}) 2026-02-12T18:08:25.070 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=354968311}) 2026-02-12T18:08:25.070 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.070 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=199009491}) 2026-02-12T18:08:25.070 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3468190459}) 2026-02-12T18:08:25.071 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.071 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=199009491}) 2026-02-12T18:08:25.071 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3850714362}) 2026-02-12T18:08:25.071 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.071 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=199009491}) 2026-02-12T18:08:25.071 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1669990939}) 2026-02-12T18:08:25.071 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.071 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=199009491}) 2026-02-12T18:08:25.071 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2921048753}) 2026-02-12T18:08:25.071 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.071 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=199009491}) 2026-02-12T18:08:25.071 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1117981996}) 2026-02-12T18:08:25.071 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.072 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=199009491}) 2026-02-12T18:08:25.072 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1157785263}) 2026-02-12T18:08:25.072 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.072 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=199009491}) 2026-02-12T18:08:25.072 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=146879698}) 2026-02-12T18:08:25.205 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.203+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.206 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.203+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5} crc {logm=327386132,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=796059058,mon_config_key=2610204668,monmap=1539371380,nvmeofgw=3360707892,osd_metadata=1679651515}) 2026-02-12T18:08:25.206 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.204+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=59,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=4} crc {logm=2022178744,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=3836115272,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=512469555}) 2026-02-12T18:08:25.206 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.204+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.206 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.204+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5} crc {logm=327386132,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=796059058,mon_config_key=2610204668,monmap=1539371380,nvmeofgw=3360707892,osd_metadata=1679651515}) 2026-02-12T18:08:25.206 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.204+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=61,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=2} crc {logm=2369975755,mdsmap=3465989318,mgr=2585383004,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=4019362957,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1532551272}) 2026-02-12T18:08:25.206 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.204+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.206 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.204+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5} crc {logm=327386132,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=796059058,mon_config_key=2610204668,monmap=1539371380,nvmeofgw=3360707892,osd_metadata=1679651515}) 2026-02-12T18:08:25.206 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.204+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=58,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=4,osd_pg_creating=1,osd_snap=1} crc {logm=351106619,mdsmap=3465989318,mgr=2585383004,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=4019362957,mon_config_key=1874198738,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=315531590,osd_pg_creating=3212700222,osd_snap=3823785925}) 2026-02-12T18:08:25.206 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.204+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.206 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.204+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5} crc {logm=327386132,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=796059058,mon_config_key=2610204668,monmap=1539371380,nvmeofgw=3360707892,osd_metadata=1679651515}) 2026-02-12T18:08:25.206 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.204+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=5} crc {logm=447636858,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=4019362957,mon_config_key=752066894,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1290305223}) 2026-02-12T18:08:25.206 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.204+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.206 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.204+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5} crc {logm=327386132,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=796059058,mon_config_key=2610204668,monmap=1539371380,nvmeofgw=3360707892,osd_metadata=1679651515}) 2026-02-12T18:08:25.206 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.204+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=59,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=4} crc {logm=314300381,mdsmap=3465989318,mgr=3277797281,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=3292871633,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=512469555}) 2026-02-12T18:08:25.206 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.204+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.206 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.204+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5} crc {logm=327386132,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=796059058,mon_config_key=2610204668,monmap=1539371380,nvmeofgw=3360707892,osd_metadata=1679651515}) 2026-02-12T18:08:25.206 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.204+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=61,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=3} crc {logm=412498958,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=2942372568,mon_config_key=1874198738,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1079468160}) 2026-02-12T18:08:25.206 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.204+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.206 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.204+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5} crc {logm=327386132,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=796059058,mon_config_key=2610204668,monmap=1539371380,nvmeofgw=3360707892,osd_metadata=1679651515}) 2026-02-12T18:08:25.206 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.204+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,nvmeofgw=2,osd_metadata=5} crc {logm=83150360,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=4019362957,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=935146538,osd_metadata=1290305223}) 2026-02-12T18:08:25.206 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.204+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.206 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.204+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=58,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5} crc {logm=327386132,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=796059058,mon_config_key=2610204668,monmap=1539371380,nvmeofgw=3360707892,osd_metadata=1679651515}) 2026-02-12T18:08:25.206 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.204+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=58,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5} crc {logm=3873036461,mdsmap=886032834,mgr=41163263,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=4019362957,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1290305223}) 2026-02-12T18:08:25.209 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.207+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.209 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.207+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_pg_creating=1,osd_snap=1,osdmap=98} crc {osd_pg_creating=3212700222,osd_snap=3823785925,osdmap=696199338}) 2026-02-12T18:08:25.209 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.207+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_pg_creating=1,osd_snap=2,osdmap=97} crc {osd_pg_creating=3212700222,osd_snap=841190635,osdmap=1563281178}) 2026-02-12T18:08:25.209 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.207+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.209 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.207+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_pg_creating=1,osd_snap=1,osdmap=98} crc {osd_pg_creating=3212700222,osd_snap=3823785925,osdmap=696199338}) 2026-02-12T18:08:25.209 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.207+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_pg_creating=1,osd_snap=2,osdmap=97} crc {osd_pg_creating=3212700222,osd_snap=841190635,osdmap=465147371}) 2026-02-12T18:08:25.209 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.207+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.209 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.207+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_pg_creating=1,osd_snap=1,osdmap=98} crc {osd_pg_creating=3212700222,osd_snap=3823785925,osdmap=696199338}) 2026-02-12T18:08:25.209 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.207+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osd_pg_creating=1,osd_snap=2,osdmap=97} crc {osd_pg_creating=3212700222,osd_snap=841190635,osdmap=1944713513}) 2026-02-12T18:08:25.209 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.207+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.209 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.207+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_pg_creating=1,osd_snap=1,osdmap=98} crc {osd_pg_creating=3212700222,osd_snap=3823785925,osdmap=696199338}) 2026-02-12T18:08:25.209 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.207+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osd_pg_creating=1,osd_snap=2,osdmap=97} crc {osd_pg_creating=3212700222,osd_snap=841190635,osdmap=1732815646}) 2026-02-12T18:08:25.209 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.207+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.209 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.207+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_pg_creating=1,osd_snap=1,osdmap=98} crc {osd_pg_creating=3212700222,osd_snap=3823785925,osdmap=696199338}) 2026-02-12T18:08:25.209 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.207+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osd_pg_creating=1,osd_snap=2,osdmap=97} crc {osd_pg_creating=3212700222,osd_snap=841190636,osdmap=109698740}) 2026-02-12T18:08:25.209 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.207+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.209 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.207+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_pg_creating=1,osd_snap=1,osdmap=98} crc {osd_pg_creating=3212700222,osd_snap=3823785925,osdmap=696199338}) 2026-02-12T18:08:25.209 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.207+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osd_pg_creating=1,osd_snap=2,osdmap=97} crc {osd_pg_creating=3212700222,osd_snap=841190635,osdmap=2794156146}) 2026-02-12T18:08:25.209 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.207+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.209 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.207+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_pg_creating=1,osd_snap=1,osdmap=98} crc {osd_pg_creating=3212700222,osd_snap=3823785925,osdmap=696199338}) 2026-02-12T18:08:25.209 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.207+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osd_pg_creating=1,osd_snap=1,osdmap=98} crc {osd_pg_creating=3212700223,osd_snap=3823785925,osdmap=1558660270}) 2026-02-12T18:08:25.209 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.207+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.209 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.207+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_pg_creating=1,osd_snap=1,osdmap=98} crc {osd_pg_creating=3212700222,osd_snap=3823785925,osdmap=696199338}) 2026-02-12T18:08:25.209 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.207+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osd_pg_creating=1,osd_snap=2,osdmap=97} crc {osd_pg_creating=3212700222,osd_snap=841190635,osdmap=4210306884}) 2026-02-12T18:08:25.217 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.216+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.217 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.216+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=80} crc {osdmap=3642946136}) 2026-02-12T18:08:25.217 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.216+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=87} crc {osdmap=3269848468}) 2026-02-12T18:08:25.217 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.216+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.217 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.216+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=80} crc {osdmap=3642946136}) 2026-02-12T18:08:25.217 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.216+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=87} crc {osdmap=3081702399}) 2026-02-12T18:08:25.217 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.216+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.218 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.216+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=80} crc {osdmap=3642946136}) 2026-02-12T18:08:25.218 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.216+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=83} crc {osdmap=2251262125}) 2026-02-12T18:08:25.218 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.216+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.218 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.216+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=80} crc {osdmap=3642946136}) 2026-02-12T18:08:25.218 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.216+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=81} crc {osdmap=576485798}) 2026-02-12T18:08:25.218 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.216+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.218 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.216+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=80} crc {osdmap=3642946136}) 2026-02-12T18:08:25.218 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.216+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=83} crc {osdmap=2215890447}) 2026-02-12T18:08:25.218 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.216+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.218 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.216+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=80} crc {osdmap=3642946136}) 2026-02-12T18:08:25.218 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.216+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=85} crc {osdmap=3902885206}) 2026-02-12T18:08:25.218 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.216+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.218 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.216+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=80} crc {osdmap=3642946136}) 2026-02-12T18:08:25.218 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.216+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=84} crc {osdmap=210085715}) 2026-02-12T18:08:25.218 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.216+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:08:25.218 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.216+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=80} crc {osdmap=3642946136}) 2026-02-12T18:08:25.218 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:08:25.216+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=85} crc {osdmap=3016386961}) 2026-02-12T18:08:25.727 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2026-02-12T18:08:25.727 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T18:08:25.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.793+0000 7fc436a8c640 10 monclient: get_monmap_and_config 2026-02-12T18:08:25.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.793+0000 7fc436a8c640 10 monclient: build_initial_monmap 2026-02-12T18:08:25.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.793+0000 7fc436a8c640 10 monclient: monmap: 2026-02-12T18:08:25.795 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:25.795 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:25.795 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:25.794462+0000 2026-02-12T18:08:25.795 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:25.794462+0000 2026-02-12T18:08:25.795 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:25.795 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:25.795 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:25.795 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:25.795 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:25.795 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:25.795 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:25.795 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:25.795 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:25.795 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:25.795 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:25.795 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:25.796 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:25.796 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:25.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.793+0000 7fc436a8c640 1 Processor -- start 2026-02-12T18:08:25.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.793+0000 7fc436a8c640 1 -- start start 2026-02-12T18:08:25.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.793+0000 7fc436a8c640 10 monclient: init 2026-02-12T18:08:25.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc436a8c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:25.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc436a8c640 10 monclient: _add_conns ranks=[4,2,10,3,0,9,8,1,6,7,5] 2026-02-12T18:08:25.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc436a8c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc43005dc20 0x7fc430144660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:25.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc436a8c640 10 monclient(hunting): picked mon.noname-c con 0x7fc43005dc20 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:08:25.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc436a8c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc43005dff0 0x7fc43005e3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:25.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc436a8c640 10 monclient(hunting): picked mon.noname-b con 0x7fc43005dff0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:08:25.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc436a8c640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7fc430089df0 0x7fc43008a240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:25.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc436a8c640 10 monclient(hunting): picked mon.noname-f con 0x7fc430089df0 addr v2:10.20.193.111:3300/0 2026-02-12T18:08:25.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc436a8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:25.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc436a8c640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7fc43008b0d0 con 0x7fc430089df0 2026-02-12T18:08:25.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc436a8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:25.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc436a8c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fc430093a30 con 0x7fc43005dff0 2026-02-12T18:08:25.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc436a8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:25.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc436a8c640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fc430092200 con 0x7fc43005dc20 2026-02-12T18:08:25.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc436a8c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:25.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc436a8c640 10 monclient(hunting): authenticate will time out at 744.520154s 2026-02-12T18:08:25.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc434801640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc43005dc20 0x7fc430144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:25.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc427fff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc43005dff0 0x7fc43005e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:25.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc434801640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc43005dc20 0x7fc430144660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:42162/0 (socket says 10.20.193.48:42162) 2026-02-12T18:08:25.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc434801640 1 -- 10.20.193.48:0/2465262189 learned_addr learned my addr 10.20.193.48:0/2465262189 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:25.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc427fff640 10 monclient(hunting): get_auth_request con 0x7fc43005dff0 auth_method 0 2026-02-12T18:08:25.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc427fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:25.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc427fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:25.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc427fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:25.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc434801640 10 monclient(hunting): get_auth_request con 0x7fc43005dc20 auth_method 0 2026-02-12T18:08:25.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc434801640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:25.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc434801640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:25.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc434801640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:25.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc427fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:25.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc427fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:25.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc427fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:25.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc434801640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:25.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc434801640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:25.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc435002640 1 --2- 10.20.193.48:0/2465262189 >> v2:10.20.193.111:3300/0 conn(0x7fc430089df0 0x7fc43008a240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:25.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc434801640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:25.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc435002640 10 monclient(hunting): get_auth_request con 0x7fc430089df0 auth_method 0 2026-02-12T18:08:25.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc435002640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:25.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc435002640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:25.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc435002640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:25.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc427fff640 10 monclient(hunting): handle_auth_done global_id 35030 payload 274 2026-02-12T18:08:25.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc427fff640 1 -- 10.20.193.48:0/2465262189 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc43005dc20 msgr2=0x7fc430144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:25.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc427fff640 1 --2- 10.20.193.48:0/2465262189 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc43005dc20 0x7fc430144660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:25.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc427fff640 1 -- 10.20.193.48:0/2465262189 >> v2:10.20.193.111:3300/0 conn(0x7fc430089df0 msgr2=0x7fc43008a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:25.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc427fff640 1 --2- 10.20.193.48:0/2465262189 >> v2:10.20.193.111:3300/0 conn(0x7fc430089df0 0x7fc43008a240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:25.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc427fff640 10 monclient: _finish_hunting 0 2026-02-12T18:08:25.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc427fff640 1 monclient: found mon.noname-b 2026-02-12T18:08:25.800 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc427fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:25.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc427fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:08:25.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.794+0000 7fc427fff640 1 -- 10.20.193.48:0/2465262189 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc430060390 con 0x7fc43005dff0 2026-02-12T18:08:25.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.796+0000 7fc427fff640 1 -- 10.20.193.48:0/2465262189 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc43005dff0 msgr2=0x7fc43005e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:25.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.796+0000 7fc427fff640 1 --2- 10.20.193.48:0/2465262189 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc43005dff0 0x7fc43005e3c0 secure :-1 s=READY pgs=105 gs=2 cs=0 l=1 c_cookie=10176017681952107567 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc418004740 tx=0x7fc41802eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d387a2ab8d96c2f server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:25.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc4277fe640 1 -- 10.20.193.48:0/2465262189 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc418035340 con 0x7fc43005dff0 2026-02-12T18:08:25.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc4277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:25.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc4277fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:08:25.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc4277fe640 10 monclient: dump: 2026-02-12T18:08:25.804 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:25.804 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:25.804 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:25.804 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:25.804 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:25.804 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:25.804 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:25.804 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:25.804 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:25.804 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:25.804 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:25.804 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:25.804 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:25.804 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:25.804 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:25.804 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:25.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc4277fe640 10 monclient: _finish_auth 0 2026-02-12T18:08:25.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc4277fe640 10 monclient: _check_auth_tickets 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc4277fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc4277fe640 1 -- 10.20.193.48:0/2465262189 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4180354c0 con 0x7fc43005dff0 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc4277fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc436a8c640 5 monclient: authenticate success, global_id 35030 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc4277fe640 1 -- 10.20.193.48:0/2465262189 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc418035af0 con 0x7fc43005dff0 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc436a8c640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc436a8c640 4 set_mon_vals no callback set 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc4277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc4277fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc4277fe640 10 monclient: dump: 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc436a8c640 10 monclient: shutdown 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc436a8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc436a8c640 1 -- 10.20.193.48:0/2465262189 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc43005dff0 msgr2=0x7fc43005e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc436a8c640 1 --2- 10.20.193.48:0/2465262189 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc43005dff0 0x7fc43005e3c0 secure :-1 s=READY pgs=105 gs=2 cs=0 l=1 c_cookie=10176017681952107567 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc418004740 tx=0x7fc41802eda0 comp rx=0 tx=0).stop 2026-02-12T18:08:25.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc436a8c640 1 -- 10.20.193.48:0/2465262189 shutdown_connections 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc436a8c640 1 --2- 10.20.193.48:0/2465262189 >> v2:10.20.193.111:3300/0 conn(0x7fc430089df0 0x7fc43008a240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc436a8c640 1 --2- 10.20.193.48:0/2465262189 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc43005dff0 0x7fc43005e3c0 unknown :-1 s=CLOSED pgs=105 gs=2 cs=0 l=1 c_cookie=10176017681952107567 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc436a8c640 1 --2- 10.20.193.48:0/2465262189 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc43005dc20 0x7fc430144660 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc436a8c640 1 -- 10.20.193.48:0/2465262189 >> 10.20.193.48:0/2465262189 conn(0x7fc4300546d0 msgr2=0x7fc430054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc436a8c640 1 -- 10.20.193.48:0/2465262189 shutdown_connections 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.797+0000 7fc436a8c640 1 -- 10.20.193.48:0/2465262189 wait complete. 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc436a8c640 10 monclient: build_initial_monmap 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc436a8c640 10 monclient: monmap: 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc436a8c640 1 Processor -- start 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc436a8c640 1 -- start start 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc436a8c640 10 monclient: init 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc436a8c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc436a8c640 10 monclient: _add_conns ranks=[8,4,3,7,6,5,1,0,2] 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc436a8c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fc43005dc20 0x7fc430112bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc436a8c640 10 monclient(hunting): picked mon.noname-e con 0x7fc43005dc20 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc436a8c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc43005dff0 0x7fc4301130f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:25.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc436a8c640 10 monclient(hunting): picked mon.noname-c con 0x7fc43005dff0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:08:25.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc436a8c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc430089df0 0x7fc430113630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:25.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc436a8c640 10 monclient(hunting): picked mon.noname-g con 0x7fc430089df0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:08:25.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc436a8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:25.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc436a8c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fc430110690 con 0x7fc430089df0 2026-02-12T18:08:25.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc436a8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:25.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc436a8c640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fc43010fb00 con 0x7fc43005dff0 2026-02-12T18:08:25.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc436a8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:25.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc436a8c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fc43010ee90 con 0x7fc43005dc20 2026-02-12T18:08:25.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc436a8c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:25.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc436a8c640 10 monclient(hunting): authenticate will time out at 744.524553s 2026-02-12T18:08:25.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc427fff640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc43005dff0 0x7fc4301130f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:25.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc434801640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fc43005dc20 0x7fc430112bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:25.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc427fff640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc43005dff0 0x7fc4301130f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:42174/0 (socket says 10.20.193.48:42174) 2026-02-12T18:08:25.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc427fff640 1 -- 10.20.193.48:0/2273164443 learned_addr learned my addr 10.20.193.48:0/2273164443 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:25.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc427fff640 10 monclient(hunting): get_auth_request con 0x7fc43005dff0 auth_method 0 2026-02-12T18:08:25.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc427fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:25.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc427fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:25.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc427fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:25.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc434801640 10 monclient(hunting): get_auth_request con 0x7fc43005dc20 auth_method 0 2026-02-12T18:08:25.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc434801640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:25.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc434801640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:25.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc434801640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:25.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc427fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:25.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc427fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc427fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc434801640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc434801640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc434801640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc435002640 1 --2- 10.20.193.48:0/2273164443 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc430089df0 0x7fc430113630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc435002640 10 monclient(hunting): get_auth_request con 0x7fc430089df0 auth_method 0 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc435002640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc435002640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc435002640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc427fff640 10 monclient(hunting): handle_auth_done global_id 44176 payload 824 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc427fff640 1 -- 10.20.193.48:0/2273164443 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fc43005dc20 msgr2=0x7fc430112bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc427fff640 1 --2- 10.20.193.48:0/2273164443 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fc43005dc20 0x7fc430112bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc427fff640 1 -- 10.20.193.48:0/2273164443 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc430089df0 msgr2=0x7fc430113630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc427fff640 1 --2- 10.20.193.48:0/2273164443 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc430089df0 0x7fc430113630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc427fff640 10 monclient: _finish_hunting 0 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc427fff640 1 monclient: found mon.noname-c 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc427fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc427fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.798+0000 7fc427fff640 1 -- 10.20.193.48:0/2273164443 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc418009420 con 0x7fc43005dff0 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc427fff640 1 -- 10.20.193.48:0/2273164443 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc43005dff0 msgr2=0x7fc4301130f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc427fff640 1 --2- 10.20.193.48:0/2273164443 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc43005dff0 0x7fc4301130f0 secure :-1 s=READY pgs=22 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc41802f2b0 tx=0x7fc4180047e0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc4257fa640 1 -- 10.20.193.48:0/2273164443 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc418035340 con 0x7fc43005dff0 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc4257fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc4257fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc4257fa640 10 monclient: dump: 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:25.808 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc4257fa640 10 monclient: _finish_auth 0 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc4257fa640 10 monclient: _check_auth_tickets 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc4257fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc4257fa640 1 -- 10.20.193.48:0/2273164443 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc418035e00 con 0x7fc43005dff0 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc4257fa640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc4257fa640 1 -- 10.20.193.48:0/2273164443 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc4180044f0 con 0x7fc43005dff0 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc4257fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc4257fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc426ffd640 4 set_mon_vals no callback set 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc4257fa640 10 monclient: dump: 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:25.809 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:25.810 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:25.810 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:25.810 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:25.810 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc436a8c640 5 monclient: authenticate success, global_id 44176 2026-02-12T18:08:25.810 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc436a8c640 10 monclient: _renew_subs 2026-02-12T18:08:25.810 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc436a8c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:08:25.810 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc436a8c640 1 -- 10.20.193.48:0/2273164443 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc430091170 con 0x7fc43005dff0 2026-02-12T18:08:25.810 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc436a8c640 10 monclient: _renew_subs 2026-02-12T18:08:25.810 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc436a8c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:08:25.810 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc436a8c640 1 -- 10.20.193.48:0/2273164443 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4301100d0 con 0x7fc43005dff0 2026-02-12T18:08:25.810 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc427fff640 1 --2- 10.20.193.48:0/2273164443 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc43005dff0 0x7fc4301130f0 secure :-1 s=READY pgs=22 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc41802f2b0 tx=0x7fc4180047e0 comp rx=0 tx=0).queue_received will delay after 1.77092e+09 on 0x7fc418077880 osd_map(116..116 src has 1..116) 2026-02-12T18:08:25.810 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc436a8c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:25.810 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc436a8c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:25.810 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc4257fa640 1 -- 10.20.193.48:0/2273164443 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fc418004030 con 0x7fc43005dff0 2026-02-12T18:08:25.810 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc436a8c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:08:25.810 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.801+0000 7fc436a8c640 1 -- 10.20.193.48:0/2273164443 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc430092510 con 0x7fc43005dff0 2026-02-12T18:08:25.810 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.802+0000 7fc4257fa640 1 --2- 10.20.193.48:0/2273164443 >> v2:10.20.193.111:6812/977811348 conn(0x7fc40003f800 0x7fc40005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:25.810 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.802+0000 7fc434801640 1 --2- 10.20.193.48:0/2273164443 >> v2:10.20.193.111:6812/977811348 conn(0x7fc40003f800 0x7fc40005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:25.810 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.802+0000 7fc434801640 10 monclient: get_auth_request con 0x7fc40003f800 auth_method 0 2026-02-12T18:08:25.810 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.804+0000 7fc434801640 1 --2- 10.20.193.48:0/2273164443 >> v2:10.20.193.111:6812/977811348 conn(0x7fc40003f800 0x7fc40005fcb0 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc420006d40 tx=0x7fc4200092c0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:25.810 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:25.804+0000 7fc4257fa640 1 -- 10.20.193.48:0/2273164443 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(116..116 src has 1..116) ==== 3897+0+0 (secure 0 0 0) 0x7fc418077880 con 0x7fc43005dff0 2026-02-12T18:08:26.286 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:08:26.287 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28441]: starting. 2026-02-12T18:08:26.287 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28441]: creating pool ceph_test_rados_delete_pools_parallel.trial111-28340 2026-02-12T18:08:26.287 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28441]: created object 0... 2026-02-12T18:08:26.287 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28441]: created object 25... 2026-02-12T18:08:26.287 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28441]: created object 49... 2026-02-12T18:08:26.288 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28441]: finishing. 2026-02-12T18:08:26.288 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28441]: shutting down. 2026-02-12T18:08:26.324 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:08:26.324 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28443]: starting. 2026-02-12T18:08:26.325 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28443]: listing objects. 2026-02-12T18:08:26.325 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28443]: listed object 0... 2026-02-12T18:08:26.325 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28443]: listed object 25... 2026-02-12T18:08:26.325 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28443]: saw 50 objects 2026-02-12T18:08:26.325 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28443]: shutting down. 2026-02-12T18:08:26.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.629+0000 7fc4257fa640 1 -- 10.20.193.48:0/2273164443 <== mon.4 v2:10.20.193.48:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fc4180036d0 con 0x7fc43005dff0 2026-02-12T18:08:26.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.629+0000 7fc4257fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:26.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.629+0000 7fc4257fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:26.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.774+0000 7fc436a8c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T18:08:26.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.774+0000 7fc436a8c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T18:08:26.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.774+0000 7fc436a8c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:08:26.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.774+0000 7fc436a8c640 1 -- 10.20.193.48:0/2273164443 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc430144660 con 0x7fc43005dff0 2026-02-12T18:08:26.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.775+0000 7fc4257fa640 1 -- 10.20.193.48:0/2273164443 <== mon.4 v2:10.20.193.48:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3660 (secure 0 0 0) 0x7fc418046e60 con 0x7fc43005dff0 2026-02-12T18:08:26.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.775+0000 7fc4257fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T18:08:26.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.775+0000 7fc4257fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:26.778 INFO:teuthology.orchestra.run.trial048.stdout:{"election_epoch":28,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","modified":"2026-02-12T18:05:32.850777Z","created":"2026-02-12T18:05:32.850777Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3300","nonce":0},{"type":"v1","addr":"10.20.193.48:6789","nonce":0}]},"addr":"10.20.193.48:6789/0","public_addr":"10.20.193.48:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850827+0000","crush_location":[]},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3300","nonce":0},{"type":"v1","addr":"10.20.193.111:6789","nonce":0}]},"addr":"10.20.193.111:6789/0","public_addr":"10.20.193.111:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850829+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3301","nonce":0},{"type":"v1","addr":"10.20.193.48:6790","nonce":0}]},"addr":"10.20.193.48:6790/0","public_addr":"10.20.193.48:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850830+0000","crush_location":[]},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3301","nonce":0},{"type":"v1","addr":"10.20.193.111:6790","nonce":0}]},"addr":"10.20.193.111:6790/0","public_addr":"10.20.193.111:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850833+0000","crush_location":[]},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3302","nonce":0},{"type":"v1","addr":"10.20.193.48:6791","nonce":0}]},"addr":"10.20.193.48:6791/0","public_addr":"10.20.193.48:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3302","nonce":0},{"type":"v1","addr":"10.20.193.111:6791","nonce":0}]},"addr":"10.20.193.111:6791/0","public_addr":"10.20.193.111:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850834+0000","crush_location":[]},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3303","nonce":0},{"type":"v1","addr":"10.20.193.48:6792","nonce":0}]},"addr":"10.20.193.48:6792/0","public_addr":"10.20.193.48:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3303","nonce":0},{"type":"v1","addr":"10.20.193.111:6792","nonce":0}]},"addr":"10.20.193.111:6792/0","public_addr":"10.20.193.111:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850835+0000","crush_location":[]},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3304","nonce":0},{"type":"v1","addr":"10.20.193.48:6793","nonce":0}]},"addr":"10.20.193.48:6793/0","public_addr":"10.20.193.48:6793/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850832+0000","crush_location":[]}]}} 2026-02-12T18:08:26.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.776+0000 7fc436a8c640 1 -- 10.20.193.48:0/2273164443 >> v2:10.20.193.111:6812/977811348 conn(0x7fc40003f800 msgr2=0x7fc40005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:26.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.776+0000 7fc436a8c640 1 --2- 10.20.193.48:0/2273164443 >> v2:10.20.193.111:6812/977811348 conn(0x7fc40003f800 0x7fc40005fcb0 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc420006d40 tx=0x7fc4200092c0 comp rx=0 tx=0).stop 2026-02-12T18:08:26.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.776+0000 7fc436a8c640 10 monclient: shutdown 2026-02-12T18:08:26.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.776+0000 7fc436a8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:26.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.776+0000 7fc436a8c640 1 -- 10.20.193.48:0/2273164443 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc43005dff0 msgr2=0x7fc4301130f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:26.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.776+0000 7fc436a8c640 1 --2- 10.20.193.48:0/2273164443 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc43005dff0 0x7fc4301130f0 secure :-1 s=READY pgs=22 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc41802f2b0 tx=0x7fc4180047e0 comp rx=0 tx=0).stop 2026-02-12T18:08:26.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.776+0000 7fc436a8c640 1 -- 10.20.193.48:0/2273164443 shutdown_connections 2026-02-12T18:08:26.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.776+0000 7fc436a8c640 1 --2- 10.20.193.48:0/2273164443 >> v2:10.20.193.111:6812/977811348 conn(0x7fc40003f800 0x7fc40005fcb0 unknown :-1 s=CLOSED pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:26.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.776+0000 7fc436a8c640 1 --2- 10.20.193.48:0/2273164443 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc430089df0 0x7fc430113630 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:26.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.776+0000 7fc436a8c640 1 --2- 10.20.193.48:0/2273164443 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc43005dff0 0x7fc4301130f0 unknown :-1 s=CLOSED pgs=22 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:26.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.776+0000 7fc436a8c640 1 --2- 10.20.193.48:0/2273164443 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fc43005dc20 0x7fc430112bb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:26.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.776+0000 7fc436a8c640 1 -- 10.20.193.48:0/2273164443 >> 10.20.193.48:0/2273164443 conn(0x7fc4300546d0 msgr2=0x7fc430125840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:26.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.776+0000 7fc436a8c640 1 -- 10.20.193.48:0/2273164443 shutdown_connections 2026-02-12T18:08:26.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.776+0000 7fc436a8c640 1 -- 10.20.193.48:0/2273164443 wait complete. 2026-02-12T18:08:26.786 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2026-02-12T18:08:26.786 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-12T18:08:26.786 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2026-02-12T18:08:26.786 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T18:08:26.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.852+0000 7f8a9494c640 10 monclient: get_monmap_and_config 2026-02-12T18:08:26.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.852+0000 7f8a9494c640 10 monclient: build_initial_monmap 2026-02-12T18:08:26.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a9494c640 10 monclient: monmap: 2026-02-12T18:08:26.854 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:26.855 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:26.855 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:26.854067+0000 2026-02-12T18:08:26.855 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:26.854067+0000 2026-02-12T18:08:26.855 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:26.855 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:26.855 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:26.855 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:26.855 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:26.855 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:26.855 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:26.855 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:26.855 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:26.856 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:26.856 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:26.856 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:26.856 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:26.856 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:26.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a9494c640 1 Processor -- start 2026-02-12T18:08:26.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a9494c640 1 -- start start 2026-02-12T18:08:26.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a9494c640 10 monclient: init 2026-02-12T18:08:26.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a9494c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:26.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a9494c640 10 monclient: _add_conns ranks=[7,3,8,9,10,4,1,2,0,5,6] 2026-02-12T18:08:26.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a9494c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f8a8c05c950 0x7f8a8c05cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:26.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a9494c640 10 monclient(hunting): picked mon.noname-i con 0x7f8a8c05c950 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:26.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a9494c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f8a8c05e490 0x7f8a8c05d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:26.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a9494c640 10 monclient(hunting): picked mon.noname-g con 0x7f8a8c05e490 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:08:26.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a9494c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8a8c13db70 0x7f8a8c13dfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:26.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a9494c640 10 monclient(hunting): picked mon.noname-e con 0x7f8a8c13db70 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:08:26.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a9494c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:26.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a9494c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f8a8c05ddd0 con 0x7f8a8c05e490 2026-02-12T18:08:26.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a9494c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:26.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a9494c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f8a8c05d7a0 con 0x7f8a8c05c950 2026-02-12T18:08:26.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a9494c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:26.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a9494c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f8a8c092990 con 0x7f8a8c13db70 2026-02-12T18:08:26.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a9494c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:26.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a9494c640 10 monclient(hunting): authenticate will time out at 745.579784s 2026-02-12T18:08:26.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a92ec2640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8a8c13db70 0x7f8a8c13dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:26.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a92ec2640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8a8c13db70 0x7f8a8c13dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:51056/0 (socket says 10.20.193.48:51056) 2026-02-12T18:08:26.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a92ec2640 1 -- 10.20.193.48:0/4020328621 learned_addr learned my addr 10.20.193.48:0/4020328621 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:26.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a92ec2640 10 monclient(hunting): get_auth_request con 0x7f8a8c13db70 auth_method 0 2026-02-12T18:08:26.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a92ec2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:26.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a92ec2640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:26.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a92ec2640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:26.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.853+0000 7f8a926c1640 1 --2- 10.20.193.48:0/4020328621 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f8a8c05c950 0x7f8a8c05cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:26.869 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.854+0000 7f8a926c1640 10 monclient(hunting): get_auth_request con 0x7f8a8c05c950 auth_method 0 2026-02-12T18:08:26.869 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.854+0000 7f8a926c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:26.869 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.854+0000 7f8a926c1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:26.869 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.854+0000 7f8a926c1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:26.869 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.854+0000 7f8a92ec2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:26.869 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.854+0000 7f8a92ec2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:26.869 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.854+0000 7f8a91ec0640 1 --2- 10.20.193.48:0/4020328621 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f8a8c05e490 0x7f8a8c05d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:26.869 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.854+0000 7f8a92ec2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:26.869 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.854+0000 7f8a91ec0640 10 monclient(hunting): get_auth_request con 0x7f8a8c05e490 auth_method 0 2026-02-12T18:08:26.869 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.854+0000 7f8a91ec0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:26.869 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.854+0000 7f8a91ec0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:26.869 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.854+0000 7f8a91ec0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:26.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.854+0000 7f8a926c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:26.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.854+0000 7f8a926c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:26.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.854+0000 7f8a926c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:26.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.854+0000 7f8a92ec2640 10 monclient(hunting): handle_auth_done global_id 5048 payload 274 2026-02-12T18:08:26.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.854+0000 7f8a92ec2640 1 -- 10.20.193.48:0/4020328621 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f8a8c05c950 msgr2=0x7f8a8c05cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:26.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.854+0000 7f8a92ec2640 1 --2- 10.20.193.48:0/4020328621 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f8a8c05c950 0x7f8a8c05cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:26.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.854+0000 7f8a92ec2640 1 -- 10.20.193.48:0/4020328621 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f8a8c05e490 msgr2=0x7f8a8c05d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:26.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.854+0000 7f8a92ec2640 1 --2- 10.20.193.48:0/4020328621 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f8a8c05e490 0x7f8a8c05d260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:26.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.854+0000 7f8a92ec2640 10 monclient: _finish_hunting 0 2026-02-12T18:08:26.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.854+0000 7f8a92ec2640 1 monclient: found mon.noname-e 2026-02-12T18:08:26.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.854+0000 7f8a92ec2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:26.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.854+0000 7f8a92ec2640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:08:26.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.854+0000 7f8a92ec2640 1 -- 10.20.193.48:0/4020328621 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a8c04dc20 con 0x7f8a8c13db70 2026-02-12T18:08:26.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.856+0000 7f8a92ec2640 1 -- 10.20.193.48:0/4020328621 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8a8c13db70 msgr2=0x7f8a8c13dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:26.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.856+0000 7f8a92ec2640 1 --2- 10.20.193.48:0/4020328621 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8a8c13db70 0x7f8a8c13dfc0 secure :-1 s=READY pgs=115 gs=1 cs=0 l=1 c_cookie=11594687254972302883 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a8000a9b0 tx=0x7f8a8002fef0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=a0e89aa08a5f8623 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:26.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.856+0000 7f8a916bf640 1 -- 10.20.193.48:0/4020328621 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8a80030b70 con 0x7f8a8c13db70 2026-02-12T18:08:26.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.856+0000 7f8a916bf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:26.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a916bf640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:08:26.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a916bf640 10 monclient: dump: 2026-02-12T18:08:26.871 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:26.871 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:26.871 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:26.871 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:26.871 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:26.872 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:26.872 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:26.872 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:26.872 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:26.872 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:26.872 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:26.872 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:26.872 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:26.872 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:26.872 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:26.872 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:26.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a916bf640 10 monclient: _finish_auth 0 2026-02-12T18:08:26.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a916bf640 10 monclient: _check_auth_tickets 2026-02-12T18:08:26.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a916bf640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:26.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a916bf640 1 -- 10.20.193.48:0/4020328621 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a80030cf0 con 0x7f8a8c13db70 2026-02-12T18:08:26.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a9494c640 5 monclient: authenticate success, global_id 5048 2026-02-12T18:08:26.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a9494c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:08:26.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a916bf640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:26.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a916bf640 1 -- 10.20.193.48:0/4020328621 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8a80030e60 con 0x7f8a8c13db70 2026-02-12T18:08:26.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a9494c640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:26.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a9494c640 4 set_mon_vals no callback set 2026-02-12T18:08:26.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a916bf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:26.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a916bf640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:08:26.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a916bf640 10 monclient: dump: 2026-02-12T18:08:26.873 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:26.874 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:26.874 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:26.874 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:26.874 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:26.874 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:26.874 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:26.874 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:26.874 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:26.874 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:26.874 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:26.874 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:26.874 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:26.874 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:26.875 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:26.875 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:26.875 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a9494c640 10 monclient: shutdown 2026-02-12T18:08:26.875 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a9494c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:26.875 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a9494c640 1 -- 10.20.193.48:0/4020328621 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8a8c13db70 msgr2=0x7f8a8c13dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:26.875 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a9494c640 1 --2- 10.20.193.48:0/4020328621 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8a8c13db70 0x7f8a8c13dfc0 secure :-1 s=READY pgs=115 gs=1 cs=0 l=1 c_cookie=11594687254972302883 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a8000a9b0 tx=0x7f8a8002fef0 comp rx=0 tx=0).stop 2026-02-12T18:08:26.875 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a9494c640 1 -- 10.20.193.48:0/4020328621 shutdown_connections 2026-02-12T18:08:26.875 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a9494c640 1 --2- 10.20.193.48:0/4020328621 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8a8c13db70 0x7f8a8c13dfc0 unknown :-1 s=CLOSED pgs=115 gs=1 cs=0 l=1 c_cookie=11594687254972302883 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:26.875 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a9494c640 1 --2- 10.20.193.48:0/4020328621 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f8a8c05e490 0x7f8a8c05d260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:26.875 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a9494c640 1 --2- 10.20.193.48:0/4020328621 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f8a8c05c950 0x7f8a8c05cd20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:26.875 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a9494c640 1 -- 10.20.193.48:0/4020328621 >> 10.20.193.48:0/4020328621 conn(0x7f8a8c0548a0 msgr2=0x7f8a8c097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:26.875 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a9494c640 1 -- 10.20.193.48:0/4020328621 shutdown_connections 2026-02-12T18:08:26.876 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a9494c640 1 -- 10.20.193.48:0/4020328621 wait complete. 2026-02-12T18:08:26.876 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a9494c640 10 monclient: build_initial_monmap 2026-02-12T18:08:26.876 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.857+0000 7f8a9494c640 10 monclient: monmap: 2026-02-12T18:08:26.876 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:26.876 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:26.876 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:26.876 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:26.876 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:26.876 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:26.876 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:26.876 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:26.876 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:26.877 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:26.877 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:26.877 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:26.877 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:26.877 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:26.877 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:26.877 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:26.877 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a9494c640 1 Processor -- start 2026-02-12T18:08:26.877 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a9494c640 1 -- start start 2026-02-12T18:08:26.877 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a9494c640 10 monclient: init 2026-02-12T18:08:26.877 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a9494c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:26.877 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a9494c640 10 monclient: _add_conns ranks=[8,7,4,5,2,3,1,6,0] 2026-02-12T18:08:26.877 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a9494c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8a8c05c950 0x7f8a8c12ca60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:26.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a9494c640 10 monclient(hunting): picked mon.noname-e con 0x7f8a8c05c950 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:08:26.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a9494c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f8a8c05e490 0x7f8a8c08d480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:26.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a9494c640 10 monclient(hunting): picked mon.noname-i con 0x7f8a8c05e490 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:26.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a9494c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f8a8c13db70 0x7f8a8c13ce90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:26.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a9494c640 10 monclient(hunting): picked mon.noname-c con 0x7f8a8c13db70 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:08:26.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a9494c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:26.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a9494c640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f8a8c141700 con 0x7f8a8c13db70 2026-02-12T18:08:26.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a9494c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:26.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a9494c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f8a8c08af40 con 0x7f8a8c05e490 2026-02-12T18:08:26.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a9494c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:26.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a9494c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f8a8c13e360 con 0x7f8a8c05c950 2026-02-12T18:08:26.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a9494c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:26.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a9494c640 10 monclient(hunting): authenticate will time out at 745.584495s 2026-02-12T18:08:26.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a926c1640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8a8c05c950 0x7f8a8c12ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:26.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a92ec2640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f8a8c13db70 0x7f8a8c13ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:26.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a926c1640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8a8c05c950 0x7f8a8c12ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:51068/0 (socket says 10.20.193.48:51068) 2026-02-12T18:08:26.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a926c1640 1 -- 10.20.193.48:0/1431381176 learned_addr learned my addr 10.20.193.48:0/1431381176 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:26.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a926c1640 10 monclient(hunting): get_auth_request con 0x7f8a8c05c950 auth_method 0 2026-02-12T18:08:26.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a926c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:26.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a926c1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:26.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a926c1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:26.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a92ec2640 10 monclient(hunting): get_auth_request con 0x7f8a8c13db70 auth_method 0 2026-02-12T18:08:26.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a92ec2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:26.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a92ec2640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:26.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a92ec2640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:26.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a926c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:26.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a926c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:26.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a926c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:26.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a92ec2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:26.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a92ec2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:26.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a92ec2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:26.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a91ec0640 1 --2- 10.20.193.48:0/1431381176 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f8a8c05e490 0x7f8a8c08d480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:26.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a91ec0640 10 monclient(hunting): get_auth_request con 0x7f8a8c05e490 auth_method 0 2026-02-12T18:08:26.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a91ec0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:26.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a91ec0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:26.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a91ec0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:26.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a926c1640 10 monclient(hunting): handle_auth_done global_id 5057 payload 824 2026-02-12T18:08:26.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a926c1640 1 -- 10.20.193.48:0/1431381176 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f8a8c05e490 msgr2=0x7f8a8c08d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:26.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a926c1640 1 --2- 10.20.193.48:0/1431381176 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f8a8c05e490 0x7f8a8c08d480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:26.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a926c1640 1 -- 10.20.193.48:0/1431381176 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f8a8c13db70 msgr2=0x7f8a8c13ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:26.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a926c1640 1 --2- 10.20.193.48:0/1431381176 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f8a8c13db70 0x7f8a8c13ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:26.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a926c1640 10 monclient: _finish_hunting 0 2026-02-12T18:08:26.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a926c1640 1 monclient: found mon.noname-e 2026-02-12T18:08:26.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a926c1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:26.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a926c1640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:08:26.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.858+0000 7f8a926c1640 1 -- 10.20.193.48:0/1431381176 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a8000a5d0 con 0x7f8a8c05c950 2026-02-12T18:08:26.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a926c1640 1 -- 10.20.193.48:0/1431381176 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8a8c05c950 msgr2=0x7f8a8c12ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:26.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a926c1640 1 --2- 10.20.193.48:0/1431381176 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8a8c05c950 0x7f8a8c12ca60 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a840093f0 tx=0x7f8a8400ed50 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:26.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a76ffd640 1 -- 10.20.193.48:0/1431381176 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8a84013470 con 0x7f8a8c05c950 2026-02-12T18:08:26.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a76ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:26.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a76ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:08:26.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a76ffd640 10 monclient: dump: 2026-02-12T18:08:26.882 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:26.882 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:26.882 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:26.882 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:26.882 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:26.882 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:26.882 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:26.882 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:26.883 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:26.883 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:26.883 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:26.883 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:26.883 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:26.883 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:26.883 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:26.883 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:26.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a76ffd640 10 monclient: _finish_auth 0 2026-02-12T18:08:26.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a76ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:08:26.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a76ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:26.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a76ffd640 1 -- 10.20.193.48:0/1431381176 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a840135f0 con 0x7f8a8c05c950 2026-02-12T18:08:26.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a76ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:26.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a76ffd640 1 -- 10.20.193.48:0/1431381176 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8a84013c20 con 0x7f8a8c05c950 2026-02-12T18:08:26.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a76ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:26.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a76ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:08:26.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a90ebe640 4 set_mon_vals no callback set 2026-02-12T18:08:26.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a76ffd640 10 monclient: dump: 2026-02-12T18:08:26.884 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:26.884 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:26.884 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:26.884 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:26.884 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:26.884 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:26.884 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:26.884 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:26.885 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:26.885 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:26.885 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:26.885 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:26.885 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:26.885 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:26.885 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:26.885 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:26.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a9494c640 5 monclient: authenticate success, global_id 5057 2026-02-12T18:08:26.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a9494c640 10 monclient: _renew_subs 2026-02-12T18:08:26.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a9494c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:08:26.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a9494c640 1 -- 10.20.193.48:0/1431381176 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a8c143b50 con 0x7f8a8c05c950 2026-02-12T18:08:26.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a9494c640 10 monclient: _renew_subs 2026-02-12T18:08:26.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a9494c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:08:26.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a9494c640 1 -- 10.20.193.48:0/1431381176 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a8c08ac60 con 0x7f8a8c05c950 2026-02-12T18:08:26.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a9494c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:26.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a9494c640 1 --2- 10.20.193.48:0/1431381176 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f8a8c08d9c0 0x7f8a8c13d3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:26.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a9494c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:26.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a9494c640 1 -- 10.20.193.48:0/1431381176 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8c08a8e0 con 0x7f8a8c08d9c0 2026-02-12T18:08:26.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a91ec0640 1 --2- 10.20.193.48:0/1431381176 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f8a8c08d9c0 0x7f8a8c13d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:26.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a91ec0640 10 monclient: get_auth_request con 0x7f8a8c08d9c0 auth_method 0 2026-02-12T18:08:26.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a91ec0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:26.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a91ec0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:26.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a91ec0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:26.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a91ec0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:26.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a91ec0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:26.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.861+0000 7f8a76ffd640 1 -- 10.20.193.48:0/1431381176 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f8a84011070 con 0x7f8a8c05c950 2026-02-12T18:08:26.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.862+0000 7f8a91ec0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:26.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.862+0000 7f8a76ffd640 1 --2- 10.20.193.48:0/1431381176 >> v2:10.20.193.111:6812/977811348 conn(0x7f8a5c03f720 0x7f8a5c05fbd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:26.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.862+0000 7f8a91ec0640 10 monclient(hunting): handle_auth_done global_id 5157 payload 824 2026-02-12T18:08:26.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.862+0000 7f8a91ec0640 1 -- 10.20.193.48:0/1431381176 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a8c140710 con 0x7f8a8c08d9c0 2026-02-12T18:08:26.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.862+0000 7f8a76ffd640 1 -- 10.20.193.48:0/1431381176 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(117..117 src has 1..117) ==== 3897+0+0 (secure 0 0 0) 0x7f8a84052b60 con 0x7f8a8c05c950 2026-02-12T18:08:26.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.862+0000 7f8a92ec2640 1 --2- 10.20.193.48:0/1431381176 >> v2:10.20.193.111:6812/977811348 conn(0x7f8a5c03f720 0x7f8a5c05fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:26.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.862+0000 7f8a92ec2640 10 monclient: get_auth_request con 0x7f8a5c03f720 auth_method 0 2026-02-12T18:08:26.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.864+0000 7f8a91ec0640 1 -- 10.20.193.48:0/1431381176 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f8a8c08d9c0 msgr2=0x7f8a8c13d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:26.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.864+0000 7f8a91ec0640 1 --2- 10.20.193.48:0/1431381176 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f8a8c08d9c0 0x7f8a8c13d3d0 secure :-1 s=READY pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a78004740 tx=0x7f8a78010c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:26.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.864+0000 7f8a76ffd640 1 -- 10.20.193.48:0/1431381176 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8a7800ebe0 con 0x7f8a8c08d9c0 2026-02-12T18:08:26.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.864+0000 7f8a76ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:26.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.864+0000 7f8a76ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:08:26.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.864+0000 7f8a76ffd640 10 monclient: dump: 2026-02-12T18:08:26.887 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:26.887 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:26.887 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:26.888 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:26.888 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:26.888 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:26.888 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:26.888 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:26.888 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:26.888 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:26.888 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:26.888 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:26.888 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:26.888 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:26.888 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:26.888 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:26.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.864+0000 7f8a76ffd640 1 -- 10.20.193.48:0/1431381176 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f8a7800c050 con 0x7f8a8c08d9c0 2026-02-12T18:08:26.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.864+0000 7f8a76ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:26.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.864+0000 7f8a76ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:26.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.864+0000 7f8a76ffd640 1 -- 10.20.193.48:0/1431381176 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f8a8c08d9c0 msgr2=0x7f8a8c13d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:26.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.864+0000 7f8a76ffd640 1 --2- 10.20.193.48:0/1431381176 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f8a8c08d9c0 0x7f8a8c13d3d0 secure :-1 s=READY pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a78004740 tx=0x7f8a78010c30 comp rx=0 tx=0).stop 2026-02-12T18:08:26.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.864+0000 7f8a76ffd640 1 -- 10.20.193.48:0/1431381176 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f8a8c08d9c0 msgr2=0x7f8a8c13d3d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:26.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.864+0000 7f8a76ffd640 1 --2- 10.20.193.48:0/1431381176 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f8a8c08d9c0 0x7f8a8c13d3d0 secure :-1 s=CLOSED pgs=218 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a78004740 tx=0x7f8a78010c30 comp rx=0 tx=0).stop 2026-02-12T18:08:26.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.865+0000 7f8a92ec2640 1 --2- 10.20.193.48:0/1431381176 >> v2:10.20.193.111:6812/977811348 conn(0x7f8a5c03f720 0x7f8a5c05fbd0 secure :-1 s=READY pgs=181 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a8002ff30 tx=0x7f8a80007f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:26.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.868+0000 7f8a9494c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:08:26.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.868+0000 7f8a9494c640 1 --2- 10.20.193.48:0/1431381176 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f8a8c129500 0x7f8a8c129900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:26.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.868+0000 7f8a9494c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:26.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.868+0000 7f8a9494c640 1 -- 10.20.193.48:0/1431381176 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f8a8c050410 con 0x7f8a8c129500 2026-02-12T18:08:26.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.868+0000 7f8a91ec0640 1 --2- 10.20.193.48:0/1431381176 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f8a8c129500 0x7f8a8c129900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:26.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.868+0000 7f8a91ec0640 10 monclient: get_auth_request con 0x7f8a8c129500 auth_method 0 2026-02-12T18:08:26.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.868+0000 7f8a91ec0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:26.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.868+0000 7f8a91ec0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:26.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.868+0000 7f8a91ec0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:26.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.868+0000 7f8a91ec0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:26.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.868+0000 7f8a91ec0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:26.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.868+0000 7f8a91ec0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:26.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.868+0000 7f8a91ec0640 10 monclient(hunting): handle_auth_done global_id 5166 payload 824 2026-02-12T18:08:26.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.868+0000 7f8a91ec0640 1 -- 10.20.193.48:0/1431381176 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8a8c097de0 con 0x7f8a8c129500 2026-02-12T18:08:26.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.870+0000 7f8a91ec0640 1 -- 10.20.193.48:0/1431381176 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f8a8c129500 msgr2=0x7f8a8c129900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:26.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.870+0000 7f8a91ec0640 1 --2- 10.20.193.48:0/1431381176 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f8a8c129500 0x7f8a8c129900 secure :-1 s=READY pgs=219 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a78004740 tx=0x7f8a78004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:26.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.870+0000 7f8a76ffd640 1 -- 10.20.193.48:0/1431381176 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8a780044f0 con 0x7f8a8c129500 2026-02-12T18:08:26.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.870+0000 7f8a76ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:26.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.870+0000 7f8a76ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:08:26.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.870+0000 7f8a76ffd640 10 monclient: dump: 2026-02-12T18:08:26.892 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:26.892 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:26.892 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:26.892 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:26.892 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:26.892 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:26.892 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:26.892 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:26.893 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:26.893 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:26.893 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:26.893 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:26.893 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:26.893 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:26.893 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:26.893 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:26.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.870+0000 7f8a76ffd640 1 -- 10.20.193.48:0/1431381176 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10017 (secure 0 0 0) 0x7f8a780216f0 con 0x7f8a8c129500 2026-02-12T18:08:26.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.870+0000 7f8a76ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:08:26.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.870+0000 7f8a76ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:26.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.870+0000 7f8a76ffd640 1 -- 10.20.193.48:0/1431381176 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f8a8c129500 msgr2=0x7f8a8c129900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:26.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.870+0000 7f8a76ffd640 1 --2- 10.20.193.48:0/1431381176 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f8a8c129500 0x7f8a8c129900 secure :-1 s=READY pgs=219 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a78004740 tx=0x7f8a78004770 comp rx=0 tx=0).stop 2026-02-12T18:08:26.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.870+0000 7f8a76ffd640 1 -- 10.20.193.48:0/1431381176 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f8a8c129500 msgr2=0x7f8a8c129900 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:26.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.870+0000 7f8a76ffd640 1 --2- 10.20.193.48:0/1431381176 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f8a8c129500 0x7f8a8c129900 secure :-1 s=CLOSED pgs=219 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a78004740 tx=0x7f8a78004770 comp rx=0 tx=0).stop 2026-02-12T18:08:26.894 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:08:26.894 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:26.894 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:26.894 INFO:teuthology.orchestra.run.trial048.stdout: "state": "leader", 2026-02-12T18:08:26.894 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 28, 2026-02-12T18:08:26.894 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 161705, 2026-02-12T18:08:26.894 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:08:26.894 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:08:26.894 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:08:26.894 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:08:26.894 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:08:26.894 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:08:26.894 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:08:26.895 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:08:26.895 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:08:26.895 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:08:26.895 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:26.895 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 3, 2026-02-12T18:08:26.895 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:26.895 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:08:26.895 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:08:26.895 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:26.895 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:26.895 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:26.895 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:26.895 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:26.895 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:26.895 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:26.895 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:26.895 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:26.895 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:26.896 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:26.896 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:26.896 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:26.896 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:26.896 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:08:26.896 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:08:26.896 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:26.896 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:26.896 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:26.896 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:26.896 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:26.896 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:26.896 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:26.896 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:26.896 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:26.896 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:26.896 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:26.896 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:26.896 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:26.897 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:26.897 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.897 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:08:26.897 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:08:26.897 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:08:26.897 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:08:26.897 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:08:26.897 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:08:26.897 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:26.897 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:26.897 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:08:26.897 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:08:26.897 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:08:26.897 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:08:26.897 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:08:26.897 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:08:26.897 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:08:26.897 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:26.897 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:08:26.898 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:26.898 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:26.898 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:26.898 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:26.898 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:26.898 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:26.898 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:26.898 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:26.898 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:26.898 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:26.898 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:26.898 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:26.898 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:26.898 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:26.898 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:08:26.898 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.898 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:08:26.898 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.898 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:26.898 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:26.898 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:26.899 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:26.899 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.899 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:26.899 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:08:26.899 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:26.899 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.899 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.899 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:26.899 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:08:26.899 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:26.899 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:26.899 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:26.899 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.899 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:08:26.899 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:08:26.899 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:26.899 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:26.899 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:08:26.899 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:26.899 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.900 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.900 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:26.900 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:26.900 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:26.900 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:26.900 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.900 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:26.900 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:08:26.900 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:26.900 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.900 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.900 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:26.900 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:08:26.900 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:26.900 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:26.900 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:26.900 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.900 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:08:26.900 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:08:26.900 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:26.901 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:26.901 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:08:26.901 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:26.901 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.901 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.901 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:26.901 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:26.901 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:26.901 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:26.901 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.901 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:26.901 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:08:26.901 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:26.901 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.901 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.901 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:26.901 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:08:26.901 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:26.901 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:26.901 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:26.901 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.902 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:08:26.902 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:08:26.902 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:26.902 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:26.902 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:08:26.902 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:26.902 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.902 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.902 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:08:26.902 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:08:26.902 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:26.902 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:26.902 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.902 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:26.902 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:08:26.902 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:26.902 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.902 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.902 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:26.902 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:08:26.903 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:26.903 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:26.903 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:26.903 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.903 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:08:26.903 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:08:26.903 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:26.903 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:26.903 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:08:26.903 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:26.903 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.903 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.903 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:08:26.903 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:08:26.903 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:26.903 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:26.903 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.903 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:26.903 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:08:26.903 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:26.903 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.904 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.904 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:26.904 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:08:26.904 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:26.904 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:26.904 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:26.904 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.904 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:08:26.904 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:08:26.904 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:26.904 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:26.904 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:26.904 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:26.904 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.904 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.904 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:26.904 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:26.904 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:26.904 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:26.904 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.904 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:26.905 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:08:26.905 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:26.905 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.905 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.905 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:26.905 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:08:26.905 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:26.905 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:26.905 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:26.905 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.905 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:08:26.905 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:08:26.905 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:26.905 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:26.905 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:08:26.905 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:26.905 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.905 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.905 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:26.905 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:26.906 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:26.906 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:26.906 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.906 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:26.906 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:08:26.906 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:26.906 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.906 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.906 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:26.906 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:08:26.906 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:26.906 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:26.906 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:26.906 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.906 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:08:26.906 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:08:26.906 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:26.906 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:26.906 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:26.906 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:26.906 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.907 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.907 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:26.907 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:26.907 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:26.907 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:26.907 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.907 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:26.907 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:08:26.907 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:26.907 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.907 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.907 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:26.907 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:08:26.907 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:26.907 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:26.907 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:26.907 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.907 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:08:26.907 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:08:26.907 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:26.907 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:26.908 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:08:26.908 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:26.908 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.908 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.908 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:08:26.908 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:08:26.908 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:26.908 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:26.908 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.908 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:26.908 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:08:26.908 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:26.908 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.908 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.908 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:26.908 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:08:26.908 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:26.908 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:26.908 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:26.908 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.908 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:08:26.908 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:08:26.909 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:26.909 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:26.909 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:08:26.909 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:26.909 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:26.909 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:26.909 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.909 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:08:26.909 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:08:26.909 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.909 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:26.909 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:26.909 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:26.909 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:26.909 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:26.909 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:08:26.909 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:26.909 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:26.909 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:26.909 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:26.909 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:26.909 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:26.909 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:26.910 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:08:26.910 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:08:26.910 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.871+0000 7f8a9494c640 1 -- 10.20.193.48:0/1431381176 >> v2:10.20.193.111:6812/977811348 conn(0x7f8a5c03f720 msgr2=0x7f8a5c05fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:26.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.871+0000 7f8a9494c640 1 --2- 10.20.193.48:0/1431381176 >> v2:10.20.193.111:6812/977811348 conn(0x7f8a5c03f720 0x7f8a5c05fbd0 secure :-1 s=READY pgs=181 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a8002ff30 tx=0x7f8a80007f90 comp rx=0 tx=0).stop 2026-02-12T18:08:26.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.871+0000 7f8a9494c640 10 monclient: shutdown 2026-02-12T18:08:26.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.871+0000 7f8a9494c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:26.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.871+0000 7f8a9494c640 1 -- 10.20.193.48:0/1431381176 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8a8c05c950 msgr2=0x7f8a8c12ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:26.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.871+0000 7f8a9494c640 1 --2- 10.20.193.48:0/1431381176 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8a8c05c950 0x7f8a8c12ca60 secure :-1 s=READY pgs=116 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8a840093f0 tx=0x7f8a8400ed50 comp rx=0 tx=0).stop 2026-02-12T18:08:26.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.871+0000 7f8a92ec2640 1 -- 10.20.193.48:0/1431381176 reap_dead start 2026-02-12T18:08:26.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.871+0000 7f8a9494c640 1 -- 10.20.193.48:0/1431381176 shutdown_connections 2026-02-12T18:08:26.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.871+0000 7f8a9494c640 1 --2- 10.20.193.48:0/1431381176 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8a8c05c950 0x7f8a8c12ca60 unknown :-1 s=CLOSED pgs=116 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:26.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.871+0000 7f8a9494c640 1 -- 10.20.193.48:0/1431381176 >> 10.20.193.48:0/1431381176 conn(0x7f8a8c0548a0 msgr2=0x7f8a8c093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:26.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.871+0000 7f8a9494c640 1 -- 10.20.193.48:0/1431381176 shutdown_connections 2026-02-12T18:08:26.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.871+0000 7f8a9494c640 1 -- 10.20.193.48:0/1431381176 wait complete. 2026-02-12T18:08:26.911 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:08:26.911 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2026-02-12T18:08:26.912 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T18:08:26.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.976+0000 7feefbb0c640 10 monclient: get_monmap_and_config 2026-02-12T18:08:26.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.976+0000 7feefbb0c640 10 monclient: build_initial_monmap 2026-02-12T18:08:26.978 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.976+0000 7feefbb0c640 10 monclient: monmap: 2026-02-12T18:08:26.978 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:26.978 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:26.978 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:26.977336+0000 2026-02-12T18:08:26.978 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:26.977336+0000 2026-02-12T18:08:26.978 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:26.978 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:26.978 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:26.978 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:26.978 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:26.979 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:26.979 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:26.979 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:26.979 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:26.979 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:26.979 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:26.979 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:26.979 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:26.979 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:26.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.976+0000 7feefbb0c640 1 Processor -- start 2026-02-12T18:08:26.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.976+0000 7feefbb0c640 1 -- start start 2026-02-12T18:08:26.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.976+0000 7feefbb0c640 10 monclient: init 2026-02-12T18:08:26.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.976+0000 7feefbb0c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:26.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefbb0c640 10 monclient: _add_conns ranks=[2,6,8,5,3,0,4,9,7,1,10] 2026-02-12T18:08:26.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefbb0c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feef40914d0 0x7feef405c950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:26.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefbb0c640 10 monclient(hunting): picked mon.noname-b con 0x7feef40914d0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:08:26.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefbb0c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feef408e210 0x7feef405ce90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:26.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefbb0c640 10 monclient(hunting): picked mon.noname-d con 0x7feef408e210 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:08:26.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefbb0c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7feef405e4b0 0x7feef405d3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:26.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefbb0c640 10 monclient(hunting): picked mon.noname-e con 0x7feef405e4b0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:08:26.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefbb0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:26.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefbb0c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7feef4092f90 con 0x7feef40914d0 2026-02-12T18:08:26.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefbb0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:26.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefbb0c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7feef40918a0 con 0x7feef408e210 2026-02-12T18:08:26.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefbb0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:26.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefbb0c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7feef405de10 con 0x7feef405e4b0 2026-02-12T18:08:26.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefbb0c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:26.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefbb0c640 10 monclient(hunting): authenticate will time out at 745.703100s 2026-02-12T18:08:26.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefa082640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7feef405e4b0 0x7feef405d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:26.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feef9080640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feef408e210 0x7feef405ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:26.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefa082640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7feef405e4b0 0x7feef405d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:51070/0 (socket says 10.20.193.48:51070) 2026-02-12T18:08:26.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefa082640 1 -- 10.20.193.48:0/4169499748 learned_addr learned my addr 10.20.193.48:0/4169499748 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:26.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefa082640 10 monclient(hunting): get_auth_request con 0x7feef405e4b0 auth_method 0 2026-02-12T18:08:26.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefa082640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:26.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefa082640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:26.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefa082640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:26.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feef9881640 1 --2- 10.20.193.48:0/4169499748 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feef40914d0 0x7feef405c950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:26.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feef9080640 10 monclient(hunting): get_auth_request con 0x7feef408e210 auth_method 0 2026-02-12T18:08:26.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feef9080640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:26.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feef9080640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:26.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feef9080640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:26.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feef9881640 10 monclient(hunting): get_auth_request con 0x7feef40914d0 auth_method 0 2026-02-12T18:08:26.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feef9881640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:26.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feef9881640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:26.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feef9881640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:26.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefa082640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:26.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefa082640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:26.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefa082640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:26.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feef9080640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:26.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feef9080640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:26.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feef9080640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:26.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feef9881640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:26.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feef9881640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:26.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feef9881640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:26.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefa082640 10 monclient(hunting): handle_auth_done global_id 5066 payload 274 2026-02-12T18:08:26.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefa082640 1 -- 10.20.193.48:0/4169499748 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feef408e210 msgr2=0x7feef405ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:26.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefa082640 1 --2- 10.20.193.48:0/4169499748 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feef408e210 0x7feef405ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:26.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefa082640 1 -- 10.20.193.48:0/4169499748 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feef40914d0 msgr2=0x7feef405c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:26.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefa082640 1 --2- 10.20.193.48:0/4169499748 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feef40914d0 0x7feef405c950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:26.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefa082640 10 monclient: _finish_hunting 0 2026-02-12T18:08:26.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefa082640 1 monclient: found mon.noname-e 2026-02-12T18:08:26.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefa082640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:26.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefa082640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:08:26.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.977+0000 7feefa082640 1 -- 10.20.193.48:0/4169499748 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef404dc20 con 0x7feef405e4b0 2026-02-12T18:08:26.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.979+0000 7feefa082640 1 -- 10.20.193.48:0/4169499748 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7feef405e4b0 msgr2=0x7feef405d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:26.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.979+0000 7feefa082640 1 --2- 10.20.193.48:0/4169499748 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7feef405e4b0 0x7feef405d3d0 secure :-1 s=READY pgs=117 gs=2 cs=0 l=1 c_cookie=7247344529884876108 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feef000a9b0 tx=0x7feef002fef0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=6493bd73aca88d4c server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:26.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feef887f640 1 -- 10.20.193.48:0/4169499748 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7feef0030b70 con 0x7feef405e4b0 2026-02-12T18:08:26.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feef887f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:26.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feef887f640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:08:26.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feef887f640 10 monclient: dump: 2026-02-12T18:08:26.989 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:26.989 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:26.989 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:26.989 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:26.989 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:26.989 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:26.989 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:26.989 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:26.989 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:26.989 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:26.989 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:26.989 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:26.989 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:26.989 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:26.989 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:26.990 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:26.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feef887f640 10 monclient: _finish_auth 0 2026-02-12T18:08:26.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feef887f640 10 monclient: _check_auth_tickets 2026-02-12T18:08:26.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feef887f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:26.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feef887f640 1 -- 10.20.193.48:0/4169499748 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef0030cf0 con 0x7feef405e4b0 2026-02-12T18:08:26.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feefbb0c640 5 monclient: authenticate success, global_id 5066 2026-02-12T18:08:26.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feefbb0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:08:26.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feef887f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:26.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feef887f640 1 -- 10.20.193.48:0/4169499748 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7feef0030e60 con 0x7feef405e4b0 2026-02-12T18:08:26.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feefbb0c640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:26.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feefbb0c640 4 set_mon_vals no callback set 2026-02-12T18:08:26.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feef887f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:26.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feef887f640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:08:26.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feef887f640 10 monclient: dump: 2026-02-12T18:08:26.990 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:26.990 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:26.990 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:26.991 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:26.991 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:26.991 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:26.991 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:26.991 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:26.991 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:26.991 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:26.991 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:26.991 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:26.991 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:26.991 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:26.991 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:26.991 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:26.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feefbb0c640 10 monclient: shutdown 2026-02-12T18:08:26.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feefbb0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:26.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feefbb0c640 1 -- 10.20.193.48:0/4169499748 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7feef405e4b0 msgr2=0x7feef405d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:26.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feefbb0c640 1 --2- 10.20.193.48:0/4169499748 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7feef405e4b0 0x7feef405d3d0 secure :-1 s=READY pgs=117 gs=2 cs=0 l=1 c_cookie=7247344529884876108 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feef000a9b0 tx=0x7feef002fef0 comp rx=0 tx=0).stop 2026-02-12T18:08:26.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feefbb0c640 1 -- 10.20.193.48:0/4169499748 shutdown_connections 2026-02-12T18:08:26.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feefbb0c640 1 --2- 10.20.193.48:0/4169499748 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7feef405e4b0 0x7feef405d3d0 unknown :-1 s=CLOSED pgs=117 gs=2 cs=0 l=1 c_cookie=7247344529884876108 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:26.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feefbb0c640 1 --2- 10.20.193.48:0/4169499748 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feef408e210 0x7feef405ce90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:26.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feefbb0c640 1 --2- 10.20.193.48:0/4169499748 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feef40914d0 0x7feef405c950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:26.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feefbb0c640 1 -- 10.20.193.48:0/4169499748 >> 10.20.193.48:0/4169499748 conn(0x7feef40548a0 msgr2=0x7feef4097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:26.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feefbb0c640 1 -- 10.20.193.48:0/4169499748 shutdown_connections 2026-02-12T18:08:26.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feefbb0c640 1 -- 10.20.193.48:0/4169499748 wait complete. 2026-02-12T18:08:26.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feefbb0c640 10 monclient: build_initial_monmap 2026-02-12T18:08:26.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.980+0000 7feefbb0c640 10 monclient: monmap: 2026-02-12T18:08:26.992 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:26.992 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:26.992 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:26.992 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:26.992 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:26.992 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:26.992 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:26.992 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:26.993 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:26.993 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:26.993 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:26.993 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:26.993 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:26.993 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:26.993 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:26.993 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:26.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feefbb0c640 1 Processor -- start 2026-02-12T18:08:26.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feefbb0c640 1 -- start start 2026-02-12T18:08:26.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feefbb0c640 10 monclient: init 2026-02-12T18:08:26.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feefbb0c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:26.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feefbb0c640 10 monclient: _add_conns ranks=[1,7,3,4,5,6,2,8,0] 2026-02-12T18:08:26.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feefbb0c640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7feef405e4b0 0x7feef41a3a90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:26.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feefbb0c640 10 monclient(hunting): picked mon.noname-f con 0x7feef405e4b0 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:08:26.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feefbb0c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7feef408e210 0x7feef41a3fd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:26.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feefbb0c640 10 monclient(hunting): picked mon.noname-i con 0x7feef408e210 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:26.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feefbb0c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7feef40914d0 0x7feef41a7c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:26.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feefbb0c640 10 monclient(hunting): picked mon.noname-g con 0x7feef40914d0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:08:26.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feefbb0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:26.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feefbb0c640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7feef41a94f0 con 0x7feef405e4b0 2026-02-12T18:08:26.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feefbb0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:26.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feefbb0c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7feef41b0000 con 0x7feef40914d0 2026-02-12T18:08:26.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feefbb0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:26.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feefbb0c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7feef408f940 con 0x7feef408e210 2026-02-12T18:08:26.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feefbb0c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:26.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feefbb0c640 10 monclient(hunting): authenticate will time out at 745.707483s 2026-02-12T18:08:26.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feef9881640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7feef405e4b0 0x7feef41a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:26.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feef9080640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7feef408e210 0x7feef41a3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:26.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feef9080640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7feef408e210 0x7feef41a3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3303/0 says I am v2:10.20.193.48:40166/0 (socket says 10.20.193.48:40166) 2026-02-12T18:08:26.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feef9881640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7feef405e4b0 0x7feef41a3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3300/0 says I am v2:10.20.193.48:51594/0 (socket says 10.20.193.48:51594) 2026-02-12T18:08:26.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feef9080640 1 -- 10.20.193.48:0/584665580 learned_addr learned my addr 10.20.193.48:0/584665580 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:26.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feef9080640 10 monclient(hunting): get_auth_request con 0x7feef408e210 auth_method 0 2026-02-12T18:08:26.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feef9080640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:26.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feef9080640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:26.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feef9080640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:26.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feef9881640 10 monclient(hunting): get_auth_request con 0x7feef405e4b0 auth_method 0 2026-02-12T18:08:26.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feef9881640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:26.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feef9881640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:26.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feef9881640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:26.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feefa082640 1 --2- 10.20.193.48:0/584665580 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7feef40914d0 0x7feef41a7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:26.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feefa082640 10 monclient(hunting): get_auth_request con 0x7feef40914d0 auth_method 0 2026-02-12T18:08:26.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feefa082640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:26.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feefa082640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:26.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feefa082640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:26.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feef9881640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:26.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feef9881640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:26.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feef9881640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:26.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feef9080640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:26.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feef9080640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:26.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.981+0000 7feef9080640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:26.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.982+0000 7feefa082640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:26.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.982+0000 7feefa082640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:26.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.982+0000 7feefa082640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:26.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.982+0000 7feef9080640 10 monclient(hunting): handle_auth_done global_id 44233 payload 824 2026-02-12T18:08:26.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.982+0000 7feef9080640 1 -- 10.20.193.48:0/584665580 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7feef40914d0 msgr2=0x7feef41a7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:26.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.982+0000 7feef9080640 1 --2- 10.20.193.48:0/584665580 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7feef40914d0 0x7feef41a7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:26.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.982+0000 7feef9080640 1 -- 10.20.193.48:0/584665580 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7feef405e4b0 msgr2=0x7feef41a3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:26.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.982+0000 7feef9080640 1 --2- 10.20.193.48:0/584665580 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7feef405e4b0 0x7feef41a3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:26.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.982+0000 7feef9080640 10 monclient: _finish_hunting 0 2026-02-12T18:08:26.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.982+0000 7feef9080640 1 monclient: found mon.noname-i 2026-02-12T18:08:26.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.982+0000 7feef9080640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:26.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.982+0000 7feef9080640 10 monclient: _send_mon_message to mon.noname-i at v2:10.20.193.111:3303/0 2026-02-12T18:08:26.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.982+0000 7feef9080640 1 -- 10.20.193.48:0/584665580 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feef000a5d0 con 0x7feef408e210 2026-02-12T18:08:27.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.984+0000 7feef9080640 1 -- 10.20.193.48:0/584665580 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7feef408e210 msgr2=0x7feef41a3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.984+0000 7feef9080640 1 --2- 10.20.193.48:0/584665580 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7feef408e210 0x7feef41a3fd0 secure :-1 s=READY pgs=24 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feee80093f0 tx=0x7feee800ed50 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.984+0000 7feee27fc640 1 -- 10.20.193.48:0/584665580 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7feee800cb50 con 0x7feef408e210 2026-02-12T18:08:27.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.984+0000 7feee27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.984+0000 7feee27fc640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2026-02-12T18:08:27.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.984+0000 7feee27fc640 10 monclient: dump: 2026-02-12T18:08:27.001 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.001 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.001 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.001 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.001 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.001 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.001 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.001 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.001 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.001 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.002 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.002 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.002 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.002 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.002 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.002 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.984+0000 7feee27fc640 10 monclient: _finish_auth 0 2026-02-12T18:08:27.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.984+0000 7feee27fc640 10 monclient: _check_auth_tickets 2026-02-12T18:08:27.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.984+0000 7feee27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:27.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.984+0000 7feee27fc640 1 -- 10.20.193.48:0/584665580 <== mon.7 v2:10.20.193.111:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feee800ccd0 con 0x7feef408e210 2026-02-12T18:08:27.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.984+0000 7feefbb0c640 5 monclient: authenticate success, global_id 44233 2026-02-12T18:08:27.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.984+0000 7feefbb0c640 10 monclient: _renew_subs 2026-02-12T18:08:27.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.984+0000 7feefbb0c640 10 monclient: _send_mon_message to mon.i at v2:10.20.193.111:3303/0 2026-02-12T18:08:27.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.984+0000 7feefbb0c640 1 -- 10.20.193.48:0/584665580 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feef408fe90 con 0x7feef408e210 2026-02-12T18:08:27.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.984+0000 7feee27fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:27.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.984+0000 7feee27fc640 1 -- 10.20.193.48:0/584665580 <== mon.7 v2:10.20.193.111:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7feee800ce40 con 0x7feef408e210 2026-02-12T18:08:27.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.984+0000 7feee27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.984+0000 7feee3fff640 4 set_mon_vals no callback set 2026-02-12T18:08:27.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.984+0000 7feee27fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:08:27.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.984+0000 7feee27fc640 10 monclient: dump: 2026-02-12T18:08:27.003 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.003 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.003 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.003 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.003 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.003 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.003 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.003 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.003 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.003 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.003 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.003 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.003 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.004 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.004 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.004 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.984+0000 7feefbb0c640 10 monclient: _renew_subs 2026-02-12T18:08:27.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.984+0000 7feefbb0c640 10 monclient: _send_mon_message to mon.i at v2:10.20.193.111:3303/0 2026-02-12T18:08:27.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.984+0000 7feefbb0c640 1 -- 10.20.193.48:0/584665580 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7feef41ab850 con 0x7feef408e210 2026-02-12T18:08:27.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.985+0000 7feefbb0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:27.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.985+0000 7feefbb0c640 1 --2- 10.20.193.48:0/584665580 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feef41a8910 0x7feef408a7c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.985+0000 7feefbb0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.985+0000 7feefbb0c640 1 -- 10.20.193.48:0/584665580 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7feef405f140 con 0x7feef41a8910 2026-02-12T18:08:27.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.985+0000 7feef9881640 1 --2- 10.20.193.48:0/584665580 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feef41a8910 0x7feef408a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.985+0000 7feef9881640 10 monclient: get_auth_request con 0x7feef41a8910 auth_method 0 2026-02-12T18:08:27.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.985+0000 7feef9881640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.985+0000 7feef9881640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.985+0000 7feef9881640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.985+0000 7feef9881640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.985+0000 7feef9881640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.985+0000 7feef9881640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.985+0000 7feef9881640 10 monclient(hunting): handle_auth_done global_id 35048 payload 824 2026-02-12T18:08:27.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.985+0000 7feef9881640 1 -- 10.20.193.48:0/584665580 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feef41ab020 con 0x7feef41a8910 2026-02-12T18:08:27.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.985+0000 7feee27fc640 1 -- 10.20.193.48:0/584665580 <== mon.7 v2:10.20.193.111:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7feee8011070 con 0x7feef408e210 2026-02-12T18:08:27.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.985+0000 7feee27fc640 1 --2- 10.20.193.48:0/584665580 >> v2:10.20.193.111:6812/977811348 conn(0x7feec403f800 0x7feec405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.985+0000 7feee27fc640 1 -- 10.20.193.48:0/584665580 <== mon.7 v2:10.20.193.111:3303/0 5 ==== osd_map(117..117 src has 1..117) ==== 3897+0+0 (secure 0 0 0) 0x7feee8052b50 con 0x7feef408e210 2026-02-12T18:08:27.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.986+0000 7feefa082640 1 --2- 10.20.193.48:0/584665580 >> v2:10.20.193.111:6812/977811348 conn(0x7feec403f800 0x7feec405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.986+0000 7feefa082640 10 monclient: get_auth_request con 0x7feec403f800 auth_method 0 2026-02-12T18:08:27.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.987+0000 7feef9881640 1 -- 10.20.193.48:0/584665580 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feef41a8910 msgr2=0x7feef408a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.987+0000 7feef9881640 1 --2- 10.20.193.48:0/584665580 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feef41a8910 0x7feef408a7c0 secure :-1 s=READY pgs=109 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feee40118f0 tx=0x7feee4011dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.987+0000 7feee27fc640 1 -- 10.20.193.48:0/584665580 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7feee400fe50 con 0x7feef41a8910 2026-02-12T18:08:27.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.987+0000 7feee27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.987+0000 7feee27fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:08:27.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.987+0000 7feee27fc640 10 monclient: dump: 2026-02-12T18:08:27.005 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.005 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.006 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.006 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.006 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.006 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.006 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.006 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.006 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.006 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.006 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.006 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.006 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.006 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.006 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.006 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.988+0000 7feee27fc640 1 -- 10.20.193.48:0/584665580 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7feee4004030 con 0x7feef41a8910 2026-02-12T18:08:27.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.988+0000 7feee27fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:27.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.988+0000 7feee27fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:27.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.988+0000 7feee27fc640 1 -- 10.20.193.48:0/584665580 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feef41a8910 msgr2=0x7feef408a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.988+0000 7feee27fc640 1 --2- 10.20.193.48:0/584665580 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feef41a8910 0x7feef408a7c0 secure :-1 s=READY pgs=109 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feee40118f0 tx=0x7feee4011dc0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.988+0000 7feee27fc640 1 -- 10.20.193.48:0/584665580 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feef41a8910 msgr2=0x7feef408a7c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:27.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.988+0000 7feee27fc640 1 --2- 10.20.193.48:0/584665580 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feef41a8910 0x7feef408a7c0 unknown :-1 s=CLOSED pgs=109 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.988+0000 7feefa082640 1 --2- 10.20.193.48:0/584665580 >> v2:10.20.193.111:6812/977811348 conn(0x7feec403f800 0x7feec405fcb0 secure :-1 s=READY pgs=182 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feef002ff30 tx=0x7feef003a040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.991+0000 7feefbb0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:08:27.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.991+0000 7feefbb0c640 1 --2- 10.20.193.48:0/584665580 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feef41a8ce0 0x7feef408ad00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.991+0000 7feefbb0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.991+0000 7feefbb0c640 1 -- 10.20.193.48:0/584665580 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7feef405fd90 con 0x7feef41a8ce0 2026-02-12T18:08:27.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.991+0000 7feef9881640 1 --2- 10.20.193.48:0/584665580 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feef41a8ce0 0x7feef408ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.991+0000 7feef9881640 10 monclient: get_auth_request con 0x7feef41a8ce0 auth_method 0 2026-02-12T18:08:27.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.991+0000 7feef9881640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.991+0000 7feef9881640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.991+0000 7feef9881640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.991+0000 7feef9881640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.991+0000 7feef9881640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.991+0000 7feef9881640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.991+0000 7feef9881640 10 monclient(hunting): handle_auth_done global_id 35057 payload 824 2026-02-12T18:08:27.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.991+0000 7feef9881640 1 -- 10.20.193.48:0/584665580 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7feef4092cb0 con 0x7feef41a8ce0 2026-02-12T18:08:27.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.994+0000 7feef9881640 1 -- 10.20.193.48:0/584665580 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feef41a8ce0 msgr2=0x7feef408ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.994+0000 7feef9881640 1 --2- 10.20.193.48:0/584665580 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feef41a8ce0 0x7feef408ad00 secure :-1 s=READY pgs=110 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feee40118f0 tx=0x7feee4004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.994+0000 7feee27fc640 1 -- 10.20.193.48:0/584665580 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7feee401ed30 con 0x7feef41a8ce0 2026-02-12T18:08:27.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.994+0000 7feee27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.994+0000 7feee27fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:08:27.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.994+0000 7feee27fc640 10 monclient: dump: 2026-02-12T18:08:27.008 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.008 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.008 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.008 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.008 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.008 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.008 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.008 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.008 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.009 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.009 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.009 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.009 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.009 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.009 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.009 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.994+0000 7feee27fc640 1 -- 10.20.193.48:0/584665580 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10182 (secure 0 0 0) 0x7feee401ee90 con 0x7feef41a8ce0 2026-02-12T18:08:27.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.994+0000 7feee27fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:08:27.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.994+0000 7feee27fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:27.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.994+0000 7feee27fc640 1 -- 10.20.193.48:0/584665580 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feef41a8ce0 msgr2=0x7feef408ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.994+0000 7feee27fc640 1 --2- 10.20.193.48:0/584665580 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feef41a8ce0 0x7feef408ad00 secure :-1 s=READY pgs=110 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feee40118f0 tx=0x7feee4004770 comp rx=0 tx=0).stop 2026-02-12T18:08:27.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.994+0000 7feee27fc640 1 -- 10.20.193.48:0/584665580 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feef41a8ce0 msgr2=0x7feef408ad00 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:27.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.994+0000 7feee27fc640 1 --2- 10.20.193.48:0/584665580 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feef41a8ce0 0x7feef408ad00 secure :-1 s=CLOSED pgs=110 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feee40118f0 tx=0x7feee4004770 comp rx=0 tx=0).stop 2026-02-12T18:08:27.010 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:08:27.010 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:27.010 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:27.010 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:08:27.010 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 28, 2026-02-12T18:08:27.010 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 161828, 2026-02-12T18:08:27.010 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:08:27.010 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:08:27.010 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:08:27.010 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:08:27.010 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:08:27.010 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:08:27.010 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:08:27.010 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:08:27.010 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:08:27.010 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:08:27.011 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.011 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 3, 2026-02-12T18:08:27.011 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:27.011 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:08:27.011 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:08:27.011 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:27.011 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:27.011 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:27.011 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:27.011 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:27.011 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:27.011 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:27.011 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:27.011 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:27.011 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:27.011 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:27.011 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:27.011 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:27.012 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.012 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:08:27.012 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:08:27.012 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:27.012 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:27.012 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:27.012 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:27.012 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:27.012 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:27.012 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:27.012 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:27.012 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:27.012 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:27.012 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:27.012 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:27.012 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:27.012 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.012 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.012 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:08:27.013 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:08:27.013 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:08:27.013 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:08:27.013 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:08:27.013 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:08:27.013 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:27.013 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:27.013 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:08:27.013 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:08:27.013 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:08:27.013 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:08:27.013 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:08:27.013 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:08:27.013 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:08:27.013 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:27.013 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:08:27.013 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:27.013 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:27.013 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:27.014 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:27.014 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:27.014 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:27.014 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:27.014 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:27.014 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:27.014 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:27.014 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:27.014 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:27.014 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:27.014 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.014 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:08:27.014 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.014 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:08:27.014 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.014 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:27.014 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:27.014 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.014 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.014 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.014 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.015 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:08:27.015 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.015 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.015 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.015 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.015 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:08:27.015 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.015 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.015 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.015 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.015 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:08:27.015 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:08:27.015 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.015 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.015 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:08:27.015 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.015 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.015 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.015 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:27.015 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:27.015 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.016 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.016 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.016 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.016 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:08:27.016 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.016 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.016 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.016 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.016 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:08:27.016 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.016 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.016 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.016 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.016 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:08:27.016 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:08:27.016 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.016 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.016 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:08:27.016 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.016 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.017 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.017 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:27.017 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:27.017 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.017 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.017 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.017 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.017 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:08:27.017 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.017 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.017 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.017 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.017 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:08:27.017 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.017 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.017 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.017 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.017 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:08:27.017 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:08:27.017 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.017 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.018 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:08:27.018 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.018 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.018 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.018 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:08:27.018 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:08:27.018 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.018 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.018 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.018 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.018 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:08:27.018 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.018 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.018 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.018 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.018 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:08:27.018 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.018 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.018 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.018 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.018 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:08:27.018 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:08:27.019 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.019 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.019 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:08:27.019 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.019 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.019 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.019 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:08:27.019 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:08:27.019 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.019 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.019 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.019 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.019 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:08:27.019 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.019 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.019 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.019 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.019 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:08:27.019 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.019 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.019 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.019 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.020 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:08:27.020 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:08:27.020 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.020 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.020 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:27.020 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.020 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.020 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.020 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:27.020 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:27.020 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.020 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.020 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.020 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.020 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:08:27.020 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.020 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.020 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.020 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.020 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:08:27.020 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.020 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.020 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.020 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.021 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:08:27.021 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:08:27.021 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.021 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.021 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:08:27.021 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.021 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.021 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.021 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:27.021 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:27.021 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.021 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.021 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.021 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.021 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:08:27.021 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.021 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.021 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.021 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.021 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:08:27.021 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.021 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.021 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.021 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.022 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:08:27.022 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:08:27.022 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.022 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.022 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:27.022 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.022 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.022 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.022 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:27.022 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:27.022 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.022 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.022 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.022 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.022 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:08:27.022 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.022 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.022 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.022 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.022 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:08:27.022 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.022 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.022 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.022 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.023 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:08:27.023 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:08:27.023 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.023 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.023 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:08:27.023 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.023 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.023 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.023 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:08:27.023 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:08:27.023 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.023 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.023 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.023 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.023 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:08:27.023 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.023 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.023 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.023 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.023 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:08:27.023 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.023 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.023 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.023 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.023 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:08:27.024 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:08:27.024 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.024 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.024 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:08:27.024 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.024 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.024 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.024 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.024 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:08:27.024 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:08:27.024 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.024 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:27.024 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:27.024 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:27.024 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.024 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.024 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:08:27.024 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.024 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:27.024 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:27.024 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:08:27.024 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.024 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.024 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:08:27.024 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.025 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:27.025 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:27.025 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:27.025 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.025 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.025 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.025 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:08:27.025 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:08:27.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.994+0000 7feefbb0c640 1 -- 10.20.193.48:0/584665580 >> v2:10.20.193.111:6812/977811348 conn(0x7feec403f800 msgr2=0x7feec405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.994+0000 7feefbb0c640 1 --2- 10.20.193.48:0/584665580 >> v2:10.20.193.111:6812/977811348 conn(0x7feec403f800 0x7feec405fcb0 secure :-1 s=READY pgs=182 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feef002ff30 tx=0x7feef003a040 comp rx=0 tx=0).stop 2026-02-12T18:08:27.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.994+0000 7feefbb0c640 10 monclient: shutdown 2026-02-12T18:08:27.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.994+0000 7feefbb0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:27.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.994+0000 7feefbb0c640 1 -- 10.20.193.48:0/584665580 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7feef408e210 msgr2=0x7feef41a3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.994+0000 7feefbb0c640 1 --2- 10.20.193.48:0/584665580 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7feef408e210 0x7feef41a3fd0 secure :-1 s=READY pgs=24 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feee80093f0 tx=0x7feee800ed50 comp rx=0 tx=0).stop 2026-02-12T18:08:27.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.994+0000 7feefa082640 1 -- 10.20.193.48:0/584665580 reap_dead start 2026-02-12T18:08:27.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.994+0000 7feefa082640 1 -- 10.20.193.48:0/584665580 reap_dead start 2026-02-12T18:08:27.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.994+0000 7feefbb0c640 1 -- 10.20.193.48:0/584665580 shutdown_connections 2026-02-12T18:08:27.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.994+0000 7feefbb0c640 1 -- 10.20.193.48:0/584665580 >> 10.20.193.48:0/584665580 conn(0x7feef40548a0 msgr2=0x7feef41af700 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:27.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.994+0000 7feefbb0c640 1 -- 10.20.193.48:0/584665580 shutdown_connections 2026-02-12T18:08:27.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:26.994+0000 7feefbb0c640 1 -- 10.20.193.48:0/584665580 wait complete. 2026-02-12T18:08:27.026 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:08:27.027 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2026-02-12T18:08:27.027 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T18:08:27.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.091+0000 7fc5475ee640 10 monclient: get_monmap_and_config 2026-02-12T18:08:27.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.091+0000 7fc5475ee640 10 monclient: build_initial_monmap 2026-02-12T18:08:27.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.091+0000 7fc5475ee640 10 monclient: monmap: 2026-02-12T18:08:27.093 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:27.093 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.094 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:27.093010+0000 2026-02-12T18:08:27.094 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:27.093010+0000 2026-02-12T18:08:27.094 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:27.094 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.094 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:27.094 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:27.094 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:27.094 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:27.094 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:27.094 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:27.094 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:27.094 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:27.095 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:27.095 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:27.095 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:27.095 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc5475ee640 1 Processor -- start 2026-02-12T18:08:27.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc5475ee640 1 -- start start 2026-02-12T18:08:27.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc5475ee640 10 monclient: init 2026-02-12T18:08:27.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc5475ee640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:27.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc5475ee640 10 monclient: _add_conns ranks=[3,5,8,0,7,4,9,6,1,2,10] 2026-02-12T18:08:27.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc5475ee640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc54005c950 0x7fc54005cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc5475ee640 10 monclient(hunting): picked mon.noname-g con 0x7fc54005c950 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:08:27.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc5475ee640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fc54005e490 0x7fc54005d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc5475ee640 10 monclient(hunting): picked mon.noname-h con 0x7fc54005e490 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:08:27.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc5475ee640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fc54013db70 0x7fc54013dfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc5475ee640 10 monclient(hunting): picked mon.noname-e con 0x7fc54013db70 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:08:27.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc5475ee640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc5475ee640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fc54005ddd0 con 0x7fc54005c950 2026-02-12T18:08:27.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc5475ee640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc5475ee640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fc54005d7a0 con 0x7fc54005e490 2026-02-12T18:08:27.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc5475ee640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc5475ee640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fc540092990 con 0x7fc54013db70 2026-02-12T18:08:27.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc5475ee640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:27.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc5475ee640 10 monclient(hunting): authenticate will time out at 745.818716s 2026-02-12T18:08:27.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc545b64640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fc54013db70 0x7fc54013dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc545b64640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fc54013db70 0x7fc54013dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:51084/0 (socket says 10.20.193.48:51084) 2026-02-12T18:08:27.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc545b64640 1 -- 10.20.193.48:0/646043084 learned_addr learned my addr 10.20.193.48:0/646043084 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:27.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc545b64640 10 monclient(hunting): get_auth_request con 0x7fc54013db70 auth_method 0 2026-02-12T18:08:27.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc545b64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc545b64640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc545b64640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc545363640 1 --2- 10.20.193.48:0/646043084 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc54005c950 0x7fc54005cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc545b64640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc545b64640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc544b62640 1 --2- 10.20.193.48:0/646043084 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fc54005e490 0x7fc54005d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc545b64640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc545363640 10 monclient(hunting): get_auth_request con 0x7fc54005c950 auth_method 0 2026-02-12T18:08:27.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc545363640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc545363640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc545363640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc544b62640 10 monclient(hunting): get_auth_request con 0x7fc54005e490 auth_method 0 2026-02-12T18:08:27.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc544b62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc544b62640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.092+0000 7fc544b62640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.093+0000 7fc545b64640 10 monclient(hunting): handle_auth_done global_id 5075 payload 274 2026-02-12T18:08:27.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.093+0000 7fc545b64640 1 -- 10.20.193.48:0/646043084 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fc54005e490 msgr2=0x7fc54005d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:27.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.093+0000 7fc545b64640 1 --2- 10.20.193.48:0/646043084 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fc54005e490 0x7fc54005d260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.093+0000 7fc545b64640 1 -- 10.20.193.48:0/646043084 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc54005c950 msgr2=0x7fc54005cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:27.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.093+0000 7fc545b64640 1 --2- 10.20.193.48:0/646043084 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc54005c950 0x7fc54005cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.093+0000 7fc545b64640 10 monclient: _finish_hunting 0 2026-02-12T18:08:27.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.093+0000 7fc545b64640 1 monclient: found mon.noname-e 2026-02-12T18:08:27.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.093+0000 7fc545b64640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:27.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.093+0000 7fc545b64640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:08:27.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.093+0000 7fc545b64640 1 -- 10.20.193.48:0/646043084 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54004dc20 con 0x7fc54013db70 2026-02-12T18:08:27.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.093+0000 7fc544b62640 1 --2- 10.20.193.48:0/646043084 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fc54005e490 0x7fc54005d260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:08:27.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.093+0000 7fc545363640 1 --2- 10.20.193.48:0/646043084 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc54005c950 0x7fc54005cd20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:08:27.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.095+0000 7fc545b64640 1 -- 10.20.193.48:0/646043084 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fc54013db70 msgr2=0x7fc54013dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.095+0000 7fc545b64640 1 --2- 10.20.193.48:0/646043084 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fc54013db70 0x7fc54013dfc0 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=10562103712290365292 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc53c00a9b0 tx=0x7fc53c02fef0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=9294215dabe6df6c server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.095+0000 7fc52ffff640 1 -- 10.20.193.48:0/646043084 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc53c030b70 con 0x7fc54013db70 2026-02-12T18:08:27.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.095+0000 7fc52ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.095+0000 7fc52ffff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:08:27.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.095+0000 7fc52ffff640 10 monclient: dump: 2026-02-12T18:08:27.100 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.100 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.100 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.100 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.100 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.100 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.100 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.100 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.100 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.100 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.100 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.100 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.100 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.100 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.100 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.100 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.095+0000 7fc52ffff640 10 monclient: _finish_auth 0 2026-02-12T18:08:27.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.095+0000 7fc52ffff640 10 monclient: _check_auth_tickets 2026-02-12T18:08:27.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.095+0000 7fc52ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:27.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.095+0000 7fc5475ee640 5 monclient: authenticate success, global_id 5075 2026-02-12T18:08:27.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.095+0000 7fc52ffff640 1 -- 10.20.193.48:0/646043084 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc53c030cf0 con 0x7fc54013db70 2026-02-12T18:08:27.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.095+0000 7fc5475ee640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:08:27.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.095+0000 7fc52ffff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:27.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.095+0000 7fc5475ee640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:27.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.095+0000 7fc52ffff640 1 -- 10.20.193.48:0/646043084 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc53c030e60 con 0x7fc54013db70 2026-02-12T18:08:27.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.095+0000 7fc5475ee640 4 set_mon_vals no callback set 2026-02-12T18:08:27.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.095+0000 7fc52ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.095+0000 7fc52ffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:08:27.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.095+0000 7fc52ffff640 10 monclient: dump: 2026-02-12T18:08:27.101 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.101 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.101 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.101 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.101 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.101 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.101 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.101 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.101 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.101 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.101 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.101 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.101 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.101 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.101 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.101 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.096+0000 7fc5475ee640 10 monclient: shutdown 2026-02-12T18:08:27.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.096+0000 7fc5475ee640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:27.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.096+0000 7fc5475ee640 1 -- 10.20.193.48:0/646043084 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fc54013db70 msgr2=0x7fc54013dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.096+0000 7fc5475ee640 1 --2- 10.20.193.48:0/646043084 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fc54013db70 0x7fc54013dfc0 secure :-1 s=READY pgs=118 gs=1 cs=0 l=1 c_cookie=10562103712290365292 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc53c00a9b0 tx=0x7fc53c02fef0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.096+0000 7fc5475ee640 1 -- 10.20.193.48:0/646043084 shutdown_connections 2026-02-12T18:08:27.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.096+0000 7fc5475ee640 1 --2- 10.20.193.48:0/646043084 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fc54013db70 0x7fc54013dfc0 unknown :-1 s=CLOSED pgs=118 gs=1 cs=0 l=1 c_cookie=10562103712290365292 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.096+0000 7fc5475ee640 1 --2- 10.20.193.48:0/646043084 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fc54005e490 0x7fc54005d260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.096+0000 7fc5475ee640 1 --2- 10.20.193.48:0/646043084 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc54005c950 0x7fc54005cd20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.096+0000 7fc5475ee640 1 -- 10.20.193.48:0/646043084 >> 10.20.193.48:0/646043084 conn(0x7fc5400548a0 msgr2=0x7fc540097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:27.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.096+0000 7fc5475ee640 1 -- 10.20.193.48:0/646043084 shutdown_connections 2026-02-12T18:08:27.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.096+0000 7fc5475ee640 1 -- 10.20.193.48:0/646043084 wait complete. 2026-02-12T18:08:27.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.096+0000 7fc5475ee640 10 monclient: build_initial_monmap 2026-02-12T18:08:27.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.096+0000 7fc5475ee640 10 monclient: monmap: 2026-02-12T18:08:27.102 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:27.102 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:27.102 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:27.102 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:27.102 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:27.102 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.102 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:27.102 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:27.102 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:27.102 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:27.102 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:27.102 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:27.102 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:27.103 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:27.103 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:27.103 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.096+0000 7fc5475ee640 1 Processor -- start 2026-02-12T18:08:27.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.096+0000 7fc5475ee640 1 -- start start 2026-02-12T18:08:27.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.096+0000 7fc5475ee640 10 monclient: init 2026-02-12T18:08:27.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.096+0000 7fc5475ee640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:27.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.096+0000 7fc5475ee640 10 monclient: _add_conns ranks=[7,2,1,8,3,4,6,0,5] 2026-02-12T18:08:27.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.096+0000 7fc5475ee640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fc54005c950 0x7fc54012c8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.096+0000 7fc5475ee640 10 monclient(hunting): picked mon.noname-i con 0x7fc54005c950 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:27.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.096+0000 7fc5475ee640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc54005e490 0x7fc54008d430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.096+0000 7fc5475ee640 10 monclient(hunting): picked mon.noname-b con 0x7fc54005e490 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:08:27.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc5475ee640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fc54013db70 0x7fc54013cd00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc5475ee640 10 monclient(hunting): picked mon.noname-f con 0x7fc54013db70 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:08:27.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc5475ee640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc5475ee640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc54013e7d0 con 0x7fc54013db70 2026-02-12T18:08:27.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc5475ee640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc5475ee640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fc54008aff0 con 0x7fc54005e490 2026-02-12T18:08:27.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc5475ee640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc5475ee640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fc54013e3f0 con 0x7fc54005c950 2026-02-12T18:08:27.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc5475ee640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:27.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc5475ee640 10 monclient(hunting): authenticate will time out at 745.823024s 2026-02-12T18:08:27.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc544b62640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc54005e490 0x7fc54008d430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc544b62640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc54005e490 0x7fc54008d430 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:52558/0 (socket says 10.20.193.48:52558) 2026-02-12T18:08:27.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc544b62640 1 -- 10.20.193.48:0/223469268 learned_addr learned my addr 10.20.193.48:0/223469268 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:27.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc544b62640 10 monclient(hunting): get_auth_request con 0x7fc54005e490 auth_method 0 2026-02-12T18:08:27.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc544b62640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc544b62640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc544b62640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc544b62640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc544b62640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc545363640 1 --2- 10.20.193.48:0/223469268 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fc54005c950 0x7fc54012c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc544b62640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc545363640 10 monclient(hunting): get_auth_request con 0x7fc54005c950 auth_method 0 2026-02-12T18:08:27.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc545363640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc545363640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc545363640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc545b64640 1 --2- 10.20.193.48:0/223469268 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fc54013db70 0x7fc54013cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc545b64640 10 monclient(hunting): get_auth_request con 0x7fc54013db70 auth_method 0 2026-02-12T18:08:27.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc545b64640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc545b64640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc545b64640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc545363640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc545363640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc545363640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc544b62640 10 monclient(hunting): handle_auth_done global_id 35066 payload 824 2026-02-12T18:08:27.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc544b62640 1 -- 10.20.193.48:0/223469268 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fc54005c950 msgr2=0x7fc54012c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc544b62640 1 --2- 10.20.193.48:0/223469268 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fc54005c950 0x7fc54012c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc544b62640 1 -- 10.20.193.48:0/223469268 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fc54013db70 msgr2=0x7fc54013cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc544b62640 1 --2- 10.20.193.48:0/223469268 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fc54013db70 0x7fc54013cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc544b62640 10 monclient: _finish_hunting 0 2026-02-12T18:08:27.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc544b62640 1 monclient: found mon.noname-b 2026-02-12T18:08:27.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc544b62640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:27.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc544b62640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:08:27.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.097+0000 7fc544b62640 1 -- 10.20.193.48:0/223469268 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc53c00a5d0 con 0x7fc54005e490 2026-02-12T18:08:27.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.099+0000 7fc544b62640 1 -- 10.20.193.48:0/223469268 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc54005e490 msgr2=0x7fc54008d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.099+0000 7fc544b62640 1 --2- 10.20.193.48:0/223469268 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc54005e490 0x7fc54008d430 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc53400e770 tx=0x7fc53400ec40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.099+0000 7fc52dffb640 1 -- 10.20.193.48:0/223469268 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc53400ee40 con 0x7fc54005e490 2026-02-12T18:08:27.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.099+0000 7fc52dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.099+0000 7fc52dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:08:27.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.099+0000 7fc52dffb640 10 monclient: dump: 2026-02-12T18:08:27.108 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.108 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.109 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.109 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.109 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.109 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.109 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.109 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.109 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.109 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.109 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.109 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.109 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.109 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.109 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.109 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.099+0000 7fc52dffb640 10 monclient: _finish_auth 0 2026-02-12T18:08:27.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.099+0000 7fc52dffb640 10 monclient: _check_auth_tickets 2026-02-12T18:08:27.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.099+0000 7fc52dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:27.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.099+0000 7fc52dffb640 1 -- 10.20.193.48:0/223469268 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc53400cda0 con 0x7fc54005e490 2026-02-12T18:08:27.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.099+0000 7fc52dffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:27.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.099+0000 7fc52dffb640 1 -- 10.20.193.48:0/223469268 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc5340138d0 con 0x7fc54005e490 2026-02-12T18:08:27.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.099+0000 7fc5475ee640 5 monclient: authenticate success, global_id 35066 2026-02-12T18:08:27.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.099+0000 7fc52dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.099+0000 7fc52f7fe640 4 set_mon_vals no callback set 2026-02-12T18:08:27.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.099+0000 7fc52dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:08:27.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.099+0000 7fc52dffb640 10 monclient: dump: 2026-02-12T18:08:27.110 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.110 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.110 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.110 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.110 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.110 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.110 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.110 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.110 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.110 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.110 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.110 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.110 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.110 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.110 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.110 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.099+0000 7fc5475ee640 10 monclient: _renew_subs 2026-02-12T18:08:27.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.099+0000 7fc5475ee640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:08:27.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.099+0000 7fc5475ee640 1 -- 10.20.193.48:0/223469268 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc540143aa0 con 0x7fc54005e490 2026-02-12T18:08:27.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.099+0000 7fc5475ee640 10 monclient: _renew_subs 2026-02-12T18:08:27.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.099+0000 7fc5475ee640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:08:27.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.099+0000 7fc5475ee640 1 -- 10.20.193.48:0/223469268 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc54008ad10 con 0x7fc54005e490 2026-02-12T18:08:27.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.100+0000 7fc5475ee640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:27.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.100+0000 7fc5475ee640 1 --2- 10.20.193.48:0/223469268 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc54008d970 0x7fc54013d240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.100+0000 7fc5475ee640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.100+0000 7fc5475ee640 1 -- 10.20.193.48:0/223469268 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fc540063180 con 0x7fc54008d970 2026-02-12T18:08:27.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.100+0000 7fc545363640 1 --2- 10.20.193.48:0/223469268 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc54008d970 0x7fc54013d240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.100+0000 7fc545363640 10 monclient: get_auth_request con 0x7fc54008d970 auth_method 0 2026-02-12T18:08:27.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.100+0000 7fc545363640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.100+0000 7fc545363640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.100+0000 7fc545363640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.100+0000 7fc545363640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.100+0000 7fc545363640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.100+0000 7fc545363640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.100+0000 7fc52dffb640 1 -- 10.20.193.48:0/223469268 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fc534013410 con 0x7fc54005e490 2026-02-12T18:08:27.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.100+0000 7fc545363640 10 monclient(hunting): handle_auth_done global_id 44194 payload 824 2026-02-12T18:08:27.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.100+0000 7fc545363640 1 -- 10.20.193.48:0/223469268 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc540097de0 con 0x7fc54008d970 2026-02-12T18:08:27.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.100+0000 7fc52dffb640 1 --2- 10.20.193.48:0/223469268 >> v2:10.20.193.111:6812/977811348 conn(0x7fc51003f800 0x7fc51005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.100+0000 7fc52dffb640 1 -- 10.20.193.48:0/223469268 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(117..117 src has 1..117) ==== 3897+0+0 (secure 0 0 0) 0x7fc534052be0 con 0x7fc54005e490 2026-02-12T18:08:27.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.100+0000 7fc545b64640 1 --2- 10.20.193.48:0/223469268 >> v2:10.20.193.111:6812/977811348 conn(0x7fc51003f800 0x7fc51005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.100+0000 7fc545b64640 10 monclient: get_auth_request con 0x7fc51003f800 auth_method 0 2026-02-12T18:08:27.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.102+0000 7fc545363640 1 -- 10.20.193.48:0/223469268 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc54008d970 msgr2=0x7fc54013d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.102+0000 7fc545363640 1 --2- 10.20.193.48:0/223469268 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc54008d970 0x7fc54013d240 secure :-1 s=READY pgs=23 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc530011800 tx=0x7fc530011cd0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.103+0000 7fc52dffb640 1 -- 10.20.193.48:0/223469268 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc53000c070 con 0x7fc54008d970 2026-02-12T18:08:27.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.103+0000 7fc52dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.103+0000 7fc52dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:08:27.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.103+0000 7fc52dffb640 10 monclient: dump: 2026-02-12T18:08:27.111 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.111 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.111 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.112 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.112 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.112 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.112 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.112 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.112 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.112 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.112 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.112 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.112 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.112 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.112 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.112 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.103+0000 7fc52dffb640 1 -- 10.20.193.48:0/223469268 <== mon.4 v2:10.20.193.48:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fc53000fa40 con 0x7fc54008d970 2026-02-12T18:08:27.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.103+0000 7fc52dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:27.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.103+0000 7fc52dffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:27.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.103+0000 7fc52dffb640 1 -- 10.20.193.48:0/223469268 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc54008d970 msgr2=0x7fc54013d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.103+0000 7fc52dffb640 1 --2- 10.20.193.48:0/223469268 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc54008d970 0x7fc54013d240 secure :-1 s=READY pgs=23 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc530011800 tx=0x7fc530011cd0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.103+0000 7fc52dffb640 1 -- 10.20.193.48:0/223469268 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc54008d970 msgr2=0x7fc54013d240 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:27.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.103+0000 7fc52dffb640 1 --2- 10.20.193.48:0/223469268 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc54008d970 0x7fc54013d240 secure :-1 s=CLOSED pgs=23 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc530011800 tx=0x7fc530011cd0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.103+0000 7fc545b64640 1 --2- 10.20.193.48:0/223469268 >> v2:10.20.193.111:6812/977811348 conn(0x7fc51003f800 0x7fc51005fcb0 secure :-1 s=READY pgs=183 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc53c02ff30 tx=0x7fc53c007f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.106+0000 7fc5475ee640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:08:27.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.106+0000 7fc5475ee640 1 --2- 10.20.193.48:0/223469268 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc54013d780 0x7fc540129370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.106+0000 7fc5475ee640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.106+0000 7fc5475ee640 1 -- 10.20.193.48:0/223469268 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fc540050410 con 0x7fc54013d780 2026-02-12T18:08:27.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.106+0000 7fc545363640 1 --2- 10.20.193.48:0/223469268 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc54013d780 0x7fc540129370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.106+0000 7fc545363640 10 monclient: get_auth_request con 0x7fc54013d780 auth_method 0 2026-02-12T18:08:27.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.106+0000 7fc545363640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.106+0000 7fc545363640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.106+0000 7fc545363640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.106+0000 7fc545363640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.106+0000 7fc545363640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.106+0000 7fc545363640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.106+0000 7fc545363640 10 monclient(hunting): handle_auth_done global_id 44203 payload 824 2026-02-12T18:08:27.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.106+0000 7fc545363640 1 -- 10.20.193.48:0/223469268 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc54005cd20 con 0x7fc54013d780 2026-02-12T18:08:27.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.109+0000 7fc545363640 1 -- 10.20.193.48:0/223469268 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc54013d780 msgr2=0x7fc540129370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.109+0000 7fc545363640 1 --2- 10.20.193.48:0/223469268 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc54013d780 0x7fc540129370 secure :-1 s=READY pgs=24 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc530011d10 tx=0x7fc530004770 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.109+0000 7fc52dffb640 1 -- 10.20.193.48:0/223469268 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc530003bd0 con 0x7fc54013d780 2026-02-12T18:08:27.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.109+0000 7fc52dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.109+0000 7fc52dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:08:27.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.109+0000 7fc52dffb640 10 monclient: dump: 2026-02-12T18:08:27.114 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.114 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.114 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.114 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.114 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.115 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.115 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.115 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.115 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.115 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.115 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.115 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.115 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.115 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.115 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.115 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.109+0000 7fc52dffb640 1 -- 10.20.193.48:0/223469268 <== mon.4 v2:10.20.193.48:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7fc530003d30 con 0x7fc54013d780 2026-02-12T18:08:27.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.109+0000 7fc52dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:08:27.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.109+0000 7fc52dffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:27.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.109+0000 7fc52dffb640 1 -- 10.20.193.48:0/223469268 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc54013d780 msgr2=0x7fc540129370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.109+0000 7fc52dffb640 1 --2- 10.20.193.48:0/223469268 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc54013d780 0x7fc540129370 secure :-1 s=READY pgs=24 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc530011d10 tx=0x7fc530004770 comp rx=0 tx=0).stop 2026-02-12T18:08:27.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.109+0000 7fc52dffb640 1 -- 10.20.193.48:0/223469268 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc54013d780 msgr2=0x7fc540129370 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:27.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.109+0000 7fc52dffb640 1 --2- 10.20.193.48:0/223469268 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc54013d780 0x7fc540129370 secure :-1 s=CLOSED pgs=24 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc530011d10 tx=0x7fc530004770 comp rx=0 tx=0).stop 2026-02-12T18:08:27.115 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:08:27.115 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:08:27.115 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:08:27.116 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:08:27.116 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 28, 2026-02-12T18:08:27.116 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 18994, 2026-02-12T18:08:27.116 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:08:27.116 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:08:27.116 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:08:27.116 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:08:27.116 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:08:27.116 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:08:27.116 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:08:27.116 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:08:27.116 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:08:27.116 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:08:27.116 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.116 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 4, 2026-02-12T18:08:27.116 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:27.116 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:08:27.116 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:08:27.116 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:27.116 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:27.116 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:27.116 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:27.116 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:27.116 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:27.117 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:27.117 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:27.117 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:27.117 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:27.117 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:27.117 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:27.117 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:27.117 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.117 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:08:27.117 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:08:27.117 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:27.117 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:27.117 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:27.117 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:27.117 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:27.117 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:27.117 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:27.117 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:27.117 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:27.117 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:27.117 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:27.117 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:27.117 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:27.117 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.117 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.118 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:08:27.118 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:08:27.118 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:08:27.118 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:08:27.118 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:08:27.118 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:08:27.118 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:27.118 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:27.118 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:08:27.118 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:08:27.118 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:08:27.118 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:08:27.118 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:08:27.118 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:08:27.118 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:08:27.118 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:27.118 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:08:27.118 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:27.118 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:27.118 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:27.118 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:27.118 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:27.118 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:27.118 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:27.118 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:27.119 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:27.119 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:27.119 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:27.119 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:27.119 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:27.119 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.119 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:08:27.119 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.119 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:08:27.119 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.119 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:27.119 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:27.119 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.119 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.119 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.119 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.119 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:08:27.119 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.119 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.119 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.119 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.119 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:08:27.119 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.119 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.119 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.120 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.120 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:08:27.120 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:08:27.120 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.120 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.120 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:08:27.120 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.120 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.120 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.120 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:27.120 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:27.120 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.120 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.120 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.120 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.120 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:08:27.120 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.120 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.120 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.120 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.120 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:08:27.120 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.120 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.120 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.120 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.120 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:08:27.121 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:08:27.121 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.121 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.121 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:08:27.121 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.121 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.121 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.121 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:27.121 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:27.121 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.121 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.121 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.121 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.121 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:08:27.121 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.121 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.121 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.121 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.121 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:08:27.121 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.121 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.121 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.121 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.121 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:08:27.121 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:08:27.122 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.122 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.122 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:08:27.122 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.122 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.122 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.122 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:08:27.122 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:08:27.122 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.122 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.122 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.122 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.122 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:08:27.122 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.122 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.122 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.122 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.122 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:08:27.122 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.122 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.122 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.122 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.122 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:08:27.122 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:08:27.122 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.122 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.123 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:08:27.123 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.123 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.123 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.123 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:08:27.123 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:08:27.123 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.123 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.123 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.123 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.123 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:08:27.123 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.123 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.123 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.123 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.123 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:08:27.123 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.123 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.123 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.123 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.123 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:08:27.123 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:08:27.123 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.123 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.123 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:27.124 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.124 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.124 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.124 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:27.124 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:27.124 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.124 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.124 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.124 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.124 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:08:27.124 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.124 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.124 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.124 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.124 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:08:27.124 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.124 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.124 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.124 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.124 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:08:27.124 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:08:27.124 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.124 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.124 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:08:27.124 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.124 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.125 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.125 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:27.125 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:27.125 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.125 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.125 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.125 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.125 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:08:27.125 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.125 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.125 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.125 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.125 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:08:27.125 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.125 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.125 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.125 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.125 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:08:27.125 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:08:27.125 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.125 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.125 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:27.125 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.125 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.125 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.126 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:27.126 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:27.126 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.126 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.126 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.126 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.126 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:08:27.126 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.126 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.126 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.126 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.126 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:08:27.126 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.126 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.126 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.126 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.126 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:08:27.126 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:08:27.126 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.126 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.126 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:08:27.126 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.126 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.126 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.126 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:08:27.127 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:08:27.127 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.127 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.127 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.127 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.127 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:08:27.127 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.127 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.127 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.127 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.127 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:08:27.127 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.127 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.127 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.127 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.127 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:08:27.127 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:08:27.127 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.127 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.127 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:08:27.127 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.127 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.127 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.127 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.127 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:08:27.127 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:08:27.128 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.128 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:27.128 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:27.128 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:27.128 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.128 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.128 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:08:27.128 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.128 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:27.128 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:27.128 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:27.128 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.128 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.128 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.128 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:08:27.128 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:08:27.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.109+0000 7fc5475ee640 1 -- 10.20.193.48:0/223469268 >> v2:10.20.193.111:6812/977811348 conn(0x7fc51003f800 msgr2=0x7fc51005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.109+0000 7fc5475ee640 1 --2- 10.20.193.48:0/223469268 >> v2:10.20.193.111:6812/977811348 conn(0x7fc51003f800 0x7fc51005fcb0 secure :-1 s=READY pgs=183 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc53c02ff30 tx=0x7fc53c007f90 comp rx=0 tx=0).stop 2026-02-12T18:08:27.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.109+0000 7fc5475ee640 10 monclient: shutdown 2026-02-12T18:08:27.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.109+0000 7fc5475ee640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:27.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.109+0000 7fc5475ee640 1 -- 10.20.193.48:0/223469268 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc54005e490 msgr2=0x7fc54008d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.109+0000 7fc5475ee640 1 --2- 10.20.193.48:0/223469268 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc54005e490 0x7fc54008d430 secure :-1 s=READY pgs=111 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc53400e770 tx=0x7fc53400ec40 comp rx=0 tx=0).stop 2026-02-12T18:08:27.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.109+0000 7fc545b64640 1 -- 10.20.193.48:0/223469268 reap_dead start 2026-02-12T18:08:27.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.109+0000 7fc545b64640 1 -- 10.20.193.48:0/223469268 reap_dead start 2026-02-12T18:08:27.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.109+0000 7fc5475ee640 1 -- 10.20.193.48:0/223469268 shutdown_connections 2026-02-12T18:08:27.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.109+0000 7fc5475ee640 1 -- 10.20.193.48:0/223469268 >> 10.20.193.48:0/223469268 conn(0x7fc5400548a0 msgr2=0x7fc540093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:27.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.109+0000 7fc5475ee640 1 -- 10.20.193.48:0/223469268 shutdown_connections 2026-02-12T18:08:27.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.109+0000 7fc5475ee640 1 -- 10.20.193.48:0/223469268 wait complete. 2026-02-12T18:08:27.130 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:08:27.130 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2026-02-12T18:08:27.130 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2026-02-12T18:08:27.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.194+0000 7fd146c8c640 10 monclient: get_monmap_and_config 2026-02-12T18:08:27.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.194+0000 7fd146c8c640 10 monclient: build_initial_monmap 2026-02-12T18:08:27.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.194+0000 7fd146c8c640 10 monclient: monmap: 2026-02-12T18:08:27.195 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:27.195 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.196 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:27.195251+0000 2026-02-12T18:08:27.196 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:27.195251+0000 2026-02-12T18:08:27.196 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:27.196 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.196 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:27.196 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:27.196 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:27.196 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:27.196 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:27.196 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:27.196 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:27.196 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:27.196 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:27.196 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:27.196 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:27.196 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.194+0000 7fd146c8c640 1 Processor -- start 2026-02-12T18:08:27.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.194+0000 7fd146c8c640 1 -- start start 2026-02-12T18:08:27.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.194+0000 7fd146c8c640 10 monclient: init 2026-02-12T18:08:27.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.194+0000 7fd146c8c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:27.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.194+0000 7fd146c8c640 10 monclient: _add_conns ranks=[2,6,1,9,5,3,0,8,10,4,7] 2026-02-12T18:08:27.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.194+0000 7fd146c8c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd14005c950 0x7fd14005cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.194+0000 7fd146c8c640 10 monclient(hunting): picked mon.noname-b con 0x7fd14005c950 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:08:27.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.194+0000 7fd146c8c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd14005e490 0x7fd14005d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.194+0000 7fd146c8c640 10 monclient(hunting): picked mon.noname-d con 0x7fd14005e490 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:08:27.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.194+0000 7fd146c8c640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fd14013db70 addr v1:10.20.193.111:6789/0 2026-02-12T18:08:27.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.194+0000 7fd146c8c640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd14004dc20 con 0x7fd14013db70 2026-02-12T18:08:27.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.194+0000 7fd146c8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.194+0000 7fd146c8c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fd14005ddd0 con 0x7fd14005c950 2026-02-12T18:08:27.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.194+0000 7fd146c8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.194+0000 7fd146c8c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fd14005d7a0 con 0x7fd14005e490 2026-02-12T18:08:27.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.194+0000 7fd146c8c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:27.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.194+0000 7fd146c8c640 10 monclient(hunting): authenticate will time out at 745.920926s 2026-02-12T18:08:27.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd137fff640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd14005e490 0x7fd14005d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd144a01640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd14005c950 0x7fd14005cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd137fff640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd14005e490 0x7fd14005d260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:59636/0 (socket says 10.20.193.48:59636) 2026-02-12T18:08:27.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd144a01640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd14005c950 0x7fd14005cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:52568/0 (socket says 10.20.193.48:52568) 2026-02-12T18:08:27.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd137fff640 1 -- 10.20.193.48:0/3666320948 learned_addr learned my addr 10.20.193.48:0/3666320948 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:27.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd137fff640 10 monclient(hunting): get_auth_request con 0x7fd14005e490 auth_method 0 2026-02-12T18:08:27.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd137fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd137fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd137fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd144a01640 10 monclient(hunting): get_auth_request con 0x7fd14005c950 auth_method 0 2026-02-12T18:08:27.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd144a01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd144a01640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd144a01640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd137fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd137fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd137fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd144a01640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd144a01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd144a01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd137fff640 10 monclient(hunting): handle_auth_done global_id 4974 payload 274 2026-02-12T18:08:27.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd137fff640 1 -- 10.20.193.48:0/3666320948 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd14005c950 msgr2=0x7fd14005cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:27.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd137fff640 1 --2- 10.20.193.48:0/3666320948 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd14005c950 0x7fd14005cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd137fff640 1 -- 10.20.193.48:0/3666320948 >> v1:10.20.193.111:6789/0 conn(0x7fd14013db70 legacy=0x7fd14013dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:27.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd137fff640 10 monclient: _finish_hunting 0 2026-02-12T18:08:27.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd137fff640 1 monclient: found mon.noname-d 2026-02-12T18:08:27.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd137fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:27.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd137fff640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:08:27.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.195+0000 7fd137fff640 1 -- 10.20.193.48:0/3666320948 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd140092990 con 0x7fd14005e490 2026-02-12T18:08:27.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.197+0000 7fd137fff640 1 -- 10.20.193.48:0/3666320948 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd14005e490 msgr2=0x7fd14005d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.197+0000 7fd137fff640 1 --2- 10.20.193.48:0/3666320948 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd14005e490 0x7fd14005d260 secure :-1 s=READY pgs=116 gs=2 cs=0 l=1 c_cookie=2290197314131171135 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd1280098d0 tx=0x7fd12802ee20 comp rx=0 tx=0).ready entity=mon.6 client_cookie=1fc86a52be57973f server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.197+0000 7fd1377fe640 1 -- 10.20.193.48:0/3666320948 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd128035340 con 0x7fd14005e490 2026-02-12T18:08:27.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.197+0000 7fd1377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.197+0000 7fd1377fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:08:27.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.197+0000 7fd1377fe640 10 monclient: dump: 2026-02-12T18:08:27.202 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.202 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.202 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.203 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.203 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.203 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.203 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.203 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.203 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.203 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.203 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.203 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.203 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.203 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.203 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.203 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.197+0000 7fd1377fe640 10 monclient: _finish_auth 0 2026-02-12T18:08:27.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.197+0000 7fd1377fe640 10 monclient: _check_auth_tickets 2026-02-12T18:08:27.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.197+0000 7fd1377fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:27.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.197+0000 7fd1377fe640 1 -- 10.20.193.48:0/3666320948 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1280354c0 con 0x7fd14005e490 2026-02-12T18:08:27.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.197+0000 7fd1377fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:27.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.197+0000 7fd1377fe640 1 -- 10.20.193.48:0/3666320948 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd128035af0 con 0x7fd14005e490 2026-02-12T18:08:27.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.197+0000 7fd146c8c640 5 monclient: authenticate success, global_id 4974 2026-02-12T18:08:27.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.197+0000 7fd146c8c640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:27.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.197+0000 7fd146c8c640 4 set_mon_vals no callback set 2026-02-12T18:08:27.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.197+0000 7fd1377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.197+0000 7fd1377fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:08:27.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.197+0000 7fd1377fe640 10 monclient: dump: 2026-02-12T18:08:27.204 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.204 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.204 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.204 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.204 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.204 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.204 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.204 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.204 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.204 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.204 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.204 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.204 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.204 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.204 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.204 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.198+0000 7fd146c8c640 10 monclient: shutdown 2026-02-12T18:08:27.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.198+0000 7fd146c8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:27.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.198+0000 7fd146c8c640 1 -- 10.20.193.48:0/3666320948 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd14005e490 msgr2=0x7fd14005d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.198+0000 7fd146c8c640 1 --2- 10.20.193.48:0/3666320948 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd14005e490 0x7fd14005d260 secure :-1 s=READY pgs=116 gs=2 cs=0 l=1 c_cookie=2290197314131171135 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd1280098d0 tx=0x7fd12802ee20 comp rx=0 tx=0).stop 2026-02-12T18:08:27.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.198+0000 7fd146c8c640 1 -- 10.20.193.48:0/3666320948 shutdown_connections 2026-02-12T18:08:27.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.198+0000 7fd146c8c640 1 --2- 10.20.193.48:0/3666320948 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd14005e490 0x7fd14005d260 unknown :-1 s=CLOSED pgs=116 gs=2 cs=0 l=1 c_cookie=2290197314131171135 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.198+0000 7fd146c8c640 1 --2- 10.20.193.48:0/3666320948 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd14005c950 0x7fd14005cd20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.198+0000 7fd146c8c640 1 -- 10.20.193.48:0/3666320948 >> 10.20.193.48:0/3666320948 conn(0x7fd1400548a0 msgr2=0x7fd140097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:27.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.198+0000 7fd146c8c640 1 -- 10.20.193.48:0/3666320948 shutdown_connections 2026-02-12T18:08:27.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.198+0000 7fd146c8c640 1 -- 10.20.193.48:0/3666320948 wait complete. 2026-02-12T18:08:27.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.198+0000 7fd146c8c640 10 monclient: build_initial_monmap 2026-02-12T18:08:27.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.198+0000 7fd146c8c640 10 monclient: monmap: 2026-02-12T18:08:27.205 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:27.205 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:27.205 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:27.205 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:27.205 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:27.205 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.205 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:27.205 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:27.205 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:27.205 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:27.205 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:27.205 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:27.205 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:27.206 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:27.206 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:27.206 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.198+0000 7fd146c8c640 1 Processor -- start 2026-02-12T18:08:27.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.198+0000 7fd146c8c640 1 -- start start 2026-02-12T18:08:27.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.198+0000 7fd146c8c640 10 monclient: init 2026-02-12T18:08:27.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd146c8c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:27.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd146c8c640 10 monclient: _add_conns ranks=[3,0,1,4,5,7,8,2,6] 2026-02-12T18:08:27.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd146c8c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd14005c950 0x7fd14008d330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd146c8c640 10 monclient(hunting): picked mon.noname-g con 0x7fd14005c950 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:08:27.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd146c8c640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd14005e490 0x7fd14008d870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd146c8c640 10 monclient(hunting): picked mon.noname-a con 0x7fd14005e490 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:08:27.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd146c8c640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd14013db70 0x7fd14013cc00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd146c8c640 10 monclient(hunting): picked mon.noname-f con 0x7fd14013db70 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:08:27.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd146c8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd146c8c640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fd14012d760 con 0x7fd14005e490 2026-02-12T18:08:27.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd146c8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd146c8c640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd14013e730 con 0x7fd14013db70 2026-02-12T18:08:27.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd146c8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd146c8c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd140142310 con 0x7fd14005c950 2026-02-12T18:08:27.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd146c8c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:27.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd146c8c640 10 monclient(hunting): authenticate will time out at 745.925182s 2026-02-12T18:08:27.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd137fff640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd14005e490 0x7fd14008d870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd137fff640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd14005e490 0x7fd14008d870 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:38102/0 (socket says 10.20.193.48:38102) 2026-02-12T18:08:27.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd137fff640 1 -- 10.20.193.48:0/1825060093 learned_addr learned my addr 10.20.193.48:0/1825060093 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:27.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd137fff640 10 monclient(hunting): get_auth_request con 0x7fd14005e490 auth_method 0 2026-02-12T18:08:27.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd137fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd137fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd137fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd137fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd137fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd137fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd144a01640 1 --2- 10.20.193.48:0/1825060093 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd14005c950 0x7fd14008d330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd144a01640 10 monclient(hunting): get_auth_request con 0x7fd14005c950 auth_method 0 2026-02-12T18:08:27.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd144a01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd144a01640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd144a01640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd144a01640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd144a01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd144a01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd137fff640 10 monclient(hunting): handle_auth_done global_id 5175 payload 824 2026-02-12T18:08:27.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd145202640 1 --2- 10.20.193.48:0/1825060093 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd14013db70 0x7fd14013cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd137fff640 1 -- 10.20.193.48:0/1825060093 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd14005c950 msgr2=0x7fd14008d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd137fff640 1 --2- 10.20.193.48:0/1825060093 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd14005c950 0x7fd14008d330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd137fff640 1 -- 10.20.193.48:0/1825060093 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd14013db70 msgr2=0x7fd14013cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd137fff640 1 --2- 10.20.193.48:0/1825060093 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd14013db70 0x7fd14013cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd137fff640 10 monclient: _finish_hunting 0 2026-02-12T18:08:27.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd137fff640 1 monclient: found mon.noname-a 2026-02-12T18:08:27.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd137fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:27.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd137fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:08:27.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd137fff640 1 -- 10.20.193.48:0/1825060093 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1280094f0 con 0x7fd14005e490 2026-02-12T18:08:27.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd145202640 10 monclient: get_auth_request con 0x7fd14013db70 auth_method 0 2026-02-12T18:08:27.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.199+0000 7fd145202640 1 --2- 10.20.193.48:0/1825060093 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd14013db70 0x7fd14013cc00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-12T18:08:27.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.201+0000 7fd137fff640 1 -- 10.20.193.48:0/1825060093 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd14005e490 msgr2=0x7fd14008d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.201+0000 7fd137fff640 1 --2- 10.20.193.48:0/1825060093 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd14005e490 0x7fd14008d870 secure :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd12802f330 tx=0x7fd128004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.201+0000 7fd1357fa640 1 -- 10.20.193.48:0/1825060093 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd128035e00 con 0x7fd14005e490 2026-02-12T18:08:27.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.201+0000 7fd1357fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.201+0000 7fd1357fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:08:27.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.201+0000 7fd1357fa640 10 monclient: dump: 2026-02-12T18:08:27.211 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.211 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.211 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.211 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.211 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.211 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.211 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.211 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.211 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.211 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.211 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.211 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.211 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.211 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.211 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.211 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.201+0000 7fd1357fa640 10 monclient: _finish_auth 0 2026-02-12T18:08:27.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.201+0000 7fd1357fa640 10 monclient: _check_auth_tickets 2026-02-12T18:08:27.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.201+0000 7fd1357fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:27.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.201+0000 7fd1357fa640 1 -- 10.20.193.48:0/1825060093 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd128037900 con 0x7fd14005e490 2026-02-12T18:08:27.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.201+0000 7fd1357fa640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:27.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.201+0000 7fd1357fa640 1 -- 10.20.193.48:0/1825060093 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd128040410 con 0x7fd14005e490 2026-02-12T18:08:27.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.201+0000 7fd1357fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.201+0000 7fd1357fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:08:27.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.201+0000 7fd136ffd640 4 set_mon_vals no callback set 2026-02-12T18:08:27.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.201+0000 7fd1357fa640 10 monclient: dump: 2026-02-12T18:08:27.212 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.212 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.212 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.212 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.212 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.212 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.212 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.212 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.212 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.212 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.212 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.212 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.212 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.212 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.212 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.212 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.201+0000 7fd146c8c640 5 monclient: authenticate success, global_id 5175 2026-02-12T18:08:27.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.201+0000 7fd146c8c640 10 monclient: _renew_subs 2026-02-12T18:08:27.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.201+0000 7fd146c8c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:08:27.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.201+0000 7fd146c8c640 1 -- 10.20.193.48:0/1825060093 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd140143c90 con 0x7fd14005e490 2026-02-12T18:08:27.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.201+0000 7fd146c8c640 10 monclient: _renew_subs 2026-02-12T18:08:27.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.201+0000 7fd146c8c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:08:27.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.201+0000 7fd146c8c640 1 -- 10.20.193.48:0/1825060093 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd14008ab10 con 0x7fd14005e490 2026-02-12T18:08:27.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.202+0000 7fd146c8c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:27.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.202+0000 7fd146c8c640 1 --2- 10.20.193.48:0/1825060093 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd14012c9d0 0x7fd14013d140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.202+0000 7fd146c8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.202+0000 7fd146c8c640 1 -- 10.20.193.48:0/1825060093 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fd14005f140 con 0x7fd14012c9d0 2026-02-12T18:08:27.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.202+0000 7fd144a01640 1 --2- 10.20.193.48:0/1825060093 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd14012c9d0 0x7fd14013d140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.202+0000 7fd144a01640 10 monclient: get_auth_request con 0x7fd14012c9d0 auth_method 0 2026-02-12T18:08:27.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.202+0000 7fd144a01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.202+0000 7fd144a01640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.202+0000 7fd144a01640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.202+0000 7fd144a01640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.202+0000 7fd144a01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.202+0000 7fd144a01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.202+0000 7fd1357fa640 1 -- 10.20.193.48:0/1825060093 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fd128046020 con 0x7fd14005e490 2026-02-12T18:08:27.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.202+0000 7fd144a01640 10 monclient(hunting): handle_auth_done global_id 4983 payload 824 2026-02-12T18:08:27.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.202+0000 7fd144a01640 1 -- 10.20.193.48:0/1825060093 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd140097de0 con 0x7fd14012c9d0 2026-02-12T18:08:27.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.203+0000 7fd1357fa640 1 --2- 10.20.193.48:0/1825060093 >> v2:10.20.193.111:6812/977811348 conn(0x7fd11003f800 0x7fd11005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.203+0000 7fd1357fa640 1 -- 10.20.193.48:0/1825060093 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 3897+0+0 (secure 0 0 0) 0x7fd128077d90 con 0x7fd14005e490 2026-02-12T18:08:27.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.203+0000 7fd145202640 1 --2- 10.20.193.48:0/1825060093 >> v2:10.20.193.111:6812/977811348 conn(0x7fd11003f800 0x7fd11005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.203+0000 7fd145202640 10 monclient: get_auth_request con 0x7fd11003f800 auth_method 0 2026-02-12T18:08:27.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.205+0000 7fd144a01640 1 -- 10.20.193.48:0/1825060093 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd14012c9d0 msgr2=0x7fd14013d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.205+0000 7fd144a01640 1 --2- 10.20.193.48:0/1825060093 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd14012c9d0 0x7fd14013d140 secure :-1 s=READY pgs=117 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd130009fd0 tx=0x7fd130011e40 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.205+0000 7fd1357fa640 1 -- 10.20.193.48:0/1825060093 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd13000fdf0 con 0x7fd14012c9d0 2026-02-12T18:08:27.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.205+0000 7fd1357fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.205+0000 7fd1357fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:08:27.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.205+0000 7fd1357fa640 10 monclient: dump: 2026-02-12T18:08:27.214 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.214 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.214 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.214 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.214 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.214 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.214 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.214 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.214 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.214 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.214 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.214 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.214 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.214 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.214 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.214 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.205+0000 7fd1357fa640 1 -- 10.20.193.48:0/1825060093 <== mon.6 v2:10.20.193.48:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fd13000f930 con 0x7fd14012c9d0 2026-02-12T18:08:27.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.205+0000 7fd1357fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:27.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.205+0000 7fd1357fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:27.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.205+0000 7fd1357fa640 1 -- 10.20.193.48:0/1825060093 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd14012c9d0 msgr2=0x7fd14013d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.205+0000 7fd1357fa640 1 --2- 10.20.193.48:0/1825060093 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd14012c9d0 0x7fd14013d140 secure :-1 s=READY pgs=117 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd130009fd0 tx=0x7fd130011e40 comp rx=0 tx=0).stop 2026-02-12T18:08:27.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.205+0000 7fd1357fa640 1 -- 10.20.193.48:0/1825060093 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd14012c9d0 msgr2=0x7fd14013d140 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:27.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.205+0000 7fd1357fa640 1 --2- 10.20.193.48:0/1825060093 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd14012c9d0 0x7fd14013d140 secure :-1 s=CLOSED pgs=117 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd130009fd0 tx=0x7fd130011e40 comp rx=0 tx=0).stop 2026-02-12T18:08:27.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.205+0000 7fd145202640 1 --2- 10.20.193.48:0/1825060093 >> v2:10.20.193.111:6812/977811348 conn(0x7fd11003f800 0x7fd11005fcb0 secure :-1 s=READY pgs=184 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd140090c00 tx=0x7fd13c00a040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.208+0000 7fd146c8c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:08:27.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.208+0000 7fd146c8c640 1 --2- 10.20.193.48:0/1825060093 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd14013d680 0x7fd14008ec20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.208+0000 7fd146c8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.208+0000 7fd146c8c640 1 -- 10.20.193.48:0/1825060093 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fd14005fd90 con 0x7fd14013d680 2026-02-12T18:08:27.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.209+0000 7fd144a01640 1 --2- 10.20.193.48:0/1825060093 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd14013d680 0x7fd14008ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.209+0000 7fd144a01640 10 monclient: get_auth_request con 0x7fd14013d680 auth_method 0 2026-02-12T18:08:27.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.209+0000 7fd144a01640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.209+0000 7fd144a01640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.209+0000 7fd144a01640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.209+0000 7fd144a01640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.209+0000 7fd144a01640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.209+0000 7fd144a01640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.209+0000 7fd144a01640 10 monclient(hunting): handle_auth_done global_id 4992 payload 824 2026-02-12T18:08:27.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.209+0000 7fd144a01640 1 -- 10.20.193.48:0/1825060093 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd14005cd20 con 0x7fd14013d680 2026-02-12T18:08:27.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.211+0000 7fd144a01640 1 -- 10.20.193.48:0/1825060093 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd14013d680 msgr2=0x7fd14008ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.211+0000 7fd144a01640 1 --2- 10.20.193.48:0/1825060093 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd14013d680 0x7fd14008ec20 secure :-1 s=READY pgs=118 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd130018000 tx=0x7fd130004770 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.211+0000 7fd1357fa640 1 -- 10.20.193.48:0/1825060093 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd13001eb20 con 0x7fd14013d680 2026-02-12T18:08:27.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.211+0000 7fd1357fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.211+0000 7fd1357fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:08:27.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.211+0000 7fd1357fa640 10 monclient: dump: 2026-02-12T18:08:27.216 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.216 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.217 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.217 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.217 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.217 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.217 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.217 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.217 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.217 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.217 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.217 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.217 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.217 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.217 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.217 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.211+0000 7fd1357fa640 1 -- 10.20.193.48:0/1825060093 <== mon.6 v2:10.20.193.48:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10015 (secure 0 0 0) 0x7fd13001ec80 con 0x7fd14013d680 2026-02-12T18:08:27.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.211+0000 7fd1357fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:08:27.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.211+0000 7fd1357fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:27.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.211+0000 7fd1357fa640 1 -- 10.20.193.48:0/1825060093 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd14013d680 msgr2=0x7fd14008ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.211+0000 7fd1357fa640 1 --2- 10.20.193.48:0/1825060093 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd14013d680 0x7fd14008ec20 secure :-1 s=READY pgs=118 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd130018000 tx=0x7fd130004770 comp rx=0 tx=0).stop 2026-02-12T18:08:27.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.211+0000 7fd1357fa640 1 -- 10.20.193.48:0/1825060093 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd14013d680 msgr2=0x7fd14008ec20 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:27.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.211+0000 7fd1357fa640 1 --2- 10.20.193.48:0/1825060093 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd14013d680 0x7fd14008ec20 secure :-1 s=CLOSED pgs=118 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd130018000 tx=0x7fd130004770 comp rx=0 tx=0).stop 2026-02-12T18:08:27.218 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:08:27.218 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:27.218 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:27.218 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:08:27.218 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 28, 2026-02-12T18:08:27.218 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 162038, 2026-02-12T18:08:27.218 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:08:27.218 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:08:27.218 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:08:27.218 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:08:27.218 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:08:27.218 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:08:27.218 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:08:27.218 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:08:27.218 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:08:27.218 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:08:27.218 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.218 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 4, 2026-02-12T18:08:27.218 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:27.218 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:08:27.219 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:08:27.219 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:27.219 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:27.219 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:27.219 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:27.219 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:27.219 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:27.219 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:27.219 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:27.219 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:27.219 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:27.219 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:27.219 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:27.219 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:27.219 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.219 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:08:27.219 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:08:27.219 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:27.219 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:27.219 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:27.219 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:27.219 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:27.220 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:27.220 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:27.220 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:27.220 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:27.220 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:27.220 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:27.220 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:27.220 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:27.220 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.220 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.220 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:08:27.220 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:08:27.220 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:08:27.220 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:08:27.220 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:08:27.220 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:08:27.220 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:27.220 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:27.220 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:08:27.220 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:08:27.220 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:08:27.220 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:08:27.220 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:08:27.221 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:08:27.221 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:08:27.221 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:27.221 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:08:27.221 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:27.221 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:27.221 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:27.221 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:27.221 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:27.221 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:27.221 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:27.221 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:27.221 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:27.221 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:27.221 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:27.221 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:27.221 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:27.221 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.221 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:08:27.221 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.221 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:08:27.221 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.221 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:27.222 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:27.222 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.222 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.222 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.222 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.222 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:08:27.222 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.222 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.222 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.222 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.222 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:08:27.222 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.222 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.222 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.222 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.222 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:08:27.222 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:08:27.222 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.222 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.222 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:08:27.222 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.222 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.222 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.222 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:27.223 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:27.223 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.223 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.223 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.223 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.223 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:08:27.223 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.223 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.223 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.223 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.223 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:08:27.223 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.223 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.223 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.223 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.223 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:08:27.223 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:08:27.223 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.223 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.223 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:08:27.223 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.223 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.223 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.224 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:27.224 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:27.224 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.224 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.224 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.224 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.224 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:08:27.224 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.224 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.224 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.224 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.224 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:08:27.224 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.224 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.224 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.224 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.224 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:08:27.224 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:08:27.224 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.224 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.224 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:08:27.224 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.224 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.225 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.225 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:08:27.225 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:08:27.225 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.225 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.225 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.225 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.225 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:08:27.225 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.225 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.225 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.225 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.225 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:08:27.225 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.225 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.225 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.225 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.225 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:08:27.225 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:08:27.225 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.225 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.225 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:08:27.225 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.225 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.226 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.226 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:08:27.226 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:08:27.226 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.226 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.226 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.226 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.226 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:08:27.226 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.226 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.226 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.226 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.226 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:08:27.226 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.226 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.226 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.226 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.226 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:08:27.226 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:08:27.226 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.226 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.226 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:27.226 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.227 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.227 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.227 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:27.227 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:27.227 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.227 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.227 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.227 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.227 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:08:27.227 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.227 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.227 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.227 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.227 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:08:27.227 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.227 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.227 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.227 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.227 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:08:27.227 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:08:27.227 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.227 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.227 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:08:27.227 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.227 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.228 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.228 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:27.228 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:27.228 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.228 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.228 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.228 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.228 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:08:27.228 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.228 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.228 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.228 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.228 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:08:27.228 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.228 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.228 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.228 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.228 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:08:27.228 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:08:27.228 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.228 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.228 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:27.228 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.228 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.228 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.229 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:27.229 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:27.229 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.229 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.229 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.229 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.229 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:08:27.229 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.229 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.229 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.229 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.229 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:08:27.229 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.229 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.229 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.229 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.229 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:08:27.229 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:08:27.229 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.229 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.229 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:08:27.229 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.229 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.230 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.230 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:08:27.230 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:08:27.230 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.230 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.230 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.230 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.230 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:08:27.230 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.230 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.230 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.230 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.230 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:08:27.230 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.230 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.230 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.230 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.230 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:08:27.230 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:08:27.230 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.230 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.230 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:08:27.230 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.230 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.230 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.230 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.231 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:08:27.231 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:08:27.231 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.231 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:27.231 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:27.231 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:27.231 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.231 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.231 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:08:27.231 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.231 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:27.231 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:27.231 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:08:27.231 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.231 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.231 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.231 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:08:27.231 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:08:27.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.211+0000 7fd146c8c640 1 -- 10.20.193.48:0/1825060093 >> v2:10.20.193.111:6812/977811348 conn(0x7fd11003f800 msgr2=0x7fd11005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.211+0000 7fd146c8c640 1 --2- 10.20.193.48:0/1825060093 >> v2:10.20.193.111:6812/977811348 conn(0x7fd11003f800 0x7fd11005fcb0 secure :-1 s=READY pgs=184 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd140090c00 tx=0x7fd13c00a040 comp rx=0 tx=0).stop 2026-02-12T18:08:27.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.211+0000 7fd146c8c640 10 monclient: shutdown 2026-02-12T18:08:27.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.211+0000 7fd146c8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:27.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.211+0000 7fd146c8c640 1 -- 10.20.193.48:0/1825060093 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd14005e490 msgr2=0x7fd14008d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.211+0000 7fd146c8c640 1 --2- 10.20.193.48:0/1825060093 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd14005e490 0x7fd14008d870 secure :-1 s=READY pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd12802f330 tx=0x7fd128004770 comp rx=0 tx=0).stop 2026-02-12T18:08:27.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.211+0000 7fd145202640 1 -- 10.20.193.48:0/1825060093 reap_dead start 2026-02-12T18:08:27.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.212+0000 7fd146c8c640 1 -- 10.20.193.48:0/1825060093 shutdown_connections 2026-02-12T18:08:27.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.212+0000 7fd146c8c640 1 --2- 10.20.193.48:0/1825060093 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd14005e490 0x7fd14008d870 unknown :-1 s=CLOSED pgs=220 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.212+0000 7fd146c8c640 1 -- 10.20.193.48:0/1825060093 >> 10.20.193.48:0/1825060093 conn(0x7fd1400548a0 msgr2=0x7fd140093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:27.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.212+0000 7fd146c8c640 1 -- 10.20.193.48:0/1825060093 shutdown_connections 2026-02-12T18:08:27.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.212+0000 7fd146c8c640 1 -- 10.20.193.48:0/1825060093 wait complete. 2026-02-12T18:08:27.233 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:08:27.233 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2026-02-12T18:08:27.233 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2026-02-12T18:08:27.300 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68bdc12640 10 monclient: get_monmap_and_config 2026-02-12T18:08:27.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68bdc12640 10 monclient: build_initial_monmap 2026-02-12T18:08:27.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68bdc12640 10 monclient: monmap: 2026-02-12T18:08:27.317 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:27.317 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.317 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:27.300095+0000 2026-02-12T18:08:27.317 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:27.300095+0000 2026-02-12T18:08:27.317 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:27.317 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.317 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:27.317 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:27.317 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:27.317 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:27.318 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:27.318 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:27.318 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:27.318 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:27.318 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:27.318 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:27.318 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:27.318 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68bdc12640 1 Processor -- start 2026-02-12T18:08:27.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68bdc12640 1 -- start start 2026-02-12T18:08:27.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68bdc12640 10 monclient: init 2026-02-12T18:08:27.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68bdc12640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:27.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68bdc12640 10 monclient: _add_conns ranks=[6,3,1,7,5,8,2,9,10,0,4] 2026-02-12T18:08:27.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68bdc12640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f68b805c950 0x7f68b805cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68bdc12640 10 monclient(hunting): picked mon.noname-d con 0x7f68b805c950 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:08:27.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68bdc12640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f68b805e490 0x7f68b805d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68bdc12640 10 monclient(hunting): picked mon.noname-g con 0x7f68b805e490 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:08:27.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68bdc12640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f68b813db70 addr v1:10.20.193.111:6789/0 2026-02-12T18:08:27.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68bdc12640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68b804dc20 con 0x7f68b813db70 2026-02-12T18:08:27.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68bdc12640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68bdc12640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f68b805ddd0 con 0x7f68b805e490 2026-02-12T18:08:27.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68bdc12640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68bdc12640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f68b805d7a0 con 0x7f68b805c950 2026-02-12T18:08:27.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68bdc12640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:27.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68bdc12640 10 monclient(hunting): authenticate will time out at 746.025791s 2026-02-12T18:08:27.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68b77fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f68b805c950 0x7f68b805cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68b77fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f68b805c950 0x7f68b805cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:59654/0 (socket says 10.20.193.48:59654) 2026-02-12T18:08:27.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68b77fe640 1 -- 10.20.193.48:0/1298456099 learned_addr learned my addr 10.20.193.48:0/1298456099 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:27.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68b77fe640 10 monclient(hunting): get_auth_request con 0x7f68b805c950 auth_method 0 2026-02-12T18:08:27.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68b77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68b77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68b77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.299+0000 7f68b77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.300+0000 7f68b77fe640 10 monclient(hunting): handle_auth_done global_id 5001 payload 274 2026-02-12T18:08:27.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.300+0000 7f68b77fe640 1 -- 10.20.193.48:0/1298456099 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f68b805e490 msgr2=0x7f68b805d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:27.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.300+0000 7f68b77fe640 1 --2- 10.20.193.48:0/1298456099 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f68b805e490 0x7f68b805d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.300+0000 7f68b77fe640 1 -- 10.20.193.48:0/1298456099 >> v1:10.20.193.111:6789/0 conn(0x7f68b813db70 legacy=0x7f68b813dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:27.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.300+0000 7f68b77fe640 10 monclient: _finish_hunting 0 2026-02-12T18:08:27.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.300+0000 7f68b77fe640 1 monclient: found mon.noname-d 2026-02-12T18:08:27.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.300+0000 7f68b77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:27.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.300+0000 7f68b77fe640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:08:27.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.300+0000 7f68b77fe640 1 -- 10.20.193.48:0/1298456099 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b8092990 con 0x7f68b805c950 2026-02-12T18:08:27.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.302+0000 7f68b77fe640 1 -- 10.20.193.48:0/1298456099 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f68b805c950 msgr2=0x7f68b805cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.302+0000 7f68b77fe640 1 --2- 10.20.193.48:0/1298456099 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f68b805c950 0x7f68b805cd20 secure :-1 s=READY pgs=119 gs=2 cs=0 l=1 c_cookie=12397084892749038256 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68a40098d0 tx=0x7f68a402ee20 comp rx=0 tx=0).ready entity=mon.6 client_cookie=ac0b4b0702ab02b0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.302+0000 7f68b67fc640 1 -- 10.20.193.48:0/1298456099 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f68a402fb80 con 0x7f68b805c950 2026-02-12T18:08:27.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.302+0000 7f68b67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.302+0000 7f68b67fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:08:27.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.302+0000 7f68b67fc640 10 monclient: dump: 2026-02-12T18:08:27.328 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.328 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.328 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.328 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.328 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.328 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.329 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.329 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.329 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.329 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.329 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.329 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.329 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.329 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.329 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.329 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.302+0000 7f68b67fc640 10 monclient: _finish_auth 0 2026-02-12T18:08:27.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.302+0000 7f68b67fc640 10 monclient: _check_auth_tickets 2026-02-12T18:08:27.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.302+0000 7f68b67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:27.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.302+0000 7f68b67fc640 1 -- 10.20.193.48:0/1298456099 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a402fd00 con 0x7f68b805c950 2026-02-12T18:08:27.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.302+0000 7f68b67fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:27.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.302+0000 7f68b67fc640 1 -- 10.20.193.48:0/1298456099 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f68a402fe70 con 0x7f68b805c950 2026-02-12T18:08:27.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.302+0000 7f68b67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.302+0000 7f68b67fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:08:27.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.302+0000 7f68b67fc640 10 monclient: dump: 2026-02-12T18:08:27.330 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.330 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.330 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.330 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.330 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.330 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.330 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.330 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.330 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.330 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.330 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.330 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.330 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.330 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.330 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.330 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.302+0000 7f68bdc12640 5 monclient: authenticate success, global_id 5001 2026-02-12T18:08:27.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.302+0000 7f68bdc12640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:27.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.302+0000 7f68bdc12640 4 set_mon_vals no callback set 2026-02-12T18:08:27.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.303+0000 7f68bdc12640 10 monclient: shutdown 2026-02-12T18:08:27.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.303+0000 7f68bdc12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:27.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.303+0000 7f68bdc12640 1 -- 10.20.193.48:0/1298456099 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f68b805c950 msgr2=0x7f68b805cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.303+0000 7f68bdc12640 1 --2- 10.20.193.48:0/1298456099 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f68b805c950 0x7f68b805cd20 secure :-1 s=READY pgs=119 gs=2 cs=0 l=1 c_cookie=12397084892749038256 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68a40098d0 tx=0x7f68a402ee20 comp rx=0 tx=0).stop 2026-02-12T18:08:27.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.303+0000 7f68bdc12640 1 -- 10.20.193.48:0/1298456099 shutdown_connections 2026-02-12T18:08:27.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.303+0000 7f68bdc12640 1 --2- 10.20.193.48:0/1298456099 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f68b805e490 0x7f68b805d260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.303+0000 7f68bdc12640 1 --2- 10.20.193.48:0/1298456099 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f68b805c950 0x7f68b805cd20 unknown :-1 s=CLOSED pgs=119 gs=2 cs=0 l=1 c_cookie=12397084892749038256 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.303+0000 7f68bdc12640 1 -- 10.20.193.48:0/1298456099 >> 10.20.193.48:0/1298456099 conn(0x7f68b80548a0 msgr2=0x7f68b8097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:27.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.303+0000 7f68bdc12640 1 -- 10.20.193.48:0/1298456099 shutdown_connections 2026-02-12T18:08:27.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.303+0000 7f68bdc12640 1 -- 10.20.193.48:0/1298456099 wait complete. 2026-02-12T18:08:27.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.303+0000 7f68bdc12640 10 monclient: build_initial_monmap 2026-02-12T18:08:27.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.303+0000 7f68bdc12640 10 monclient: monmap: 2026-02-12T18:08:27.331 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:27.331 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:27.331 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:27.331 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:27.332 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:27.332 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.332 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:27.332 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:27.332 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:27.332 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:27.332 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:27.332 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:27.332 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:27.332 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:27.332 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:27.332 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.303+0000 7f68bdc12640 1 Processor -- start 2026-02-12T18:08:27.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.303+0000 7f68bdc12640 1 -- start start 2026-02-12T18:08:27.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.303+0000 7f68bdc12640 10 monclient: init 2026-02-12T18:08:27.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68bdc12640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:27.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68bdc12640 10 monclient: _add_conns ranks=[1,8,5,6,7,4,0,3,2] 2026-02-12T18:08:27.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68bdc12640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f68b805c950 0x7f68b81db7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68bdc12640 10 monclient(hunting): picked mon.noname-f con 0x7f68b805c950 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:08:27.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68bdc12640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f68b805e490 0x7f68b81dbd10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68bdc12640 10 monclient(hunting): picked mon.noname-e con 0x7f68b805e490 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:08:27.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68bdc12640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f68b813db70 0x7f68b808a980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68bdc12640 10 monclient(hunting): picked mon.noname-h con 0x7f68b813db70 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:08:27.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68bdc12640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68bdc12640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f68b813d7d0 con 0x7f68b805c950 2026-02-12T18:08:27.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68bdc12640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68bdc12640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f68b8143e20 con 0x7f68b813db70 2026-02-12T18:08:27.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68bdc12640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68bdc12640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f68b81422a0 con 0x7f68b805e490 2026-02-12T18:08:27.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68bdc12640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:27.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68bdc12640 10 monclient(hunting): authenticate will time out at 746.030203s 2026-02-12T18:08:27.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b6ffd640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f68b805e490 0x7f68b81dbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b6ffd640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f68b805e490 0x7f68b81dbd10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:51096/0 (socket says 10.20.193.48:51096) 2026-02-12T18:08:27.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b6ffd640 1 -- 10.20.193.48:0/1089566698 learned_addr learned my addr 10.20.193.48:0/1089566698 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:27.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b6ffd640 10 monclient(hunting): get_auth_request con 0x7f68b805e490 auth_method 0 2026-02-12T18:08:27.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b77fe640 1 --2- 10.20.193.48:0/1089566698 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f68b805c950 0x7f68b81db7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b77fe640 10 monclient(hunting): get_auth_request con 0x7f68b805c950 auth_method 0 2026-02-12T18:08:27.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b7fff640 1 --2- 10.20.193.48:0/1089566698 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f68b813db70 0x7f68b808a980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b7fff640 10 monclient(hunting): get_auth_request con 0x7f68b813db70 auth_method 0 2026-02-12T18:08:27.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b6ffd640 10 monclient(hunting): handle_auth_done global_id 5084 payload 824 2026-02-12T18:08:27.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b6ffd640 1 -- 10.20.193.48:0/1089566698 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f68b813db70 msgr2=0x7f68b808a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b6ffd640 1 --2- 10.20.193.48:0/1089566698 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f68b813db70 0x7f68b808a980 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b6ffd640 1 -- 10.20.193.48:0/1089566698 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f68b805c950 msgr2=0x7f68b81db7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b6ffd640 1 --2- 10.20.193.48:0/1089566698 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f68b805c950 0x7f68b81db7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b6ffd640 10 monclient: _finish_hunting 0 2026-02-12T18:08:27.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b6ffd640 1 monclient: found mon.noname-e 2026-02-12T18:08:27.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:27.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b6ffd640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:08:27.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.304+0000 7f68b6ffd640 1 -- 10.20.193.48:0/1089566698 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a40094f0 con 0x7f68b805e490 2026-02-12T18:08:27.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.306+0000 7f68b6ffd640 1 -- 10.20.193.48:0/1089566698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f68b805e490 msgr2=0x7f68b81dbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.306+0000 7f68b6ffd640 1 --2- 10.20.193.48:0/1089566698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f68b805e490 0x7f68b81dbd10 secure :-1 s=READY pgs=119 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68a800b520 tx=0x7f68a800b9f0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.306+0000 7f6893fff640 1 -- 10.20.193.48:0/1089566698 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f68a8004490 con 0x7f68b805e490 2026-02-12T18:08:27.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.306+0000 7f6893fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.306+0000 7f6893fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:08:27.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.306+0000 7f6893fff640 10 monclient: dump: 2026-02-12T18:08:27.335 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.335 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.336 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.336 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.336 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.336 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.336 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.336 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.336 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.336 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.336 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.336 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.336 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.336 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.336 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.336 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.306+0000 7f6893fff640 10 monclient: _finish_auth 0 2026-02-12T18:08:27.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.306+0000 7f6893fff640 10 monclient: _check_auth_tickets 2026-02-12T18:08:27.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.306+0000 7f6893fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:27.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.306+0000 7f6893fff640 1 -- 10.20.193.48:0/1089566698 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68a8002b60 con 0x7f68b805e490 2026-02-12T18:08:27.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.306+0000 7f6893fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:27.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.306+0000 7f6893fff640 1 -- 10.20.193.48:0/1089566698 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f68a8002cd0 con 0x7f68b805e490 2026-02-12T18:08:27.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.306+0000 7f6893fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.306+0000 7f6893fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:08:27.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.306+0000 7f68b5ffb640 4 set_mon_vals no callback set 2026-02-12T18:08:27.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.306+0000 7f6893fff640 10 monclient: dump: 2026-02-12T18:08:27.337 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.337 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.337 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.337 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.337 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.337 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.337 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.337 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.337 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.337 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.337 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.337 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.337 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.337 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.338 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.338 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.306+0000 7f68bdc12640 5 monclient: authenticate success, global_id 5084 2026-02-12T18:08:27.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.306+0000 7f68bdc12640 10 monclient: _renew_subs 2026-02-12T18:08:27.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.306+0000 7f68bdc12640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:08:27.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.306+0000 7f68bdc12640 1 -- 10.20.193.48:0/1089566698 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68b808c270 con 0x7f68b805e490 2026-02-12T18:08:27.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.306+0000 7f68bdc12640 10 monclient: _renew_subs 2026-02-12T18:08:27.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.306+0000 7f68bdc12640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:08:27.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.306+0000 7f68bdc12640 1 -- 10.20.193.48:0/1089566698 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f68b808cdd0 con 0x7f68b805e490 2026-02-12T18:08:27.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.307+0000 7f68bdc12640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:27.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.307+0000 7f68bdc12640 1 --2- 10.20.193.48:0/1089566698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f68b812eb80 0x7f68b808aec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.307+0000 7f68bdc12640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.307+0000 7f68bdc12640 1 -- 10.20.193.48:0/1089566698 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f68b8063180 con 0x7f68b812eb80 2026-02-12T18:08:27.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.307+0000 7f6893fff640 1 -- 10.20.193.48:0/1089566698 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f68a80026a0 con 0x7f68b805e490 2026-02-12T18:08:27.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.307+0000 7f68b77fe640 1 --2- 10.20.193.48:0/1089566698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f68b812eb80 0x7f68b808aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.307+0000 7f68b77fe640 10 monclient: get_auth_request con 0x7f68b812eb80 auth_method 0 2026-02-12T18:08:27.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.307+0000 7f68b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.307+0000 7f68b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.307+0000 7f68b77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.307+0000 7f68b77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.307+0000 7f68b77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.307+0000 7f68b77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.307+0000 7f6893fff640 1 --2- 10.20.193.48:0/1089566698 >> v2:10.20.193.111:6812/977811348 conn(0x7f688803f800 0x7f688805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.307+0000 7f68b77fe640 10 monclient(hunting): handle_auth_done global_id 5093 payload 824 2026-02-12T18:08:27.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.307+0000 7f68b77fe640 1 -- 10.20.193.48:0/1089566698 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f68b8097de0 con 0x7f68b812eb80 2026-02-12T18:08:27.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.307+0000 7f6893fff640 1 -- 10.20.193.48:0/1089566698 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(117..117 src has 1..117) ==== 3897+0+0 (secure 0 0 0) 0x7f68a8052c30 con 0x7f68b805e490 2026-02-12T18:08:27.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.307+0000 7f68b7fff640 1 --2- 10.20.193.48:0/1089566698 >> v2:10.20.193.111:6812/977811348 conn(0x7f688803f800 0x7f688805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.308+0000 7f68b7fff640 10 monclient: get_auth_request con 0x7f688803f800 auth_method 0 2026-02-12T18:08:27.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.310+0000 7f68b77fe640 1 -- 10.20.193.48:0/1089566698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f68b812eb80 msgr2=0x7f68b808aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.310+0000 7f68b77fe640 1 --2- 10.20.193.48:0/1089566698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f68b812eb80 0x7f68b808aec0 secure :-1 s=READY pgs=120 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68a40098d0 tx=0x7f68a40047e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.310+0000 7f6893fff640 1 -- 10.20.193.48:0/1089566698 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f68a4042d60 con 0x7f68b812eb80 2026-02-12T18:08:27.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.310+0000 7f6893fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.310+0000 7f6893fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:08:27.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.310+0000 7f6893fff640 10 monclient: dump: 2026-02-12T18:08:27.339 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.339 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.340 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.340 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.340 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.340 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.340 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.340 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.340 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.340 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.340 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.340 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.340 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.340 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.340 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.340 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.310+0000 7f6893fff640 1 -- 10.20.193.48:0/1089566698 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f68a40428a0 con 0x7f68b812eb80 2026-02-12T18:08:27.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.310+0000 7f6893fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:27.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.310+0000 7f6893fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:27.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.310+0000 7f6893fff640 1 -- 10.20.193.48:0/1089566698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f68b812eb80 msgr2=0x7f68b808aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.310+0000 7f6893fff640 1 --2- 10.20.193.48:0/1089566698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f68b812eb80 0x7f68b808aec0 secure :-1 s=READY pgs=120 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68a40098d0 tx=0x7f68a40047e0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.310+0000 7f6893fff640 1 -- 10.20.193.48:0/1089566698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f68b812eb80 msgr2=0x7f68b808aec0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:27.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.310+0000 7f6893fff640 1 --2- 10.20.193.48:0/1089566698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f68b812eb80 0x7f68b808aec0 secure :-1 s=CLOSED pgs=120 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68a40098d0 tx=0x7f68a40047e0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.310+0000 7f68b7fff640 1 --2- 10.20.193.48:0/1089566698 >> v2:10.20.193.111:6812/977811348 conn(0x7f688803f800 0x7f688805fcb0 secure :-1 s=READY pgs=185 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68b808c510 tx=0x7f68ac00a040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.313+0000 7f68bdc12640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:08:27.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.313+0000 7f68bdc12640 1 --2- 10.20.193.48:0/1089566698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f68b808b400 0x7f68b808b7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.313+0000 7f68bdc12640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.313+0000 7f68bdc12640 1 -- 10.20.193.48:0/1089566698 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f68b8050410 con 0x7f68b808b400 2026-02-12T18:08:27.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.313+0000 7f68b77fe640 1 --2- 10.20.193.48:0/1089566698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f68b808b400 0x7f68b808b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.313+0000 7f68b77fe640 10 monclient: get_auth_request con 0x7f68b808b400 auth_method 0 2026-02-12T18:08:27.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.313+0000 7f68b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.313+0000 7f68b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.313+0000 7f68b77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.313+0000 7f68b77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.313+0000 7f68b77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.313+0000 7f68b77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.313+0000 7f68b77fe640 10 monclient(hunting): handle_auth_done global_id 5102 payload 824 2026-02-12T18:08:27.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.313+0000 7f68b77fe640 1 -- 10.20.193.48:0/1089566698 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f68b805cd20 con 0x7f68b808b400 2026-02-12T18:08:27.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.315+0000 7f68b77fe640 1 -- 10.20.193.48:0/1089566698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f68b808b400 msgr2=0x7f68b808b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.315+0000 7f68b77fe640 1 --2- 10.20.193.48:0/1089566698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f68b808b400 0x7f68b808b7d0 secure :-1 s=READY pgs=121 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68a4004740 tx=0x7f68a4008030 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.316+0000 7f6893fff640 1 -- 10.20.193.48:0/1089566698 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f68a4052040 con 0x7f68b808b400 2026-02-12T18:08:27.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.316+0000 7f6893fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.316+0000 7f6893fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:08:27.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.316+0000 7f6893fff640 10 monclient: dump: 2026-02-12T18:08:27.342 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.342 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.342 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.342 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.342 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.342 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.342 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.342 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.342 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.342 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.342 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.342 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.343 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.343 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.343 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.343 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.316+0000 7f6893fff640 1 -- 10.20.193.48:0/1089566698 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10015 (secure 0 0 0) 0x7f68a40413e0 con 0x7f68b808b400 2026-02-12T18:08:27.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.316+0000 7f6893fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:08:27.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.316+0000 7f6893fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:27.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.316+0000 7f6893fff640 1 -- 10.20.193.48:0/1089566698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f68b808b400 msgr2=0x7f68b808b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.316+0000 7f6893fff640 1 --2- 10.20.193.48:0/1089566698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f68b808b400 0x7f68b808b7d0 secure :-1 s=READY pgs=121 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68a4004740 tx=0x7f68a4008030 comp rx=0 tx=0).stop 2026-02-12T18:08:27.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.316+0000 7f6893fff640 1 -- 10.20.193.48:0/1089566698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f68b808b400 msgr2=0x7f68b808b7d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:27.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.316+0000 7f6893fff640 1 --2- 10.20.193.48:0/1089566698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f68b808b400 0x7f68b808b7d0 secure :-1 s=CLOSED pgs=121 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68a4004740 tx=0x7f68a4008030 comp rx=0 tx=0).stop 2026-02-12T18:08:27.343 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:08:27.343 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:08:27.344 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:08:27.344 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:08:27.344 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 28, 2026-02-12T18:08:27.344 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 162143, 2026-02-12T18:08:27.344 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:08:27.344 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:08:27.344 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:08:27.344 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:08:27.344 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:08:27.344 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:08:27.344 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:08:27.344 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:08:27.344 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:08:27.344 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:08:27.344 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.344 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 4, 2026-02-12T18:08:27.344 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:27.345 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:08:27.345 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:08:27.345 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:27.345 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:27.345 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:27.345 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:27.345 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:27.345 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:27.345 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:27.345 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:27.345 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:27.345 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:27.345 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:27.345 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:27.345 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:27.345 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.345 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:08:27.345 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:08:27.345 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:27.346 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:27.346 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:27.346 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:27.346 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:27.346 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:27.346 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:27.346 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:27.346 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:27.346 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:27.346 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:27.346 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:27.346 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:27.346 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.346 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.346 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:08:27.346 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:08:27.346 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:08:27.346 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:08:27.347 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:08:27.347 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:08:27.347 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:27.347 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:27.347 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:08:27.347 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:08:27.347 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:08:27.347 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:08:27.347 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:08:27.347 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:08:27.347 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:08:27.347 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:27.347 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:08:27.347 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:27.347 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:27.347 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:27.347 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:27.347 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:27.347 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:27.347 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:27.348 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:27.348 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:27.348 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:27.348 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:27.348 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:27.348 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:27.348 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.348 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:08:27.348 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.348 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:08:27.348 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.348 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:27.348 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:27.348 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.348 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.348 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.348 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.348 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:08:27.348 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.348 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.348 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.349 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.349 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:08:27.349 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.349 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.349 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.349 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.349 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:08:27.349 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:08:27.349 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.349 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.349 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:08:27.349 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.349 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.349 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.349 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:27.349 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:27.349 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.349 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.349 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.349 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.350 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:08:27.350 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.350 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.350 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.350 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.350 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:08:27.350 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.350 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.350 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.350 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.350 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:08:27.350 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:08:27.350 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.350 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.350 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:08:27.350 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.350 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.350 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.350 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:27.350 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:27.350 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.351 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.351 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.351 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.351 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:08:27.351 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.351 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.351 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.351 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.351 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:08:27.351 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.351 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.351 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.351 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.351 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:08:27.351 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:08:27.351 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.351 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.351 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:08:27.351 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.351 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.351 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.352 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:08:27.352 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:08:27.352 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.352 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.352 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.352 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.352 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:08:27.352 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.352 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.352 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.352 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.352 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:08:27.352 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.352 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.352 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.352 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.352 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:08:27.352 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:08:27.352 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.352 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.352 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:08:27.352 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.353 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.353 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.353 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:08:27.353 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:08:27.353 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.353 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.353 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.353 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.353 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:08:27.353 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.353 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.353 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.353 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.353 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:08:27.353 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.353 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.353 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.353 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.353 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:08:27.353 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:08:27.353 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.354 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.354 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:27.354 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.354 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.354 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.354 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:27.354 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:27.354 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.354 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.354 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.354 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.354 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:08:27.354 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.354 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.354 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.354 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.354 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:08:27.354 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.354 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.354 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.354 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.354 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:08:27.354 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:08:27.355 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.355 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.355 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:08:27.355 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.355 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.355 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.355 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:27.355 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:27.355 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.355 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.355 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.355 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.355 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:08:27.355 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.355 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.355 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.355 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.355 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:08:27.355 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.355 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.355 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.355 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.355 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:08:27.355 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:08:27.356 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.356 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.356 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:27.356 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.356 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.356 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.356 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:27.356 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:27.356 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.356 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.356 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.356 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.356 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:08:27.356 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.356 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.356 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.356 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.356 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:08:27.356 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.356 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.356 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.356 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.356 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:08:27.356 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:08:27.357 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.357 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.357 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:08:27.357 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.357 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.357 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.357 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:08:27.357 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:08:27.357 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.357 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.357 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.357 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.357 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:08:27.357 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.357 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.357 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.357 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.357 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:08:27.357 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.357 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.357 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.357 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.357 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:08:27.357 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:08:27.357 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.357 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.358 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:08:27.358 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.358 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.358 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.358 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.358 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:08:27.358 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:08:27.358 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.358 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:27.358 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:27.358 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:27.358 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.358 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.358 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:08:27.358 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.358 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:27.358 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:27.358 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:08:27.358 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.358 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.358 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.358 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:08:27.358 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:08:27.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.316+0000 7f68bdc12640 1 -- 10.20.193.48:0/1089566698 >> v2:10.20.193.111:6812/977811348 conn(0x7f688803f800 msgr2=0x7f688805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.316+0000 7f68bdc12640 1 --2- 10.20.193.48:0/1089566698 >> v2:10.20.193.111:6812/977811348 conn(0x7f688803f800 0x7f688805fcb0 secure :-1 s=READY pgs=185 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68b808c510 tx=0x7f68ac00a040 comp rx=0 tx=0).stop 2026-02-12T18:08:27.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.316+0000 7f68bdc12640 10 monclient: shutdown 2026-02-12T18:08:27.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.316+0000 7f68bdc12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:27.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.316+0000 7f68bdc12640 1 -- 10.20.193.48:0/1089566698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f68b805e490 msgr2=0x7f68b81dbd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.316+0000 7f68b7fff640 1 -- 10.20.193.48:0/1089566698 reap_dead start 2026-02-12T18:08:27.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.316+0000 7f68bdc12640 1 --2- 10.20.193.48:0/1089566698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f68b805e490 0x7f68b81dbd10 secure :-1 s=READY pgs=119 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f68a800b520 tx=0x7f68a800b9f0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.316+0000 7f68bdc12640 1 -- 10.20.193.48:0/1089566698 shutdown_connections 2026-02-12T18:08:27.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.316+0000 7f68bdc12640 1 --2- 10.20.193.48:0/1089566698 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f68b805e490 0x7f68b81dbd10 unknown :-1 s=CLOSED pgs=119 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.316+0000 7f68bdc12640 1 -- 10.20.193.48:0/1089566698 >> 10.20.193.48:0/1089566698 conn(0x7f68b80548a0 msgr2=0x7f68b8090fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:27.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.316+0000 7f68bdc12640 1 -- 10.20.193.48:0/1089566698 shutdown_connections 2026-02-12T18:08:27.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.316+0000 7f68bdc12640 1 -- 10.20.193.48:0/1089566698 wait complete. 2026-02-12T18:08:27.360 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:08:27.360 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2026-02-12T18:08:27.360 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2026-02-12T18:08:27.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.426+0000 7f205e81b640 10 monclient: get_monmap_and_config 2026-02-12T18:08:27.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.426+0000 7f205e81b640 10 monclient: build_initial_monmap 2026-02-12T18:08:27.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.426+0000 7f205e81b640 10 monclient: monmap: 2026-02-12T18:08:27.428 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:27.428 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.428 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:27.427268+0000 2026-02-12T18:08:27.428 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:27.427268+0000 2026-02-12T18:08:27.428 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:27.428 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.428 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:27.428 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:27.428 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:27.428 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:27.428 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:27.429 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:27.429 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:27.429 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:27.429 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:27.429 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:27.429 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:27.429 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.426+0000 7f205e81b640 1 Processor -- start 2026-02-12T18:08:27.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.426+0000 7f205e81b640 1 -- start start 2026-02-12T18:08:27.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.426+0000 7f205e81b640 10 monclient: init 2026-02-12T18:08:27.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.426+0000 7f205e81b640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:27.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.426+0000 7f205e81b640 10 monclient: _add_conns ranks=[5,8,1,9,3,4,0,7,10,2,6] 2026-02-12T18:08:27.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.426+0000 7f205e81b640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f205805d550 0x7f205805d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.426+0000 7f205e81b640 10 monclient(hunting): picked mon.noname-h con 0x7f205805d550 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:08:27.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.426+0000 7f205e81b640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f205805de60 0x7f2058141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.426+0000 7f205e81b640 10 monclient(hunting): picked mon.noname-e con 0x7f205805de60 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:08:27.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.426+0000 7f205e81b640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f205813ef60 addr v1:10.20.193.111:6789/0 2026-02-12T18:08:27.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.426+0000 7f205e81b640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f205804dc20 con 0x7f205813ef60 2026-02-12T18:08:27.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.426+0000 7f205e81b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.426+0000 7f205e81b640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f205808d390 con 0x7f205805d550 2026-02-12T18:08:27.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.426+0000 7f205e81b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.426+0000 7f205e81b640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f205808d5a0 con 0x7f205805de60 2026-02-12T18:08:27.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.426+0000 7f205e81b640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:27.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.426+0000 7f205e81b640 10 monclient(hunting): authenticate will time out at 746.152965s 2026-02-12T18:08:27.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f20577fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f205805de60 0x7f2058141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f20577fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f205805de60 0x7f2058141fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:51116/0 (socket says 10.20.193.48:51116) 2026-02-12T18:08:27.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f20577fe640 1 -- 10.20.193.48:0/3346199677 learned_addr learned my addr 10.20.193.48:0/3346199677 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:27.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f20577fe640 10 monclient(hunting): get_auth_request con 0x7f205805de60 auth_method 0 2026-02-12T18:08:27.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f20577fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f20577fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f20577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f2057fff640 1 --2- 10.20.193.48:0/3346199677 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f205805d550 0x7f205805d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f2057fff640 10 monclient(hunting): get_auth_request con 0x7f205805d550 auth_method 0 2026-02-12T18:08:27.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f2057fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f2057fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f2057fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f20577fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f20577fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f20577fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f2057fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f2057fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f2057fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f20577fe640 10 monclient(hunting): handle_auth_done global_id 5111 payload 274 2026-02-12T18:08:27.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f20577fe640 1 -- 10.20.193.48:0/3346199677 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f205805d550 msgr2=0x7f205805d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:27.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f20577fe640 1 --2- 10.20.193.48:0/3346199677 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f205805d550 0x7f205805d920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f20577fe640 1 -- 10.20.193.48:0/3346199677 >> v1:10.20.193.111:6789/0 conn(0x7f205813ef60 legacy=0x7f20581424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:27.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f20577fe640 10 monclient: _finish_hunting 0 2026-02-12T18:08:27.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f20577fe640 1 monclient: found mon.noname-e 2026-02-12T18:08:27.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f20577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:27.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f20577fe640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:08:27.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.427+0000 7f20577fe640 1 -- 10.20.193.48:0/3346199677 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20580580e0 con 0x7f205805de60 2026-02-12T18:08:27.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.429+0000 7f20577fe640 1 -- 10.20.193.48:0/3346199677 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f205805de60 msgr2=0x7f2058141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.429+0000 7f20577fe640 1 --2- 10.20.193.48:0/3346199677 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f205805de60 0x7f2058141fa0 secure :-1 s=READY pgs=122 gs=2 cs=0 l=1 c_cookie=15171517434718361236 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20480098d0 tx=0x7f204802ee20 comp rx=0 tx=0).ready entity=mon.8 client_cookie=d28c0eb988089694 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.429+0000 7f2056ffd640 1 -- 10.20.193.48:0/3346199677 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2048035340 con 0x7f205805de60 2026-02-12T18:08:27.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.429+0000 7f2056ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.429+0000 7f2056ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:08:27.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.429+0000 7f2056ffd640 10 monclient: dump: 2026-02-12T18:08:27.436 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.437 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.437 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.437 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.437 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.437 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.437 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.437 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.437 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.437 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.437 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.437 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.437 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.437 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.437 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.437 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.429+0000 7f2056ffd640 10 monclient: _finish_auth 0 2026-02-12T18:08:27.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.429+0000 7f2056ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:08:27.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.429+0000 7f2056ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:27.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.429+0000 7f2056ffd640 1 -- 10.20.193.48:0/3346199677 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20480354c0 con 0x7f205805de60 2026-02-12T18:08:27.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.429+0000 7f2056ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:27.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.429+0000 7f205e81b640 5 monclient: authenticate success, global_id 5111 2026-02-12T18:08:27.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.429+0000 7f205e81b640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:27.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.429+0000 7f2056ffd640 1 -- 10.20.193.48:0/3346199677 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2048035af0 con 0x7f205805de60 2026-02-12T18:08:27.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.429+0000 7f205e81b640 4 set_mon_vals no callback set 2026-02-12T18:08:27.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.429+0000 7f2056ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.429+0000 7f2056ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:08:27.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.429+0000 7f2056ffd640 10 monclient: dump: 2026-02-12T18:08:27.438 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.438 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.438 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.438 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.438 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.438 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.438 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.438 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.438 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.438 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.439 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.439 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.439 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.439 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.439 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.439 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.430+0000 7f205e81b640 10 monclient: shutdown 2026-02-12T18:08:27.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.430+0000 7f205e81b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:27.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.430+0000 7f205e81b640 1 -- 10.20.193.48:0/3346199677 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f205805de60 msgr2=0x7f2058141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.430+0000 7f205e81b640 1 --2- 10.20.193.48:0/3346199677 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f205805de60 0x7f2058141fa0 secure :-1 s=READY pgs=122 gs=2 cs=0 l=1 c_cookie=15171517434718361236 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20480098d0 tx=0x7f204802ee20 comp rx=0 tx=0).stop 2026-02-12T18:08:27.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.430+0000 7f205e81b640 1 -- 10.20.193.48:0/3346199677 shutdown_connections 2026-02-12T18:08:27.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.430+0000 7f205e81b640 1 --2- 10.20.193.48:0/3346199677 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f205805de60 0x7f2058141fa0 unknown :-1 s=CLOSED pgs=122 gs=2 cs=0 l=1 c_cookie=15171517434718361236 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.430+0000 7f205e81b640 1 --2- 10.20.193.48:0/3346199677 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f205805d550 0x7f205805d920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.430+0000 7f205e81b640 1 -- 10.20.193.48:0/3346199677 >> 10.20.193.48:0/3346199677 conn(0x7f20580546a0 msgr2=0x7f2058054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:27.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.430+0000 7f205e81b640 1 -- 10.20.193.48:0/3346199677 shutdown_connections 2026-02-12T18:08:27.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.430+0000 7f205e81b640 1 -- 10.20.193.48:0/3346199677 wait complete. 2026-02-12T18:08:27.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.430+0000 7f205e81b640 10 monclient: build_initial_monmap 2026-02-12T18:08:27.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.430+0000 7f205e81b640 10 monclient: monmap: 2026-02-12T18:08:27.440 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:27.440 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:27.440 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:27.440 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:27.440 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:27.440 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.440 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:27.440 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:27.440 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:27.440 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:27.440 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:27.440 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:27.440 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:27.440 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:27.440 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:27.440 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.440 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.430+0000 7f205e81b640 1 Processor -- start 2026-02-12T18:08:27.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.430+0000 7f205e81b640 1 -- start start 2026-02-12T18:08:27.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.430+0000 7f205e81b640 10 monclient: init 2026-02-12T18:08:27.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f205e81b640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:27.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f205e81b640 10 monclient: _add_conns ranks=[7,8,4,3,5,2,6,0,1] 2026-02-12T18:08:27.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f205e81b640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f205805d550 0x7f205808a680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f205e81b640 10 monclient(hunting): picked mon.noname-i con 0x7f205805d550 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:27.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f205e81b640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f205805de60 0x7f205808abc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f205e81b640 10 monclient(hunting): picked mon.noname-e con 0x7f205805de60 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:08:27.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f205e81b640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f205813ef60 0x7f205808b100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f205e81b640 10 monclient(hunting): picked mon.noname-c con 0x7f205813ef60 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:08:27.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f205e81b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f205e81b640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f2058120270 con 0x7f205813ef60 2026-02-12T18:08:27.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f205e81b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f205e81b640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f205808c1a0 con 0x7f205805d550 2026-02-12T18:08:27.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f205e81b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f205e81b640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f205813def0 con 0x7f205805de60 2026-02-12T18:08:27.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f205e81b640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:27.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f205e81b640 10 monclient(hunting): authenticate will time out at 746.157155s 2026-02-12T18:08:27.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f20577fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f205805de60 0x7f205808abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f20577fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f205805de60 0x7f205808abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:51128/0 (socket says 10.20.193.48:51128) 2026-02-12T18:08:27.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f20577fe640 1 -- 10.20.193.48:0/2150140626 learned_addr learned my addr 10.20.193.48:0/2150140626 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:27.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f20577fe640 10 monclient(hunting): get_auth_request con 0x7f205805de60 auth_method 0 2026-02-12T18:08:27.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f20577fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f20577fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f20577fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f205cd91640 1 --2- 10.20.193.48:0/2150140626 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f205813ef60 0x7f205808b100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f20577fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f20577fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f20577fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f205cd91640 10 monclient(hunting): get_auth_request con 0x7f205813ef60 auth_method 0 2026-02-12T18:08:27.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f205cd91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f205cd91640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f205cd91640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f205cd91640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f205cd91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f205cd91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f2057fff640 1 --2- 10.20.193.48:0/2150140626 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f205805d550 0x7f205808a680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f20577fe640 10 monclient(hunting): handle_auth_done global_id 5120 payload 824 2026-02-12T18:08:27.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f20577fe640 1 -- 10.20.193.48:0/2150140626 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f205805d550 msgr2=0x7f205808a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f20577fe640 1 --2- 10.20.193.48:0/2150140626 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f205805d550 0x7f205808a680 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f20577fe640 1 -- 10.20.193.48:0/2150140626 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f205813ef60 msgr2=0x7f205808b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f20577fe640 1 --2- 10.20.193.48:0/2150140626 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f205813ef60 0x7f205808b100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f20577fe640 10 monclient: _finish_hunting 0 2026-02-12T18:08:27.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f20577fe640 1 monclient: found mon.noname-e 2026-02-12T18:08:27.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f20577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:27.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f20577fe640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:08:27.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.431+0000 7f20577fe640 1 -- 10.20.193.48:0/2150140626 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20480094f0 con 0x7f205805de60 2026-02-12T18:08:27.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.433+0000 7f20577fe640 1 -- 10.20.193.48:0/2150140626 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f205805de60 msgr2=0x7f205808abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.433+0000 7f20577fe640 1 --2- 10.20.193.48:0/2150140626 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f205805de60 0x7f205808abc0 secure :-1 s=READY pgs=123 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2048004740 tx=0x7f2048004770 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.433+0000 7f2054ff9640 1 -- 10.20.193.48:0/2150140626 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2048035e00 con 0x7f205805de60 2026-02-12T18:08:27.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.433+0000 7f2054ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.433+0000 7f2054ff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:08:27.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.433+0000 7f2054ff9640 10 monclient: dump: 2026-02-12T18:08:27.447 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.447 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.447 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.447 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.447 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.447 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.447 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.447 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.447 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.448 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.448 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.448 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.448 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.448 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.448 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.448 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.433+0000 7f2054ff9640 10 monclient: _finish_auth 0 2026-02-12T18:08:27.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.433+0000 7f2054ff9640 10 monclient: _check_auth_tickets 2026-02-12T18:08:27.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.433+0000 7f2054ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:27.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.433+0000 7f2054ff9640 1 -- 10.20.193.48:0/2150140626 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2048037900 con 0x7f205805de60 2026-02-12T18:08:27.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.433+0000 7f2054ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:27.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.433+0000 7f2054ff9640 1 -- 10.20.193.48:0/2150140626 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2048040410 con 0x7f205805de60 2026-02-12T18:08:27.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.433+0000 7f2054ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.433+0000 7f20567fc640 4 set_mon_vals no callback set 2026-02-12T18:08:27.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.433+0000 7f2054ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:08:27.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.433+0000 7f2054ff9640 10 monclient: dump: 2026-02-12T18:08:27.448 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.449 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.449 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.449 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.449 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.449 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.449 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.449 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.449 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.449 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.449 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.449 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.449 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.449 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.449 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.449 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.449 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.433+0000 7f205e81b640 5 monclient: authenticate success, global_id 5120 2026-02-12T18:08:27.449 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.433+0000 7f205e81b640 10 monclient: _renew_subs 2026-02-12T18:08:27.449 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.433+0000 7f205e81b640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:08:27.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.433+0000 7f205e81b640 1 -- 10.20.193.48:0/2150140626 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20581329a0 con 0x7f205805de60 2026-02-12T18:08:27.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.433+0000 7f205e81b640 10 monclient: _renew_subs 2026-02-12T18:08:27.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.433+0000 7f205e81b640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:08:27.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.433+0000 7f205e81b640 1 -- 10.20.193.48:0/2150140626 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f205810f070 con 0x7f205805de60 2026-02-12T18:08:27.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.434+0000 7f205e81b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:27.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.434+0000 7f205e81b640 1 --2- 10.20.193.48:0/2150140626 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2058091010 0x7f205808b640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.434+0000 7f205e81b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.434+0000 7f205e81b640 1 -- 10.20.193.48:0/2150140626 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f205805f140 con 0x7f2058091010 2026-02-12T18:08:27.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.434+0000 7f2054ff9640 1 -- 10.20.193.48:0/2150140626 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f2048046020 con 0x7f205805de60 2026-02-12T18:08:27.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.434+0000 7f2057fff640 1 --2- 10.20.193.48:0/2150140626 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2058091010 0x7f205808b640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.434+0000 7f2057fff640 10 monclient: get_auth_request con 0x7f2058091010 auth_method 0 2026-02-12T18:08:27.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.434+0000 7f2057fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.434+0000 7f2057fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.434+0000 7f2057fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.434+0000 7f2057fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.434+0000 7f2057fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.434+0000 7f2057fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.434+0000 7f2054ff9640 1 --2- 10.20.193.48:0/2150140626 >> v2:10.20.193.111:6812/977811348 conn(0x7f202803f7f0 0x7f202805fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.434+0000 7f2054ff9640 1 -- 10.20.193.48:0/2150140626 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(117..117 src has 1..117) ==== 3897+0+0 (secure 0 0 0) 0x7f2048077de0 con 0x7f205805de60 2026-02-12T18:08:27.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.434+0000 7f2057fff640 10 monclient(hunting): handle_auth_done global_id 5104 payload 824 2026-02-12T18:08:27.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.434+0000 7f2057fff640 1 -- 10.20.193.48:0/2150140626 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f205808d060 con 0x7f2058091010 2026-02-12T18:08:27.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.435+0000 7f205cd91640 1 --2- 10.20.193.48:0/2150140626 >> v2:10.20.193.111:6812/977811348 conn(0x7f202803f7f0 0x7f202805fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.435+0000 7f205cd91640 10 monclient: get_auth_request con 0x7f202803f7f0 auth_method 0 2026-02-12T18:08:27.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.437+0000 7f2057fff640 1 -- 10.20.193.48:0/2150140626 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2058091010 msgr2=0x7f205808b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.437+0000 7f2057fff640 1 --2- 10.20.193.48:0/2150140626 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2058091010 0x7f205808b640 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2044010790 tx=0x7f2044010c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.437+0000 7f2054ff9640 1 -- 10.20.193.48:0/2150140626 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2044010e80 con 0x7f2058091010 2026-02-12T18:08:27.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.437+0000 7f2054ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.437+0000 7f2054ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:08:27.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.437+0000 7f2054ff9640 10 monclient: dump: 2026-02-12T18:08:27.451 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.451 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.451 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.451 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.451 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.451 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.451 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.452 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.452 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.452 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.452 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.452 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.452 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.452 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.452 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.452 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.437+0000 7f2054ff9640 1 -- 10.20.193.48:0/2150140626 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f204400ebe0 con 0x7f2058091010 2026-02-12T18:08:27.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.437+0000 7f2054ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:27.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.437+0000 7f2054ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:27.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.437+0000 7f2054ff9640 1 -- 10.20.193.48:0/2150140626 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2058091010 msgr2=0x7f205808b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.437+0000 7f2054ff9640 1 --2- 10.20.193.48:0/2150140626 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2058091010 0x7f205808b640 secure :-1 s=READY pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2044010790 tx=0x7f2044010c60 comp rx=0 tx=0).stop 2026-02-12T18:08:27.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.437+0000 7f2054ff9640 1 -- 10.20.193.48:0/2150140626 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2058091010 msgr2=0x7f205808b640 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:27.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.437+0000 7f2054ff9640 1 --2- 10.20.193.48:0/2150140626 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2058091010 0x7f205808b640 secure :-1 s=CLOSED pgs=180 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2044010790 tx=0x7f2044010c60 comp rx=0 tx=0).stop 2026-02-12T18:08:27.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.437+0000 7f205cd91640 1 --2- 10.20.193.48:0/2150140626 >> v2:10.20.193.111:6812/977811348 conn(0x7f202803f7f0 0x7f202805fca0 secure :-1 s=READY pgs=186 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f204c008fd0 tx=0x7f204c008f20 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.440+0000 7f205e81b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:08:27.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.440+0000 7f205e81b640 1 --2- 10.20.193.48:0/2150140626 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f205813c4c0 0x7f2058058b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.440+0000 7f205e81b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.440+0000 7f205e81b640 1 -- 10.20.193.48:0/2150140626 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f205805fd90 con 0x7f205813c4c0 2026-02-12T18:08:27.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.441+0000 7f2057fff640 1 --2- 10.20.193.48:0/2150140626 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f205813c4c0 0x7f2058058b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.441+0000 7f2057fff640 10 monclient: get_auth_request con 0x7f205813c4c0 auth_method 0 2026-02-12T18:08:27.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.441+0000 7f2057fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.441+0000 7f2057fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.441+0000 7f2057fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.441+0000 7f2057fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.441+0000 7f2057fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.441+0000 7f2057fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.441+0000 7f2057fff640 10 monclient(hunting): handle_auth_done global_id 5113 payload 824 2026-02-12T18:08:27.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.441+0000 7f2057fff640 1 -- 10.20.193.48:0/2150140626 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f205805e310 con 0x7f205813c4c0 2026-02-12T18:08:27.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.444+0000 7f2057fff640 1 -- 10.20.193.48:0/2150140626 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f205813c4c0 msgr2=0x7f2058058b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.444+0000 7f2057fff640 1 --2- 10.20.193.48:0/2150140626 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f205813c4c0 0x7f2058058b60 secure :-1 s=READY pgs=181 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20440023d0 tx=0x7f20440047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.444+0000 7f2054ff9640 1 -- 10.20.193.48:0/2150140626 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f20440034f0 con 0x7f205813c4c0 2026-02-12T18:08:27.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.444+0000 7f2054ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.444+0000 7f2054ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:08:27.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.444+0000 7f2054ff9640 10 monclient: dump: 2026-02-12T18:08:27.454 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.454 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.454 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.454 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.454 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.454 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.454 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.454 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.454 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.454 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.454 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.454 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.454 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.454 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.454 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.454 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.444+0000 7f2054ff9640 1 -- 10.20.193.48:0/2150140626 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10349 (secure 0 0 0) 0x7f2044021610 con 0x7f205813c4c0 2026-02-12T18:08:27.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.444+0000 7f2054ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:08:27.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.444+0000 7f2054ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:27.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.444+0000 7f2054ff9640 1 -- 10.20.193.48:0/2150140626 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f205813c4c0 msgr2=0x7f2058058b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.444+0000 7f2054ff9640 1 --2- 10.20.193.48:0/2150140626 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f205813c4c0 0x7f2058058b60 secure :-1 s=READY pgs=181 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20440023d0 tx=0x7f20440047e0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.444+0000 7f2054ff9640 1 -- 10.20.193.48:0/2150140626 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f205813c4c0 msgr2=0x7f2058058b60 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:27.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.444+0000 7f2054ff9640 1 --2- 10.20.193.48:0/2150140626 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f205813c4c0 0x7f2058058b60 secure :-1 s=CLOSED pgs=181 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20440023d0 tx=0x7f20440047e0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.455 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:08:27.455 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:27.455 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:27.455 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:08:27.455 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 28, 2026-02-12T18:08:27.455 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 162241, 2026-02-12T18:08:27.455 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:08:27.455 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:08:27.456 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:08:27.456 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:08:27.456 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:08:27.456 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:08:27.456 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:08:27.456 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:08:27.456 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:08:27.456 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:08:27.456 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.456 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 4, 2026-02-12T18:08:27.456 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:27.456 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:08:27.456 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:08:27.456 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:27.456 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:27.456 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:27.456 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:27.456 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:27.457 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:27.457 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:27.457 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:27.457 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:27.457 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:27.457 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:27.457 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:27.457 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:27.457 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.457 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:08:27.457 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:08:27.457 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:27.457 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:27.457 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:27.457 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:27.457 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:27.457 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:27.457 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:27.457 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:27.458 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:27.458 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:27.458 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:27.458 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:27.458 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:27.458 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.458 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.458 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:08:27.458 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:08:27.458 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:08:27.458 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:08:27.458 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:08:27.458 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:08:27.458 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:27.458 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:27.458 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:08:27.458 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:08:27.458 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:08:27.458 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:08:27.459 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:08:27.459 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:08:27.459 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:08:27.459 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:27.459 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:08:27.459 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:27.459 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:27.459 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:27.459 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:27.459 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:27.459 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:27.459 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:27.459 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:27.459 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:27.459 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:27.459 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:27.459 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:27.459 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:27.459 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.459 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:08:27.459 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.460 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:08:27.460 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.460 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:27.460 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:27.460 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.460 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.460 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.460 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.460 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:08:27.460 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.460 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.460 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.460 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.460 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:08:27.460 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.460 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.460 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.460 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.460 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:08:27.460 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:08:27.460 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.461 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.461 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:08:27.461 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.461 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.461 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.461 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:27.461 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:27.461 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.461 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.461 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.461 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.461 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:08:27.461 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.461 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.461 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.461 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.461 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:08:27.461 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.461 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.461 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.461 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.461 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:08:27.462 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:08:27.462 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.462 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.462 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:08:27.462 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.462 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.462 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.462 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:27.462 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:27.462 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.462 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.462 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.462 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.462 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:08:27.462 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.462 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.462 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.462 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.462 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:08:27.462 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.462 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.462 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.462 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.463 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:08:27.463 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:08:27.463 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.463 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.463 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:08:27.463 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.463 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.463 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.463 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:08:27.463 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:08:27.463 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.463 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.463 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.463 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.463 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:08:27.463 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.463 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.463 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.463 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.463 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:08:27.463 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.464 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.464 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.464 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.464 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:08:27.464 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:08:27.464 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.464 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.464 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:08:27.464 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.464 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.464 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.464 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:08:27.464 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:08:27.464 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.464 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.464 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.464 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.464 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:08:27.464 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.464 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.464 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.464 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.464 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:08:27.465 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.465 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.465 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.465 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.465 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:08:27.465 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:08:27.465 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.465 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.465 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:27.465 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.465 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.465 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.465 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:27.465 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:27.465 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.465 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.465 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.465 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.465 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:08:27.465 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.465 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.465 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.465 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.466 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:08:27.466 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.466 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.466 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.466 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.466 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:08:27.466 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:08:27.466 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.466 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.466 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:08:27.466 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.466 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.466 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.466 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:27.466 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:27.466 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.466 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.466 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.466 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.466 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:08:27.466 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.466 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.466 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.466 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.467 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:08:27.467 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.467 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.467 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.467 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.467 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:08:27.467 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:08:27.467 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.467 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.467 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:27.467 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.467 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.467 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.467 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:27.467 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:27.467 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.467 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.467 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.467 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.467 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:08:27.467 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.467 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.467 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.467 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.467 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:08:27.468 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.468 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.468 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.468 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.468 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:08:27.468 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:08:27.468 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.468 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.468 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:08:27.468 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.468 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.468 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.468 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:08:27.468 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:08:27.468 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.468 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.468 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.468 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.468 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:08:27.468 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.468 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.468 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.468 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.468 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:08:27.468 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: "num": 4 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.469 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.470 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:08:27.470 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.470 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:27.470 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:27.470 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:08:27.470 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.470 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.470 INFO:teuthology.orchestra.run.trial048.stdout: "mgr": [ 2026-02-12T18:08:27.470 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.470 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:27.470 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:27.470 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:27.470 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.470 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.470 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.470 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:08:27.470 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:08:27.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.444+0000 7f205e81b640 1 -- 10.20.193.48:0/2150140626 >> v2:10.20.193.111:6812/977811348 conn(0x7f202803f7f0 msgr2=0x7f202805fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.444+0000 7f205e81b640 1 --2- 10.20.193.48:0/2150140626 >> v2:10.20.193.111:6812/977811348 conn(0x7f202803f7f0 0x7f202805fca0 secure :-1 s=READY pgs=186 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f204c008fd0 tx=0x7f204c008f20 comp rx=0 tx=0).stop 2026-02-12T18:08:27.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.444+0000 7f205e81b640 10 monclient: shutdown 2026-02-12T18:08:27.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.444+0000 7f205e81b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:27.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.444+0000 7f205e81b640 1 -- 10.20.193.48:0/2150140626 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f205805de60 msgr2=0x7f205808abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.444+0000 7f205e81b640 1 --2- 10.20.193.48:0/2150140626 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f205805de60 0x7f205808abc0 secure :-1 s=READY pgs=123 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2048004740 tx=0x7f2048004770 comp rx=0 tx=0).stop 2026-02-12T18:08:27.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.444+0000 7f205cd91640 1 -- 10.20.193.48:0/2150140626 reap_dead start 2026-02-12T18:08:27.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.444+0000 7f205e81b640 1 -- 10.20.193.48:0/2150140626 shutdown_connections 2026-02-12T18:08:27.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.444+0000 7f205e81b640 1 --2- 10.20.193.48:0/2150140626 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f205805de60 0x7f205808abc0 unknown :-1 s=CLOSED pgs=123 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.444+0000 7f205e81b640 1 -- 10.20.193.48:0/2150140626 >> 10.20.193.48:0/2150140626 conn(0x7f20580546a0 msgr2=0x7f205813c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:27.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.444+0000 7f205e81b640 1 -- 10.20.193.48:0/2150140626 shutdown_connections 2026-02-12T18:08:27.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.444+0000 7f205e81b640 1 -- 10.20.193.48:0/2150140626 wait complete. 2026-02-12T18:08:27.472 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:08:27.472 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2026-02-12T18:08:27.472 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2026-02-12T18:08:27.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.537+0000 7f72ca90c640 10 monclient: get_monmap_and_config 2026-02-12T18:08:27.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.537+0000 7f72ca90c640 10 monclient: build_initial_monmap 2026-02-12T18:08:27.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.537+0000 7f72ca90c640 10 monclient: monmap: 2026-02-12T18:08:27.542 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:27.542 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.542 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:27.538743+0000 2026-02-12T18:08:27.542 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:27.538743+0000 2026-02-12T18:08:27.542 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:27.542 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.542 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:27.542 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:27.542 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:27.542 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:27.542 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:27.542 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:27.542 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:27.542 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:27.542 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:27.542 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:27.542 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:27.543 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72ca90c640 1 Processor -- start 2026-02-12T18:08:27.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72ca90c640 1 -- start start 2026-02-12T18:08:27.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72ca90c640 10 monclient: init 2026-02-12T18:08:27.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72ca90c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:27.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72ca90c640 10 monclient: _add_conns ranks=[10,7,8,2,1,0,5,4,6,3,9] 2026-02-12T18:08:27.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72ca90c640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f72c405d550 0x7f72c405d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72ca90c640 10 monclient(hunting): picked mon.noname-f con 0x7f72c405d550 addr v2:10.20.193.111:3300/0 2026-02-12T18:08:27.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72ca90c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f72c405de60 0x7f72c4141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72ca90c640 10 monclient(hunting): picked mon.noname-i con 0x7f72c405de60 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:27.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72ca90c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f72c413ef60 0x7f72c41424e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72ca90c640 10 monclient(hunting): picked mon.noname-e con 0x7f72c413ef60 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:08:27.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72ca90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72ca90c640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f72c408d390 con 0x7f72c405d550 2026-02-12T18:08:27.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72ca90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72ca90c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f72c408d5a0 con 0x7f72c405de60 2026-02-12T18:08:27.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72ca90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72ca90c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f72c40580e0 con 0x7f72c413ef60 2026-02-12T18:08:27.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72ca90c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:27.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72ca90c640 10 monclient(hunting): authenticate will time out at 746.264458s 2026-02-12T18:08:27.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c8e82640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f72c413ef60 0x7f72c41424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c8e82640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f72c413ef60 0x7f72c41424e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:51132/0 (socket says 10.20.193.48:51132) 2026-02-12T18:08:27.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c8e82640 1 -- 10.20.193.48:0/1686976619 learned_addr learned my addr 10.20.193.48:0/1686976619 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:27.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c8e82640 10 monclient(hunting): get_auth_request con 0x7f72c413ef60 auth_method 0 2026-02-12T18:08:27.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c8e82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c8e82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c8e82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c8e82640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c8e82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c37fe640 1 --2- 10.20.193.48:0/1686976619 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f72c405de60 0x7f72c4141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c8e82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c37fe640 10 monclient(hunting): get_auth_request con 0x7f72c405de60 auth_method 0 2026-02-12T18:08:27.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c3fff640 1 --2- 10.20.193.48:0/1686976619 >> v2:10.20.193.111:3300/0 conn(0x7f72c405d550 0x7f72c405d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c3fff640 10 monclient(hunting): get_auth_request con 0x7f72c405d550 auth_method 0 2026-02-12T18:08:27.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c8e82640 10 monclient(hunting): handle_auth_done global_id 5129 payload 274 2026-02-12T18:08:27.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c8e82640 1 -- 10.20.193.48:0/1686976619 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f72c405de60 msgr2=0x7f72c4141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:27.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c8e82640 1 --2- 10.20.193.48:0/1686976619 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f72c405de60 0x7f72c4141fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c8e82640 1 -- 10.20.193.48:0/1686976619 >> v2:10.20.193.111:3300/0 conn(0x7f72c405d550 msgr2=0x7f72c405d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:27.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c8e82640 1 --2- 10.20.193.48:0/1686976619 >> v2:10.20.193.111:3300/0 conn(0x7f72c405d550 0x7f72c405d920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c8e82640 10 monclient: _finish_hunting 0 2026-02-12T18:08:27.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c8e82640 1 monclient: found mon.noname-e 2026-02-12T18:08:27.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c8e82640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:27.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c8e82640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:08:27.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.538+0000 7f72c8e82640 1 -- 10.20.193.48:0/1686976619 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72c404dc20 con 0x7f72c413ef60 2026-02-12T18:08:27.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72c8e82640 1 -- 10.20.193.48:0/1686976619 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f72c413ef60 msgr2=0x7f72c41424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72c8e82640 1 --2- 10.20.193.48:0/1686976619 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f72c413ef60 0x7f72c41424e0 secure :-1 s=READY pgs=124 gs=1 cs=0 l=1 c_cookie=14782636080350281659 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72b800a140 tx=0x7f72b802fed0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=cd2679317d26bfbb server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72c2ffd640 1 -- 10.20.193.48:0/1686976619 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f72b8030b50 con 0x7f72c413ef60 2026-02-12T18:08:27.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72c2ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:08:27.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72c2ffd640 10 monclient: dump: 2026-02-12T18:08:27.551 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.551 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.551 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.551 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.551 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.551 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.552 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.552 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.552 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.552 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.552 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.552 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.552 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.552 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.552 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.552 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72c2ffd640 10 monclient: _finish_auth 0 2026-02-12T18:08:27.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72c2ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:08:27.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72c2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:27.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72ca90c640 5 monclient: authenticate success, global_id 5129 2026-02-12T18:08:27.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72c2ffd640 1 -- 10.20.193.48:0/1686976619 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b8030cd0 con 0x7f72c413ef60 2026-02-12T18:08:27.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72ca90c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:08:27.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72c2ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:27.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72c2ffd640 1 -- 10.20.193.48:0/1686976619 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f72b8030e40 con 0x7f72c413ef60 2026-02-12T18:08:27.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72ca90c640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:27.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72ca90c640 4 set_mon_vals no callback set 2026-02-12T18:08:27.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72c2ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:08:27.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72c2ffd640 10 monclient: dump: 2026-02-12T18:08:27.553 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.553 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.553 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.553 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.553 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.553 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.553 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.553 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.553 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.553 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.553 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.553 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.553 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.554 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.554 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.554 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72ca90c640 10 monclient: shutdown 2026-02-12T18:08:27.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72ca90c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:27.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72ca90c640 1 -- 10.20.193.48:0/1686976619 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f72c413ef60 msgr2=0x7f72c41424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72ca90c640 1 --2- 10.20.193.48:0/1686976619 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f72c413ef60 0x7f72c41424e0 secure :-1 s=READY pgs=124 gs=1 cs=0 l=1 c_cookie=14782636080350281659 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72b800a140 tx=0x7f72b802fed0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72ca90c640 1 -- 10.20.193.48:0/1686976619 shutdown_connections 2026-02-12T18:08:27.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72ca90c640 1 --2- 10.20.193.48:0/1686976619 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f72c405de60 0x7f72c4141fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72ca90c640 1 --2- 10.20.193.48:0/1686976619 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f72c413ef60 0x7f72c41424e0 unknown :-1 s=CLOSED pgs=124 gs=1 cs=0 l=1 c_cookie=14782636080350281659 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72ca90c640 1 --2- 10.20.193.48:0/1686976619 >> v2:10.20.193.111:3300/0 conn(0x7f72c405d550 0x7f72c405d920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72ca90c640 1 -- 10.20.193.48:0/1686976619 >> 10.20.193.48:0/1686976619 conn(0x7f72c40546a0 msgr2=0x7f72c4054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:27.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72ca90c640 1 -- 10.20.193.48:0/1686976619 shutdown_connections 2026-02-12T18:08:27.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.541+0000 7f72ca90c640 1 -- 10.20.193.48:0/1686976619 wait complete. 2026-02-12T18:08:27.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.542+0000 7f72ca90c640 10 monclient: build_initial_monmap 2026-02-12T18:08:27.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.542+0000 7f72ca90c640 10 monclient: monmap: 2026-02-12T18:08:27.554 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:27.554 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:27.555 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:27.555 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:27.555 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:27.555 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.555 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:27.555 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:27.555 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:27.555 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:27.555 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:27.555 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:27.555 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:27.555 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:27.555 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:27.555 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.542+0000 7f72ca90c640 1 Processor -- start 2026-02-12T18:08:27.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.542+0000 7f72ca90c640 1 -- start start 2026-02-12T18:08:27.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.542+0000 7f72ca90c640 10 monclient: init 2026-02-12T18:08:27.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.542+0000 7f72ca90c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:27.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.542+0000 7f72ca90c640 10 monclient: _add_conns ranks=[1,3,7,0,4,5,6,2,8] 2026-02-12T18:08:27.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.542+0000 7f72ca90c640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f72c405d550 0x7f72c413c3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.542+0000 7f72ca90c640 10 monclient(hunting): picked mon.noname-f con 0x7f72c405d550 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:08:27.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.542+0000 7f72ca90c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f72c405de60 0x7f72c408a680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.542+0000 7f72ca90c640 10 monclient(hunting): picked mon.noname-g con 0x7f72c405de60 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:08:27.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.542+0000 7f72ca90c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f72c413ef60 0x7f72c408abc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.542+0000 7f72ca90c640 10 monclient(hunting): picked mon.noname-i con 0x7f72c413ef60 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:27.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.542+0000 7f72ca90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.542+0000 7f72ca90c640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f72c410ea00 con 0x7f72c405d550 2026-02-12T18:08:27.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.542+0000 7f72ca90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.542+0000 7f72ca90c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f72c410ec70 con 0x7f72c405de60 2026-02-12T18:08:27.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.542+0000 7f72ca90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.542+0000 7f72ca90c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f72c410ef50 con 0x7f72c413ef60 2026-02-12T18:08:27.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.542+0000 7f72ca90c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:27.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.542+0000 7f72ca90c640 10 monclient(hunting): authenticate will time out at 746.268870s 2026-02-12T18:08:27.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c3fff640 1 -- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f72c405d550 msgr2=0x7f72c413c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-12T18:08:27.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c3fff640 1 -- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f72c405d550 msgr2=0x7f72c413c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:08:27.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c3fff640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f72c405d550 0x7f72c413c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner read peer banner failed r=-1 ((1) Operation not permitted) 2026-02-12T18:08:27.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c8e82640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f72c413ef60 0x7f72c408abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c3fff640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f72c405d550 0x7f72c413c3c0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:08:27.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c37fe640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f72c405de60 0x7f72c408a680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c8e82640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f72c413ef60 0x7f72c408abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3303/0 says I am v2:10.20.193.48:40222/0 (socket says 10.20.193.48:40222) 2026-02-12T18:08:27.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c8e82640 1 -- 10.20.193.48:0/909081946 learned_addr learned my addr 10.20.193.48:0/909081946 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:27.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c37fe640 10 monclient(hunting): get_auth_request con 0x7f72c405de60 auth_method 0 2026-02-12T18:08:27.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c8e82640 10 monclient(hunting): get_auth_request con 0x7f72c413ef60 auth_method 0 2026-02-12T18:08:27.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c8e82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c8e82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c8e82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c8e82640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c8e82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c8e82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c8e82640 10 monclient(hunting): handle_auth_done global_id 44260 payload 824 2026-02-12T18:08:27.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c8e82640 1 -- 10.20.193.48:0/909081946 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f72c405de60 msgr2=0x7f72c408a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c8e82640 1 --2- 10.20.193.48:0/909081946 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f72c405de60 0x7f72c408a680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c8e82640 1 -- 10.20.193.48:0/909081946 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f72c405d550 msgr2=0x7f72c413c3c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:08:27.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c8e82640 1 --2- 10.20.193.48:0/909081946 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f72c405d550 0x7f72c413c3c0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c8e82640 10 monclient: _finish_hunting 0 2026-02-12T18:08:27.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c8e82640 1 monclient: found mon.noname-i 2026-02-12T18:08:27.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c8e82640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:27.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c8e82640 10 monclient: _send_mon_message to mon.noname-i at v2:10.20.193.111:3303/0 2026-02-12T18:08:27.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.543+0000 7f72c8e82640 1 -- 10.20.193.48:0/909081946 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72b800a5d0 con 0x7f72c413ef60 2026-02-12T18:08:27.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.545+0000 7f72c8e82640 1 -- 10.20.193.48:0/909081946 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f72c413ef60 msgr2=0x7f72c408abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.545+0000 7f72c8e82640 1 --2- 10.20.193.48:0/909081946 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f72c413ef60 0x7f72c408abc0 secure :-1 s=READY pgs=25 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72b800a360 tx=0x7f72b8005850 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.545+0000 7f72c0ff9640 1 -- 10.20.193.48:0/909081946 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f72b8030b50 con 0x7f72c413ef60 2026-02-12T18:08:27.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.545+0000 7f72c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.545+0000 7f72c0ff9640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2026-02-12T18:08:27.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.545+0000 7f72c0ff9640 10 monclient: dump: 2026-02-12T18:08:27.558 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.558 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.558 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.558 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.559 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.559 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.559 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.559 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.559 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.559 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.559 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.559 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.559 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.559 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.559 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.559 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.545+0000 7f72c0ff9640 10 monclient: _finish_auth 0 2026-02-12T18:08:27.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.545+0000 7f72c0ff9640 10 monclient: _check_auth_tickets 2026-02-12T18:08:27.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.545+0000 7f72c0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:27.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.545+0000 7f72c0ff9640 1 -- 10.20.193.48:0/909081946 <== mon.7 v2:10.20.193.111:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72b8004bd0 con 0x7f72c413ef60 2026-02-12T18:08:27.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.545+0000 7f72c0ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:27.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.545+0000 7f72c0ff9640 1 -- 10.20.193.48:0/909081946 <== mon.7 v2:10.20.193.111:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f72b8038dc0 con 0x7f72c413ef60 2026-02-12T18:08:27.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.545+0000 7f72c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.545+0000 7f72c0ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:08:27.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.545+0000 7f72c27fc640 4 set_mon_vals no callback set 2026-02-12T18:08:27.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.545+0000 7f72c0ff9640 10 monclient: dump: 2026-02-12T18:08:27.560 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.560 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.560 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.560 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.560 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.560 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.560 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.560 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.560 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.560 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.560 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.560 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.560 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.560 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.560 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.561 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.545+0000 7f72ca90c640 5 monclient: authenticate success, global_id 44260 2026-02-12T18:08:27.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.545+0000 7f72ca90c640 10 monclient: _renew_subs 2026-02-12T18:08:27.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.545+0000 7f72ca90c640 10 monclient: _send_mon_message to mon.i at v2:10.20.193.111:3303/0 2026-02-12T18:08:27.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.545+0000 7f72ca90c640 1 -- 10.20.193.48:0/909081946 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72c410f230 con 0x7f72c413ef60 2026-02-12T18:08:27.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.545+0000 7f72ca90c640 10 monclient: _renew_subs 2026-02-12T18:08:27.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.545+0000 7f72ca90c640 10 monclient: _send_mon_message to mon.i at v2:10.20.193.111:3303/0 2026-02-12T18:08:27.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.545+0000 7f72ca90c640 1 -- 10.20.193.48:0/909081946 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f72c4132990 con 0x7f72c413ef60 2026-02-12T18:08:27.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.546+0000 7f72ca90c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:27.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.546+0000 7f72ca90c640 1 --2- 10.20.193.48:0/909081946 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f72c4091010 0x7f72c408b100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.546+0000 7f72ca90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.546+0000 7f72ca90c640 1 -- 10.20.193.48:0/909081946 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f72c405f140 con 0x7f72c4091010 2026-02-12T18:08:27.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.546+0000 7f72c0ff9640 1 -- 10.20.193.48:0/909081946 <== mon.7 v2:10.20.193.111:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f72b8047030 con 0x7f72c413ef60 2026-02-12T18:08:27.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.546+0000 7f72c3fff640 1 --2- 10.20.193.48:0/909081946 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f72c4091010 0x7f72c408b100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.546+0000 7f72c3fff640 10 monclient: get_auth_request con 0x7f72c4091010 auth_method 0 2026-02-12T18:08:27.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.546+0000 7f72c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.546+0000 7f72c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.546+0000 7f72c3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.546+0000 7f72c3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.546+0000 7f72c3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.546+0000 7f72c3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.546+0000 7f72c0ff9640 1 --2- 10.20.193.48:0/909081946 >> v2:10.20.193.111:6812/977811348 conn(0x7f729403f800 0x7f729405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.546+0000 7f72c0ff9640 1 -- 10.20.193.48:0/909081946 <== mon.7 v2:10.20.193.111:3303/0 5 ==== osd_map(117..117 src has 1..117) ==== 3897+0+0 (secure 0 0 0) 0x7f72b8078d30 con 0x7f72c413ef60 2026-02-12T18:08:27.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.546+0000 7f72c37fe640 1 --2- 10.20.193.48:0/909081946 >> v2:10.20.193.111:6812/977811348 conn(0x7f729403f800 0x7f729405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.546+0000 7f72c37fe640 10 monclient: get_auth_request con 0x7f729403f800 auth_method 0 2026-02-12T18:08:27.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.546+0000 7f72c3fff640 10 monclient(hunting): handle_auth_done global_id 5007 payload 824 2026-02-12T18:08:27.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.546+0000 7f72c3fff640 1 -- 10.20.193.48:0/909081946 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f72c410ede0 con 0x7f72c4091010 2026-02-12T18:08:27.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.549+0000 7f72c3fff640 1 -- 10.20.193.48:0/909081946 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f72c4091010 msgr2=0x7f72c408b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.549+0000 7f72c3fff640 1 --2- 10.20.193.48:0/909081946 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f72c4091010 0x7f72c408b100 secure :-1 s=READY pgs=126 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72b000d4d0 tx=0x7f72b000d9a0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.549+0000 7f72c37fe640 1 --2- 10.20.193.48:0/909081946 >> v2:10.20.193.111:6812/977811348 conn(0x7f729403f800 0x7f729405fcb0 secure :-1 s=READY pgs=187 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72c405c760 tx=0x7f72b4009210 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.549+0000 7f72c0ff9640 1 -- 10.20.193.48:0/909081946 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f72b0012cc0 con 0x7f72c4091010 2026-02-12T18:08:27.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.549+0000 7f72c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.549+0000 7f72c0ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:08:27.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.549+0000 7f72c0ff9640 10 monclient: dump: 2026-02-12T18:08:27.562 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.562 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.563 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.563 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.563 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.563 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.563 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.563 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.563 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.563 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.563 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.563 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.563 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.563 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.563 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.563 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.549+0000 7f72c0ff9640 1 -- 10.20.193.48:0/909081946 <== mon.3 v2:10.20.193.111:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f72b0012e20 con 0x7f72c4091010 2026-02-12T18:08:27.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.549+0000 7f72c0ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:27.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.549+0000 7f72c0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:27.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.549+0000 7f72c0ff9640 1 -- 10.20.193.48:0/909081946 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f72c4091010 msgr2=0x7f72c408b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.549+0000 7f72c0ff9640 1 --2- 10.20.193.48:0/909081946 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f72c4091010 0x7f72c408b100 secure :-1 s=READY pgs=126 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72b000d4d0 tx=0x7f72b000d9a0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.564 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.549+0000 7f72c0ff9640 1 -- 10.20.193.48:0/909081946 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f72c4091010 msgr2=0x7f72c408b100 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:27.564 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.549+0000 7f72c0ff9640 1 --2- 10.20.193.48:0/909081946 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f72c4091010 0x7f72c408b100 secure :-1 s=CLOSED pgs=126 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72b000d4d0 tx=0x7f72b000d9a0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.552+0000 7f72ca90c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:08:27.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.552+0000 7f72ca90c640 1 --2- 10.20.193.48:0/909081946 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f72c408b640 0x7f72c4058920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.552+0000 7f72ca90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.552+0000 7f72ca90c640 1 -- 10.20.193.48:0/909081946 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f72c4050410 con 0x7f72c408b640 2026-02-12T18:08:27.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.553+0000 7f72c3fff640 1 --2- 10.20.193.48:0/909081946 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f72c408b640 0x7f72c4058920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.553+0000 7f72c3fff640 10 monclient: get_auth_request con 0x7f72c408b640 auth_method 0 2026-02-12T18:08:27.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.553+0000 7f72c3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.553+0000 7f72c3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.565 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.553+0000 7f72c3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.553+0000 7f72c3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.553+0000 7f72c3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.553+0000 7f72c3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.553+0000 7f72c3fff640 10 monclient(hunting): handle_auth_done global_id 5016 payload 824 2026-02-12T18:08:27.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.553+0000 7f72c3fff640 1 -- 10.20.193.48:0/909081946 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f72c408d060 con 0x7f72c408b640 2026-02-12T18:08:27.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.555+0000 7f72c3fff640 1 -- 10.20.193.48:0/909081946 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f72c408b640 msgr2=0x7f72c4058920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.555+0000 7f72c3fff640 1 --2- 10.20.193.48:0/909081946 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f72c408b640 0x7f72c4058920 secure :-1 s=READY pgs=127 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72b000d4d0 tx=0x7f72b0004770 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.555+0000 7f72c0ff9640 1 -- 10.20.193.48:0/909081946 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f72b00034f0 con 0x7f72c408b640 2026-02-12T18:08:27.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.555+0000 7f72c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.555+0000 7f72c0ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:08:27.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.555+0000 7f72c0ff9640 10 monclient: dump: 2026-02-12T18:08:27.566 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.566 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.566 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.566 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.566 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.566 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.567 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.567 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.567 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.567 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.567 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.567 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.567 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.567 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.567 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.567 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.556+0000 7f72c0ff9640 1 -- 10.20.193.48:0/909081946 <== mon.3 v2:10.20.193.111:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10015 (secure 0 0 0) 0x7f72b0003030 con 0x7f72c408b640 2026-02-12T18:08:27.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.556+0000 7f72c0ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:08:27.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.556+0000 7f72c0ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:27.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.556+0000 7f72c0ff9640 1 -- 10.20.193.48:0/909081946 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f72c408b640 msgr2=0x7f72c4058920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.556+0000 7f72c0ff9640 1 --2- 10.20.193.48:0/909081946 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f72c408b640 0x7f72c4058920 secure :-1 s=READY pgs=127 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72b000d4d0 tx=0x7f72b0004770 comp rx=0 tx=0).stop 2026-02-12T18:08:27.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.556+0000 7f72c0ff9640 1 -- 10.20.193.48:0/909081946 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f72c408b640 msgr2=0x7f72c4058920 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:27.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.556+0000 7f72c0ff9640 1 --2- 10.20.193.48:0/909081946 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f72c408b640 0x7f72c4058920 secure :-1 s=CLOSED pgs=127 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72b000d4d0 tx=0x7f72b0004770 comp rx=0 tx=0).stop 2026-02-12T18:08:27.568 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:08:27.568 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:08:27.568 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:08:27.568 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:08:27.568 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 28, 2026-02-12T18:08:27.568 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 162352, 2026-02-12T18:08:27.568 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:08:27.568 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:08:27.568 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:08:27.568 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:08:27.568 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:08:27.568 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:08:27.568 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:08:27.568 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:08:27.569 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:08:27.569 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:08:27.569 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.569 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 4, 2026-02-12T18:08:27.569 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:27.569 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:08:27.569 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:08:27.569 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:27.569 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:27.569 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:27.569 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:27.569 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:27.569 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:27.569 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:27.569 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:27.569 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:27.569 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:27.569 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:27.569 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:27.570 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:27.570 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.570 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:08:27.570 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:08:27.570 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:27.570 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:27.570 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:27.570 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:27.570 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:27.570 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:27.570 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:27.570 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:27.570 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:27.570 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:27.570 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:27.570 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:27.570 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:27.570 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.570 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.570 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:08:27.571 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:08:27.571 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:08:27.571 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:08:27.571 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:08:27.571 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:08:27.571 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:27.571 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:27.571 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:08:27.571 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:08:27.571 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:08:27.571 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:08:27.571 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:08:27.571 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:08:27.571 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:08:27.571 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:27.571 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:08:27.571 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:27.571 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:27.571 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:27.571 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:27.572 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:27.572 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:27.572 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:27.572 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:27.572 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:27.572 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:27.572 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:27.572 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:27.572 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:27.572 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.572 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:08:27.572 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.572 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:08:27.572 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.572 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:27.572 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:27.572 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.572 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.572 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.572 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.573 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:08:27.573 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.573 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.573 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.573 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.573 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:08:27.573 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.573 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.573 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.573 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.573 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:08:27.573 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:08:27.573 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.573 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.573 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:08:27.573 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.573 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.573 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.573 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:27.573 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:27.573 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.573 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.574 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.574 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.574 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:08:27.574 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.574 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.574 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.574 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.574 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:08:27.574 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.574 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.574 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.574 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.574 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:08:27.574 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:08:27.574 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.574 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.574 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:08:27.574 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.574 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.574 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.574 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:27.574 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:27.574 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.575 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.575 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.575 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.575 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:08:27.575 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.575 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.575 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.575 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.575 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:08:27.575 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.575 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.575 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.575 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.575 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:08:27.575 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:08:27.575 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.575 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.575 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:08:27.575 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.575 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.575 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.575 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:08:27.575 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:08:27.576 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.576 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.576 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.576 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.576 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:08:27.576 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.576 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.576 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.576 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.576 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:08:27.576 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.576 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.576 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.576 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.576 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:08:27.576 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:08:27.576 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.576 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.576 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:08:27.576 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.576 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.576 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.576 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:08:27.576 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:08:27.577 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.577 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.577 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.577 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.577 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:08:27.577 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.577 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.577 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.577 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.577 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:08:27.577 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.577 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.577 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.577 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.577 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:08:27.577 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:08:27.577 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.577 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.577 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:27.577 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.577 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.577 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.577 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:27.578 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:27.578 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.578 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.578 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.578 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.578 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:08:27.578 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.578 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.578 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.578 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.578 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:08:27.578 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.578 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.578 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.578 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.578 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:08:27.578 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:08:27.578 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.578 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.578 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:08:27.578 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.578 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.578 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.578 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:27.578 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:27.579 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.579 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.579 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.579 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.579 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:08:27.579 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.579 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.579 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.579 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.579 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:08:27.579 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.579 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.579 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.579 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.579 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:08:27.579 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:08:27.579 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.579 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.579 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:27.579 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.579 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.579 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.579 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:27.579 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:27.580 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.580 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.580 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.580 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.580 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:08:27.580 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.580 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.580 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.580 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.580 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:08:27.580 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.580 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.580 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.580 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.580 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:08:27.580 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:08:27.580 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.580 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.580 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:08:27.580 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.580 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.580 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.580 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:08:27.580 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:08:27.581 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.581 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.581 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.581 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.581 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:08:27.581 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.581 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.581 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.581 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.581 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:08:27.581 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.581 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.581 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.581 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.581 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:08:27.581 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:08:27.581 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.581 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.581 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:08:27.581 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.581 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.581 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.581 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.581 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:08:27.581 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:08:27.581 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.582 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:27.582 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:27.582 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:27.582 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.582 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.582 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:08:27.582 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.582 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:27.582 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:27.582 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:08:27.582 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.582 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.582 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.582 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:08:27.582 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:08:27.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.556+0000 7f72ca90c640 1 -- 10.20.193.48:0/909081946 >> v2:10.20.193.111:6812/977811348 conn(0x7f729403f800 msgr2=0x7f729405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.556+0000 7f72ca90c640 1 --2- 10.20.193.48:0/909081946 >> v2:10.20.193.111:6812/977811348 conn(0x7f729403f800 0x7f729405fcb0 secure :-1 s=READY pgs=187 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72c405c760 tx=0x7f72b4009210 comp rx=0 tx=0).stop 2026-02-12T18:08:27.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.556+0000 7f72ca90c640 10 monclient: shutdown 2026-02-12T18:08:27.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.556+0000 7f72ca90c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:27.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.556+0000 7f72ca90c640 1 -- 10.20.193.48:0/909081946 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f72c413ef60 msgr2=0x7f72c408abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.556+0000 7f72ca90c640 1 --2- 10.20.193.48:0/909081946 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f72c413ef60 0x7f72c408abc0 secure :-1 s=READY pgs=25 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f72b800a360 tx=0x7f72b8005850 comp rx=0 tx=0).stop 2026-02-12T18:08:27.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.556+0000 7f72c8e82640 1 -- 10.20.193.48:0/909081946 reap_dead start 2026-02-12T18:08:27.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.556+0000 7f72c8e82640 1 -- 10.20.193.48:0/909081946 reap_dead start 2026-02-12T18:08:27.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.556+0000 7f72ca90c640 1 -- 10.20.193.48:0/909081946 shutdown_connections 2026-02-12T18:08:27.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.556+0000 7f72ca90c640 1 -- 10.20.193.48:0/909081946 >> 10.20.193.48:0/909081946 conn(0x7f72c40546a0 msgr2=0x7f72c4122b90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:27.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.556+0000 7f72ca90c640 1 -- 10.20.193.48:0/909081946 shutdown_connections 2026-02-12T18:08:27.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.556+0000 7f72ca90c640 1 -- 10.20.193.48:0/909081946 wait complete. 2026-02-12T18:08:27.584 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:08:27.584 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2026-02-12T18:08:27.584 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2026-02-12T18:08:27.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.649+0000 7ff15bbc2640 10 monclient: get_monmap_and_config 2026-02-12T18:08:27.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.649+0000 7ff15bbc2640 10 monclient: build_initial_monmap 2026-02-12T18:08:27.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.649+0000 7ff15bbc2640 10 monclient: monmap: 2026-02-12T18:08:27.650 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:27.650 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.650 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:27.650415+0000 2026-02-12T18:08:27.650 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:27.650415+0000 2026-02-12T18:08:27.650 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:27.650 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.651 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:27.651 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:27.651 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:27.651 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:27.651 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:27.651 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:27.651 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:27.651 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:27.651 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:27.651 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:27.651 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:27.651 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.653 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.649+0000 7ff15bbc2640 1 Processor -- start 2026-02-12T18:08:27.653 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.649+0000 7ff15bbc2640 1 -- start start 2026-02-12T18:08:27.653 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.649+0000 7ff15bbc2640 10 monclient: init 2026-02-12T18:08:27.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15bbc2640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:27.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15bbc2640 10 monclient: _add_conns ranks=[9,3,8,0,6,1,2,10,4,7,5] 2026-02-12T18:08:27.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15bbc2640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7ff15405c950 0x7ff15405cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15bbc2640 10 monclient(hunting): picked mon.noname-a con 0x7ff15405c950 addr v2:10.20.193.48:3300/0 2026-02-12T18:08:27.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15bbc2640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff15405e490 0x7ff15405d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15bbc2640 10 monclient(hunting): picked mon.noname-g con 0x7ff15405e490 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:08:27.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15bbc2640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff15413db70 0x7ff15413e010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15bbc2640 10 monclient(hunting): picked mon.noname-e con 0x7ff15413db70 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:08:27.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15bbc2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15bbc2640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7ff15405ddd0 con 0x7ff15405c950 2026-02-12T18:08:27.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15bbc2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15bbc2640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff15405d7a0 con 0x7ff15405e490 2026-02-12T18:08:27.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15bbc2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15bbc2640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7ff154092990 con 0x7ff15413db70 2026-02-12T18:08:27.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15bbc2640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:27.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15bbc2640 10 monclient(hunting): authenticate will time out at 746.376214s 2026-02-12T18:08:27.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff159937640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7ff15405c950 0x7ff15405cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15a138640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff15413db70 0x7ff15413e010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff159937640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7ff15405c950 0x7ff15405cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:38104/0 (socket says 10.20.193.48:38104) 2026-02-12T18:08:27.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15a138640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff15413db70 0x7ff15413e010 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:51138/0 (socket says 10.20.193.48:51138) 2026-02-12T18:08:27.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff159937640 1 -- 10.20.193.48:0/3778502475 learned_addr learned my addr 10.20.193.48:0/3778502475 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:27.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff159937640 10 monclient(hunting): get_auth_request con 0x7ff15405c950 auth_method 0 2026-02-12T18:08:27.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff159937640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff159937640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff159937640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15a138640 10 monclient(hunting): get_auth_request con 0x7ff15413db70 auth_method 0 2026-02-12T18:08:27.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15a138640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15a138640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15a138640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff159136640 1 --2- 10.20.193.48:0/3778502475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff15405e490 0x7ff15405d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff159136640 10 monclient(hunting): get_auth_request con 0x7ff15405e490 auth_method 0 2026-02-12T18:08:27.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff159136640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff159136640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff159136640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15a138640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.656 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15a138640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.656 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15a138640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.656 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff159937640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.656 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff159937640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.656 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff159937640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.656 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff159136640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.656 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff159136640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.656 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff159136640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.656 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15a138640 10 monclient(hunting): handle_auth_done global_id 5138 payload 274 2026-02-12T18:08:27.656 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15a138640 1 -- 10.20.193.48:0/3778502475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff15405e490 msgr2=0x7ff15405d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:27.656 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15a138640 1 --2- 10.20.193.48:0/3778502475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff15405e490 0x7ff15405d260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.656 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15a138640 1 -- 10.20.193.48:0/3778502475 >> v2:10.20.193.48:3300/0 conn(0x7ff15405c950 msgr2=0x7ff15405cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:27.656 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15a138640 1 --2- 10.20.193.48:0/3778502475 >> v2:10.20.193.48:3300/0 conn(0x7ff15405c950 0x7ff15405cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.656 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15a138640 10 monclient: _finish_hunting 0 2026-02-12T18:08:27.656 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15a138640 1 monclient: found mon.noname-e 2026-02-12T18:08:27.656 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15a138640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:27.656 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15a138640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:08:27.656 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff15a138640 1 -- 10.20.193.48:0/3778502475 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff15404dc20 con 0x7ff15413db70 2026-02-12T18:08:27.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.650+0000 7ff159937640 1 --2- 10.20.193.48:0/3778502475 >> v2:10.20.193.48:3300/0 conn(0x7ff15405c950 0x7ff15405cd20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:08:27.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff15a138640 1 -- 10.20.193.48:0/3778502475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff15413db70 msgr2=0x7ff15413e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff15a138640 1 --2- 10.20.193.48:0/3778502475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff15413db70 0x7ff15413e010 secure :-1 s=READY pgs=125 gs=2 cs=0 l=1 c_cookie=1827743427468983314 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff150005820 tx=0x7ff15002fdf0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=195d72f6a6d7fc12 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff158935640 1 -- 10.20.193.48:0/3778502475 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff150036340 con 0x7ff15413db70 2026-02-12T18:08:27.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff158935640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff158935640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:08:27.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff158935640 10 monclient: dump: 2026-02-12T18:08:27.661 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.662 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.662 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.662 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.662 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.662 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.662 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.662 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.662 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.662 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.662 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.662 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.662 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.662 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.662 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.662 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff158935640 10 monclient: _finish_auth 0 2026-02-12T18:08:27.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff158935640 10 monclient: _check_auth_tickets 2026-02-12T18:08:27.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff158935640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:27.663 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff158935640 1 -- 10.20.193.48:0/3778502475 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1500364c0 con 0x7ff15413db70 2026-02-12T18:08:27.663 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff15bbc2640 5 monclient: authenticate success, global_id 5138 2026-02-12T18:08:27.663 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff15bbc2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:08:27.663 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff158935640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:27.663 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff158935640 1 -- 10.20.193.48:0/3778502475 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff150036af0 con 0x7ff15413db70 2026-02-12T18:08:27.663 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff15bbc2640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:27.663 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff15bbc2640 4 set_mon_vals no callback set 2026-02-12T18:08:27.663 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff158935640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.663 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff158935640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:08:27.663 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff158935640 10 monclient: dump: 2026-02-12T18:08:27.663 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.663 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.663 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.663 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.663 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.663 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.663 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.663 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.664 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.664 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.664 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.664 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.664 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.664 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.664 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.664 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff15bbc2640 10 monclient: shutdown 2026-02-12T18:08:27.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff15bbc2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:27.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff15bbc2640 1 -- 10.20.193.48:0/3778502475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff15413db70 msgr2=0x7ff15413e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff15bbc2640 1 --2- 10.20.193.48:0/3778502475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff15413db70 0x7ff15413e010 secure :-1 s=READY pgs=125 gs=2 cs=0 l=1 c_cookie=1827743427468983314 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff150005820 tx=0x7ff15002fdf0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff15bbc2640 1 -- 10.20.193.48:0/3778502475 shutdown_connections 2026-02-12T18:08:27.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff15bbc2640 1 --2- 10.20.193.48:0/3778502475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff15413db70 0x7ff15413e010 unknown :-1 s=CLOSED pgs=125 gs=2 cs=0 l=1 c_cookie=1827743427468983314 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff15bbc2640 1 --2- 10.20.193.48:0/3778502475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff15405e490 0x7ff15405d260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff15bbc2640 1 --2- 10.20.193.48:0/3778502475 >> v2:10.20.193.48:3300/0 conn(0x7ff15405c950 0x7ff15405cd20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff15bbc2640 1 -- 10.20.193.48:0/3778502475 >> 10.20.193.48:0/3778502475 conn(0x7ff1540548a0 msgr2=0x7ff154097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:27.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff15bbc2640 1 -- 10.20.193.48:0/3778502475 shutdown_connections 2026-02-12T18:08:27.665 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.653+0000 7ff15bbc2640 1 -- 10.20.193.48:0/3778502475 wait complete. 2026-02-12T18:08:27.665 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff15bbc2640 10 monclient: build_initial_monmap 2026-02-12T18:08:27.665 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff15bbc2640 10 monclient: monmap: 2026-02-12T18:08:27.665 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:27.665 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:27.665 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:27.665 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:27.665 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:27.665 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.665 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:27.665 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:27.665 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:27.665 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:27.665 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:27.665 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:27.665 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:27.665 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:27.665 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:27.665 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.665 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff15bbc2640 1 Processor -- start 2026-02-12T18:08:27.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff15bbc2640 1 -- start start 2026-02-12T18:08:27.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff15bbc2640 10 monclient: init 2026-02-12T18:08:27.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff15bbc2640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:27.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff15bbc2640 10 monclient: _add_conns ranks=[4,7,1,6,8,0,3,2,5] 2026-02-12T18:08:27.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff15bbc2640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff15405c950 0x7ff15412c7c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff15bbc2640 10 monclient(hunting): picked mon.noname-c con 0x7ff15405c950 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:08:27.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff15bbc2640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ff15405e490 0x7ff15408d450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff15bbc2640 10 monclient(hunting): picked mon.noname-i con 0x7ff15405e490 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:27.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff15bbc2640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff15413db70 0x7ff15413cbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff15bbc2640 10 monclient(hunting): picked mon.noname-f con 0x7ff15413db70 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:08:27.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff15bbc2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff15bbc2640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff15408a670 con 0x7ff15413db70 2026-02-12T18:08:27.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff15bbc2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff15bbc2640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7ff15413e300 con 0x7ff15405c950 2026-02-12T18:08:27.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff15bbc2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff15bbc2640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7ff154143ad0 con 0x7ff15405e490 2026-02-12T18:08:27.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff15bbc2640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:27.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff15bbc2640 10 monclient(hunting): authenticate will time out at 746.380818s 2026-02-12T18:08:27.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff159937640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff15405c950 0x7ff15412c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff159937640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff15405c950 0x7ff15412c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:42238/0 (socket says 10.20.193.48:42238) 2026-02-12T18:08:27.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff159937640 1 -- 10.20.193.48:0/984902524 learned_addr learned my addr 10.20.193.48:0/984902524 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:27.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff159937640 10 monclient(hunting): get_auth_request con 0x7ff15405c950 auth_method 0 2026-02-12T18:08:27.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff159937640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff159937640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff159937640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff159937640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff159937640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff159937640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.654+0000 7ff159136640 1 --2- 10.20.193.48:0/984902524 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ff15405e490 0x7ff15408d450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.655+0000 7ff159136640 10 monclient(hunting): get_auth_request con 0x7ff15405e490 auth_method 0 2026-02-12T18:08:27.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.655+0000 7ff159136640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.655+0000 7ff159136640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.655+0000 7ff159136640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.655+0000 7ff15a138640 1 --2- 10.20.193.48:0/984902524 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff15413db70 0x7ff15413cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.655+0000 7ff15a138640 10 monclient(hunting): get_auth_request con 0x7ff15413db70 auth_method 0 2026-02-12T18:08:27.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.655+0000 7ff15a138640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.655+0000 7ff15a138640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.655+0000 7ff15a138640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.655+0000 7ff159937640 10 monclient(hunting): handle_auth_done global_id 44221 payload 824 2026-02-12T18:08:27.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.655+0000 7ff159937640 1 -- 10.20.193.48:0/984902524 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ff15405e490 msgr2=0x7ff15408d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.655+0000 7ff159937640 1 --2- 10.20.193.48:0/984902524 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ff15405e490 0x7ff15408d450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.655+0000 7ff159937640 1 -- 10.20.193.48:0/984902524 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff15413db70 msgr2=0x7ff15413cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.655+0000 7ff159937640 1 --2- 10.20.193.48:0/984902524 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff15413db70 0x7ff15413cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.655+0000 7ff159937640 10 monclient: _finish_hunting 0 2026-02-12T18:08:27.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.655+0000 7ff159937640 1 monclient: found mon.noname-c 2026-02-12T18:08:27.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.655+0000 7ff159937640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:27.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.655+0000 7ff159937640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:08:27.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.655+0000 7ff159937640 1 -- 10.20.193.48:0/984902524 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1440094f0 con 0x7ff15405c950 2026-02-12T18:08:27.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff159937640 1 -- 10.20.193.48:0/984902524 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff15405c950 msgr2=0x7ff15412c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff159937640 1 --2- 10.20.193.48:0/984902524 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff15405c950 0x7ff15412c7c0 secure :-1 s=READY pgs=25 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff144006f70 tx=0x7ff14400c520 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff1427fc640 1 -- 10.20.193.48:0/984902524 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff14400ee90 con 0x7ff15405c950 2026-02-12T18:08:27.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff1427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff1427fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:08:27.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff1427fc640 10 monclient: dump: 2026-02-12T18:08:27.668 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.668 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.669 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.669 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.669 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.669 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.669 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.669 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.669 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.669 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.669 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.669 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.669 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.669 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.669 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.669 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.669 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff1427fc640 10 monclient: _finish_auth 0 2026-02-12T18:08:27.669 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff1427fc640 10 monclient: _check_auth_tickets 2026-02-12T18:08:27.669 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff1427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:27.669 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff1427fc640 1 -- 10.20.193.48:0/984902524 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff14400ce20 con 0x7ff15405c950 2026-02-12T18:08:27.669 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff1427fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:27.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff1427fc640 1 -- 10.20.193.48:0/984902524 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff1440044f0 con 0x7ff15405c950 2026-02-12T18:08:27.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff15bbc2640 5 monclient: authenticate success, global_id 44221 2026-02-12T18:08:27.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff15bbc2640 10 monclient: _renew_subs 2026-02-12T18:08:27.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff15bbc2640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:08:27.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff143fff640 4 set_mon_vals no callback set 2026-02-12T18:08:27.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff15bbc2640 1 -- 10.20.193.48:0/984902524 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff15000a500 con 0x7ff15405c950 2026-02-12T18:08:27.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff1427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff1427fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:08:27.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff1427fc640 10 monclient: dump: 2026-02-12T18:08:27.670 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.670 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.670 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.670 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.670 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.670 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.670 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.670 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.670 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.670 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.670 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.671 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.671 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.671 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.671 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.671 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff15bbc2640 10 monclient: _renew_subs 2026-02-12T18:08:27.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff15bbc2640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:08:27.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff15bbc2640 1 -- 10.20.193.48:0/984902524 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7ff15408af10 con 0x7ff15405c950 2026-02-12T18:08:27.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff15bbc2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:27.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff15bbc2640 1 --2- 10.20.193.48:0/984902524 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff15408d990 0x7ff15413d130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff15bbc2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.657+0000 7ff15bbc2640 1 -- 10.20.193.48:0/984902524 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7ff15405f140 con 0x7ff15408d990 2026-02-12T18:08:27.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.658+0000 7ff159136640 1 --2- 10.20.193.48:0/984902524 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff15408d990 0x7ff15413d130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.658+0000 7ff159136640 10 monclient: get_auth_request con 0x7ff15408d990 auth_method 0 2026-02-12T18:08:27.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.658+0000 7ff159136640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.658+0000 7ff159136640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.658+0000 7ff159136640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.658+0000 7ff1427fc640 1 -- 10.20.193.48:0/984902524 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7ff144011070 con 0x7ff15405c950 2026-02-12T18:08:27.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.658+0000 7ff159136640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.658+0000 7ff159136640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.658+0000 7ff159136640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.658+0000 7ff1427fc640 1 --2- 10.20.193.48:0/984902524 >> v2:10.20.193.111:6812/977811348 conn(0x7ff12403f800 0x7ff12405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.658+0000 7ff1427fc640 1 -- 10.20.193.48:0/984902524 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(117..117 src has 1..117) ==== 3897+0+0 (secure 0 0 0) 0x7ff144052ea0 con 0x7ff15405c950 2026-02-12T18:08:27.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.658+0000 7ff159136640 10 monclient(hunting): handle_auth_done global_id 5045 payload 824 2026-02-12T18:08:27.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.658+0000 7ff159136640 1 -- 10.20.193.48:0/984902524 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff154097de0 con 0x7ff15408d990 2026-02-12T18:08:27.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.658+0000 7ff15a138640 1 --2- 10.20.193.48:0/984902524 >> v2:10.20.193.111:6812/977811348 conn(0x7ff12403f800 0x7ff12405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.658+0000 7ff15a138640 10 monclient: get_auth_request con 0x7ff12403f800 auth_method 0 2026-02-12T18:08:27.674 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.660+0000 7ff159136640 1 -- 10.20.193.48:0/984902524 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff15408d990 msgr2=0x7ff15413d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.674 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.660+0000 7ff159136640 1 --2- 10.20.193.48:0/984902524 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff15408d990 0x7ff15413d130 secure :-1 s=READY pgs=126 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff15413f030 tx=0x7ff148011a70 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.674 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.661+0000 7ff1427fc640 1 -- 10.20.193.48:0/984902524 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff148015460 con 0x7ff15408d990 2026-02-12T18:08:27.674 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.661+0000 7ff1427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.674 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.661+0000 7ff1427fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:08:27.674 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.661+0000 7ff1427fc640 10 monclient: dump: 2026-02-12T18:08:27.674 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.674 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.674 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.674 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.674 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.674 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.675 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.675 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.675 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.675 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.675 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.675 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.675 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.675 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.675 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.675 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.675 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.661+0000 7ff1427fc640 1 -- 10.20.193.48:0/984902524 <== mon.5 v2:10.20.193.111:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7ff14800fac0 con 0x7ff15408d990 2026-02-12T18:08:27.675 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.661+0000 7ff1427fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:27.675 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.661+0000 7ff1427fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:27.675 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.661+0000 7ff1427fc640 1 -- 10.20.193.48:0/984902524 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff15408d990 msgr2=0x7ff15413d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.675 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.661+0000 7ff1427fc640 1 --2- 10.20.193.48:0/984902524 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff15408d990 0x7ff15413d130 secure :-1 s=READY pgs=126 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff15413f030 tx=0x7ff148011a70 comp rx=0 tx=0).stop 2026-02-12T18:08:27.675 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.661+0000 7ff1427fc640 1 -- 10.20.193.48:0/984902524 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff15408d990 msgr2=0x7ff15413d130 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:27.675 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.661+0000 7ff1427fc640 1 --2- 10.20.193.48:0/984902524 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff15408d990 0x7ff15413d130 secure :-1 s=CLOSED pgs=126 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff15413f030 tx=0x7ff148011a70 comp rx=0 tx=0).stop 2026-02-12T18:08:27.675 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.661+0000 7ff15a138640 1 --2- 10.20.193.48:0/984902524 >> v2:10.20.193.111:6812/977811348 conn(0x7ff12403f800 0x7ff12405fcb0 secure :-1 s=READY pgs=188 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff150008fd0 tx=0x7ff15003a040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.664+0000 7ff15bbc2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:08:27.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.664+0000 7ff15bbc2640 1 --2- 10.20.193.48:0/984902524 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff15413d670 0x7ff154129240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.664+0000 7ff15bbc2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.664+0000 7ff15bbc2640 1 -- 10.20.193.48:0/984902524 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7ff15405fd90 con 0x7ff15413d670 2026-02-12T18:08:27.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.664+0000 7ff159136640 1 --2- 10.20.193.48:0/984902524 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff15413d670 0x7ff154129240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.664+0000 7ff159136640 10 monclient: get_auth_request con 0x7ff15413d670 auth_method 0 2026-02-12T18:08:27.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.664+0000 7ff159136640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.664+0000 7ff159136640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.664+0000 7ff159136640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.664+0000 7ff159136640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.664+0000 7ff159136640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.664+0000 7ff159136640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.664+0000 7ff159136640 10 monclient(hunting): handle_auth_done global_id 5054 payload 824 2026-02-12T18:08:27.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.664+0000 7ff159136640 1 -- 10.20.193.48:0/984902524 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff15405cd20 con 0x7ff15413d670 2026-02-12T18:08:27.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.667+0000 7ff159136640 1 -- 10.20.193.48:0/984902524 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff15413d670 msgr2=0x7ff154129240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.667+0000 7ff159136640 1 --2- 10.20.193.48:0/984902524 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff15413d670 0x7ff154129240 secure :-1 s=READY pgs=127 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff15413f030 tx=0x7ff1480047e0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.667+0000 7ff1427fc640 1 -- 10.20.193.48:0/984902524 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff148005e00 con 0x7ff15413d670 2026-02-12T18:08:27.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.667+0000 7ff1427fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.667+0000 7ff1427fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:08:27.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.667+0000 7ff1427fc640 10 monclient: dump: 2026-02-12T18:08:27.677 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.677 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.677 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.677 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.677 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.677 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.677 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.677 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.677 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.677 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.677 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.677 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.677 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.677 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.677 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.677 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.667+0000 7ff1427fc640 1 -- 10.20.193.48:0/984902524 <== mon.5 v2:10.20.193.111:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10015 (secure 0 0 0) 0x7ff148004450 con 0x7ff15413d670 2026-02-12T18:08:27.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.667+0000 7ff1427fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:08:27.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.667+0000 7ff1427fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:27.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.667+0000 7ff1427fc640 1 -- 10.20.193.48:0/984902524 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff15413d670 msgr2=0x7ff154129240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.667+0000 7ff1427fc640 1 --2- 10.20.193.48:0/984902524 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff15413d670 0x7ff154129240 secure :-1 s=READY pgs=127 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff15413f030 tx=0x7ff1480047e0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.667+0000 7ff1427fc640 1 -- 10.20.193.48:0/984902524 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff15413d670 msgr2=0x7ff154129240 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:27.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.667+0000 7ff1427fc640 1 --2- 10.20.193.48:0/984902524 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff15413d670 0x7ff154129240 secure :-1 s=CLOSED pgs=127 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff15413f030 tx=0x7ff1480047e0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.678 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:08:27.678 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:27.678 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:27.678 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:08:27.678 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 28, 2026-02-12T18:08:27.678 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 162461, 2026-02-12T18:08:27.679 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:08:27.679 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:08:27.679 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:08:27.679 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:08:27.679 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:08:27.679 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:08:27.679 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:08:27.679 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:08:27.679 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:08:27.679 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:08:27.679 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.679 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 4, 2026-02-12T18:08:27.679 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:27.679 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:08:27.679 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:08:27.679 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:27.679 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:27.679 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:27.680 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:27.680 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:27.680 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:27.680 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:27.680 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:27.680 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:27.680 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:27.680 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:27.680 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:27.680 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:27.680 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.680 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:08:27.680 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:08:27.680 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:27.680 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:27.680 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:27.680 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:27.680 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:27.680 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:27.681 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:27.681 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:27.681 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:27.681 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:27.681 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:27.681 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:27.681 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:27.681 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.681 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.681 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:08:27.681 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:08:27.681 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:08:27.681 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:08:27.681 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:08:27.681 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:08:27.681 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:27.681 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:27.681 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:08:27.681 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:08:27.681 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:08:27.682 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:08:27.682 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:08:27.682 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:08:27.682 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:08:27.682 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:27.682 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:08:27.682 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:27.682 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:27.682 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:27.682 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:27.682 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:27.682 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:27.682 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:27.682 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:27.682 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:27.682 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:27.682 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:27.682 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:27.682 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:27.682 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.682 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:08:27.683 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.683 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:08:27.683 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.683 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:27.683 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:27.683 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.683 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.683 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.683 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.683 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:08:27.683 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.683 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.683 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.683 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.683 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:08:27.683 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.683 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.683 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.683 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.683 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:08:27.683 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:08:27.683 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.684 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.684 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:08:27.684 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.684 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.684 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.684 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:27.684 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:27.684 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.684 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.684 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.684 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.684 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:08:27.684 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.684 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.684 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.684 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.684 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:08:27.684 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.684 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.684 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.684 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.684 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:08:27.685 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:08:27.685 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.685 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.685 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:08:27.685 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.685 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.685 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.685 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:27.685 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:27.685 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.685 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.685 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.685 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.685 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:08:27.685 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.685 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.685 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.685 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.685 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:08:27.685 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.685 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.685 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.685 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.685 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:08:27.686 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:08:27.686 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.686 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.686 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:08:27.686 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.686 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.686 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.686 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:08:27.686 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:08:27.686 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.686 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.686 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.686 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.686 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:08:27.686 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.686 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.686 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.686 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.686 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:08:27.686 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.686 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.686 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.686 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.686 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:08:27.687 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:08:27.687 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.687 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.687 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:08:27.687 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.687 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.687 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.687 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:08:27.687 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:08:27.687 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.687 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.687 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.687 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.687 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:08:27.687 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.687 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.687 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.687 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.687 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:08:27.687 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.687 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.687 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.687 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.687 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:08:27.688 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:08:27.688 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.688 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.688 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:27.688 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.688 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.688 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.688 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:27.688 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:27.688 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.688 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.688 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.688 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.688 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:08:27.688 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.688 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.688 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.688 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.688 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:08:27.688 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.688 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.688 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.688 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.688 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:08:27.689 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:08:27.689 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.689 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.689 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:08:27.689 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.689 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.689 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.689 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:27.689 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:27.689 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.689 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.689 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.689 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.689 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:08:27.689 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.689 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.689 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.689 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.689 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:08:27.689 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.689 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.689 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.689 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.689 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:08:27.689 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:08:27.690 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.690 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.690 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:27.690 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.690 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.690 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.690 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:27.690 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:27.690 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.690 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.690 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.690 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.690 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:08:27.690 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.690 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.690 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.690 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.690 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:08:27.690 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.690 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.690 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.690 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.690 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:08:27.690 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:08:27.691 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.691 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.691 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:08:27.691 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.691 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.691 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.691 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:08:27.691 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:08:27.691 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.691 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.691 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.691 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.691 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:08:27.691 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.691 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.691 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.691 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.691 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:08:27.691 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.691 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.691 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.691 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.691 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:08:27.691 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:08:27.691 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.691 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.692 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:08:27.692 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.692 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.692 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.692 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.692 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:08:27.692 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:08:27.692 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.692 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:27.692 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:27.692 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:27.692 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.692 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.692 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:08:27.692 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.692 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:27.692 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:27.692 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:08:27.692 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.692 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.692 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.692 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:08:27.692 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:08:27.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.667+0000 7ff15bbc2640 1 -- 10.20.193.48:0/984902524 >> v2:10.20.193.111:6812/977811348 conn(0x7ff12403f800 msgr2=0x7ff12405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.667+0000 7ff15bbc2640 1 --2- 10.20.193.48:0/984902524 >> v2:10.20.193.111:6812/977811348 conn(0x7ff12403f800 0x7ff12405fcb0 secure :-1 s=READY pgs=188 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff150008fd0 tx=0x7ff15003a040 comp rx=0 tx=0).stop 2026-02-12T18:08:27.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.667+0000 7ff15bbc2640 10 monclient: shutdown 2026-02-12T18:08:27.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.667+0000 7ff15bbc2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:27.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.667+0000 7ff15bbc2640 1 -- 10.20.193.48:0/984902524 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff15405c950 msgr2=0x7ff15412c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.667+0000 7ff15bbc2640 1 --2- 10.20.193.48:0/984902524 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff15405c950 0x7ff15412c7c0 secure :-1 s=READY pgs=25 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff144006f70 tx=0x7ff14400c520 comp rx=0 tx=0).stop 2026-02-12T18:08:27.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.667+0000 7ff15a138640 1 -- 10.20.193.48:0/984902524 reap_dead start 2026-02-12T18:08:27.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.667+0000 7ff15bbc2640 1 -- 10.20.193.48:0/984902524 shutdown_connections 2026-02-12T18:08:27.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.667+0000 7ff15bbc2640 1 --2- 10.20.193.48:0/984902524 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff15405c950 0x7ff15412c7c0 unknown :-1 s=CLOSED pgs=25 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.667+0000 7ff15bbc2640 1 -- 10.20.193.48:0/984902524 >> 10.20.193.48:0/984902524 conn(0x7ff1540548a0 msgr2=0x7ff154093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:27.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.667+0000 7ff15bbc2640 1 -- 10.20.193.48:0/984902524 shutdown_connections 2026-02-12T18:08:27.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.667+0000 7ff15bbc2640 1 -- 10.20.193.48:0/984902524 wait complete. 2026-02-12T18:08:27.694 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:08:27.694 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2026-02-12T18:08:27.694 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2026-02-12T18:08:27.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.759+0000 7f5cd1f0c640 10 monclient: get_monmap_and_config 2026-02-12T18:08:27.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.759+0000 7f5cd1f0c640 10 monclient: build_initial_monmap 2026-02-12T18:08:27.761 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.759+0000 7f5cd1f0c640 10 monclient: monmap: 2026-02-12T18:08:27.761 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:27.761 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.761 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:27.760394+0000 2026-02-12T18:08:27.761 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:27.760394+0000 2026-02-12T18:08:27.761 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:27.761 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.761 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:27.761 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:27.761 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:27.761 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:27.761 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:27.761 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:27.761 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:27.761 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:27.761 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:27.761 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:27.761 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:27.761 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.759+0000 7f5cd1f0c640 1 Processor -- start 2026-02-12T18:08:27.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.759+0000 7f5cd1f0c640 1 -- start start 2026-02-12T18:08:27.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.759+0000 7f5cd1f0c640 10 monclient: init 2026-02-12T18:08:27.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5cd1f0c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:27.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5cd1f0c640 10 monclient: _add_conns ranks=[1,2,7,0,8,5,3,6,4,10,9] 2026-02-12T18:08:27.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5cd1f0c640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f5ccc05dc40 addr v1:10.20.193.111:6789/0 2026-02-12T18:08:27.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5cd1f0c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5ccc140f30 0x7f5ccc185600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5cd1f0c640 10 monclient(hunting): picked mon.noname-b con 0x7f5ccc140f30 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:08:27.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5cd1f0c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5ccc141360 0x7f5ccc1a5b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5cd1f0c640 10 monclient(hunting): picked mon.noname-i con 0x7f5ccc141360 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:27.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5cd1f0c640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ccc04dc20 con 0x7f5ccc05dc40 2026-02-12T18:08:27.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5cd1f0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5cd1f0c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f5ccc092030 con 0x7f5ccc140f30 2026-02-12T18:08:27.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5cd1f0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5cd1f0c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f5ccc093d10 con 0x7f5ccc141360 2026-02-12T18:08:27.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5cd1f0c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:27.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5cd1f0c640 10 monclient(hunting): authenticate will time out at 746.486120s 2026-02-12T18:08:27.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccaffd640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5ccc140f30 0x7f5ccc185600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccaffd640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5ccc140f30 0x7f5ccc185600 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:52580/0 (socket says 10.20.193.48:52580) 2026-02-12T18:08:27.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccaffd640 1 -- 10.20.193.48:0/2158938372 learned_addr learned my addr 10.20.193.48:0/2158938372 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:27.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccaffd640 10 monclient(hunting): get_auth_request con 0x7f5ccc140f30 auth_method 0 2026-02-12T18:08:27.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccbfff640 1 --2- 10.20.193.48:0/2158938372 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5ccc141360 0x7f5ccc1a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccbfff640 10 monclient(hunting): get_auth_request con 0x7f5ccc141360 auth_method 0 2026-02-12T18:08:27.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccaffd640 10 monclient(hunting): handle_auth_done global_id 35084 payload 274 2026-02-12T18:08:27.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccaffd640 1 -- 10.20.193.48:0/2158938372 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5ccc141360 msgr2=0x7f5ccc1a5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:27.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccaffd640 1 --2- 10.20.193.48:0/2158938372 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5ccc141360 0x7f5ccc1a5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccaffd640 1 -- 10.20.193.48:0/2158938372 >> v1:10.20.193.111:6789/0 conn(0x7f5ccc05dc40 legacy=0x7f5ccc05e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:27.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccaffd640 10 monclient: _finish_hunting 0 2026-02-12T18:08:27.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccaffd640 1 monclient: found mon.noname-b 2026-02-12T18:08:27.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:27.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccaffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:08:27.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.760+0000 7f5ccaffd640 1 -- 10.20.193.48:0/2158938372 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ccc093470 con 0x7f5ccc140f30 2026-02-12T18:08:27.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.762+0000 7f5ccaffd640 1 -- 10.20.193.48:0/2158938372 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5ccc140f30 msgr2=0x7f5ccc185600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.762+0000 7f5ccaffd640 1 --2- 10.20.193.48:0/2158938372 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5ccc140f30 0x7f5ccc185600 secure :-1 s=READY pgs=112 gs=2 cs=0 l=1 c_cookie=3800074963751643357 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cbc0098d0 tx=0x7f5cbc02ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34bc940bbe45a8dd server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cca7fc640 1 -- 10.20.193.48:0/2158938372 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5cbc035340 con 0x7f5ccc140f30 2026-02-12T18:08:27.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cca7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:08:27.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cca7fc640 10 monclient: dump: 2026-02-12T18:08:27.770 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.770 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.770 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.770 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.770 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.770 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.770 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.770 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.770 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.770 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.770 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.770 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.770 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.771 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.771 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.771 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cca7fc640 10 monclient: _finish_auth 0 2026-02-12T18:08:27.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cca7fc640 10 monclient: _check_auth_tickets 2026-02-12T18:08:27.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cca7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:27.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cca7fc640 1 -- 10.20.193.48:0/2158938372 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cbc0354c0 con 0x7f5ccc140f30 2026-02-12T18:08:27.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cd1f0c640 5 monclient: authenticate success, global_id 35084 2026-02-12T18:08:27.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cd1f0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:08:27.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cca7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:27.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cca7fc640 1 -- 10.20.193.48:0/2158938372 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5cbc035af0 con 0x7f5ccc140f30 2026-02-12T18:08:27.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cca7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cca7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:08:27.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cca7fc640 10 monclient: dump: 2026-02-12T18:08:27.771 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.771 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.771 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.771 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.771 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.772 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.772 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.772 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.772 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.772 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.772 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.772 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.772 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.772 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.772 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.772 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cd1f0c640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:27.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cd1f0c640 4 set_mon_vals no callback set 2026-02-12T18:08:27.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cd1f0c640 10 monclient: shutdown 2026-02-12T18:08:27.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cd1f0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:27.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cd1f0c640 1 -- 10.20.193.48:0/2158938372 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5ccc140f30 msgr2=0x7f5ccc185600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cd1f0c640 1 --2- 10.20.193.48:0/2158938372 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5ccc140f30 0x7f5ccc185600 secure :-1 s=READY pgs=112 gs=2 cs=0 l=1 c_cookie=3800074963751643357 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cbc0098d0 tx=0x7f5cbc02ee20 comp rx=0 tx=0).stop 2026-02-12T18:08:27.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cd1f0c640 1 -- 10.20.193.48:0/2158938372 shutdown_connections 2026-02-12T18:08:27.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cd1f0c640 1 --2- 10.20.193.48:0/2158938372 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5ccc141360 0x7f5ccc1a5b50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cd1f0c640 1 --2- 10.20.193.48:0/2158938372 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5ccc140f30 0x7f5ccc185600 unknown :-1 s=CLOSED pgs=112 gs=2 cs=0 l=1 c_cookie=3800074963751643357 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cd1f0c640 1 -- 10.20.193.48:0/2158938372 >> 10.20.193.48:0/2158938372 conn(0x7f5ccc097d10 msgr2=0x7f5ccc094010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:27.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cd1f0c640 1 -- 10.20.193.48:0/2158938372 shutdown_connections 2026-02-12T18:08:27.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.763+0000 7f5cd1f0c640 1 -- 10.20.193.48:0/2158938372 wait complete. 2026-02-12T18:08:27.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5cd1f0c640 10 monclient: build_initial_monmap 2026-02-12T18:08:27.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5cd1f0c640 10 monclient: monmap: 2026-02-12T18:08:27.773 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:27.773 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:27.773 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:27.773 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:27.773 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:27.773 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.773 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:27.773 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:27.773 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:27.773 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:27.773 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:27.773 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:27.773 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:27.773 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:27.773 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:27.773 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5cd1f0c640 1 Processor -- start 2026-02-12T18:08:27.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5cd1f0c640 1 -- start start 2026-02-12T18:08:27.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5cd1f0c640 10 monclient: init 2026-02-12T18:08:27.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5cd1f0c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:27.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5cd1f0c640 10 monclient: _add_conns ranks=[1,7,0,2,3,8,6,4,5] 2026-02-12T18:08:27.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5cd1f0c640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f5ccc05dc40 0x7f5ccc12caf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5cd1f0c640 10 monclient(hunting): picked mon.noname-f con 0x7f5ccc05dc40 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:08:27.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5cd1f0c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5ccc140f30 0x7f5ccc12d030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5cd1f0c640 10 monclient(hunting): picked mon.noname-i con 0x7f5ccc140f30 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:27.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5cd1f0c640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5ccc141360 0x7f5ccc12d570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5cd1f0c640 10 monclient(hunting): picked mon.noname-a con 0x7f5ccc141360 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:08:27.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5cd1f0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5cd1f0c640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f5ccc12e260 con 0x7f5ccc141360 2026-02-12T18:08:27.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5cd1f0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5cd1f0c640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5ccc090c10 con 0x7f5ccc05dc40 2026-02-12T18:08:27.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5cd1f0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5cd1f0c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f5ccc05d130 con 0x7f5ccc140f30 2026-02-12T18:08:27.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5cd1f0c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:27.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5cd1f0c640 10 monclient(hunting): authenticate will time out at 746.490594s 2026-02-12T18:08:27.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccbfff640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5ccc141360 0x7f5ccc12d570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccbfff640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5ccc141360 0x7f5ccc12d570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:38108/0 (socket says 10.20.193.48:38108) 2026-02-12T18:08:27.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccbfff640 1 -- 10.20.193.48:0/3426967285 learned_addr learned my addr 10.20.193.48:0/3426967285 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:27.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccbfff640 10 monclient(hunting): get_auth_request con 0x7f5ccc141360 auth_method 0 2026-02-12T18:08:27.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccaffd640 1 --2- 10.20.193.48:0/3426967285 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5ccc140f30 0x7f5ccc12d030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccb7fe640 1 --2- 10.20.193.48:0/3426967285 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f5ccc05dc40 0x7f5ccc12caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccaffd640 10 monclient(hunting): get_auth_request con 0x7f5ccc140f30 auth_method 0 2026-02-12T18:08:27.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccb7fe640 10 monclient(hunting): get_auth_request con 0x7f5ccc05dc40 auth_method 0 2026-02-12T18:08:27.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccbfff640 10 monclient(hunting): handle_auth_done global_id 5193 payload 824 2026-02-12T18:08:27.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccbfff640 1 -- 10.20.193.48:0/3426967285 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5ccc140f30 msgr2=0x7f5ccc12d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccbfff640 1 --2- 10.20.193.48:0/3426967285 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5ccc140f30 0x7f5ccc12d030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccbfff640 1 -- 10.20.193.48:0/3426967285 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f5ccc05dc40 msgr2=0x7f5ccc12caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccbfff640 1 --2- 10.20.193.48:0/3426967285 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f5ccc05dc40 0x7f5ccc12caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccbfff640 10 monclient: _finish_hunting 0 2026-02-12T18:08:27.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccbfff640 1 monclient: found mon.noname-a 2026-02-12T18:08:27.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:27.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccbfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:08:27.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.764+0000 7f5ccbfff640 1 -- 10.20.193.48:0/3426967285 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cbc0094f0 con 0x7f5ccc141360 2026-02-12T18:08:27.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5ccbfff640 1 -- 10.20.193.48:0/3426967285 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5ccc141360 msgr2=0x7f5ccc12d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5ccbfff640 1 --2- 10.20.193.48:0/3426967285 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5ccc141360 0x7f5ccc12d570 secure :-1 s=READY pgs=221 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cc000f900 tx=0x7f5cc000fdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5ca7fff640 1 -- 10.20.193.48:0/3426967285 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5cc000dbb0 con 0x7f5ccc141360 2026-02-12T18:08:27.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5ca7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5ca7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:08:27.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5ca7fff640 10 monclient: dump: 2026-02-12T18:08:27.777 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.777 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.777 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.777 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.777 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.777 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.777 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.777 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.777 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.777 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.777 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.777 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.777 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.777 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.777 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.777 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5ca7fff640 10 monclient: _finish_auth 0 2026-02-12T18:08:27.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5ca7fff640 10 monclient: _check_auth_tickets 2026-02-12T18:08:27.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5ca7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:27.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5cd1f0c640 5 monclient: authenticate success, global_id 5193 2026-02-12T18:08:27.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5cd1f0c640 10 monclient: _renew_subs 2026-02-12T18:08:27.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5ca7fff640 1 -- 10.20.193.48:0/3426967285 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cc000dd30 con 0x7f5ccc141360 2026-02-12T18:08:27.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5cd1f0c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:08:27.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5cd1f0c640 1 -- 10.20.193.48:0/3426967285 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ccc1302e0 con 0x7f5ccc141360 2026-02-12T18:08:27.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5ca7fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:27.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5ca7fff640 1 -- 10.20.193.48:0/3426967285 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5cc000dea0 con 0x7f5ccc141360 2026-02-12T18:08:27.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5ca7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5cc9ffb640 4 set_mon_vals no callback set 2026-02-12T18:08:27.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5ca7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:08:27.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5ca7fff640 10 monclient: dump: 2026-02-12T18:08:27.778 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.778 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.778 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.778 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.778 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.778 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.778 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.778 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.778 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.779 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.779 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.779 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.779 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.779 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.779 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.779 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5cd1f0c640 10 monclient: _renew_subs 2026-02-12T18:08:27.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5cd1f0c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:08:27.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5cd1f0c640 1 -- 10.20.193.48:0/3426967285 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ccc1405d0 con 0x7f5ccc141360 2026-02-12T18:08:27.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5cd1f0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:27.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5cd1f0c640 1 --2- 10.20.193.48:0/3426967285 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5ccc095410 0x7f5ccc08b750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5cd1f0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.767+0000 7f5cd1f0c640 1 -- 10.20.193.48:0/3426967285 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f5ccc08a400 con 0x7f5ccc095410 2026-02-12T18:08:27.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.768+0000 7f5ca7fff640 1 -- 10.20.193.48:0/3426967285 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f5cc0012070 con 0x7f5ccc141360 2026-02-12T18:08:27.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.768+0000 7f5ccb7fe640 1 --2- 10.20.193.48:0/3426967285 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5ccc095410 0x7f5ccc08b750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.768+0000 7f5ccb7fe640 10 monclient: get_auth_request con 0x7f5ccc095410 auth_method 0 2026-02-12T18:08:27.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.768+0000 7f5ccb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.768+0000 7f5ccb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.768+0000 7f5ccb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.768+0000 7f5ccb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.768+0000 7f5ccb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.768+0000 7f5ccb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.768+0000 7f5ca7fff640 1 --2- 10.20.193.48:0/3426967285 >> v2:10.20.193.111:6812/977811348 conn(0x7f5c9c03f7f0 0x7f5c9c05fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.768+0000 7f5ca7fff640 1 -- 10.20.193.48:0/3426967285 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 3897+0+0 (secure 0 0 0) 0x7f5cc0054270 con 0x7f5ccc141360 2026-02-12T18:08:27.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.768+0000 7f5ccaffd640 1 --2- 10.20.193.48:0/3426967285 >> v2:10.20.193.111:6812/977811348 conn(0x7f5c9c03f7f0 0x7f5c9c05fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.768+0000 7f5ccaffd640 10 monclient: get_auth_request con 0x7f5c9c03f7f0 auth_method 0 2026-02-12T18:08:27.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.768+0000 7f5ccb7fe640 10 monclient(hunting): handle_auth_done global_id 44296 payload 824 2026-02-12T18:08:27.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.768+0000 7f5ccb7fe640 1 -- 10.20.193.48:0/3426967285 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ccc093a30 con 0x7f5ccc095410 2026-02-12T18:08:27.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.770+0000 7f5ccb7fe640 1 -- 10.20.193.48:0/3426967285 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5ccc095410 msgr2=0x7f5ccc08b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.770+0000 7f5ccb7fe640 1 --2- 10.20.193.48:0/3426967285 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5ccc095410 0x7f5ccc08b750 secure :-1 s=READY pgs=26 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cb8006fd0 tx=0x7f5cb8009940 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.770+0000 7f5ca7fff640 1 -- 10.20.193.48:0/3426967285 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5cb8012db0 con 0x7f5ccc095410 2026-02-12T18:08:27.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.770+0000 7f5ca7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.770+0000 7f5ca7fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:08:27.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.770+0000 7f5ca7fff640 10 monclient: dump: 2026-02-12T18:08:27.782 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.782 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.782 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.782 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.782 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.782 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.782 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.782 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.782 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.782 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.782 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.782 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.782 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.783 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.783 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.783 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.770+0000 7f5ccaffd640 1 --2- 10.20.193.48:0/3426967285 >> v2:10.20.193.111:6812/977811348 conn(0x7f5c9c03f7f0 0x7f5c9c05fca0 secure :-1 s=READY pgs=189 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cbc004740 tx=0x7f5cbc033000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.771+0000 7f5ca7fff640 1 -- 10.20.193.48:0/3426967285 <== mon.7 v2:10.20.193.111:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f5cb80128f0 con 0x7f5ccc095410 2026-02-12T18:08:27.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.771+0000 7f5ca7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:27.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.771+0000 7f5ca7fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:27.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.771+0000 7f5ca7fff640 1 -- 10.20.193.48:0/3426967285 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5ccc095410 msgr2=0x7f5ccc08b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.771+0000 7f5ca7fff640 1 --2- 10.20.193.48:0/3426967285 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5ccc095410 0x7f5ccc08b750 secure :-1 s=READY pgs=26 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cb8006fd0 tx=0x7f5cb8009940 comp rx=0 tx=0).stop 2026-02-12T18:08:27.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.771+0000 7f5ca7fff640 1 -- 10.20.193.48:0/3426967285 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5ccc095410 msgr2=0x7f5ccc08b750 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:27.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.771+0000 7f5ca7fff640 1 --2- 10.20.193.48:0/3426967285 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5ccc095410 0x7f5ccc08b750 secure :-1 s=CLOSED pgs=26 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cb8006fd0 tx=0x7f5cb8009940 comp rx=0 tx=0).stop 2026-02-12T18:08:27.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.774+0000 7f5cd1f0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:08:27.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.774+0000 7f5cd1f0c640 1 --2- 10.20.193.48:0/3426967285 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5ccc12dab0 0x7f5ccc08bc90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.774+0000 7f5cd1f0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.774+0000 7f5cd1f0c640 1 -- 10.20.193.48:0/3426967285 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f5ccc050410 con 0x7f5ccc12dab0 2026-02-12T18:08:27.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.774+0000 7f5ccb7fe640 1 --2- 10.20.193.48:0/3426967285 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5ccc12dab0 0x7f5ccc08bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.774+0000 7f5ccb7fe640 10 monclient: get_auth_request con 0x7f5ccc12dab0 auth_method 0 2026-02-12T18:08:27.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.774+0000 7f5ccb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.774+0000 7f5ccb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.774+0000 7f5ccb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.774+0000 7f5ccb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.774+0000 7f5ccb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.774+0000 7f5ccb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.775+0000 7f5ccb7fe640 10 monclient(hunting): handle_auth_done global_id 44305 payload 824 2026-02-12T18:08:27.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.775+0000 7f5ccb7fe640 1 -- 10.20.193.48:0/3426967285 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5ccc141cf0 con 0x7f5ccc12dab0 2026-02-12T18:08:27.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.777+0000 7f5ccb7fe640 1 -- 10.20.193.48:0/3426967285 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5ccc12dab0 msgr2=0x7f5ccc08bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.777+0000 7f5ccb7fe640 1 --2- 10.20.193.48:0/3426967285 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5ccc12dab0 0x7f5ccc08bc90 secure :-1 s=READY pgs=27 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cb8006fd0 tx=0x7f5cb80047a0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.777+0000 7f5ca7fff640 1 -- 10.20.193.48:0/3426967285 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5cb8021070 con 0x7f5ccc12dab0 2026-02-12T18:08:27.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.777+0000 7f5ca7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.777+0000 7f5ca7fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:08:27.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.777+0000 7f5ca7fff640 10 monclient: dump: 2026-02-12T18:08:27.784 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.784 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.784 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.784 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.784 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.784 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.784 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.785 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.785 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.785 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.785 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.785 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.785 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.785 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.785 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.785 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.777+0000 7f5ca7fff640 1 -- 10.20.193.48:0/3426967285 <== mon.7 v2:10.20.193.111:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7f5cb800e6d0 con 0x7f5ccc12dab0 2026-02-12T18:08:27.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.777+0000 7f5ca7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:08:27.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.777+0000 7f5ca7fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:27.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.777+0000 7f5ca7fff640 1 -- 10.20.193.48:0/3426967285 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5ccc12dab0 msgr2=0x7f5ccc08bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.777+0000 7f5ca7fff640 1 --2- 10.20.193.48:0/3426967285 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5ccc12dab0 0x7f5ccc08bc90 secure :-1 s=READY pgs=27 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cb8006fd0 tx=0x7f5cb80047a0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.777+0000 7f5ca7fff640 1 -- 10.20.193.48:0/3426967285 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5ccc12dab0 msgr2=0x7f5ccc08bc90 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:27.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.777+0000 7f5ca7fff640 1 --2- 10.20.193.48:0/3426967285 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5ccc12dab0 0x7f5ccc08bc90 secure :-1 s=CLOSED pgs=27 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cb8006fd0 tx=0x7f5cb80047a0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.786 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:08:27.786 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:27.786 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:27.786 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:08:27.786 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 28, 2026-02-12T18:08:27.786 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 19658, 2026-02-12T18:08:27.786 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:08:27.786 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:08:27.786 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:08:27.786 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:08:27.786 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:08:27.786 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:08:27.786 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:08:27.786 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:08:27.786 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:08:27.786 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:08:27.786 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.787 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 4, 2026-02-12T18:08:27.787 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:27.787 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:08:27.787 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:08:27.787 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:27.787 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:27.787 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:27.787 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:27.787 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:27.787 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:27.787 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:27.787 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:27.787 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:27.787 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:27.787 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:27.787 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:27.787 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:27.787 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.787 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:08:27.788 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:08:27.788 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:27.788 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:27.788 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:27.788 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:27.788 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:27.788 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:27.788 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:27.788 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:27.788 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:27.788 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:27.788 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:27.788 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:27.788 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:27.788 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.788 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.788 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:08:27.788 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:08:27.788 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:08:27.788 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:08:27.788 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:08:27.789 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:08:27.789 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:27.789 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:27.789 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:08:27.789 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:08:27.789 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:08:27.789 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:08:27.789 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:08:27.789 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:08:27.789 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:08:27.789 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:27.789 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:08:27.789 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:27.789 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:27.789 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:27.789 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:27.789 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:27.789 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:27.789 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:27.789 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:27.790 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:27.790 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:27.790 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:27.790 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:27.790 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:27.790 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.790 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:08:27.790 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.790 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:08:27.790 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.790 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:27.790 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:27.790 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.790 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.790 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.790 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.790 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:08:27.790 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.790 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.790 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.791 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.791 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:08:27.791 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.791 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.791 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.791 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.791 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:08:27.791 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:08:27.791 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.791 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.791 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:08:27.791 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.791 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.791 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.791 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:27.791 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:27.791 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.791 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.791 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.791 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.791 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:08:27.792 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.792 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.792 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.792 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.792 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:08:27.792 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.792 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.792 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.792 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.792 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:08:27.792 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:08:27.792 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.792 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.792 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:08:27.792 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.792 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.792 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.792 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:27.792 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:27.792 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.792 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.792 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.793 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.793 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:08:27.793 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.793 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.793 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.793 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.793 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:08:27.793 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.793 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.793 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.793 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.793 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:08:27.793 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:08:27.793 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.793 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.793 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:08:27.793 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.793 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.793 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.793 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:08:27.794 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:08:27.794 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.794 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.794 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.794 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.794 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:08:27.794 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.794 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.794 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.794 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.794 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:08:27.794 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.794 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.794 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.794 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.794 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:08:27.794 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:08:27.794 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.794 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.794 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:08:27.794 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.794 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.795 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.795 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:08:27.795 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:08:27.795 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.795 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.795 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.795 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.795 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:08:27.795 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.795 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.795 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.795 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.795 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:08:27.795 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.795 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.795 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.795 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.795 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:08:27.795 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:08:27.795 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.795 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.795 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:27.795 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.795 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.796 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.796 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:27.796 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:27.796 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.796 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.796 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.796 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.796 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:08:27.796 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.796 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.796 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.796 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.796 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:08:27.796 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.796 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.796 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.796 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.796 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:08:27.796 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:08:27.796 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.796 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.796 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:08:27.796 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.796 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.797 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.797 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:27.797 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:27.797 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.797 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.797 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.797 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.797 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:08:27.797 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.797 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.797 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.797 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.797 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:08:27.797 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.797 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.797 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.797 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.797 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:08:27.797 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:08:27.797 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.797 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.797 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:27.797 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.797 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.798 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.798 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:27.798 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:27.798 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.798 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.798 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.798 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.798 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:08:27.798 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.798 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.798 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.798 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.798 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:08:27.798 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.798 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.798 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.798 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.798 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:08:27.798 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:08:27.798 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.798 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.798 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:08:27.798 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.799 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.799 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.799 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:08:27.799 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:08:27.799 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:27.799 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:27.799 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.799 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:27.799 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:08:27.799 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.799 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.799 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.799 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:27.799 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:08:27.799 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:27.799 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.799 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.799 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.799 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:08:27.799 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:08:27.799 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:27.799 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:27.799 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:08:27.799 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:27.799 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.800 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.800 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.800 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:08:27.800 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:08:27.800 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.800 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:27.800 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:27.800 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:27.800 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.800 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:27.800 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:08:27.800 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:27.800 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:27.800 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:27.800 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:27.800 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:27.800 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:27.800 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:27.800 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:08:27.800 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:08:27.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.777+0000 7f5cd1f0c640 1 -- 10.20.193.48:0/3426967285 >> v2:10.20.193.111:6812/977811348 conn(0x7f5c9c03f7f0 msgr2=0x7f5c9c05fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.777+0000 7f5cd1f0c640 1 --2- 10.20.193.48:0/3426967285 >> v2:10.20.193.111:6812/977811348 conn(0x7f5c9c03f7f0 0x7f5c9c05fca0 secure :-1 s=READY pgs=189 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cbc004740 tx=0x7f5cbc033000 comp rx=0 tx=0).stop 2026-02-12T18:08:27.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.777+0000 7f5cd1f0c640 10 monclient: shutdown 2026-02-12T18:08:27.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.777+0000 7f5cd1f0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:27.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.777+0000 7f5cd1f0c640 1 -- 10.20.193.48:0/3426967285 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5ccc141360 msgr2=0x7f5ccc12d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.777+0000 7f5ccbfff640 1 -- 10.20.193.48:0/3426967285 reap_dead start 2026-02-12T18:08:27.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.777+0000 7f5cd1f0c640 1 --2- 10.20.193.48:0/3426967285 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5ccc141360 0x7f5ccc12d570 secure :-1 s=READY pgs=221 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5cc000f900 tx=0x7f5cc000fdd0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.778+0000 7f5cd1f0c640 1 -- 10.20.193.48:0/3426967285 shutdown_connections 2026-02-12T18:08:27.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.778+0000 7f5cd1f0c640 1 --2- 10.20.193.48:0/3426967285 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5ccc141360 0x7f5ccc12d570 unknown :-1 s=CLOSED pgs=221 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.778+0000 7f5cd1f0c640 1 -- 10.20.193.48:0/3426967285 >> 10.20.193.48:0/3426967285 conn(0x7f5ccc097d10 msgr2=0x7f5ccc056440 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:27.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.778+0000 7f5cd1f0c640 1 -- 10.20.193.48:0/3426967285 shutdown_connections 2026-02-12T18:08:27.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.778+0000 7f5cd1f0c640 1 -- 10.20.193.48:0/3426967285 wait complete. 2026-02-12T18:08:27.802 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:08:27.802 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['e', 'c', 'g'] 2026-02-12T18:08:27.802 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-12T18:08:27.802 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.e 2026-02-12T18:08:27.802 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.e store 2026-02-12T18:08:27.802 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e sync_force --yes-i-really-mean-it 2026-02-12T18:08:27.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.866+0000 7f8d27d0c640 10 monclient: get_monmap_and_config 2026-02-12T18:08:27.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.866+0000 7f8d27d0c640 10 monclient: build_initial_monmap 2026-02-12T18:08:27.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.866+0000 7f8d27d0c640 10 monclient: monmap: 2026-02-12T18:08:27.868 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:27.868 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.868 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:27.867286+0000 2026-02-12T18:08:27.868 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:27.867286+0000 2026-02-12T18:08:27.868 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:27.868 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.868 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:27.868 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:27.868 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:27.868 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:27.868 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:27.868 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:27.868 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:27.868 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:27.868 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:27.868 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:27.868 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:27.869 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.866+0000 7f8d27d0c640 1 Processor -- start 2026-02-12T18:08:27.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.866+0000 7f8d27d0c640 1 -- start start 2026-02-12T18:08:27.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.866+0000 7f8d27d0c640 10 monclient: init 2026-02-12T18:08:27.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.866+0000 7f8d27d0c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:27.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.866+0000 7f8d27d0c640 10 monclient: _add_conns ranks=[5,9,10,6,2,8,0,1,4,3,7] 2026-02-12T18:08:27.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.866+0000 7f8d27d0c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f8d20090070 0x7f8d2005d630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.866+0000 7f8d27d0c640 10 monclient(hunting): picked mon.noname-h con 0x7f8d20090070 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:08:27.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.866+0000 7f8d27d0c640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f8d2008cf80 0x7f8d2005db70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.866+0000 7f8d27d0c640 10 monclient(hunting): picked mon.noname-a con 0x7f8d2008cf80 addr v2:10.20.193.48:3300/0 2026-02-12T18:08:27.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.866+0000 7f8d27d0c640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f8d20141fa0 0x7f8d20142440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.866+0000 7f8d27d0c640 10 monclient(hunting): picked mon.noname-f con 0x7f8d20141fa0 addr v2:10.20.193.111:3300/0 2026-02-12T18:08:27.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.866+0000 7f8d27d0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.866+0000 7f8d27d0c640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f8d20057de0 con 0x7f8d2008cf80 2026-02-12T18:08:27.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.866+0000 7f8d27d0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.866+0000 7f8d27d0c640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f8d20090440 con 0x7f8d20141fa0 2026-02-12T18:08:27.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.866+0000 7f8d27d0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.866+0000 7f8d27d0c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f8d2013f130 con 0x7f8d20090070 2026-02-12T18:08:27.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.866+0000 7f8d27d0c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:27.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.866+0000 7f8d27d0c640 10 monclient(hunting): authenticate will time out at 746.592989s 2026-02-12T18:08:27.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25280640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f8d2008cf80 0x7f8d2005db70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25280640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f8d2008cf80 0x7f8d2005db70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:38110/0 (socket says 10.20.193.48:38110) 2026-02-12T18:08:27.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25280640 1 -- 10.20.193.48:0/4063650403 learned_addr learned my addr 10.20.193.48:0/4063650403 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:27.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25280640 10 monclient(hunting): get_auth_request con 0x7f8d2008cf80 auth_method 0 2026-02-12T18:08:27.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25280640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25280640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25280640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25a81640 1 --2- 10.20.193.48:0/4063650403 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f8d20090070 0x7f8d2005d630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d26282640 1 --2- 10.20.193.48:0/4063650403 >> v2:10.20.193.111:3300/0 conn(0x7f8d20141fa0 0x7f8d20142440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25a81640 10 monclient(hunting): get_auth_request con 0x7f8d20090070 auth_method 0 2026-02-12T18:08:27.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25a81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25a81640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25a81640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d26282640 10 monclient(hunting): get_auth_request con 0x7f8d20141fa0 auth_method 0 2026-02-12T18:08:27.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d26282640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d26282640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d26282640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25280640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25280640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25280640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25a81640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25a81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25a81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25280640 10 monclient(hunting): handle_auth_done global_id 5202 payload 274 2026-02-12T18:08:27.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25280640 1 -- 10.20.193.48:0/4063650403 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f8d20090070 msgr2=0x7f8d2005d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:27.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25280640 1 --2- 10.20.193.48:0/4063650403 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f8d20090070 0x7f8d2005d630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25280640 1 -- 10.20.193.48:0/4063650403 >> v2:10.20.193.111:3300/0 conn(0x7f8d20141fa0 msgr2=0x7f8d20142440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:27.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25280640 1 --2- 10.20.193.48:0/4063650403 >> v2:10.20.193.111:3300/0 conn(0x7f8d20141fa0 0x7f8d20142440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25280640 10 monclient: _finish_hunting 0 2026-02-12T18:08:27.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25280640 1 monclient: found mon.noname-a 2026-02-12T18:08:27.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25280640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:27.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25280640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:08:27.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d25280640 1 -- 10.20.193.48:0/4063650403 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d2004dc20 con 0x7f8d2008cf80 2026-02-12T18:08:27.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.867+0000 7f8d26282640 1 --2- 10.20.193.48:0/4063650403 >> v2:10.20.193.111:3300/0 conn(0x7f8d20141fa0 0x7f8d20142440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:08:27.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.869+0000 7f8d25280640 1 -- 10.20.193.48:0/4063650403 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f8d2008cf80 msgr2=0x7f8d2005db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.869+0000 7f8d25280640 1 --2- 10.20.193.48:0/4063650403 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f8d2008cf80 0x7f8d2005db70 secure :-1 s=READY pgs=222 gs=1 cs=0 l=1 c_cookie=11302035239141502337 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d2008cbb0 tx=0x7f8d1402edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd8e52b53f9ed81 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d24a7f640 1 -- 10.20.193.48:0/4063650403 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8d14035340 con 0x7f8d2008cf80 2026-02-12T18:08:27.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d24a7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d24a7f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:08:27.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d24a7f640 10 monclient: dump: 2026-02-12T18:08:27.878 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.878 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.878 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.878 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.878 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.878 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.878 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.878 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.878 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.878 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.878 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.879 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.879 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.879 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.879 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.879 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d24a7f640 10 monclient: _finish_auth 0 2026-02-12T18:08:27.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d24a7f640 10 monclient: _check_auth_tickets 2026-02-12T18:08:27.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d24a7f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:27.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d24a7f640 1 -- 10.20.193.48:0/4063650403 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d140354c0 con 0x7f8d2008cf80 2026-02-12T18:08:27.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d27d0c640 5 monclient: authenticate success, global_id 5202 2026-02-12T18:08:27.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d27d0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:08:27.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d24a7f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:27.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d24a7f640 1 -- 10.20.193.48:0/4063650403 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8d14035af0 con 0x7f8d2008cf80 2026-02-12T18:08:27.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d24a7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d24a7f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:08:27.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d24a7f640 10 monclient: dump: 2026-02-12T18:08:27.879 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.879 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.879 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.879 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.880 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.880 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.880 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.880 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.880 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.880 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.880 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.880 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.880 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.880 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.880 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.880 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d27d0c640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:27.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d27d0c640 4 set_mon_vals no callback set 2026-02-12T18:08:27.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d27d0c640 10 monclient: shutdown 2026-02-12T18:08:27.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d27d0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:27.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d27d0c640 1 -- 10.20.193.48:0/4063650403 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f8d2008cf80 msgr2=0x7f8d2005db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d27d0c640 1 --2- 10.20.193.48:0/4063650403 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f8d2008cf80 0x7f8d2005db70 secure :-1 s=READY pgs=222 gs=1 cs=0 l=1 c_cookie=11302035239141502337 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d2008cbb0 tx=0x7f8d1402edc0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d27d0c640 1 -- 10.20.193.48:0/4063650403 shutdown_connections 2026-02-12T18:08:27.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d27d0c640 1 --2- 10.20.193.48:0/4063650403 >> v2:10.20.193.111:3300/0 conn(0x7f8d20141fa0 0x7f8d20142440 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d27d0c640 1 --2- 10.20.193.48:0/4063650403 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f8d2008cf80 0x7f8d2005db70 unknown :-1 s=CLOSED pgs=222 gs=1 cs=0 l=1 c_cookie=11302035239141502337 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d27d0c640 1 --2- 10.20.193.48:0/4063650403 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f8d20090070 0x7f8d2005d630 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d27d0c640 1 -- 10.20.193.48:0/4063650403 >> 10.20.193.48:0/4063650403 conn(0x7f8d200546a0 msgr2=0x7f8d20054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:27.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d27d0c640 1 -- 10.20.193.48:0/4063650403 shutdown_connections 2026-02-12T18:08:27.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d27d0c640 1 -- 10.20.193.48:0/4063650403 wait complete. 2026-02-12T18:08:27.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d27d0c640 10 monclient: build_initial_monmap 2026-02-12T18:08:27.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.870+0000 7f8d27d0c640 10 monclient: monmap: 2026-02-12T18:08:27.881 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:27.881 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:27.881 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:27.881 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:27.881 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:27.881 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.881 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:27.881 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:27.881 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:27.881 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:27.881 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:27.881 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:27.881 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:27.882 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:27.882 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:27.882 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d27d0c640 1 Processor -- start 2026-02-12T18:08:27.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d27d0c640 1 -- start start 2026-02-12T18:08:27.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d27d0c640 10 monclient: init 2026-02-12T18:08:27.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d27d0c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:27.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d27d0c640 10 monclient: _add_conns ranks=[8,2,6,4,3,5,0,7,1] 2026-02-12T18:08:27.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d27d0c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8d2008cf80 0x7f8d2010c330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d27d0c640 10 monclient(hunting): picked mon.noname-e con 0x7f8d2008cf80 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:08:27.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d27d0c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f8d20090070 0x7f8d20109760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d27d0c640 10 monclient(hunting): picked mon.noname-b con 0x7f8d20090070 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:08:27.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d27d0c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8d20141fa0 0x7f8d20109ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d27d0c640 10 monclient(hunting): picked mon.noname-d con 0x7f8d20141fa0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:08:27.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d27d0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d27d0c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f8d2013d2f0 con 0x7f8d20090070 2026-02-12T18:08:27.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d27d0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d27d0c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f8d2005ca00 con 0x7f8d20141fa0 2026-02-12T18:08:27.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d27d0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d27d0c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f8d2013d840 con 0x7f8d2008cf80 2026-02-12T18:08:27.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d27d0c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:27.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d27d0c640 10 monclient(hunting): authenticate will time out at 746.597463s 2026-02-12T18:08:27.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25a81640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8d2008cf80 0x7f8d2010c330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25a81640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8d2008cf80 0x7f8d2010c330 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:51154/0 (socket says 10.20.193.48:51154) 2026-02-12T18:08:27.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25a81640 1 -- 10.20.193.48:0/1530536907 learned_addr learned my addr 10.20.193.48:0/1530536907 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:27.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25a81640 10 monclient(hunting): get_auth_request con 0x7f8d2008cf80 auth_method 0 2026-02-12T18:08:27.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25a81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25a81640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25a81640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25280640 1 --2- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f8d20090070 0x7f8d20109760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25280640 10 monclient(hunting): get_auth_request con 0x7f8d20090070 auth_method 0 2026-02-12T18:08:27.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25280640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25280640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25280640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d26282640 1 --2- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8d20141fa0 0x7f8d20109ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25a81640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25a81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25a81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d26282640 10 monclient(hunting): get_auth_request con 0x7f8d20141fa0 auth_method 0 2026-02-12T18:08:27.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d26282640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d26282640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d26282640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25280640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25280640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25280640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d26282640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d26282640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d26282640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25a81640 10 monclient(hunting): handle_auth_done global_id 5147 payload 824 2026-02-12T18:08:27.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25a81640 1 -- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8d20141fa0 msgr2=0x7f8d20109ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25a81640 1 --2- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8d20141fa0 0x7f8d20109ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25a81640 1 -- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f8d20090070 msgr2=0x7f8d20109760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25a81640 1 --2- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f8d20090070 0x7f8d20109760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25a81640 10 monclient: _finish_hunting 0 2026-02-12T18:08:27.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25a81640 1 monclient: found mon.noname-e 2026-02-12T18:08:27.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25a81640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:27.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25a81640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:08:27.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.871+0000 7f8d25a81640 1 -- 10.20.193.48:0/1530536907 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d140094f0 con 0x7f8d2008cf80 2026-02-12T18:08:27.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.873+0000 7f8d25a81640 1 -- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8d2008cf80 msgr2=0x7f8d2010c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.873+0000 7f8d25a81640 1 --2- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8d2008cf80 0x7f8d2010c330 secure :-1 s=READY pgs=126 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d100093f0 tx=0x7f8d1000ed50 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d0e7fc640 1 -- 10.20.193.48:0/1530536907 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8d1000cb50 con 0x7f8d2008cf80 2026-02-12T18:08:27.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d0e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d0e7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:08:27.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d0e7fc640 10 monclient: dump: 2026-02-12T18:08:27.885 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.885 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.885 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.885 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.885 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.885 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.885 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.885 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.885 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.885 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.885 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.885 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.885 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.885 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.885 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.885 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d0e7fc640 10 monclient: _finish_auth 0 2026-02-12T18:08:27.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d0e7fc640 10 monclient: _check_auth_tickets 2026-02-12T18:08:27.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d0e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:27.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d0e7fc640 1 -- 10.20.193.48:0/1530536907 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d1000ccd0 con 0x7f8d2008cf80 2026-02-12T18:08:27.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d27d0c640 5 monclient: authenticate success, global_id 5147 2026-02-12T18:08:27.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d27d0c640 10 monclient: _renew_subs 2026-02-12T18:08:27.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d27d0c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:08:27.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d27d0c640 1 -- 10.20.193.48:0/1530536907 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d2010bea0 con 0x7f8d2008cf80 2026-02-12T18:08:27.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d0e7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:27.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d0e7fc640 1 -- 10.20.193.48:0/1530536907 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8d1000ce40 con 0x7f8d2008cf80 2026-02-12T18:08:27.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d0e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d0ffff640 4 set_mon_vals no callback set 2026-02-12T18:08:27.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d0e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:08:27.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d0e7fc640 10 monclient: dump: 2026-02-12T18:08:27.886 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.886 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.886 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.886 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.886 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.886 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.886 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.887 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.887 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.887 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.887 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.887 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.887 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.887 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.887 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.887 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d27d0c640 10 monclient: _renew_subs 2026-02-12T18:08:27.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d27d0c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:08:27.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d27d0c640 1 -- 10.20.193.48:0/1530536907 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d2005c490 con 0x7f8d2008cf80 2026-02-12T18:08:27.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d27d0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:27.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d27d0c640 1 --2- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8d20090ff0 0x7f8d2010a1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d27d0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d27d0c640 1 -- 10.20.193.48:0/1530536907 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f8d200631f0 con 0x7f8d20090ff0 2026-02-12T18:08:27.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d25280640 1 --2- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8d20090ff0 0x7f8d2010a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d25280640 10 monclient: get_auth_request con 0x7f8d20090ff0 auth_method 0 2026-02-12T18:08:27.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d25280640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d25280640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d25280640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d25280640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d25280640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d25280640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.874+0000 7f8d0e7fc640 1 -- 10.20.193.48:0/1530536907 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f8d10011070 con 0x7f8d2008cf80 2026-02-12T18:08:27.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.875+0000 7f8d25280640 10 monclient(hunting): handle_auth_done global_id 5156 payload 824 2026-02-12T18:08:27.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.875+0000 7f8d25280640 1 -- 10.20.193.48:0/1530536907 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8d2008f750 con 0x7f8d20090ff0 2026-02-12T18:08:27.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.875+0000 7f8d0e7fc640 1 --2- 10.20.193.48:0/1530536907 >> v2:10.20.193.111:6812/977811348 conn(0x7f8cf003f800 0x7f8cf005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.875+0000 7f8d0e7fc640 1 -- 10.20.193.48:0/1530536907 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(117..117 src has 1..117) ==== 3897+0+0 (secure 0 0 0) 0x7f8d10052b50 con 0x7f8d2008cf80 2026-02-12T18:08:27.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.875+0000 7f8d26282640 1 --2- 10.20.193.48:0/1530536907 >> v2:10.20.193.111:6812/977811348 conn(0x7f8cf003f800 0x7f8cf005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.875+0000 7f8d26282640 10 monclient: get_auth_request con 0x7f8cf003f800 auth_method 0 2026-02-12T18:08:27.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.877+0000 7f8d25280640 1 -- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8d20090ff0 msgr2=0x7f8d2010a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.877+0000 7f8d25280640 1 --2- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8d20090ff0 0x7f8d2010a1e0 secure :-1 s=READY pgs=127 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d2008cbb0 tx=0x7f8d140047e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.877+0000 7f8d0e7fc640 1 -- 10.20.193.48:0/1530536907 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8d14035d50 con 0x7f8d20090ff0 2026-02-12T18:08:27.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.877+0000 7f8d0e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.877+0000 7f8d0e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:08:27.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.877+0000 7f8d0e7fc640 10 monclient: dump: 2026-02-12T18:08:27.890 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.890 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.890 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.890 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.890 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.890 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.890 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.890 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.891 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.891 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.891 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.891 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.891 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.891 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.891 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.891 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.877+0000 7f8d0e7fc640 1 -- 10.20.193.48:0/1530536907 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f8d14037440 con 0x7f8d20090ff0 2026-02-12T18:08:27.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.877+0000 7f8d0e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:27.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.877+0000 7f8d0e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:27.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.877+0000 7f8d0e7fc640 1 -- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8d20090ff0 msgr2=0x7f8d2010a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.877+0000 7f8d0e7fc640 1 --2- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8d20090ff0 0x7f8d2010a1e0 secure :-1 s=READY pgs=127 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d2008cbb0 tx=0x7f8d140047e0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.877+0000 7f8d0e7fc640 1 -- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8d20090ff0 msgr2=0x7f8d2010a1e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:27.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.877+0000 7f8d0e7fc640 1 --2- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8d20090ff0 0x7f8d2010a1e0 secure :-1 s=CLOSED pgs=127 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d2008cbb0 tx=0x7f8d140047e0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.877+0000 7f8d26282640 1 --2- 10.20.193.48:0/1530536907 >> v2:10.20.193.111:6812/977811348 conn(0x7f8cf003f800 0x7f8cf005fcb0 secure :-1 s=READY pgs=190 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d2005c800 tx=0x7f8d1c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.881+0000 7f8d27d0c640 10 start_mon_command cmd=[{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2026-02-12T18:08:27.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.881+0000 7f8d27d0c640 1 --2- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8d2012ca90 0x7f8d2012ce90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:27.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.881+0000 7f8d27d0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:27.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.881+0000 7f8d27d0c640 1 -- 10.20.193.48:0/1530536907 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f8d2005f140 con 0x7f8d2012ca90 2026-02-12T18:08:27.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.881+0000 7f8d25280640 1 --2- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8d2012ca90 0x7f8d2012ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:27.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.881+0000 7f8d25280640 10 monclient: get_auth_request con 0x7f8d2012ca90 auth_method 0 2026-02-12T18:08:27.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.881+0000 7f8d25280640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:27.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.881+0000 7f8d25280640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:27.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.881+0000 7f8d25280640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:27.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.881+0000 7f8d25280640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:27.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.881+0000 7f8d25280640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:27.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.881+0000 7f8d25280640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:27.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.881+0000 7f8d25280640 10 monclient(hunting): handle_auth_done global_id 5165 payload 824 2026-02-12T18:08:27.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.881+0000 7f8d25280640 1 -- 10.20.193.48:0/1530536907 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 2: {"prefix": "sync_force", "yes_i_really_mean_it": true}) -- 0x7f8d2005e2f0 con 0x7f8d2012ca90 2026-02-12T18:08:27.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.883+0000 7f8d25280640 1 -- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8d2012ca90 msgr2=0x7f8d2012ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:27.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.883+0000 7f8d25280640 1 --2- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8d2012ca90 0x7f8d2012ce90 secure :-1 s=READY pgs=128 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d140023d0 tx=0x7f8d14004770 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:27.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.883+0000 7f8d0e7fc640 1 -- 10.20.193.48:0/1530536907 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8d14003b90 con 0x7f8d2012ca90 2026-02-12T18:08:27.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.884+0000 7f8d0e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:27.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.884+0000 7f8d0e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:08:27.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.884+0000 7f8d0e7fc640 10 monclient: dump: 2026-02-12T18:08:27.892 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:27.892 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:27.892 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.893 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:27.893 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:27.893 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:27.893 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:27.893 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:27.893 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:27.893 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:27.893 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:27.893 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:27.893 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:27.893 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:27.893 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:27.893 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:27.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.884+0000 7f8d0e7fc640 1 -- 10.20.193.48:0/1530536907 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+83 (secure 0 0 0) 0x7f8d14050070 con 0x7f8d2012ca90 2026-02-12T18:08:27.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.884+0000 7f8d0e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2026-02-12T18:08:27.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.884+0000 7f8d0e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:27.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.884+0000 7f8d0e7fc640 1 -- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8d2012ca90 msgr2=0x7f8d2012ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.884+0000 7f8d0e7fc640 1 --2- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8d2012ca90 0x7f8d2012ce90 secure :-1 s=READY pgs=128 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d140023d0 tx=0x7f8d14004770 comp rx=0 tx=0).stop 2026-02-12T18:08:27.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.884+0000 7f8d0e7fc640 1 -- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8d2012ca90 msgr2=0x7f8d2012ce90 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:27.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.884+0000 7f8d0e7fc640 1 --2- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8d2012ca90 0x7f8d2012ce90 secure :-1 s=CLOSED pgs=128 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d140023d0 tx=0x7f8d14004770 comp rx=0 tx=0).stop 2026-02-12T18:08:27.894 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:08:27.894 INFO:teuthology.orchestra.run.trial048.stdout: "ret": 0, 2026-02-12T18:08:27.894 INFO:teuthology.orchestra.run.trial048.stdout: "msg": "forcing store sync the next time the monitor starts" 2026-02-12T18:08:27.894 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:08:27.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.884+0000 7f8d27d0c640 1 -- 10.20.193.48:0/1530536907 >> v2:10.20.193.111:6812/977811348 conn(0x7f8cf003f800 msgr2=0x7f8cf005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.884+0000 7f8d27d0c640 1 --2- 10.20.193.48:0/1530536907 >> v2:10.20.193.111:6812/977811348 conn(0x7f8cf003f800 0x7f8cf005fcb0 secure :-1 s=READY pgs=190 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d2005c800 tx=0x7f8d1c009040 comp rx=0 tx=0).stop 2026-02-12T18:08:27.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.884+0000 7f8d27d0c640 10 monclient: shutdown 2026-02-12T18:08:27.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.884+0000 7f8d27d0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:27.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.884+0000 7f8d27d0c640 1 -- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8d2008cf80 msgr2=0x7f8d2010c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:27.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.884+0000 7f8d26282640 1 -- 10.20.193.48:0/1530536907 reap_dead start 2026-02-12T18:08:27.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.884+0000 7f8d27d0c640 1 --2- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8d2008cf80 0x7f8d2010c330 secure :-1 s=READY pgs=126 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8d100093f0 tx=0x7f8d1000ed50 comp rx=0 tx=0).stop 2026-02-12T18:08:27.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.884+0000 7f8d27d0c640 1 -- 10.20.193.48:0/1530536907 shutdown_connections 2026-02-12T18:08:27.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.884+0000 7f8d27d0c640 1 --2- 10.20.193.48:0/1530536907 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f8d2008cf80 0x7f8d2010c330 unknown :-1 s=CLOSED pgs=126 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:27.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.884+0000 7f8d27d0c640 1 -- 10.20.193.48:0/1530536907 >> 10.20.193.48:0/1530536907 conn(0x7f8d200546a0 msgr2=0x7f8d20121030 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:27.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.884+0000 7f8d27d0c640 1 -- 10.20.193.48:0/1530536907 shutdown_connections 2026-02-12T18:08:27.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:27.884+0000 7f8d27d0c640 1 -- 10.20.193.48:0/1530536907 wait complete. 2026-02-12T18:08:27.896 INFO:tasks.mon_thrash.mon_thrasher:killing mon.e 2026-02-12T18:08:27.896 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2026-02-12T18:08:27.896 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:08:27.905 INFO:tasks.ceph.mon.e:Stopped 2026-02-12T18:08:27.905 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2026-02-12T18:08:27.905 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2026-02-12T18:08:27.905 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-12T18:08:27.905 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:08:27.955 INFO:tasks.ceph.mon.c:Stopped 2026-02-12T18:08:27.955 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.g 2026-02-12T18:08:27.955 INFO:tasks.mon_thrash.mon_thrasher:killing mon.g 2026-02-12T18:08:27.955 DEBUG:tasks.ceph.mon.g:waiting for process to exit 2026-02-12T18:08:27.955 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:08:27.965 INFO:tasks.ceph.mon.g:Stopped 2026-02-12T18:08:27.965 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 6 2026-02-12T18:08:27.965 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T18:08:28.062 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.058+0000 7fd22bc12640 10 monclient: get_monmap_and_config 2026-02-12T18:08:28.062 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.058+0000 7fd22bc12640 10 monclient: build_initial_monmap 2026-02-12T18:08:28.062 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.058+0000 7fd22bc12640 10 monclient: monmap: 2026-02-12T18:08:28.062 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:28.062 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:28.062 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:28.059150+0000 2026-02-12T18:08:28.063 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:28.059150+0000 2026-02-12T18:08:28.063 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:28.063 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:28.063 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:28.063 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:28.063 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:28.063 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:28.063 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:28.063 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:28.063 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:28.064 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:28.064 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:28.064 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:28.064 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:28.064 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:28.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.058+0000 7fd22bc12640 1 Processor -- start 2026-02-12T18:08:28.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.058+0000 7fd22bc12640 1 -- start start 2026-02-12T18:08:28.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.058+0000 7fd22bc12640 10 monclient: init 2026-02-12T18:08:28.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.058+0000 7fd22bc12640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:28.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.058+0000 7fd22bc12640 10 monclient: _add_conns ranks=[1,6,4,5,7,2,10,0,9,3,8] 2026-02-12T18:08:28.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.058+0000 7fd22bc12640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fd22405dc20 addr v1:10.20.193.111:6789/0 2026-02-12T18:08:28.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.058+0000 7fd22bc12640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd224144660 0x7fd224185500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:28.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.058+0000 7fd22bc12640 10 monclient(hunting): picked mon.noname-d con 0x7fd224144660 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:08:28.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.058+0000 7fd22bc12640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd224185a40 0x7fd2241a5e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:28.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.058+0000 7fd22bc12640 10 monclient(hunting): picked mon.noname-c con 0x7fd224185a40 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:08:28.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.058+0000 7fd22bc12640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd224060390 con 0x7fd22405dc20 2026-02-12T18:08:28.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.058+0000 7fd22bc12640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:28.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.058+0000 7fd22bc12640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fd224092200 con 0x7fd224185a40 2026-02-12T18:08:28.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.058+0000 7fd22bc12640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:28.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.058+0000 7fd22bc12640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fd22408b250 con 0x7fd224144660 2026-02-12T18:08:28.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.058+0000 7fd22bc12640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:28.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.058+0000 7fd22bc12640 10 monclient(hunting): authenticate will time out at 746.784873s 2026-02-12T18:08:28.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.058+0000 7fd22a188640 1 -- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd224185a40 msgr2=0x7fd2241a5e20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.48:3302/0 2026-02-12T18:08:28.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.058+0000 7fd22a188640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd224185a40 0x7fd2241a5e20 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:08:28.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.058+0000 7fd229186640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd224144660 0x7fd224185500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:28.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.059+0000 7fd229186640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd224144660 0x7fd224185500 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:59674/0 (socket says 10.20.193.48:59674) 2026-02-12T18:08:28.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.059+0000 7fd229186640 1 -- 10.20.193.48:0/1818017178 learned_addr learned my addr 10.20.193.48:0/1818017178 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:28.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.059+0000 7fd229186640 10 monclient(hunting): get_auth_request con 0x7fd224144660 auth_method 0 2026-02-12T18:08:28.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.059+0000 7fd229186640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:28.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.059+0000 7fd229186640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:28.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.059+0000 7fd229186640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:28.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.059+0000 7fd229186640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:28.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.059+0000 7fd229186640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:28.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.059+0000 7fd229186640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:28.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.059+0000 7fd229186640 10 monclient(hunting): handle_auth_done global_id 5019 payload 274 2026-02-12T18:08:28.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.059+0000 7fd229186640 1 -- 10.20.193.48:0/1818017178 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd224185a40 msgr2=0x7fd2241a5e20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:08:28.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.059+0000 7fd229186640 1 --2- 10.20.193.48:0/1818017178 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd224185a40 0x7fd2241a5e20 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:28.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.059+0000 7fd229186640 1 -- 10.20.193.48:0/1818017178 >> v1:10.20.193.111:6789/0 conn(0x7fd22405dc20 legacy=0x7fd22405dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:28.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.059+0000 7fd229186640 10 monclient: _finish_hunting 0 2026-02-12T18:08:28.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.059+0000 7fd229186640 1 monclient: found mon.noname-d 2026-02-12T18:08:28.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.059+0000 7fd229186640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:28.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.059+0000 7fd229186640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:08:28.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.059+0000 7fd229186640 1 -- 10.20.193.48:0/1818017178 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd224144a50 con 0x7fd224144660 2026-02-12T18:08:28.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.061+0000 7fd229186640 1 -- 10.20.193.48:0/1818017178 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd224144660 msgr2=0x7fd224185500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:28.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.061+0000 7fd229186640 1 --2- 10.20.193.48:0/1818017178 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd224144660 0x7fd224185500 secure :-1 s=READY pgs=120 gs=2 cs=0 l=1 c_cookie=12674800772343242394 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2180098d0 tx=0x7fd21802eed0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=afe5f026025d9e9a server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:28.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.061+0000 7fd228985640 1 -- 10.20.193.48:0/1818017178 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd21802fc30 con 0x7fd224144660 2026-02-12T18:08:28.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.061+0000 7fd228985640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:28.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.061+0000 7fd228985640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:08:28.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.061+0000 7fd228985640 10 monclient: dump: 2026-02-12T18:08:28.076 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:28.076 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:28.076 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:28.076 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:28.076 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:28.076 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:28.076 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:28.076 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:28.076 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:28.077 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:28.077 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:28.077 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:28.077 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:28.077 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:28.077 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:28.077 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:28.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.061+0000 7fd228985640 10 monclient: _finish_auth 0 2026-02-12T18:08:28.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.061+0000 7fd228985640 10 monclient: _check_auth_tickets 2026-02-12T18:08:28.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.061+0000 7fd228985640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:28.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.061+0000 7fd228985640 1 -- 10.20.193.48:0/1818017178 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd21802fdb0 con 0x7fd224144660 2026-02-12T18:08:28.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.061+0000 7fd228985640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:28.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.061+0000 7fd228985640 1 -- 10.20.193.48:0/1818017178 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd218035cc0 con 0x7fd224144660 2026-02-12T18:08:28.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.061+0000 7fd22bc12640 5 monclient: authenticate success, global_id 5019 2026-02-12T18:08:28.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.061+0000 7fd22bc12640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:28.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.061+0000 7fd22bc12640 4 set_mon_vals no callback set 2026-02-12T18:08:28.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.061+0000 7fd228985640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:28.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.061+0000 7fd228985640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:08:28.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.061+0000 7fd228985640 10 monclient: dump: 2026-02-12T18:08:28.078 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:28.078 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:28.078 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:28.078 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:28.079 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:28.079 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:28.079 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:28.079 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:28.079 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:28.079 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:28.079 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:28.079 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:28.079 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:28.079 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:28.079 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:28.080 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:28.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.062+0000 7fd22bc12640 10 monclient: shutdown 2026-02-12T18:08:28.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.062+0000 7fd22bc12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:28.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.062+0000 7fd22bc12640 1 -- 10.20.193.48:0/1818017178 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd224144660 msgr2=0x7fd224185500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:28.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.062+0000 7fd22bc12640 1 --2- 10.20.193.48:0/1818017178 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd224144660 0x7fd224185500 secure :-1 s=READY pgs=120 gs=2 cs=0 l=1 c_cookie=12674800772343242394 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd2180098d0 tx=0x7fd21802eed0 comp rx=0 tx=0).stop 2026-02-12T18:08:28.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.062+0000 7fd22bc12640 1 -- 10.20.193.48:0/1818017178 shutdown_connections 2026-02-12T18:08:28.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.062+0000 7fd22bc12640 1 --2- 10.20.193.48:0/1818017178 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd224185a40 0x7fd2241a5e20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:28.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.062+0000 7fd22bc12640 1 --2- 10.20.193.48:0/1818017178 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd224144660 0x7fd224185500 unknown :-1 s=CLOSED pgs=120 gs=2 cs=0 l=1 c_cookie=12674800772343242394 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:28.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.062+0000 7fd22bc12640 1 -- 10.20.193.48:0/1818017178 >> 10.20.193.48:0/1818017178 conn(0x7fd2240546d0 msgr2=0x7fd224054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:28.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.062+0000 7fd22bc12640 1 -- 10.20.193.48:0/1818017178 shutdown_connections 2026-02-12T18:08:28.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.062+0000 7fd22bc12640 1 -- 10.20.193.48:0/1818017178 wait complete. 2026-02-12T18:08:28.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.062+0000 7fd22bc12640 10 monclient: build_initial_monmap 2026-02-12T18:08:28.081 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.062+0000 7fd22bc12640 10 monclient: monmap: 2026-02-12T18:08:28.081 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:28.081 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:28.081 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:28.081 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:28.081 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:28.081 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:28.081 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:28.081 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:28.081 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:28.081 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:28.081 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:28.082 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:28.082 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:28.082 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:28.082 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:28.082 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:28.082 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22bc12640 1 Processor -- start 2026-02-12T18:08:28.082 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22bc12640 1 -- start start 2026-02-12T18:08:28.082 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22bc12640 10 monclient: init 2026-02-12T18:08:28.082 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22bc12640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:28.082 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22bc12640 10 monclient: _add_conns ranks=[5,3,1,7,8,4,6,2,0] 2026-02-12T18:08:28.082 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22bc12640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd22405dc20 0x7fd224185240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:28.082 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22bc12640 10 monclient(hunting): picked mon.noname-h con 0x7fd22405dc20 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:08:28.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22bc12640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd224144660 0x7fd2241315c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:28.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22bc12640 10 monclient(hunting): picked mon.noname-g con 0x7fd224144660 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:08:28.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22bc12640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd224185a40 0x7fd224131b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:28.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22bc12640 10 monclient(hunting): picked mon.noname-f con 0x7fd224185a40 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:08:28.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22bc12640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:28.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22bc12640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd22410f000 con 0x7fd224185a40 2026-02-12T18:08:28.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22bc12640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:28.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22bc12640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd22410f2e0 con 0x7fd224144660 2026-02-12T18:08:28.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22bc12640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:28.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22bc12640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fd22408e3d0 con 0x7fd22405dc20 2026-02-12T18:08:28.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22bc12640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:28.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22bc12640 10 monclient(hunting): authenticate will time out at 746.789440s 2026-02-12T18:08:28.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd229186640 1 -- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd224144660 msgr2=0x7fd2241315c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3301/0 2026-02-12T18:08:28.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd229186640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd224144660 0x7fd2241315c0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:08:28.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd229987640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd22405dc20 0x7fd224185240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:28.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd229987640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd22405dc20 0x7fd224185240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3302/0 says I am v2:10.20.193.48:55630/0 (socket says 10.20.193.48:55630) 2026-02-12T18:08:28.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd229987640 1 -- 10.20.193.48:0/4257905705 learned_addr learned my addr 10.20.193.48:0/4257905705 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:28.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd229987640 10 monclient(hunting): get_auth_request con 0x7fd22405dc20 auth_method 0 2026-02-12T18:08:28.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd229987640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:28.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd229987640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:28.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd229987640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:28.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22a188640 1 --2- 10.20.193.48:0/4257905705 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd224185a40 0x7fd224131b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:28.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22a188640 10 monclient(hunting): get_auth_request con 0x7fd224185a40 auth_method 0 2026-02-12T18:08:28.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22a188640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:28.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22a188640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:28.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22a188640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:28.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd229987640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:28.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd229987640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:28.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd229987640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:28.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22a188640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:28.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22a188640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:28.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd22a188640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:28.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd229987640 10 monclient(hunting): handle_auth_done global_id 5072 payload 824 2026-02-12T18:08:28.086 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd229987640 1 -- 10.20.193.48:0/4257905705 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd224144660 msgr2=0x7fd2241315c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:08:28.086 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd229987640 1 --2- 10.20.193.48:0/4257905705 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd224144660 0x7fd2241315c0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:28.086 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd229987640 1 -- 10.20.193.48:0/4257905705 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd224185a40 msgr2=0x7fd224131b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:28.086 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd229987640 1 --2- 10.20.193.48:0/4257905705 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd224185a40 0x7fd224131b00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:28.086 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd229987640 10 monclient: _finish_hunting 0 2026-02-12T18:08:28.086 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd229987640 1 monclient: found mon.noname-h 2026-02-12T18:08:28.086 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd229987640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:28.086 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd229987640 10 monclient: _send_mon_message to mon.noname-h at v2:10.20.193.111:3302/0 2026-02-12T18:08:28.086 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.063+0000 7fd229987640 1 -- 10.20.193.48:0/4257905705 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2180094f0 con 0x7fd22405dc20 2026-02-12T18:08:28.086 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.066+0000 7fd229987640 1 -- 10.20.193.48:0/4257905705 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd22405dc20 msgr2=0x7fd224185240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:28.086 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.066+0000 7fd229987640 1 --2- 10.20.193.48:0/4257905705 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd22405dc20 0x7fd224185240 secure :-1 s=READY pgs=128 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd21400c480 tx=0x7fd21400c950 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:28.086 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.067+0000 7fd2127fc640 1 -- 10.20.193.48:0/4257905705 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd214006d50 con 0x7fd22405dc20 2026-02-12T18:08:28.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.067+0000 7fd2127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:28.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.067+0000 7fd2127fc640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2026-02-12T18:08:28.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.067+0000 7fd2127fc640 10 monclient: dump: 2026-02-12T18:08:28.087 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:28.087 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:28.087 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:28.087 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:28.087 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:28.087 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:28.087 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:28.087 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:28.087 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:28.087 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:28.088 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:28.088 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:28.088 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:28.088 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:28.088 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:28.088 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:28.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.067+0000 7fd2127fc640 10 monclient: _finish_auth 0 2026-02-12T18:08:28.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.067+0000 7fd2127fc640 10 monclient: _check_auth_tickets 2026-02-12T18:08:28.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.067+0000 7fd2127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:28.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.067+0000 7fd2127fc640 1 -- 10.20.193.48:0/4257905705 <== mon.5 v2:10.20.193.111:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd214007030 con 0x7fd22405dc20 2026-02-12T18:08:28.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.067+0000 7fd2127fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:28.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.067+0000 7fd2127fc640 1 -- 10.20.193.48:0/4257905705 <== mon.5 v2:10.20.193.111:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd214007660 con 0x7fd22405dc20 2026-02-12T18:08:28.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.067+0000 7fd22bc12640 5 monclient: authenticate success, global_id 5072 2026-02-12T18:08:28.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.067+0000 7fd22bc12640 10 monclient: _renew_subs 2026-02-12T18:08:28.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.067+0000 7fd22bc12640 10 monclient: _send_mon_message to mon.h at v2:10.20.193.111:3302/0 2026-02-12T18:08:28.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.067+0000 7fd213fff640 4 set_mon_vals no callback set 2026-02-12T18:08:28.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.067+0000 7fd22bc12640 1 -- 10.20.193.48:0/4257905705 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd22408dcf0 con 0x7fd22405dc20 2026-02-12T18:08:28.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.067+0000 7fd2127fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:28.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.067+0000 7fd2127fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:08:28.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.067+0000 7fd2127fc640 10 monclient: dump: 2026-02-12T18:08:28.089 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:28.089 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:28.089 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:28.089 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:28.089 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:28.090 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:28.090 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:28.090 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:28.090 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:28.090 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:28.090 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:28.090 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:28.090 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:28.090 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:28.090 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:28.090 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:28.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.067+0000 7fd22bc12640 10 monclient: _renew_subs 2026-02-12T18:08:28.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.067+0000 7fd22bc12640 10 monclient: _send_mon_message to mon.h at v2:10.20.193.111:3302/0 2026-02-12T18:08:28.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.067+0000 7fd22bc12640 1 -- 10.20.193.48:0/4257905705 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fd224122ae0 con 0x7fd22405dc20 2026-02-12T18:08:28.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.067+0000 7fd22bc12640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:28.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.067+0000 7fd22bc12640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:28.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.067+0000 7fd22bc12640 10 monclient: _send_mon_message to mon.h at v2:10.20.193.111:3302/0 2026-02-12T18:08:28.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.067+0000 7fd22bc12640 1 -- 10.20.193.48:0/4257905705 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd224092510 con 0x7fd22405dc20 2026-02-12T18:08:28.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.068+0000 7fd2127fc640 1 -- 10.20.193.48:0/4257905705 <== mon.5 v2:10.20.193.111:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fd2140071a0 con 0x7fd22405dc20 2026-02-12T18:08:28.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.068+0000 7fd2127fc640 1 --2- 10.20.193.48:0/4257905705 >> v2:10.20.193.111:6812/977811348 conn(0x7fd1f403f7c0 0x7fd1f405fc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:28.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.068+0000 7fd2127fc640 1 -- 10.20.193.48:0/4257905705 <== mon.5 v2:10.20.193.111:3302/0 5 ==== osd_map(118..118 src has 1..118) ==== 3503+0+0 (secure 0 0 0) 0x7fd2140525d0 con 0x7fd22405dc20 2026-02-12T18:08:28.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.068+0000 7fd229186640 1 --2- 10.20.193.48:0/4257905705 >> v2:10.20.193.111:6812/977811348 conn(0x7fd1f403f7c0 0x7fd1f405fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:28.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.068+0000 7fd229186640 10 monclient: get_auth_request con 0x7fd1f403f7c0 auth_method 0 2026-02-12T18:08:28.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.071+0000 7fd229186640 1 --2- 10.20.193.48:0/4257905705 >> v2:10.20.193.111:6812/977811348 conn(0x7fd1f403f7c0 0x7fd1f405fc70 secure :-1 s=READY pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd218009820 tx=0x7fd218033000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:28.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.071+0000 7fd2127fc640 1 -- 10.20.193.48:0/4257905705 <== mon.5 v2:10.20.193.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fd214010d10 con 0x7fd22405dc20 2026-02-12T18:08:28.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.071+0000 7fd2127fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:28.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.071+0000 7fd2127fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:28.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.216+0000 7fd22bc12640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T18:08:28.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.216+0000 7fd22bc12640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T18:08:28.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.216+0000 7fd22bc12640 10 monclient: _send_mon_message to mon.h at v2:10.20.193.111:3302/0 2026-02-12T18:08:28.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.216+0000 7fd22bc12640 1 -- 10.20.193.48:0/4257905705 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd22405dff0 con 0x7fd22405dc20 2026-02-12T18:08:28.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.216+0000 7fd2127fc640 1 -- 10.20.193.48:0/4257905705 <== mon.5 v2:10.20.193.111:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3660 (secure 0 0 0) 0x7fd2140102e0 con 0x7fd22405dc20 2026-02-12T18:08:28.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.216+0000 7fd2127fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T18:08:28.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.216+0000 7fd2127fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:28.219 INFO:teuthology.orchestra.run.trial048.stdout:{"election_epoch":28,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","modified":"2026-02-12T18:05:32.850777Z","created":"2026-02-12T18:05:32.850777Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3300","nonce":0},{"type":"v1","addr":"10.20.193.48:6789","nonce":0}]},"addr":"10.20.193.48:6789/0","public_addr":"10.20.193.48:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850827+0000","crush_location":[]},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3300","nonce":0},{"type":"v1","addr":"10.20.193.111:6789","nonce":0}]},"addr":"10.20.193.111:6789/0","public_addr":"10.20.193.111:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850829+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3301","nonce":0},{"type":"v1","addr":"10.20.193.48:6790","nonce":0}]},"addr":"10.20.193.48:6790/0","public_addr":"10.20.193.48:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850830+0000","crush_location":[]},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3301","nonce":0},{"type":"v1","addr":"10.20.193.111:6790","nonce":0}]},"addr":"10.20.193.111:6790/0","public_addr":"10.20.193.111:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850833+0000","crush_location":[]},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3302","nonce":0},{"type":"v1","addr":"10.20.193.48:6791","nonce":0}]},"addr":"10.20.193.48:6791/0","public_addr":"10.20.193.48:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3302","nonce":0},{"type":"v1","addr":"10.20.193.111:6791","nonce":0}]},"addr":"10.20.193.111:6791/0","public_addr":"10.20.193.111:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850834+0000","crush_location":[]},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3303","nonce":0},{"type":"v1","addr":"10.20.193.48:6792","nonce":0}]},"addr":"10.20.193.48:6792/0","public_addr":"10.20.193.48:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3303","nonce":0},{"type":"v1","addr":"10.20.193.111:6792","nonce":0}]},"addr":"10.20.193.111:6792/0","public_addr":"10.20.193.111:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850835+0000","crush_location":[]},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3304","nonce":0},{"type":"v1","addr":"10.20.193.48:6793","nonce":0}]},"addr":"10.20.193.48:6793/0","public_addr":"10.20.193.48:6793/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850832+0000","crush_location":[]}]}} 2026-02-12T18:08:28.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.217+0000 7fd22bc12640 1 -- 10.20.193.48:0/4257905705 >> v2:10.20.193.111:6812/977811348 conn(0x7fd1f403f7c0 msgr2=0x7fd1f405fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:28.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.217+0000 7fd22bc12640 1 --2- 10.20.193.48:0/4257905705 >> v2:10.20.193.111:6812/977811348 conn(0x7fd1f403f7c0 0x7fd1f405fc70 secure :-1 s=READY pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd218009820 tx=0x7fd218033000 comp rx=0 tx=0).stop 2026-02-12T18:08:28.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.217+0000 7fd22bc12640 10 monclient: shutdown 2026-02-12T18:08:28.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.217+0000 7fd22bc12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:28.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.217+0000 7fd22bc12640 1 -- 10.20.193.48:0/4257905705 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd22405dc20 msgr2=0x7fd224185240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:28.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.217+0000 7fd22bc12640 1 --2- 10.20.193.48:0/4257905705 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd22405dc20 0x7fd224185240 secure :-1 s=READY pgs=128 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd21400c480 tx=0x7fd21400c950 comp rx=0 tx=0).stop 2026-02-12T18:08:28.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.217+0000 7fd22bc12640 1 -- 10.20.193.48:0/4257905705 shutdown_connections 2026-02-12T18:08:28.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.217+0000 7fd22bc12640 1 --2- 10.20.193.48:0/4257905705 >> v2:10.20.193.111:6812/977811348 conn(0x7fd1f403f7c0 0x7fd1f405fc70 unknown :-1 s=CLOSED pgs=191 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:28.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.217+0000 7fd22bc12640 1 --2- 10.20.193.48:0/4257905705 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd224185a40 0x7fd224131b00 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:28.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.217+0000 7fd22bc12640 1 --2- 10.20.193.48:0/4257905705 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd224144660 0x7fd2241315c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:28.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.217+0000 7fd22bc12640 1 --2- 10.20.193.48:0/4257905705 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd22405dc20 0x7fd224185240 unknown :-1 s=CLOSED pgs=128 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:28.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.217+0000 7fd22bc12640 1 -- 10.20.193.48:0/4257905705 >> 10.20.193.48:0/4257905705 conn(0x7fd2240546d0 msgr2=0x7fd2241255a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:28.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.217+0000 7fd22bc12640 1 -- 10.20.193.48:0/4257905705 shutdown_connections 2026-02-12T18:08:28.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:28.217+0000 7fd22bc12640 1 -- 10.20.193.48:0/4257905705 wait complete. 2026-02-12T18:08:28.308 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.e is failed for ~0s 2026-02-12T18:08:28.397 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:08:28.397 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28442]: starting. 2026-02-12T18:08:28.397 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28442]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-28340 2026-02-12T18:08:28.397 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28442]: shutting down. 2026-02-12T18:08:28.399 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:08:28.399 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:08:28.399 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:08:28.401 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:08:31.228 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T18:08:31.295 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.293+0000 7f2b07dd4640 10 monclient: get_monmap_and_config 2026-02-12T18:08:31.295 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.293+0000 7f2b07dd4640 10 monclient: build_initial_monmap 2026-02-12T18:08:31.295 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.293+0000 7f2b07dd4640 10 monclient: monmap: 2026-02-12T18:08:31.295 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:31.295 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:31.295 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:31.295001+0000 2026-02-12T18:08:31.295 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:31.295001+0000 2026-02-12T18:08:31.295 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:31.295 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:31.295 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:31.295 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:31.295 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:31.295 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:31.295 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:31.295 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:31.295 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:31.295 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:31.295 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:31.295 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:31.295 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:31.295 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:31.296 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b07dd4640 1 Processor -- start 2026-02-12T18:08:31.296 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b07dd4640 1 -- start start 2026-02-12T18:08:31.296 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b07dd4640 10 monclient: init 2026-02-12T18:08:31.296 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b07dd4640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:31.296 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b07dd4640 10 monclient: _add_conns ranks=[2,3,7,1,10,0,9,6,4,8,5] 2026-02-12T18:08:31.296 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b07dd4640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2b0005dc20 0x7f2b00144660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:31.296 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b07dd4640 10 monclient(hunting): picked mon.noname-b con 0x7f2b0005dc20 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:08:31.296 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b07dd4640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2b0005dff0 0x7f2b0005e3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:31.296 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b07dd4640 10 monclient(hunting): picked mon.noname-g con 0x7f2b0005dff0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:08:31.296 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b07dd4640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2b00089df0 0x7f2b0008a240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:31.296 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b07dd4640 10 monclient(hunting): picked mon.noname-i con 0x7f2b00089df0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:31.296 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b07dd4640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:31.296 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b07dd4640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f2b00093a30 con 0x7f2b0005dc20 2026-02-12T18:08:31.296 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b07dd4640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:31.296 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b07dd4640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2b00092200 con 0x7f2b0005dff0 2026-02-12T18:08:31.296 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b07dd4640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b07dd4640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f2b0008b250 con 0x7f2b00089df0 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b07dd4640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b07dd4640 10 monclient(hunting): authenticate will time out at 750.020743s 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b05348640 1 -- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2b0005dff0 msgr2=0x7f2b0005e3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3301/0 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b05348640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2b0005dff0 0x7f2b0005e3c0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b05b49640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2b0005dc20 0x7f2b00144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b05b49640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2b0005dc20 0x7f2b00144660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:52620/0 (socket says 10.20.193.48:52620) 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b05b49640 1 -- 10.20.193.48:0/998599788 learned_addr learned my addr 10.20.193.48:0/998599788 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b05b49640 10 monclient(hunting): get_auth_request con 0x7f2b0005dc20 auth_method 0 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b05b49640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b05b49640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b05b49640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b05b49640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b05b49640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b05b49640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b0634a640 1 --2- 10.20.193.48:0/998599788 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2b00089df0 0x7f2b0008a240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b0634a640 10 monclient(hunting): get_auth_request con 0x7f2b00089df0 auth_method 0 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b0634a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b0634a640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.294+0000 7f2b0634a640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.295+0000 7f2b05b49640 10 monclient(hunting): handle_auth_done global_id 35120 payload 274 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.295+0000 7f2b05b49640 1 -- 10.20.193.48:0/998599788 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2b00089df0 msgr2=0x7f2b0008a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.295+0000 7f2b05b49640 1 --2- 10.20.193.48:0/998599788 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2b00089df0 0x7f2b0008a240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.295+0000 7f2b05b49640 1 -- 10.20.193.48:0/998599788 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2b0005dff0 msgr2=0x7f2b0005e3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.295+0000 7f2b05b49640 1 --2- 10.20.193.48:0/998599788 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2b0005dff0 0x7f2b0005e3c0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.295+0000 7f2b05b49640 10 monclient: _finish_hunting 0 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.295+0000 7f2b05b49640 1 monclient: found mon.noname-b 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.295+0000 7f2b05b49640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.295+0000 7f2b05b49640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:08:31.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.295+0000 7f2b05b49640 1 -- 10.20.193.48:0/998599788 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b00060390 con 0x7f2b0005dc20 2026-02-12T18:08:31.298 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.297+0000 7f2b05b49640 1 -- 10.20.193.48:0/998599788 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2b0005dc20 msgr2=0x7f2b00144660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:31.298 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.297+0000 7f2b05b49640 1 --2- 10.20.193.48:0/998599788 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2b0005dc20 0x7f2b00144660 secure :-1 s=READY pgs=135 gs=1 cs=0 l=1 c_cookie=15748918475732378284 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2af0009900 tx=0x7f2af002eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da8f65e98e9d62ac server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.297+0000 7f2b04b47640 1 -- 10.20.193.48:0/998599788 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2af0035340 con 0x7f2b0005dc20 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.297+0000 7f2b04b47640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.297+0000 7f2b04b47640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.297+0000 7f2b04b47640 10 monclient: dump: 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.297+0000 7f2b04b47640 10 monclient: _finish_auth 0 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.297+0000 7f2b04b47640 10 monclient: _check_auth_tickets 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.297+0000 7f2b04b47640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.297+0000 7f2b04b47640 1 -- 10.20.193.48:0/998599788 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af00354c0 con 0x7f2b0005dc20 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.297+0000 7f2b07dd4640 5 monclient: authenticate success, global_id 35120 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.297+0000 7f2b07dd4640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.297+0000 7f2b04b47640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.297+0000 7f2b04b47640 1 -- 10.20.193.48:0/998599788 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2af0035af0 con 0x7f2b0005dc20 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.297+0000 7f2b07dd4640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.297+0000 7f2b07dd4640 4 set_mon_vals no callback set 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.297+0000 7f2b04b47640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.297+0000 7f2b04b47640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.297+0000 7f2b04b47640 10 monclient: dump: 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:31.299 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:31.300 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:31.300 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:31.300 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:31.300 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:31.300 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:31.300 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:31.300 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:31.300 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:31.300 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:31.300 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:31.300 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:31.300 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:31.300 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:31.300 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.298+0000 7f2b07dd4640 10 monclient: shutdown 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.298+0000 7f2b07dd4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.298+0000 7f2b07dd4640 1 -- 10.20.193.48:0/998599788 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2b0005dc20 msgr2=0x7f2b00144660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.298+0000 7f2b07dd4640 1 --2- 10.20.193.48:0/998599788 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2b0005dc20 0x7f2b00144660 secure :-1 s=READY pgs=135 gs=1 cs=0 l=1 c_cookie=15748918475732378284 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2af0009900 tx=0x7f2af002eeb0 comp rx=0 tx=0).stop 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.298+0000 7f2b07dd4640 1 -- 10.20.193.48:0/998599788 shutdown_connections 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.298+0000 7f2b07dd4640 1 --2- 10.20.193.48:0/998599788 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2b00089df0 0x7f2b0008a240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.298+0000 7f2b07dd4640 1 --2- 10.20.193.48:0/998599788 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2b0005dff0 0x7f2b0005e3c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.298+0000 7f2b07dd4640 1 --2- 10.20.193.48:0/998599788 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2b0005dc20 0x7f2b00144660 unknown :-1 s=CLOSED pgs=135 gs=1 cs=0 l=1 c_cookie=15748918475732378284 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.298+0000 7f2b07dd4640 1 -- 10.20.193.48:0/998599788 >> 10.20.193.48:0/998599788 conn(0x7f2b000546d0 msgr2=0x7f2b00054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.298+0000 7f2b07dd4640 1 -- 10.20.193.48:0/998599788 shutdown_connections 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.298+0000 7f2b07dd4640 1 -- 10.20.193.48:0/998599788 wait complete. 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.298+0000 7f2b07dd4640 10 monclient: build_initial_monmap 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.298+0000 7f2b07dd4640 10 monclient: monmap: 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:31.301 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b07dd4640 1 Processor -- start 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b07dd4640 1 -- start start 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b07dd4640 10 monclient: init 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b07dd4640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b07dd4640 10 monclient: _add_conns ranks=[8,6,3,4,2,1,7,5,0] 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b07dd4640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2b0005dc20 0x7f2b00111c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b07dd4640 10 monclient(hunting): picked mon.noname-e con 0x7f2b0005dc20 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b07dd4640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f2b0005dff0 0x7f2b001121d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b07dd4640 10 monclient(hunting): picked mon.noname-d con 0x7f2b0005dff0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b07dd4640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2b00089df0 0x7f2b0008f720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b07dd4640 10 monclient(hunting): picked mon.noname-g con 0x7f2b00089df0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b07dd4640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b07dd4640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2b0010dc10 con 0x7f2b00089df0 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b07dd4640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b07dd4640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f2b0010f130 con 0x7f2b0005dff0 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b07dd4640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b07dd4640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f2b0010f410 con 0x7f2b0005dc20 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b07dd4640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b07dd4640 10 monclient(hunting): authenticate will time out at 750.025302s 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b05b49640 1 -- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2b0005dc20 msgr2=0x7f2b00111c90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.48:3304/0 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b05b49640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2b0005dc20 0x7f2b00111c90 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b0634a640 1 -- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2b00089df0 msgr2=0x7f2b0008f720 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3301/0 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b05348640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f2b0005dff0 0x7f2b001121d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b0634a640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2b00089df0 0x7f2b0008f720 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b05348640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f2b0005dff0 0x7f2b001121d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:59686/0 (socket says 10.20.193.48:59686) 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b05348640 1 -- 10.20.193.48:0/2881126969 learned_addr learned my addr 10.20.193.48:0/2881126969 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b05348640 10 monclient(hunting): get_auth_request con 0x7f2b0005dff0 auth_method 0 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b05348640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b05348640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b05348640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b05348640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b05348640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b05348640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b05348640 10 monclient(hunting): handle_auth_done global_id 5028 payload 824 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b05348640 1 -- 10.20.193.48:0/2881126969 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2b0005dc20 msgr2=0x7f2b00111c90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b05348640 1 --2- 10.20.193.48:0/2881126969 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2b0005dc20 0x7f2b00111c90 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b05348640 1 -- 10.20.193.48:0/2881126969 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2b00089df0 msgr2=0x7f2b0008f720 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b05348640 1 --2- 10.20.193.48:0/2881126969 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2b00089df0 0x7f2b0008f720 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b05348640 10 monclient: _finish_hunting 0 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b05348640 1 monclient: found mon.noname-d 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b05348640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b05348640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:08:31.302 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.299+0000 7f2b05348640 1 -- 10.20.193.48:0/2881126969 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2af00094f0 con 0x7f2b0005dff0 2026-02-12T18:08:31.303 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.301+0000 7f2b05348640 1 -- 10.20.193.48:0/2881126969 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f2b0005dff0 msgr2=0x7f2b001121d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:31.303 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.301+0000 7f2b05348640 1 --2- 10.20.193.48:0/2881126969 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f2b0005dff0 0x7f2b001121d0 secure :-1 s=READY pgs=132 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2af400b540 tx=0x7f2af400ba10 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:31.303 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.301+0000 7f2aee7fc640 1 -- 10.20.193.48:0/2881126969 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2af4005530 con 0x7f2b0005dff0 2026-02-12T18:08:31.303 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.301+0000 7f2aee7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:31.303 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.301+0000 7f2aee7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:08:31.303 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.301+0000 7f2aee7fc640 10 monclient: dump: 2026-02-12T18:08:31.303 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:31.303 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:31.303 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:31.303 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:31.303 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:31.303 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:31.303 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:31.303 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:31.303 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:31.303 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:31.303 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:31.303 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:31.303 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:31.303 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:31.303 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:31.303 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:31.303 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.301+0000 7f2aee7fc640 10 monclient: _finish_auth 0 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.301+0000 7f2aee7fc640 10 monclient: _check_auth_tickets 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.301+0000 7f2aee7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.301+0000 7f2aee7fc640 1 -- 10.20.193.48:0/2881126969 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2af4005690 con 0x7f2b0005dff0 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.301+0000 7f2b07dd4640 5 monclient: authenticate success, global_id 5028 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.301+0000 7f2b07dd4640 10 monclient: _renew_subs 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.301+0000 7f2b07dd4640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.301+0000 7f2b07dd4640 1 -- 10.20.193.48:0/2881126969 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b0010e8b0 con 0x7f2b0005dff0 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.302+0000 7f2aee7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.302+0000 7f2aee7fc640 1 -- 10.20.193.48:0/2881126969 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2af4005800 con 0x7f2b0005dff0 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.302+0000 7f2aee7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.302+0000 7f2aeffff640 4 set_mon_vals no callback set 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.302+0000 7f2aee7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.302+0000 7f2aee7fc640 10 monclient: dump: 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.302+0000 7f2b07dd4640 10 monclient: _renew_subs 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.302+0000 7f2b07dd4640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:08:31.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.302+0000 7f2b07dd4640 1 -- 10.20.193.48:0/2881126969 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b0010ee50 con 0x7f2b0005dff0 2026-02-12T18:08:31.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.302+0000 7f2b07dd4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:31.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.302+0000 7f2b07dd4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:31.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.302+0000 7f2b07dd4640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:08:31.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.302+0000 7f2b07dd4640 1 -- 10.20.193.48:0/2881126969 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b00092510 con 0x7f2b0005dff0 2026-02-12T18:08:31.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.302+0000 7f2aee7fc640 1 -- 10.20.193.48:0/2881126969 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f2af400d040 con 0x7f2b0005dff0 2026-02-12T18:08:31.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.302+0000 7f2aee7fc640 1 --2- 10.20.193.48:0/2881126969 >> v2:10.20.193.111:6812/977811348 conn(0x7f2ad003f780 0x7f2ad005fc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:31.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.302+0000 7f2aee7fc640 1 -- 10.20.193.48:0/2881126969 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(118..118 src has 1..118) ==== 3503+0+0 (secure 0 0 0) 0x7f2af4052b20 con 0x7f2b0005dff0 2026-02-12T18:08:31.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.303+0000 7f2b05b49640 1 --2- 10.20.193.48:0/2881126969 >> v2:10.20.193.111:6812/977811348 conn(0x7f2ad003f780 0x7f2ad005fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:31.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.303+0000 7f2b05b49640 10 monclient: get_auth_request con 0x7f2ad003f780 auth_method 0 2026-02-12T18:08:31.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.305+0000 7f2aee7fc640 1 -- 10.20.193.48:0/2881126969 <== mon.6 v2:10.20.193.48:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f2af400fb70 con 0x7f2b0005dff0 2026-02-12T18:08:31.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.305+0000 7f2aee7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:31.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.305+0000 7f2aee7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:31.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.305+0000 7f2b05b49640 1 --2- 10.20.193.48:0/2881126969 >> v2:10.20.193.111:6812/977811348 conn(0x7f2ad003f780 0x7f2ad005fc30 secure :-1 s=READY pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2af00023d0 tx=0x7f2af0033000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:31.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.448+0000 7f2b07dd4640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T18:08:31.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.448+0000 7f2b07dd4640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T18:08:31.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.448+0000 7f2b07dd4640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:08:31.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.448+0000 7f2b07dd4640 1 -- 10.20.193.48:0/2881126969 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2b00144660 con 0x7f2b0005dff0 2026-02-12T18:08:31.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.448+0000 7f2aee7fc640 1 -- 10.20.193.48:0/2881126969 <== mon.6 v2:10.20.193.48:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3660 (secure 0 0 0) 0x7f2af4013020 con 0x7f2b0005dff0 2026-02-12T18:08:31.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.448+0000 7f2aee7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T18:08:31.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.448+0000 7f2aee7fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:31.451 INFO:teuthology.orchestra.run.trial048.stdout:{"election_epoch":28,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","modified":"2026-02-12T18:05:32.850777Z","created":"2026-02-12T18:05:32.850777Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3300","nonce":0},{"type":"v1","addr":"10.20.193.48:6789","nonce":0}]},"addr":"10.20.193.48:6789/0","public_addr":"10.20.193.48:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850827+0000","crush_location":[]},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3300","nonce":0},{"type":"v1","addr":"10.20.193.111:6789","nonce":0}]},"addr":"10.20.193.111:6789/0","public_addr":"10.20.193.111:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850829+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3301","nonce":0},{"type":"v1","addr":"10.20.193.48:6790","nonce":0}]},"addr":"10.20.193.48:6790/0","public_addr":"10.20.193.48:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850830+0000","crush_location":[]},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3301","nonce":0},{"type":"v1","addr":"10.20.193.111:6790","nonce":0}]},"addr":"10.20.193.111:6790/0","public_addr":"10.20.193.111:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850833+0000","crush_location":[]},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3302","nonce":0},{"type":"v1","addr":"10.20.193.48:6791","nonce":0}]},"addr":"10.20.193.48:6791/0","public_addr":"10.20.193.48:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3302","nonce":0},{"type":"v1","addr":"10.20.193.111:6791","nonce":0}]},"addr":"10.20.193.111:6791/0","public_addr":"10.20.193.111:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850834+0000","crush_location":[]},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3303","nonce":0},{"type":"v1","addr":"10.20.193.48:6792","nonce":0}]},"addr":"10.20.193.48:6792/0","public_addr":"10.20.193.48:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3303","nonce":0},{"type":"v1","addr":"10.20.193.111:6792","nonce":0}]},"addr":"10.20.193.111:6792/0","public_addr":"10.20.193.111:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850835+0000","crush_location":[]},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3304","nonce":0},{"type":"v1","addr":"10.20.193.48:6793","nonce":0}]},"addr":"10.20.193.48:6793/0","public_addr":"10.20.193.48:6793/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850832+0000","crush_location":[]}]}} 2026-02-12T18:08:31.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.450+0000 7f2b07dd4640 1 -- 10.20.193.48:0/2881126969 >> v2:10.20.193.111:6812/977811348 conn(0x7f2ad003f780 msgr2=0x7f2ad005fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:31.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.450+0000 7f2b07dd4640 1 --2- 10.20.193.48:0/2881126969 >> v2:10.20.193.111:6812/977811348 conn(0x7f2ad003f780 0x7f2ad005fc30 secure :-1 s=READY pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2af00023d0 tx=0x7f2af0033000 comp rx=0 tx=0).stop 2026-02-12T18:08:31.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.450+0000 7f2b07dd4640 10 monclient: shutdown 2026-02-12T18:08:31.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.450+0000 7f2b07dd4640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:31.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.450+0000 7f2b07dd4640 1 -- 10.20.193.48:0/2881126969 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f2b0005dff0 msgr2=0x7f2b001121d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:31.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.450+0000 7f2b07dd4640 1 --2- 10.20.193.48:0/2881126969 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f2b0005dff0 0x7f2b001121d0 secure :-1 s=READY pgs=132 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2af400b540 tx=0x7f2af400ba10 comp rx=0 tx=0).stop 2026-02-12T18:08:31.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.450+0000 7f2b07dd4640 1 -- 10.20.193.48:0/2881126969 shutdown_connections 2026-02-12T18:08:31.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.450+0000 7f2b07dd4640 1 --2- 10.20.193.48:0/2881126969 >> v2:10.20.193.111:6812/977811348 conn(0x7f2ad003f780 0x7f2ad005fc30 unknown :-1 s=CLOSED pgs=194 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:31.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.450+0000 7f2b07dd4640 1 --2- 10.20.193.48:0/2881126969 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2b00089df0 0x7f2b0008f720 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:31.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.450+0000 7f2b07dd4640 1 --2- 10.20.193.48:0/2881126969 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f2b0005dff0 0x7f2b001121d0 unknown :-1 s=CLOSED pgs=132 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:31.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.450+0000 7f2b07dd4640 1 --2- 10.20.193.48:0/2881126969 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2b0005dc20 0x7f2b00111c90 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:31.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.450+0000 7f2b07dd4640 1 -- 10.20.193.48:0/2881126969 >> 10.20.193.48:0/2881126969 conn(0x7f2b000546d0 msgr2=0x7f2b001247d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:31.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.450+0000 7f2b07dd4640 1 -- 10.20.193.48:0/2881126969 shutdown_connections 2026-02-12T18:08:31.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:31.450+0000 7f2b07dd4640 1 -- 10.20.193.48:0/2881126969 wait complete. 2026-02-12T18:08:34.461 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T18:08:34.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.525+0000 7f790190c640 10 monclient: get_monmap_and_config 2026-02-12T18:08:34.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.525+0000 7f790190c640 10 monclient: build_initial_monmap 2026-02-12T18:08:34.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.525+0000 7f790190c640 10 monclient: monmap: 2026-02-12T18:08:34.526 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:34.526 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:34.526 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:34.526364+0000 2026-02-12T18:08:34.526 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:34.526364+0000 2026-02-12T18:08:34.526 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:34.526 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:34.527 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:34.527 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:34.527 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:34.527 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:34.527 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:34.527 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:34.527 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:34.527 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:34.527 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:34.527 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:34.527 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:34.527 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:34.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.525+0000 7f790190c640 1 Processor -- start 2026-02-12T18:08:34.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.525+0000 7f790190c640 1 -- start start 2026-02-12T18:08:34.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.525+0000 7f790190c640 10 monclient: init 2026-02-12T18:08:34.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f790190c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:34.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f790190c640 10 monclient: _add_conns ranks=[5,3,0,1,7,9,6,4,10,8,2] 2026-02-12T18:08:34.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f790190c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f78fc05dc20 0x7f78fc144660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:34.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f790190c640 10 monclient(hunting): picked mon.noname-h con 0x7f78fc05dc20 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:08:34.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f790190c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f78fc05dff0 0x7f78fc05e3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:34.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f790190c640 10 monclient(hunting): picked mon.noname-g con 0x7f78fc05dff0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:08:34.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f790190c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f78fc089df0 addr v1:10.20.193.48:6789/0 2026-02-12T18:08:34.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f790190c640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78fc060390 con 0x7f78fc089df0 2026-02-12T18:08:34.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f790190c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:34.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f790190c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f78fc08b0d0 con 0x7f78fc05dff0 2026-02-12T18:08:34.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f790190c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:34.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f790190c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f78fc093a30 con 0x7f78fc05dc20 2026-02-12T18:08:34.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f790190c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:34.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f790190c640 10 monclient(hunting): authenticate will time out at 753.252099s 2026-02-12T18:08:34.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f78fa7fc640 1 -- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f78fc05dff0 msgr2=0x7f78fc05e3c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3301/0 2026-02-12T18:08:34.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f78fa7fc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f78fc05dff0 0x7f78fc05e3c0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:08:34.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f78fb7fe640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f78fc089df0 0x7f78fc08a240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:35632/0 (socket says 10.20.193.48:35632) 2026-02-12T18:08:34.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f78fb7fe640 1 -- 10.20.193.48:0/3451684866 learned_addr learned my addr 10.20.193.48:0/3451684866 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:08:34.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f78faffd640 1 --2- 10.20.193.48:0/3451684866 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f78fc05dc20 0x7f78fc144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:34.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f78faffd640 10 monclient(hunting): get_auth_request con 0x7f78fc05dc20 auth_method 0 2026-02-12T18:08:34.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f78faffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:34.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f78faffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:34.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f78faffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:34.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f78faffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:34.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f78faffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:34.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f78faffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:34.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f78faffd640 10 monclient(hunting): handle_auth_done global_id 5099 payload 274 2026-02-12T18:08:34.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f78faffd640 1 -- 10.20.193.48:0/3451684866 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f78fc05dff0 msgr2=0x7f78fc05e3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:08:34.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f78faffd640 1 --2- 10.20.193.48:0/3451684866 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f78fc05dff0 0x7f78fc05e3c0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:34.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f78faffd640 1 -- 10.20.193.48:0/3451684866 >> v1:10.20.193.48:6789/0 conn(0x7f78fc089df0 legacy=0x7f78fc08a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:34.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f78faffd640 10 monclient: _finish_hunting 0 2026-02-12T18:08:34.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f78faffd640 1 monclient: found mon.noname-h 2026-02-12T18:08:34.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f78faffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:34.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f78faffd640 10 monclient: _send_mon_message to mon.noname-h at v2:10.20.193.111:3302/0 2026-02-12T18:08:34.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.526+0000 7f78faffd640 1 -- 10.20.193.48:0/3451684866 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78fc08b250 con 0x7f78fc05dc20 2026-02-12T18:08:34.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.529+0000 7f78faffd640 1 -- 10.20.193.48:0/3451684866 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f78fc05dc20 msgr2=0x7f78fc144660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:34.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.529+0000 7f78faffd640 1 --2- 10.20.193.48:0/3451684866 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f78fc05dc20 0x7f78fc144660 secure :-1 s=READY pgs=146 gs=2 cs=0 l=1 c_cookie=12398970194134346863 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78f0009800 tx=0x7f78f002edf0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=ac11fdb2f208ac6f server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:34.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.529+0000 7f78f9ffb640 1 -- 10.20.193.48:0/3451684866 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f78f002fb50 con 0x7f78fc05dc20 2026-02-12T18:08:34.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.529+0000 7f78f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:34.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.529+0000 7f78f9ffb640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2026-02-12T18:08:34.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.529+0000 7f78f9ffb640 10 monclient: dump: 2026-02-12T18:08:34.531 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:34.531 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:34.531 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:34.531 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:34.531 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:34.531 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:34.531 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:34.531 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:34.532 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:34.532 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:34.532 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:34.532 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:34.532 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:34.532 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:34.532 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:34.532 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:34.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.529+0000 7f78f9ffb640 10 monclient: _finish_auth 0 2026-02-12T18:08:34.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.529+0000 7f78f9ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:08:34.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.529+0000 7f78f9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:34.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.529+0000 7f790190c640 5 monclient: authenticate success, global_id 5099 2026-02-12T18:08:34.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.529+0000 7f78f9ffb640 1 -- 10.20.193.48:0/3451684866 <== mon.5 v2:10.20.193.111:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f002fcd0 con 0x7f78fc05dc20 2026-02-12T18:08:34.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.529+0000 7f78f9ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:34.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.529+0000 7f78f9ffb640 1 -- 10.20.193.48:0/3451684866 <== mon.5 v2:10.20.193.111:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f78f002fe40 con 0x7f78fc05dc20 2026-02-12T18:08:34.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.529+0000 7f78f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:34.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.529+0000 7f78f9ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:08:34.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.529+0000 7f78f9ffb640 10 monclient: dump: 2026-02-12T18:08:34.532 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:34.532 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:34.532 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:34.532 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:34.532 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:34.532 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:34.532 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:34.532 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:34.533 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:34.533 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:34.533 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:34.533 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:34.533 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:34.533 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:34.533 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:34.533 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:34.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.529+0000 7f790190c640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:34.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.529+0000 7f790190c640 4 set_mon_vals no callback set 2026-02-12T18:08:34.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.530+0000 7f790190c640 10 monclient: shutdown 2026-02-12T18:08:34.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.530+0000 7f790190c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:34.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.530+0000 7f790190c640 1 -- 10.20.193.48:0/3451684866 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f78fc05dc20 msgr2=0x7f78fc144660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:34.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.530+0000 7f790190c640 1 --2- 10.20.193.48:0/3451684866 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f78fc05dc20 0x7f78fc144660 secure :-1 s=READY pgs=146 gs=2 cs=0 l=1 c_cookie=12398970194134346863 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78f0009800 tx=0x7f78f002edf0 comp rx=0 tx=0).stop 2026-02-12T18:08:34.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.530+0000 7f790190c640 1 -- 10.20.193.48:0/3451684866 shutdown_connections 2026-02-12T18:08:34.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.530+0000 7f790190c640 1 --2- 10.20.193.48:0/3451684866 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f78fc05dff0 0x7f78fc05e3c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:34.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.530+0000 7f790190c640 1 --2- 10.20.193.48:0/3451684866 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f78fc05dc20 0x7f78fc144660 unknown :-1 s=CLOSED pgs=146 gs=2 cs=0 l=1 c_cookie=12398970194134346863 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:34.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.530+0000 7f790190c640 1 -- 10.20.193.48:0/3451684866 >> 10.20.193.48:0/3451684866 conn(0x7f78fc0546d0 msgr2=0x7f78fc054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:34.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.530+0000 7f790190c640 1 -- 10.20.193.48:0/3451684866 shutdown_connections 2026-02-12T18:08:34.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.530+0000 7f790190c640 1 -- 10.20.193.48:0/3451684866 wait complete. 2026-02-12T18:08:34.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.530+0000 7f790190c640 10 monclient: build_initial_monmap 2026-02-12T18:08:34.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.530+0000 7f790190c640 10 monclient: monmap: 2026-02-12T18:08:34.535 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:34.535 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:34.535 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:34.535 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:34.535 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:34.535 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:34.535 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:34.536 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:34.536 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:34.536 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:34.536 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:34.536 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:34.536 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:34.536 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:34.536 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:34.536 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:34.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.530+0000 7f790190c640 1 Processor -- start 2026-02-12T18:08:34.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.530+0000 7f790190c640 1 -- start start 2026-02-12T18:08:34.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.530+0000 7f790190c640 10 monclient: init 2026-02-12T18:08:34.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f790190c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:34.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f790190c640 10 monclient: _add_conns ranks=[8,7,2,0,1,3,5,4,6] 2026-02-12T18:08:34.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f790190c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f78fc05dc20 0x7f78fc10db60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:34.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f790190c640 10 monclient(hunting): picked mon.noname-e con 0x7f78fc05dc20 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:08:34.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f790190c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f78fc05dff0 0x7f78fc10e0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:34.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f790190c640 10 monclient(hunting): picked mon.noname-i con 0x7f78fc05dff0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:34.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f790190c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f78fc089df0 0x7f78fc10e5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:34.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f790190c640 10 monclient(hunting): picked mon.noname-b con 0x7f78fc089df0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:08:34.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f790190c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:34.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f790190c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f78fc1109f0 con 0x7f78fc089df0 2026-02-12T18:08:34.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f790190c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:34.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f790190c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f78fc142450 con 0x7f78fc05dff0 2026-02-12T18:08:34.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f790190c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:34.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f790190c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f78fc1429a0 con 0x7f78fc05dc20 2026-02-12T18:08:34.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f790190c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:34.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f790190c640 10 monclient(hunting): authenticate will time out at 753.257164s 2026-02-12T18:08:34.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78faffd640 1 -- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f78fc05dc20 msgr2=0x7f78fc10db60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.48:3304/0 2026-02-12T18:08:34.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78faffd640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f78fc05dc20 0x7f78fc10db60 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:08:34.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fb7fe640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f78fc089df0 0x7f78fc10e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:34.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fb7fe640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f78fc089df0 0x7f78fc10e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:35672/0 (socket says 10.20.193.48:35672) 2026-02-12T18:08:34.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fb7fe640 1 -- 10.20.193.48:0/2721353144 learned_addr learned my addr 10.20.193.48:0/2721353144 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:34.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fb7fe640 10 monclient(hunting): get_auth_request con 0x7f78fc089df0 auth_method 0 2026-02-12T18:08:34.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:34.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:34.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:34.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fa7fc640 1 --2- 10.20.193.48:0/2721353144 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f78fc05dff0 0x7f78fc10e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:34.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fa7fc640 10 monclient(hunting): get_auth_request con 0x7f78fc05dff0 auth_method 0 2026-02-12T18:08:34.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fa7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:34.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fa7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:34.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fa7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:34.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:34.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:34.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:34.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fa7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:34.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fa7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:34.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fa7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:34.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fb7fe640 10 monclient(hunting): handle_auth_done global_id 35129 payload 824 2026-02-12T18:08:34.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fb7fe640 1 -- 10.20.193.48:0/2721353144 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f78fc05dc20 msgr2=0x7f78fc10db60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:08:34.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fb7fe640 1 --2- 10.20.193.48:0/2721353144 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f78fc05dc20 0x7f78fc10db60 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:34.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fb7fe640 1 -- 10.20.193.48:0/2721353144 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f78fc05dff0 msgr2=0x7f78fc10e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:34.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fb7fe640 1 --2- 10.20.193.48:0/2721353144 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f78fc05dff0 0x7f78fc10e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:34.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fb7fe640 10 monclient: _finish_hunting 0 2026-02-12T18:08:34.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fb7fe640 1 monclient: found mon.noname-b 2026-02-12T18:08:34.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:34.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fb7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:08:34.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.531+0000 7f78fb7fe640 1 -- 10.20.193.48:0/2721353144 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f0009420 con 0x7f78fc089df0 2026-02-12T18:08:34.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.533+0000 7f78fb7fe640 1 -- 10.20.193.48:0/2721353144 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f78fc089df0 msgr2=0x7f78fc10e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:34.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.533+0000 7f78fb7fe640 1 --2- 10.20.193.48:0/2721353144 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f78fc089df0 0x7f78fc10e5e0 secure :-1 s=READY pgs=139 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78ec00d520 tx=0x7f78ec00d9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:34.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.533+0000 7f78d3fff640 1 -- 10.20.193.48:0/2721353144 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f78ec006e90 con 0x7f78fc089df0 2026-02-12T18:08:34.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.533+0000 7f78d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:34.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.533+0000 7f78d3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:08:34.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.533+0000 7f78d3fff640 10 monclient: dump: 2026-02-12T18:08:34.538 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:34.538 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:34.538 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:34.538 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:34.538 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:34.538 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:34.538 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:34.538 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:34.538 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:34.538 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:34.538 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:34.538 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:34.538 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:34.538 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:34.539 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:34.539 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:34.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.533+0000 7f78d3fff640 10 monclient: _finish_auth 0 2026-02-12T18:08:34.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.533+0000 7f78d3fff640 10 monclient: _check_auth_tickets 2026-02-12T18:08:34.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.533+0000 7f78d3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:34.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.533+0000 7f78d3fff640 1 -- 10.20.193.48:0/2721353144 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78ec008530 con 0x7f78fc089df0 2026-02-12T18:08:34.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.533+0000 7f790190c640 5 monclient: authenticate success, global_id 35129 2026-02-12T18:08:34.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.533+0000 7f790190c640 10 monclient: _renew_subs 2026-02-12T18:08:34.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.533+0000 7f790190c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:08:34.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.533+0000 7f790190c640 1 -- 10.20.193.48:0/2721353144 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78fc08e140 con 0x7f78fc089df0 2026-02-12T18:08:34.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.533+0000 7f78d3fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:34.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.533+0000 7f78d3fff640 1 -- 10.20.193.48:0/2721353144 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f78ec0086a0 con 0x7f78fc089df0 2026-02-12T18:08:34.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.533+0000 7f78d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:34.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.533+0000 7f78f97fa640 4 set_mon_vals no callback set 2026-02-12T18:08:34.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.533+0000 7f78d3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:08:34.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.533+0000 7f78d3fff640 10 monclient: dump: 2026-02-12T18:08:34.539 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:34.539 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:34.539 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:34.539 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:34.539 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:34.539 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:34.539 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:34.539 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:34.539 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:34.539 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:34.540 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:34.540 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:34.540 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:34.540 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:34.540 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:34.540 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:34.540 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.534+0000 7f790190c640 10 monclient: _renew_subs 2026-02-12T18:08:34.540 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.534+0000 7f790190c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:08:34.540 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.534+0000 7f790190c640 1 -- 10.20.193.48:0/2721353144 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f78fc1239a0 con 0x7f78fc089df0 2026-02-12T18:08:34.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.534+0000 7f790190c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:34.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.534+0000 7f790190c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:34.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.534+0000 7f790190c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:08:34.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.534+0000 7f790190c640 1 -- 10.20.193.48:0/2721353144 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78fc092510 con 0x7f78fc089df0 2026-02-12T18:08:34.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.534+0000 7f78d3fff640 1 -- 10.20.193.48:0/2721353144 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f78ec008070 con 0x7f78fc089df0 2026-02-12T18:08:34.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.535+0000 7f78d3fff640 1 --2- 10.20.193.48:0/2721353144 >> v2:10.20.193.111:6812/977811348 conn(0x7f78cc03f7c0 0x7f78cc05fc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:34.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.535+0000 7f78d3fff640 1 -- 10.20.193.48:0/2721353144 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(118..118 src has 1..118) ==== 3503+0+0 (secure 0 0 0) 0x7f78ec052f10 con 0x7f78fc089df0 2026-02-12T18:08:34.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.535+0000 7f78faffd640 1 --2- 10.20.193.48:0/2721353144 >> v2:10.20.193.111:6812/977811348 conn(0x7f78cc03f7c0 0x7f78cc05fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:34.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.535+0000 7f78faffd640 10 monclient: get_auth_request con 0x7f78cc03f7c0 auth_method 0 2026-02-12T18:08:34.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.537+0000 7f78d3fff640 1 -- 10.20.193.48:0/2721353144 <== mon.2 v2:10.20.193.48:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f78ec012ab0 con 0x7f78fc089df0 2026-02-12T18:08:34.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.537+0000 7f78d3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:34.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.537+0000 7f78d3fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:34.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.537+0000 7f78faffd640 1 --2- 10.20.193.48:0/2721353144 >> v2:10.20.193.111:6812/977811348 conn(0x7f78cc03f7c0 0x7f78cc05fc70 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78f00090b0 tx=0x7f78f0039040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:34.615 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.e has been restored 2026-02-12T18:08:34.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.680+0000 7f790190c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T18:08:34.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.680+0000 7f790190c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T18:08:34.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.680+0000 7f790190c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:08:34.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.680+0000 7f790190c640 1 -- 10.20.193.48:0/2721353144 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f78fc144660 con 0x7f78fc089df0 2026-02-12T18:08:34.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.680+0000 7f78d3fff640 1 -- 10.20.193.48:0/2721353144 <== mon.2 v2:10.20.193.48:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3661 (secure 0 0 0) 0x7f78ec018070 con 0x7f78fc089df0 2026-02-12T18:08:34.683 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.680+0000 7f78d3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T18:08:34.683 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.680+0000 7f78d3fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:34.683 INFO:teuthology.orchestra.run.trial048.stdout:{"election_epoch":28,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":11,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","modified":"2026-02-12T18:05:32.850777Z","created":"2026-02-12T18:05:32.850777Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3300","nonce":0},{"type":"v1","addr":"10.20.193.48:6789","nonce":0}]},"addr":"10.20.193.48:6789/0","public_addr":"10.20.193.48:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850827+0000","crush_location":[]},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3300","nonce":0},{"type":"v1","addr":"10.20.193.111:6789","nonce":0}]},"addr":"10.20.193.111:6789/0","public_addr":"10.20.193.111:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850829+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3301","nonce":0},{"type":"v1","addr":"10.20.193.48:6790","nonce":0}]},"addr":"10.20.193.48:6790/0","public_addr":"10.20.193.48:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850830+0000","crush_location":[]},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3301","nonce":0},{"type":"v1","addr":"10.20.193.111:6790","nonce":0}]},"addr":"10.20.193.111:6790/0","public_addr":"10.20.193.111:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850833+0000","crush_location":[]},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3302","nonce":0},{"type":"v1","addr":"10.20.193.48:6791","nonce":0}]},"addr":"10.20.193.48:6791/0","public_addr":"10.20.193.48:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3302","nonce":0},{"type":"v1","addr":"10.20.193.111:6791","nonce":0}]},"addr":"10.20.193.111:6791/0","public_addr":"10.20.193.111:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850834+0000","crush_location":[]},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3303","nonce":0},{"type":"v1","addr":"10.20.193.48:6792","nonce":0}]},"addr":"10.20.193.48:6792/0","public_addr":"10.20.193.48:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3303","nonce":0},{"type":"v1","addr":"10.20.193.111:6792","nonce":0}]},"addr":"10.20.193.111:6792/0","public_addr":"10.20.193.111:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850835+0000","crush_location":[]},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3304","nonce":0},{"type":"v1","addr":"10.20.193.48:6793","nonce":0}]},"addr":"10.20.193.48:6793/0","public_addr":"10.20.193.48:6793/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850832+0000","crush_location":[]}]}} 2026-02-12T18:08:34.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.682+0000 7f790190c640 1 -- 10.20.193.48:0/2721353144 >> v2:10.20.193.111:6812/977811348 conn(0x7f78cc03f7c0 msgr2=0x7f78cc05fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:34.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.682+0000 7f790190c640 1 --2- 10.20.193.48:0/2721353144 >> v2:10.20.193.111:6812/977811348 conn(0x7f78cc03f7c0 0x7f78cc05fc70 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78f00090b0 tx=0x7f78f0039040 comp rx=0 tx=0).stop 2026-02-12T18:08:34.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.682+0000 7f790190c640 10 monclient: shutdown 2026-02-12T18:08:34.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.682+0000 7f790190c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:34.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.682+0000 7f790190c640 1 -- 10.20.193.48:0/2721353144 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f78fc089df0 msgr2=0x7f78fc10e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:34.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.682+0000 7f790190c640 1 --2- 10.20.193.48:0/2721353144 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f78fc089df0 0x7f78fc10e5e0 secure :-1 s=READY pgs=139 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f78ec00d520 tx=0x7f78ec00d9f0 comp rx=0 tx=0).stop 2026-02-12T18:08:34.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.682+0000 7f790190c640 1 -- 10.20.193.48:0/2721353144 shutdown_connections 2026-02-12T18:08:34.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.682+0000 7f790190c640 1 --2- 10.20.193.48:0/2721353144 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f78fc089df0 0x7f78fc10e5e0 unknown :-1 s=CLOSED pgs=139 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:34.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.682+0000 7f790190c640 1 --2- 10.20.193.48:0/2721353144 >> v2:10.20.193.111:6812/977811348 conn(0x7f78cc03f7c0 0x7f78cc05fc70 unknown :-1 s=CLOSED pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:34.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.682+0000 7f790190c640 1 --2- 10.20.193.48:0/2721353144 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f78fc05dff0 0x7f78fc10e0a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:34.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.682+0000 7f790190c640 1 --2- 10.20.193.48:0/2721353144 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f78fc05dc20 0x7f78fc10db60 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:34.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.682+0000 7f790190c640 1 -- 10.20.193.48:0/2721353144 >> 10.20.193.48:0/2721353144 conn(0x7f78fc0546d0 msgr2=0x7f78fc124e40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:34.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.682+0000 7f790190c640 1 -- 10.20.193.48:0/2721353144 shutdown_connections 2026-02-12T18:08:34.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:34.682+0000 7f790190c640 1 -- 10.20.193.48:0/2721353144 wait complete. 2026-02-12T18:08:37.692 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T18:08:37.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.758+0000 7f117addd640 10 monclient: get_monmap_and_config 2026-02-12T18:08:37.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.758+0000 7f117addd640 10 monclient: build_initial_monmap 2026-02-12T18:08:37.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.758+0000 7f117addd640 10 monclient: monmap: 2026-02-12T18:08:37.761 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:37.761 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:37.761 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:37.759935+0000 2026-02-12T18:08:37.761 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:37.759935+0000 2026-02-12T18:08:37.761 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:37.761 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:37.761 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:37.761 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:37.761 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:37.761 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:37.761 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:37.762 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:37.762 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:37.762 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:37.762 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:37.762 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:37.762 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:37.762 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:37.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f117addd640 1 Processor -- start 2026-02-12T18:08:37.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f117addd640 1 -- start start 2026-02-12T18:08:37.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f117addd640 10 monclient: init 2026-02-12T18:08:37.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f117addd640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:37.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f117addd640 10 monclient: _add_conns ranks=[5,2,9,1,0,10,8,3,4,7,6] 2026-02-12T18:08:37.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f117addd640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f117405dc20 0x7f1174144660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:37.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f117addd640 10 monclient(hunting): picked mon.noname-h con 0x7f117405dc20 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:08:37.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f117addd640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f117405dff0 0x7f117405e3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:37.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f117addd640 10 monclient(hunting): picked mon.noname-b con 0x7f117405dff0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:08:37.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f117addd640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f1174089df0 0x7f117408a240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:37.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f117addd640 10 monclient(hunting): picked mon.noname-a con 0x7f1174089df0 addr v2:10.20.193.48:3300/0 2026-02-12T18:08:37.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f117addd640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:37.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f117addd640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f117408b0d0 con 0x7f1174089df0 2026-02-12T18:08:37.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f117addd640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:37.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f117addd640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f1174093a30 con 0x7f117405dff0 2026-02-12T18:08:37.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f117addd640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:37.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f117addd640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f1174092200 con 0x7f117405dc20 2026-02-12T18:08:37.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f117addd640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:37.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f117addd640 10 monclient(hunting): authenticate will time out at 756.485700s 2026-02-12T18:08:37.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f1179353640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f1174089df0 0x7f117408a240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:37.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f116bfff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f117405dff0 0x7f117405e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:37.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f1179353640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f1174089df0 0x7f117408a240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:52110/0 (socket says 10.20.193.48:52110) 2026-02-12T18:08:37.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f1179353640 1 -- 10.20.193.48:0/2051164595 learned_addr learned my addr 10.20.193.48:0/2051164595 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:37.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f1179353640 10 monclient(hunting): get_auth_request con 0x7f1174089df0 auth_method 0 2026-02-12T18:08:37.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f1179353640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:37.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f1179353640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:37.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f1179353640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:37.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f116bfff640 10 monclient(hunting): get_auth_request con 0x7f117405dff0 auth_method 0 2026-02-12T18:08:37.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f116bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:37.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f116bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:37.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f116bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:37.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f1178b52640 1 --2- 10.20.193.48:0/2051164595 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f117405dc20 0x7f1174144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:37.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f116bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:37.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f116bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:37.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f116bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:37.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f1178b52640 10 monclient(hunting): get_auth_request con 0x7f117405dc20 auth_method 0 2026-02-12T18:08:37.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f1178b52640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:37.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f1178b52640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:37.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f1178b52640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:37.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f1179353640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:37.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f1179353640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:37.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.759+0000 7f1179353640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:37.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.760+0000 7f116bfff640 10 monclient(hunting): handle_auth_done global_id 35138 payload 274 2026-02-12T18:08:37.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.760+0000 7f116bfff640 1 -- 10.20.193.48:0/2051164595 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f117405dc20 msgr2=0x7f1174144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:37.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.760+0000 7f116bfff640 1 --2- 10.20.193.48:0/2051164595 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f117405dc20 0x7f1174144660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:37.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.760+0000 7f116bfff640 1 -- 10.20.193.48:0/2051164595 >> v2:10.20.193.48:3300/0 conn(0x7f1174089df0 msgr2=0x7f117408a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:37.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.760+0000 7f116bfff640 1 --2- 10.20.193.48:0/2051164595 >> v2:10.20.193.48:3300/0 conn(0x7f1174089df0 0x7f117408a240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:37.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.760+0000 7f116bfff640 10 monclient: _finish_hunting 0 2026-02-12T18:08:37.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.760+0000 7f116bfff640 1 monclient: found mon.noname-b 2026-02-12T18:08:37.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.760+0000 7f116bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:37.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.760+0000 7f116bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:08:37.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.760+0000 7f116bfff640 1 -- 10.20.193.48:0/2051164595 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1174060390 con 0x7f117405dff0 2026-02-12T18:08:37.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.762+0000 7f116bfff640 1 -- 10.20.193.48:0/2051164595 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f117405dff0 msgr2=0x7f117405e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:37.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.762+0000 7f116bfff640 1 --2- 10.20.193.48:0/2051164595 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f117405dff0 0x7f117405e3c0 secure :-1 s=READY pgs=140 gs=1 cs=0 l=1 c_cookie=12643332189768235246 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f115c004740 tx=0x7f115c02edb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af7623a3ac65b8ee server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:37.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.762+0000 7f116b7fe640 1 -- 10.20.193.48:0/2051164595 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f115c035340 con 0x7f117405dff0 2026-02-12T18:08:37.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.762+0000 7f116b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:37.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.762+0000 7f116b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:08:37.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.762+0000 7f116b7fe640 10 monclient: dump: 2026-02-12T18:08:37.777 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:37.777 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:37.777 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:37.777 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:37.777 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:37.777 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:37.777 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:37.777 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:37.777 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:37.777 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:37.778 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:37.778 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:37.778 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:37.778 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:37.778 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:37.778 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:37.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.762+0000 7f116b7fe640 10 monclient: _finish_auth 0 2026-02-12T18:08:37.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.762+0000 7f116b7fe640 10 monclient: _check_auth_tickets 2026-02-12T18:08:37.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.762+0000 7f116b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:37.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.762+0000 7f116b7fe640 1 -- 10.20.193.48:0/2051164595 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f115c0354c0 con 0x7f117405dff0 2026-02-12T18:08:37.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.762+0000 7f116b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:37.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.762+0000 7f116b7fe640 1 -- 10.20.193.48:0/2051164595 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f115c035af0 con 0x7f117405dff0 2026-02-12T18:08:37.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.762+0000 7f116b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:37.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.762+0000 7f116b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:08:37.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.762+0000 7f116b7fe640 10 monclient: dump: 2026-02-12T18:08:37.779 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:37.779 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:37.779 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:37.779 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:37.779 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:37.779 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:37.779 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:37.779 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:37.780 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:37.780 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:37.780 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:37.780 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:37.780 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:37.780 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:37.780 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:37.780 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:37.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.762+0000 7f117addd640 5 monclient: authenticate success, global_id 35138 2026-02-12T18:08:37.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.762+0000 7f117addd640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:37.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.762+0000 7f117addd640 4 set_mon_vals no callback set 2026-02-12T18:08:37.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.763+0000 7f117addd640 10 monclient: shutdown 2026-02-12T18:08:37.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.763+0000 7f117addd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:37.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.763+0000 7f117addd640 1 -- 10.20.193.48:0/2051164595 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f117405dff0 msgr2=0x7f117405e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:37.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.763+0000 7f117addd640 1 --2- 10.20.193.48:0/2051164595 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f117405dff0 0x7f117405e3c0 secure :-1 s=READY pgs=140 gs=1 cs=0 l=1 c_cookie=12643332189768235246 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f115c004740 tx=0x7f115c02edb0 comp rx=0 tx=0).stop 2026-02-12T18:08:37.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.763+0000 7f117addd640 1 -- 10.20.193.48:0/2051164595 shutdown_connections 2026-02-12T18:08:37.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.763+0000 7f117addd640 1 --2- 10.20.193.48:0/2051164595 >> v2:10.20.193.48:3300/0 conn(0x7f1174089df0 0x7f117408a240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:37.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.763+0000 7f117addd640 1 --2- 10.20.193.48:0/2051164595 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f117405dff0 0x7f117405e3c0 unknown :-1 s=CLOSED pgs=140 gs=1 cs=0 l=1 c_cookie=12643332189768235246 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:37.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.763+0000 7f117addd640 1 --2- 10.20.193.48:0/2051164595 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f117405dc20 0x7f1174144660 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:37.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.763+0000 7f117addd640 1 -- 10.20.193.48:0/2051164595 >> 10.20.193.48:0/2051164595 conn(0x7f11740546d0 msgr2=0x7f1174054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:37.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.763+0000 7f117addd640 1 -- 10.20.193.48:0/2051164595 shutdown_connections 2026-02-12T18:08:37.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.763+0000 7f117addd640 1 -- 10.20.193.48:0/2051164595 wait complete. 2026-02-12T18:08:37.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.763+0000 7f117addd640 10 monclient: build_initial_monmap 2026-02-12T18:08:37.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.763+0000 7f117addd640 10 monclient: monmap: 2026-02-12T18:08:37.782 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:37.782 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:37.782 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:37.782 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:37.782 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:37.782 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:37.782 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:37.782 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:37.782 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:37.782 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:37.782 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:37.783 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:37.783 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:37.783 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:37.783 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:37.783 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:37.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.763+0000 7f117addd640 1 Processor -- start 2026-02-12T18:08:37.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.763+0000 7f117addd640 1 -- start start 2026-02-12T18:08:37.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.763+0000 7f117addd640 10 monclient: init 2026-02-12T18:08:37.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f117addd640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:37.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f117addd640 10 monclient: _add_conns ranks=[8,2,0,4,6,5,3,1,7] 2026-02-12T18:08:37.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f117addd640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f117405dc20 0x7f1174112bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:37.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f117addd640 10 monclient(hunting): picked mon.noname-e con 0x7f117405dc20 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:08:37.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f117addd640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f117405dff0 0x7f11741130f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:37.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f117addd640 10 monclient(hunting): picked mon.noname-b con 0x7f117405dff0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:08:37.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f117addd640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1174089df0 0x7f1174113630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:37.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f117addd640 10 monclient(hunting): picked mon.noname-a con 0x7f1174089df0 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:08:37.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f117addd640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:37.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f117addd640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f1174110690 con 0x7f1174089df0 2026-02-12T18:08:37.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f117addd640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:37.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f117addd640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f117410fb00 con 0x7f117405dff0 2026-02-12T18:08:37.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f117addd640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:37.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f117addd640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f117410ee90 con 0x7f117405dc20 2026-02-12T18:08:37.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f117addd640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:37.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f117addd640 10 monclient(hunting): authenticate will time out at 756.490178s 2026-02-12T18:08:37.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f1178b52640 1 -- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f117405dc20 msgr2=0x7f1174112bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.48:3304/0 2026-02-12T18:08:37.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f1178b52640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f117405dc20 0x7f1174112bb0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:08:37.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f116bfff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f117405dff0 0x7f11741130f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:37.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f116bfff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f117405dff0 0x7f11741130f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:35694/0 (socket says 10.20.193.48:35694) 2026-02-12T18:08:37.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f116bfff640 1 -- 10.20.193.48:0/314365643 learned_addr learned my addr 10.20.193.48:0/314365643 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:37.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f116bfff640 10 monclient(hunting): get_auth_request con 0x7f117405dff0 auth_method 0 2026-02-12T18:08:37.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f116bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:37.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f1179353640 1 --2- 10.20.193.48:0/314365643 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1174089df0 0x7f1174113630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:37.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f116bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:37.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f116bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:37.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f1179353640 10 monclient(hunting): get_auth_request con 0x7f1174089df0 auth_method 0 2026-02-12T18:08:37.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f1179353640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:37.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f1179353640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:37.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f1179353640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:37.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f116bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:37.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f116bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:37.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f116bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:37.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f1179353640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:37.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f1179353640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:37.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f1179353640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:37.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f116bfff640 10 monclient(hunting): handle_auth_done global_id 35147 payload 824 2026-02-12T18:08:37.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f116bfff640 1 -- 10.20.193.48:0/314365643 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f117405dc20 msgr2=0x7f1174112bb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:08:37.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f116bfff640 1 --2- 10.20.193.48:0/314365643 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f117405dc20 0x7f1174112bb0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:37.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f116bfff640 1 -- 10.20.193.48:0/314365643 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1174089df0 msgr2=0x7f1174113630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:37.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f116bfff640 1 --2- 10.20.193.48:0/314365643 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1174089df0 0x7f1174113630 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:37.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f116bfff640 10 monclient: _finish_hunting 0 2026-02-12T18:08:37.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f116bfff640 1 monclient: found mon.noname-b 2026-02-12T18:08:37.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f116bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:37.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f116bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:08:37.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.764+0000 7f116bfff640 1 -- 10.20.193.48:0/314365643 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115c009420 con 0x7f117405dff0 2026-02-12T18:08:37.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.766+0000 7f116bfff640 1 -- 10.20.193.48:0/314365643 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f117405dff0 msgr2=0x7f11741130f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:37.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.766+0000 7f116bfff640 1 --2- 10.20.193.48:0/314365643 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f117405dff0 0x7f11741130f0 secure :-1 s=READY pgs=141 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f115c02f2c0 tx=0x7f115c0047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:37.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.766+0000 7f11697fa640 1 -- 10.20.193.48:0/314365643 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f115c035de0 con 0x7f117405dff0 2026-02-12T18:08:37.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.766+0000 7f11697fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:37.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.766+0000 7f11697fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:08:37.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.766+0000 7f11697fa640 10 monclient: dump: 2026-02-12T18:08:37.788 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:37.788 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:37.788 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:37.788 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:37.788 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:37.788 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:37.788 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:37.788 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:37.788 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:37.788 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:37.788 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:37.788 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:37.789 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:37.789 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:37.789 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:37.789 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:37.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.766+0000 7f11697fa640 10 monclient: _finish_auth 0 2026-02-12T18:08:37.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.766+0000 7f11697fa640 10 monclient: _check_auth_tickets 2026-02-12T18:08:37.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.766+0000 7f11697fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:37.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.766+0000 7f11697fa640 1 -- 10.20.193.48:0/314365643 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f115c0044f0 con 0x7f117405dff0 2026-02-12T18:08:37.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.766+0000 7f117addd640 5 monclient: authenticate success, global_id 35147 2026-02-12T18:08:37.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.766+0000 7f117addd640 10 monclient: _renew_subs 2026-02-12T18:08:37.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.766+0000 7f117addd640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:08:37.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.766+0000 7f117addd640 1 -- 10.20.193.48:0/314365643 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1174091170 con 0x7f117405dff0 2026-02-12T18:08:37.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.766+0000 7f11697fa640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:37.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.766+0000 7f11697fa640 1 -- 10.20.193.48:0/314365643 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f115c003b90 con 0x7f117405dff0 2026-02-12T18:08:37.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.766+0000 7f11697fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:37.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.766+0000 7f11697fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:08:37.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.766+0000 7f116affd640 4 set_mon_vals no callback set 2026-02-12T18:08:37.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.766+0000 7f11697fa640 10 monclient: dump: 2026-02-12T18:08:37.790 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:37.790 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:37.790 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:37.790 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:37.790 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:37.790 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:37.790 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:37.790 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:37.791 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:37.791 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:37.791 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:37.791 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:37.791 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:37.791 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:37.791 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:37.791 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:37.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.766+0000 7f117addd640 10 monclient: _renew_subs 2026-02-12T18:08:37.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.766+0000 7f117addd640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:08:37.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.766+0000 7f117addd640 1 -- 10.20.193.48:0/314365643 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f11741100d0 con 0x7f117405dff0 2026-02-12T18:08:37.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.767+0000 7f117addd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:37.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.767+0000 7f117addd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:37.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.767+0000 7f117addd640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:08:37.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.767+0000 7f11697fa640 1 -- 10.20.193.48:0/314365643 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f115c003cf0 con 0x7f117405dff0 2026-02-12T18:08:37.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.767+0000 7f117addd640 1 -- 10.20.193.48:0/314365643 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1174092510 con 0x7f117405dff0 2026-02-12T18:08:37.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.767+0000 7f11697fa640 1 --2- 10.20.193.48:0/314365643 >> v2:10.20.193.111:6812/977811348 conn(0x7f114403f7c0 0x7f114405fc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:37.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.767+0000 7f11697fa640 1 -- 10.20.193.48:0/314365643 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(118..118 src has 1..118) ==== 3503+0+0 (secure 0 0 0) 0x7f115c0776b0 con 0x7f117405dff0 2026-02-12T18:08:37.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.767+0000 7f1178b52640 1 --2- 10.20.193.48:0/314365643 >> v2:10.20.193.111:6812/977811348 conn(0x7f114403f7c0 0x7f114405fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:37.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.767+0000 7f1178b52640 10 monclient: get_auth_request con 0x7f114403f7c0 auth_method 0 2026-02-12T18:08:37.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.770+0000 7f11697fa640 1 -- 10.20.193.48:0/314365643 <== mon.2 v2:10.20.193.48:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f115c041c00 con 0x7f117405dff0 2026-02-12T18:08:37.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.770+0000 7f11697fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:37.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.770+0000 7f11697fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:37.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.770+0000 7f1178b52640 1 --2- 10.20.193.48:0/314365643 >> v2:10.20.193.111:6812/977811348 conn(0x7f114403f7c0 0x7f114405fc70 secure :-1 s=READY pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1164004740 tx=0x7f1164008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:37.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.917+0000 7f117addd640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T18:08:37.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.917+0000 7f117addd640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T18:08:37.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.917+0000 7f117addd640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:08:37.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.917+0000 7f117addd640 1 -- 10.20.193.48:0/314365643 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1174144660 con 0x7f117405dff0 2026-02-12T18:08:37.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.918+0000 7f11697fa640 1 -- 10.20.193.48:0/314365643 <== mon.2 v2:10.20.193.48:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3661 (secure 0 0 0) 0x7f115c046020 con 0x7f117405dff0 2026-02-12T18:08:37.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.918+0000 7f11697fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T18:08:37.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.918+0000 7f11697fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:37.920 INFO:teuthology.orchestra.run.trial048.stdout:{"election_epoch":28,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","modified":"2026-02-12T18:05:32.850777Z","created":"2026-02-12T18:05:32.850777Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3300","nonce":0},{"type":"v1","addr":"10.20.193.48:6789","nonce":0}]},"addr":"10.20.193.48:6789/0","public_addr":"10.20.193.48:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850827+0000","crush_location":[]},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3300","nonce":0},{"type":"v1","addr":"10.20.193.111:6789","nonce":0}]},"addr":"10.20.193.111:6789/0","public_addr":"10.20.193.111:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850829+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3301","nonce":0},{"type":"v1","addr":"10.20.193.48:6790","nonce":0}]},"addr":"10.20.193.48:6790/0","public_addr":"10.20.193.48:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850830+0000","crush_location":[]},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3301","nonce":0},{"type":"v1","addr":"10.20.193.111:6790","nonce":0}]},"addr":"10.20.193.111:6790/0","public_addr":"10.20.193.111:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850833+0000","crush_location":[]},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3302","nonce":0},{"type":"v1","addr":"10.20.193.48:6791","nonce":0}]},"addr":"10.20.193.48:6791/0","public_addr":"10.20.193.48:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3302","nonce":0},{"type":"v1","addr":"10.20.193.111:6791","nonce":0}]},"addr":"10.20.193.111:6791/0","public_addr":"10.20.193.111:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850834+0000","crush_location":[]},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3303","nonce":0},{"type":"v1","addr":"10.20.193.48:6792","nonce":0}]},"addr":"10.20.193.48:6792/0","public_addr":"10.20.193.48:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3303","nonce":0},{"type":"v1","addr":"10.20.193.111:6792","nonce":0}]},"addr":"10.20.193.111:6792/0","public_addr":"10.20.193.111:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850835+0000","crush_location":[]},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3304","nonce":0},{"type":"v1","addr":"10.20.193.48:6793","nonce":0}]},"addr":"10.20.193.48:6793/0","public_addr":"10.20.193.48:6793/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850832+0000","crush_location":[]}]}} 2026-02-12T18:08:37.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.919+0000 7f117addd640 1 -- 10.20.193.48:0/314365643 >> v2:10.20.193.111:6812/977811348 conn(0x7f114403f7c0 msgr2=0x7f114405fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:37.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.919+0000 7f117addd640 1 --2- 10.20.193.48:0/314365643 >> v2:10.20.193.111:6812/977811348 conn(0x7f114403f7c0 0x7f114405fc70 secure :-1 s=READY pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1164004740 tx=0x7f1164008040 comp rx=0 tx=0).stop 2026-02-12T18:08:37.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.919+0000 7f117addd640 10 monclient: shutdown 2026-02-12T18:08:37.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.919+0000 7f117addd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:37.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.919+0000 7f117addd640 1 -- 10.20.193.48:0/314365643 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f117405dff0 msgr2=0x7f11741130f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:37.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.919+0000 7f117addd640 1 --2- 10.20.193.48:0/314365643 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f117405dff0 0x7f11741130f0 secure :-1 s=READY pgs=141 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f115c02f2c0 tx=0x7f115c0047e0 comp rx=0 tx=0).stop 2026-02-12T18:08:37.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.919+0000 7f117addd640 1 -- 10.20.193.48:0/314365643 shutdown_connections 2026-02-12T18:08:37.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.919+0000 7f117addd640 1 --2- 10.20.193.48:0/314365643 >> v2:10.20.193.111:6812/977811348 conn(0x7f114403f7c0 0x7f114405fc70 unknown :-1 s=CLOSED pgs=196 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:37.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.919+0000 7f117addd640 1 --2- 10.20.193.48:0/314365643 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1174089df0 0x7f1174113630 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:37.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.919+0000 7f117addd640 1 --2- 10.20.193.48:0/314365643 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f117405dff0 0x7f11741130f0 unknown :-1 s=CLOSED pgs=141 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:37.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.919+0000 7f117addd640 1 --2- 10.20.193.48:0/314365643 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f117405dc20 0x7f1174112bb0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:37.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.919+0000 7f117addd640 1 -- 10.20.193.48:0/314365643 >> 10.20.193.48:0/314365643 conn(0x7f11740546d0 msgr2=0x7f1174125840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:37.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.919+0000 7f117addd640 1 -- 10.20.193.48:0/314365643 shutdown_connections 2026-02-12T18:08:37.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:37.919+0000 7f117addd640 1 -- 10.20.193.48:0/314365643 wait complete. 2026-02-12T18:08:40.929 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T18:08:40.997 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.996+0000 7f473110c640 10 monclient: get_monmap_and_config 2026-02-12T18:08:40.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.996+0000 7f473110c640 10 monclient: build_initial_monmap 2026-02-12T18:08:40.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.996+0000 7f473110c640 10 monclient: monmap: 2026-02-12T18:08:40.998 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:40.998 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:40.998 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:40.997715+0000 2026-02-12T18:08:40.998 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:40.997715+0000 2026-02-12T18:08:40.998 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:40.998 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:40.998 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:40.998 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:40.998 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:40.999 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:40.999 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:40.999 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:40.999 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:40.999 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:40.999 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:40.999 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:40.999 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:40.999 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:41.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f473110c640 1 Processor -- start 2026-02-12T18:08:41.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f473110c640 1 -- start start 2026-02-12T18:08:41.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f473110c640 10 monclient: init 2026-02-12T18:08:41.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f473110c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:41.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f473110c640 10 monclient: _add_conns ranks=[3,10,5,6,7,8,2,4,9,0,1] 2026-02-12T18:08:41.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f473110c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f472c057db0 0x7f472c144700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:41.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f473110c640 10 monclient(hunting): picked mon.noname-g con 0x7f472c057db0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:08:41.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f473110c640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f472c090cb0 0x7f472c0910a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:41.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f473110c640 10 monclient(hunting): picked mon.noname-f con 0x7f472c090cb0 addr v2:10.20.193.111:3300/0 2026-02-12T18:08:41.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f473110c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c140cd0 0x7f472c141140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:41.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f473110c640 10 monclient(hunting): picked mon.noname-h con 0x7f472c140cd0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:08:41.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f473110c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:41.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f473110c640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f472c058180 con 0x7f472c090cb0 2026-02-12T18:08:41.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f473110c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:41.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f473110c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f472c091ad0 con 0x7f472c057db0 2026-02-12T18:08:41.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f473110c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:41.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f473110c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f472c056ff0 con 0x7f472c140cd0 2026-02-12T18:08:41.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f473110c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:41.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f473110c640 10 monclient(hunting): authenticate will time out at 759.723424s 2026-02-12T18:08:41.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f472ad76640 1 -- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f472c057db0 msgr2=0x7f472c144700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3301/0 2026-02-12T18:08:41.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f472ad76640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f472c057db0 0x7f472c144700 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:08:41.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f472a575640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f472c090cb0 0x7f472c0910a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:41.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f472b577640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c140cd0 0x7f472c141140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:41.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f472a575640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f472c090cb0 0x7f472c0910a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3300/0 says I am v2:10.20.193.48:52922/0 (socket says 10.20.193.48:52922) 2026-02-12T18:08:41.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f472a575640 1 -- 10.20.193.48:0/708868221 learned_addr learned my addr 10.20.193.48:0/708868221 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:41.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f472a575640 10 monclient(hunting): get_auth_request con 0x7f472c090cb0 auth_method 0 2026-02-12T18:08:41.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f472a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:41.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f472a575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:41.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f472a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:41.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f472b577640 10 monclient(hunting): get_auth_request con 0x7f472c140cd0 auth_method 0 2026-02-12T18:08:41.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f472b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:41.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f472b577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:41.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f472b577640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:41.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f472a575640 1 -- 10.20.193.48:0/708868221 >> v2:10.20.193.111:3300/0 conn(0x7f472c090cb0 msgr2=0x7f472c0910a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:08:41.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f472a575640 1 -- 10.20.193.48:0/708868221 >> v2:10.20.193.111:3300/0 conn(0x7f472c090cb0 msgr2=0x7f472c0910a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:08:41.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f472a575640 1 --2- 10.20.193.48:0/708868221 >> v2:10.20.193.111:3300/0 conn(0x7f472c090cb0 0x7f472c0910a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:08:41.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f472a575640 1 --2- 10.20.193.48:0/708868221 >> v2:10.20.193.111:3300/0 conn(0x7f472c090cb0 0x7f472c0910a0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:08:41.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f472b577640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c140cd0 msgr2=0x7f472c141140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-12T18:08:41.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f472b577640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c140cd0 msgr2=0x7f472c141140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:08:41.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c140cd0 0x7f472c141140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:08:41.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:40.997+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c140cd0 0x7f472c141140 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:08:41.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.198+0000 7f472a575640 1 --2- 10.20.193.48:0/708868221 >> v2:10.20.193.111:3300/0 conn(0x7f472c090cb0 0x7f472c0910a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:41.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.198+0000 7f472a575640 10 monclient(hunting): get_auth_request con 0x7f472c090cb0 auth_method 0 2026-02-12T18:08:41.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.198+0000 7f472a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:41.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.198+0000 7f472a575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:41.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.198+0000 7f472a575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:08:41.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.198+0000 7f472a575640 1 -- 10.20.193.48:0/708868221 >> v2:10.20.193.111:3300/0 conn(0x7f472c090cb0 msgr2=0x7f472c0910a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:08:41.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.198+0000 7f472a575640 1 -- 10.20.193.48:0/708868221 >> v2:10.20.193.111:3300/0 conn(0x7f472c090cb0 msgr2=0x7f472c0910a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:08:41.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.198+0000 7f472a575640 1 --2- 10.20.193.48:0/708868221 >> v2:10.20.193.111:3300/0 conn(0x7f472c090cb0 0x7f472c0910a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:08:41.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.198+0000 7f472a575640 1 --2- 10.20.193.48:0/708868221 >> v2:10.20.193.111:3300/0 conn(0x7f472c090cb0 0x7f472c0910a0 unknown :-1 s=START_CONNECT pgs=0 gs=7 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:08:41.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.198+0000 7f472ad76640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f472c057db0 msgr2=0x7f472c144700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3301/0 2026-02-12T18:08:41.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.198+0000 7f472ad76640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f472c057db0 0x7f472c144700 unknown :-1 s=START_CONNECT pgs=0 gs=8 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:08:41.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.199+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c140cd0 0x7f472c141140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=9 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:41.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.199+0000 7f472b577640 10 monclient(hunting): get_auth_request con 0x7f472c140cd0 auth_method 0 2026-02-12T18:08:41.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.199+0000 7f472b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:41.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.199+0000 7f472b577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:41.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.199+0000 7f472b577640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:08:41.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.199+0000 7f472b577640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c140cd0 msgr2=0x7f472c141140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:08:41.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.199+0000 7f472b577640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c140cd0 msgr2=0x7f472c141140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:08:41.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.199+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c140cd0 0x7f472c141140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=9 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:08:41.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.199+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c140cd0 0x7f472c141140 unknown :-1 s=START_CONNECT pgs=0 gs=10 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:08:41.602 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.599+0000 7f472a575640 1 --2- 10.20.193.48:0/708868221 >> v2:10.20.193.111:3300/0 conn(0x7f472c090cb0 0x7f472c0910a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=11 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:41.602 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.599+0000 7f472a575640 10 monclient(hunting): get_auth_request con 0x7f472c090cb0 auth_method 0 2026-02-12T18:08:41.602 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.599+0000 7f472a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:41.602 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.599+0000 7f472a575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:41.602 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.599+0000 7f472a575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:08:41.602 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.599+0000 7f472ad76640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f472c057db0 msgr2=0x7f472c144700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3301/0 2026-02-12T18:08:41.602 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.599+0000 7f472ad76640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f472c057db0 0x7f472c144700 unknown :-1 s=START_CONNECT pgs=0 gs=12 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:08:41.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.599+0000 7f472a575640 1 -- 10.20.193.48:0/708868221 >> v2:10.20.193.111:3300/0 conn(0x7f472c090cb0 msgr2=0x7f472c0910a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:08:41.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.599+0000 7f472a575640 1 -- 10.20.193.48:0/708868221 >> v2:10.20.193.111:3300/0 conn(0x7f472c090cb0 msgr2=0x7f472c0910a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:08:41.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.599+0000 7f472a575640 1 --2- 10.20.193.48:0/708868221 >> v2:10.20.193.111:3300/0 conn(0x7f472c090cb0 0x7f472c0910a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=11 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:08:41.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.599+0000 7f472a575640 1 --2- 10.20.193.48:0/708868221 >> v2:10.20.193.111:3300/0 conn(0x7f472c090cb0 0x7f472c0910a0 unknown :-1 s=START_CONNECT pgs=0 gs=13 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:08:41.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.600+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c140cd0 0x7f472c141140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=14 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:41.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.600+0000 7f472b577640 10 monclient(hunting): get_auth_request con 0x7f472c140cd0 auth_method 0 2026-02-12T18:08:41.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.600+0000 7f472b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:41.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.600+0000 7f472b577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:41.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.600+0000 7f472b577640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:08:41.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.600+0000 7f472b577640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c140cd0 msgr2=0x7f472c141140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:08:41.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.600+0000 7f472b577640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c140cd0 msgr2=0x7f472c141140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:08:41.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.600+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c140cd0 0x7f472c141140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=14 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:08:41.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:41.600+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c140cd0 0x7f472c141140 unknown :-1 s=START_CONNECT pgs=0 gs=15 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:08:42.403 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:42.400+0000 7f472ad76640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f472c057db0 msgr2=0x7f472c144700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3301/0 2026-02-12T18:08:42.403 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:42.400+0000 7f472ad76640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f472c057db0 0x7f472c144700 unknown :-1 s=START_CONNECT pgs=0 gs=16 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:08:42.403 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:42.400+0000 7f472a575640 1 --2- 10.20.193.48:0/708868221 >> v2:10.20.193.111:3300/0 conn(0x7f472c090cb0 0x7f472c0910a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=17 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:42.404 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:42.400+0000 7f472a575640 10 monclient(hunting): get_auth_request con 0x7f472c090cb0 auth_method 0 2026-02-12T18:08:42.404 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:42.400+0000 7f472a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:42.404 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:42.400+0000 7f472a575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:42.404 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:42.400+0000 7f472a575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:08:42.404 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:42.400+0000 7f472a575640 1 -- 10.20.193.48:0/708868221 >> v2:10.20.193.111:3300/0 conn(0x7f472c090cb0 msgr2=0x7f472c0910a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:08:42.404 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:42.400+0000 7f472a575640 1 -- 10.20.193.48:0/708868221 >> v2:10.20.193.111:3300/0 conn(0x7f472c090cb0 msgr2=0x7f472c0910a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:08:42.404 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:42.400+0000 7f472a575640 1 --2- 10.20.193.48:0/708868221 >> v2:10.20.193.111:3300/0 conn(0x7f472c090cb0 0x7f472c0910a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=17 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:08:42.404 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:42.400+0000 7f472a575640 1 --2- 10.20.193.48:0/708868221 >> v2:10.20.193.111:3300/0 conn(0x7f472c090cb0 0x7f472c0910a0 unknown :-1 s=START_CONNECT pgs=0 gs=18 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:08:42.404 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:42.401+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c140cd0 0x7f472c141140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=19 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:42.404 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:42.401+0000 7f472b577640 10 monclient(hunting): get_auth_request con 0x7f472c140cd0 auth_method 0 2026-02-12T18:08:42.404 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:42.401+0000 7f472b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:42.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:42.401+0000 7f472b577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:42.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:42.401+0000 7f472b577640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:08:42.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:42.401+0000 7f472b577640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c140cd0 msgr2=0x7f472c141140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:08:42.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:42.401+0000 7f472b577640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c140cd0 msgr2=0x7f472c141140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:08:42.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:42.401+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c140cd0 0x7f472c141140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=19 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:08:42.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:42.401+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c140cd0 0x7f472c141140 unknown :-1 s=START_CONNECT pgs=0 gs=20 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:08:44.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f4728d72640 10 monclient(hunting): tick 2026-02-12T18:08:44.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f4728d72640 10 monclient(hunting): _check_auth_tickets 2026-02-12T18:08:44.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f4728d72640 1 monclient(hunting): continuing hunt 2026-02-12T18:08:44.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f4728d72640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T18:08:44.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f4728d72640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c140cd0 msgr2=0x7f472c141140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:08:44.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f4728d72640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c140cd0 0x7f472c141140 unknown :-1 s=START_CONNECT pgs=0 gs=20 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:44.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f4728d72640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f472c057db0 msgr2=0x7f472c144700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:08:44.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f4728d72640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f472c057db0 0x7f472c144700 unknown :-1 s=START_CONNECT pgs=0 gs=16 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:44.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f4728d72640 1 -- 10.20.193.48:0/708868221 >> v2:10.20.193.111:3300/0 conn(0x7f472c090cb0 msgr2=0x7f472c0910a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:08:44.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f4728d72640 1 --2- 10.20.193.48:0/708868221 >> v2:10.20.193.111:3300/0 conn(0x7f472c090cb0 0x7f472c0910a0 unknown :-1 s=START_CONNECT pgs=0 gs=18 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:44.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f4728d72640 10 monclient: _add_conns ranks=[8,7,2,4,0,1,9,6] 2026-02-12T18:08:44.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f4728d72640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4710003890 0x7f4710023cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:44.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f4728d72640 10 monclient(hunting): picked mon.noname-e con 0x7f4710003890 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:08:44.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f4728d72640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f47100242d0 0x7f4710044750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:44.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f4728d72640 10 monclient(hunting): picked mon.noname-i con 0x7f47100242d0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:44.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f4728d72640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4710044e40 0x7f47100652c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:44.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f4728d72640 10 monclient(hunting): picked mon.noname-b con 0x7f4710044e40 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:08:44.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f4728d72640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:44.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f4728d72640 1 -- 10.20.193.48:0/708868221 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f472c058180 con 0x7f4710044e40 2026-02-12T18:08:44.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f472ad76640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4710003890 msgr2=0x7f4710023cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.48:3304/0 2026-02-12T18:08:44.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f4728d72640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:44.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f4728d72640 1 -- 10.20.193.48:0/708868221 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f472c091ad0 con 0x7f47100242d0 2026-02-12T18:08:44.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f4728d72640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:44.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f4728d72640 1 -- 10.20.193.48:0/708868221 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f472c056ff0 con 0x7f4710003890 2026-02-12T18:08:44.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f472ad76640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4710003890 0x7f4710023cd0 unknown :-1 s=START_CONNECT pgs=0 gs=21 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:08:44.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f4728d72640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:44.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4710044e40 0x7f47100652c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=22 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:44.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f472b577640 10 monclient(hunting): get_auth_request con 0x7f4710044e40 auth_method 0 2026-02-12T18:08:44.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f472b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:44.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f472b577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:44.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f472b577640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:44.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f472a575640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f47100242d0 0x7f4710044750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=23 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:44.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f472b577640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4710044e40 msgr2=0x7f47100652c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-12T18:08:44.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f472a575640 10 monclient(hunting): get_auth_request con 0x7f47100242d0 auth_method 0 2026-02-12T18:08:44.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f472b577640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4710044e40 msgr2=0x7f47100652c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:08:44.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f472a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:44.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f472a575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:44.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f472a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:44.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4710044e40 0x7f47100652c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=22 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:08:44.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4710044e40 0x7f47100652c0 unknown :-1 s=START_CONNECT pgs=0 gs=24 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:08:44.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f472a575640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f47100242d0 msgr2=0x7f4710044750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:08:44.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f472a575640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f47100242d0 msgr2=0x7f4710044750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:08:44.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f472a575640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f47100242d0 0x7f4710044750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=23 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:08:44.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:43.998+0000 7f472a575640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f47100242d0 0x7f4710044750 unknown :-1 s=START_CONNECT pgs=0 gs=25 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:08:44.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.199+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4710044e40 0x7f47100652c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=26 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:44.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.199+0000 7f472b577640 10 monclient(hunting): get_auth_request con 0x7f4710044e40 auth_method 0 2026-02-12T18:08:44.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.199+0000 7f472b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:44.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.199+0000 7f472b577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:44.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.199+0000 7f472b577640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:08:44.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.199+0000 7f472b577640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4710044e40 msgr2=0x7f47100652c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:08:44.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.199+0000 7f472b577640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4710044e40 msgr2=0x7f47100652c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:08:44.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.199+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4710044e40 0x7f47100652c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=26 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:08:44.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.199+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4710044e40 0x7f47100652c0 unknown :-1 s=START_CONNECT pgs=0 gs=27 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:08:44.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.199+0000 7f472a575640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f47100242d0 0x7f4710044750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=28 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:44.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.199+0000 7f472a575640 10 monclient(hunting): get_auth_request con 0x7f47100242d0 auth_method 0 2026-02-12T18:08:44.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.199+0000 7f472a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:44.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.199+0000 7f472a575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:44.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.199+0000 7f472a575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:08:44.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.199+0000 7f472a575640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f47100242d0 msgr2=0x7f4710044750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:08:44.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.199+0000 7f472a575640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f47100242d0 msgr2=0x7f4710044750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:08:44.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.199+0000 7f472a575640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f47100242d0 0x7f4710044750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=28 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:08:44.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.199+0000 7f472a575640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f47100242d0 0x7f4710044750 unknown :-1 s=START_CONNECT pgs=0 gs=29 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:08:44.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.199+0000 7f472ad76640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4710003890 msgr2=0x7f4710023cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.48:3304/0 2026-02-12T18:08:44.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.199+0000 7f472ad76640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4710003890 0x7f4710023cd0 unknown :-1 s=START_CONNECT pgs=0 gs=30 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:08:44.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.600+0000 7f472ad76640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4710003890 msgr2=0x7f4710023cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.48:3304/0 2026-02-12T18:08:44.602 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.600+0000 7f472ad76640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4710003890 0x7f4710023cd0 unknown :-1 s=START_CONNECT pgs=0 gs=31 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:08:44.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.600+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4710044e40 0x7f47100652c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=32 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:44.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.600+0000 7f472b577640 10 monclient(hunting): get_auth_request con 0x7f4710044e40 auth_method 0 2026-02-12T18:08:44.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.600+0000 7f472b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:44.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.600+0000 7f472b577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:44.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.600+0000 7f472b577640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:08:44.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.600+0000 7f472b577640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4710044e40 msgr2=0x7f47100652c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:08:44.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.600+0000 7f472b577640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4710044e40 msgr2=0x7f47100652c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:08:44.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.600+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4710044e40 0x7f47100652c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=32 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:08:44.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.600+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4710044e40 0x7f47100652c0 unknown :-1 s=START_CONNECT pgs=0 gs=33 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:08:44.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.601+0000 7f472a575640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f47100242d0 0x7f4710044750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=34 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:44.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.601+0000 7f472a575640 10 monclient(hunting): get_auth_request con 0x7f47100242d0 auth_method 0 2026-02-12T18:08:44.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.601+0000 7f472a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:44.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.601+0000 7f472a575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:44.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.601+0000 7f472a575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:08:44.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.601+0000 7f472a575640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f47100242d0 msgr2=0x7f4710044750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:08:44.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.601+0000 7f472a575640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f47100242d0 msgr2=0x7f4710044750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:08:44.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.601+0000 7f472a575640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f47100242d0 0x7f4710044750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=34 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:08:44.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:44.601+0000 7f472a575640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f47100242d0 0x7f4710044750 unknown :-1 s=START_CONNECT pgs=0 gs=35 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:08:45.402 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:45.401+0000 7f472ad76640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4710003890 msgr2=0x7f4710023cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.48:3304/0 2026-02-12T18:08:45.403 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:45.401+0000 7f472ad76640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4710003890 0x7f4710023cd0 unknown :-1 s=START_CONNECT pgs=0 gs=36 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:08:45.404 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:45.401+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4710044e40 0x7f47100652c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=37 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:45.404 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:45.401+0000 7f472b577640 10 monclient(hunting): get_auth_request con 0x7f4710044e40 auth_method 0 2026-02-12T18:08:45.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:45.401+0000 7f472b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:45.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:45.401+0000 7f472b577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:45.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:45.401+0000 7f472b577640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:08:45.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:45.402+0000 7f472b577640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4710044e40 msgr2=0x7f47100652c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:08:45.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:45.402+0000 7f472b577640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4710044e40 msgr2=0x7f47100652c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:08:45.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:45.402+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4710044e40 0x7f47100652c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=37 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:08:45.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:45.402+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4710044e40 0x7f47100652c0 unknown :-1 s=START_CONNECT pgs=0 gs=38 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:08:45.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:45.402+0000 7f472a575640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f47100242d0 0x7f4710044750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=39 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:45.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:45.402+0000 7f472a575640 10 monclient(hunting): get_auth_request con 0x7f47100242d0 auth_method 0 2026-02-12T18:08:45.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:45.402+0000 7f472a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:45.406 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:45.402+0000 7f472a575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:45.406 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:45.402+0000 7f472a575640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:08:45.406 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:45.402+0000 7f472a575640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f47100242d0 msgr2=0x7f4710044750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:08:45.406 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:45.402+0000 7f472a575640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f47100242d0 msgr2=0x7f4710044750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:08:45.406 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:45.402+0000 7f472a575640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f47100242d0 0x7f4710044750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=39 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:08:45.406 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:45.402+0000 7f472a575640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f47100242d0 0x7f4710044750 unknown :-1 s=START_CONNECT pgs=0 gs=40 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:08:47.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f4728d72640 10 monclient(hunting): tick 2026-02-12T18:08:47.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f4728d72640 10 monclient(hunting): _check_auth_tickets 2026-02-12T18:08:47.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f4728d72640 1 monclient(hunting): continuing hunt 2026-02-12T18:08:47.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f4728d72640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T18:08:47.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f4728d72640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4710003890 msgr2=0x7f4710023cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:08:47.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f4728d72640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4710003890 0x7f4710023cd0 unknown :-1 s=START_CONNECT pgs=0 gs=36 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:47.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f4728d72640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f47100242d0 msgr2=0x7f4710044750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:08:47.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f4728d72640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f47100242d0 0x7f4710044750 unknown :-1 s=START_CONNECT pgs=0 gs=40 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:47.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f4728d72640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4710044e40 msgr2=0x7f47100652c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:08:47.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f4728d72640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4710044e40 0x7f47100652c0 unknown :-1 s=START_CONNECT pgs=0 gs=38 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:47.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f472b577640 1 -- 10.20.193.48:0/708868221 reap_dead start 2026-02-12T18:08:47.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f472b577640 1 -- 10.20.193.48:0/708868221 reap_dead start 2026-02-12T18:08:47.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f4728d72640 10 monclient: _add_conns ranks=[4,0,9,1,6] 2026-02-12T18:08:47.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f4728d72640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4710003ca0 0x7f4710045230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:47.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f4728d72640 10 monclient(hunting): picked mon.noname-c con 0x7f4710003ca0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:08:47.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f4728d72640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4710045770 addr v1:10.20.193.48:6789/0 2026-02-12T18:08:47.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f4728d72640 1 --2- 10.20.193.48:0/708868221 >> v2:10.20.193.48:3300/0 conn(0x7f47100446d0 0x7f4710047300 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:47.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f4728d72640 10 monclient(hunting): picked mon.noname-a con 0x7f47100446d0 addr v2:10.20.193.48:3300/0 2026-02-12T18:08:47.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f4728d72640 1 -- 10.20.193.48:0/708868221 --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f472c060390 con 0x7f4710045770 2026-02-12T18:08:47.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f472ad76640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4710003ca0 msgr2=0x7f4710045230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.48:3302/0 2026-02-12T18:08:47.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f4728d72640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:47.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f4728d72640 1 -- 10.20.193.48:0/708868221 --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f472c058180 con 0x7f47100446d0 2026-02-12T18:08:47.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f4728d72640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:47.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f4728d72640 1 -- 10.20.193.48:0/708868221 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f472c091ad0 con 0x7f4710003ca0 2026-02-12T18:08:47.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f472ad76640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4710003ca0 0x7f4710045230 unknown :-1 s=START_CONNECT pgs=0 gs=42 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:08:47.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f4728d72640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:47.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> v2:10.20.193.48:3300/0 conn(0x7f47100446d0 0x7f4710047300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=43 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:47.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f472b577640 10 monclient(hunting): get_auth_request con 0x7f47100446d0 auth_method 0 2026-02-12T18:08:47.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f472b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:47.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f472b577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:47.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f472b577640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:47.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f472b577640 1 -- 10.20.193.48:0/708868221 >> v2:10.20.193.48:3300/0 conn(0x7f47100446d0 msgr2=0x7f4710047300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:08:47.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f472b577640 1 -- 10.20.193.48:0/708868221 >> v2:10.20.193.48:3300/0 conn(0x7f47100446d0 msgr2=0x7f4710047300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:08:47.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> v2:10.20.193.48:3300/0 conn(0x7f47100446d0 0x7f4710047300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=43 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:08:47.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.998+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> v2:10.20.193.48:3300/0 conn(0x7f47100446d0 0x7f4710047300 unknown :-1 s=START_CONNECT pgs=0 gs=44 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:08:47.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:46.999+0000 7f472a575640 1 -- 10.20.193.48:0/708868221 >> v1:10.20.193.48:6789/0 conn(0x7f4710045770 legacy=0x7f4710045be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:47.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:47.199+0000 7f472ad76640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4710003ca0 msgr2=0x7f4710045230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.48:3302/0 2026-02-12T18:08:47.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:47.199+0000 7f472ad76640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4710003ca0 0x7f4710045230 unknown :-1 s=START_CONNECT pgs=0 gs=45 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:08:47.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:47.199+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> v2:10.20.193.48:3300/0 conn(0x7f47100446d0 0x7f4710047300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=46 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:47.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:47.199+0000 7f472b577640 10 monclient(hunting): get_auth_request con 0x7f47100446d0 auth_method 0 2026-02-12T18:08:47.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:47.199+0000 7f472b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:47.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:47.199+0000 7f472b577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:47.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:47.199+0000 7f472b577640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:08:47.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:47.199+0000 7f472b577640 1 -- 10.20.193.48:0/708868221 >> v2:10.20.193.48:3300/0 conn(0x7f47100446d0 msgr2=0x7f4710047300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:08:47.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:47.199+0000 7f472b577640 1 -- 10.20.193.48:0/708868221 >> v2:10.20.193.48:3300/0 conn(0x7f47100446d0 msgr2=0x7f4710047300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:08:47.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:47.199+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> v2:10.20.193.48:3300/0 conn(0x7f47100446d0 0x7f4710047300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=46 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:08:47.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:47.199+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> v2:10.20.193.48:3300/0 conn(0x7f47100446d0 0x7f4710047300 unknown :-1 s=START_CONNECT pgs=0 gs=47 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:08:47.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:47.600+0000 7f472ad76640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4710003ca0 msgr2=0x7f4710045230 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.48:3302/0 2026-02-12T18:08:47.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:47.600+0000 7f472ad76640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4710003ca0 0x7f4710045230 unknown :-1 s=START_CONNECT pgs=0 gs=48 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:08:47.602 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:47.600+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> v2:10.20.193.48:3300/0 conn(0x7f47100446d0 0x7f4710047300 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=49 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:47.602 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:47.600+0000 7f472b577640 10 monclient(hunting): get_auth_request con 0x7f47100446d0 auth_method 0 2026-02-12T18:08:47.602 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:47.600+0000 7f472b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:47.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:47.600+0000 7f472b577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:47.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:47.600+0000 7f472b577640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:08:47.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:47.600+0000 7f472b577640 1 -- 10.20.193.48:0/708868221 >> v2:10.20.193.48:3300/0 conn(0x7f47100446d0 msgr2=0x7f4710047300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:08:47.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:47.600+0000 7f472b577640 1 -- 10.20.193.48:0/708868221 >> v2:10.20.193.48:3300/0 conn(0x7f47100446d0 msgr2=0x7f4710047300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:08:47.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:47.600+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> v2:10.20.193.48:3300/0 conn(0x7f47100446d0 0x7f4710047300 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=49 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:08:47.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:47.600+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> v2:10.20.193.48:3300/0 conn(0x7f47100446d0 0x7f4710047300 unknown :-1 s=START_CONNECT pgs=0 gs=50 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:08:48.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.077+0000 7f4729d74640 1 -- 10.20.193.48:0/708868221 <== mon.0 v1:10.20.193.48:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4160882434 0 0) 0x7f472c060390 con 0x7f4710045770 2026-02-12T18:08:48.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.077+0000 7f4729d74640 10 monclient(hunting): _negotiate 2026-02-12T18:08:48.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.077+0000 7f4729d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.077+0000 7f4729d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.077+0000 7f4729d74640 10 monclient(hunting): my global_id is 5229 2026-02-12T18:08:48.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.077+0000 7f4729d74640 1 -- 10.20.193.48:0/708868221 --> v1:10.20.193.48:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47180035e0 con 0x7f4710045770 2026-02-12T18:08:48.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 1 -- 10.20.193.48:0/708868221 <== mon.0 v1:10.20.193.48:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3154146367 0 0) 0x7f47180035e0 con 0x7f4710045770 2026-02-12T18:08:48.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4710003ca0 msgr2=0x7f4710045230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:08:48.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4710003ca0 0x7f4710045230 unknown :-1 s=START_CONNECT pgs=0 gs=48 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 1 -- 10.20.193.48:0/708868221 >> v2:10.20.193.48:3300/0 conn(0x7f47100446d0 msgr2=0x7f4710047300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:08:48.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 1 --2- 10.20.193.48:0/708868221 >> v2:10.20.193.48:3300/0 conn(0x7f47100446d0 0x7f4710047300 unknown :-1 s=START_CONNECT pgs=0 gs=50 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 10 monclient: _finish_hunting 0 2026-02-12T18:08:48.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 1 monclient: found mon.noname-a-legacy 2026-02-12T18:08:48.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:48.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.48:6789/0 2026-02-12T18:08:48.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 1 -- 10.20.193.48:0/708868221 --> v1:10.20.193.48:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4710048880 con 0x7f4710045770 2026-02-12T18:08:48.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 10 monclient: _finish_auth 0 2026-02-12T18:08:48.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 10 monclient: _check_auth_tickets 2026-02-12T18:08:48.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:48.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 1 -- 10.20.193.48:0/708868221 <== mon.0 v1:10.20.193.48:6789/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (unknown 3750814960 0 0) 0x7f4714016b00 con 0x7f4710045770 2026-02-12T18:08:48.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-12T18:08:48.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 10 monclient: dump: 2026-02-12T18:08:48.089 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.089 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.089 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.089 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.089 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.089 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.089 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.089 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.090 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.090 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.090 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.090 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.090 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.090 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.090 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.090 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] but i'm connected to v1:10.20.193.48:6789/0, reconnecting 2026-02-12T18:08:48.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:48.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 1 -- 10.20.193.48:0/708868221 >> v1:10.20.193.48:6789/0 conn(0x7f4710045770 legacy=0x7f4710045be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 10 monclient: _add_conns ranks=[0,5,3,2,6,7,1,8,4] 2026-02-12T18:08:48.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f4718004280 0x7f4718004850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 10 monclient(hunting): picked mon.a con 0x7f4718004280 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:08:48.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f4718004eb0 0x7f4718005320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 10 monclient(hunting): picked mon.h con 0x7f4718004eb0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:08:48.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f4718045d20 0x7f4718066180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 10 monclient(hunting): picked mon.g con 0x7f4718045d20 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:08:48.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 1 -- 10.20.193.48:0/708868221 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f472c058180 con 0x7f4718004280 2026-02-12T18:08:48.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 1 -- 10.20.193.48:0/708868221 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f472c091ad0 con 0x7f4718045d20 2026-02-12T18:08:48.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 1 -- 10.20.193.48:0/708868221 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f4718066a90 con 0x7f4718004eb0 2026-02-12T18:08:48.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:48.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f4729d74640 10 monclient(hunting): _finish_auth 0 2026-02-12T18:08:48.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f472ad76640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f4718004280 0x7f4718004850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=51 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f472b577640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f4718045d20 msgr2=0x7f4718066180 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3301/0 2026-02-12T18:08:48.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f472b577640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f4718045d20 0x7f4718066180 unknown :-1 s=START_CONNECT pgs=0 gs=52 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:08:48.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f472ad76640 10 monclient(hunting): get_auth_request con 0x7f4718004280 auth_method 0 2026-02-12T18:08:48.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f472ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f472ad76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f472ad76640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:08:48.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f472ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f472ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f472ad76640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:08:48.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f472ad76640 10 monclient(hunting): handle_auth_done global_id 5229 payload 293 2026-02-12T18:08:48.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f472ad76640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f4718004eb0 msgr2=0x7f4718005320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:48.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f472ad76640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f4718004eb0 0x7f4718005320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=53 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f472ad76640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f4718045d20 msgr2=0x7f4718066180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:08:48.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f472ad76640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f4718045d20 0x7f4718066180 unknown :-1 s=START_CONNECT pgs=0 gs=52 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f472ad76640 10 monclient: _finish_hunting 0 2026-02-12T18:08:48.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f472ad76640 1 monclient: found mon.a 2026-02-12T18:08:48.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f472ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:48.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f472ad76640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:08:48.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f472ad76640 1 -- 10.20.193.48:0/708868221 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47180035e0 con 0x7f4718004280 2026-02-12T18:08:48.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f472ad76640 10 monclient: _finish_auth 0 2026-02-12T18:08:48.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f472ad76640 10 monclient: _check_auth_tickets 2026-02-12T18:08:48.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f472ad76640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:48.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f473110c640 5 monclient: authenticate success, global_id 5229 2026-02-12T18:08:48.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f473110c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:08:48.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.084+0000 7f472b577640 1 -- 10.20.193.48:0/708868221 reap_dead start 2026-02-12T18:08:48.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.087+0000 7f472ad76640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f4718004280 msgr2=0x7f4718004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:48.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.087+0000 7f472ad76640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f4718004280 0x7f4718004850 secure :-1 s=READY pgs=248 gs=51 cs=0 l=1 c_cookie=787169608983566300 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4720007ef0 tx=0x7f472002fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aec9696b972d7dc server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.087+0000 7f4729d74640 1 -- 10.20.193.48:0/708868221 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4720035870 con 0x7f4718004280 2026-02-12T18:08:48.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.087+0000 7f4729d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.087+0000 7f4729d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:08:48.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.087+0000 7f4729d74640 10 monclient: dump: 2026-02-12T18:08:48.101 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.101 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.101 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.101 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.102 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.102 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.102 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.102 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.102 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.102 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.102 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.102 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.102 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.102 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.102 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.102 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.087+0000 7f473110c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:08:48.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.087+0000 7f4729d74640 1 -- 10.20.193.48:0/708868221 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47200359f0 con 0x7f4718004280 2026-02-12T18:08:48.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.087+0000 7f4729d74640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:48.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.087+0000 7f4729d74640 1 -- 10.20.193.48:0/708868221 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4720035b60 con 0x7f4718004280 2026-02-12T18:08:48.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.087+0000 7f4729d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.087+0000 7f4729d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:08:48.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.087+0000 7f4729d74640 10 monclient: dump: 2026-02-12T18:08:48.103 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.103 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.103 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.104 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.104 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.104 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.104 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.104 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.104 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.104 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.104 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.104 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.104 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.104 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.104 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.105 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.087+0000 7f473110c640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:48.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.087+0000 7f473110c640 4 set_mon_vals no callback set 2026-02-12T18:08:48.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.087+0000 7f473110c640 10 monclient: shutdown 2026-02-12T18:08:48.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.087+0000 7f473110c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:48.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.087+0000 7f473110c640 1 -- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f4718004280 msgr2=0x7f4718004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.087+0000 7f473110c640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f4718004280 0x7f4718004850 secure :-1 s=READY pgs=248 gs=51 cs=0 l=1 c_cookie=787169608983566300 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4720007ef0 tx=0x7f472002fa00 comp rx=0 tx=0).stop 2026-02-12T18:08:48.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.087+0000 7f473110c640 1 -- 10.20.193.48:0/708868221 shutdown_connections 2026-02-12T18:08:48.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.087+0000 7f473110c640 1 --2- 10.20.193.48:0/708868221 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f4718004280 0x7f4718004850 unknown :-1 s=CLOSED pgs=248 gs=51 cs=0 l=1 c_cookie=787169608983566300 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.087+0000 7f473110c640 1 -- 10.20.193.48:0/708868221 >> 10.20.193.48:0/708868221 conn(0x7f472c054d90 msgr2=0x7f472c0952a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:48.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.087+0000 7f473110c640 1 -- 10.20.193.48:0/708868221 shutdown_connections 2026-02-12T18:08:48.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.087+0000 7f473110c640 1 -- 10.20.193.48:0/708868221 wait complete. 2026-02-12T18:08:48.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f473110c640 10 monclient: build_initial_monmap 2026-02-12T18:08:48.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f473110c640 10 monclient: monmap: 2026-02-12T18:08:48.106 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:48.106 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:48.106 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:48.106 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:48.106 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:48.106 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.106 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:48.106 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:48.107 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:48.107 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:48.107 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:48.107 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:48.107 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:48.107 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:48.107 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:48.107 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f473110c640 1 Processor -- start 2026-02-12T18:08:48.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f473110c640 1 -- start start 2026-02-12T18:08:48.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f473110c640 10 monclient: init 2026-02-12T18:08:48.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f473110c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:48.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f473110c640 10 monclient: _add_conns ranks=[6,7,5,2,3,8,0,1,4] 2026-02-12T18:08:48.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f473110c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4718004280 0x7f472c1db290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f473110c640 10 monclient(hunting): picked mon.noname-d con 0x7f4718004280 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:08:48.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f473110c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f472c1db7d0 0x7f472c12b900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f473110c640 10 monclient(hunting): picked mon.noname-i con 0x7f472c1db7d0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:48.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f473110c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c12be40 0x7f472c12c2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f473110c640 10 monclient(hunting): picked mon.noname-h con 0x7f472c12be40 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:08:48.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f473110c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f473110c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f472c092a40 con 0x7f472c12be40 2026-02-12T18:08:48.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f473110c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f473110c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f472c12d020 con 0x7f4718004280 2026-02-12T18:08:48.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f473110c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f473110c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f472c13e940 con 0x7f472c1db7d0 2026-02-12T18:08:48.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f473110c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:48.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f473110c640 10 monclient(hunting): authenticate will time out at 766.814887s 2026-02-12T18:08:48.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f472ad76640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4718004280 0x7f472c1db290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f472ad76640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4718004280 0x7f472c1db290 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:38806/0 (socket says 10.20.193.48:38806) 2026-02-12T18:08:48.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f472ad76640 1 -- 10.20.193.48:0/2421530171 learned_addr learned my addr 10.20.193.48:0/2421530171 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:48.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f472ad76640 10 monclient(hunting): get_auth_request con 0x7f4718004280 auth_method 0 2026-02-12T18:08:48.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f472ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f472ad76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.088+0000 7f472ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.089+0000 7f472b577640 1 --2- 10.20.193.48:0/2421530171 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c12be40 0x7f472c12c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.089+0000 7f472ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.089+0000 7f472ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.089+0000 7f472ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.089+0000 7f472b577640 10 monclient(hunting): get_auth_request con 0x7f472c12be40 auth_method 0 2026-02-12T18:08:48.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.089+0000 7f472b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.089+0000 7f472b577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.089+0000 7f472b577640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.089+0000 7f472a575640 1 --2- 10.20.193.48:0/2421530171 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f472c1db7d0 0x7f472c12b900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.089+0000 7f472a575640 10 monclient(hunting): get_auth_request con 0x7f472c1db7d0 auth_method 0 2026-02-12T18:08:48.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.089+0000 7f472a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.089+0000 7f472a575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.089+0000 7f472a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.089+0000 7f472ad76640 10 monclient(hunting): handle_auth_done global_id 5037 payload 824 2026-02-12T18:08:48.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.089+0000 7f472ad76640 1 -- 10.20.193.48:0/2421530171 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f472c1db7d0 msgr2=0x7f472c12b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.089+0000 7f472ad76640 1 --2- 10.20.193.48:0/2421530171 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f472c1db7d0 0x7f472c12b900 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.089+0000 7f472ad76640 1 -- 10.20.193.48:0/2421530171 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c12be40 msgr2=0x7f472c12c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.089+0000 7f472ad76640 1 --2- 10.20.193.48:0/2421530171 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c12be40 0x7f472c12c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.089+0000 7f472ad76640 10 monclient: _finish_hunting 0 2026-02-12T18:08:48.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.089+0000 7f472ad76640 1 monclient: found mon.noname-d 2026-02-12T18:08:48.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.089+0000 7f472ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:48.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.089+0000 7f472ad76640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:08:48.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.089+0000 7f472ad76640 1 -- 10.20.193.48:0/2421530171 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f472c12eae0 con 0x7f4718004280 2026-02-12T18:08:48.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.089+0000 7f472b577640 1 --2- 10.20.193.48:0/2421530171 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c12be40 0x7f472c12c2b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:08:48.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.089+0000 7f472a575640 1 --2- 10.20.193.48:0/2421530171 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f472c1db7d0 0x7f472c12b900 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:08:48.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.091+0000 7f472ad76640 1 -- 10.20.193.48:0/2421530171 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4718004280 msgr2=0x7f472c1db290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:48.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.091+0000 7f472ad76640 1 --2- 10.20.193.48:0/2421530171 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4718004280 0x7f472c1db290 secure :-1 s=READY pgs=140 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4720003900 tx=0x7f4720004000 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.091+0000 7f470b7fe640 1 -- 10.20.193.48:0/2421530171 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4720036910 con 0x7f4718004280 2026-02-12T18:08:48.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.091+0000 7f470b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.091+0000 7f470b7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:08:48.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.091+0000 7f470b7fe640 10 monclient: dump: 2026-02-12T18:08:48.112 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.112 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.112 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.112 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.112 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.112 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.112 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.112 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.112 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.113 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.113 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.113 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.113 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.113 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.113 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.113 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.091+0000 7f470b7fe640 10 monclient: _finish_auth 0 2026-02-12T18:08:48.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.091+0000 7f470b7fe640 10 monclient: _check_auth_tickets 2026-02-12T18:08:48.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.091+0000 7f470b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:48.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.091+0000 7f470b7fe640 1 -- 10.20.193.48:0/2421530171 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4720036ad0 con 0x7f4718004280 2026-02-12T18:08:48.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.091+0000 7f470b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:48.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.091+0000 7f470b7fe640 1 -- 10.20.193.48:0/2421530171 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4720036c40 con 0x7f4718004280 2026-02-12T18:08:48.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.091+0000 7f473110c640 5 monclient: authenticate success, global_id 5037 2026-02-12T18:08:48.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.091+0000 7f4729573640 4 set_mon_vals no callback set 2026-02-12T18:08:48.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.091+0000 7f473110c640 10 monclient: _renew_subs 2026-02-12T18:08:48.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.091+0000 7f473110c640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:08:48.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.091+0000 7f473110c640 1 -- 10.20.193.48:0/2421530171 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f472c12edc0 con 0x7f4718004280 2026-02-12T18:08:48.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.091+0000 7f470b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.091+0000 7f470b7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:08:48.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.091+0000 7f470b7fe640 10 monclient: dump: 2026-02-12T18:08:48.114 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.114 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.114 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.115 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.115 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.115 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.115 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.115 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.115 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.115 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.115 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.115 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.115 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.115 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.115 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.116 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.091+0000 7f473110c640 10 monclient: _renew_subs 2026-02-12T18:08:48.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.091+0000 7f473110c640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:08:48.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.091+0000 7f473110c640 1 -- 10.20.193.48:0/2421530171 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f472c12e7d0 con 0x7f4718004280 2026-02-12T18:08:48.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.092+0000 7f470b7fe640 1 -- 10.20.193.48:0/2421530171 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f4720034070 con 0x7f4718004280 2026-02-12T18:08:48.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.092+0000 7f473110c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:48.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.092+0000 7f473110c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:48.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.092+0000 7f473110c640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:08:48.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.092+0000 7f473110c640 1 -- 10.20.193.48:0/2421530171 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f472c12f230 con 0x7f4718004280 2026-02-12T18:08:48.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.092+0000 7f470b7fe640 1 --2- 10.20.193.48:0/2421530171 >> v2:10.20.193.111:6812/977811348 conn(0x7f46f803f7f0 0x7f46f805fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.092+0000 7f470b7fe640 1 -- 10.20.193.48:0/2421530171 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(118..118 src has 1..118) ==== 3503+0+0 (secure 0 0 0) 0x7f47200789b0 con 0x7f4718004280 2026-02-12T18:08:48.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.092+0000 7f472a575640 1 --2- 10.20.193.48:0/2421530171 >> v2:10.20.193.111:6812/977811348 conn(0x7f46f803f7f0 0x7f46f805fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.092+0000 7f472a575640 10 monclient: get_auth_request con 0x7f46f803f7f0 auth_method 0 2026-02-12T18:08:48.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.094+0000 7f470b7fe640 1 -- 10.20.193.48:0/2421530171 <== mon.6 v2:10.20.193.48:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f4720036450 con 0x7f4718004280 2026-02-12T18:08:48.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.094+0000 7f470b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:48.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.094+0000 7f470b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:48.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.095+0000 7f472a575640 1 --2- 10.20.193.48:0/2421530171 >> v2:10.20.193.111:6812/977811348 conn(0x7f46f803f7f0 0x7f46f805fca0 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f472c08f620 tx=0x7f4714006c50 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.241+0000 7f473110c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T18:08:48.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.241+0000 7f473110c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T18:08:48.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.241+0000 7f473110c640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:08:48.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.241+0000 7f473110c640 1 -- 10.20.193.48:0/2421530171 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f472c094410 con 0x7f4718004280 2026-02-12T18:08:48.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.241+0000 7f470b7fe640 1 -- 10.20.193.48:0/2421530171 <== mon.6 v2:10.20.193.48:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3642 (secure 0 0 0) 0x7f4720046020 con 0x7f4718004280 2026-02-12T18:08:48.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.241+0000 7f470b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T18:08:48.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.241+0000 7f470b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:48.244 INFO:teuthology.orchestra.run.trial048.stdout:{"election_epoch":38,"quorum":[0,1,2,5,6,7],"quorum_names":["a","f","b","h","d","i"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","modified":"2026-02-12T18:05:32.850777Z","created":"2026-02-12T18:05:32.850777Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3300","nonce":0},{"type":"v1","addr":"10.20.193.48:6789","nonce":0}]},"addr":"10.20.193.48:6789/0","public_addr":"10.20.193.48:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850827+0000","crush_location":[]},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3300","nonce":0},{"type":"v1","addr":"10.20.193.111:6789","nonce":0}]},"addr":"10.20.193.111:6789/0","public_addr":"10.20.193.111:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850829+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3301","nonce":0},{"type":"v1","addr":"10.20.193.48:6790","nonce":0}]},"addr":"10.20.193.48:6790/0","public_addr":"10.20.193.48:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850830+0000","crush_location":[]},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3301","nonce":0},{"type":"v1","addr":"10.20.193.111:6790","nonce":0}]},"addr":"10.20.193.111:6790/0","public_addr":"10.20.193.111:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850833+0000","crush_location":[]},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3302","nonce":0},{"type":"v1","addr":"10.20.193.48:6791","nonce":0}]},"addr":"10.20.193.48:6791/0","public_addr":"10.20.193.48:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3302","nonce":0},{"type":"v1","addr":"10.20.193.111:6791","nonce":0}]},"addr":"10.20.193.111:6791/0","public_addr":"10.20.193.111:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850834+0000","crush_location":[]},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3303","nonce":0},{"type":"v1","addr":"10.20.193.48:6792","nonce":0}]},"addr":"10.20.193.48:6792/0","public_addr":"10.20.193.48:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3303","nonce":0},{"type":"v1","addr":"10.20.193.111:6792","nonce":0}]},"addr":"10.20.193.111:6792/0","public_addr":"10.20.193.111:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850835+0000","crush_location":[]},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3304","nonce":0},{"type":"v1","addr":"10.20.193.48:6793","nonce":0}]},"addr":"10.20.193.48:6793/0","public_addr":"10.20.193.48:6793/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850832+0000","crush_location":[]}]}} 2026-02-12T18:08:48.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.243+0000 7f473110c640 1 -- 10.20.193.48:0/2421530171 >> v2:10.20.193.111:6812/977811348 conn(0x7f46f803f7f0 msgr2=0x7f46f805fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.243+0000 7f473110c640 1 --2- 10.20.193.48:0/2421530171 >> v2:10.20.193.111:6812/977811348 conn(0x7f46f803f7f0 0x7f46f805fca0 secure :-1 s=READY pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f472c08f620 tx=0x7f4714006c50 comp rx=0 tx=0).stop 2026-02-12T18:08:48.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.243+0000 7f473110c640 10 monclient: shutdown 2026-02-12T18:08:48.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.243+0000 7f473110c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:48.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.243+0000 7f473110c640 1 -- 10.20.193.48:0/2421530171 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4718004280 msgr2=0x7f472c1db290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.243+0000 7f473110c640 1 --2- 10.20.193.48:0/2421530171 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4718004280 0x7f472c1db290 secure :-1 s=READY pgs=140 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4720003900 tx=0x7f4720004000 comp rx=0 tx=0).stop 2026-02-12T18:08:48.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.243+0000 7f473110c640 1 -- 10.20.193.48:0/2421530171 shutdown_connections 2026-02-12T18:08:48.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.243+0000 7f473110c640 1 --2- 10.20.193.48:0/2421530171 >> v2:10.20.193.111:6812/977811348 conn(0x7f46f803f7f0 0x7f46f805fca0 unknown :-1 s=CLOSED pgs=197 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.243+0000 7f473110c640 1 --2- 10.20.193.48:0/2421530171 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f472c1db7d0 0x7f472c12b900 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.243+0000 7f473110c640 1 --2- 10.20.193.48:0/2421530171 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f472c12be40 0x7f472c12c2b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.243+0000 7f473110c640 1 --2- 10.20.193.48:0/2421530171 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4718004280 0x7f472c1db290 unknown :-1 s=CLOSED pgs=140 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.243+0000 7f473110c640 1 -- 10.20.193.48:0/2421530171 >> 10.20.193.48:0/2421530171 conn(0x7f472c054d90 msgr2=0x7f472c08b970 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:48.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.243+0000 7f473110c640 1 -- 10.20.193.48:0/2421530171 shutdown_connections 2026-02-12T18:08:48.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.243+0000 7f473110c640 1 -- 10.20.193.48:0/2421530171 wait complete. 2026-02-12T18:08:48.253 INFO:tasks.mon_thrash.ceph_manager:quorum is size 6 2026-02-12T18:08:48.253 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon a 2026-02-12T18:08:48.253 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T18:08:48.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.319+0000 7f3d9348c640 10 monclient: get_monmap_and_config 2026-02-12T18:08:48.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.319+0000 7f3d9348c640 10 monclient: build_initial_monmap 2026-02-12T18:08:48.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.319+0000 7f3d9348c640 10 monclient: monmap: 2026-02-12T18:08:48.321 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:48.321 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.321 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:48.320582+0000 2026-02-12T18:08:48.321 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:48.320582+0000 2026-02-12T18:08:48.321 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:48.321 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.322 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:48.322 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:48.322 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:48.322 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:48.322 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:48.322 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:48.322 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:48.322 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:48.322 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:48.322 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:48.322 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:48.322 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.319+0000 7f3d9348c640 1 Processor -- start 2026-02-12T18:08:48.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.319+0000 7f3d9348c640 1 -- start start 2026-02-12T18:08:48.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.319+0000 7f3d9348c640 10 monclient: init 2026-02-12T18:08:48.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d9348c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:48.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d9348c640 10 monclient: _add_conns ranks=[6,5,2,0,9,7,1,3,4,10,8] 2026-02-12T18:08:48.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d9348c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3d8c05dc40 0x7f3d8c05e010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d9348c640 10 monclient(hunting): picked mon.noname-d con 0x7f3d8c05dc40 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:08:48.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d9348c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f3d8c140f30 0x7f3d8c089df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d9348c640 10 monclient(hunting): picked mon.noname-h con 0x7f3d8c140f30 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:08:48.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d9348c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f3d8c141360 0x7f3d8c08a330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d9348c640 10 monclient(hunting): picked mon.noname-b con 0x7f3d8c141360 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:08:48.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d9348c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d9348c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f3d8c093d10 con 0x7f3d8c141360 2026-02-12T18:08:48.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d9348c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d9348c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f3d8c141cf0 con 0x7f3d8c140f30 2026-02-12T18:08:48.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d9348c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d9348c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f3d8c093470 con 0x7f3d8c05dc40 2026-02-12T18:08:48.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d9348c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:48.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d9348c640 10 monclient(hunting): authenticate will time out at 767.046298s 2026-02-12T18:08:48.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91a02640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f3d8c141360 0x7f3d8c08a330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91201640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3d8c05dc40 0x7f3d8c05e010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91a02640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f3d8c141360 0x7f3d8c08a330 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:43082/0 (socket says 10.20.193.48:43082) 2026-02-12T18:08:48.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91a02640 1 -- 10.20.193.48:0/3874966361 learned_addr learned my addr 10.20.193.48:0/3874966361 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:48.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91a02640 10 monclient(hunting): get_auth_request con 0x7f3d8c141360 auth_method 0 2026-02-12T18:08:48.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91a02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91a02640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91a02640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91201640 10 monclient(hunting): get_auth_request con 0x7f3d8c05dc40 auth_method 0 2026-02-12T18:08:48.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91201640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91201640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91201640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d90a00640 1 --2- 10.20.193.48:0/3874966361 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f3d8c140f30 0x7f3d8c089df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d90a00640 10 monclient(hunting): get_auth_request con 0x7f3d8c140f30 auth_method 0 2026-02-12T18:08:48.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d90a00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d90a00640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d90a00640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91201640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91201640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91201640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91a02640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91a02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91a02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d90a00640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d90a00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d90a00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91201640 10 monclient(hunting): handle_auth_done global_id 5046 payload 274 2026-02-12T18:08:48.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91201640 1 -- 10.20.193.48:0/3874966361 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f3d8c140f30 msgr2=0x7f3d8c089df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:48.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91201640 1 --2- 10.20.193.48:0/3874966361 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f3d8c140f30 0x7f3d8c089df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91201640 1 -- 10.20.193.48:0/3874966361 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f3d8c141360 msgr2=0x7f3d8c08a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:48.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91201640 1 --2- 10.20.193.48:0/3874966361 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f3d8c141360 0x7f3d8c08a330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91201640 10 monclient: _finish_hunting 0 2026-02-12T18:08:48.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91201640 1 monclient: found mon.noname-d 2026-02-12T18:08:48.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91201640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:48.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91201640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:08:48.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91201640 1 -- 10.20.193.48:0/3874966361 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8c04dc20 con 0x7f3d8c05dc40 2026-02-12T18:08:48.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.320+0000 7f3d91a02640 1 --2- 10.20.193.48:0/3874966361 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f3d8c141360 0x7f3d8c08a330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:08:48.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d91201640 1 -- 10.20.193.48:0/3874966361 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3d8c05dc40 msgr2=0x7f3d8c05e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:48.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d91201640 1 --2- 10.20.193.48:0/3874966361 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3d8c05dc40 0x7f3d8c05e010 secure :-1 s=READY pgs=141 gs=1 cs=0 l=1 c_cookie=316657437326052999 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d7c009830 tx=0x7f3d7c02ed30 comp rx=0 tx=0).ready entity=mon.6 client_cookie=464fe42f34e0e87 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d7bfff640 1 -- 10.20.193.48:0/3874966361 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3d7c02fe70 con 0x7f3d8c05dc40 2026-02-12T18:08:48.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d7bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d7bfff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:08:48.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d7bfff640 10 monclient: dump: 2026-02-12T18:08:48.339 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.340 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.340 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.340 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.340 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.340 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.340 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.340 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.340 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.340 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.340 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.340 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.341 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.341 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.341 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.341 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d7bfff640 10 monclient: _finish_auth 0 2026-02-12T18:08:48.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d7bfff640 10 monclient: _check_auth_tickets 2026-02-12T18:08:48.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d7bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:48.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d9348c640 5 monclient: authenticate success, global_id 5046 2026-02-12T18:08:48.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d9348c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:08:48.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d7bfff640 1 -- 10.20.193.48:0/3874966361 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d7c035340 con 0x7f3d8c05dc40 2026-02-12T18:08:48.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d7bfff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:48.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d7bfff640 1 -- 10.20.193.48:0/3874966361 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3d7c035970 con 0x7f3d8c05dc40 2026-02-12T18:08:48.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d7bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d7bfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:08:48.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d7bfff640 10 monclient: dump: 2026-02-12T18:08:48.342 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.342 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.342 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.342 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.342 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.342 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.342 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.342 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.342 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.343 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.343 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.343 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.343 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.343 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.343 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.343 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d9348c640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:48.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d9348c640 4 set_mon_vals no callback set 2026-02-12T18:08:48.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d9348c640 10 monclient: shutdown 2026-02-12T18:08:48.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d9348c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:48.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d9348c640 1 -- 10.20.193.48:0/3874966361 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3d8c05dc40 msgr2=0x7f3d8c05e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d9348c640 1 --2- 10.20.193.48:0/3874966361 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3d8c05dc40 0x7f3d8c05e010 secure :-1 s=READY pgs=141 gs=1 cs=0 l=1 c_cookie=316657437326052999 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d7c009830 tx=0x7f3d7c02ed30 comp rx=0 tx=0).stop 2026-02-12T18:08:48.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d9348c640 1 -- 10.20.193.48:0/3874966361 shutdown_connections 2026-02-12T18:08:48.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d9348c640 1 --2- 10.20.193.48:0/3874966361 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f3d8c141360 0x7f3d8c08a330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d9348c640 1 --2- 10.20.193.48:0/3874966361 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f3d8c140f30 0x7f3d8c089df0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d9348c640 1 --2- 10.20.193.48:0/3874966361 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3d8c05dc40 0x7f3d8c05e010 unknown :-1 s=CLOSED pgs=141 gs=1 cs=0 l=1 c_cookie=316657437326052999 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d9348c640 1 -- 10.20.193.48:0/3874966361 >> 10.20.193.48:0/3874966361 conn(0x7f3d8c097d10 msgr2=0x7f3d8c094010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:48.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d9348c640 1 -- 10.20.193.48:0/3874966361 shutdown_connections 2026-02-12T18:08:48.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.323+0000 7f3d9348c640 1 -- 10.20.193.48:0/3874966361 wait complete. 2026-02-12T18:08:48.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d9348c640 10 monclient: build_initial_monmap 2026-02-12T18:08:48.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d9348c640 10 monclient: monmap: 2026-02-12T18:08:48.344 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:48.344 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:48.345 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:48.345 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:48.345 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:48.345 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.345 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:48.345 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:48.345 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:48.345 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:48.345 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:48.345 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:48.345 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:48.345 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:48.346 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:48.346 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d9348c640 1 Processor -- start 2026-02-12T18:08:48.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d9348c640 1 -- start start 2026-02-12T18:08:48.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d9348c640 10 monclient: init 2026-02-12T18:08:48.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d9348c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:48.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d9348c640 10 monclient: _add_conns ranks=[1,0,3,4,2,6,7,5,8] 2026-02-12T18:08:48.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d9348c640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f3d8c05dc40 0x7f3d8c133b40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d9348c640 10 monclient(hunting): picked mon.noname-f con 0x7f3d8c05dc40 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:08:48.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d9348c640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3d8c140f30 0x7f3d8c10db60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d9348c640 10 monclient(hunting): picked mon.noname-a con 0x7f3d8c140f30 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:08:48.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d9348c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f3d8c141360 0x7f3d8c10e0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d9348c640 10 monclient(hunting): picked mon.noname-g con 0x7f3d8c141360 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:08:48.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d9348c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d9348c640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c140bd0 con 0x7f3d8c140f30 2026-02-12T18:08:48.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d9348c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d9348c640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c10f280 con 0x7f3d8c05dc40 2026-02-12T18:08:48.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d9348c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d9348c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f3d8c124590 con 0x7f3d8c141360 2026-02-12T18:08:48.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d9348c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:48.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d9348c640 10 monclient(hunting): authenticate will time out at 767.050683s 2026-02-12T18:08:48.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d91a02640 1 -- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f3d8c141360 msgr2=0x7f3d8c10e0a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3301/0 2026-02-12T18:08:48.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d91a02640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f3d8c141360 0x7f3d8c10e0a0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:08:48.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d90a00640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3d8c140f30 0x7f3d8c10db60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d90a00640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3d8c140f30 0x7f3d8c10db60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:60692/0 (socket says 10.20.193.48:60692) 2026-02-12T18:08:48.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d90a00640 1 -- 10.20.193.48:0/878499449 learned_addr learned my addr 10.20.193.48:0/878499449 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:48.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d90a00640 10 monclient(hunting): get_auth_request con 0x7f3d8c140f30 auth_method 0 2026-02-12T18:08:48.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d90a00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d90a00640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d90a00640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d90a00640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d90a00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d90a00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d91201640 1 --2- 10.20.193.48:0/878499449 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f3d8c05dc40 0x7f3d8c133b40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d91201640 10 monclient(hunting): get_auth_request con 0x7f3d8c05dc40 auth_method 0 2026-02-12T18:08:48.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d91201640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d91201640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d91201640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d90a00640 10 monclient(hunting): handle_auth_done global_id 5238 payload 824 2026-02-12T18:08:48.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d90a00640 1 -- 10.20.193.48:0/878499449 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f3d8c141360 msgr2=0x7f3d8c10e0a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:08:48.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d90a00640 1 --2- 10.20.193.48:0/878499449 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f3d8c141360 0x7f3d8c10e0a0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d90a00640 1 -- 10.20.193.48:0/878499449 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f3d8c05dc40 msgr2=0x7f3d8c133b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d90a00640 1 --2- 10.20.193.48:0/878499449 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f3d8c05dc40 0x7f3d8c133b40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d90a00640 10 monclient: _finish_hunting 0 2026-02-12T18:08:48.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d90a00640 1 monclient: found mon.noname-a 2026-02-12T18:08:48.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d90a00640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:48.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d90a00640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:08:48.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.324+0000 7f3d90a00640 1 -- 10.20.193.48:0/878499449 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8800a5d0 con 0x7f3d8c140f30 2026-02-12T18:08:48.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d90a00640 1 -- 10.20.193.48:0/878499449 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3d8c140f30 msgr2=0x7f3d8c10db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:48.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d90a00640 1 --2- 10.20.193.48:0/878499449 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3d8c140f30 0x7f3d8c10db60 secure :-1 s=READY pgs=249 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d800093f0 tx=0x7f3d8000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d79ffb640 1 -- 10.20.193.48:0/878499449 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3d8000cb50 con 0x7f3d8c140f30 2026-02-12T18:08:48.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d79ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d79ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:08:48.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d79ffb640 10 monclient: dump: 2026-02-12T18:08:48.350 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.350 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.350 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.350 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.350 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.350 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.351 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.351 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.351 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.351 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.351 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.351 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.351 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.351 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.351 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.351 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d79ffb640 10 monclient: _finish_auth 0 2026-02-12T18:08:48.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d79ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:08:48.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d79ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:48.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d79ffb640 1 -- 10.20.193.48:0/878499449 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d8000ccd0 con 0x7f3d8c140f30 2026-02-12T18:08:48.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d79ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:48.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d79ffb640 1 -- 10.20.193.48:0/878499449 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3d8000ce40 con 0x7f3d8c140f30 2026-02-12T18:08:48.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d79ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d7b7fe640 4 set_mon_vals no callback set 2026-02-12T18:08:48.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d79ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:08:48.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d79ffb640 10 monclient: dump: 2026-02-12T18:08:48.352 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.352 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.352 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.352 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.352 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.353 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.353 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.353 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.353 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.353 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.353 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.353 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.353 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.353 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.353 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.353 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d9348c640 5 monclient: authenticate success, global_id 5238 2026-02-12T18:08:48.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d9348c640 10 monclient: _renew_subs 2026-02-12T18:08:48.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d9348c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:08:48.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d9348c640 1 -- 10.20.193.48:0/878499449 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d7c009420 con 0x7f3d8c140f30 2026-02-12T18:08:48.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d9348c640 10 monclient: _renew_subs 2026-02-12T18:08:48.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d9348c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:08:48.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d9348c640 1 -- 10.20.193.48:0/878499449 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d8c111020 con 0x7f3d8c140f30 2026-02-12T18:08:48.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d9348c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:48.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d9348c640 1 --2- 10.20.193.48:0/878499449 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3d8c10fde0 0x7f3d8c124ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d9348c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d9348c640 1 -- 10.20.193.48:0/878499449 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c1111b0 con 0x7f3d8c10fde0 2026-02-12T18:08:48.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.327+0000 7f3d91201640 1 --2- 10.20.193.48:0/878499449 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3d8c10fde0 0x7f3d8c124ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.328+0000 7f3d91201640 10 monclient: get_auth_request con 0x7f3d8c10fde0 auth_method 0 2026-02-12T18:08:48.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.328+0000 7f3d91201640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.328+0000 7f3d91201640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.328+0000 7f3d91201640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.328+0000 7f3d79ffb640 1 -- 10.20.193.48:0/878499449 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f3d80011070 con 0x7f3d8c140f30 2026-02-12T18:08:48.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.328+0000 7f3d91201640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.328+0000 7f3d91201640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.328+0000 7f3d91201640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.328+0000 7f3d91201640 10 monclient(hunting): handle_auth_done global_id 5247 payload 824 2026-02-12T18:08:48.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.328+0000 7f3d79ffb640 1 --2- 10.20.193.48:0/878499449 >> v2:10.20.193.111:6812/977811348 conn(0x7f3d5c03f7c0 0x7f3d5c05fc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.328+0000 7f3d91201640 1 -- 10.20.193.48:0/878499449 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d8c094a40 con 0x7f3d8c10fde0 2026-02-12T18:08:48.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.328+0000 7f3d79ffb640 1 -- 10.20.193.48:0/878499449 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 3503+0+0 (secure 0 0 0) 0x7f3d80052a00 con 0x7f3d8c140f30 2026-02-12T18:08:48.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.328+0000 7f3d91a02640 1 --2- 10.20.193.48:0/878499449 >> v2:10.20.193.111:6812/977811348 conn(0x7f3d5c03f7c0 0x7f3d5c05fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.328+0000 7f3d91a02640 10 monclient: get_auth_request con 0x7f3d5c03f7c0 auth_method 0 2026-02-12T18:08:48.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.330+0000 7f3d91201640 1 -- 10.20.193.48:0/878499449 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3d8c10fde0 msgr2=0x7f3d8c124ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:48.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.330+0000 7f3d91201640 1 --2- 10.20.193.48:0/878499449 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3d8c10fde0 0x7f3d8c124ee0 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d7c009830 tx=0x7f3d7c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.330+0000 7f3d79ffb640 1 -- 10.20.193.48:0/878499449 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3d7c003b90 con 0x7f3d8c10fde0 2026-02-12T18:08:48.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.330+0000 7f3d79ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.330+0000 7f3d79ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:08:48.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.330+0000 7f3d79ffb640 10 monclient: dump: 2026-02-12T18:08:48.356 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.356 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.356 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.356 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.356 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.356 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.356 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.356 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.357 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.357 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.357 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.357 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.357 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.357 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.357 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.357 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.330+0000 7f3d79ffb640 1 -- 10.20.193.48:0/878499449 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f3d7c003cf0 con 0x7f3d8c10fde0 2026-02-12T18:08:48.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.330+0000 7f3d79ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:48.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.330+0000 7f3d79ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:48.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.330+0000 7f3d79ffb640 1 -- 10.20.193.48:0/878499449 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3d8c10fde0 msgr2=0x7f3d8c124ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.330+0000 7f3d79ffb640 1 --2- 10.20.193.48:0/878499449 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3d8c10fde0 0x7f3d8c124ee0 secure :-1 s=READY pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d7c009830 tx=0x7f3d7c004770 comp rx=0 tx=0).stop 2026-02-12T18:08:48.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.330+0000 7f3d79ffb640 1 -- 10.20.193.48:0/878499449 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3d8c10fde0 msgr2=0x7f3d8c124ee0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:48.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.330+0000 7f3d79ffb640 1 --2- 10.20.193.48:0/878499449 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3d8c10fde0 0x7f3d8c124ee0 secure :-1 s=CLOSED pgs=250 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d7c009830 tx=0x7f3d7c004770 comp rx=0 tx=0).stop 2026-02-12T18:08:48.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.330+0000 7f3d91a02640 1 --2- 10.20.193.48:0/878499449 >> v2:10.20.193.111:6812/977811348 conn(0x7f3d5c03f7c0 0x7f3d5c05fc70 secure :-1 s=READY pgs=198 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d88005820 tx=0x7f3d88005850 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.334+0000 7f3d9348c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:08:48.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.334+0000 7f3d9348c640 1 --2- 10.20.193.48:0/878499449 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3d8c095410 0x7f3d8c125420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.334+0000 7f3d9348c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.334+0000 7f3d9348c640 1 -- 10.20.193.48:0/878499449 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c05f140 con 0x7f3d8c095410 2026-02-12T18:08:48.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.334+0000 7f3d91201640 1 --2- 10.20.193.48:0/878499449 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3d8c095410 0x7f3d8c125420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.334+0000 7f3d91201640 10 monclient: get_auth_request con 0x7f3d8c095410 auth_method 0 2026-02-12T18:08:48.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.334+0000 7f3d91201640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.334+0000 7f3d91201640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.334+0000 7f3d91201640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.334+0000 7f3d91201640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.334+0000 7f3d91201640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.334+0000 7f3d91201640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.334+0000 7f3d91201640 10 monclient(hunting): handle_auth_done global_id 5256 payload 824 2026-02-12T18:08:48.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.334+0000 7f3d91201640 1 -- 10.20.193.48:0/878499449 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3d8c093a30 con 0x7f3d8c095410 2026-02-12T18:08:48.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.336+0000 7f3d91201640 1 -- 10.20.193.48:0/878499449 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3d8c095410 msgr2=0x7f3d8c125420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:48.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.336+0000 7f3d91201640 1 --2- 10.20.193.48:0/878499449 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3d8c095410 0x7f3d8c125420 secure :-1 s=READY pgs=251 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d7c0023d0 tx=0x7f3d7c009210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.336+0000 7f3d79ffb640 1 -- 10.20.193.48:0/878499449 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3d7c050070 con 0x7f3d8c095410 2026-02-12T18:08:48.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.336+0000 7f3d79ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.336+0000 7f3d79ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:08:48.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.336+0000 7f3d79ffb640 10 monclient: dump: 2026-02-12T18:08:48.361 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.361 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.361 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.361 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.361 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.361 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.361 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.361 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.361 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.361 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.362 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.362 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.362 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.362 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.362 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.362 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.337+0000 7f3d79ffb640 1 -- 10.20.193.48:0/878499449 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9984 (secure 0 0 0) 0x7f3d7c035cf0 con 0x7f3d8c095410 2026-02-12T18:08:48.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.337+0000 7f3d79ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:08:48.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.337+0000 7f3d79ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:48.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.337+0000 7f3d79ffb640 1 -- 10.20.193.48:0/878499449 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3d8c095410 msgr2=0x7f3d8c125420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.337+0000 7f3d79ffb640 1 --2- 10.20.193.48:0/878499449 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3d8c095410 0x7f3d8c125420 secure :-1 s=READY pgs=251 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d7c0023d0 tx=0x7f3d7c009210 comp rx=0 tx=0).stop 2026-02-12T18:08:48.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.337+0000 7f3d79ffb640 1 -- 10.20.193.48:0/878499449 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3d8c095410 msgr2=0x7f3d8c125420 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:48.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.337+0000 7f3d79ffb640 1 --2- 10.20.193.48:0/878499449 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3d8c095410 0x7f3d8c125420 secure :-1 s=CLOSED pgs=251 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d7c0023d0 tx=0x7f3d7c009210 comp rx=0 tx=0).stop 2026-02-12T18:08:48.363 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:08:48.363 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:48.363 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:48.363 INFO:teuthology.orchestra.run.trial048.stdout: "state": "leader", 2026-02-12T18:08:48.363 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 38, 2026-02-12T18:08:48.363 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 183170, 2026-02-12T18:08:48.363 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:08:48.363 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:08:48.363 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:08:48.363 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:08:48.363 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:08:48.363 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:08:48.363 INFO:teuthology.orchestra.run.trial048.stdout: 7 2026-02-12T18:08:48.363 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:48.364 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:08:48.364 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:48.364 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:08:48.364 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:08:48.364 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:48.364 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:48.364 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:48.364 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:48.364 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:48.364 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:48.364 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:48.364 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:48.364 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:48.364 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:48.364 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:48.364 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:48.365 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:48.365 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:48.365 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:08:48.365 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:08:48.365 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:48.365 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:48.365 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:48.365 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:48.365 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:48.365 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:48.365 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:48.365 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:48.365 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:48.365 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:48.365 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:48.365 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:48.365 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:48.365 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.366 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.366 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:08:48.366 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:08:48.366 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:08:48.366 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:08:48.366 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:08:48.366 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:08:48.366 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:48.366 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:48.366 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:08:48.366 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:08:48.366 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:08:48.366 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:08:48.366 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:08:48.366 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:08:48.366 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:08:48.366 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:48.367 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:08:48.367 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:48.367 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:48.367 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:48.367 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:48.367 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:48.367 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:48.367 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:48.367 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:48.367 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:48.367 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:48.367 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:48.367 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:48.367 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:48.367 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:48.367 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:08:48.367 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.367 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:08:48.367 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.368 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:48.368 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:48.368 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.368 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.368 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.368 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.368 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:08:48.368 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.368 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.368 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.368 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.368 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:08:48.368 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.368 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.368 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.368 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.368 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:08:48.368 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:08:48.368 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.368 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.369 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:08:48.369 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.369 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.369 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.369 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:48.369 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:48.369 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.369 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.369 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.369 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.369 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:08:48.369 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.369 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.369 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.369 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.369 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:08:48.369 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.369 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.369 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.369 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.370 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:08:48.370 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:08:48.370 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.370 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.370 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:08:48.370 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.370 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.370 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.370 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:48.370 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:48.370 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.370 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.370 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.370 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.370 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:08:48.370 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.370 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.370 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.370 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.371 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:08:48.371 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.371 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.371 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.371 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.371 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:08:48.371 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:08:48.371 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.371 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.371 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:08:48.371 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.371 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.371 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.371 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:08:48.371 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:08:48.371 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.371 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.371 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.371 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.371 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:08:48.372 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.372 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.372 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.372 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.372 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:08:48.372 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.372 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.372 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.372 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.372 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:08:48.372 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:08:48.372 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.372 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.372 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:08:48.372 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.372 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.372 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.372 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:08:48.372 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:08:48.372 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.373 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.373 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.373 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.373 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:08:48.373 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.373 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.373 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.373 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.373 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:08:48.373 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.373 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.373 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.373 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.373 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:08:48.373 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:08:48.373 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.373 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.373 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:48.373 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.373 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.373 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.374 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:48.374 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:48.374 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.374 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.374 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.374 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.374 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:08:48.374 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.374 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.374 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.374 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.374 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:08:48.374 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.374 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.374 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.374 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.374 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:08:48.374 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:08:48.374 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.374 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.374 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:08:48.375 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.375 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.375 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.375 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:48.375 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:48.375 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.375 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.375 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.375 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.375 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:08:48.375 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.375 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.375 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.375 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.375 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:08:48.375 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.375 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.375 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.375 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.375 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:08:48.375 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:08:48.375 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.375 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.376 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:48.376 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.376 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.376 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.376 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:48.376 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:48.376 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.376 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.376 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.376 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.376 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:08:48.376 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.376 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.376 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.376 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.376 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:08:48.376 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.376 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.376 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.376 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.376 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:08:48.376 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:08:48.377 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.377 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.377 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:08:48.377 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.377 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.377 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.377 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:08:48.377 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:08:48.377 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.377 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.377 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.377 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.377 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:08:48.377 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.377 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.377 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.377 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.377 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:08:48.377 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.377 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.377 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.377 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.377 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:08:48.378 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:08:48.378 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.378 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.378 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:08:48.378 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.378 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.378 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.378 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.378 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:08:48.378 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:08:48.378 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.378 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:48.378 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:48.378 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:48.378 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.378 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:48.378 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:08:48.378 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.378 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:48.378 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:48.378 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:08:48.378 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.378 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.379 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.379 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:08:48.379 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:08:48.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.337+0000 7f3d9348c640 1 -- 10.20.193.48:0/878499449 >> v2:10.20.193.111:6812/977811348 conn(0x7f3d5c03f7c0 msgr2=0x7f3d5c05fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.337+0000 7f3d9348c640 1 --2- 10.20.193.48:0/878499449 >> v2:10.20.193.111:6812/977811348 conn(0x7f3d5c03f7c0 0x7f3d5c05fc70 secure :-1 s=READY pgs=198 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d88005820 tx=0x7f3d88005850 comp rx=0 tx=0).stop 2026-02-12T18:08:48.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.337+0000 7f3d9348c640 10 monclient: shutdown 2026-02-12T18:08:48.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.337+0000 7f3d9348c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:48.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.337+0000 7f3d9348c640 1 -- 10.20.193.48:0/878499449 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3d8c140f30 msgr2=0x7f3d8c10db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.337+0000 7f3d91a02640 1 -- 10.20.193.48:0/878499449 reap_dead start 2026-02-12T18:08:48.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.337+0000 7f3d9348c640 1 --2- 10.20.193.48:0/878499449 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3d8c140f30 0x7f3d8c10db60 secure :-1 s=READY pgs=249 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3d800093f0 tx=0x7f3d8000ed30 comp rx=0 tx=0).stop 2026-02-12T18:08:48.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.337+0000 7f3d9348c640 1 -- 10.20.193.48:0/878499449 shutdown_connections 2026-02-12T18:08:48.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.337+0000 7f3d9348c640 1 --2- 10.20.193.48:0/878499449 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3d8c140f30 0x7f3d8c10db60 unknown :-1 s=CLOSED pgs=249 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.337+0000 7f3d9348c640 1 -- 10.20.193.48:0/878499449 >> 10.20.193.48:0/878499449 conn(0x7f3d8c097d10 msgr2=0x7f3d8c08a5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:48.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.337+0000 7f3d9348c640 1 -- 10.20.193.48:0/878499449 shutdown_connections 2026-02-12T18:08:48.380 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.337+0000 7f3d9348c640 1 -- 10.20.193.48:0/878499449 wait complete. 2026-02-12T18:08:48.380 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2026-02-12T18:08:48.381 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon b 2026-02-12T18:08:48.381 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T18:08:48.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.446+0000 7f37f8b0c640 10 monclient: get_monmap_and_config 2026-02-12T18:08:48.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.446+0000 7f37f8b0c640 10 monclient: build_initial_monmap 2026-02-12T18:08:48.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.446+0000 7f37f8b0c640 10 monclient: monmap: 2026-02-12T18:08:48.448 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:48.448 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.448 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:48.447512+0000 2026-02-12T18:08:48.448 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:48.447512+0000 2026-02-12T18:08:48.448 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:48.448 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.448 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:48.448 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:48.448 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:48.448 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:48.448 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:48.448 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:48.448 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:48.448 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:48.448 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:48.448 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:48.449 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:48.449 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.446+0000 7f37f8b0c640 1 Processor -- start 2026-02-12T18:08:48.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.446+0000 7f37f8b0c640 1 -- start start 2026-02-12T18:08:48.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.446+0000 7f37f8b0c640 10 monclient: init 2026-02-12T18:08:48.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f8b0c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:48.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f8b0c640 10 monclient: _add_conns ranks=[8,6,5,4,3,2,0,7,9,1,10] 2026-02-12T18:08:48.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f8b0c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f37f405d550 0x7f37f405d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f8b0c640 10 monclient(hunting): picked mon.noname-e con 0x7f37f405d550 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:08:48.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f8b0c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f37f405de60 0x7f37f4141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f8b0c640 10 monclient(hunting): picked mon.noname-d con 0x7f37f405de60 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:08:48.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f8b0c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f37f413ef60 0x7f37f41424e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f8b0c640 10 monclient(hunting): picked mon.noname-h con 0x7f37f413ef60 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:08:48.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f8b0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f8b0c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f37f408d390 con 0x7f37f413ef60 2026-02-12T18:08:48.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f8b0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f8b0c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f37f408d5a0 con 0x7f37f405de60 2026-02-12T18:08:48.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f8b0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f8b0c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f37f40580e0 con 0x7f37f405d550 2026-02-12T18:08:48.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f8b0c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:48.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f8b0c640 10 monclient(hunting): authenticate will time out at 767.173274s 2026-02-12T18:08:48.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f2575640 1 -- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f37f405d550 msgr2=0x7f37f405d920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.48:3304/0 2026-02-12T18:08:48.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f2575640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f37f405d550 0x7f37f405d920 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:08:48.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f1d74640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f37f405de60 0x7f37f4141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f1d74640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f37f405de60 0x7f37f4141fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:38816/0 (socket says 10.20.193.48:38816) 2026-02-12T18:08:48.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f1d74640 1 -- 10.20.193.48:0/1530588209 learned_addr learned my addr 10.20.193.48:0/1530588209 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:48.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f1d74640 10 monclient(hunting): get_auth_request con 0x7f37f405de60 auth_method 0 2026-02-12T18:08:48.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f1d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f2d76640 1 --2- 10.20.193.48:0/1530588209 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f37f413ef60 0x7f37f41424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f2d76640 10 monclient(hunting): get_auth_request con 0x7f37f413ef60 auth_method 0 2026-02-12T18:08:48.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f2d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f1d74640 10 monclient(hunting): handle_auth_done global_id 5055 payload 274 2026-02-12T18:08:48.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f1d74640 1 -- 10.20.193.48:0/1530588209 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f37f405d550 msgr2=0x7f37f405d920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:08:48.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f1d74640 1 --2- 10.20.193.48:0/1530588209 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f37f405d550 0x7f37f405d920 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f1d74640 1 -- 10.20.193.48:0/1530588209 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f37f413ef60 msgr2=0x7f37f41424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:48.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f1d74640 1 --2- 10.20.193.48:0/1530588209 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f37f413ef60 0x7f37f41424e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f1d74640 10 monclient: _finish_hunting 0 2026-02-12T18:08:48.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f1d74640 1 monclient: found mon.noname-d 2026-02-12T18:08:48.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f1d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:48.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f1d74640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:08:48.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f1d74640 1 -- 10.20.193.48:0/1530588209 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f404dc20 con 0x7f37f405de60 2026-02-12T18:08:48.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.447+0000 7f37f2d76640 1 --2- 10.20.193.48:0/1530588209 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f37f413ef60 0x7f37f41424e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:08:48.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f1d74640 1 -- 10.20.193.48:0/1530588209 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f37f405de60 msgr2=0x7f37f4141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:48.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f1d74640 1 --2- 10.20.193.48:0/1530588209 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f37f405de60 0x7f37f4141fa0 secure :-1 s=READY pgs=142 gs=2 cs=0 l=1 c_cookie=14437040526805673516 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37dc0098d0 tx=0x7f37dc02ee30 comp rx=0 tx=0).ready entity=mon.6 client_cookie=c85aabde502ba62c server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f1573640 1 -- 10.20.193.48:0/1530588209 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f37dc035340 con 0x7f37f405de60 2026-02-12T18:08:48.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f1573640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:08:48.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f1573640 10 monclient: dump: 2026-02-12T18:08:48.458 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.458 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.458 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.458 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.458 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.458 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.458 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.458 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.458 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.458 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.458 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.458 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.458 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.458 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.458 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.459 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f1573640 10 monclient: _finish_auth 0 2026-02-12T18:08:48.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f1573640 10 monclient: _check_auth_tickets 2026-02-12T18:08:48.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:48.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f1573640 1 -- 10.20.193.48:0/1530588209 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37dc0354c0 con 0x7f37f405de60 2026-02-12T18:08:48.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f8b0c640 5 monclient: authenticate success, global_id 5055 2026-02-12T18:08:48.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f8b0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:08:48.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f1573640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:48.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f1573640 1 -- 10.20.193.48:0/1530588209 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f37dc035af0 con 0x7f37f405de60 2026-02-12T18:08:48.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f8b0c640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:48.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f8b0c640 4 set_mon_vals no callback set 2026-02-12T18:08:48.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f1573640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:08:48.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f1573640 10 monclient: dump: 2026-02-12T18:08:48.459 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.459 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.459 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.460 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.460 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.460 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.460 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.460 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.460 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.460 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.460 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.460 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.460 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.460 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.460 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.460 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f8b0c640 10 monclient: shutdown 2026-02-12T18:08:48.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f8b0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:48.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f8b0c640 1 -- 10.20.193.48:0/1530588209 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f37f405de60 msgr2=0x7f37f4141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f8b0c640 1 --2- 10.20.193.48:0/1530588209 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f37f405de60 0x7f37f4141fa0 secure :-1 s=READY pgs=142 gs=2 cs=0 l=1 c_cookie=14437040526805673516 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37dc0098d0 tx=0x7f37dc02ee30 comp rx=0 tx=0).stop 2026-02-12T18:08:48.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f8b0c640 1 -- 10.20.193.48:0/1530588209 shutdown_connections 2026-02-12T18:08:48.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f8b0c640 1 --2- 10.20.193.48:0/1530588209 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f37f413ef60 0x7f37f41424e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f8b0c640 1 --2- 10.20.193.48:0/1530588209 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f37f405de60 0x7f37f4141fa0 unknown :-1 s=CLOSED pgs=142 gs=2 cs=0 l=1 c_cookie=14437040526805673516 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f8b0c640 1 --2- 10.20.193.48:0/1530588209 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f37f405d550 0x7f37f405d920 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f8b0c640 1 -- 10.20.193.48:0/1530588209 >> 10.20.193.48:0/1530588209 conn(0x7f37f40546a0 msgr2=0x7f37f4054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:48.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f8b0c640 1 -- 10.20.193.48:0/1530588209 shutdown_connections 2026-02-12T18:08:48.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.450+0000 7f37f8b0c640 1 -- 10.20.193.48:0/1530588209 wait complete. 2026-02-12T18:08:48.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f8b0c640 10 monclient: build_initial_monmap 2026-02-12T18:08:48.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f8b0c640 10 monclient: monmap: 2026-02-12T18:08:48.461 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:48.461 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:48.461 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:48.461 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:48.461 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:48.461 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.461 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:48.462 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:48.462 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:48.462 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:48.462 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:48.462 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:48.462 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:48.462 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:48.462 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:48.462 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f8b0c640 1 Processor -- start 2026-02-12T18:08:48.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f8b0c640 1 -- start start 2026-02-12T18:08:48.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f8b0c640 10 monclient: init 2026-02-12T18:08:48.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f8b0c640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:48.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f8b0c640 10 monclient: _add_conns ranks=[1,5,0,4,3,6,2,8,7] 2026-02-12T18:08:48.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f8b0c640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f37f405d550 0x7f37f4131a70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f8b0c640 10 monclient(hunting): picked mon.noname-f con 0x7f37f405d550 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:08:48.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f8b0c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f37f405de60 0x7f37f408a680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f8b0c640 10 monclient(hunting): picked mon.noname-h con 0x7f37f405de60 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:08:48.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f8b0c640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f37f413ef60 0x7f37f408abc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f8b0c640 10 monclient(hunting): picked mon.noname-a con 0x7f37f413ef60 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:08:48.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f8b0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f8b0c640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f37f413dc40 con 0x7f37f413ef60 2026-02-12T18:08:48.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f8b0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f8b0c640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f37f408bba0 con 0x7f37f405d550 2026-02-12T18:08:48.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f8b0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f8b0c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f37f410f2e0 con 0x7f37f405de60 2026-02-12T18:08:48.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f8b0c640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:48.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f8b0c640 10 monclient(hunting): authenticate will time out at 767.177628s 2026-02-12T18:08:48.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f2d76640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f37f413ef60 0x7f37f408abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f2d76640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f37f413ef60 0x7f37f408abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:60722/0 (socket says 10.20.193.48:60722) 2026-02-12T18:08:48.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f2d76640 1 -- 10.20.193.48:0/570862492 learned_addr learned my addr 10.20.193.48:0/570862492 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:48.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f2d76640 10 monclient(hunting): get_auth_request con 0x7f37f413ef60 auth_method 0 2026-02-12T18:08:48.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f2d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f1d74640 1 --2- 10.20.193.48:0/570862492 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f37f405de60 0x7f37f408a680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f1d74640 10 monclient(hunting): get_auth_request con 0x7f37f405de60 auth_method 0 2026-02-12T18:08:48.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f1d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f2575640 1 --2- 10.20.193.48:0/570862492 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f37f405d550 0x7f37f4131a70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f2575640 10 monclient(hunting): get_auth_request con 0x7f37f405d550 auth_method 0 2026-02-12T18:08:48.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f2575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f1d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f1d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.451+0000 7f37f1d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.452+0000 7f37f2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.452+0000 7f37f2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.452+0000 7f37f2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.452+0000 7f37f2d76640 10 monclient(hunting): handle_auth_done global_id 5265 payload 824 2026-02-12T18:08:48.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.452+0000 7f37f2d76640 1 -- 10.20.193.48:0/570862492 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f37f405de60 msgr2=0x7f37f408a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.452+0000 7f37f2d76640 1 --2- 10.20.193.48:0/570862492 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f37f405de60 0x7f37f408a680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.452+0000 7f37f2d76640 1 -- 10.20.193.48:0/570862492 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f37f405d550 msgr2=0x7f37f4131a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.452+0000 7f37f2d76640 1 --2- 10.20.193.48:0/570862492 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f37f405d550 0x7f37f4131a70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.452+0000 7f37f2d76640 10 monclient: _finish_hunting 0 2026-02-12T18:08:48.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.452+0000 7f37f2d76640 1 monclient: found mon.noname-a 2026-02-12T18:08:48.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.452+0000 7f37f2d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:48.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.452+0000 7f37f2d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:08:48.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.452+0000 7f37f2d76640 1 -- 10.20.193.48:0/570862492 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37dc0094f0 con 0x7f37f413ef60 2026-02-12T18:08:48.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.454+0000 7f37f2d76640 1 -- 10.20.193.48:0/570862492 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f37f413ef60 msgr2=0x7f37f408abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:48.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.454+0000 7f37f2d76640 1 --2- 10.20.193.48:0/570862492 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f37f413ef60 0x7f37f408abc0 secure :-1 s=READY pgs=252 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37e400f7e0 tx=0x7f37e400fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.454+0000 7f37daffd640 1 -- 10.20.193.48:0/570862492 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f37e40047b0 con 0x7f37f413ef60 2026-02-12T18:08:48.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.454+0000 7f37daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.454+0000 7f37daffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:08:48.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.454+0000 7f37daffd640 10 monclient: dump: 2026-02-12T18:08:48.468 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.468 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.469 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.469 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.469 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.469 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.469 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.469 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.469 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.469 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.469 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.469 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.469 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.469 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.469 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.469 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.454+0000 7f37daffd640 10 monclient: _finish_auth 0 2026-02-12T18:08:48.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.454+0000 7f37daffd640 10 monclient: _check_auth_tickets 2026-02-12T18:08:48.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.454+0000 7f37daffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:48.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.454+0000 7f37daffd640 1 -- 10.20.193.48:0/570862492 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37e4004950 con 0x7f37f413ef60 2026-02-12T18:08:48.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.454+0000 7f37f8b0c640 5 monclient: authenticate success, global_id 5265 2026-02-12T18:08:48.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.454+0000 7f37f8b0c640 10 monclient: _renew_subs 2026-02-12T18:08:48.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.454+0000 7f37f8b0c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:08:48.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.454+0000 7f37f8b0c640 1 -- 10.20.193.48:0/570862492 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37f4120370 con 0x7f37f413ef60 2026-02-12T18:08:48.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.454+0000 7f37daffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:48.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.454+0000 7f37daffd640 1 -- 10.20.193.48:0/570862492 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f37e400d6d0 con 0x7f37f413ef60 2026-02-12T18:08:48.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.454+0000 7f37daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.454+0000 7f37f0d72640 4 set_mon_vals no callback set 2026-02-12T18:08:48.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.454+0000 7f37daffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:08:48.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.454+0000 7f37daffd640 10 monclient: dump: 2026-02-12T18:08:48.470 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.470 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.470 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.470 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.470 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.471 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.471 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.471 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.471 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.471 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.471 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.471 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.471 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.471 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.471 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.471 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.454+0000 7f37f8b0c640 10 monclient: _renew_subs 2026-02-12T18:08:48.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.454+0000 7f37f8b0c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:08:48.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.454+0000 7f37f8b0c640 1 -- 10.20.193.48:0/570862492 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37f41207c0 con 0x7f37f413ef60 2026-02-12T18:08:48.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.454+0000 7f37f8b0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:48.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.455+0000 7f37f8b0c640 1 --2- 10.20.193.48:0/570862492 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f37f4091010 0x7f37f408b100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.455+0000 7f37f8b0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.455+0000 7f37f8b0c640 1 -- 10.20.193.48:0/570862492 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f37f410ede0 con 0x7f37f4091010 2026-02-12T18:08:48.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.455+0000 7f37f2575640 1 --2- 10.20.193.48:0/570862492 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f37f4091010 0x7f37f408b100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.455+0000 7f37f2575640 10 monclient: get_auth_request con 0x7f37f4091010 auth_method 0 2026-02-12T18:08:48.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.455+0000 7f37f2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.455+0000 7f37f2575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.455+0000 7f37f2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.455+0000 7f37f2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.455+0000 7f37f2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.455+0000 7f37f2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.455+0000 7f37f2d76640 1 --2- 10.20.193.48:0/570862492 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f37f413ef60 0x7f37f408abc0 secure :-1 s=READY pgs=252 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37e400f7e0 tx=0x7f37e400fcb0 comp rx=0 tx=0).queue_received will delay after 1.77092e+09 on 0x7f37e4004ac0 mgrmap(e 5) 2026-02-12T18:08:48.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.455+0000 7f37daffd640 1 -- 10.20.193.48:0/570862492 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f37e4004ac0 con 0x7f37f413ef60 2026-02-12T18:08:48.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.455+0000 7f37f2575640 10 monclient(hunting): handle_auth_done global_id 35165 payload 824 2026-02-12T18:08:48.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.455+0000 7f37f2575640 1 -- 10.20.193.48:0/570862492 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f37f405e310 con 0x7f37f4091010 2026-02-12T18:08:48.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.455+0000 7f37f2575640 1 -- 10.20.193.48:0/570862492 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f37f4091010 msgr2=0x7f37f408b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-12T18:08:48.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.455+0000 7f37f2575640 1 -- 10.20.193.48:0/570862492 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f37f4091010 msgr2=0x7f37f408b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:08:48.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.455+0000 7f37f2575640 1 --2- 10.20.193.48:0/570862492 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f37f4091010 0x7f37f408b100 secure :-1 s=SESSION_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37e8003950 tx=0x7f37e8009a10 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:08:48.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.455+0000 7f37daffd640 1 --2- 10.20.193.48:0/570862492 >> v2:10.20.193.111:6812/977811348 conn(0x7f37c003f800 0x7f37c005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.455+0000 7f37f2575640 1 --2- 10.20.193.48:0/570862492 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f37f4091010 0x7f37f408b100 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:08:48.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.455+0000 7f37f1d74640 1 --2- 10.20.193.48:0/570862492 >> v2:10.20.193.111:6812/977811348 conn(0x7f37c003f800 0x7f37c005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.455+0000 7f37f1d74640 10 monclient: get_auth_request con 0x7f37c003f800 auth_method 0 2026-02-12T18:08:48.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.458+0000 7f37f1d74640 1 --2- 10.20.193.48:0/570862492 >> v2:10.20.193.111:6812/977811348 conn(0x7f37c003f800 0x7f37c005fcb0 secure :-1 s=READY pgs=199 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37dc02ee70 tx=0x7f37dc033000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.656+0000 7f37f2575640 1 --2- 10.20.193.48:0/570862492 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f37f4091010 0x7f37f408b100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.656+0000 7f37f2575640 10 monclient: get_auth_request con 0x7f37f4091010 auth_method 0 2026-02-12T18:08:48.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.656+0000 7f37f2575640 10 monclient: get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.656+0000 7f37f2575640 10 monclient: _init_auth method 2 2026-02-12T18:08:48.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.656+0000 7f37f2575640 10 monclient: _init_auth already have auth, reseting 2026-02-12T18:08:48.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.656+0000 7f37f2575640 10 monclient: handle_auth_reply_more payload 9 2026-02-12T18:08:48.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.656+0000 7f37f2575640 10 monclient: handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.656+0000 7f37f2575640 10 monclient: handle_auth_reply_more responding with 132 bytes 2026-02-12T18:08:48.658 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.656+0000 7f37f2575640 10 monclient: handle_auth_done global_id 35165 payload 293 2026-02-12T18:08:48.659 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.658+0000 7f37f2575640 1 -- 10.20.193.48:0/570862492 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f37f4091010 msgr2=0x7f37f408b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:48.659 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.658+0000 7f37f2575640 1 --2- 10.20.193.48:0/570862492 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f37f4091010 0x7f37f408b100 secure :-1 s=READY pgs=146 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37e8003950 tx=0x7f37e8009190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.659 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.658+0000 7f37daffd640 1 -- 10.20.193.48:0/570862492 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f37e800ed30 con 0x7f37f4091010 2026-02-12T18:08:48.660 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.658+0000 7f37daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.660 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.658+0000 7f37daffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:08:48.660 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.658+0000 7f37daffd640 10 monclient: dump: 2026-02-12T18:08:48.660 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.660 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.660 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.660 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.660 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.660 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.660 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.660 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.660 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.660 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.660 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.660 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.660 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.661 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.661 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.661 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.658+0000 7f37daffd640 1 -- 10.20.193.48:0/570862492 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f37e800ee90 con 0x7f37f4091010 2026-02-12T18:08:48.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.658+0000 7f37daffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:48.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.658+0000 7f37daffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:48.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.658+0000 7f37daffd640 1 -- 10.20.193.48:0/570862492 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f37f4091010 msgr2=0x7f37f408b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.658+0000 7f37daffd640 1 --2- 10.20.193.48:0/570862492 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f37f4091010 0x7f37f408b100 secure :-1 s=READY pgs=146 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37e8003950 tx=0x7f37e8009190 comp rx=0 tx=0).stop 2026-02-12T18:08:48.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.658+0000 7f37daffd640 1 -- 10.20.193.48:0/570862492 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f37f4091010 msgr2=0x7f37f408b100 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:48.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.658+0000 7f37daffd640 1 --2- 10.20.193.48:0/570862492 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f37f4091010 0x7f37f408b100 secure :-1 s=CLOSED pgs=146 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37e8003950 tx=0x7f37e8009190 comp rx=0 tx=0).stop 2026-02-12T18:08:48.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.662+0000 7f37f8b0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:08:48.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.662+0000 7f37f8b0c640 1 --2- 10.20.193.48:0/570862492 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f37f41313f0 0x7f37f4121c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.662+0000 7f37f8b0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.662+0000 7f37f8b0c640 1 -- 10.20.193.48:0/570862492 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f37f405f140 con 0x7f37f41313f0 2026-02-12T18:08:48.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.662+0000 7f37f2575640 1 --2- 10.20.193.48:0/570862492 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f37f41313f0 0x7f37f4121c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.662+0000 7f37f2575640 10 monclient: get_auth_request con 0x7f37f41313f0 auth_method 0 2026-02-12T18:08:48.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.662+0000 7f37f2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.662+0000 7f37f2575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.662+0000 7f37f2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.662+0000 7f37f2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.662+0000 7f37f2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.662+0000 7f37f2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.662+0000 7f37f2575640 10 monclient(hunting): handle_auth_done global_id 35174 payload 824 2026-02-12T18:08:48.665 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.662+0000 7f37f2575640 1 -- 10.20.193.48:0/570862492 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f37f4057e00 con 0x7f37f41313f0 2026-02-12T18:08:48.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.664+0000 7f37f2575640 1 -- 10.20.193.48:0/570862492 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f37f41313f0 msgr2=0x7f37f4121c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:48.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.664+0000 7f37f2575640 1 --2- 10.20.193.48:0/570862492 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f37f41313f0 0x7f37f4121c80 secure :-1 s=READY pgs=147 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37e8014040 tx=0x7f37e80038e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.664+0000 7f37daffd640 1 -- 10.20.193.48:0/570862492 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f37e8012cd0 con 0x7f37f41313f0 2026-02-12T18:08:48.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.664+0000 7f37daffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.665+0000 7f37daffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:08:48.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.665+0000 7f37daffd640 10 monclient: dump: 2026-02-12T18:08:48.667 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.667 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.667 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.667 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.667 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.667 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.667 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.667 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.667 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.667 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.667 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.667 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.667 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.667 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.667 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.668 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.665+0000 7f37daffd640 1 -- 10.20.193.48:0/570862492 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10316 (secure 0 0 0) 0x7f37e8012e30 con 0x7f37f41313f0 2026-02-12T18:08:48.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.665+0000 7f37daffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:08:48.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.665+0000 7f37daffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:48.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.665+0000 7f37daffd640 1 -- 10.20.193.48:0/570862492 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f37f41313f0 msgr2=0x7f37f4121c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.665+0000 7f37daffd640 1 --2- 10.20.193.48:0/570862492 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f37f41313f0 0x7f37f4121c80 secure :-1 s=READY pgs=147 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37e8014040 tx=0x7f37e80038e0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.665+0000 7f37daffd640 1 -- 10.20.193.48:0/570862492 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f37f41313f0 msgr2=0x7f37f4121c80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:48.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.665+0000 7f37daffd640 1 --2- 10.20.193.48:0/570862492 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f37f41313f0 0x7f37f4121c80 unknown :-1 s=CLOSED pgs=147 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.668 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:08:48.668 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:48.668 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:48.669 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:08:48.669 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 38, 2026-02-12T18:08:48.669 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 183498, 2026-02-12T18:08:48.669 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:08:48.669 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:08:48.669 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:08:48.669 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:08:48.669 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:08:48.669 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:08:48.669 INFO:teuthology.orchestra.run.trial048.stdout: 7 2026-02-12T18:08:48.669 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:48.669 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:08:48.669 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:48.669 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:08:48.669 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:08:48.670 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:48.670 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:48.670 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:48.670 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:48.670 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:48.670 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:48.670 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:48.670 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:48.670 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:48.670 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:48.670 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:48.670 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:48.670 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:48.670 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:48.670 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:08:48.670 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:08:48.671 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:48.671 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:48.671 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:48.671 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:48.671 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:48.671 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:48.671 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:48.671 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:48.671 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:48.671 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:48.671 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:48.671 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:48.671 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:48.671 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.671 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.671 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:08:48.671 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:08:48.672 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:08:48.672 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:08:48.672 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:08:48.672 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:08:48.672 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:48.672 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:48.672 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:08:48.672 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:08:48.672 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:08:48.672 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:08:48.672 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:08:48.672 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:08:48.672 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:08:48.672 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:48.672 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:08:48.672 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:48.673 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:48.673 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:48.673 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:48.673 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:48.673 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:48.673 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:48.673 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:48.673 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:48.673 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:48.673 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:48.673 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:48.673 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:48.673 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:48.673 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:08:48.673 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.673 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:08:48.673 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.673 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:48.674 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:48.674 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.674 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.674 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.674 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.674 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:08:48.674 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.674 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.674 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.674 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.674 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:08:48.674 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.674 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.674 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.674 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.674 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:08:48.675 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:08:48.675 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.675 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.675 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:08:48.675 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.675 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.675 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.675 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:48.675 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:48.675 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.675 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.675 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.675 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.675 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:08:48.675 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.675 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.675 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.676 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.676 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:08:48.676 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.676 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.676 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.676 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.676 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:08:48.676 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:08:48.676 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.676 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.676 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:08:48.676 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.676 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.676 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.676 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:48.676 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:48.676 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.677 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.677 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.677 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.677 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:08:48.677 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.677 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.677 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.677 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.677 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:08:48.677 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.677 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.677 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.677 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.677 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:08:48.677 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:08:48.677 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.678 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.678 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:08:48.678 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.678 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.678 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.678 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:08:48.678 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:08:48.678 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.678 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.678 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.678 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.678 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:08:48.678 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.678 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.678 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.678 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.678 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:08:48.679 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.679 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.679 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.679 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.679 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:08:48.679 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:08:48.679 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.679 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.679 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:08:48.679 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.679 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.679 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.679 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:08:48.679 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:08:48.679 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.679 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.679 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.680 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.680 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:08:48.680 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.680 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.680 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.680 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.680 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:08:48.680 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.680 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.680 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.680 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.680 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:08:48.680 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:08:48.680 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.680 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.680 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:48.680 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.681 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.681 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.681 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:48.681 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:48.681 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.681 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.681 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.681 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.681 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:08:48.681 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.681 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.681 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.681 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.681 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:08:48.681 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.681 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.681 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.682 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.682 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:08:48.682 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:08:48.682 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.682 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.682 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:08:48.682 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.682 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.682 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.682 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:48.682 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:48.682 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.682 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.682 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.682 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.682 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:08:48.682 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.683 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.683 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.683 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.683 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:08:48.683 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.683 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.683 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.683 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.683 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:08:48.683 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:08:48.683 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.683 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.683 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:48.683 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.683 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.683 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.683 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:48.684 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:48.684 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.684 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.684 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.684 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.684 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:08:48.684 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.684 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.684 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.684 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.684 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:08:48.684 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.684 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.684 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.684 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.684 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:08:48.684 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:08:48.685 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.685 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.685 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:08:48.685 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.685 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.685 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.685 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:08:48.685 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:08:48.685 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.685 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.685 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.685 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.685 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:08:48.685 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.685 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.685 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.686 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.686 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:08:48.686 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.686 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.686 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.686 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.686 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:08:48.686 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:08:48.686 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.686 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.686 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:08:48.686 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.686 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.686 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.686 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.686 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:08:48.686 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:08:48.687 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.687 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:48.687 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:48.687 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:48.687 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.687 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:48.687 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:08:48.687 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.687 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:48.687 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:48.687 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:08:48.687 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.687 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:48.687 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:08:48.687 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.687 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:48.687 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:48.687 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:08:48.688 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.688 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:48.688 INFO:teuthology.orchestra.run.trial048.stdout: "mgr": [ 2026-02-12T18:08:48.688 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.688 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:48.688 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:48.688 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:48.688 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.688 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.688 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.688 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:08:48.688 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:08:48.689 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.665+0000 7f37f8b0c640 1 -- 10.20.193.48:0/570862492 >> v2:10.20.193.111:6812/977811348 conn(0x7f37c003f800 msgr2=0x7f37c005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.689 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.665+0000 7f37f8b0c640 1 --2- 10.20.193.48:0/570862492 >> v2:10.20.193.111:6812/977811348 conn(0x7f37c003f800 0x7f37c005fcb0 secure :-1 s=READY pgs=199 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37dc02ee70 tx=0x7f37dc033000 comp rx=0 tx=0).stop 2026-02-12T18:08:48.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.665+0000 7f37f8b0c640 10 monclient: shutdown 2026-02-12T18:08:48.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.665+0000 7f37f8b0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:48.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.665+0000 7f37f8b0c640 1 -- 10.20.193.48:0/570862492 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f37f413ef60 msgr2=0x7f37f408abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.665+0000 7f37f8b0c640 1 --2- 10.20.193.48:0/570862492 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f37f413ef60 0x7f37f408abc0 secure :-1 s=READY pgs=252 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f37e400f7e0 tx=0x7f37e400fcb0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.665+0000 7f37f2d76640 1 -- 10.20.193.48:0/570862492 reap_dead start 2026-02-12T18:08:48.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.665+0000 7f37f2d76640 1 -- 10.20.193.48:0/570862492 reap_dead start 2026-02-12T18:08:48.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.665+0000 7f37daffd640 1 -- 10.20.193.48:0/570862492 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 3503+0+0 (unknown 0 0 0) 0x7f37e4053c80 con 0x7f37f413ef60 2026-02-12T18:08:48.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.665+0000 7f37f8b0c640 1 -- 10.20.193.48:0/570862492 shutdown_connections 2026-02-12T18:08:48.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.665+0000 7f37f8b0c640 1 -- 10.20.193.48:0/570862492 >> 10.20.193.48:0/570862492 conn(0x7f37f40546a0 msgr2=0x7f37f405cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:48.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.665+0000 7f37f8b0c640 1 -- 10.20.193.48:0/570862492 shutdown_connections 2026-02-12T18:08:48.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.665+0000 7f37f8b0c640 1 -- 10.20.193.48:0/570862492 wait complete. 2026-02-12T18:08:48.691 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2026-02-12T18:08:48.691 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon d 2026-02-12T18:08:48.691 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2026-02-12T18:08:48.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.754+0000 7fcacc5dd640 10 monclient: get_monmap_and_config 2026-02-12T18:08:48.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.754+0000 7fcacc5dd640 10 monclient: build_initial_monmap 2026-02-12T18:08:48.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.754+0000 7fcacc5dd640 10 monclient: monmap: 2026-02-12T18:08:48.756 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:48.756 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.756 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:48.755894+0000 2026-02-12T18:08:48.756 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:48.755894+0000 2026-02-12T18:08:48.756 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:48.756 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.756 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:48.757 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:48.757 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:48.757 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:48.757 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:48.757 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:48.757 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:48.757 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:48.757 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:48.757 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:48.757 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:48.757 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.755+0000 7fcacc5dd640 1 Processor -- start 2026-02-12T18:08:48.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.755+0000 7fcacc5dd640 1 -- start start 2026-02-12T18:08:48.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.755+0000 7fcacc5dd640 10 monclient: init 2026-02-12T18:08:48.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.755+0000 7fcacc5dd640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:48.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.755+0000 7fcacc5dd640 10 monclient: _add_conns ranks=[1,0,5,4,6,2,8,7,3,10,9] 2026-02-12T18:08:48.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.755+0000 7fcacc5dd640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fcac405d550 addr v1:10.20.193.111:6789/0 2026-02-12T18:08:48.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.755+0000 7fcacc5dd640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fcac413ef60 addr v1:10.20.193.48:6789/0 2026-02-12T18:08:48.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.755+0000 7fcacc5dd640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fcac4184a40 0x7fcac41a4e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.755+0000 7fcacc5dd640 10 monclient(hunting): picked mon.noname-h con 0x7fcac4184a40 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:08:48.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.755+0000 7fcacc5dd640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcac404dc20 con 0x7fcac413ef60 2026-02-12T18:08:48.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.755+0000 7fcacc5dd640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcac408d390 con 0x7fcac405d550 2026-02-12T18:08:48.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.755+0000 7fcacc5dd640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.755+0000 7fcacc5dd640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fcac408d5a0 con 0x7fcac4184a40 2026-02-12T18:08:48.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.755+0000 7fcacc5dd640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:48.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.755+0000 7fcacc5dd640 10 monclient(hunting): authenticate will time out at 767.481636s 2026-02-12T18:08:48.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.755+0000 7fcac9b51640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7fcac413ef60 0x7fcac4183320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:54024/0 (socket says 10.20.193.48:54024) 2026-02-12T18:08:48.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.755+0000 7fcac9b51640 1 -- 10.20.193.48:0/1691520740 learned_addr learned my addr 10.20.193.48:0/1691520740 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:08:48.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.755+0000 7fcacab53640 1 --2- 10.20.193.48:0/1691520740 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fcac4184a40 0x7fcac41a4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.755+0000 7fcacab53640 10 monclient(hunting): get_auth_request con 0x7fcac4184a40 auth_method 0 2026-02-12T18:08:48.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.755+0000 7fcacab53640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.755+0000 7fcacab53640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.755+0000 7fcacab53640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.755+0000 7fcacab53640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.755+0000 7fcacab53640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.755+0000 7fcacab53640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.756+0000 7fcacab53640 10 monclient(hunting): handle_auth_done global_id 5153 payload 274 2026-02-12T18:08:48.761 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.756+0000 7fcacab53640 1 -- 10.20.193.48:0/1691520740 >> v1:10.20.193.111:6789/0 conn(0x7fcac405d550 legacy=0x7fcac405d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:48.761 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.756+0000 7fcacab53640 1 -- 10.20.193.48:0/1691520740 >> v1:10.20.193.48:6789/0 conn(0x7fcac413ef60 legacy=0x7fcac4183320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:48.761 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.756+0000 7fcacab53640 10 monclient: _finish_hunting 0 2026-02-12T18:08:48.761 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.756+0000 7fcacab53640 1 monclient: found mon.noname-h 2026-02-12T18:08:48.761 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.756+0000 7fcacab53640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:48.761 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.756+0000 7fcacab53640 10 monclient: _send_mon_message to mon.noname-h at v2:10.20.193.111:3302/0 2026-02-12T18:08:48.761 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.756+0000 7fcacab53640 1 -- 10.20.193.48:0/1691520740 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac40580e0 con 0x7fcac4184a40 2026-02-12T18:08:48.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.758+0000 7fcacab53640 1 -- 10.20.193.48:0/1691520740 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fcac4184a40 msgr2=0x7fcac41a4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:48.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.758+0000 7fcacab53640 1 --2- 10.20.193.48:0/1691520740 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fcac4184a40 0x7fcac41a4e20 secure :-1 s=READY pgs=152 gs=3 cs=0 l=1 c_cookie=15828418970424817913 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcac000a8e0 tx=0x7fcac002fe20 comp rx=0 tx=0).ready entity=mon.5 client_cookie=dba9d730e839b8f9 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.758+0000 7fcac9350640 1 -- 10.20.193.48:0/1691520740 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcac0030b80 con 0x7fcac4184a40 2026-02-12T18:08:48.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.758+0000 7fcac9350640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.758+0000 7fcac9350640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2026-02-12T18:08:48.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.758+0000 7fcac9350640 10 monclient: dump: 2026-02-12T18:08:48.767 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.767 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.767 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.767 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.767 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.767 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.767 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.767 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.767 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.767 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.767 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.767 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.767 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.767 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.767 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.768 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.758+0000 7fcac9350640 10 monclient: _finish_auth 0 2026-02-12T18:08:48.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.758+0000 7fcac9350640 10 monclient: _check_auth_tickets 2026-02-12T18:08:48.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.758+0000 7fcac9350640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:48.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.758+0000 7fcac9350640 1 -- 10.20.193.48:0/1691520740 <== mon.5 v2:10.20.193.111:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcac0030d00 con 0x7fcac4184a40 2026-02-12T18:08:48.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.758+0000 7fcac9350640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:48.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.758+0000 7fcacc5dd640 5 monclient: authenticate success, global_id 5153 2026-02-12T18:08:48.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.758+0000 7fcac9350640 1 -- 10.20.193.48:0/1691520740 <== mon.5 v2:10.20.193.111:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcac0036cc0 con 0x7fcac4184a40 2026-02-12T18:08:48.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.758+0000 7fcacc5dd640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:48.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.758+0000 7fcacc5dd640 4 set_mon_vals no callback set 2026-02-12T18:08:48.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.758+0000 7fcac9350640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.758+0000 7fcac9350640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:08:48.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.758+0000 7fcac9350640 10 monclient: dump: 2026-02-12T18:08:48.768 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.768 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.768 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.769 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.769 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.769 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.769 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.769 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.769 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.769 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.769 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.769 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.769 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.769 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.769 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.769 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.759+0000 7fcacc5dd640 10 monclient: shutdown 2026-02-12T18:08:48.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.759+0000 7fcacc5dd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:48.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.759+0000 7fcacc5dd640 1 -- 10.20.193.48:0/1691520740 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fcac4184a40 msgr2=0x7fcac41a4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.759+0000 7fcacc5dd640 1 --2- 10.20.193.48:0/1691520740 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fcac4184a40 0x7fcac41a4e20 secure :-1 s=READY pgs=152 gs=3 cs=0 l=1 c_cookie=15828418970424817913 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcac000a8e0 tx=0x7fcac002fe20 comp rx=0 tx=0).stop 2026-02-12T18:08:48.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.759+0000 7fcacc5dd640 1 -- 10.20.193.48:0/1691520740 shutdown_connections 2026-02-12T18:08:48.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.759+0000 7fcacc5dd640 1 --2- 10.20.193.48:0/1691520740 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fcac4184a40 0x7fcac41a4e20 unknown :-1 s=CLOSED pgs=152 gs=3 cs=0 l=1 c_cookie=15828418970424817913 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.759+0000 7fcacc5dd640 1 -- 10.20.193.48:0/1691520740 >> 10.20.193.48:0/1691520740 conn(0x7fcac40546a0 msgr2=0x7fcac4054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:48.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.759+0000 7fcacc5dd640 1 -- 10.20.193.48:0/1691520740 shutdown_connections 2026-02-12T18:08:48.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.759+0000 7fcacc5dd640 1 -- 10.20.193.48:0/1691520740 wait complete. 2026-02-12T18:08:48.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.759+0000 7fcacc5dd640 10 monclient: build_initial_monmap 2026-02-12T18:08:48.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.759+0000 7fcacc5dd640 10 monclient: monmap: 2026-02-12T18:08:48.770 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:48.770 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:48.770 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:48.770 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:48.770 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:48.770 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.770 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:48.770 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:48.770 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:48.770 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:48.771 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:48.771 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:48.771 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:48.771 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:48.771 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:48.771 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.759+0000 7fcacc5dd640 1 Processor -- start 2026-02-12T18:08:48.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.759+0000 7fcacc5dd640 1 -- start start 2026-02-12T18:08:48.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.759+0000 7fcacc5dd640 10 monclient: init 2026-02-12T18:08:48.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcacc5dd640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:48.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcacc5dd640 10 monclient: _add_conns ranks=[5,6,8,1,0,3,7,2,4] 2026-02-12T18:08:48.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcacc5dd640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fcac405d550 0x7fcac4118a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcacc5dd640 10 monclient(hunting): picked mon.noname-h con 0x7fcac405d550 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:08:48.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcacc5dd640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcac413ef60 0x7fcac4118fc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcacc5dd640 10 monclient(hunting): picked mon.noname-d con 0x7fcac413ef60 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:08:48.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcacc5dd640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcac4184a40 0x7fcac408a680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcacc5dd640 10 monclient(hunting): picked mon.noname-e con 0x7fcac4184a40 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:08:48.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcacc5dd640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcacc5dd640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fcac408e6a0 con 0x7fcac405d550 2026-02-12T18:08:48.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcacc5dd640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcacc5dd640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fcac412c020 con 0x7fcac413ef60 2026-02-12T18:08:48.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcacc5dd640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcacc5dd640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fcac413db40 con 0x7fcac4184a40 2026-02-12T18:08:48.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcacc5dd640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:48.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcacc5dd640 10 monclient(hunting): authenticate will time out at 767.486153s 2026-02-12T18:08:48.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcacab53640 1 -- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcac4184a40 msgr2=0x7fcac408a680 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.48:3304/0 2026-02-12T18:08:48.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcacab53640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcac4184a40 0x7fcac408a680 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:08:48.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcac9b51640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcac413ef60 0x7fcac4118fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcac9b51640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcac413ef60 0x7fcac4118fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:38828/0 (socket says 10.20.193.48:38828) 2026-02-12T18:08:48.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcac9b51640 1 -- 10.20.193.48:0/362509238 learned_addr learned my addr 10.20.193.48:0/362509238 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:48.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcac9b51640 10 monclient(hunting): get_auth_request con 0x7fcac413ef60 auth_method 0 2026-02-12T18:08:48.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcac9b51640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcac9b51640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcac9b51640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcac9b51640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcac9b51640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcaca352640 1 --2- 10.20.193.48:0/362509238 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fcac405d550 0x7fcac4118a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcac9b51640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcaca352640 10 monclient(hunting): get_auth_request con 0x7fcac405d550 auth_method 0 2026-02-12T18:08:48.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcaca352640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcaca352640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcaca352640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcaca352640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcaca352640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcaca352640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcac9b51640 10 monclient(hunting): handle_auth_done global_id 5064 payload 824 2026-02-12T18:08:48.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcac9b51640 1 -- 10.20.193.48:0/362509238 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcac4184a40 msgr2=0x7fcac408a680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:08:48.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcac9b51640 1 --2- 10.20.193.48:0/362509238 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fcac4184a40 0x7fcac408a680 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcac9b51640 1 -- 10.20.193.48:0/362509238 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fcac405d550 msgr2=0x7fcac4118a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcac9b51640 1 --2- 10.20.193.48:0/362509238 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fcac405d550 0x7fcac4118a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcac9b51640 10 monclient: _finish_hunting 0 2026-02-12T18:08:48.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcac9b51640 1 monclient: found mon.noname-d 2026-02-12T18:08:48.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcac9b51640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:48.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcac9b51640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:08:48.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.760+0000 7fcac9b51640 1 -- 10.20.193.48:0/362509238 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac000a500 con 0x7fcac413ef60 2026-02-12T18:08:48.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.762+0000 7fcac9b51640 1 -- 10.20.193.48:0/362509238 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcac413ef60 msgr2=0x7fcac4118fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:48.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.762+0000 7fcac9b51640 1 --2- 10.20.193.48:0/362509238 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcac413ef60 0x7fcac4118fc0 secure :-1 s=READY pgs=143 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcab8007fd0 tx=0x7fcab800c970 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.762+0000 7fcaaaffd640 1 -- 10.20.193.48:0/362509238 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcab8005db0 con 0x7fcac413ef60 2026-02-12T18:08:48.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.762+0000 7fcaaaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.762+0000 7fcaaaffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:08:48.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.762+0000 7fcaaaffd640 10 monclient: dump: 2026-02-12T18:08:48.774 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.774 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.774 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.774 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.774 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.775 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.775 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.775 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.775 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.775 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.775 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.775 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.775 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.775 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.775 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.775 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.762+0000 7fcaaaffd640 10 monclient: _finish_auth 0 2026-02-12T18:08:48.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.762+0000 7fcaaaffd640 10 monclient: _check_auth_tickets 2026-02-12T18:08:48.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.762+0000 7fcaaaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:48.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.762+0000 7fcaaaffd640 1 -- 10.20.193.48:0/362509238 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcab8007530 con 0x7fcac413ef60 2026-02-12T18:08:48.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.762+0000 7fcaaaffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:48.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.762+0000 7fcaaaffd640 1 -- 10.20.193.48:0/362509238 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcab80076a0 con 0x7fcac413ef60 2026-02-12T18:08:48.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.762+0000 7fcaaaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.762+0000 7fcaaaffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:08:48.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.762+0000 7fcac8b4f640 4 set_mon_vals no callback set 2026-02-12T18:08:48.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.762+0000 7fcaaaffd640 10 monclient: dump: 2026-02-12T18:08:48.776 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.776 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.776 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.776 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.776 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.776 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.776 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.776 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.776 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.776 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.776 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.776 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.776 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.777 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.777 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.777 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.762+0000 7fcacc5dd640 5 monclient: authenticate success, global_id 5064 2026-02-12T18:08:48.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.762+0000 7fcacc5dd640 10 monclient: _renew_subs 2026-02-12T18:08:48.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.762+0000 7fcacc5dd640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:08:48.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.762+0000 7fcacc5dd640 1 -- 10.20.193.48:0/362509238 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcac408bf90 con 0x7fcac413ef60 2026-02-12T18:08:48.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.762+0000 7fcacc5dd640 10 monclient: _renew_subs 2026-02-12T18:08:48.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.762+0000 7fcacc5dd640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:08:48.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.762+0000 7fcacc5dd640 1 -- 10.20.193.48:0/362509238 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fcac412acd0 con 0x7fcac413ef60 2026-02-12T18:08:48.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.763+0000 7fcacc5dd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:48.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.763+0000 7fcacc5dd640 1 --2- 10.20.193.48:0/362509238 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcac4091010 0x7fcac408abc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.763+0000 7fcacc5dd640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.763+0000 7fcacc5dd640 1 -- 10.20.193.48:0/362509238 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fcac40631f0 con 0x7fcac4091010 2026-02-12T18:08:48.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.763+0000 7fcaca352640 1 --2- 10.20.193.48:0/362509238 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcac4091010 0x7fcac408abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.763+0000 7fcaca352640 10 monclient: get_auth_request con 0x7fcac4091010 auth_method 0 2026-02-12T18:08:48.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.763+0000 7fcaca352640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.763+0000 7fcaca352640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.763+0000 7fcaca352640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.763+0000 7fcaca352640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.763+0000 7fcaca352640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.763+0000 7fcaca352640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.763+0000 7fcaaaffd640 1 -- 10.20.193.48:0/362509238 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fcab8007070 con 0x7fcac413ef60 2026-02-12T18:08:48.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.763+0000 7fcaca352640 10 monclient(hunting): handle_auth_done global_id 5073 payload 824 2026-02-12T18:08:48.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.763+0000 7fcaca352640 1 -- 10.20.193.48:0/362509238 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcac405e310 con 0x7fcac4091010 2026-02-12T18:08:48.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.763+0000 7fcaaaffd640 1 --2- 10.20.193.48:0/362509238 >> v2:10.20.193.111:6812/977811348 conn(0x7fca9403f7b0 0x7fca9405fc60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.763+0000 7fcaaaffd640 1 -- 10.20.193.48:0/362509238 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(118..118 src has 1..118) ==== 3503+0+0 (secure 0 0 0) 0x7fcab8051ec0 con 0x7fcac413ef60 2026-02-12T18:08:48.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.764+0000 7fcacab53640 1 --2- 10.20.193.48:0/362509238 >> v2:10.20.193.111:6812/977811348 conn(0x7fca9403f7b0 0x7fca9405fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.764+0000 7fcacab53640 10 monclient: get_auth_request con 0x7fca9403f7b0 auth_method 0 2026-02-12T18:08:48.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.765+0000 7fcaca352640 1 -- 10.20.193.48:0/362509238 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcac4091010 msgr2=0x7fcac408abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:48.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.765+0000 7fcaca352640 1 --2- 10.20.193.48:0/362509238 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcac4091010 0x7fcac408abc0 secure :-1 s=READY pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcab4003770 tx=0x7fcab400fc10 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.766+0000 7fcaaaffd640 1 -- 10.20.193.48:0/362509238 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcab400dbc0 con 0x7fcac4091010 2026-02-12T18:08:48.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.766+0000 7fcaaaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.766+0000 7fcaaaffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:08:48.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.766+0000 7fcaaaffd640 10 monclient: dump: 2026-02-12T18:08:48.781 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.781 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.781 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.781 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.781 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.781 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.781 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.781 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.782 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.782 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.782 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.782 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.782 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.782 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.782 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.782 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.766+0000 7fcaaaffd640 1 -- 10.20.193.48:0/362509238 <== mon.6 v2:10.20.193.48:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fcab400dd20 con 0x7fcac4091010 2026-02-12T18:08:48.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.766+0000 7fcaaaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:48.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.766+0000 7fcaaaffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:48.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.766+0000 7fcaaaffd640 1 -- 10.20.193.48:0/362509238 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcac4091010 msgr2=0x7fcac408abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.766+0000 7fcaaaffd640 1 --2- 10.20.193.48:0/362509238 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcac4091010 0x7fcac408abc0 secure :-1 s=READY pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcab4003770 tx=0x7fcab400fc10 comp rx=0 tx=0).stop 2026-02-12T18:08:48.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.766+0000 7fcaaaffd640 1 -- 10.20.193.48:0/362509238 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcac4091010 msgr2=0x7fcac408abc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:48.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.766+0000 7fcaaaffd640 1 --2- 10.20.193.48:0/362509238 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcac4091010 0x7fcac408abc0 secure :-1 s=CLOSED pgs=144 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcab4003770 tx=0x7fcab400fc10 comp rx=0 tx=0).stop 2026-02-12T18:08:48.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.766+0000 7fcacab53640 1 --2- 10.20.193.48:0/362509238 >> v2:10.20.193.111:6812/977811348 conn(0x7fca9403f7b0 0x7fca9405fc60 secure :-1 s=READY pgs=200 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcac0004760 tx=0x7fcac0034000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.769+0000 7fcacc5dd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:08:48.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.769+0000 7fcacc5dd640 1 --2- 10.20.193.48:0/362509238 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcac408b100 0x7fcac408b500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.769+0000 7fcacc5dd640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.769+0000 7fcacc5dd640 1 -- 10.20.193.48:0/362509238 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fcac4050410 con 0x7fcac408b100 2026-02-12T18:08:48.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.769+0000 7fcaca352640 1 --2- 10.20.193.48:0/362509238 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcac408b100 0x7fcac408b500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.769+0000 7fcaca352640 10 monclient: get_auth_request con 0x7fcac408b100 auth_method 0 2026-02-12T18:08:48.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.769+0000 7fcaca352640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.769+0000 7fcaca352640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.769+0000 7fcaca352640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.769+0000 7fcaca352640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.769+0000 7fcaca352640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.769+0000 7fcaca352640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.769+0000 7fcaca352640 10 monclient(hunting): handle_auth_done global_id 5082 payload 824 2026-02-12T18:08:48.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.769+0000 7fcaca352640 1 -- 10.20.193.48:0/362509238 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcac4057e00 con 0x7fcac408b100 2026-02-12T18:08:48.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.771+0000 7fcaca352640 1 -- 10.20.193.48:0/362509238 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcac408b100 msgr2=0x7fcac408b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:48.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.771+0000 7fcaca352640 1 --2- 10.20.193.48:0/362509238 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcac408b100 0x7fcac408b500 secure :-1 s=READY pgs=145 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcab4016000 tx=0x7fcab4003810 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.772+0000 7fcaaaffd640 1 -- 10.20.193.48:0/362509238 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fcab4014d50 con 0x7fcac408b100 2026-02-12T18:08:48.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.772+0000 7fcaaaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.772+0000 7fcaaaffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:08:48.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.772+0000 7fcaaaffd640 10 monclient: dump: 2026-02-12T18:08:48.784 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.784 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.784 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.784 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.784 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.784 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.784 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.784 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.784 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.784 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.784 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.784 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.784 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.784 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.784 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.785 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.772+0000 7fcaaaffd640 1 -- 10.20.193.48:0/362509238 <== mon.6 v2:10.20.193.48:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9982 (secure 0 0 0) 0x7fcab4014890 con 0x7fcac408b100 2026-02-12T18:08:48.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.772+0000 7fcaaaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:08:48.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.772+0000 7fcaaaffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:48.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.772+0000 7fcaaaffd640 1 -- 10.20.193.48:0/362509238 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcac408b100 msgr2=0x7fcac408b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.772+0000 7fcaaaffd640 1 --2- 10.20.193.48:0/362509238 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcac408b100 0x7fcac408b500 secure :-1 s=READY pgs=145 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcab4016000 tx=0x7fcab4003810 comp rx=0 tx=0).stop 2026-02-12T18:08:48.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.772+0000 7fcaaaffd640 1 -- 10.20.193.48:0/362509238 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcac408b100 msgr2=0x7fcac408b500 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:48.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.772+0000 7fcaaaffd640 1 --2- 10.20.193.48:0/362509238 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcac408b100 0x7fcac408b500 secure :-1 s=CLOSED pgs=145 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcab4016000 tx=0x7fcab4003810 comp rx=0 tx=0).stop 2026-02-12T18:08:48.785 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:08:48.785 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:48.785 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:48.786 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:08:48.786 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 38, 2026-02-12T18:08:48.786 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 183598, 2026-02-12T18:08:48.786 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:08:48.786 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:08:48.786 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:08:48.786 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:08:48.786 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:08:48.786 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:08:48.786 INFO:teuthology.orchestra.run.trial048.stdout: 7 2026-02-12T18:08:48.786 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:48.786 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:08:48.786 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:48.786 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:08:48.786 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:08:48.786 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:48.787 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:48.787 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:48.787 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:48.787 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:48.787 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:48.787 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:48.787 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:48.787 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:48.787 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:48.787 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:48.787 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:48.787 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:48.787 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:48.787 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:08:48.787 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:08:48.787 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:48.787 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:48.788 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:48.788 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:48.788 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:48.788 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:48.788 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:48.788 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:48.788 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:48.788 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:48.788 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:48.788 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:48.788 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:48.788 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.788 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.788 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:08:48.788 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:08:48.788 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:08:48.788 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:08:48.788 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:08:48.789 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:08:48.789 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:48.789 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:48.789 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:08:48.789 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:08:48.789 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:08:48.789 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:08:48.789 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:08:48.789 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:08:48.789 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:08:48.789 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:48.789 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:08:48.789 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:48.789 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:48.789 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:48.789 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:48.789 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:48.789 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:48.790 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:48.790 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:48.790 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:48.790 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:48.790 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:48.790 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:48.790 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:48.790 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:48.790 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:08:48.790 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.790 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:08:48.790 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.790 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:48.790 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:48.790 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.790 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.790 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.790 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.790 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:08:48.791 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.791 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.791 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.791 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.791 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:08:48.791 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.791 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.791 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.791 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.791 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:08:48.791 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:08:48.791 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.791 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.791 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:08:48.791 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.791 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.791 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.791 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:48.791 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:48.792 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.792 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.792 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.792 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.792 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:08:48.792 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.792 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.792 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.792 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.792 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:08:48.792 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.792 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.792 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.792 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.792 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:08:48.792 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:08:48.792 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.792 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.792 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:08:48.792 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.793 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.793 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.793 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:48.793 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:48.793 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.793 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.793 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.793 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.793 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:08:48.793 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.793 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.793 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.793 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.793 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:08:48.793 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.793 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.793 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.793 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.793 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:08:48.793 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:08:48.793 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.793 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.794 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:08:48.794 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.794 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.794 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.794 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:08:48.794 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:08:48.794 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.794 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.794 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.794 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.794 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:08:48.794 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.794 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.794 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.794 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.794 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:08:48.794 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.794 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.794 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.794 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.794 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:08:48.794 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:08:48.795 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.795 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.795 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:08:48.795 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.795 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.795 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.795 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:08:48.795 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:08:48.795 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.795 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.795 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.795 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.795 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:08:48.795 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.795 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.795 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.795 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.795 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:08:48.795 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.795 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.795 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.795 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.796 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:08:48.796 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:08:48.796 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.796 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.796 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:48.796 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.796 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.796 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.796 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:48.796 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:48.796 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.796 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.796 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.796 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.796 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:08:48.796 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.796 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.796 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.796 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.796 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:08:48.796 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.796 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.796 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.797 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.797 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:08:48.797 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:08:48.797 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.797 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.797 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:08:48.797 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.797 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.797 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.797 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:48.797 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:48.797 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.797 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.797 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.797 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.797 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:08:48.797 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.797 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.797 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.797 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.797 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:08:48.797 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.797 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.798 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.798 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.798 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:08:48.798 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:08:48.798 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.798 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.798 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:48.798 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.798 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.798 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.798 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:48.798 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:48.798 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.798 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.798 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.798 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.798 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:08:48.798 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.798 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.798 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.798 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.798 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:08:48.798 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.799 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.799 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.799 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.799 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:08:48.799 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:08:48.799 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.799 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.799 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:08:48.799 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.799 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.799 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.799 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:08:48.799 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:08:48.799 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.799 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.799 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.799 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.799 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:08:48.799 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.799 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.799 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.799 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.799 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:08:48.799 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.800 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.800 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.800 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.800 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:08:48.800 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:08:48.800 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.800 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.800 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:08:48.800 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.800 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.800 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.800 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.800 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:08:48.800 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:08:48.800 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.800 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:48.800 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:48.800 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:48.800 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.800 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:48.800 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:08:48.800 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.800 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:48.800 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:48.800 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:08:48.801 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.801 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.801 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.801 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:08:48.801 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:08:48.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.772+0000 7fcacc5dd640 1 -- 10.20.193.48:0/362509238 >> v2:10.20.193.111:6812/977811348 conn(0x7fca9403f7b0 msgr2=0x7fca9405fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.772+0000 7fcacc5dd640 1 --2- 10.20.193.48:0/362509238 >> v2:10.20.193.111:6812/977811348 conn(0x7fca9403f7b0 0x7fca9405fc60 secure :-1 s=READY pgs=200 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcac0004760 tx=0x7fcac0034000 comp rx=0 tx=0).stop 2026-02-12T18:08:48.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.772+0000 7fcacc5dd640 10 monclient: shutdown 2026-02-12T18:08:48.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.772+0000 7fcacc5dd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:48.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.772+0000 7fcacc5dd640 1 -- 10.20.193.48:0/362509238 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcac413ef60 msgr2=0x7fcac4118fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.772+0000 7fcacc5dd640 1 --2- 10.20.193.48:0/362509238 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fcac413ef60 0x7fcac4118fc0 secure :-1 s=READY pgs=143 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fcab8007fd0 tx=0x7fcab800c970 comp rx=0 tx=0).stop 2026-02-12T18:08:48.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.772+0000 7fcacab53640 1 -- 10.20.193.48:0/362509238 reap_dead start 2026-02-12T18:08:48.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.772+0000 7fcacab53640 1 -- 10.20.193.48:0/362509238 reap_dead start 2026-02-12T18:08:48.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.772+0000 7fcacc5dd640 1 -- 10.20.193.48:0/362509238 shutdown_connections 2026-02-12T18:08:48.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.772+0000 7fcacc5dd640 1 -- 10.20.193.48:0/362509238 >> 10.20.193.48:0/362509238 conn(0x7fcac40546a0 msgr2=0x7fcac413d190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:48.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.772+0000 7fcacc5dd640 1 -- 10.20.193.48:0/362509238 shutdown_connections 2026-02-12T18:08:48.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.772+0000 7fcacc5dd640 1 -- 10.20.193.48:0/362509238 wait complete. 2026-02-12T18:08:48.802 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2026-02-12T18:08:48.802 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon f 2026-02-12T18:08:48.802 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2026-02-12T18:08:48.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.867+0000 7fa855ccc640 10 monclient: get_monmap_and_config 2026-02-12T18:08:48.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.867+0000 7fa855ccc640 10 monclient: build_initial_monmap 2026-02-12T18:08:48.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.867+0000 7fa855ccc640 10 monclient: monmap: 2026-02-12T18:08:48.868 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:48.869 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.869 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:48.868141+0000 2026-02-12T18:08:48.869 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:48.868141+0000 2026-02-12T18:08:48.869 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:48.869 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.869 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:48.869 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:48.869 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:48.869 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:48.869 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:48.869 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:48.869 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:48.869 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:48.869 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:48.869 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:48.869 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:48.869 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.867+0000 7fa855ccc640 1 Processor -- start 2026-02-12T18:08:48.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.867+0000 7fa855ccc640 1 -- start start 2026-02-12T18:08:48.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.867+0000 7fa855ccc640 10 monclient: init 2026-02-12T18:08:48.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.867+0000 7fa855ccc640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:48.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa855ccc640 10 monclient: _add_conns ranks=[9,7,5,3,6,1,8,10,2,4,0] 2026-02-12T18:08:48.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa855ccc640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fa85008f1a0 0x7fa85008fba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa855ccc640 10 monclient(hunting): picked mon.noname-a con 0x7fa85008f1a0 addr v2:10.20.193.48:3300/0 2026-02-12T18:08:48.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa855ccc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa8500900e0 0x7fa8500904b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa855ccc640 10 monclient(hunting): picked mon.noname-i con 0x7fa8500900e0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:48.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa855ccc640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa850182990 0x7fa8501a2d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa855ccc640 10 monclient(hunting): picked mon.noname-h con 0x7fa850182990 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:08:48.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa855ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa855ccc640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7fa850091870 con 0x7fa85008f1a0 2026-02-12T18:08:48.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa855ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa855ccc640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fa85008b460 con 0x7fa850182990 2026-02-12T18:08:48.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa855ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa855ccc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fa8500909f0 con 0x7fa8500900e0 2026-02-12T18:08:48.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa855ccc640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:48.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa855ccc640 10 monclient(hunting): authenticate will time out at 767.594066s 2026-02-12T18:08:48.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84f7fe640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fa85008f1a0 0x7fa85008fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84f7fe640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fa85008f1a0 0x7fa85008fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:60736/0 (socket says 10.20.193.48:60736) 2026-02-12T18:08:48.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84f7fe640 1 -- 10.20.193.48:0/2894580838 learned_addr learned my addr 10.20.193.48:0/2894580838 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:48.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84f7fe640 10 monclient(hunting): get_auth_request con 0x7fa85008f1a0 auth_method 0 2026-02-12T18:08:48.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84ffff640 1 --2- 10.20.193.48:0/2894580838 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa850182990 0x7fa8501a2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84effd640 1 --2- 10.20.193.48:0/2894580838 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa8500900e0 0x7fa8500904b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84effd640 10 monclient(hunting): get_auth_request con 0x7fa8500900e0 auth_method 0 2026-02-12T18:08:48.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84ffff640 10 monclient(hunting): get_auth_request con 0x7fa850182990 auth_method 0 2026-02-12T18:08:48.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84f7fe640 10 monclient(hunting): handle_auth_done global_id 5274 payload 274 2026-02-12T18:08:48.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84f7fe640 1 -- 10.20.193.48:0/2894580838 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa8500900e0 msgr2=0x7fa8500904b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:48.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84f7fe640 1 --2- 10.20.193.48:0/2894580838 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa8500900e0 0x7fa8500904b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84f7fe640 1 -- 10.20.193.48:0/2894580838 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa850182990 msgr2=0x7fa8501a2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:48.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84f7fe640 1 --2- 10.20.193.48:0/2894580838 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa850182990 0x7fa8501a2d70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84f7fe640 10 monclient: _finish_hunting 0 2026-02-12T18:08:48.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84f7fe640 1 monclient: found mon.noname-a 2026-02-12T18:08:48.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:48.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84f7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:08:48.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.868+0000 7fa84f7fe640 1 -- 10.20.193.48:0/2894580838 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa85004dc20 con 0x7fa85008f1a0 2026-02-12T18:08:48.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.870+0000 7fa84f7fe640 1 -- 10.20.193.48:0/2894580838 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa85008f1a0 msgr2=0x7fa85008fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:48.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.870+0000 7fa84f7fe640 1 --2- 10.20.193.48:0/2894580838 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa85008f1a0 0x7fa85008fba0 secure :-1 s=READY pgs=254 gs=1 cs=0 l=1 c_cookie=4655473185444236626 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa83c009060 tx=0x7fa83c02edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=409b903247c28d52 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa84e7fc640 1 -- 10.20.193.48:0/2894580838 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa83c035340 con 0x7fa85008f1a0 2026-02-12T18:08:48.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa84e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa84e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:08:48.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa84e7fc640 10 monclient: dump: 2026-02-12T18:08:48.879 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.879 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.879 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.879 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.879 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.879 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.879 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.879 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.879 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.879 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.879 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.879 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.879 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.879 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.879 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.879 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa84e7fc640 10 monclient: _finish_auth 0 2026-02-12T18:08:48.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa84e7fc640 10 monclient: _check_auth_tickets 2026-02-12T18:08:48.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa84e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:48.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa855ccc640 5 monclient: authenticate success, global_id 5274 2026-02-12T18:08:48.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa84e7fc640 1 -- 10.20.193.48:0/2894580838 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa83c0354c0 con 0x7fa85008f1a0 2026-02-12T18:08:48.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa855ccc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:08:48.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa84e7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:48.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa855ccc640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:48.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa855ccc640 4 set_mon_vals no callback set 2026-02-12T18:08:48.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa84e7fc640 1 -- 10.20.193.48:0/2894580838 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa83c035af0 con 0x7fa85008f1a0 2026-02-12T18:08:48.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa84e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa84e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:08:48.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa84e7fc640 10 monclient: dump: 2026-02-12T18:08:48.880 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.880 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.880 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.880 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.880 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.881 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.881 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.881 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.881 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.881 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.881 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.881 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.881 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.881 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.881 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.881 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa855ccc640 10 monclient: shutdown 2026-02-12T18:08:48.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa855ccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:48.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa855ccc640 1 -- 10.20.193.48:0/2894580838 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa85008f1a0 msgr2=0x7fa85008fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa855ccc640 1 --2- 10.20.193.48:0/2894580838 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa85008f1a0 0x7fa85008fba0 secure :-1 s=READY pgs=254 gs=1 cs=0 l=1 c_cookie=4655473185444236626 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa83c009060 tx=0x7fa83c02edf0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa855ccc640 1 -- 10.20.193.48:0/2894580838 shutdown_connections 2026-02-12T18:08:48.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa855ccc640 1 --2- 10.20.193.48:0/2894580838 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa850182990 0x7fa8501a2d70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa855ccc640 1 --2- 10.20.193.48:0/2894580838 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa8500900e0 0x7fa8500904b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa855ccc640 1 --2- 10.20.193.48:0/2894580838 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa85008f1a0 0x7fa85008fba0 unknown :-1 s=CLOSED pgs=254 gs=1 cs=0 l=1 c_cookie=4655473185444236626 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa855ccc640 1 -- 10.20.193.48:0/2894580838 >> 10.20.193.48:0/2894580838 conn(0x7fa850054f40 msgr2=0x7fa8500951a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:48.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa855ccc640 1 -- 10.20.193.48:0/2894580838 shutdown_connections 2026-02-12T18:08:48.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa855ccc640 1 -- 10.20.193.48:0/2894580838 wait complete. 2026-02-12T18:08:48.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa855ccc640 10 monclient: build_initial_monmap 2026-02-12T18:08:48.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.871+0000 7fa855ccc640 10 monclient: monmap: 2026-02-12T18:08:48.882 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:48.882 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:48.882 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:48.882 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:48.882 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:48.882 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.882 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:48.882 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:48.882 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:48.882 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:48.882 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:48.882 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:48.883 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:48.883 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:48.883 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:48.883 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa855ccc640 1 Processor -- start 2026-02-12T18:08:48.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa855ccc640 1 -- start start 2026-02-12T18:08:48.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa855ccc640 10 monclient: init 2026-02-12T18:08:48.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa855ccc640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:48.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa855ccc640 10 monclient: _add_conns ranks=[4,0,1,7,3,5,2,8,6] 2026-02-12T18:08:48.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa855ccc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa85008f1a0 0x7fa850122070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa855ccc640 10 monclient(hunting): picked mon.noname-c con 0x7fa85008f1a0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:08:48.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa855ccc640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa8500900e0 0x7fa8501225b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa855ccc640 10 monclient(hunting): picked mon.noname-a con 0x7fa8500900e0 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:08:48.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa855ccc640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fa850182990 0x7fa850122af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa855ccc640 10 monclient(hunting): picked mon.noname-f con 0x7fa850182990 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:08:48.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa855ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa855ccc640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fa8500904b0 con 0x7fa8500900e0 2026-02-12T18:08:48.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa855ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa855ccc640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa850123600 con 0x7fa850182990 2026-02-12T18:08:48.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa855ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa855ccc640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fa85010f860 con 0x7fa85008f1a0 2026-02-12T18:08:48.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa855ccc640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:48.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa855ccc640 10 monclient(hunting): authenticate will time out at 767.598347s 2026-02-12T18:08:48.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84f7fe640 1 -- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa85008f1a0 msgr2=0x7fa850122070 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.48:3302/0 2026-02-12T18:08:48.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84f7fe640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa85008f1a0 0x7fa850122070 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:08:48.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84effd640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa8500900e0 0x7fa8501225b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84effd640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa8500900e0 0x7fa8501225b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:60752/0 (socket says 10.20.193.48:60752) 2026-02-12T18:08:48.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84effd640 1 -- 10.20.193.48:0/821368356 learned_addr learned my addr 10.20.193.48:0/821368356 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:48.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84effd640 10 monclient(hunting): get_auth_request con 0x7fa8500900e0 auth_method 0 2026-02-12T18:08:48.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84ffff640 1 --2- 10.20.193.48:0/821368356 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fa850182990 0x7fa850122af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84ffff640 10 monclient(hunting): get_auth_request con 0x7fa850182990 auth_method 0 2026-02-12T18:08:48.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84effd640 10 monclient(hunting): handle_auth_done global_id 5283 payload 824 2026-02-12T18:08:48.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84effd640 1 -- 10.20.193.48:0/821368356 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa85008f1a0 msgr2=0x7fa850122070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:08:48.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84effd640 1 --2- 10.20.193.48:0/821368356 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa85008f1a0 0x7fa850122070 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84effd640 1 -- 10.20.193.48:0/821368356 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fa850182990 msgr2=0x7fa850122af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84effd640 1 --2- 10.20.193.48:0/821368356 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fa850182990 0x7fa850122af0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84effd640 10 monclient: _finish_hunting 0 2026-02-12T18:08:48.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84effd640 1 monclient: found mon.noname-a 2026-02-12T18:08:48.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:48.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84effd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:08:48.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.872+0000 7fa84effd640 1 -- 10.20.193.48:0/821368356 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83c0094f0 con 0x7fa8500900e0 2026-02-12T18:08:48.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.874+0000 7fa84effd640 1 -- 10.20.193.48:0/821368356 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa8500900e0 msgr2=0x7fa8501225b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:48.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.874+0000 7fa84effd640 1 --2- 10.20.193.48:0/821368356 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa8500900e0 0x7fa8501225b0 secure :-1 s=READY pgs=255 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa84000e8b0 tx=0x7fa84000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.874+0000 7fa82bfff640 1 -- 10.20.193.48:0/821368356 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa84000cb50 con 0x7fa8500900e0 2026-02-12T18:08:48.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.874+0000 7fa82bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.874+0000 7fa82bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:08:48.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.874+0000 7fa82bfff640 10 monclient: dump: 2026-02-12T18:08:48.886 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.886 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.886 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.886 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.886 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.886 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.886 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.886 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.886 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.886 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.886 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.886 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.886 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.886 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.886 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.886 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.874+0000 7fa82bfff640 10 monclient: _finish_auth 0 2026-02-12T18:08:48.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.874+0000 7fa82bfff640 10 monclient: _check_auth_tickets 2026-02-12T18:08:48.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.874+0000 7fa82bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:48.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.874+0000 7fa82bfff640 1 -- 10.20.193.48:0/821368356 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa84000ccd0 con 0x7fa8500900e0 2026-02-12T18:08:48.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.874+0000 7fa82bfff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:48.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.874+0000 7fa82bfff640 1 -- 10.20.193.48:0/821368356 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa84000ce40 con 0x7fa8500900e0 2026-02-12T18:08:48.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.874+0000 7fa82bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.875+0000 7fa82bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:08:48.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.875+0000 7fa82bfff640 10 monclient: dump: 2026-02-12T18:08:48.887 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.887 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.887 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.887 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.887 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.887 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.887 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.887 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.887 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.887 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.887 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.888 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.888 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.888 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.888 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.888 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.875+0000 7fa84dffb640 4 set_mon_vals no callback set 2026-02-12T18:08:48.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.875+0000 7fa855ccc640 5 monclient: authenticate success, global_id 5283 2026-02-12T18:08:48.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.875+0000 7fa855ccc640 10 monclient: _renew_subs 2026-02-12T18:08:48.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.875+0000 7fa855ccc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:08:48.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.875+0000 7fa855ccc640 1 -- 10.20.193.48:0/821368356 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa85010ea10 con 0x7fa8500900e0 2026-02-12T18:08:48.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.875+0000 7fa855ccc640 10 monclient: _renew_subs 2026-02-12T18:08:48.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.875+0000 7fa855ccc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:08:48.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.875+0000 7fa855ccc640 1 -- 10.20.193.48:0/821368356 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa850110100 con 0x7fa8500900e0 2026-02-12T18:08:48.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.875+0000 7fa855ccc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:48.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.875+0000 7fa855ccc640 1 --2- 10.20.193.48:0/821368356 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fa85005a3c0 0x7fa85005a790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.875+0000 7fa855ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.875+0000 7fa855ccc640 1 -- 10.20.193.48:0/821368356 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa85005f140 con 0x7fa85005a3c0 2026-02-12T18:08:48.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.875+0000 7fa84f7fe640 1 --2- 10.20.193.48:0/821368356 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fa85005a3c0 0x7fa85005a790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.875+0000 7fa84f7fe640 10 monclient: get_auth_request con 0x7fa85005a3c0 auth_method 0 2026-02-12T18:08:48.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.875+0000 7fa84f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.875+0000 7fa84f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.875+0000 7fa84f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.875+0000 7fa82bfff640 1 -- 10.20.193.48:0/821368356 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fa840011070 con 0x7fa8500900e0 2026-02-12T18:08:48.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.875+0000 7fa84f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.875+0000 7fa84f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.875+0000 7fa84f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.875+0000 7fa82bfff640 1 --2- 10.20.193.48:0/821368356 >> v2:10.20.193.111:6812/977811348 conn(0x7fa82003f7c0 0x7fa82005fc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.875+0000 7fa82bfff640 1 -- 10.20.193.48:0/821368356 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 3503+0+0 (secure 0 0 0) 0x7fa8400529c0 con 0x7fa8500900e0 2026-02-12T18:08:48.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.875+0000 7fa84f7fe640 10 monclient(hunting): handle_auth_done global_id 5203 payload 824 2026-02-12T18:08:48.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.876+0000 7fa84f7fe640 1 -- 10.20.193.48:0/821368356 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa85008a0e0 con 0x7fa85005a3c0 2026-02-12T18:08:48.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.876+0000 7fa84ffff640 1 --2- 10.20.193.48:0/821368356 >> v2:10.20.193.111:6812/977811348 conn(0x7fa82003f7c0 0x7fa82005fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.876+0000 7fa84ffff640 10 monclient: get_auth_request con 0x7fa82003f7c0 auth_method 0 2026-02-12T18:08:48.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.878+0000 7fa84f7fe640 1 -- 10.20.193.48:0/821368356 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fa85005a3c0 msgr2=0x7fa85005a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:48.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.878+0000 7fa84f7fe640 1 --2- 10.20.193.48:0/821368356 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fa85005a3c0 0x7fa85005a790 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa83c009060 tx=0x7fa83c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.878+0000 7fa82bfff640 1 -- 10.20.193.48:0/821368356 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa83c006c80 con 0x7fa85005a3c0 2026-02-12T18:08:48.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.878+0000 7fa82bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.878+0000 7fa82bfff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:08:48.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.878+0000 7fa82bfff640 10 monclient: dump: 2026-02-12T18:08:48.892 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.892 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.892 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.892 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.892 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.892 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.892 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.892 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.892 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.892 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.892 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.892 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.892 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.892 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.892 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.893 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.878+0000 7fa84ffff640 1 --2- 10.20.193.48:0/821368356 >> v2:10.20.193.111:6812/977811348 conn(0x7fa82003f7c0 0x7fa82005fc70 secure :-1 s=READY pgs=201 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8501270d0 tx=0x7fa844009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.878+0000 7fa82bfff640 1 -- 10.20.193.48:0/821368356 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fa83c035c80 con 0x7fa85005a3c0 2026-02-12T18:08:48.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.878+0000 7fa82bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:48.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.878+0000 7fa82bfff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:48.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.878+0000 7fa82bfff640 1 -- 10.20.193.48:0/821368356 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fa85005a3c0 msgr2=0x7fa85005a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.878+0000 7fa82bfff640 1 --2- 10.20.193.48:0/821368356 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fa85005a3c0 0x7fa85005a790 secure :-1 s=READY pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa83c009060 tx=0x7fa83c004770 comp rx=0 tx=0).stop 2026-02-12T18:08:48.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.878+0000 7fa82bfff640 1 -- 10.20.193.48:0/821368356 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fa85005a3c0 msgr2=0x7fa85005a790 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:48.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.878+0000 7fa82bfff640 1 --2- 10.20.193.48:0/821368356 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fa85005a3c0 0x7fa85005a790 secure :-1 s=CLOSED pgs=211 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa83c009060 tx=0x7fa83c004770 comp rx=0 tx=0).stop 2026-02-12T18:08:48.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.881+0000 7fa855ccc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:08:48.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.881+0000 7fa855ccc640 1 --2- 10.20.193.48:0/821368356 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fa85005acd0 0x7fa85010c440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.881+0000 7fa855ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.881+0000 7fa855ccc640 1 -- 10.20.193.48:0/821368356 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fa85005fd90 con 0x7fa85005acd0 2026-02-12T18:08:48.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.882+0000 7fa84f7fe640 1 --2- 10.20.193.48:0/821368356 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fa85005acd0 0x7fa85010c440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.882+0000 7fa84f7fe640 10 monclient: get_auth_request con 0x7fa85005acd0 auth_method 0 2026-02-12T18:08:48.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.882+0000 7fa84f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.882+0000 7fa84f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.882+0000 7fa84f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.882+0000 7fa84f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.882+0000 7fa84f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.882+0000 7fa84f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.882+0000 7fa84f7fe640 10 monclient(hunting): handle_auth_done global_id 5212 payload 824 2026-02-12T18:08:48.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.882+0000 7fa84f7fe640 1 -- 10.20.193.48:0/821368356 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa85008f570 con 0x7fa85005acd0 2026-02-12T18:08:48.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.885+0000 7fa84f7fe640 1 -- 10.20.193.48:0/821368356 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fa85005acd0 msgr2=0x7fa85010c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:48.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.885+0000 7fa84f7fe640 1 --2- 10.20.193.48:0/821368356 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fa85005acd0 0x7fa85010c440 secure :-1 s=READY pgs=212 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa83c009820 tx=0x7fa83c0092c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.885+0000 7fa82bfff640 1 -- 10.20.193.48:0/821368356 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa83c04e070 con 0x7fa85005acd0 2026-02-12T18:08:48.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.885+0000 7fa82bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.885+0000 7fa82bfff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:08:48.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.885+0000 7fa82bfff640 10 monclient: dump: 2026-02-12T18:08:48.894 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.894 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.894 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.894 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.894 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.894 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.894 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.895 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.895 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.895 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.895 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.895 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.895 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.895 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.895 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.895 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.885+0000 7fa82bfff640 1 -- 10.20.193.48:0/821368356 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10149 (secure 0 0 0) 0x7fa83c003bd0 con 0x7fa85005acd0 2026-02-12T18:08:48.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.885+0000 7fa82bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:08:48.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.885+0000 7fa82bfff640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:48.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.885+0000 7fa82bfff640 1 -- 10.20.193.48:0/821368356 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fa85005acd0 msgr2=0x7fa85010c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.885+0000 7fa82bfff640 1 --2- 10.20.193.48:0/821368356 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fa85005acd0 0x7fa85010c440 secure :-1 s=READY pgs=212 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa83c009820 tx=0x7fa83c0092c0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.885+0000 7fa82bfff640 1 -- 10.20.193.48:0/821368356 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fa85005acd0 msgr2=0x7fa85010c440 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:48.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.885+0000 7fa82bfff640 1 --2- 10.20.193.48:0/821368356 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fa85005acd0 0x7fa85010c440 unknown :-1 s=CLOSED pgs=212 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.896 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:08:48.896 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:48.896 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:48.896 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:08:48.896 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 38, 2026-02-12T18:08:48.896 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 183682, 2026-02-12T18:08:48.896 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:08:48.896 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:08:48.896 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:08:48.896 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:08:48.896 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:08:48.896 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:08:48.896 INFO:teuthology.orchestra.run.trial048.stdout: 7 2026-02-12T18:08:48.896 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:48.897 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:08:48.897 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:48.897 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:08:48.897 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:08:48.897 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:48.897 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:48.897 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:48.897 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:48.897 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:48.897 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:48.897 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:48.897 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:48.897 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:48.897 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:48.897 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:48.897 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:48.897 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:48.897 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:48.897 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:08:48.898 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:08:48.898 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:48.898 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:48.898 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:48.898 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:48.898 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:48.898 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:48.898 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:48.898 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:48.898 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:48.898 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:48.898 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:48.898 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:48.898 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:48.898 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.898 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.898 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:08:48.898 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:08:48.899 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:08:48.899 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:08:48.899 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:08:48.899 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:08:48.899 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:48.899 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:48.899 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:08:48.899 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:08:48.899 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:08:48.899 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:08:48.899 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:08:48.899 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:08:48.899 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:08:48.899 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:48.899 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:08:48.899 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:48.899 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:48.899 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:48.900 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:48.900 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:48.900 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:48.900 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:48.900 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:48.900 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:48.900 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:48.900 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:48.900 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:48.900 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:48.900 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:48.900 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:08:48.900 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.900 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:08:48.900 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.900 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:48.900 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:48.900 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.900 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.900 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.900 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.900 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:08:48.901 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.901 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.901 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.901 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.901 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:08:48.901 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.901 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.901 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.901 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.901 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:08:48.901 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:08:48.901 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.901 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.901 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:08:48.901 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.901 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.901 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.901 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:48.901 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:48.901 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.901 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.902 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.902 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.902 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:08:48.902 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.902 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.902 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.902 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.902 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:08:48.902 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.902 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.902 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.902 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.902 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:08:48.902 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:08:48.902 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.902 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.902 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:08:48.902 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.902 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.902 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.902 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:48.902 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:48.903 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.903 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.903 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.903 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.903 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:08:48.903 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.903 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.903 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.903 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.903 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:08:48.903 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.903 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.903 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.903 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.903 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:08:48.903 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:08:48.903 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.903 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.903 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:08:48.903 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.903 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.903 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.903 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:08:48.903 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:08:48.904 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.904 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.904 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.904 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.904 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:08:48.904 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.904 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.904 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.904 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.904 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:08:48.904 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.904 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.904 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.904 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.904 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:08:48.904 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:08:48.904 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.904 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.904 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:08:48.904 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.904 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.904 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.904 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:08:48.905 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:08:48.905 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.905 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.905 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.905 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.905 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:08:48.905 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.905 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.905 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.905 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.905 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:08:48.905 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.905 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.905 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.905 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.905 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:08:48.905 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:08:48.905 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.905 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.905 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:48.905 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.905 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.905 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.905 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:48.905 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:48.906 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.906 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.906 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.906 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.906 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:08:48.906 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.906 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.906 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.906 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.906 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:08:48.906 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.906 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.906 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.906 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.906 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:08:48.906 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:08:48.906 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.906 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.906 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:08:48.906 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.906 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.906 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.906 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:48.906 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:48.906 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.907 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.907 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.907 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.907 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:08:48.907 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.907 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.907 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.907 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.907 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:08:48.907 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.907 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.907 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.907 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.907 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:08:48.907 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:08:48.907 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.907 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.907 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:48.907 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.907 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.907 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.907 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:48.907 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:48.907 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.907 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.908 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.908 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.908 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:08:48.908 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.908 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.908 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.908 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.908 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:08:48.908 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.908 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.908 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.908 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.908 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:08:48.908 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:08:48.908 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.908 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.908 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:08:48.908 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.908 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.908 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.908 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:08:48.908 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:08:48.908 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:48.908 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:48.909 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.909 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:48.909 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:08:48.909 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.909 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.909 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.909 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:48.909 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:08:48.909 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:48.909 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.909 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.909 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.909 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:08:48.909 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:08:48.909 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:48.909 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:48.909 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:08:48.909 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:48.909 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.909 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.909 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.909 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:08:48.909 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:08:48.909 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.909 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:48.909 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:48.910 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:48.910 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.910 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:48.910 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:08:48.910 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.910 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:48.910 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:48.910 INFO:teuthology.orchestra.run.trial048.stdout: "num": 4 2026-02-12T18:08:48.910 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.910 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:48.910 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:08:48.910 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:48.910 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:48.910 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:48.910 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:08:48.910 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:48.910 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:48.910 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:48.910 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:08:48.910 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:08:48.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.885+0000 7fa855ccc640 1 -- 10.20.193.48:0/821368356 >> v2:10.20.193.111:6812/977811348 conn(0x7fa82003f7c0 msgr2=0x7fa82005fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.885+0000 7fa855ccc640 1 --2- 10.20.193.48:0/821368356 >> v2:10.20.193.111:6812/977811348 conn(0x7fa82003f7c0 0x7fa82005fc70 secure :-1 s=READY pgs=201 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8501270d0 tx=0x7fa844009040 comp rx=0 tx=0).stop 2026-02-12T18:08:48.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.885+0000 7fa855ccc640 10 monclient: shutdown 2026-02-12T18:08:48.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.885+0000 7fa855ccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:48.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.885+0000 7fa855ccc640 1 -- 10.20.193.48:0/821368356 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa8500900e0 msgr2=0x7fa8501225b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.885+0000 7fa84ffff640 1 -- 10.20.193.48:0/821368356 reap_dead start 2026-02-12T18:08:48.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.885+0000 7fa855ccc640 1 --2- 10.20.193.48:0/821368356 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa8500900e0 0x7fa8501225b0 secure :-1 s=READY pgs=255 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa84000e8b0 tx=0x7fa84000ed80 comp rx=0 tx=0).stop 2026-02-12T18:08:48.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.885+0000 7fa855ccc640 1 -- 10.20.193.48:0/821368356 shutdown_connections 2026-02-12T18:08:48.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.885+0000 7fa855ccc640 1 --2- 10.20.193.48:0/821368356 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa8500900e0 0x7fa8501225b0 unknown :-1 s=CLOSED pgs=255 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.911 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.885+0000 7fa855ccc640 1 -- 10.20.193.48:0/821368356 >> 10.20.193.48:0/821368356 conn(0x7fa850054f40 msgr2=0x7fa85005d600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:48.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.885+0000 7fa855ccc640 1 -- 10.20.193.48:0/821368356 shutdown_connections 2026-02-12T18:08:48.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.885+0000 7fa855ccc640 1 -- 10.20.193.48:0/821368356 wait complete. 2026-02-12T18:08:48.912 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2026-02-12T18:08:48.912 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon h 2026-02-12T18:08:48.912 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2026-02-12T18:08:48.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.974+0000 7f6b2e636640 10 monclient: get_monmap_and_config 2026-02-12T18:08:48.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.974+0000 7f6b2e636640 10 monclient: build_initial_monmap 2026-02-12T18:08:48.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b2e636640 10 monclient: monmap: 2026-02-12T18:08:48.976 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:48.976 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.976 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:48.976053+0000 2026-02-12T18:08:48.976 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:48.976053+0000 2026-02-12T18:08:48.976 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:48.976 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.976 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:48.976 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:48.977 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:48.977 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:48.977 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:48.977 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:48.977 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:48.977 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:48.977 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:48.977 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:48.977 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:48.977 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.979 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b2e636640 1 Processor -- start 2026-02-12T18:08:48.979 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b2e636640 1 -- start start 2026-02-12T18:08:48.979 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b2e636640 10 monclient: init 2026-02-12T18:08:48.979 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b2e636640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:48.979 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b2e636640 10 monclient: _add_conns ranks=[9,2,10,6,1,8,0,3,7,4,5] 2026-02-12T18:08:48.979 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b2e636640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f6b2805c950 0x7f6b2805cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.979 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b2e636640 10 monclient(hunting): picked mon.noname-a con 0x7f6b2805c950 addr v2:10.20.193.48:3300/0 2026-02-12T18:08:48.979 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b2e636640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6b2805e490 0x7f6b2805d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.979 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b2e636640 10 monclient(hunting): picked mon.noname-b con 0x7f6b2805e490 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:08:48.979 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b2e636640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f6b2813db70 0x7f6b2813e010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.979 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b2e636640 10 monclient(hunting): picked mon.noname-f con 0x7f6b2813db70 addr v2:10.20.193.111:3300/0 2026-02-12T18:08:48.979 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b2e636640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.979 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b2e636640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f6b2805ddd0 con 0x7f6b2805c950 2026-02-12T18:08:48.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b2e636640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b2e636640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f6b2805d7a0 con 0x7f6b2813db70 2026-02-12T18:08:48.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b2e636640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b2e636640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f6b28092990 con 0x7f6b2805e490 2026-02-12T18:08:48.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b2e636640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:48.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b2e636640 10 monclient(hunting): authenticate will time out at 767.701760s 2026-02-12T18:08:48.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b27fff640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f6b2805c950 0x7f6b2805cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b277fe640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6b2805e490 0x7f6b2805d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b27fff640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f6b2805c950 0x7f6b2805cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:60768/0 (socket says 10.20.193.48:60768) 2026-02-12T18:08:48.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b27fff640 1 -- 10.20.193.48:0/3340701388 learned_addr learned my addr 10.20.193.48:0/3340701388 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:48.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b27fff640 10 monclient(hunting): get_auth_request con 0x7f6b2805c950 auth_method 0 2026-02-12T18:08:48.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b27fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b27fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b27fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b277fe640 10 monclient(hunting): get_auth_request con 0x7f6b2805e490 auth_method 0 2026-02-12T18:08:48.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b277fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b277fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b2cbac640 1 --2- 10.20.193.48:0/3340701388 >> v2:10.20.193.111:3300/0 conn(0x7f6b2813db70 0x7f6b2813e010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b2cbac640 10 monclient(hunting): get_auth_request con 0x7f6b2813db70 auth_method 0 2026-02-12T18:08:48.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b2cbac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b2cbac640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b2cbac640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b277fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b277fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.975+0000 7f6b277fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.976+0000 7f6b27fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.976+0000 7f6b27fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.976+0000 7f6b27fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.976+0000 7f6b2cbac640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.976+0000 7f6b2cbac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.976+0000 7f6b2cbac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.976+0000 7f6b27fff640 10 monclient(hunting): handle_auth_done global_id 5292 payload 274 2026-02-12T18:08:48.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.976+0000 7f6b27fff640 1 -- 10.20.193.48:0/3340701388 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6b2805e490 msgr2=0x7f6b2805d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:48.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.976+0000 7f6b27fff640 1 --2- 10.20.193.48:0/3340701388 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6b2805e490 0x7f6b2805d260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.976+0000 7f6b27fff640 1 -- 10.20.193.48:0/3340701388 >> v2:10.20.193.111:3300/0 conn(0x7f6b2813db70 msgr2=0x7f6b2813e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:48.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.976+0000 7f6b27fff640 1 --2- 10.20.193.48:0/3340701388 >> v2:10.20.193.111:3300/0 conn(0x7f6b2813db70 0x7f6b2813e010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.976+0000 7f6b27fff640 10 monclient: _finish_hunting 0 2026-02-12T18:08:48.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.976+0000 7f6b27fff640 1 monclient: found mon.noname-a 2026-02-12T18:08:48.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.976+0000 7f6b27fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:48.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.976+0000 7f6b27fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:08:48.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.976+0000 7f6b27fff640 1 -- 10.20.193.48:0/3340701388 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b2804dc20 con 0x7f6b2805c950 2026-02-12T18:08:48.982 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.976+0000 7f6b277fe640 1 --2- 10.20.193.48:0/3340701388 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6b2805e490 0x7f6b2805d260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:08:48.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.978+0000 7f6b27fff640 1 -- 10.20.193.48:0/3340701388 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6b2805c950 msgr2=0x7f6b2805cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:48.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.978+0000 7f6b27fff640 1 --2- 10.20.193.48:0/3340701388 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6b2805c950 0x7f6b2805cd20 secure :-1 s=READY pgs=256 gs=1 cs=0 l=1 c_cookie=6821747046734537389 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b280981f0 tx=0x7f6b1402edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eabb6cbbc2ea2ad server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.978+0000 7f6b26ffd640 1 -- 10.20.193.48:0/3340701388 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6b14035340 con 0x7f6b2805c950 2026-02-12T18:08:48.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.978+0000 7f6b26ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.978+0000 7f6b26ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:08:48.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.978+0000 7f6b26ffd640 10 monclient: dump: 2026-02-12T18:08:48.986 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.986 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.986 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.986 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.986 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.986 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.986 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.986 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.986 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.986 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.986 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.986 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.986 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.986 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.986 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.986 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.978+0000 7f6b26ffd640 10 monclient: _finish_auth 0 2026-02-12T18:08:48.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.978+0000 7f6b26ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:08:48.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.978+0000 7f6b26ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:48.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.978+0000 7f6b26ffd640 1 -- 10.20.193.48:0/3340701388 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b140354c0 con 0x7f6b2805c950 2026-02-12T18:08:48.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.978+0000 7f6b2e636640 5 monclient: authenticate success, global_id 5292 2026-02-12T18:08:48.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.978+0000 7f6b2e636640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:08:48.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.978+0000 7f6b26ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:48.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.978+0000 7f6b26ffd640 1 -- 10.20.193.48:0/3340701388 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6b14035af0 con 0x7f6b2805c950 2026-02-12T18:08:48.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.978+0000 7f6b2e636640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:48.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.978+0000 7f6b2e636640 4 set_mon_vals no callback set 2026-02-12T18:08:48.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.978+0000 7f6b26ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.978+0000 7f6b26ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:08:48.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.978+0000 7f6b26ffd640 10 monclient: dump: 2026-02-12T18:08:48.987 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.987 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.987 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.987 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.987 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.987 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.987 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.987 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.987 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.988 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.988 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.988 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.988 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.988 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.988 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.988 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.979+0000 7f6b2e636640 10 monclient: shutdown 2026-02-12T18:08:48.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.979+0000 7f6b2e636640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:48.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.979+0000 7f6b2e636640 1 -- 10.20.193.48:0/3340701388 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6b2805c950 msgr2=0x7f6b2805cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.979+0000 7f6b2e636640 1 --2- 10.20.193.48:0/3340701388 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6b2805c950 0x7f6b2805cd20 secure :-1 s=READY pgs=256 gs=1 cs=0 l=1 c_cookie=6821747046734537389 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b280981f0 tx=0x7f6b1402edb0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.979+0000 7f6b2e636640 1 -- 10.20.193.48:0/3340701388 shutdown_connections 2026-02-12T18:08:48.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.979+0000 7f6b2e636640 1 --2- 10.20.193.48:0/3340701388 >> v2:10.20.193.111:3300/0 conn(0x7f6b2813db70 0x7f6b2813e010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.979+0000 7f6b2e636640 1 --2- 10.20.193.48:0/3340701388 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6b2805e490 0x7f6b2805d260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.979+0000 7f6b2e636640 1 --2- 10.20.193.48:0/3340701388 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6b2805c950 0x7f6b2805cd20 unknown :-1 s=CLOSED pgs=256 gs=1 cs=0 l=1 c_cookie=6821747046734537389 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.979+0000 7f6b2e636640 1 -- 10.20.193.48:0/3340701388 >> 10.20.193.48:0/3340701388 conn(0x7f6b280548a0 msgr2=0x7f6b28097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:48.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.979+0000 7f6b2e636640 1 -- 10.20.193.48:0/3340701388 shutdown_connections 2026-02-12T18:08:48.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.979+0000 7f6b2e636640 1 -- 10.20.193.48:0/3340701388 wait complete. 2026-02-12T18:08:48.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.979+0000 7f6b2e636640 10 monclient: build_initial_monmap 2026-02-12T18:08:48.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.979+0000 7f6b2e636640 10 monclient: monmap: 2026-02-12T18:08:48.988 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:48.989 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:48.989 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:48.989 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:48.989 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:48.989 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.989 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:48.989 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:48.989 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:48.989 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:48.989 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:48.989 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:48.989 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:48.989 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:48.989 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:48.989 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b2e636640 1 Processor -- start 2026-02-12T18:08:48.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b2e636640 1 -- start start 2026-02-12T18:08:48.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b2e636640 10 monclient: init 2026-02-12T18:08:48.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b2e636640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:48.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b2e636640 10 monclient: _add_conns ranks=[0,4,7,6,3,5,1,2,8] 2026-02-12T18:08:48.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b2e636640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6b2805c950 0x7f6b2812c7b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b2e636640 10 monclient(hunting): picked mon.noname-a con 0x7f6b2805c950 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:08:48.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b2e636640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6b2805e490 0x7f6b2808d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b2e636640 10 monclient(hunting): picked mon.noname-c con 0x7f6b2805e490 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:08:48.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b2e636640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6b2813db70 0x7f6b2808d7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b2e636640 10 monclient(hunting): picked mon.noname-i con 0x7f6b2813db70 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:48.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b2e636640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b2e636640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f6b2812ccf0 con 0x7f6b2805c950 2026-02-12T18:08:48.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b2e636640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b2e636640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f6b2812d770 con 0x7f6b2805e490 2026-02-12T18:08:48.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b2e636640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b2e636640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f6b2813e330 con 0x7f6b2813db70 2026-02-12T18:08:48.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b2e636640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:48.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b2e636640 10 monclient(hunting): authenticate will time out at 767.706340s 2026-02-12T18:08:48.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b277fe640 1 -- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6b2805e490 msgr2=0x7f6b2808d260 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.48:3302/0 2026-02-12T18:08:48.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b277fe640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6b2805e490 0x7f6b2808d260 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:08:48.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b27fff640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6b2805c950 0x7f6b2812c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b27fff640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6b2805c950 0x7f6b2812c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:60772/0 (socket says 10.20.193.48:60772) 2026-02-12T18:08:48.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b27fff640 1 -- 10.20.193.48:0/3419421324 learned_addr learned my addr 10.20.193.48:0/3419421324 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:48.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b27fff640 10 monclient(hunting): get_auth_request con 0x7f6b2805c950 auth_method 0 2026-02-12T18:08:48.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b27fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b27fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b27fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b27fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b27fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b27fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b2cbac640 1 --2- 10.20.193.48:0/3419421324 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6b2813db70 0x7f6b2808d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b2cbac640 10 monclient(hunting): get_auth_request con 0x7f6b2813db70 auth_method 0 2026-02-12T18:08:48.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b2cbac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b2cbac640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b2cbac640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b27fff640 10 monclient(hunting): handle_auth_done global_id 5301 payload 824 2026-02-12T18:08:48.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b27fff640 1 -- 10.20.193.48:0/3419421324 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6b2813db70 msgr2=0x7f6b2808d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b27fff640 1 --2- 10.20.193.48:0/3419421324 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6b2813db70 0x7f6b2808d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b27fff640 1 -- 10.20.193.48:0/3419421324 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6b2805e490 msgr2=0x7f6b2808d260 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:08:48.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b27fff640 1 --2- 10.20.193.48:0/3419421324 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6b2805e490 0x7f6b2808d260 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:48.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b27fff640 10 monclient: _finish_hunting 0 2026-02-12T18:08:48.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b27fff640 1 monclient: found mon.noname-a 2026-02-12T18:08:48.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b27fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:48.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b27fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:08:48.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.980+0000 7f6b27fff640 1 -- 10.20.193.48:0/3419421324 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b18009420 con 0x7f6b2805c950 2026-02-12T18:08:48.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.982+0000 7f6b27fff640 1 -- 10.20.193.48:0/3419421324 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6b2805c950 msgr2=0x7f6b2812c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:48.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.982+0000 7f6b27fff640 1 --2- 10.20.193.48:0/3419421324 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6b2805c950 0x7f6b2812c7b0 secure :-1 s=READY pgs=257 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b14009060 tx=0x7f6b14004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.982+0000 7f6b24ff9640 1 -- 10.20.193.48:0/3419421324 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6b14035340 con 0x7f6b2805c950 2026-02-12T18:08:48.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.982+0000 7f6b24ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.982+0000 7f6b24ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:08:48.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.982+0000 7f6b24ff9640 10 monclient: dump: 2026-02-12T18:08:48.992 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.992 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.992 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.992 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.992 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.992 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.992 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.992 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.992 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.992 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.992 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.992 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.992 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.992 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.992 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.992 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.982+0000 7f6b24ff9640 10 monclient: _finish_auth 0 2026-02-12T18:08:48.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.982+0000 7f6b24ff9640 10 monclient: _check_auth_tickets 2026-02-12T18:08:48.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.982+0000 7f6b24ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:48.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.982+0000 7f6b24ff9640 1 -- 10.20.193.48:0/3419421324 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b14035e00 con 0x7f6b2805c950 2026-02-12T18:08:48.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.982+0000 7f6b2e636640 5 monclient: authenticate success, global_id 5301 2026-02-12T18:08:48.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.982+0000 7f6b2e636640 10 monclient: _renew_subs 2026-02-12T18:08:48.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.982+0000 7f6b2e636640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:08:48.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.982+0000 7f6b2e636640 1 -- 10.20.193.48:0/3419421324 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b140094f0 con 0x7f6b2805c950 2026-02-12T18:08:48.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.982+0000 7f6b24ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:48.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.982+0000 7f6b24ff9640 1 -- 10.20.193.48:0/3419421324 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6b14037dc0 con 0x7f6b2805c950 2026-02-12T18:08:48.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.982+0000 7f6b24ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.982+0000 7f6b24ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:08:48.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.982+0000 7f6b267fc640 4 set_mon_vals no callback set 2026-02-12T18:08:48.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.982+0000 7f6b24ff9640 10 monclient: dump: 2026-02-12T18:08:48.993 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.993 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.993 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.993 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.993 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.993 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.993 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.993 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.993 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.994 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.994 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.994 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.994 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.994 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.994 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.994 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.983+0000 7f6b2e636640 10 monclient: _renew_subs 2026-02-12T18:08:48.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.983+0000 7f6b2e636640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:08:48.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.983+0000 7f6b2e636640 1 -- 10.20.193.48:0/3419421324 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b2808ad40 con 0x7f6b2805c950 2026-02-12T18:08:48.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.983+0000 7f6b2e636640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:48.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.983+0000 7f6b2e636640 1 --2- 10.20.193.48:0/3419421324 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6b2813cbe0 0x7f6b2813cfb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.983+0000 7f6b2e636640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.983+0000 7f6b2e636640 1 -- 10.20.193.48:0/3419421324 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f6b28063180 con 0x7f6b2813cbe0 2026-02-12T18:08:48.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.983+0000 7f6b277fe640 1 --2- 10.20.193.48:0/3419421324 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6b2813cbe0 0x7f6b2813cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.983+0000 7f6b24ff9640 1 -- 10.20.193.48:0/3419421324 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f6b14046020 con 0x7f6b2805c950 2026-02-12T18:08:48.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.983+0000 7f6b277fe640 10 monclient: get_auth_request con 0x7f6b2813cbe0 auth_method 0 2026-02-12T18:08:48.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.983+0000 7f6b277fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.983+0000 7f6b277fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.983+0000 7f6b277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.983+0000 7f6b277fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.983+0000 7f6b277fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.983+0000 7f6b277fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.983+0000 7f6b24ff9640 1 --2- 10.20.193.48:0/3419421324 >> v2:10.20.193.111:6812/977811348 conn(0x7f6af803f7c0 0x7f6af805fc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.983+0000 7f6b24ff9640 1 -- 10.20.193.48:0/3419421324 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 3503+0+0 (secure 0 0 0) 0x7f6b14077d40 con 0x7f6b2805c950 2026-02-12T18:08:48.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.984+0000 7f6b277fe640 10 monclient(hunting): handle_auth_done global_id 5180 payload 824 2026-02-12T18:08:48.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.984+0000 7f6b277fe640 1 -- 10.20.193.48:0/3419421324 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6b28097de0 con 0x7f6b2813cbe0 2026-02-12T18:08:48.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.984+0000 7f6b2cbac640 1 --2- 10.20.193.48:0/3419421324 >> v2:10.20.193.111:6812/977811348 conn(0x7f6af803f7c0 0x7f6af805fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.984+0000 7f6b2cbac640 10 monclient: get_auth_request con 0x7f6af803f7c0 auth_method 0 2026-02-12T18:08:48.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.986+0000 7f6b277fe640 1 -- 10.20.193.48:0/3419421324 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6b2813cbe0 msgr2=0x7f6b2813cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:48.997 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.986+0000 7f6b277fe640 1 --2- 10.20.193.48:0/3419421324 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6b2813cbe0 0x7f6b2813cfb0 secure :-1 s=READY pgs=153 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b28091950 tx=0x7f6b1800ed50 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.997 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.986+0000 7f6b24ff9640 1 -- 10.20.193.48:0/3419421324 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6b18004450 con 0x7f6b2813cbe0 2026-02-12T18:08:48.997 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.986+0000 7f6b24ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.997 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.986+0000 7f6b24ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:08:48.997 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.986+0000 7f6b24ff9640 10 monclient: dump: 2026-02-12T18:08:48.997 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.997 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.997 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.997 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.997 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.997 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.997 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.997 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.997 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:48.997 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:48.997 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:48.997 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:48.997 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:48.997 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:48.998 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:48.998 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:48.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.986+0000 7f6b2cbac640 1 --2- 10.20.193.48:0/3419421324 >> v2:10.20.193.111:6812/977811348 conn(0x7f6af803f7c0 0x7f6af805fc70 secure :-1 s=READY pgs=202 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b28141120 tx=0x7f6b1c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.986+0000 7f6b24ff9640 1 -- 10.20.193.48:0/3419421324 <== mon.5 v2:10.20.193.111:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f6b180045b0 con 0x7f6b2813cbe0 2026-02-12T18:08:48.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.986+0000 7f6b24ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:48.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.986+0000 7f6b24ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:48.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.986+0000 7f6b24ff9640 1 -- 10.20.193.48:0/3419421324 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6b2813cbe0 msgr2=0x7f6b2813cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:48.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.986+0000 7f6b24ff9640 1 --2- 10.20.193.48:0/3419421324 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6b2813cbe0 0x7f6b2813cfb0 secure :-1 s=READY pgs=153 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b28091950 tx=0x7f6b1800ed50 comp rx=0 tx=0).stop 2026-02-12T18:08:48.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.986+0000 7f6b24ff9640 1 -- 10.20.193.48:0/3419421324 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6b2813cbe0 msgr2=0x7f6b2813cfb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:48.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.986+0000 7f6b24ff9640 1 --2- 10.20.193.48:0/3419421324 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6b2813cbe0 0x7f6b2813cfb0 secure :-1 s=CLOSED pgs=153 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b28091950 tx=0x7f6b1800ed50 comp rx=0 tx=0).stop 2026-02-12T18:08:48.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.990+0000 7f6b2e636640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:08:48.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.990+0000 7f6b2e636640 1 --2- 10.20.193.48:0/3419421324 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6b2813d4f0 0x7f6b2813f070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:48.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.990+0000 7f6b2e636640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:48.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.990+0000 7f6b2e636640 1 -- 10.20.193.48:0/3419421324 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f6b28050410 con 0x7f6b2813d4f0 2026-02-12T18:08:48.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.990+0000 7f6b277fe640 1 --2- 10.20.193.48:0/3419421324 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6b2813d4f0 0x7f6b2813f070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:48.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.990+0000 7f6b277fe640 10 monclient: get_auth_request con 0x7f6b2813d4f0 auth_method 0 2026-02-12T18:08:48.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.990+0000 7f6b277fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:48.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.990+0000 7f6b277fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:48.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.990+0000 7f6b277fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:48.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.990+0000 7f6b277fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:48.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.990+0000 7f6b277fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:48.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.990+0000 7f6b277fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:48.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.990+0000 7f6b277fe640 10 monclient(hunting): handle_auth_done global_id 5189 payload 824 2026-02-12T18:08:48.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.990+0000 7f6b277fe640 1 -- 10.20.193.48:0/3419421324 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6b2805cd20 con 0x7f6b2813d4f0 2026-02-12T18:08:48.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.992+0000 7f6b277fe640 1 -- 10.20.193.48:0/3419421324 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6b2813d4f0 msgr2=0x7f6b2813f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:48.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.992+0000 7f6b277fe640 1 --2- 10.20.193.48:0/3419421324 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6b2813d4f0 0x7f6b2813f070 secure :-1 s=READY pgs=154 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b180023d0 tx=0x7f6b180047e0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:48.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.993+0000 7f6b24ff9640 1 -- 10.20.193.48:0/3419421324 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6b18023070 con 0x7f6b2813d4f0 2026-02-12T18:08:48.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.993+0000 7f6b24ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:48.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.993+0000 7f6b24ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:08:48.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.993+0000 7f6b24ff9640 10 monclient: dump: 2026-02-12T18:08:48.999 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:48.999 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:48.999 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.999 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:48.999 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:48.999 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:48.999 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:48.999 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:48.999 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:49.000 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:49.000 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:49.000 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:49.000 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:49.000 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:49.000 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:49.000 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:49.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.993+0000 7f6b24ff9640 1 -- 10.20.193.48:0/3419421324 <== mon.5 v2:10.20.193.111:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9982 (secure 0 0 0) 0x7f6b1800ceb0 con 0x7f6b2813d4f0 2026-02-12T18:08:49.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.993+0000 7f6b24ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:08:49.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.993+0000 7f6b24ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:49.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.993+0000 7f6b24ff9640 1 -- 10.20.193.48:0/3419421324 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6b2813d4f0 msgr2=0x7f6b2813f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:49.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.993+0000 7f6b24ff9640 1 --2- 10.20.193.48:0/3419421324 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6b2813d4f0 0x7f6b2813f070 secure :-1 s=READY pgs=154 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b180023d0 tx=0x7f6b180047e0 comp rx=0 tx=0).stop 2026-02-12T18:08:49.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.993+0000 7f6b24ff9640 1 -- 10.20.193.48:0/3419421324 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6b2813d4f0 msgr2=0x7f6b2813f070 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:49.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.993+0000 7f6b24ff9640 1 --2- 10.20.193.48:0/3419421324 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6b2813d4f0 0x7f6b2813f070 secure :-1 s=CLOSED pgs=154 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b180023d0 tx=0x7f6b180047e0 comp rx=0 tx=0).stop 2026-02-12T18:08:49.000 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:08:49.001 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:49.001 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:49.001 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:08:49.001 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 38, 2026-02-12T18:08:49.001 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 183787, 2026-02-12T18:08:49.001 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:08:49.001 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:08:49.001 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:08:49.001 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:08:49.001 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:08:49.001 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:08:49.001 INFO:teuthology.orchestra.run.trial048.stdout: 7 2026-02-12T18:08:49.001 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:49.001 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:08:49.001 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:49.001 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:08:49.001 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:08:49.001 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:49.001 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:49.002 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:49.002 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:49.002 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:49.002 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:49.002 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:49.002 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:49.002 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:49.002 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:49.002 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:49.002 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:49.002 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:49.002 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:49.002 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:08:49.002 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:08:49.002 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:49.002 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:49.002 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:49.002 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:49.002 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:49.002 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:49.002 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:49.003 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:49.003 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:49.003 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:49.003 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:49.003 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:49.003 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:49.003 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:49.003 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.003 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:08:49.003 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:08:49.003 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:08:49.003 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:08:49.003 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:08:49.003 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:08:49.003 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:49.003 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:49.003 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:08:49.003 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:08:49.003 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:08:49.003 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:08:49.004 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:08:49.004 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:08:49.004 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:08:49.004 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:49.004 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:08:49.004 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:49.004 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:49.004 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:49.004 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:49.004 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:49.004 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:49.004 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:49.004 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:49.004 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:49.004 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:49.004 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:49.004 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:49.004 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:49.004 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:49.004 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:08:49.004 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.004 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:08:49.005 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.005 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:49.005 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:49.005 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:49.005 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:49.005 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.005 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:49.005 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:08:49.005 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.005 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.005 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.005 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:49.005 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:08:49.005 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.005 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:49.005 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:49.005 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.005 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:08:49.005 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:08:49.005 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:49.005 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:49.005 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:08:49.006 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:49.006 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.006 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.006 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:49.006 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:49.006 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:49.006 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:49.006 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.006 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:49.006 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:08:49.006 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.006 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.006 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.006 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:49.006 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:08:49.006 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.006 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:49.006 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:49.006 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.006 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:08:49.006 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:08:49.006 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:49.006 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:49.007 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:08:49.007 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:49.007 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.007 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.007 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:49.007 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:49.007 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:49.007 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:49.007 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.007 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:49.007 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:08:49.007 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.007 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.007 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.007 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:49.007 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:08:49.007 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.007 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:49.007 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:49.007 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.007 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:08:49.007 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:08:49.008 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:49.008 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:49.008 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:08:49.008 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:49.008 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.008 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.008 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:08:49.008 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:08:49.008 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:49.008 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:49.008 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.008 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:49.008 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:08:49.008 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.008 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.008 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.008 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:49.008 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:08:49.008 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.008 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:49.008 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:49.008 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.008 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:08:49.008 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:08:49.009 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:49.009 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:49.009 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:08:49.009 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:49.009 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.009 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.009 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:08:49.009 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:08:49.009 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:49.009 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:49.009 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.009 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:49.009 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:08:49.009 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.009 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.009 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.009 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:49.009 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:08:49.009 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.009 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:49.009 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:49.009 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.009 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:08:49.010 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:08:49.010 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:49.010 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:49.010 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:49.010 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:49.010 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.010 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.010 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:49.010 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:49.010 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:49.010 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:49.010 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.010 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:49.010 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:08:49.010 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.010 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.010 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.010 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:49.010 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:08:49.010 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.010 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:49.010 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:49.010 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.011 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:08:49.011 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:08:49.011 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:49.011 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:49.011 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:08:49.011 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:49.011 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.011 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.011 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:49.011 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:49.011 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:49.011 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:49.011 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.011 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:49.011 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:08:49.011 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.011 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.011 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.011 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:49.011 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:08:49.011 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.011 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:49.011 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:49.011 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.012 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:08:49.012 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:08:49.012 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:49.012 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:49.012 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:49.012 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:49.012 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.012 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.012 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:49.012 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:49.012 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:49.012 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:49.012 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.012 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:49.012 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:08:49.012 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.012 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.012 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.012 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:49.012 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:08:49.012 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.012 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:49.012 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:49.012 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.012 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:08:49.013 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:08:49.013 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:49.013 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:49.013 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:08:49.013 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:49.013 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.013 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.013 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:08:49.013 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:08:49.013 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:49.013 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:49.013 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.013 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:49.013 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:08:49.013 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.013 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.013 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.013 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:49.013 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:08:49.013 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.013 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:49.013 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:49.013 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.013 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:08:49.013 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:08:49.014 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:49.014 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:49.014 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:08:49.014 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:49.014 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:49.014 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:49.014 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.014 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:08:49.014 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:08:49.014 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.014 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:49.014 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:49.014 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:49.014 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:49.014 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:49.014 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:08:49.014 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.014 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:49.014 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:49.014 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:08:49.014 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:49.014 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:49.014 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.014 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:08:49.014 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:08:49.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.993+0000 7f6b2e636640 1 -- 10.20.193.48:0/3419421324 >> v2:10.20.193.111:6812/977811348 conn(0x7f6af803f7c0 msgr2=0x7f6af805fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:49.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.993+0000 7f6b2e636640 1 --2- 10.20.193.48:0/3419421324 >> v2:10.20.193.111:6812/977811348 conn(0x7f6af803f7c0 0x7f6af805fc70 secure :-1 s=READY pgs=202 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b28141120 tx=0x7f6b1c009040 comp rx=0 tx=0).stop 2026-02-12T18:08:49.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.993+0000 7f6b2e636640 10 monclient: shutdown 2026-02-12T18:08:49.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.993+0000 7f6b2e636640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:49.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.993+0000 7f6b2e636640 1 -- 10.20.193.48:0/3419421324 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6b2805c950 msgr2=0x7f6b2812c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:49.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.993+0000 7f6b2e636640 1 --2- 10.20.193.48:0/3419421324 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6b2805c950 0x7f6b2812c7b0 secure :-1 s=READY pgs=257 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6b14009060 tx=0x7f6b14004770 comp rx=0 tx=0).stop 2026-02-12T18:08:49.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.993+0000 7f6b2cbac640 1 -- 10.20.193.48:0/3419421324 reap_dead start 2026-02-12T18:08:49.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.993+0000 7f6b2e636640 1 -- 10.20.193.48:0/3419421324 shutdown_connections 2026-02-12T18:08:49.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.993+0000 7f6b2e636640 1 --2- 10.20.193.48:0/3419421324 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6b2805c950 0x7f6b2812c7b0 unknown :-1 s=CLOSED pgs=257 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:49.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.993+0000 7f6b2e636640 1 -- 10.20.193.48:0/3419421324 >> 10.20.193.48:0/3419421324 conn(0x7f6b280548a0 msgr2=0x7f6b28093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:49.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.993+0000 7f6b2e636640 1 -- 10.20.193.48:0/3419421324 shutdown_connections 2026-02-12T18:08:49.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:48.993+0000 7f6b2e636640 1 -- 10.20.193.48:0/3419421324 wait complete. 2026-02-12T18:08:49.016 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2026-02-12T18:08:49.016 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon i 2026-02-12T18:08:49.016 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2026-02-12T18:08:49.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.083+0000 7efd282cc640 10 monclient: get_monmap_and_config 2026-02-12T18:08:49.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.083+0000 7efd282cc640 10 monclient: build_initial_monmap 2026-02-12T18:08:49.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.083+0000 7efd282cc640 10 monclient: monmap: 2026-02-12T18:08:49.085 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:49.085 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:49.085 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:08:49.084698+0000 2026-02-12T18:08:49.085 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:08:49.084698+0000 2026-02-12T18:08:49.085 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:49.085 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:49.085 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:08:49.085 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:08:49.085 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:49.085 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:49.085 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:49.085 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:49.085 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:49.085 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:49.085 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:49.085 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:08:49.085 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:08:49.085 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:49.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd282cc640 1 Processor -- start 2026-02-12T18:08:49.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd282cc640 1 -- start start 2026-02-12T18:08:49.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd282cc640 10 monclient: init 2026-02-12T18:08:49.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd282cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:49.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd282cc640 10 monclient: _add_conns ranks=[0,2,7,6,10,1,4,8,3,9,5] 2026-02-12T18:08:49.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd282cc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7efd2008f1a0 addr v1:10.20.193.48:6789/0 2026-02-12T18:08:49.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd282cc640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7efd200902b0 0x7efd20090680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:49.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd282cc640 10 monclient(hunting): picked mon.noname-b con 0x7efd200902b0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:08:49.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd282cc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd201839a0 0x7efd201a3d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:49.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd282cc640 10 monclient(hunting): picked mon.noname-i con 0x7efd201839a0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:49.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd282cc640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd2004dc20 con 0x7efd2008f1a0 2026-02-12T18:08:49.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd282cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:49.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd282cc640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7efd2008ba70 con 0x7efd200902b0 2026-02-12T18:08:49.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd282cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:49.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd282cc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7efd20089df0 con 0x7efd201839a0 2026-02-12T18:08:49.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd282cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:49.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd282cc640 10 monclient(hunting): authenticate will time out at 767.810486s 2026-02-12T18:08:49.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd26041640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7efd2008f1a0 0x7efd2008fba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:54040/0 (socket says 10.20.193.48:54040) 2026-02-12T18:08:49.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd26041640 1 -- 10.20.193.48:0/2105344490 learned_addr learned my addr 10.20.193.48:0/2105344490 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:08:49.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd26842640 1 --2- 10.20.193.48:0/2105344490 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd201839a0 0x7efd201a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:49.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd26842640 10 monclient(hunting): get_auth_request con 0x7efd201839a0 auth_method 0 2026-02-12T18:08:49.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd26842640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:49.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd26842640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:49.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd26842640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:49.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd26842640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:49.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd26842640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:49.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd26842640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:49.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd26842640 10 monclient(hunting): handle_auth_done global_id 44377 payload 274 2026-02-12T18:08:49.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd26842640 1 -- 10.20.193.48:0/2105344490 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7efd200902b0 msgr2=0x7efd20090680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:49.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd26842640 1 --2- 10.20.193.48:0/2105344490 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7efd200902b0 0x7efd20090680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:49.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd26842640 1 -- 10.20.193.48:0/2105344490 >> v1:10.20.193.48:6789/0 conn(0x7efd2008f1a0 legacy=0x7efd2008fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:08:49.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd26842640 10 monclient: _finish_hunting 0 2026-02-12T18:08:49.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd26842640 1 monclient: found mon.noname-i 2026-02-12T18:08:49.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd26842640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:49.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd26842640 10 monclient: _send_mon_message to mon.noname-i at v2:10.20.193.111:3303/0 2026-02-12T18:08:49.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.084+0000 7efd26842640 1 -- 10.20.193.48:0/2105344490 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd2008f570 con 0x7efd201839a0 2026-02-12T18:08:49.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.087+0000 7efd26842640 1 -- 10.20.193.48:0/2105344490 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd201839a0 msgr2=0x7efd201a3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:49.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.087+0000 7efd26842640 1 --2- 10.20.193.48:0/2105344490 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd201839a0 0x7efd201a3d80 secure :-1 s=READY pgs=46 gs=3 cs=0 l=1 c_cookie=12134878340884858015 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd1c00a910 tx=0x7efd1c02fdb0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=a867bf8ec506049f server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:49.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.087+0000 7efd2503f640 1 -- 10.20.193.48:0/2105344490 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7efd1c036340 con 0x7efd201839a0 2026-02-12T18:08:49.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.087+0000 7efd2503f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:49.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.087+0000 7efd2503f640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2026-02-12T18:08:49.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.087+0000 7efd2503f640 10 monclient: dump: 2026-02-12T18:08:49.091 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:49.091 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:49.091 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:49.091 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:49.092 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:49.092 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:49.092 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:49.092 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:49.092 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:49.092 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:49.092 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:49.092 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:49.092 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:49.092 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:49.092 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:49.092 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:49.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.087+0000 7efd2503f640 10 monclient: _finish_auth 0 2026-02-12T18:08:49.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.087+0000 7efd2503f640 10 monclient: _check_auth_tickets 2026-02-12T18:08:49.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.087+0000 7efd2503f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:49.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.087+0000 7efd2503f640 1 -- 10.20.193.48:0/2105344490 <== mon.7 v2:10.20.193.111:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd1c0364c0 con 0x7efd201839a0 2026-02-12T18:08:49.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.087+0000 7efd2503f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:49.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.087+0000 7efd2503f640 1 -- 10.20.193.48:0/2105344490 <== mon.7 v2:10.20.193.111:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7efd1c036af0 con 0x7efd201839a0 2026-02-12T18:08:49.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.087+0000 7efd282cc640 5 monclient: authenticate success, global_id 44377 2026-02-12T18:08:49.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.087+0000 7efd282cc640 10 monclient: get_monmap_and_config success 2026-02-12T18:08:49.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.087+0000 7efd282cc640 4 set_mon_vals no callback set 2026-02-12T18:08:49.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.087+0000 7efd2503f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:49.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.087+0000 7efd2503f640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:08:49.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.087+0000 7efd2503f640 10 monclient: dump: 2026-02-12T18:08:49.093 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:49.093 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:49.093 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:49.093 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:49.093 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:49.093 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:49.093 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:49.093 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:49.093 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:49.093 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:49.093 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:49.093 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:49.093 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:49.093 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:49.093 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:49.093 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:49.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.088+0000 7efd282cc640 10 monclient: shutdown 2026-02-12T18:08:49.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.088+0000 7efd282cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:49.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.088+0000 7efd282cc640 1 -- 10.20.193.48:0/2105344490 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd201839a0 msgr2=0x7efd201a3d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:49.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.088+0000 7efd282cc640 1 --2- 10.20.193.48:0/2105344490 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd201839a0 0x7efd201a3d80 secure :-1 s=READY pgs=46 gs=3 cs=0 l=1 c_cookie=12134878340884858015 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd1c00a910 tx=0x7efd1c02fdb0 comp rx=0 tx=0).stop 2026-02-12T18:08:49.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.088+0000 7efd282cc640 1 -- 10.20.193.48:0/2105344490 shutdown_connections 2026-02-12T18:08:49.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.088+0000 7efd282cc640 1 --2- 10.20.193.48:0/2105344490 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7efd200902b0 0x7efd20090680 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:49.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.088+0000 7efd282cc640 1 --2- 10.20.193.48:0/2105344490 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd201839a0 0x7efd201a3d80 unknown :-1 s=CLOSED pgs=46 gs=3 cs=0 l=1 c_cookie=12134878340884858015 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:49.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.088+0000 7efd282cc640 1 -- 10.20.193.48:0/2105344490 >> 10.20.193.48:0/2105344490 conn(0x7efd20054f30 msgr2=0x7efd200951a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:49.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.088+0000 7efd282cc640 1 -- 10.20.193.48:0/2105344490 shutdown_connections 2026-02-12T18:08:49.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.088+0000 7efd282cc640 1 -- 10.20.193.48:0/2105344490 wait complete. 2026-02-12T18:08:49.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.088+0000 7efd282cc640 10 monclient: build_initial_monmap 2026-02-12T18:08:49.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.088+0000 7efd282cc640 10 monclient: monmap: 2026-02-12T18:08:49.094 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:08:49.094 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:08:49.094 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:08:49.094 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:08:49.094 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:08:49.094 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:49.094 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:08:49.094 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:08:49.094 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:08:49.094 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:08:49.094 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:08:49.094 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:08:49.094 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:08:49.094 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:08:49.094 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:08:49.094 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:49.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.088+0000 7efd282cc640 1 Processor -- start 2026-02-12T18:08:49.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.088+0000 7efd282cc640 1 -- start start 2026-02-12T18:08:49.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.088+0000 7efd282cc640 10 monclient: init 2026-02-12T18:08:49.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd282cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:08:49.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd282cc640 10 monclient: _add_conns ranks=[7,0,1,6,2,3,5,4,8] 2026-02-12T18:08:49.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd282cc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd2008f1a0 0x7efd20151320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:49.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd282cc640 10 monclient(hunting): picked mon.noname-i con 0x7efd2008f1a0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:08:49.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd282cc640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7efd200902b0 0x7efd20134490 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:49.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd282cc640 10 monclient(hunting): picked mon.noname-a con 0x7efd200902b0 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:08:49.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd282cc640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7efd201839a0 0x7efd2014e330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:49.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd282cc640 10 monclient(hunting): picked mon.noname-f con 0x7efd201839a0 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:08:49.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd282cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:49.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd282cc640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7efd201353f0 con 0x7efd200902b0 2026-02-12T18:08:49.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd282cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:49.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd282cc640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7efd20133500 con 0x7efd201839a0 2026-02-12T18:08:49.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd282cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:49.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd282cc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7efd2008fe30 con 0x7efd2008f1a0 2026-02-12T18:08:49.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd282cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:08:49.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd282cc640 10 monclient(hunting): authenticate will time out at 767.815131s 2026-02-12T18:08:49.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd25840640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7efd200902b0 0x7efd20134490 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:49.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd25840640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7efd200902b0 0x7efd20134490 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:60792/0 (socket says 10.20.193.48:60792) 2026-02-12T18:08:49.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd25840640 1 -- 10.20.193.48:0/2452286084 learned_addr learned my addr 10.20.193.48:0/2452286084 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:08:49.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd25840640 10 monclient(hunting): get_auth_request con 0x7efd200902b0 auth_method 0 2026-02-12T18:08:49.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd25840640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:49.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd25840640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:49.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd25840640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:49.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd25840640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:49.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd25840640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:49.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd26041640 1 --2- 10.20.193.48:0/2452286084 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd2008f1a0 0x7efd20151320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:49.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd25840640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:49.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd26041640 10 monclient(hunting): get_auth_request con 0x7efd2008f1a0 auth_method 0 2026-02-12T18:08:49.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd26041640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:49.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd26041640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:49.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd26041640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:49.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd26842640 1 --2- 10.20.193.48:0/2452286084 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7efd201839a0 0x7efd2014e330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:49.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd26842640 10 monclient(hunting): get_auth_request con 0x7efd201839a0 auth_method 0 2026-02-12T18:08:49.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd26842640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:49.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd26842640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:49.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd26842640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:49.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd26041640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:49.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd26041640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:49.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd26041640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:49.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd25840640 10 monclient(hunting): handle_auth_done global_id 5310 payload 824 2026-02-12T18:08:49.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd25840640 1 -- 10.20.193.48:0/2452286084 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd2008f1a0 msgr2=0x7efd20151320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:49.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd25840640 1 --2- 10.20.193.48:0/2452286084 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd2008f1a0 0x7efd20151320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:49.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd25840640 1 -- 10.20.193.48:0/2452286084 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7efd201839a0 msgr2=0x7efd2014e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:49.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd25840640 1 --2- 10.20.193.48:0/2452286084 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7efd201839a0 0x7efd2014e330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:08:49.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd25840640 10 monclient: _finish_hunting 0 2026-02-12T18:08:49.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd25840640 1 monclient: found mon.noname-a 2026-02-12T18:08:49.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd25840640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:08:49.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd25840640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:08:49.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd25840640 1 -- 10.20.193.48:0/2452286084 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd1c00a500 con 0x7efd200902b0 2026-02-12T18:08:49.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.089+0000 7efd26842640 1 --2- 10.20.193.48:0/2452286084 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7efd201839a0 0x7efd2014e330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:08:49.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.091+0000 7efd25840640 1 -- 10.20.193.48:0/2452286084 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7efd200902b0 msgr2=0x7efd20134490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:49.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.091+0000 7efd25840640 1 --2- 10.20.193.48:0/2452286084 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7efd200902b0 0x7efd20134490 secure :-1 s=READY pgs=261 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd1400b520 tx=0x7efd1400b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:49.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.091+0000 7efd06ffd640 1 -- 10.20.193.48:0/2452286084 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7efd14004490 con 0x7efd200902b0 2026-02-12T18:08:49.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.091+0000 7efd06ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:49.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.091+0000 7efd06ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:08:49.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.091+0000 7efd06ffd640 10 monclient: dump: 2026-02-12T18:08:49.100 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:49.100 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:49.100 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:49.100 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:49.100 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:49.100 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:49.100 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:49.100 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:49.100 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:49.100 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:49.100 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:49.100 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:49.100 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:49.100 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:49.100 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:49.100 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:49.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.091+0000 7efd06ffd640 10 monclient: _finish_auth 0 2026-02-12T18:08:49.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.091+0000 7efd06ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:08:49.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.091+0000 7efd06ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:08:49.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.091+0000 7efd06ffd640 1 -- 10.20.193.48:0/2452286084 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd14002b60 con 0x7efd200902b0 2026-02-12T18:08:49.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.091+0000 7efd282cc640 5 monclient: authenticate success, global_id 5310 2026-02-12T18:08:49.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.091+0000 7efd06ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:08:49.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.091+0000 7efd06ffd640 1 -- 10.20.193.48:0/2452286084 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7efd14002cd0 con 0x7efd200902b0 2026-02-12T18:08:49.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.091+0000 7efd06ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:49.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.091+0000 7efd2483e640 4 set_mon_vals no callback set 2026-02-12T18:08:49.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.091+0000 7efd06ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:08:49.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.091+0000 7efd06ffd640 10 monclient: dump: 2026-02-12T18:08:49.101 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:49.101 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:49.101 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:49.101 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:49.101 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:49.101 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:49.101 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:49.101 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:49.101 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:49.101 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:49.101 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:49.101 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:49.101 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:49.101 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:49.101 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:49.101 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:49.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.091+0000 7efd282cc640 10 monclient: _renew_subs 2026-02-12T18:08:49.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.091+0000 7efd282cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:08:49.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.091+0000 7efd282cc640 1 -- 10.20.193.48:0/2452286084 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd20134e20 con 0x7efd200902b0 2026-02-12T18:08:49.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.091+0000 7efd282cc640 10 monclient: _renew_subs 2026-02-12T18:08:49.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.091+0000 7efd282cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:08:49.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.091+0000 7efd282cc640 1 -- 10.20.193.48:0/2452286084 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd20135c90 con 0x7efd200902b0 2026-02-12T18:08:49.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.092+0000 7efd282cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:49.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.092+0000 7efd282cc640 1 --2- 10.20.193.48:0/2452286084 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd20135790 0x7efd20154390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:49.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.092+0000 7efd282cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:49.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.092+0000 7efd282cc640 1 -- 10.20.193.48:0/2452286084 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7efd2005f140 con 0x7efd20135790 2026-02-12T18:08:49.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.092+0000 7efd06ffd640 1 -- 10.20.193.48:0/2452286084 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7efd140026a0 con 0x7efd200902b0 2026-02-12T18:08:49.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.092+0000 7efd26041640 1 --2- 10.20.193.48:0/2452286084 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd20135790 0x7efd20154390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:49.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.092+0000 7efd26041640 10 monclient: get_auth_request con 0x7efd20135790 auth_method 0 2026-02-12T18:08:49.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.092+0000 7efd26041640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:49.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.092+0000 7efd26041640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:49.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.092+0000 7efd26041640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:49.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.092+0000 7efd06ffd640 1 --2- 10.20.193.48:0/2452286084 >> v2:10.20.193.111:6812/977811348 conn(0x7efcf003f730 0x7efcf005fbe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:49.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.092+0000 7efd06ffd640 1 -- 10.20.193.48:0/2452286084 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 3897+0+0 (secure 0 0 0) 0x7efd14052be0 con 0x7efd200902b0 2026-02-12T18:08:49.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.092+0000 7efd26041640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:49.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.092+0000 7efd26041640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:49.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.092+0000 7efd26041640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:49.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.092+0000 7efd26842640 1 --2- 10.20.193.48:0/2452286084 >> v2:10.20.193.111:6812/977811348 conn(0x7efcf003f730 0x7efcf005fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:49.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.092+0000 7efd26842640 10 monclient: get_auth_request con 0x7efcf003f730 auth_method 0 2026-02-12T18:08:49.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.092+0000 7efd26041640 10 monclient(hunting): handle_auth_done global_id 44395 payload 824 2026-02-12T18:08:49.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.093+0000 7efd26041640 1 -- 10.20.193.48:0/2452286084 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efd2008a7a0 con 0x7efd20135790 2026-02-12T18:08:49.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.095+0000 7efd26842640 1 --2- 10.20.193.48:0/2452286084 >> v2:10.20.193.111:6812/977811348 conn(0x7efcf003f730 0x7efcf005fbe0 secure :-1 s=READY pgs=203 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd1c00a830 tx=0x7efd1c034000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:49.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.095+0000 7efd26041640 1 -- 10.20.193.48:0/2452286084 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd20135790 msgr2=0x7efd20154390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:49.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.095+0000 7efd26041640 1 --2- 10.20.193.48:0/2452286084 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd20135790 0x7efd20154390 secure :-1 s=READY pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd1000cad0 tx=0x7efd10007860 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:49.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.095+0000 7efd06ffd640 1 -- 10.20.193.48:0/2452286084 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7efd1000eca0 con 0x7efd20135790 2026-02-12T18:08:49.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.095+0000 7efd06ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:49.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.095+0000 7efd06ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:08:49.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.095+0000 7efd06ffd640 10 monclient: dump: 2026-02-12T18:08:49.103 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:49.103 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:49.103 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:49.103 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:49.103 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:49.103 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:49.103 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:49.103 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:49.103 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:49.103 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:49.103 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:49.103 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:49.103 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:49.103 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:49.103 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:49.104 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:49.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.095+0000 7efd06ffd640 1 -- 10.20.193.48:0/2452286084 <== mon.7 v2:10.20.193.111:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7efd1000ee00 con 0x7efd20135790 2026-02-12T18:08:49.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.095+0000 7efd06ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:08:49.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.095+0000 7efd06ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:08:49.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.095+0000 7efd06ffd640 1 -- 10.20.193.48:0/2452286084 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd20135790 msgr2=0x7efd20154390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:49.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.095+0000 7efd06ffd640 1 --2- 10.20.193.48:0/2452286084 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd20135790 0x7efd20154390 secure :-1 s=READY pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd1000cad0 tx=0x7efd10007860 comp rx=0 tx=0).stop 2026-02-12T18:08:49.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.095+0000 7efd06ffd640 1 -- 10.20.193.48:0/2452286084 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd20135790 msgr2=0x7efd20154390 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:49.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.095+0000 7efd06ffd640 1 --2- 10.20.193.48:0/2452286084 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd20135790 0x7efd20154390 secure :-1 s=CLOSED pgs=47 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd1000cad0 tx=0x7efd10007860 comp rx=0 tx=0).stop 2026-02-12T18:08:49.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.099+0000 7efd282cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:08:49.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.099+0000 7efd282cc640 1 --2- 10.20.193.48:0/2452286084 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd201548d0 0x7efd20154cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:08:49.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.099+0000 7efd282cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:08:49.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.099+0000 7efd282cc640 1 -- 10.20.193.48:0/2452286084 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7efd20050410 con 0x7efd201548d0 2026-02-12T18:08:49.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.099+0000 7efd26041640 1 --2- 10.20.193.48:0/2452286084 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd201548d0 0x7efd20154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:08:49.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.099+0000 7efd26041640 10 monclient: get_auth_request con 0x7efd201548d0 auth_method 0 2026-02-12T18:08:49.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.099+0000 7efd26041640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:08:49.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.099+0000 7efd26041640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:08:49.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.099+0000 7efd26041640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:08:49.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.099+0000 7efd26041640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:08:49.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.099+0000 7efd26041640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:08:49.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.099+0000 7efd26041640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:08:49.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.099+0000 7efd26041640 10 monclient(hunting): handle_auth_done global_id 44404 payload 824 2026-02-12T18:08:49.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.099+0000 7efd26041640 1 -- 10.20.193.48:0/2452286084 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efd20155210 con 0x7efd201548d0 2026-02-12T18:08:49.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.102+0000 7efd26041640 1 -- 10.20.193.48:0/2452286084 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd201548d0 msgr2=0x7efd20154cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:08:49.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.102+0000 7efd26041640 1 --2- 10.20.193.48:0/2452286084 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd201548d0 0x7efd20154cd0 secure :-1 s=READY pgs=48 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd10016040 tx=0x7efd10004a00 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:08:49.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.102+0000 7efd06ffd640 1 -- 10.20.193.48:0/2452286084 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7efd1001e320 con 0x7efd201548d0 2026-02-12T18:08:49.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.102+0000 7efd06ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:08:49.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.102+0000 7efd06ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:08:49.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.102+0000 7efd06ffd640 10 monclient: dump: 2026-02-12T18:08:49.106 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:08:49.106 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:08:49.106 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:49.106 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:08:49.106 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:08:49.106 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:08:49.106 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:08:49.106 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:08:49.106 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:08:49.106 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:08:49.106 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:08:49.106 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:08:49.106 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:08:49.106 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:08:49.106 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:08:49.107 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:08:49.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.102+0000 7efd06ffd640 1 -- 10.20.193.48:0/2452286084 <== mon.7 v2:10.20.193.111:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9981 (secure 0 0 0) 0x7efd10014a60 con 0x7efd201548d0 2026-02-12T18:08:49.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.102+0000 7efd06ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:08:49.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.102+0000 7efd06ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:08:49.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.102+0000 7efd06ffd640 1 -- 10.20.193.48:0/2452286084 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd201548d0 msgr2=0x7efd20154cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:49.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.102+0000 7efd06ffd640 1 --2- 10.20.193.48:0/2452286084 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd201548d0 0x7efd20154cd0 secure :-1 s=READY pgs=48 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd10016040 tx=0x7efd10004a00 comp rx=0 tx=0).stop 2026-02-12T18:08:49.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.102+0000 7efd06ffd640 1 -- 10.20.193.48:0/2452286084 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd201548d0 msgr2=0x7efd20154cd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:08:49.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.102+0000 7efd06ffd640 1 --2- 10.20.193.48:0/2452286084 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7efd201548d0 0x7efd20154cd0 secure :-1 s=CLOSED pgs=48 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd10016040 tx=0x7efd10004a00 comp rx=0 tx=0).stop 2026-02-12T18:08:49.107 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:08:49.107 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:49.107 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:49.107 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:08:49.107 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 38, 2026-02-12T18:08:49.107 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 40983, 2026-02-12T18:08:49.107 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:08:49.107 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:08:49.107 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:08:49.108 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:08:49.108 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:08:49.108 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:08:49.108 INFO:teuthology.orchestra.run.trial048.stdout: 7 2026-02-12T18:08:49.108 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:49.108 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 1, 2026-02-12T18:08:49.108 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:49.108 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:08:49.108 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:08:49.108 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:49.108 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:49.108 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:49.108 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:49.108 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:49.108 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:49.108 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:49.108 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:49.108 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:49.108 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:49.108 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:49.108 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:49.108 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:49.108 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:49.108 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:08:49.109 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:08:49.109 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:49.109 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:49.109 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:49.109 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:49.109 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:49.109 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:49.109 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:49.109 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:49.109 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:49.109 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:49.109 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:49.109 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:49.109 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:49.109 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:49.109 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.109 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:08:49.109 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:08:49.109 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:08:49.109 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:08:49.109 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:08:49.109 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:08:49.109 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:49.110 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:08:49.110 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:08:49.110 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:08:49.110 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:08:49.110 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:08:49.110 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:08:49.110 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:08:49.110 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:08:49.110 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:08:49.110 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:08:49.110 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:08:49.110 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:08:49.110 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:08:49.110 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:08:49.110 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:08:49.110 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:08:49.110 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:08:49.110 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:08:49.110 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:08:49.110 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:08:49.110 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:08:49.110 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:08:49.110 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:08:49.111 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:49.111 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:08:49.111 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.111 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:08:49.111 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.111 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:08:49.111 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:08:49.111 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:49.111 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:49.111 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.111 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:49.111 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:08:49.111 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.111 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.111 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.111 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:49.111 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:08:49.111 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.111 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:49.111 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:49.111 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.111 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:08:49.111 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:08:49.111 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:49.112 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:49.112 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:08:49.112 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:49.112 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.112 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.112 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:08:49.112 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:08:49.112 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:49.112 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:49.112 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.112 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:49.112 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:08:49.112 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.112 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.112 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.112 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:49.112 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:08:49.112 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.112 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:49.112 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:49.112 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.112 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:08:49.112 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:08:49.112 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:49.113 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:49.113 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:08:49.113 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:49.113 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.113 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.113 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:08:49.113 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:08:49.113 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:49.113 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:49.113 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.113 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:49.113 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:08:49.113 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.113 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.113 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.113 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:49.113 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:08:49.113 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.113 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:49.113 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:49.113 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.113 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:08:49.113 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:08:49.113 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:49.114 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:49.114 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:08:49.114 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:49.114 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.114 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.114 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:08:49.114 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:08:49.114 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:49.114 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:49.114 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.114 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:49.114 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:08:49.114 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.114 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.114 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.114 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:49.114 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:08:49.114 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.114 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:49.114 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:49.114 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.114 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:08:49.114 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:08:49.114 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:49.115 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:49.115 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:08:49.115 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:49.115 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.115 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.115 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:08:49.115 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:08:49.115 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:49.115 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:49.115 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.115 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:49.115 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:08:49.115 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.115 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.115 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.115 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:49.115 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:08:49.115 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.115 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:49.115 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:49.115 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.115 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:08:49.115 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:08:49.115 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:49.116 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:49.116 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:49.116 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:49.116 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.116 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.116 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:08:49.116 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:08:49.116 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:49.116 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:49.116 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.116 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:49.116 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:08:49.116 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.116 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.116 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.116 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:49.116 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:08:49.116 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.116 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:49.116 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:49.116 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.116 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:08:49.117 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:08:49.117 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:49.117 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:49.117 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:08:49.117 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:49.117 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.117 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.117 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:08:49.117 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:08:49.117 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:49.117 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:49.117 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.117 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:49.117 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:08:49.117 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.117 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.117 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.117 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:49.117 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:08:49.117 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.117 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:49.117 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:49.117 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.117 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:08:49.117 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:08:49.118 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:49.118 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:49.118 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:08:49.118 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:49.118 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.118 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.118 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:08:49.118 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:08:49.118 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:49.118 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:49.118 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.118 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:49.118 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:08:49.118 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.118 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.118 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.118 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:49.118 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:08:49.118 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.118 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:49.118 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:49.118 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.118 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:08:49.118 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:08:49.119 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:49.119 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:49.119 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:08:49.119 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:49.119 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.119 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.119 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:08:49.119 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:08:49.119 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:08:49.119 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:08:49.119 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.119 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:08:49.119 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:08:49.119 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.119 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.119 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.119 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:08:49.119 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:08:49.119 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:08:49.119 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:49.119 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:49.119 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.119 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:08:49.119 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:08:49.119 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:08:49.119 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:08:49.120 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:08:49.120 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:08:49.120 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:49.120 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:49.120 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.120 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:08:49.120 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:08:49.120 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.120 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:49.120 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:49.120 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:08:49.120 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:49.120 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:08:49.120 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:08:49.120 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:08:49.120 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:08:49.120 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:08:49.120 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:08:49.120 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:08:49.120 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:08:49.120 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:08:49.120 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:08:49.120 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:08:49.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.102+0000 7efd282cc640 1 -- 10.20.193.48:0/2452286084 >> v2:10.20.193.111:6812/977811348 conn(0x7efcf003f730 msgr2=0x7efcf005fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:49.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.102+0000 7efd282cc640 1 --2- 10.20.193.48:0/2452286084 >> v2:10.20.193.111:6812/977811348 conn(0x7efcf003f730 0x7efcf005fbe0 secure :-1 s=READY pgs=203 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd1c00a830 tx=0x7efd1c034000 comp rx=0 tx=0).stop 2026-02-12T18:08:49.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.102+0000 7efd282cc640 10 monclient: shutdown 2026-02-12T18:08:49.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.102+0000 7efd282cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:08:49.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.102+0000 7efd282cc640 1 -- 10.20.193.48:0/2452286084 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7efd200902b0 msgr2=0x7efd20134490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:08:49.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.102+0000 7efd282cc640 1 --2- 10.20.193.48:0/2452286084 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7efd200902b0 0x7efd20134490 secure :-1 s=READY pgs=261 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7efd1400b520 tx=0x7efd1400b9f0 comp rx=0 tx=0).stop 2026-02-12T18:08:49.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.102+0000 7efd26842640 1 -- 10.20.193.48:0/2452286084 reap_dead start 2026-02-12T18:08:49.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.102+0000 7efd26842640 1 -- 10.20.193.48:0/2452286084 reap_dead start 2026-02-12T18:08:49.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.103+0000 7efd282cc640 1 -- 10.20.193.48:0/2452286084 shutdown_connections 2026-02-12T18:08:49.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.103+0000 7efd282cc640 1 -- 10.20.193.48:0/2452286084 >> 10.20.193.48:0/2452286084 conn(0x7efd20054f30 msgr2=0x7efd2008df80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:08:49.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.103+0000 7efd282cc640 1 -- 10.20.193.48:0/2452286084 shutdown_connections 2026-02-12T18:08:49.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:08:49.103+0000 7efd282cc640 1 -- 10.20.193.48:0/2452286084 wait complete. 2026-02-12T18:08:49.122 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2026-02-12T18:08:49.122 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-12T18:08:50.144 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28517]: starting. 2026-02-12T18:08:50.145 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28517]: creating pool ceph_test_rados_delete_pools_parallel.trial111-28516 2026-02-12T18:08:50.145 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28517]: created object 0... 2026-02-12T18:08:50.145 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28517]: created object 25... 2026-02-12T18:08:50.145 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28517]: created object 49... 2026-02-12T18:08:50.145 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28517]: finishing. 2026-02-12T18:08:50.145 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28517]: shutting down. 2026-02-12T18:08:50.398 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28518]: starting. 2026-02-12T18:08:50.398 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28518]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-28516 2026-02-12T18:08:50.398 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28518]: shutting down. 2026-02-12T18:08:53.157 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:08:53.158 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28552]: starting. 2026-02-12T18:08:53.158 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28552]: creating pool ceph_test_rados_delete_pools_parallel.trial111-28516 2026-02-12T18:08:53.158 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28552]: created object 0... 2026-02-12T18:08:53.158 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28552]: created object 25... 2026-02-12T18:08:53.158 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28552]: created object 49... 2026-02-12T18:08:53.158 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28552]: finishing. 2026-02-12T18:08:53.158 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28552]: shutting down. 2026-02-12T18:08:53.393 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:08:53.394 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28554]: starting. 2026-02-12T18:08:53.394 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28554]: listing objects. 2026-02-12T18:08:53.394 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28554]: listed object 0... 2026-02-12T18:08:53.394 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28554]: listed object 25... 2026-02-12T18:08:53.394 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28554]: saw 50 objects 2026-02-12T18:08:53.394 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28554]: shutting down. 2026-02-12T18:08:54.105 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:08:54.105 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28553]: starting. 2026-02-12T18:08:54.105 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28553]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-28516 2026-02-12T18:08:54.105 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28553]: shutting down. 2026-02-12T18:08:54.106 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:08:54.106 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:08:54.106 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:08:54.108 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:08:56.367 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28628]: starting. 2026-02-12T18:08:56.368 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28628]: creating pool ceph_test_rados_delete_pools_parallel.trial111-28627 2026-02-12T18:08:56.368 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28628]: created object 0... 2026-02-12T18:08:56.368 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28628]: created object 25... 2026-02-12T18:08:56.368 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28628]: created object 49... 2026-02-12T18:08:56.368 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28628]: finishing. 2026-02-12T18:08:56.368 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28628]: shutting down. 2026-02-12T18:08:57.317 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28629]: starting. 2026-02-12T18:08:57.318 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28629]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-28627 2026-02-12T18:08:57.318 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28629]: shutting down. 2026-02-12T18:08:59.380 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:08:59.380 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28662]: starting. 2026-02-12T18:08:59.380 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28662]: creating pool ceph_test_rados_delete_pools_parallel.trial111-28627 2026-02-12T18:08:59.380 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28662]: created object 0... 2026-02-12T18:08:59.380 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28662]: created object 25... 2026-02-12T18:08:59.380 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28662]: created object 49... 2026-02-12T18:08:59.381 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28662]: finishing. 2026-02-12T18:08:59.381 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28662]: shutting down. 2026-02-12T18:08:59.613 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:08:59.613 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28664]: starting. 2026-02-12T18:08:59.614 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28664]: listing objects. 2026-02-12T18:08:59.614 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28664]: listed object 0... 2026-02-12T18:08:59.614 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28664]: listed object 25... 2026-02-12T18:08:59.614 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28664]: saw 50 objects 2026-02-12T18:08:59.614 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28664]: shutting down. 2026-02-12T18:09:00.329 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:00.330 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28663]: starting. 2026-02-12T18:09:00.330 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28663]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-28627 2026-02-12T18:09:00.330 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28663]: shutting down. 2026-02-12T18:09:00.330 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:00.331 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:00.331 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:09:00.333 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:09:02.401 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28738]: starting. 2026-02-12T18:09:02.401 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28738]: creating pool ceph_test_rados_delete_pools_parallel.trial111-28737 2026-02-12T18:09:02.401 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28738]: created object 0... 2026-02-12T18:09:02.401 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28738]: created object 25... 2026-02-12T18:09:02.402 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28738]: created object 49... 2026-02-12T18:09:02.402 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28738]: finishing. 2026-02-12T18:09:02.402 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28738]: shutting down. 2026-02-12T18:09:03.338 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28739]: starting. 2026-02-12T18:09:03.338 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28739]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-28737 2026-02-12T18:09:03.338 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28739]: shutting down. 2026-02-12T18:09:05.251 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:05.252 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28773]: starting. 2026-02-12T18:09:05.252 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28773]: creating pool ceph_test_rados_delete_pools_parallel.trial111-28737 2026-02-12T18:09:05.252 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28773]: created object 0... 2026-02-12T18:09:05.252 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28773]: created object 25... 2026-02-12T18:09:05.252 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28773]: created object 49... 2026-02-12T18:09:05.252 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28773]: finishing. 2026-02-12T18:09:05.252 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28773]: shutting down. 2026-02-12T18:09:05.289 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:05.289 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28775]: starting. 2026-02-12T18:09:05.289 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28775]: listing objects. 2026-02-12T18:09:05.289 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28775]: listed object 0... 2026-02-12T18:09:05.289 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28775]: listed object 25... 2026-02-12T18:09:05.289 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28775]: saw 50 objects 2026-02-12T18:09:05.289 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28775]: shutting down. 2026-02-12T18:09:06.191 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:06.192 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28774]: starting. 2026-02-12T18:09:06.192 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28774]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-28737 2026-02-12T18:09:06.192 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28774]: shutting down. 2026-02-12T18:09:06.192 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:06.193 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:06.193 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:09:06.195 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:09:11.267 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28849]: starting. 2026-02-12T18:09:11.267 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28849]: creating pool ceph_test_rados_delete_pools_parallel.trial111-28848 2026-02-12T18:09:11.267 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28849]: created object 0... 2026-02-12T18:09:11.267 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28849]: created object 25... 2026-02-12T18:09:11.267 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28849]: created object 49... 2026-02-12T18:09:11.267 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28849]: finishing. 2026-02-12T18:09:11.267 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28849]: shutting down. 2026-02-12T18:09:12.204 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28850]: starting. 2026-02-12T18:09:12.204 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28850]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-28848 2026-02-12T18:09:12.204 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28850]: shutting down. 2026-02-12T18:09:14.472 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:14.472 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28883]: starting. 2026-02-12T18:09:14.472 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28883]: creating pool ceph_test_rados_delete_pools_parallel.trial111-28848 2026-02-12T18:09:14.472 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28883]: created object 0... 2026-02-12T18:09:14.472 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28883]: created object 25... 2026-02-12T18:09:14.472 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28883]: created object 49... 2026-02-12T18:09:14.472 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28883]: finishing. 2026-02-12T18:09:14.472 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28883]: shutting down. 2026-02-12T18:09:14.504 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:14.504 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28885]: starting. 2026-02-12T18:09:14.504 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28885]: listing objects. 2026-02-12T18:09:14.504 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28885]: listed object 0... 2026-02-12T18:09:14.504 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28885]: listed object 25... 2026-02-12T18:09:14.504 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28885]: saw 50 objects 2026-02-12T18:09:14.504 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28885]: shutting down. 2026-02-12T18:09:15.218 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:15.218 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28884]: starting. 2026-02-12T18:09:15.218 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28884]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-28848 2026-02-12T18:09:15.218 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28884]: shutting down. 2026-02-12T18:09:15.219 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:15.219 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:15.219 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:09:15.221 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:09:17.281 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28959]: starting. 2026-02-12T18:09:17.281 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28959]: creating pool ceph_test_rados_delete_pools_parallel.trial111-28958 2026-02-12T18:09:17.281 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28959]: created object 0... 2026-02-12T18:09:17.281 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28959]: created object 25... 2026-02-12T18:09:17.281 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28959]: created object 49... 2026-02-12T18:09:17.281 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28959]: finishing. 2026-02-12T18:09:17.281 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[28959]: shutting down. 2026-02-12T18:09:18.225 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28960]: starting. 2026-02-12T18:09:18.225 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28960]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-28958 2026-02-12T18:09:18.225 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[28960]: shutting down. 2026-02-12T18:09:20.254 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:20.254 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28993]: starting. 2026-02-12T18:09:20.254 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28993]: creating pool ceph_test_rados_delete_pools_parallel.trial111-28958 2026-02-12T18:09:20.254 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28993]: created object 0... 2026-02-12T18:09:20.254 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28993]: created object 25... 2026-02-12T18:09:20.254 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28993]: created object 49... 2026-02-12T18:09:20.254 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28993]: finishing. 2026-02-12T18:09:20.254 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[28993]: shutting down. 2026-02-12T18:09:20.287 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:20.287 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28995]: starting. 2026-02-12T18:09:20.287 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28995]: listing objects. 2026-02-12T18:09:20.287 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28995]: listed object 0... 2026-02-12T18:09:20.287 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28995]: listed object 25... 2026-02-12T18:09:20.287 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28995]: saw 50 objects 2026-02-12T18:09:20.287 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[28995]: shutting down. 2026-02-12T18:09:21.194 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:21.195 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28994]: starting. 2026-02-12T18:09:21.195 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28994]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-28958 2026-02-12T18:09:21.195 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[28994]: shutting down. 2026-02-12T18:09:21.196 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:21.196 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:21.196 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:09:21.198 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:09:23.297 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29069]: starting. 2026-02-12T18:09:23.298 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29069]: creating pool ceph_test_rados_delete_pools_parallel.trial111-29068 2026-02-12T18:09:23.298 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29069]: created object 0... 2026-02-12T18:09:23.298 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29069]: created object 25... 2026-02-12T18:09:23.298 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29069]: created object 49... 2026-02-12T18:09:23.298 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29069]: finishing. 2026-02-12T18:09:23.298 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29069]: shutting down. 2026-02-12T18:09:24.242 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29070]: starting. 2026-02-12T18:09:24.242 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29070]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-29068 2026-02-12T18:09:24.242 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29070]: shutting down. 2026-02-12T18:09:26.485 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:26.486 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29115]: starting. 2026-02-12T18:09:26.486 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29115]: creating pool ceph_test_rados_delete_pools_parallel.trial111-29068 2026-02-12T18:09:26.486 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29115]: created object 0... 2026-02-12T18:09:26.486 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29115]: created object 25... 2026-02-12T18:09:26.486 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29115]: created object 49... 2026-02-12T18:09:26.486 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29115]: finishing. 2026-02-12T18:09:26.486 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29115]: shutting down. 2026-02-12T18:09:26.520 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:26.520 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29117]: starting. 2026-02-12T18:09:26.521 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29117]: listing objects. 2026-02-12T18:09:26.521 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29117]: listed object 0... 2026-02-12T18:09:26.521 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29117]: listed object 25... 2026-02-12T18:09:26.521 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29117]: saw 50 objects 2026-02-12T18:09:26.521 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29117]: shutting down. 2026-02-12T18:09:27.540 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:27.541 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[29116]: starting. 2026-02-12T18:09:27.541 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[29116]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-29068 2026-02-12T18:09:27.541 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[29116]: shutting down. 2026-02-12T18:09:27.542 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:27.542 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:27.542 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:09:27.544 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:09:29.611 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29191]: starting. 2026-02-12T18:09:29.612 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29191]: creating pool ceph_test_rados_delete_pools_parallel.trial111-29190 2026-02-12T18:09:29.612 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29191]: created object 0... 2026-02-12T18:09:29.612 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29191]: created object 25... 2026-02-12T18:09:29.612 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29191]: created object 49... 2026-02-12T18:09:29.612 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29191]: finishing. 2026-02-12T18:09:29.612 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29191]: shutting down. 2026-02-12T18:09:30.196 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29192]: starting. 2026-02-12T18:09:30.196 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29192]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-29190 2026-02-12T18:09:30.196 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29192]: shutting down. 2026-02-12T18:09:32.470 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:32.470 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29225]: starting. 2026-02-12T18:09:32.470 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29225]: creating pool ceph_test_rados_delete_pools_parallel.trial111-29190 2026-02-12T18:09:32.470 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29225]: created object 0... 2026-02-12T18:09:32.471 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29225]: created object 25... 2026-02-12T18:09:32.471 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29225]: created object 49... 2026-02-12T18:09:32.471 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29225]: finishing. 2026-02-12T18:09:32.471 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29225]: shutting down. 2026-02-12T18:09:32.503 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:32.503 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29227]: starting. 2026-02-12T18:09:32.503 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29227]: listing objects. 2026-02-12T18:09:32.503 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29227]: listed object 0... 2026-02-12T18:09:32.503 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29227]: listed object 25... 2026-02-12T18:09:32.503 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29227]: saw 50 objects 2026-02-12T18:09:32.503 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29227]: shutting down. 2026-02-12T18:09:33.203 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:33.203 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[29226]: starting. 2026-02-12T18:09:33.203 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[29226]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-29190 2026-02-12T18:09:33.204 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[29226]: shutting down. 2026-02-12T18:09:33.205 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:33.205 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:33.205 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:09:33.207 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:09:35.292 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29301]: starting. 2026-02-12T18:09:35.292 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29301]: creating pool ceph_test_rados_delete_pools_parallel.trial111-29300 2026-02-12T18:09:35.292 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29301]: created object 0... 2026-02-12T18:09:35.292 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29301]: created object 25... 2026-02-12T18:09:35.292 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29301]: created object 49... 2026-02-12T18:09:35.292 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29301]: finishing. 2026-02-12T18:09:35.292 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29301]: shutting down. 2026-02-12T18:09:36.221 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29302]: starting. 2026-02-12T18:09:36.222 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29302]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-29300 2026-02-12T18:09:36.222 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29302]: shutting down. 2026-02-12T18:09:38.300 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:38.300 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29336]: starting. 2026-02-12T18:09:38.300 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29336]: creating pool ceph_test_rados_delete_pools_parallel.trial111-29300 2026-02-12T18:09:38.300 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29336]: created object 0... 2026-02-12T18:09:38.300 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29336]: created object 25... 2026-02-12T18:09:38.300 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29336]: created object 49... 2026-02-12T18:09:38.300 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29336]: finishing. 2026-02-12T18:09:38.300 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29336]: shutting down. 2026-02-12T18:09:38.332 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:38.332 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29338]: starting. 2026-02-12T18:09:38.332 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29338]: listing objects. 2026-02-12T18:09:38.332 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29338]: listed object 0... 2026-02-12T18:09:38.332 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29338]: listed object 25... 2026-02-12T18:09:38.332 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29338]: saw 50 objects 2026-02-12T18:09:38.332 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29338]: shutting down. 2026-02-12T18:09:39.242 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:39.242 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[29337]: starting. 2026-02-12T18:09:39.242 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[29337]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-29300 2026-02-12T18:09:39.242 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[29337]: shutting down. 2026-02-12T18:09:39.243 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:39.243 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:39.243 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:09:39.245 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:09:41.262 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29412]: starting. 2026-02-12T18:09:41.262 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29412]: creating pool ceph_test_rados_delete_pools_parallel.trial111-29411 2026-02-12T18:09:41.262 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29412]: created object 0... 2026-02-12T18:09:41.262 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29412]: created object 25... 2026-02-12T18:09:41.263 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29412]: created object 49... 2026-02-12T18:09:41.263 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29412]: finishing. 2026-02-12T18:09:41.263 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29412]: shutting down. 2026-02-12T18:09:42.198 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29413]: starting. 2026-02-12T18:09:42.198 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29413]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-29411 2026-02-12T18:09:42.198 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29413]: shutting down. 2026-02-12T18:09:44.909 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:44.910 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29447]: starting. 2026-02-12T18:09:44.910 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29447]: creating pool ceph_test_rados_delete_pools_parallel.trial111-29411 2026-02-12T18:09:44.910 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29447]: created object 0... 2026-02-12T18:09:44.910 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29447]: created object 25... 2026-02-12T18:09:44.910 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29447]: created object 49... 2026-02-12T18:09:44.910 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29447]: finishing. 2026-02-12T18:09:44.910 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29447]: shutting down. 2026-02-12T18:09:44.942 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:44.943 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29449]: starting. 2026-02-12T18:09:44.943 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29449]: listing objects. 2026-02-12T18:09:44.943 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29449]: listed object 0... 2026-02-12T18:09:44.943 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29449]: listed object 25... 2026-02-12T18:09:44.943 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29449]: saw 50 objects 2026-02-12T18:09:44.943 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29449]: shutting down. 2026-02-12T18:09:45.861 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:45.861 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[29448]: starting. 2026-02-12T18:09:45.862 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[29448]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-29411 2026-02-12T18:09:45.862 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[29448]: shutting down. 2026-02-12T18:09:45.863 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:45.863 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:45.863 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:09:45.865 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:09:47.933 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29523]: starting. 2026-02-12T18:09:47.933 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29523]: creating pool ceph_test_rados_delete_pools_parallel.trial111-29522 2026-02-12T18:09:47.933 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29523]: created object 0... 2026-02-12T18:09:47.934 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29523]: created object 25... 2026-02-12T18:09:47.934 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29523]: created object 49... 2026-02-12T18:09:47.934 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29523]: finishing. 2026-02-12T18:09:47.934 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29523]: shutting down. 2026-02-12T18:09:48.864 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29524]: starting. 2026-02-12T18:09:48.865 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29524]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-29522 2026-02-12T18:09:48.865 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29524]: shutting down. 2026-02-12T18:09:50.255 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:50.255 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29557]: starting. 2026-02-12T18:09:50.255 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29557]: creating pool ceph_test_rados_delete_pools_parallel.trial111-29522 2026-02-12T18:09:50.255 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29557]: created object 0... 2026-02-12T18:09:50.255 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29557]: created object 25... 2026-02-12T18:09:50.255 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29557]: created object 49... 2026-02-12T18:09:50.256 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29557]: finishing. 2026-02-12T18:09:50.256 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29557]: shutting down. 2026-02-12T18:09:50.288 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:50.288 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29559]: starting. 2026-02-12T18:09:50.288 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29559]: listing objects. 2026-02-12T18:09:50.288 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29559]: listed object 0... 2026-02-12T18:09:50.288 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29559]: listed object 25... 2026-02-12T18:09:50.288 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29559]: saw 50 objects 2026-02-12T18:09:50.288 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29559]: shutting down. 2026-02-12T18:09:51.200 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:51.201 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[29558]: starting. 2026-02-12T18:09:51.201 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[29558]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-29522 2026-02-12T18:09:51.201 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[29558]: shutting down. 2026-02-12T18:09:51.201 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:51.201 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:51.202 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:09:51.204 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:09:53.265 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29633]: starting. 2026-02-12T18:09:53.265 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29633]: creating pool ceph_test_rados_delete_pools_parallel.trial111-29632 2026-02-12T18:09:53.265 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29633]: created object 0... 2026-02-12T18:09:53.265 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29633]: created object 25... 2026-02-12T18:09:53.265 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29633]: created object 49... 2026-02-12T18:09:53.265 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29633]: finishing. 2026-02-12T18:09:53.266 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29633]: shutting down. 2026-02-12T18:09:54.216 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29634]: starting. 2026-02-12T18:09:54.216 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29634]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-29632 2026-02-12T18:09:54.216 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29634]: shutting down. 2026-02-12T18:09:56.463 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:56.464 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29667]: starting. 2026-02-12T18:09:56.464 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29667]: creating pool ceph_test_rados_delete_pools_parallel.trial111-29632 2026-02-12T18:09:56.464 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29667]: created object 0... 2026-02-12T18:09:56.464 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29667]: created object 25... 2026-02-12T18:09:56.464 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29667]: created object 49... 2026-02-12T18:09:56.464 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29667]: finishing. 2026-02-12T18:09:56.464 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29667]: shutting down. 2026-02-12T18:09:56.984 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:56.985 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29669]: starting. 2026-02-12T18:09:56.985 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29669]: listing objects. 2026-02-12T18:09:56.985 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29669]: listed object 0... 2026-02-12T18:09:56.985 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29669]: listed object 25... 2026-02-12T18:09:56.985 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29669]: saw 50 objects 2026-02-12T18:09:56.985 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29669]: shutting down. 2026-02-12T18:09:57.408 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:57.408 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[29668]: starting. 2026-02-12T18:09:57.408 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[29668]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-29632 2026-02-12T18:09:57.408 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[29668]: shutting down. 2026-02-12T18:09:57.409 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:57.409 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:09:57.409 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:09:57.411 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:09:59.481 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29743]: starting. 2026-02-12T18:09:59.481 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29743]: creating pool ceph_test_rados_delete_pools_parallel.trial111-29742 2026-02-12T18:09:59.481 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29743]: created object 0... 2026-02-12T18:09:59.481 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29743]: created object 25... 2026-02-12T18:09:59.481 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29743]: created object 49... 2026-02-12T18:09:59.481 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29743]: finishing. 2026-02-12T18:09:59.481 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29743]: shutting down. 2026-02-12T18:10:00.198 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29744]: starting. 2026-02-12T18:10:00.198 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29744]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-29742 2026-02-12T18:10:00.198 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29744]: shutting down. 2026-02-12T18:10:02.266 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:10:02.266 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29777]: starting. 2026-02-12T18:10:02.266 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29777]: creating pool ceph_test_rados_delete_pools_parallel.trial111-29742 2026-02-12T18:10:02.266 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29777]: created object 0... 2026-02-12T18:10:02.266 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29777]: created object 25... 2026-02-12T18:10:02.266 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29777]: created object 49... 2026-02-12T18:10:02.266 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29777]: finishing. 2026-02-12T18:10:02.267 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29777]: shutting down. 2026-02-12T18:10:02.298 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:10:02.299 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29779]: starting. 2026-02-12T18:10:02.299 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29779]: listing objects. 2026-02-12T18:10:02.299 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29779]: listed object 0... 2026-02-12T18:10:02.299 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29779]: listed object 25... 2026-02-12T18:10:02.299 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29779]: saw 50 objects 2026-02-12T18:10:02.299 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29779]: shutting down. 2026-02-12T18:10:03.212 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:10:03.212 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[29778]: starting. 2026-02-12T18:10:03.212 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[29778]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-29742 2026-02-12T18:10:03.213 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[29778]: shutting down. 2026-02-12T18:10:03.213 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:10:03.213 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:10:03.213 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:10:03.216 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:10:05.281 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29855]: starting. 2026-02-12T18:10:05.281 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29855]: creating pool ceph_test_rados_delete_pools_parallel.trial111-29854 2026-02-12T18:10:05.281 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29855]: created object 0... 2026-02-12T18:10:05.281 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29855]: created object 25... 2026-02-12T18:10:05.281 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29855]: created object 49... 2026-02-12T18:10:05.281 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29855]: finishing. 2026-02-12T18:10:05.282 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29855]: shutting down. 2026-02-12T18:10:06.224 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29856]: starting. 2026-02-12T18:10:06.224 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29856]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-29854 2026-02-12T18:10:06.224 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29856]: shutting down. 2026-02-12T18:10:08.286 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:10:08.287 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29889]: starting. 2026-02-12T18:10:08.287 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29889]: creating pool ceph_test_rados_delete_pools_parallel.trial111-29854 2026-02-12T18:10:08.287 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29889]: created object 0... 2026-02-12T18:10:08.287 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29889]: created object 25... 2026-02-12T18:10:08.287 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29889]: created object 49... 2026-02-12T18:10:08.287 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29889]: finishing. 2026-02-12T18:10:08.287 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29889]: shutting down. 2026-02-12T18:10:08.319 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:10:08.319 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29891]: starting. 2026-02-12T18:10:08.319 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29891]: listing objects. 2026-02-12T18:10:08.319 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29891]: listed object 0... 2026-02-12T18:10:08.320 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29891]: listed object 25... 2026-02-12T18:10:08.320 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29891]: saw 50 objects 2026-02-12T18:10:08.320 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[29891]: shutting down. 2026-02-12T18:10:09.238 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:10:09.238 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[29890]: starting. 2026-02-12T18:10:09.238 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[29890]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-29854 2026-02-12T18:10:09.238 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[29890]: shutting down. 2026-02-12T18:10:09.239 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:10:09.239 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:10:09.239 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:10:09.241 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:10:11.268 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29965]: starting. 2026-02-12T18:10:11.268 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29965]: creating pool ceph_test_rados_delete_pools_parallel.trial111-29964 2026-02-12T18:10:11.269 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29965]: created object 0... 2026-02-12T18:10:11.269 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29965]: created object 25... 2026-02-12T18:10:11.269 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29965]: created object 49... 2026-02-12T18:10:11.269 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29965]: finishing. 2026-02-12T18:10:11.269 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[29965]: shutting down. 2026-02-12T18:10:12.202 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29966]: starting. 2026-02-12T18:10:12.202 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29966]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-29964 2026-02-12T18:10:12.202 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[29966]: shutting down. 2026-02-12T18:10:14.269 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:10:14.269 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29999]: starting. 2026-02-12T18:10:14.269 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29999]: creating pool ceph_test_rados_delete_pools_parallel.trial111-29964 2026-02-12T18:10:14.270 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29999]: created object 0... 2026-02-12T18:10:14.270 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29999]: created object 25... 2026-02-12T18:10:14.270 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29999]: created object 49... 2026-02-12T18:10:14.270 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29999]: finishing. 2026-02-12T18:10:14.270 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[29999]: shutting down. 2026-02-12T18:10:14.301 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:10:14.302 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30001]: starting. 2026-02-12T18:10:14.302 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30001]: listing objects. 2026-02-12T18:10:14.302 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30001]: listed object 0... 2026-02-12T18:10:14.302 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30001]: listed object 25... 2026-02-12T18:10:14.302 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30001]: saw 50 objects 2026-02-12T18:10:14.302 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30001]: shutting down. 2026-02-12T18:10:15.224 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:10:15.225 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[30000]: starting. 2026-02-12T18:10:15.225 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[30000]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-29964 2026-02-12T18:10:15.225 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[30000]: shutting down. 2026-02-12T18:10:15.225 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:10:15.225 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:10:15.226 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:10:15.228 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:10:17.291 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30075]: starting. 2026-02-12T18:10:17.292 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30075]: creating pool ceph_test_rados_delete_pools_parallel.trial111-30074 2026-02-12T18:10:17.292 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30075]: created object 0... 2026-02-12T18:10:17.292 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30075]: created object 25... 2026-02-12T18:10:17.292 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30075]: created object 49... 2026-02-12T18:10:17.292 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30075]: finishing. 2026-02-12T18:10:17.292 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30075]: shutting down. 2026-02-12T18:10:18.233 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[30076]: starting. 2026-02-12T18:10:18.233 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[30076]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-30074 2026-02-12T18:10:18.233 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[30076]: shutting down. 2026-02-12T18:10:19.123 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.e 2026-02-12T18:10:19.123 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.e 2026-02-12T18:10:19.123 INFO:tasks.ceph.mon.e:Restarting daemon 2026-02-12T18:10:19.124 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2026-02-12T18:10:19.137 INFO:tasks.ceph.mon.e:Started 2026-02-12T18:10:19.137 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-12T18:10:19.137 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2026-02-12T18:10:19.138 INFO:tasks.ceph.mon.c:Restarting daemon 2026-02-12T18:10:19.138 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2026-02-12T18:10:19.141 INFO:tasks.ceph.mon.c:Started 2026-02-12T18:10:19.141 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.g 2026-02-12T18:10:19.141 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.g 2026-02-12T18:10:19.141 INFO:tasks.ceph.mon.g:Restarting daemon 2026-02-12T18:10:19.141 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i g 2026-02-12T18:10:19.144 INFO:tasks.ceph.mon.g:Started 2026-02-12T18:10:19.144 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2026-02-12T18:10:19.144 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T18:10:19.203 INFO:tasks.ceph.mon.e.trial048.stderr:2026-02-12T18:10:19.202+0000 7fbedbe33c00 -1 mon.e@-1(???).log v0 log_external_backlog rewinding external_log_to from 108 -> 0 (sync_force? mon rebuild?) 2026-02-12T18:10:19.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.222+0000 7fb19a50c640 10 monclient: get_monmap_and_config 2026-02-12T18:10:19.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.222+0000 7fb19a50c640 10 monclient: build_initial_monmap 2026-02-12T18:10:19.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.222+0000 7fb19a50c640 10 monclient: monmap: 2026-02-12T18:10:19.223 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:19.223 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:19.223 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:10:19.222596+0000 2026-02-12T18:10:19.223 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:10:19.222596+0000 2026-02-12T18:10:19.223 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:19.223 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:19.223 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:10:19.224 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:10:19.224 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:19.224 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:19.224 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:19.224 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:19.224 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:19.224 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:19.224 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:19.224 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:10:19.224 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:10:19.224 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:19.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb19a50c640 1 Processor -- start 2026-02-12T18:10:19.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb19a50c640 1 -- start start 2026-02-12T18:10:19.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb19a50c640 10 monclient: init 2026-02-12T18:10:19.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb19a50c640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:19.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb19a50c640 10 monclient: _add_conns ranks=[4,10,7,9,3,5,1,8,0,6,2] 2026-02-12T18:10:19.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb19a50c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb19405dc20 0x7fb194144660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:19.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb19a50c640 10 monclient(hunting): picked mon.noname-c con 0x7fb19405dc20 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:10:19.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb19a50c640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7fb19405dff0 0x7fb19405e3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:19.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb19a50c640 10 monclient(hunting): picked mon.noname-f con 0x7fb19405dff0 addr v2:10.20.193.111:3300/0 2026-02-12T18:10:19.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb19a50c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb194089df0 0x7fb19408a240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:19.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb19a50c640 10 monclient(hunting): picked mon.noname-i con 0x7fb194089df0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:10:19.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb19a50c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:19.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb19a50c640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7fb19408b0d0 con 0x7fb19405dff0 2026-02-12T18:10:19.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb19a50c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:19.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb19a50c640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fb194093a30 con 0x7fb19405dc20 2026-02-12T18:10:19.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb19a50c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:19.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb19a50c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fb194092200 con 0x7fb194089df0 2026-02-12T18:10:19.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb19a50c640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:19.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb19a50c640 10 monclient(hunting): authenticate will time out at 857.948558s 2026-02-12T18:10:19.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb193fff640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb19405dc20 0x7fb194144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:19.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb193fff640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb19405dc20 0x7fb194144660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:51490/0 (socket says 10.20.193.48:51490) 2026-02-12T18:10:19.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb193fff640 1 -- 10.20.193.48:0/1259275186 learned_addr learned my addr 10.20.193.48:0/1259275186 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:19.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb193fff640 10 monclient(hunting): get_auth_request con 0x7fb19405dc20 auth_method 0 2026-02-12T18:10:19.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb193fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:19.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb193fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:19.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb193fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:19.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> v2:10.20.193.111:3300/0 conn(0x7fb19405dff0 0x7fb19405e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:19.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb1937fe640 10 monclient(hunting): get_auth_request con 0x7fb19405dff0 auth_method 0 2026-02-12T18:10:19.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb1937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:19.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb1937fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:19.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.223+0000 7fb1937fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:19.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.224+0000 7fb198a82640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb194089df0 0x7fb19408a240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:19.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.224+0000 7fb198a82640 10 monclient(hunting): get_auth_request con 0x7fb194089df0 auth_method 0 2026-02-12T18:10:19.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.224+0000 7fb198a82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:19.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.224+0000 7fb198a82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:19.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.224+0000 7fb198a82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:19.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.224+0000 7fb1937fe640 1 -- 10.20.193.48:0/1259275186 >> v2:10.20.193.111:3300/0 conn(0x7fb19405dff0 msgr2=0x7fb19405e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:10:19.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.224+0000 7fb1937fe640 1 -- 10.20.193.48:0/1259275186 >> v2:10.20.193.111:3300/0 conn(0x7fb19405dff0 msgr2=0x7fb19405e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:19.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.224+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> v2:10.20.193.111:3300/0 conn(0x7fb19405dff0 0x7fb19405e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:19.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.224+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> v2:10.20.193.111:3300/0 conn(0x7fb19405dff0 0x7fb19405e3e0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:19.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.224+0000 7fb193fff640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb19405dc20 msgr2=0x7fb194144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:10:19.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.224+0000 7fb193fff640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb19405dc20 msgr2=0x7fb194144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:19.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.224+0000 7fb193fff640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb19405dc20 0x7fb194144660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:19.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.224+0000 7fb193fff640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb19405dc20 0x7fb194144660 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:19.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.224+0000 7fb198a82640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb194089df0 msgr2=0x7fb19408a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-12T18:10:19.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.224+0000 7fb198a82640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb194089df0 msgr2=0x7fb19408a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:19.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.224+0000 7fb198a82640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb194089df0 0x7fb19408a240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:19.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.224+0000 7fb198a82640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb194089df0 0x7fb19408a240 unknown :-1 s=START_CONNECT pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:19.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb193fff640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb19405dc20 0x7fb194144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=8 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:19.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb193fff640 10 monclient(hunting): get_auth_request con 0x7fb19405dc20 auth_method 0 2026-02-12T18:10:19.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb193fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:19.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb193fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:19.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb193fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:19.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> v2:10.20.193.111:3300/0 conn(0x7fb19405dff0 0x7fb19405e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:19.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb1937fe640 10 monclient(hunting): get_auth_request con 0x7fb19405dff0 auth_method 0 2026-02-12T18:10:19.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb1937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:19.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb1937fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:19.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb1937fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:19.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb193fff640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb19405dc20 msgr2=0x7fb194144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:10:19.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb193fff640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb19405dc20 msgr2=0x7fb194144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:19.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb193fff640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb19405dc20 0x7fb194144660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=8 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:19.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb193fff640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb19405dc20 0x7fb194144660 unknown :-1 s=START_CONNECT pgs=0 gs=10 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:10:19.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb1937fe640 1 -- 10.20.193.48:0/1259275186 >> v2:10.20.193.111:3300/0 conn(0x7fb19405dff0 msgr2=0x7fb19405e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:10:19.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb198a82640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb194089df0 0x7fb19408a240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=9 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:19.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb1937fe640 1 -- 10.20.193.48:0/1259275186 >> v2:10.20.193.111:3300/0 conn(0x7fb19405dff0 msgr2=0x7fb19405e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:19.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> v2:10.20.193.111:3300/0 conn(0x7fb19405dff0 0x7fb19405e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=7 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:19.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> v2:10.20.193.111:3300/0 conn(0x7fb19405dff0 0x7fb19405e3e0 unknown :-1 s=START_CONNECT pgs=0 gs=11 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:10:19.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb198a82640 10 monclient(hunting): get_auth_request con 0x7fb194089df0 auth_method 0 2026-02-12T18:10:19.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb198a82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:19.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb198a82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:19.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb198a82640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:19.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb198a82640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb194089df0 msgr2=0x7fb19408a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-12T18:10:19.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb198a82640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb194089df0 msgr2=0x7fb19408a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:19.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb198a82640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb194089df0 0x7fb19408a240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=9 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:19.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.425+0000 7fb198a82640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb194089df0 0x7fb19408a240 unknown :-1 s=START_CONNECT pgs=0 gs=12 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:10:19.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.826+0000 7fb193fff640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb19405dc20 0x7fb194144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=13 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:19.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.826+0000 7fb193fff640 10 monclient(hunting): get_auth_request con 0x7fb19405dc20 auth_method 0 2026-02-12T18:10:19.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.826+0000 7fb193fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:19.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.826+0000 7fb193fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:19.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.826+0000 7fb193fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:19.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.826+0000 7fb193fff640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb19405dc20 msgr2=0x7fb194144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:10:19.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.826+0000 7fb193fff640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb19405dc20 msgr2=0x7fb194144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:19.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.826+0000 7fb193fff640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb19405dc20 0x7fb194144660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=13 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:19.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.826+0000 7fb193fff640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb19405dc20 0x7fb194144660 unknown :-1 s=START_CONNECT pgs=0 gs=14 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:10:19.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.826+0000 7fb198a82640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb194089df0 0x7fb19408a240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=15 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:19.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.826+0000 7fb198a82640 10 monclient(hunting): get_auth_request con 0x7fb194089df0 auth_method 0 2026-02-12T18:10:19.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.826+0000 7fb198a82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:19.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.826+0000 7fb198a82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:19.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.826+0000 7fb198a82640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:19.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.826+0000 7fb198a82640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb194089df0 msgr2=0x7fb19408a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:10:19.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.826+0000 7fb198a82640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb194089df0 msgr2=0x7fb19408a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:19.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.826+0000 7fb198a82640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb194089df0 0x7fb19408a240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=15 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:19.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.826+0000 7fb198a82640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb194089df0 0x7fb19408a240 unknown :-1 s=START_CONNECT pgs=0 gs=16 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:10:19.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.827+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> v2:10.20.193.111:3300/0 conn(0x7fb19405dff0 0x7fb19405e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=17 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:19.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.827+0000 7fb1937fe640 10 monclient(hunting): get_auth_request con 0x7fb19405dff0 auth_method 0 2026-02-12T18:10:19.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.827+0000 7fb1937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:19.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.827+0000 7fb1937fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:19.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.827+0000 7fb1937fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:19.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.827+0000 7fb1937fe640 1 -- 10.20.193.48:0/1259275186 >> v2:10.20.193.111:3300/0 conn(0x7fb19405dff0 msgr2=0x7fb19405e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:10:19.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.827+0000 7fb1937fe640 1 -- 10.20.193.48:0/1259275186 >> v2:10.20.193.111:3300/0 conn(0x7fb19405dff0 msgr2=0x7fb19405e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:19.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.827+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> v2:10.20.193.111:3300/0 conn(0x7fb19405dff0 0x7fb19405e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=17 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:19.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:19.827+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> v2:10.20.193.111:3300/0 conn(0x7fb19405dff0 0x7fb19405e3e0 unknown :-1 s=START_CONNECT pgs=0 gs=18 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:10:20.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.626+0000 7fb193fff640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb19405dc20 0x7fb194144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=19 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:20.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.626+0000 7fb193fff640 10 monclient(hunting): get_auth_request con 0x7fb19405dc20 auth_method 0 2026-02-12T18:10:20.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.626+0000 7fb193fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:20.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.626+0000 7fb193fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:20.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.626+0000 7fb193fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:20.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.626+0000 7fb193fff640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb19405dc20 msgr2=0x7fb194144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:10:20.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.626+0000 7fb193fff640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb19405dc20 msgr2=0x7fb194144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:20.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.626+0000 7fb193fff640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb19405dc20 0x7fb194144660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=19 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:20.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.626+0000 7fb193fff640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb19405dc20 0x7fb194144660 unknown :-1 s=START_CONNECT pgs=0 gs=20 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:10:20.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.626+0000 7fb198a82640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb194089df0 0x7fb19408a240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=21 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:20.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.626+0000 7fb198a82640 10 monclient(hunting): get_auth_request con 0x7fb194089df0 auth_method 0 2026-02-12T18:10:20.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.626+0000 7fb198a82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:20.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.626+0000 7fb198a82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:20.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.626+0000 7fb198a82640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:20.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.626+0000 7fb198a82640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb194089df0 msgr2=0x7fb19408a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:10:20.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.626+0000 7fb198a82640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb194089df0 msgr2=0x7fb19408a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:20.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.626+0000 7fb198a82640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb194089df0 0x7fb19408a240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=21 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:20.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.626+0000 7fb198a82640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb194089df0 0x7fb19408a240 unknown :-1 s=START_CONNECT pgs=0 gs=22 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:10:20.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.627+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> v2:10.20.193.111:3300/0 conn(0x7fb19405dff0 0x7fb19405e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=23 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:20.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.627+0000 7fb1937fe640 10 monclient(hunting): get_auth_request con 0x7fb19405dff0 auth_method 0 2026-02-12T18:10:20.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.627+0000 7fb1937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:20.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.627+0000 7fb1937fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:20.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.627+0000 7fb1937fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:20.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.627+0000 7fb1937fe640 1 -- 10.20.193.48:0/1259275186 >> v2:10.20.193.111:3300/0 conn(0x7fb19405dff0 msgr2=0x7fb19405e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:10:20.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.627+0000 7fb1937fe640 1 -- 10.20.193.48:0/1259275186 >> v2:10.20.193.111:3300/0 conn(0x7fb19405dff0 msgr2=0x7fb19405e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:20.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.627+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> v2:10.20.193.111:3300/0 conn(0x7fb19405dff0 0x7fb19405e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=23 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:20.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:20.627+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> v2:10.20.193.111:3300/0 conn(0x7fb19405dff0 0x7fb19405e3e0 unknown :-1 s=START_CONNECT pgs=0 gs=24 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:10:22.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb191ffb640 10 monclient(hunting): tick 2026-02-12T18:10:22.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb191ffb640 10 monclient(hunting): _check_auth_tickets 2026-02-12T18:10:22.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb191ffb640 1 monclient(hunting): continuing hunt 2026-02-12T18:10:22.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb191ffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T18:10:22.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb191ffb640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb194089df0 msgr2=0x7fb19408a240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:10:22.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb191ffb640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb194089df0 0x7fb19408a240 unknown :-1 s=START_CONNECT pgs=0 gs=22 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:22.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb191ffb640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb19405dc20 msgr2=0x7fb194144660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:10:22.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb191ffb640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb19405dc20 0x7fb194144660 unknown :-1 s=START_CONNECT pgs=0 gs=20 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:22.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb191ffb640 1 -- 10.20.193.48:0/1259275186 >> v2:10.20.193.111:3300/0 conn(0x7fb19405dff0 msgr2=0x7fb19405e3e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:10:22.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb191ffb640 1 --2- 10.20.193.48:0/1259275186 >> v2:10.20.193.111:3300/0 conn(0x7fb19405dff0 0x7fb19405e3e0 unknown :-1 s=START_CONNECT pgs=0 gs=24 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:22.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb191ffb640 10 monclient: _add_conns ranks=[5,3,8,9,6,0,2,1] 2026-02-12T18:10:22.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb191ffb640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb1700038a0 0x7fb170023ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:22.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb191ffb640 10 monclient(hunting): picked mon.noname-h con 0x7fb1700038a0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:10:22.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb191ffb640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170024240 0x7fb1700446c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:22.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb191ffb640 10 monclient(hunting): picked mon.noname-g con 0x7fb170024240 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:10:22.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb191ffb640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb170044db0 0x7fb170065230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:22.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb191ffb640 10 monclient(hunting): picked mon.noname-e con 0x7fb170044db0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:10:22.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb191ffb640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:22.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb191ffb640 1 -- 10.20.193.48:0/1259275186 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fb19408b0d0 con 0x7fb170024240 2026-02-12T18:10:22.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb191ffb640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:22.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb191ffb640 1 -- 10.20.193.48:0/1259275186 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fb194093a30 con 0x7fb1700038a0 2026-02-12T18:10:22.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb191ffb640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:22.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb191ffb640 1 -- 10.20.193.48:0/1259275186 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fb194092200 con 0x7fb170044db0 2026-02-12T18:10:22.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb191ffb640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:22.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb198a82640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb170044db0 0x7fb170065230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=26 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:22.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb198a82640 10 monclient(hunting): get_auth_request con 0x7fb170044db0 auth_method 0 2026-02-12T18:10:22.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb198a82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:22.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb198a82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:22.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb198a82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:22.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170024240 0x7fb1700446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=27 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:22.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb193fff640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb1700038a0 0x7fb170023ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=25 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:22.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb1937fe640 10 monclient(hunting): get_auth_request con 0x7fb170024240 auth_method 0 2026-02-12T18:10:22.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb1937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:22.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb1937fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:22.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb1937fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:22.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb193fff640 10 monclient(hunting): get_auth_request con 0x7fb1700038a0 auth_method 0 2026-02-12T18:10:22.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb193fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:22.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb193fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:22.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb193fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:22.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb198a82640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb170044db0 msgr2=0x7fb170065230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-12T18:10:22.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb198a82640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb170044db0 msgr2=0x7fb170065230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:22.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb198a82640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb170044db0 0x7fb170065230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=26 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:22.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb198a82640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb170044db0 0x7fb170065230 unknown :-1 s=START_CONNECT pgs=0 gs=28 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:22.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb1937fe640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170024240 msgr2=0x7fb1700446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:10:22.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb1937fe640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170024240 msgr2=0x7fb1700446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:22.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170024240 0x7fb1700446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=27 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:22.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170024240 0x7fb1700446c0 unknown :-1 s=START_CONNECT pgs=0 gs=29 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:22.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb193fff640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb1700038a0 msgr2=0x7fb170023ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:10:22.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb193fff640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb1700038a0 msgr2=0x7fb170023ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:22.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb193fff640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb1700038a0 0x7fb170023ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=25 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:22.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.222+0000 7fb193fff640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb1700038a0 0x7fb170023ce0 unknown :-1 s=START_CONNECT pgs=0 gs=30 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:22.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb198a82640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb170044db0 0x7fb170065230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=31 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:22.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb198a82640 10 monclient(hunting): get_auth_request con 0x7fb170044db0 auth_method 0 2026-02-12T18:10:22.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb198a82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:22.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb198a82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:22.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb198a82640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:22.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb198a82640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb170044db0 msgr2=0x7fb170065230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:10:22.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb198a82640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb170044db0 msgr2=0x7fb170065230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:22.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb198a82640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb170044db0 0x7fb170065230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=31 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:22.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb198a82640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb170044db0 0x7fb170065230 unknown :-1 s=START_CONNECT pgs=0 gs=34 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:10:22.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170024240 0x7fb1700446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=33 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:22.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb193fff640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb1700038a0 0x7fb170023ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=32 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:22.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb1937fe640 10 monclient(hunting): get_auth_request con 0x7fb170024240 auth_method 0 2026-02-12T18:10:22.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb1937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:22.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb1937fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:22.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb1937fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:22.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb193fff640 10 monclient(hunting): get_auth_request con 0x7fb1700038a0 auth_method 0 2026-02-12T18:10:22.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb193fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:22.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb193fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:22.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb193fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:22.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb1937fe640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170024240 msgr2=0x7fb1700446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:10:22.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb1937fe640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170024240 msgr2=0x7fb1700446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:22.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170024240 0x7fb1700446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=33 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:22.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170024240 0x7fb1700446c0 unknown :-1 s=START_CONNECT pgs=0 gs=35 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:10:22.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb193fff640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb1700038a0 msgr2=0x7fb170023ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-12T18:10:22.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb193fff640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb1700038a0 msgr2=0x7fb170023ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:22.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb193fff640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb1700038a0 0x7fb170023ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=32 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:22.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.423+0000 7fb193fff640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb1700038a0 0x7fb170023ce0 unknown :-1 s=START_CONNECT pgs=0 gs=36 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:10:22.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.824+0000 7fb193fff640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb1700038a0 0x7fb170023ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=37 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:22.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.824+0000 7fb193fff640 10 monclient(hunting): get_auth_request con 0x7fb1700038a0 auth_method 0 2026-02-12T18:10:22.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.824+0000 7fb193fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:22.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.824+0000 7fb193fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:22.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.824+0000 7fb193fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:22.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.824+0000 7fb193fff640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb1700038a0 msgr2=0x7fb170023ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:10:22.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.824+0000 7fb193fff640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb1700038a0 msgr2=0x7fb170023ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:22.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.824+0000 7fb193fff640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb1700038a0 0x7fb170023ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=37 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:22.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.824+0000 7fb193fff640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb1700038a0 0x7fb170023ce0 unknown :-1 s=START_CONNECT pgs=0 gs=38 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:10:22.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.824+0000 7fb198a82640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb170044db0 0x7fb170065230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=39 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:22.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.824+0000 7fb198a82640 10 monclient(hunting): get_auth_request con 0x7fb170044db0 auth_method 0 2026-02-12T18:10:22.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.824+0000 7fb198a82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:22.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.824+0000 7fb198a82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:22.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.824+0000 7fb198a82640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:22.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.824+0000 7fb198a82640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb170044db0 msgr2=0x7fb170065230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:10:22.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.824+0000 7fb198a82640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb170044db0 msgr2=0x7fb170065230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:22.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.824+0000 7fb198a82640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb170044db0 0x7fb170065230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=39 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:22.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.824+0000 7fb198a82640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb170044db0 0x7fb170065230 unknown :-1 s=START_CONNECT pgs=0 gs=40 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:10:22.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.825+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170024240 0x7fb1700446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=41 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:22.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.825+0000 7fb1937fe640 10 monclient(hunting): get_auth_request con 0x7fb170024240 auth_method 0 2026-02-12T18:10:22.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.825+0000 7fb1937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:22.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.825+0000 7fb1937fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:22.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.825+0000 7fb1937fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:22.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.825+0000 7fb1937fe640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170024240 msgr2=0x7fb1700446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:10:22.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.825+0000 7fb1937fe640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170024240 msgr2=0x7fb1700446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:22.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.825+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170024240 0x7fb1700446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=41 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:22.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:22.825+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170024240 0x7fb1700446c0 unknown :-1 s=START_CONNECT pgs=0 gs=42 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:10:23.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.625+0000 7fb193fff640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb1700038a0 0x7fb170023ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=43 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:23.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.625+0000 7fb193fff640 10 monclient(hunting): get_auth_request con 0x7fb1700038a0 auth_method 0 2026-02-12T18:10:23.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.625+0000 7fb193fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:23.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.625+0000 7fb193fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:23.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.625+0000 7fb193fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:23.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.625+0000 7fb198a82640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb170044db0 0x7fb170065230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=44 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:23.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.625+0000 7fb198a82640 10 monclient(hunting): get_auth_request con 0x7fb170044db0 auth_method 0 2026-02-12T18:10:23.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.625+0000 7fb198a82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:23.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.625+0000 7fb198a82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:23.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.625+0000 7fb198a82640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:23.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.625+0000 7fb198a82640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb170044db0 msgr2=0x7fb170065230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:10:23.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.625+0000 7fb198a82640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb170044db0 msgr2=0x7fb170065230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:23.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.625+0000 7fb198a82640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb170044db0 0x7fb170065230 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=44 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:23.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.625+0000 7fb198a82640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb170044db0 0x7fb170065230 unknown :-1 s=START_CONNECT pgs=0 gs=45 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:10:23.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.625+0000 7fb193fff640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb1700038a0 msgr2=0x7fb170023ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:10:23.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.625+0000 7fb193fff640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb1700038a0 msgr2=0x7fb170023ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:23.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.625+0000 7fb193fff640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb1700038a0 0x7fb170023ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=43 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:23.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.625+0000 7fb193fff640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb1700038a0 0x7fb170023ce0 unknown :-1 s=START_CONNECT pgs=0 gs=46 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:10:23.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.626+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170024240 0x7fb1700446c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=47 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:23.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.626+0000 7fb1937fe640 10 monclient(hunting): get_auth_request con 0x7fb170024240 auth_method 0 2026-02-12T18:10:23.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.626+0000 7fb1937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:23.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.626+0000 7fb1937fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:23.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.626+0000 7fb1937fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:23.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.626+0000 7fb1937fe640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170024240 msgr2=0x7fb1700446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:10:23.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.626+0000 7fb1937fe640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170024240 msgr2=0x7fb1700446c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:23.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.626+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170024240 0x7fb1700446c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=47 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:23.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:23.626+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170024240 0x7fb1700446c0 unknown :-1 s=START_CONNECT pgs=0 gs=48 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:10:25.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb191ffb640 10 monclient(hunting): tick 2026-02-12T18:10:25.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb191ffb640 10 monclient(hunting): _check_auth_tickets 2026-02-12T18:10:25.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb191ffb640 1 monclient(hunting): continuing hunt 2026-02-12T18:10:25.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb191ffb640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T18:10:25.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb191ffb640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb170044db0 msgr2=0x7fb170065230 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:10:25.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb191ffb640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb170044db0 0x7fb170065230 unknown :-1 s=START_CONNECT pgs=0 gs=45 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:25.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb191ffb640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb1700038a0 msgr2=0x7fb170023ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:10:25.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb191ffb640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb1700038a0 0x7fb170023ce0 unknown :-1 s=START_CONNECT pgs=0 gs=46 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:25.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb191ffb640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170024240 msgr2=0x7fb1700446c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:10:25.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb191ffb640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170024240 0x7fb1700446c0 unknown :-1 s=START_CONNECT pgs=0 gs=48 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:25.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb198a82640 1 -- 10.20.193.48:0/1259275186 reap_dead start 2026-02-12T18:10:25.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb198a82640 1 -- 10.20.193.48:0/1259275186 reap_dead start 2026-02-12T18:10:25.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb191ffb640 10 monclient: _add_conns ranks=[6,2,0,9,1] 2026-02-12T18:10:25.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb191ffb640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb170024630 0x7fb170003cd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:25.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb191ffb640 10 monclient(hunting): picked mon.noname-d con 0x7fb170024630 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:10:25.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb191ffb640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb170004210 0x7fb170065230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:25.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb191ffb640 10 monclient(hunting): picked mon.noname-b con 0x7fb170004210 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:10:25.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb191ffb640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fb170004620 addr v1:10.20.193.48:6789/0 2026-02-12T18:10:25.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb191ffb640 1 -- 10.20.193.48:0/1259275186 --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb194060390 con 0x7fb170004620 2026-02-12T18:10:25.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb191ffb640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:25.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb191ffb640 1 -- 10.20.193.48:0/1259275186 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fb19408b0d0 con 0x7fb170004210 2026-02-12T18:10:25.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb191ffb640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:25.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb191ffb640 1 -- 10.20.193.48:0/1259275186 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fb194093a30 con 0x7fb170024630 2026-02-12T18:10:25.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb191ffb640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:25.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb193fff640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb170024630 0x7fb170003cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=50 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:25.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb170004210 0x7fb170065230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=51 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:25.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb1937fe640 10 monclient(hunting): get_auth_request con 0x7fb170004210 auth_method 0 2026-02-12T18:10:25.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb1937fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:25.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb1937fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:25.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb1937fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:25.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb193fff640 10 monclient(hunting): get_auth_request con 0x7fb170024630 auth_method 0 2026-02-12T18:10:25.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb193fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:25.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb193fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:25.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb193fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:25.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb1937fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:25.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb1937fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:25.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb1937fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:25.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb193fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:25.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb193fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:25.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.222+0000 7fb193fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:25.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.223+0000 7fb1937fe640 10 monclient(hunting): handle_auth_done global_id 35588 payload 274 2026-02-12T18:10:25.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.223+0000 7fb1937fe640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb170024630 msgr2=0x7fb170003cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:25.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.223+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb170024630 0x7fb170003cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=50 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:25.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.223+0000 7fb1937fe640 1 -- 10.20.193.48:0/1259275186 >> v1:10.20.193.48:6789/0 conn(0x7fb170004620 legacy=0x7fb170004ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:25.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.223+0000 7fb1937fe640 10 monclient: _finish_hunting 0 2026-02-12T18:10:25.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.223+0000 7fb1937fe640 1 monclient: found mon.noname-b 2026-02-12T18:10:25.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.223+0000 7fb1937fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:25.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.223+0000 7fb1937fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:10:25.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.223+0000 7fb1937fe640 1 -- 10.20.193.48:0/1259275186 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb170007350 con 0x7fb170004210 2026-02-12T18:10:25.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.225+0000 7fb1937fe640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb170004210 msgr2=0x7fb170065230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:25.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.225+0000 7fb1937fe640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb170004210 0x7fb170065230 secure :-1 s=READY pgs=208 gs=51 cs=0 l=1 c_cookie=5628570342799279139 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1700037b0 tx=0x7fb184030650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e1cb2e7c3d98423 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:25.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.227+0000 7fb192ffd640 1 -- 10.20.193.48:0/1259275186 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb184004300 con 0x7fb170004210 2026-02-12T18:10:25.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.227+0000 7fb192ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:25.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.227+0000 7fb192ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:10:25.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.227+0000 7fb192ffd640 10 monclient: dump: 2026-02-12T18:10:25.239 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:25.239 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:25.239 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:25.239 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:25.239 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:25.239 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:25.239 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:25.239 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:25.239 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:25.239 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:25.239 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:25.239 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:25.239 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:25.240 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:25.240 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:25.240 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:25.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.227+0000 7fb192ffd640 10 monclient: _finish_auth 0 2026-02-12T18:10:25.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.227+0000 7fb192ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:10:25.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.227+0000 7fb192ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:25.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.227+0000 7fb192ffd640 1 -- 10.20.193.48:0/1259275186 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb184033050 con 0x7fb170004210 2026-02-12T18:10:25.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.227+0000 7fb192ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:25.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.227+0000 7fb19a50c640 5 monclient: authenticate success, global_id 35588 2026-02-12T18:10:25.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.227+0000 7fb192ffd640 1 -- 10.20.193.48:0/1259275186 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb1840044a0 con 0x7fb170004210 2026-02-12T18:10:25.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.227+0000 7fb19a50c640 10 monclient: get_monmap_and_config success 2026-02-12T18:10:25.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.227+0000 7fb192ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:25.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.227+0000 7fb19a50c640 4 set_mon_vals no callback set 2026-02-12T18:10:25.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.227+0000 7fb192ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:10:25.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.227+0000 7fb192ffd640 10 monclient: dump: 2026-02-12T18:10:25.241 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:25.241 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:25.241 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:25.241 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:25.241 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:25.241 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:25.241 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:25.241 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:25.241 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:25.242 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:25.242 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:25.242 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:25.242 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:25.242 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:25.242 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:25.242 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:25.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.228+0000 7fb19a50c640 10 monclient: shutdown 2026-02-12T18:10:25.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.228+0000 7fb19a50c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:25.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.228+0000 7fb19a50c640 1 -- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb170004210 msgr2=0x7fb170065230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:25.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.228+0000 7fb19a50c640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb170004210 0x7fb170065230 secure :-1 s=READY pgs=208 gs=51 cs=0 l=1 c_cookie=5628570342799279139 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1700037b0 tx=0x7fb184030650 comp rx=0 tx=0).stop 2026-02-12T18:10:25.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.228+0000 7fb19a50c640 1 -- 10.20.193.48:0/1259275186 shutdown_connections 2026-02-12T18:10:25.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.228+0000 7fb19a50c640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb170004210 0x7fb170065230 unknown :-1 s=CLOSED pgs=208 gs=51 cs=0 l=1 c_cookie=5628570342799279139 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:25.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.228+0000 7fb19a50c640 1 --2- 10.20.193.48:0/1259275186 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb170024630 0x7fb170003cd0 unknown :-1 s=CLOSED pgs=0 gs=50 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:25.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.228+0000 7fb19a50c640 1 -- 10.20.193.48:0/1259275186 >> 10.20.193.48:0/1259275186 conn(0x7fb1940546d0 msgr2=0x7fb194054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:25.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.228+0000 7fb19a50c640 1 -- 10.20.193.48:0/1259275186 shutdown_connections 2026-02-12T18:10:25.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.228+0000 7fb19a50c640 1 -- 10.20.193.48:0/1259275186 wait complete. 2026-02-12T18:10:25.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.228+0000 7fb19a50c640 10 monclient: build_initial_monmap 2026-02-12T18:10:25.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.228+0000 7fb19a50c640 10 monclient: monmap: 2026-02-12T18:10:25.243 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:25.243 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:10:25.243 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:10:25.243 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:10:25.244 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:25.244 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:25.244 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:10:25.244 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:10:25.244 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:25.244 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:25.244 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:25.244 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:25.244 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:25.244 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:25.244 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:25.244 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:25.244 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb19a50c640 1 Processor -- start 2026-02-12T18:10:25.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb19a50c640 1 -- start start 2026-02-12T18:10:25.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb19a50c640 10 monclient: init 2026-02-12T18:10:25.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb19a50c640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:25.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb19a50c640 10 monclient: _add_conns ranks=[3,7,2,4,5,0,6,1,8] 2026-02-12T18:10:25.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb19a50c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170004210 0x7fb19408b480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:25.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb19a50c640 10 monclient(hunting): picked mon.noname-g con 0x7fb170004210 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:10:25.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb19a50c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb170004620 0x7fb19408b9c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:25.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb19a50c640 10 monclient(hunting): picked mon.noname-i con 0x7fb170004620 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:10:25.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb19a50c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb170024630 0x7fb19408bf00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:25.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb19a50c640 10 monclient(hunting): picked mon.noname-b con 0x7fb170024630 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:10:25.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb19a50c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:25.245 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb19a50c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fb19408da60 con 0x7fb170024630 2026-02-12T18:10:25.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb19a50c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:25.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb19a50c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fb19408dd40 con 0x7fb170004210 2026-02-12T18:10:25.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb19a50c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:25.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb19a50c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fb1941422c0 con 0x7fb170004620 2026-02-12T18:10:25.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb19a50c640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:25.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb19a50c640 10 monclient(hunting): authenticate will time out at 863.955450s 2026-02-12T18:10:25.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb198a82640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb170024630 0x7fb19408bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:25.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb198a82640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb170024630 0x7fb19408bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:58856/0 (socket says 10.20.193.48:58856) 2026-02-12T18:10:25.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb198a82640 1 -- 10.20.193.48:0/201191674 learned_addr learned my addr 10.20.193.48:0/201191674 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:25.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb198a82640 10 monclient(hunting): get_auth_request con 0x7fb170024630 auth_method 0 2026-02-12T18:10:25.246 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb198a82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:25.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb198a82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:25.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb198a82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:25.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb198a82640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:25.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb198a82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:25.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb198a82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:25.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb193fff640 1 --2- 10.20.193.48:0/201191674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170004210 0x7fb19408b480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:25.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb193fff640 10 monclient(hunting): get_auth_request con 0x7fb170004210 auth_method 0 2026-02-12T18:10:25.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb193fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:25.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb193fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:25.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb193fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:25.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb1937fe640 1 --2- 10.20.193.48:0/201191674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb170004620 0x7fb19408b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:25.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb198a82640 10 monclient(hunting): handle_auth_done global_id 35597 payload 824 2026-02-12T18:10:25.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb193fff640 1 -- 10.20.193.48:0/201191674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170004210 msgr2=0x7fb19408b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-12T18:10:25.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb193fff640 1 -- 10.20.193.48:0/201191674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170004210 msgr2=0x7fb19408b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:10:25.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb193fff640 1 --2- 10.20.193.48:0/201191674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170004210 0x7fb19408b480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:25.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb198a82640 1 -- 10.20.193.48:0/201191674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb170004620 msgr2=0x7fb19408b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:25.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb198a82640 1 --2- 10.20.193.48:0/201191674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb170004620 0x7fb19408b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:25.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb193fff640 1 --2- 10.20.193.48:0/201191674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170004210 0x7fb19408b480 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:25.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb198a82640 1 -- 10.20.193.48:0/201191674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170004210 msgr2=0x7fb19408b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:10:25.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb198a82640 1 --2- 10.20.193.48:0/201191674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170004210 0x7fb19408b480 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:25.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb198a82640 10 monclient: _finish_hunting 0 2026-02-12T18:10:25.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb198a82640 1 monclient: found mon.noname-b 2026-02-12T18:10:25.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb198a82640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:25.248 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb198a82640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:10:25.249 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb198a82640 1 -- 10.20.193.48:0/201191674 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb18400e040 con 0x7fb170024630 2026-02-12T18:10:25.249 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb1937fe640 10 monclient: get_auth_request con 0x7fb170004620 auth_method 0 2026-02-12T18:10:25.249 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.229+0000 7fb1937fe640 1 --2- 10.20.193.48:0/201191674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb170004620 0x7fb19408b9c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-12T18:10:25.249 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.231+0000 7fb198a82640 1 -- 10.20.193.48:0/201191674 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb170024630 msgr2=0x7fb19408bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:25.249 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.231+0000 7fb198a82640 1 --2- 10.20.193.48:0/201191674 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb170024630 0x7fb19408bf00 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb194093ec0 tx=0x7fb188017740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:25.249 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb190ff9640 1 -- 10.20.193.48:0/201191674 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb18801f070 con 0x7fb170024630 2026-02-12T18:10:25.249 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb190ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:25.249 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb190ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:10:25.249 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb190ff9640 10 monclient: dump: 2026-02-12T18:10:25.249 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:25.249 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:25.249 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:25.249 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:25.250 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:25.250 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:25.250 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:25.250 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:25.250 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:25.250 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:25.250 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:25.250 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:25.250 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:25.250 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:25.250 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:25.250 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:25.251 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb190ff9640 10 monclient: _finish_auth 0 2026-02-12T18:10:25.251 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb190ff9640 10 monclient: _check_auth_tickets 2026-02-12T18:10:25.251 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb190ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:25.251 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb190ff9640 1 -- 10.20.193.48:0/201191674 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb18800d040 con 0x7fb170024630 2026-02-12T18:10:25.251 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb19a50c640 5 monclient: authenticate success, global_id 35597 2026-02-12T18:10:25.251 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb19a50c640 10 monclient: _renew_subs 2026-02-12T18:10:25.251 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb19a50c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:10:25.251 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb19a50c640 1 -- 10.20.193.48:0/201191674 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb19408d780 con 0x7fb170024630 2026-02-12T18:10:25.251 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb190ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:25.251 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb190ff9640 1 -- 10.20.193.48:0/201191674 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb188017ea0 con 0x7fb170024630 2026-02-12T18:10:25.251 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb190ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:25.252 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb190ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:10:25.252 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb1927fc640 4 set_mon_vals no callback set 2026-02-12T18:10:25.252 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb190ff9640 10 monclient: dump: 2026-02-12T18:10:25.252 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:25.252 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:25.252 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:25.252 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:25.252 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:25.252 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:25.252 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:25.252 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:25.252 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:25.252 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:25.253 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:25.253 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:25.253 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:25.253 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:25.253 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:25.253 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:25.253 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb19a50c640 10 monclient: _renew_subs 2026-02-12T18:10:25.253 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb19a50c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:10:25.253 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb19a50c640 1 -- 10.20.193.48:0/201191674 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1940915b0 con 0x7fb170024630 2026-02-12T18:10:25.253 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb190ff9640 1 -- 10.20.193.48:0/201191674 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fb1880183e0 con 0x7fb170024630 2026-02-12T18:10:25.253 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb19a50c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:25.253 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb19a50c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:25.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb19a50c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:10:25.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb19a50c640 1 -- 10.20.193.48:0/201191674 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb194092510 con 0x7fb170024630 2026-02-12T18:10:25.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb190ff9640 1 --2- 10.20.193.48:0/201191674 >> v2:10.20.193.111:6812/977811348 conn(0x7fb16403f800 0x7fb16405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:25.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.232+0000 7fb190ff9640 1 -- 10.20.193.48:0/201191674 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(206..206 src has 1..206) ==== 3897+0+0 (secure 0 0 0) 0x7fb188053f60 con 0x7fb170024630 2026-02-12T18:10:25.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.233+0000 7fb193fff640 1 --2- 10.20.193.48:0/201191674 >> v2:10.20.193.111:6812/977811348 conn(0x7fb16403f800 0x7fb16405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:25.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.233+0000 7fb193fff640 10 monclient: get_auth_request con 0x7fb16403f800 auth_method 0 2026-02-12T18:10:25.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.235+0000 7fb190ff9640 1 -- 10.20.193.48:0/201191674 <== mon.2 v2:10.20.193.48:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fb18802ab60 con 0x7fb170024630 2026-02-12T18:10:25.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.235+0000 7fb190ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:25.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.235+0000 7fb190ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:10:25.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.235+0000 7fb193fff640 1 --2- 10.20.193.48:0/201191674 >> v2:10.20.193.111:6812/977811348 conn(0x7fb16403f800 0x7fb16405fcb0 secure :-1 s=READY pgs=281 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb180004740 tx=0x7fb180008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:25.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.382+0000 7fb19a50c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T18:10:25.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.382+0000 7fb19a50c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T18:10:25.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.382+0000 7fb19a50c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:10:25.383 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.382+0000 7fb19a50c640 1 -- 10.20.193.48:0/201191674 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fb194144660 con 0x7fb170024630 2026-02-12T18:10:25.384 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.382+0000 7fb190ff9640 1 -- 10.20.193.48:0/201191674 <== mon.2 v2:10.20.193.48:3301/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3648 (secure 0 0 0) 0x7fb188028e50 con 0x7fb170024630 2026-02-12T18:10:25.384 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.382+0000 7fb190ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T18:10:25.384 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.382+0000 7fb190ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:10:25.384 INFO:teuthology.orchestra.run.trial048.stdout:{"election_epoch":40,"quorum":[0,1,2,3,5,6,7],"quorum_names":["a","f","b","g","h","d","i"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","modified":"2026-02-12T18:05:32.850777Z","created":"2026-02-12T18:05:32.850777Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3300","nonce":0},{"type":"v1","addr":"10.20.193.48:6789","nonce":0}]},"addr":"10.20.193.48:6789/0","public_addr":"10.20.193.48:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850827+0000","crush_location":[]},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3300","nonce":0},{"type":"v1","addr":"10.20.193.111:6789","nonce":0}]},"addr":"10.20.193.111:6789/0","public_addr":"10.20.193.111:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850829+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3301","nonce":0},{"type":"v1","addr":"10.20.193.48:6790","nonce":0}]},"addr":"10.20.193.48:6790/0","public_addr":"10.20.193.48:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850830+0000","crush_location":[]},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3301","nonce":0},{"type":"v1","addr":"10.20.193.111:6790","nonce":0}]},"addr":"10.20.193.111:6790/0","public_addr":"10.20.193.111:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850833+0000","crush_location":[]},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3302","nonce":0},{"type":"v1","addr":"10.20.193.48:6791","nonce":0}]},"addr":"10.20.193.48:6791/0","public_addr":"10.20.193.48:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3302","nonce":0},{"type":"v1","addr":"10.20.193.111:6791","nonce":0}]},"addr":"10.20.193.111:6791/0","public_addr":"10.20.193.111:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850834+0000","crush_location":[]},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3303","nonce":0},{"type":"v1","addr":"10.20.193.48:6792","nonce":0}]},"addr":"10.20.193.48:6792/0","public_addr":"10.20.193.48:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3303","nonce":0},{"type":"v1","addr":"10.20.193.111:6792","nonce":0}]},"addr":"10.20.193.111:6792/0","public_addr":"10.20.193.111:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850835+0000","crush_location":[]},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3304","nonce":0},{"type":"v1","addr":"10.20.193.48:6793","nonce":0}]},"addr":"10.20.193.48:6793/0","public_addr":"10.20.193.48:6793/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850832+0000","crush_location":[]}]}} 2026-02-12T18:10:25.385 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.383+0000 7fb19a50c640 1 -- 10.20.193.48:0/201191674 >> v2:10.20.193.111:6812/977811348 conn(0x7fb16403f800 msgr2=0x7fb16405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:25.385 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.383+0000 7fb19a50c640 1 --2- 10.20.193.48:0/201191674 >> v2:10.20.193.111:6812/977811348 conn(0x7fb16403f800 0x7fb16405fcb0 secure :-1 s=READY pgs=281 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb180004740 tx=0x7fb180008040 comp rx=0 tx=0).stop 2026-02-12T18:10:25.385 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.383+0000 7fb19a50c640 10 monclient: shutdown 2026-02-12T18:10:25.385 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.383+0000 7fb19a50c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:25.385 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.383+0000 7fb19a50c640 1 -- 10.20.193.48:0/201191674 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb170024630 msgr2=0x7fb19408bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:25.385 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.383+0000 7fb19a50c640 1 --2- 10.20.193.48:0/201191674 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb170024630 0x7fb19408bf00 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb194093ec0 tx=0x7fb188017740 comp rx=0 tx=0).stop 2026-02-12T18:10:25.385 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.384+0000 7fb19a50c640 1 -- 10.20.193.48:0/201191674 shutdown_connections 2026-02-12T18:10:25.385 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.384+0000 7fb19a50c640 1 --2- 10.20.193.48:0/201191674 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb170024630 0x7fb19408bf00 unknown :-1 s=CLOSED pgs=209 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:25.385 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.384+0000 7fb19a50c640 1 --2- 10.20.193.48:0/201191674 >> v2:10.20.193.111:6812/977811348 conn(0x7fb16403f800 0x7fb16405fcb0 unknown :-1 s=CLOSED pgs=281 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:25.385 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.384+0000 7fb19a50c640 1 --2- 10.20.193.48:0/201191674 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb170004620 0x7fb19408b9c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:25.385 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.384+0000 7fb19a50c640 1 --2- 10.20.193.48:0/201191674 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb170004210 0x7fb19408b480 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:25.385 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.384+0000 7fb19a50c640 1 -- 10.20.193.48:0/201191674 >> 10.20.193.48:0/201191674 conn(0x7fb1940546d0 msgr2=0x7fb194125620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:25.385 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.384+0000 7fb19a50c640 1 -- 10.20.193.48:0/201191674 shutdown_connections 2026-02-12T18:10:25.385 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:25.384+0000 7fb19a50c640 1 -- 10.20.193.48:0/201191674 wait complete. 2026-02-12T18:10:27.064 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:10:27.064 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30109]: starting. 2026-02-12T18:10:27.064 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30109]: creating pool ceph_test_rados_delete_pools_parallel.trial111-30074 2026-02-12T18:10:27.064 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30109]: created object 0... 2026-02-12T18:10:27.064 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30109]: created object 25... 2026-02-12T18:10:27.064 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30109]: created object 49... 2026-02-12T18:10:27.064 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30109]: finishing. 2026-02-12T18:10:27.064 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30109]: shutting down. 2026-02-12T18:10:27.096 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:10:27.096 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30111]: starting. 2026-02-12T18:10:27.096 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30111]: listing objects. 2026-02-12T18:10:27.097 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30111]: listed object 0... 2026-02-12T18:10:27.097 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30111]: listed object 25... 2026-02-12T18:10:27.097 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30111]: saw 50 objects 2026-02-12T18:10:27.097 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30111]: shutting down. 2026-02-12T18:10:27.261 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:10:27.261 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[30110]: starting. 2026-02-12T18:10:27.261 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[30110]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-30074 2026-02-12T18:10:27.261 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[30110]: shutting down. 2026-02-12T18:10:27.262 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:10:27.262 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:10:27.262 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:10:27.264 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:10:28.394 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T18:10:28.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.461+0000 7fefaf65b640 10 monclient: get_monmap_and_config 2026-02-12T18:10:28.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.461+0000 7fefaf65b640 10 monclient: build_initial_monmap 2026-02-12T18:10:28.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.461+0000 7fefaf65b640 10 monclient: monmap: 2026-02-12T18:10:28.464 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:28.464 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:28.464 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:10:28.462935+0000 2026-02-12T18:10:28.464 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:10:28.462935+0000 2026-02-12T18:10:28.464 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:28.464 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.464 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:10:28.464 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:10:28.464 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:28.464 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:28.464 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:28.465 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:28.465 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:28.465 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:28.465 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:28.465 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:10:28.465 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:10:28.465 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefaf65b640 1 Processor -- start 2026-02-12T18:10:28.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefaf65b640 1 -- start start 2026-02-12T18:10:28.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefaf65b640 10 monclient: init 2026-02-12T18:10:28.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefaf65b640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:28.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefaf65b640 10 monclient: _add_conns ranks=[3,8,6,4,7,1,5,0,2,10,9] 2026-02-12T18:10:28.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefaf65b640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fefa805cb90 0x7fefa8144130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefaf65b640 10 monclient(hunting): picked mon.noname-g con 0x7fefa805cb90 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:10:28.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefaf65b640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fefa8144670 0x7fefa8144a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefaf65b640 10 monclient(hunting): picked mon.noname-e con 0x7fefa8144670 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:10:28.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefaf65b640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fefa8095890 0x7fefa8095ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefaf65b640 10 monclient(hunting): picked mon.noname-d con 0x7fefa8095890 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:10:28.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefaf65b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefaf65b640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fefa805e8d0 con 0x7fefa805cb90 2026-02-12T18:10:28.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefaf65b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefaf65b640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fefa8144fc0 con 0x7fefa8095890 2026-02-12T18:10:28.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefaf65b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefaf65b640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fefa8092370 con 0x7fefa8144670 2026-02-12T18:10:28.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefaf65b640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:28.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefaf65b640 10 monclient(hunting): authenticate will time out at 867.188785s 2026-02-12T18:10:28.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefadbd1640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fefa8095890 0x7fefa8095ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefacbcf640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fefa8144670 0x7fefa8144a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefacbcf640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fefa8144670 0x7fefa8144a80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:56950/0 (socket says 10.20.193.48:56950) 2026-02-12T18:10:28.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefacbcf640 1 -- 10.20.193.48:0/3174765991 learned_addr learned my addr 10.20.193.48:0/3174765991 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:28.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefadbd1640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fefa8095890 0x7fefa8095ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:36588/0 (socket says 10.20.193.48:36588) 2026-02-12T18:10:28.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefacbcf640 10 monclient(hunting): get_auth_request con 0x7fefa8144670 auth_method 0 2026-02-12T18:10:28.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefacbcf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefacbcf640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefacbcf640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefadbd1640 10 monclient(hunting): get_auth_request con 0x7fefa8095890 auth_method 0 2026-02-12T18:10:28.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefadbd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefadbd1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.462+0000 7fefadbd1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.463+0000 7fefadbd1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:28.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.463+0000 7fefadbd1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:28.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.463+0000 7fefacbcf640 1 -- 10.20.193.48:0/3174765991 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fefa8144670 msgr2=0x7fefa8144a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:10:28.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.463+0000 7fefad3d0640 1 --2- 10.20.193.48:0/3174765991 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fefa805cb90 0x7fefa8144130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.463+0000 7fefacbcf640 1 -- 10.20.193.48:0/3174765991 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fefa8144670 msgr2=0x7fefa8144a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:28.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.463+0000 7fefacbcf640 1 --2- 10.20.193.48:0/3174765991 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fefa8144670 0x7fefa8144a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:28.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.463+0000 7fefadbd1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:28.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.463+0000 7fefad3d0640 10 monclient(hunting): get_auth_request con 0x7fefa805cb90 auth_method 0 2026-02-12T18:10:28.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.463+0000 7fefad3d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.463+0000 7fefad3d0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.463+0000 7fefad3d0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.463+0000 7fefacbcf640 1 --2- 10.20.193.48:0/3174765991 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fefa8144670 0x7fefa8144a80 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:28.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.463+0000 7fefadbd1640 10 monclient(hunting): handle_auth_done global_id 5478 payload 274 2026-02-12T18:10:28.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.463+0000 7fefadbd1640 1 -- 10.20.193.48:0/3174765991 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fefa8144670 msgr2=0x7fefa8144a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:10:28.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.463+0000 7fefadbd1640 1 --2- 10.20.193.48:0/3174765991 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fefa8144670 0x7fefa8144a80 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.463+0000 7fefadbd1640 1 -- 10.20.193.48:0/3174765991 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fefa805cb90 msgr2=0x7fefa8144130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:28.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.463+0000 7fefadbd1640 1 --2- 10.20.193.48:0/3174765991 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fefa805cb90 0x7fefa8144130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.463+0000 7fefadbd1640 10 monclient: _finish_hunting 0 2026-02-12T18:10:28.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.463+0000 7fefadbd1640 1 monclient: found mon.noname-d 2026-02-12T18:10:28.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.463+0000 7fefadbd1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:28.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.463+0000 7fefadbd1640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:10:28.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.463+0000 7fefadbd1640 1 -- 10.20.193.48:0/3174765991 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa8060390 con 0x7fefa8095890 2026-02-12T18:10:28.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.465+0000 7fefadbd1640 1 -- 10.20.193.48:0/3174765991 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fefa8095890 msgr2=0x7fefa8095ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:28.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.465+0000 7fefadbd1640 1 --2- 10.20.193.48:0/3174765991 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fefa8095890 0x7fefa8095ce0 secure :-1 s=READY pgs=187 gs=1 cs=0 l=1 c_cookie=535182760518298686 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefa400a940 tx=0x7fefa402fe80 comp rx=0 tx=0).ready entity=mon.6 client_cookie=76d59e29a9b2c3e server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:28.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.465+0000 7fef97fff640 1 -- 10.20.193.48:0/3174765991 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fefa4036340 con 0x7fefa8095890 2026-02-12T18:10:28.479 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.465+0000 7fef97fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:28.479 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.465+0000 7fef97fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:10:28.479 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.465+0000 7fef97fff640 10 monclient: dump: 2026-02-12T18:10:28.479 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:28.479 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:28.479 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.479 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.479 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:28.479 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.479 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:28.479 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:28.479 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:28.480 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:28.480 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:28.480 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:28.480 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:28.480 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:28.480 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:28.480 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.480 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.465+0000 7fef97fff640 10 monclient: _finish_auth 0 2026-02-12T18:10:28.480 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.465+0000 7fef97fff640 10 monclient: _check_auth_tickets 2026-02-12T18:10:28.480 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.465+0000 7fef97fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:28.480 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.465+0000 7fef97fff640 1 -- 10.20.193.48:0/3174765991 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa40364c0 con 0x7fefa8095890 2026-02-12T18:10:28.480 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.465+0000 7fefaf65b640 5 monclient: authenticate success, global_id 5478 2026-02-12T18:10:28.480 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.465+0000 7fefaf65b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:10:28.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.465+0000 7fef97fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:28.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.465+0000 7fef97fff640 1 -- 10.20.193.48:0/3174765991 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fefa4036af0 con 0x7fefa8095890 2026-02-12T18:10:28.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.465+0000 7fef97fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:28.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.466+0000 7fef97fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:10:28.481 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.466+0000 7fef97fff640 10 monclient: dump: 2026-02-12T18:10:28.481 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:28.481 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:28.481 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.481 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.481 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:28.481 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.481 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:28.482 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:28.482 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:28.482 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:28.482 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:28.482 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:28.482 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:28.482 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:28.482 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:28.482 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.482 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.466+0000 7fefaf65b640 10 monclient: get_monmap_and_config success 2026-02-12T18:10:28.482 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.466+0000 7fefaf65b640 4 set_mon_vals no callback set 2026-02-12T18:10:28.482 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.466+0000 7fefaf65b640 10 monclient: shutdown 2026-02-12T18:10:28.482 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.466+0000 7fefaf65b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:28.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.466+0000 7fefaf65b640 1 -- 10.20.193.48:0/3174765991 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fefa8095890 msgr2=0x7fefa8095ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:28.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.466+0000 7fefaf65b640 1 --2- 10.20.193.48:0/3174765991 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fefa8095890 0x7fefa8095ce0 secure :-1 s=READY pgs=187 gs=1 cs=0 l=1 c_cookie=535182760518298686 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefa400a940 tx=0x7fefa402fe80 comp rx=0 tx=0).stop 2026-02-12T18:10:28.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.466+0000 7fefaf65b640 1 -- 10.20.193.48:0/3174765991 shutdown_connections 2026-02-12T18:10:28.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.466+0000 7fefaf65b640 1 --2- 10.20.193.48:0/3174765991 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fefa8095890 0x7fefa8095ce0 unknown :-1 s=CLOSED pgs=187 gs=1 cs=0 l=1 c_cookie=535182760518298686 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.466+0000 7fefaf65b640 1 --2- 10.20.193.48:0/3174765991 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fefa8144670 0x7fefa8144a80 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.466+0000 7fefaf65b640 1 --2- 10.20.193.48:0/3174765991 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fefa805cb90 0x7fefa8144130 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.466+0000 7fefaf65b640 1 -- 10.20.193.48:0/3174765991 >> 10.20.193.48:0/3174765991 conn(0x7fefa80943b0 msgr2=0x7fefa80947b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:28.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.466+0000 7fefaf65b640 1 -- 10.20.193.48:0/3174765991 shutdown_connections 2026-02-12T18:10:28.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.466+0000 7fefaf65b640 1 -- 10.20.193.48:0/3174765991 wait complete. 2026-02-12T18:10:28.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.466+0000 7fefaf65b640 10 monclient: build_initial_monmap 2026-02-12T18:10:28.483 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.466+0000 7fefaf65b640 10 monclient: monmap: 2026-02-12T18:10:28.483 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:28.484 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:10:28.484 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:10:28.484 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:10:28.484 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:28.484 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.484 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:10:28.484 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:10:28.484 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:28.484 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:28.484 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:28.484 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:28.484 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:28.484 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:28.485 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:28.485 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.466+0000 7fefaf65b640 1 Processor -- start 2026-02-12T18:10:28.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.466+0000 7fefaf65b640 1 -- start start 2026-02-12T18:10:28.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.466+0000 7fefaf65b640 10 monclient: init 2026-02-12T18:10:28.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefaf65b640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:28.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefaf65b640 10 monclient: _add_conns ranks=[3,0,6,4,1,7,5,2,8] 2026-02-12T18:10:28.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefaf65b640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fefa805cb90 0x7fefa808cb90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefaf65b640 10 monclient(hunting): picked mon.noname-g con 0x7fefa805cb90 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:10:28.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefaf65b640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fefa8095890 0x7fefa808d0d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefaf65b640 10 monclient(hunting): picked mon.noname-a con 0x7fefa8095890 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:10:28.485 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefaf65b640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fefa8144670 0x7fefa8132810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefaf65b640 10 monclient(hunting): picked mon.noname-d con 0x7fefa8144670 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:10:28.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefaf65b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefaf65b640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fefa810f230 con 0x7fefa8095890 2026-02-12T18:10:28.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefaf65b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefaf65b640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fefa808a9d0 con 0x7fefa805cb90 2026-02-12T18:10:28.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefaf65b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefaf65b640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fefa810fad0 con 0x7fefa8144670 2026-02-12T18:10:28.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefaf65b640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:28.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefaf65b640 10 monclient(hunting): authenticate will time out at 867.193198s 2026-02-12T18:10:28.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefadbd1640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fefa8144670 0x7fefa8132810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefacbcf640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fefa8095890 0x7fefa808d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.486 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefadbd1640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fefa8144670 0x7fefa8132810 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:36594/0 (socket says 10.20.193.48:36594) 2026-02-12T18:10:28.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefadbd1640 1 -- 10.20.193.48:0/2125487041 learned_addr learned my addr 10.20.193.48:0/2125487041 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:28.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefadbd1640 10 monclient(hunting): get_auth_request con 0x7fefa8144670 auth_method 0 2026-02-12T18:10:28.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefadbd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefadbd1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefadbd1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefacbcf640 10 monclient(hunting): get_auth_request con 0x7fefa8095890 auth_method 0 2026-02-12T18:10:28.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefacbcf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefacbcf640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefacbcf640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefadbd1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:28.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefadbd1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:28.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefadbd1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:28.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefad3d0640 1 --2- 10.20.193.48:0/2125487041 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fefa805cb90 0x7fefa808cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.488 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefad3d0640 10 monclient(hunting): get_auth_request con 0x7fefa805cb90 auth_method 0 2026-02-12T18:10:28.488 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefad3d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.488 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefad3d0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.488 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefad3d0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.488 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefacbcf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:28.488 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefacbcf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:28.488 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefacbcf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:28.488 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefad3d0640 1 -- 10.20.193.48:0/2125487041 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fefa805cb90 msgr2=0x7fefa808cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-12T18:10:28.488 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefadbd1640 10 monclient(hunting): handle_auth_done global_id 5487 payload 824 2026-02-12T18:10:28.488 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefad3d0640 1 -- 10.20.193.48:0/2125487041 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fefa805cb90 msgr2=0x7fefa808cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:10:28.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefad3d0640 1 --2- 10.20.193.48:0/2125487041 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fefa805cb90 0x7fefa808cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:28.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefadbd1640 1 -- 10.20.193.48:0/2125487041 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fefa805cb90 msgr2=0x7fefa808cb90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:10:28.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefad3d0640 1 --2- 10.20.193.48:0/2125487041 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fefa805cb90 0x7fefa808cb90 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:28.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefadbd1640 1 --2- 10.20.193.48:0/2125487041 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fefa805cb90 0x7fefa808cb90 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefadbd1640 1 -- 10.20.193.48:0/2125487041 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fefa8095890 msgr2=0x7fefa808d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:28.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefadbd1640 1 --2- 10.20.193.48:0/2125487041 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fefa8095890 0x7fefa808d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefadbd1640 10 monclient: _finish_hunting 0 2026-02-12T18:10:28.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefadbd1640 1 monclient: found mon.noname-d 2026-02-12T18:10:28.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefadbd1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:28.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefadbd1640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:10:28.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.467+0000 7fefadbd1640 1 -- 10.20.193.48:0/2125487041 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefa400a500 con 0x7fefa8144670 2026-02-12T18:10:28.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.469+0000 7fefadbd1640 1 -- 10.20.193.48:0/2125487041 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fefa8144670 msgr2=0x7fefa8132810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:28.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.469+0000 7fefadbd1640 1 --2- 10.20.193.48:0/2125487041 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fefa8144670 0x7fefa8132810 secure :-1 s=READY pgs=188 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefa810fc90 tx=0x7fefa4005850 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:28.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.469+0000 7fef95ffb640 1 -- 10.20.193.48:0/2125487041 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fefa40054f0 con 0x7fefa8144670 2026-02-12T18:10:28.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.469+0000 7fef95ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:28.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.469+0000 7fef95ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:10:28.490 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.469+0000 7fef95ffb640 10 monclient: dump: 2026-02-12T18:10:28.490 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:28.490 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:28.490 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.490 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.490 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:28.491 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.491 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:28.491 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:28.491 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:28.491 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:28.491 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:28.491 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:28.491 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:28.491 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:28.491 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:28.491 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.469+0000 7fef95ffb640 10 monclient: _finish_auth 0 2026-02-12T18:10:28.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.469+0000 7fef95ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:10:28.492 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.469+0000 7fef95ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:28.492 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.469+0000 7fef95ffb640 1 -- 10.20.193.48:0/2125487041 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fefa40056b0 con 0x7fefa8144670 2026-02-12T18:10:28.492 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.469+0000 7fef95ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:28.492 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.469+0000 7fef95ffb640 1 -- 10.20.193.48:0/2125487041 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fefa4004c70 con 0x7fefa8144670 2026-02-12T18:10:28.492 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.469+0000 7fefaf65b640 5 monclient: authenticate success, global_id 5487 2026-02-12T18:10:28.492 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.469+0000 7fefaf65b640 10 monclient: _renew_subs 2026-02-12T18:10:28.492 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.469+0000 7fef977fe640 4 set_mon_vals no callback set 2026-02-12T18:10:28.492 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.469+0000 7fefaf65b640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:10:28.492 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.469+0000 7fefaf65b640 1 -- 10.20.193.48:0/2125487041 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefa808a580 con 0x7fefa8144670 2026-02-12T18:10:28.492 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.469+0000 7fef95ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:28.492 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.469+0000 7fef95ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:10:28.492 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.469+0000 7fef95ffb640 10 monclient: dump: 2026-02-12T18:10:28.493 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:28.493 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:28.493 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.493 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.493 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:28.493 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.493 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:28.493 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:28.493 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:28.493 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:28.493 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:28.493 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:28.493 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:28.494 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:28.494 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:28.494 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.469+0000 7fefaf65b640 10 monclient: _renew_subs 2026-02-12T18:10:28.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.469+0000 7fefaf65b640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:10:28.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.469+0000 7fefaf65b640 1 -- 10.20.193.48:0/2125487041 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fefa810f7f0 con 0x7fefa8144670 2026-02-12T18:10:28.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.470+0000 7fefaf65b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:28.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.470+0000 7fefaf65b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:28.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.470+0000 7fefaf65b640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:10:28.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.470+0000 7fefaf65b640 1 -- 10.20.193.48:0/2125487041 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefa8056260 con 0x7fefa8144670 2026-02-12T18:10:28.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.470+0000 7fef95ffb640 1 -- 10.20.193.48:0/2125487041 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fefa40047b0 con 0x7fefa8144670 2026-02-12T18:10:28.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.470+0000 7fef95ffb640 1 --2- 10.20.193.48:0/2125487041 >> v2:10.20.193.111:6812/977811348 conn(0x7fef7803f800 0x7fef7805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.495 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.470+0000 7fef95ffb640 1 -- 10.20.193.48:0/2125487041 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(210..210 src has 1..210) ==== 3897+0+0 (secure 0 0 0) 0x7fefa4079020 con 0x7fefa8144670 2026-02-12T18:10:28.495 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.470+0000 7fefad3d0640 1 --2- 10.20.193.48:0/2125487041 >> v2:10.20.193.111:6812/977811348 conn(0x7fef7803f800 0x7fef7805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.495 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.470+0000 7fefad3d0640 10 monclient: get_auth_request con 0x7fef7803f800 auth_method 0 2026-02-12T18:10:28.495 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.473+0000 7fef95ffb640 1 -- 10.20.193.48:0/2125487041 <== mon.6 v2:10.20.193.48:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fefa8056260 con 0x7fefa8144670 2026-02-12T18:10:28.496 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.473+0000 7fef95ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:28.496 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.473+0000 7fef95ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:10:28.496 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.473+0000 7fefad3d0640 1 --2- 10.20.193.48:0/2125487041 >> v2:10.20.193.111:6812/977811348 conn(0x7fef7803f800 0x7fef7805fcb0 secure :-1 s=READY pgs=284 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef98004740 tx=0x7fef98008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:28.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.618+0000 7fefaf65b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T18:10:28.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.618+0000 7fefaf65b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T18:10:28.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.618+0000 7fefaf65b640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:10:28.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.618+0000 7fefaf65b640 1 -- 10.20.193.48:0/2125487041 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fefa8056260 con 0x7fefa8144670 2026-02-12T18:10:28.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.618+0000 7fef95ffb640 1 -- 10.20.193.48:0/2125487041 <== mon.6 v2:10.20.193.48:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3660 (secure 0 0 0) 0x7fefa8056260 con 0x7fefa8144670 2026-02-12T18:10:28.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.618+0000 7fef95ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T18:10:28.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.618+0000 7fef95ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:10:28.621 INFO:teuthology.orchestra.run.trial048.stdout:{"election_epoch":46,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","modified":"2026-02-12T18:05:32.850777Z","created":"2026-02-12T18:05:32.850777Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3300","nonce":0},{"type":"v1","addr":"10.20.193.48:6789","nonce":0}]},"addr":"10.20.193.48:6789/0","public_addr":"10.20.193.48:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850827+0000","crush_location":[]},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3300","nonce":0},{"type":"v1","addr":"10.20.193.111:6789","nonce":0}]},"addr":"10.20.193.111:6789/0","public_addr":"10.20.193.111:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850829+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3301","nonce":0},{"type":"v1","addr":"10.20.193.48:6790","nonce":0}]},"addr":"10.20.193.48:6790/0","public_addr":"10.20.193.48:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850830+0000","crush_location":[]},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3301","nonce":0},{"type":"v1","addr":"10.20.193.111:6790","nonce":0}]},"addr":"10.20.193.111:6790/0","public_addr":"10.20.193.111:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850833+0000","crush_location":[]},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3302","nonce":0},{"type":"v1","addr":"10.20.193.48:6791","nonce":0}]},"addr":"10.20.193.48:6791/0","public_addr":"10.20.193.48:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3302","nonce":0},{"type":"v1","addr":"10.20.193.111:6791","nonce":0}]},"addr":"10.20.193.111:6791/0","public_addr":"10.20.193.111:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850834+0000","crush_location":[]},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3303","nonce":0},{"type":"v1","addr":"10.20.193.48:6792","nonce":0}]},"addr":"10.20.193.48:6792/0","public_addr":"10.20.193.48:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3303","nonce":0},{"type":"v1","addr":"10.20.193.111:6792","nonce":0}]},"addr":"10.20.193.111:6792/0","public_addr":"10.20.193.111:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850835+0000","crush_location":[]},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3304","nonce":0},{"type":"v1","addr":"10.20.193.48:6793","nonce":0}]},"addr":"10.20.193.48:6793/0","public_addr":"10.20.193.48:6793/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850832+0000","crush_location":[]}]}} 2026-02-12T18:10:28.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.620+0000 7fefaf65b640 1 -- 10.20.193.48:0/2125487041 >> v2:10.20.193.111:6812/977811348 conn(0x7fef7803f800 msgr2=0x7fef7805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:28.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.620+0000 7fefaf65b640 1 --2- 10.20.193.48:0/2125487041 >> v2:10.20.193.111:6812/977811348 conn(0x7fef7803f800 0x7fef7805fcb0 secure :-1 s=READY pgs=284 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fef98004740 tx=0x7fef98008040 comp rx=0 tx=0).stop 2026-02-12T18:10:28.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.620+0000 7fefaf65b640 10 monclient: shutdown 2026-02-12T18:10:28.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.620+0000 7fefaf65b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:28.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.620+0000 7fefaf65b640 1 -- 10.20.193.48:0/2125487041 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fefa8144670 msgr2=0x7fefa8132810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:28.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.620+0000 7fefaf65b640 1 --2- 10.20.193.48:0/2125487041 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fefa8144670 0x7fefa8132810 secure :-1 s=READY pgs=188 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fefa810fc90 tx=0x7fefa4005850 comp rx=0 tx=0).stop 2026-02-12T18:10:28.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.620+0000 7fefaf65b640 1 -- 10.20.193.48:0/2125487041 shutdown_connections 2026-02-12T18:10:28.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.620+0000 7fefaf65b640 1 --2- 10.20.193.48:0/2125487041 >> v2:10.20.193.111:6812/977811348 conn(0x7fef7803f800 0x7fef7805fcb0 unknown :-1 s=CLOSED pgs=284 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.620+0000 7fefaf65b640 1 --2- 10.20.193.48:0/2125487041 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fefa8144670 0x7fefa8132810 unknown :-1 s=CLOSED pgs=188 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.620+0000 7fefaf65b640 1 --2- 10.20.193.48:0/2125487041 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fefa8095890 0x7fefa808d0d0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.620+0000 7fefaf65b640 1 --2- 10.20.193.48:0/2125487041 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fefa805cb90 0x7fefa808cb90 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.620+0000 7fefaf65b640 1 -- 10.20.193.48:0/2125487041 >> 10.20.193.48:0/2125487041 conn(0x7fefa80943b0 msgr2=0x7fefa808ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:28.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.620+0000 7fefaf65b640 1 -- 10.20.193.48:0/2125487041 shutdown_connections 2026-02-12T18:10:28.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.620+0000 7fefaf65b640 1 -- 10.20.193.48:0/2125487041 wait complete. 2026-02-12T18:10:28.629 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2026-02-12T18:10:28.629 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2026-02-12T18:10:28.630 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T18:10:28.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.695+0000 7f2112647640 10 monclient: get_monmap_and_config 2026-02-12T18:10:28.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.695+0000 7f2112647640 10 monclient: build_initial_monmap 2026-02-12T18:10:28.697 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.695+0000 7f2112647640 10 monclient: monmap: 2026-02-12T18:10:28.698 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:28.698 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:28.698 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:10:28.697010+0000 2026-02-12T18:10:28.698 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:10:28.697010+0000 2026-02-12T18:10:28.698 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:28.698 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.698 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:10:28.698 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:10:28.698 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:28.698 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:28.698 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:28.699 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:28.699 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:28.699 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:28.699 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:28.699 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:10:28.699 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:10:28.699 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f2112647640 1 Processor -- start 2026-02-12T18:10:28.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f2112647640 1 -- start start 2026-02-12T18:10:28.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f2112647640 10 monclient: init 2026-02-12T18:10:28.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f2112647640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:28.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f2112647640 10 monclient: _add_conns ranks=[9,3,5,4,10,2,1,8,7,6,0] 2026-02-12T18:10:28.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f2112647640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f210c05d550 0x7f210c05d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f2112647640 10 monclient(hunting): picked mon.noname-a con 0x7f210c05d550 addr v2:10.20.193.48:3300/0 2026-02-12T18:10:28.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f2112647640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f210c05de60 0x7f210c141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f2112647640 10 monclient(hunting): picked mon.noname-g con 0x7f210c05de60 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:10:28.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f2112647640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f210c13ef60 0x7f210c1424e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f2112647640 10 monclient(hunting): picked mon.noname-h con 0x7f210c13ef60 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:10:28.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f2112647640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f2112647640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f210c08d390 con 0x7f210c05d550 2026-02-12T18:10:28.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f2112647640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f2112647640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f210c08d5a0 con 0x7f210c05de60 2026-02-12T18:10:28.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f2112647640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f2112647640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f210c0580e0 con 0x7f210c13ef60 2026-02-12T18:10:28.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f2112647640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:28.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f2112647640 10 monclient(hunting): authenticate will time out at 867.422757s 2026-02-12T18:10:28.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f210bfff640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f210c05d550 0x7f210c05d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f210bfff640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f210c05d550 0x7f210c05d920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:58018/0 (socket says 10.20.193.48:58018) 2026-02-12T18:10:28.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f210bfff640 1 -- 10.20.193.48:0/2593883284 learned_addr learned my addr 10.20.193.48:0/2593883284 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:28.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f210bfff640 10 monclient(hunting): get_auth_request con 0x7f210c05d550 auth_method 0 2026-02-12T18:10:28.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f210bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f210bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f210bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f2110bbd640 1 --2- 10.20.193.48:0/2593883284 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f210c13ef60 0x7f210c1424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f210bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:28.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f210bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:28.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f210bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:28.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.696+0000 7f210b7fe640 1 --2- 10.20.193.48:0/2593883284 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f210c05de60 0x7f210c141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.697+0000 7f2110bbd640 10 monclient(hunting): get_auth_request con 0x7f210c13ef60 auth_method 0 2026-02-12T18:10:28.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.697+0000 7f2110bbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.697+0000 7f2110bbd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.697+0000 7f2110bbd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.697+0000 7f210b7fe640 10 monclient(hunting): get_auth_request con 0x7f210c05de60 auth_method 0 2026-02-12T18:10:28.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.697+0000 7f210b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.697+0000 7f210b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.697+0000 7f210b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.697+0000 7f2110bbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:28.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.697+0000 7f2110bbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:28.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.697+0000 7f210b7fe640 1 -- 10.20.193.48:0/2593883284 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f210c05de60 msgr2=0x7f210c141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:10:28.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.697+0000 7f210b7fe640 1 -- 10.20.193.48:0/2593883284 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f210c05de60 msgr2=0x7f210c141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:28.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.697+0000 7f210b7fe640 1 --2- 10.20.193.48:0/2593883284 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f210c05de60 0x7f210c141fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:28.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.697+0000 7f2110bbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:28.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.697+0000 7f210bfff640 10 monclient(hunting): handle_auth_done global_id 5796 payload 274 2026-02-12T18:10:28.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.697+0000 7f210b7fe640 1 --2- 10.20.193.48:0/2593883284 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f210c05de60 0x7f210c141fa0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:28.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.697+0000 7f210bfff640 1 -- 10.20.193.48:0/2593883284 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f210c13ef60 msgr2=0x7f210c1424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:28.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.697+0000 7f210bfff640 1 --2- 10.20.193.48:0/2593883284 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f210c13ef60 0x7f210c1424e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.697+0000 7f210bfff640 1 -- 10.20.193.48:0/2593883284 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f210c05de60 msgr2=0x7f210c141fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:10:28.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.697+0000 7f210bfff640 1 --2- 10.20.193.48:0/2593883284 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f210c05de60 0x7f210c141fa0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.697+0000 7f210bfff640 10 monclient: _finish_hunting 0 2026-02-12T18:10:28.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.697+0000 7f210bfff640 1 monclient: found mon.noname-a 2026-02-12T18:10:28.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.697+0000 7f210bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:28.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.697+0000 7f210bfff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:10:28.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.697+0000 7f210bfff640 1 -- 10.20.193.48:0/2593883284 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f210c04dc20 con 0x7f210c05d550 2026-02-12T18:10:28.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.699+0000 7f210bfff640 1 -- 10.20.193.48:0/2593883284 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f210c05d550 msgr2=0x7f210c05d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:28.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.699+0000 7f210bfff640 1 --2- 10.20.193.48:0/2593883284 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f210c05d550 0x7f210c05d920 secure :-1 s=READY pgs=348 gs=1 cs=0 l=1 c_cookie=3554501367689592421 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20f8009060 tx=0x7f20f802edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=315420294ec73e65 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:28.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.699+0000 7f210affd640 1 -- 10.20.193.48:0/2593883284 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f20f8035340 con 0x7f210c05d550 2026-02-12T18:10:28.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.699+0000 7f210affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:28.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.699+0000 7f210affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:10:28.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.699+0000 7f210affd640 10 monclient: dump: 2026-02-12T18:10:28.716 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:28.716 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:28.716 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.716 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.716 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:28.716 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.716 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:28.716 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:28.716 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:28.716 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:28.716 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:28.716 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:28.717 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:28.717 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:28.717 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:28.717 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.699+0000 7f210affd640 10 monclient: _finish_auth 0 2026-02-12T18:10:28.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.699+0000 7f210affd640 10 monclient: _check_auth_tickets 2026-02-12T18:10:28.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.699+0000 7f210affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:28.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.699+0000 7f210affd640 1 -- 10.20.193.48:0/2593883284 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f80354c0 con 0x7f210c05d550 2026-02-12T18:10:28.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.699+0000 7f2112647640 5 monclient: authenticate success, global_id 5796 2026-02-12T18:10:28.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.699+0000 7f2112647640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:10:28.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.699+0000 7f210affd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:28.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.700+0000 7f210affd640 1 -- 10.20.193.48:0/2593883284 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f20f8035af0 con 0x7f210c05d550 2026-02-12T18:10:28.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.700+0000 7f210affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:28.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.700+0000 7f210affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:10:28.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.700+0000 7f210affd640 10 monclient: dump: 2026-02-12T18:10:28.718 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:28.718 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:28.718 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.718 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.718 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:28.718 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.718 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:28.718 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:28.718 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:28.718 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:28.719 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:28.719 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:28.719 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:28.719 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:28.719 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:28.719 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.700+0000 7f2112647640 10 monclient: get_monmap_and_config success 2026-02-12T18:10:28.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.700+0000 7f2112647640 4 set_mon_vals no callback set 2026-02-12T18:10:28.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.700+0000 7f2112647640 10 monclient: shutdown 2026-02-12T18:10:28.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.700+0000 7f2112647640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:28.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.700+0000 7f2112647640 1 -- 10.20.193.48:0/2593883284 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f210c05d550 msgr2=0x7f210c05d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:28.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.700+0000 7f2112647640 1 --2- 10.20.193.48:0/2593883284 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f210c05d550 0x7f210c05d920 secure :-1 s=READY pgs=348 gs=1 cs=0 l=1 c_cookie=3554501367689592421 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20f8009060 tx=0x7f20f802edf0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.700+0000 7f2112647640 1 -- 10.20.193.48:0/2593883284 shutdown_connections 2026-02-12T18:10:28.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.700+0000 7f2112647640 1 --2- 10.20.193.48:0/2593883284 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f210c13ef60 0x7f210c1424e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.700+0000 7f2112647640 1 --2- 10.20.193.48:0/2593883284 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f210c05de60 0x7f210c141fa0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.700+0000 7f2112647640 1 --2- 10.20.193.48:0/2593883284 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f210c05d550 0x7f210c05d920 unknown :-1 s=CLOSED pgs=348 gs=1 cs=0 l=1 c_cookie=3554501367689592421 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.700+0000 7f2112647640 1 -- 10.20.193.48:0/2593883284 >> 10.20.193.48:0/2593883284 conn(0x7f210c0546a0 msgr2=0x7f210c054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:28.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.700+0000 7f2112647640 1 -- 10.20.193.48:0/2593883284 shutdown_connections 2026-02-12T18:10:28.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.700+0000 7f2112647640 1 -- 10.20.193.48:0/2593883284 wait complete. 2026-02-12T18:10:28.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.700+0000 7f2112647640 10 monclient: build_initial_monmap 2026-02-12T18:10:28.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.700+0000 7f2112647640 10 monclient: monmap: 2026-02-12T18:10:28.720 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:28.720 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:10:28.720 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:10:28.721 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:10:28.721 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:28.721 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.721 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:10:28.721 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:10:28.721 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:28.721 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:28.721 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:28.721 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:28.721 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:28.721 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:28.721 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:28.721 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.700+0000 7f2112647640 1 Processor -- start 2026-02-12T18:10:28.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f2112647640 1 -- start start 2026-02-12T18:10:28.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f2112647640 10 monclient: init 2026-02-12T18:10:28.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f2112647640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:28.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f2112647640 10 monclient: _add_conns ranks=[2,3,5,1,8,6,7,0,4] 2026-02-12T18:10:28.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f2112647640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f210c05d550 0x7f210c08a680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f2112647640 10 monclient(hunting): picked mon.noname-b con 0x7f210c05d550 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:10:28.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f2112647640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f210c05de60 0x7f210c08abc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f2112647640 10 monclient(hunting): picked mon.noname-g con 0x7f210c05de60 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:10:28.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f2112647640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f210c13ef60 0x7f210c08b100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f2112647640 10 monclient(hunting): picked mon.noname-h con 0x7f210c13ef60 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:10:28.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f2112647640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f2112647640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f210c10eab0 con 0x7f210c05d550 2026-02-12T18:10:28.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f2112647640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f2112647640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f210c13dcd0 con 0x7f210c05de60 2026-02-12T18:10:28.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f2112647640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f2112647640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f210c120890 con 0x7f210c13ef60 2026-02-12T18:10:28.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f2112647640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:28.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f2112647640 10 monclient(hunting): authenticate will time out at 867.427278s 2026-02-12T18:10:28.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210bfff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f210c05d550 0x7f210c08a680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210bfff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f210c05d550 0x7f210c08a680 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:58862/0 (socket says 10.20.193.48:58862) 2026-02-12T18:10:28.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210bfff640 1 -- 10.20.193.48:0/2414087872 learned_addr learned my addr 10.20.193.48:0/2414087872 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:28.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210bfff640 10 monclient(hunting): get_auth_request con 0x7f210c05d550 auth_method 0 2026-02-12T18:10:28.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:28.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:28.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:28.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f2110bbd640 1 --2- 10.20.193.48:0/2414087872 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f210c13ef60 0x7f210c08b100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f2110bbd640 10 monclient(hunting): get_auth_request con 0x7f210c13ef60 auth_method 0 2026-02-12T18:10:28.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f2110bbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f2110bbd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f2110bbd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210b7fe640 1 --2- 10.20.193.48:0/2414087872 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f210c05de60 0x7f210c08abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210b7fe640 10 monclient(hunting): get_auth_request con 0x7f210c05de60 auth_method 0 2026-02-12T18:10:28.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f2110bbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:28.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f2110bbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:28.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f2110bbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:28.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210b7fe640 1 -- 10.20.193.48:0/2414087872 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f210c05de60 msgr2=0x7f210c08abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-12T18:10:28.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210b7fe640 1 -- 10.20.193.48:0/2414087872 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f210c05de60 msgr2=0x7f210c08abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:10:28.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210b7fe640 1 --2- 10.20.193.48:0/2414087872 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f210c05de60 0x7f210c08abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:28.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210b7fe640 1 --2- 10.20.193.48:0/2414087872 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f210c05de60 0x7f210c08abc0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:28.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210bfff640 10 monclient(hunting): handle_auth_done global_id 35624 payload 824 2026-02-12T18:10:28.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210bfff640 1 -- 10.20.193.48:0/2414087872 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f210c13ef60 msgr2=0x7f210c08b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:28.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210bfff640 1 --2- 10.20.193.48:0/2414087872 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f210c13ef60 0x7f210c08b100 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210bfff640 1 -- 10.20.193.48:0/2414087872 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f210c05de60 msgr2=0x7f210c08abc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:10:28.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210bfff640 1 --2- 10.20.193.48:0/2414087872 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f210c05de60 0x7f210c08abc0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210bfff640 10 monclient: _finish_hunting 0 2026-02-12T18:10:28.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210bfff640 1 monclient: found mon.noname-b 2026-02-12T18:10:28.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:28.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:10:28.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.701+0000 7f210bfff640 1 -- 10.20.193.48:0/2414087872 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f80094f0 con 0x7f210c05d550 2026-02-12T18:10:28.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.703+0000 7f210bfff640 1 -- 10.20.193.48:0/2414087872 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f210c05d550 msgr2=0x7f210c08a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:28.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.703+0000 7f210bfff640 1 --2- 10.20.193.48:0/2414087872 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f210c05d550 0x7f210c08a680 secure :-1 s=READY pgs=211 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20f8004740 tx=0x7f20f8004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:28.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f2108ff9640 1 -- 10.20.193.48:0/2414087872 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f20f8035e00 con 0x7f210c05d550 2026-02-12T18:10:28.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f2108ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:28.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f2108ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:10:28.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f2108ff9640 10 monclient: dump: 2026-02-12T18:10:28.727 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:28.727 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:28.727 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.727 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.727 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:28.727 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.727 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:28.727 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:28.727 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:28.728 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:28.728 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:28.728 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:28.728 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:28.728 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:28.728 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:28.728 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f2108ff9640 10 monclient: _finish_auth 0 2026-02-12T18:10:28.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f2108ff9640 10 monclient: _check_auth_tickets 2026-02-12T18:10:28.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f2108ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:28.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f2108ff9640 1 -- 10.20.193.48:0/2414087872 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20f8037900 con 0x7f210c05d550 2026-02-12T18:10:28.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f2112647640 5 monclient: authenticate success, global_id 35624 2026-02-12T18:10:28.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f2112647640 10 monclient: _renew_subs 2026-02-12T18:10:28.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f2112647640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:10:28.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f2112647640 1 -- 10.20.193.48:0/2414087872 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f210c10f350 con 0x7f210c05d550 2026-02-12T18:10:28.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f2108ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:28.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f2108ff9640 1 -- 10.20.193.48:0/2414087872 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f20f8040410 con 0x7f210c05d550 2026-02-12T18:10:28.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f2108ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:28.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f210a7fc640 4 set_mon_vals no callback set 2026-02-12T18:10:28.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f2108ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:10:28.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f2108ff9640 10 monclient: dump: 2026-02-12T18:10:28.729 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:28.729 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:28.729 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.729 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.730 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:28.730 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.730 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:28.730 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:28.730 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:28.730 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:28.730 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:28.730 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:28.730 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:28.730 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:28.730 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:28.730 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f2112647640 10 monclient: _renew_subs 2026-02-12T18:10:28.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f2112647640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:10:28.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f2112647640 1 -- 10.20.193.48:0/2414087872 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f210c10dc70 con 0x7f210c05d550 2026-02-12T18:10:28.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f2112647640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:28.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f2112647640 1 --2- 10.20.193.48:0/2414087872 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f210c091010 0x7f210c08b640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f2112647640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f2112647640 1 -- 10.20.193.48:0/2414087872 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f210c05f140 con 0x7f210c091010 2026-02-12T18:10:28.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f210bfff640 1 --2- 10.20.193.48:0/2414087872 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f210c05d550 0x7f210c08a680 secure :-1 s=READY pgs=211 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20f8004740 tx=0x7f20f8004770 comp rx=0 tx=0).queue_received will delay after 1.77092e+09 on 0x7f20f8077d40 osd_map(210..210 src has 1..210) 2026-02-12T18:10:28.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f2108ff9640 1 -- 10.20.193.48:0/2414087872 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f20f8046020 con 0x7f210c05d550 2026-02-12T18:10:28.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f210b7fe640 1 --2- 10.20.193.48:0/2414087872 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f210c091010 0x7f210c08b640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f210b7fe640 10 monclient: get_auth_request con 0x7f210c091010 auth_method 0 2026-02-12T18:10:28.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f210b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f210b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f210b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f210b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:28.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f210b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:28.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f210b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:28.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.704+0000 7f2108ff9640 1 --2- 10.20.193.48:0/2414087872 >> v2:10.20.193.111:6812/977811348 conn(0x7f20dc03f800 0x7f20dc05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.705+0000 7f210b7fe640 10 monclient(hunting): handle_auth_done global_id 5805 payload 824 2026-02-12T18:10:28.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.705+0000 7f210b7fe640 1 -- 10.20.193.48:0/2414087872 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f210c10de90 con 0x7f210c091010 2026-02-12T18:10:28.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.705+0000 7f2110bbd640 1 --2- 10.20.193.48:0/2414087872 >> v2:10.20.193.111:6812/977811348 conn(0x7f20dc03f800 0x7f20dc05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.705+0000 7f2110bbd640 10 monclient: get_auth_request con 0x7f20dc03f800 auth_method 0 2026-02-12T18:10:28.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.707+0000 7f210b7fe640 1 -- 10.20.193.48:0/2414087872 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f210c091010 msgr2=0x7f210c08b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:28.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.707+0000 7f210b7fe640 1 --2- 10.20.193.48:0/2414087872 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f210c091010 0x7f210c08b640 secure :-1 s=READY pgs=349 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f210c05c7a0 tx=0x7f20fc010c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:28.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.707+0000 7f2108ff9640 1 -- 10.20.193.48:0/2414087872 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f20fc0044f0 con 0x7f210c091010 2026-02-12T18:10:28.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.707+0000 7f2108ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:28.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.707+0000 7f2108ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:10:28.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.707+0000 7f2108ff9640 10 monclient: dump: 2026-02-12T18:10:28.733 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:28.733 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:28.733 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.733 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.733 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:28.733 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.733 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:28.733 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:28.733 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:28.733 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:28.733 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:28.733 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:28.733 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:28.733 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:28.733 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:28.734 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.707+0000 7f2108ff9640 1 -- 10.20.193.48:0/2414087872 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f20fc00c050 con 0x7f210c091010 2026-02-12T18:10:28.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.707+0000 7f2108ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:28.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.707+0000 7f2108ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:10:28.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.707+0000 7f2108ff9640 1 -- 10.20.193.48:0/2414087872 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f210c091010 msgr2=0x7f210c08b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:28.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.707+0000 7f2108ff9640 1 --2- 10.20.193.48:0/2414087872 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f210c091010 0x7f210c08b640 secure :-1 s=READY pgs=349 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f210c05c7a0 tx=0x7f20fc010c30 comp rx=0 tx=0).stop 2026-02-12T18:10:28.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.707+0000 7f2108ff9640 1 -- 10.20.193.48:0/2414087872 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f210c091010 msgr2=0x7f210c08b640 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:28.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.707+0000 7f2108ff9640 1 --2- 10.20.193.48:0/2414087872 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f210c091010 0x7f210c08b640 secure :-1 s=CLOSED pgs=349 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f210c05c7a0 tx=0x7f20fc010c30 comp rx=0 tx=0).stop 2026-02-12T18:10:28.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.707+0000 7f2110bbd640 1 --2- 10.20.193.48:0/2414087872 >> v2:10.20.193.111:6812/977811348 conn(0x7f20dc03f800 0x7f20dc05fcb0 secure :-1 s=READY pgs=285 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f210c08c720 tx=0x7f210000a2d0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:28.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.711+0000 7f2112647640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:10:28.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.711+0000 7f2112647640 1 --2- 10.20.193.48:0/2414087872 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f210c13c500 0x7f210c058940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.711+0000 7f2112647640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.711+0000 7f2112647640 1 -- 10.20.193.48:0/2414087872 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f210c050410 con 0x7f210c13c500 2026-02-12T18:10:28.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.711+0000 7f210b7fe640 1 --2- 10.20.193.48:0/2414087872 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f210c13c500 0x7f210c058940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.711+0000 7f210b7fe640 10 monclient: get_auth_request con 0x7f210c13c500 auth_method 0 2026-02-12T18:10:28.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.711+0000 7f210b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.711+0000 7f210b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.711+0000 7f210b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.711+0000 7f210b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:28.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.711+0000 7f210b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:28.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.711+0000 7f210b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:28.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.711+0000 7f210b7fe640 10 monclient(hunting): handle_auth_done global_id 5814 payload 824 2026-02-12T18:10:28.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.711+0000 7f210b7fe640 1 -- 10.20.193.48:0/2414087872 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f210c057e00 con 0x7f210c13c500 2026-02-12T18:10:28.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.713+0000 7f210b7fe640 1 -- 10.20.193.48:0/2414087872 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f210c13c500 msgr2=0x7f210c058940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:28.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.713+0000 7f210b7fe640 1 --2- 10.20.193.48:0/2414087872 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f210c13c500 0x7f210c058940 secure :-1 s=READY pgs=350 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20fc004000 tx=0x7f20fc004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:28.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.713+0000 7f2108ff9640 1 -- 10.20.193.48:0/2414087872 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f20fc020650 con 0x7f210c13c500 2026-02-12T18:10:28.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.713+0000 7f2108ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:28.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.713+0000 7f2108ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:10:28.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.713+0000 7f2108ff9640 10 monclient: dump: 2026-02-12T18:10:28.737 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:28.737 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:28.738 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.738 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.738 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:28.738 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.738 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:28.738 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:28.738 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:28.738 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:28.738 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:28.738 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:28.738 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:28.738 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:28.738 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:28.738 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.714+0000 7f2108ff9640 1 -- 10.20.193.48:0/2414087872 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10184 (secure 0 0 0) 0x7f20fc0207b0 con 0x7f210c13c500 2026-02-12T18:10:28.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.714+0000 7f2108ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:10:28.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.714+0000 7f2108ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:10:28.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.714+0000 7f2108ff9640 1 -- 10.20.193.48:0/2414087872 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f210c13c500 msgr2=0x7f210c058940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:28.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.714+0000 7f2108ff9640 1 --2- 10.20.193.48:0/2414087872 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f210c13c500 0x7f210c058940 secure :-1 s=READY pgs=350 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20fc004000 tx=0x7f20fc004770 comp rx=0 tx=0).stop 2026-02-12T18:10:28.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.714+0000 7f2108ff9640 1 -- 10.20.193.48:0/2414087872 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f210c13c500 msgr2=0x7f210c058940 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:28.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.714+0000 7f2108ff9640 1 --2- 10.20.193.48:0/2414087872 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f210c13c500 0x7f210c058940 secure :-1 s=CLOSED pgs=350 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20fc004000 tx=0x7f20fc004770 comp rx=0 tx=0).stop 2026-02-12T18:10:28.739 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:10:28.739 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:10:28.739 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:10:28.739 INFO:teuthology.orchestra.run.trial048.stdout: "state": "leader", 2026-02-12T18:10:28.739 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 46, 2026-02-12T18:10:28.740 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 283548, 2026-02-12T18:10:28.740 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:10:28.740 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:10:28.740 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:10:28.740 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:10:28.740 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:10:28.740 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:10:28.740 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:10:28.740 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:10:28.740 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:10:28.740 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:10:28.740 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:28.740 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 3, 2026-02-12T18:10:28.740 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:28.740 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:10:28.740 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:10:28.740 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:28.741 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:28.741 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:28.741 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:28.741 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:28.741 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:28.741 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:28.741 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:28.741 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:28.741 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:28.741 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:28.741 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:28.741 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:28.741 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:28.741 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:10:28.741 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:10:28.741 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:28.741 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:28.742 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:28.742 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:28.742 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:28.742 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:28.742 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:28.742 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:28.742 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:28.742 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:28.742 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:28.742 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:28.742 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:28.742 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:28.742 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.742 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:10:28.742 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:10:28.742 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:10:28.742 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:10:28.742 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:10:28.743 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:10:28.743 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:28.743 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:28.743 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:10:28.743 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:10:28.743 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:10:28.743 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:10:28.743 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:10:28.743 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:10:28.743 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:10:28.743 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:28.743 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:10:28.743 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:28.743 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:28.743 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:28.743 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:28.743 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:28.743 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:28.743 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:28.744 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:28.744 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:28.744 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:28.744 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:28.744 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:28.744 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:28.744 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:28.744 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:10:28.744 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.744 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:10:28.744 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.744 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:10:28.744 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:10:28.744 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:28.744 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:28.744 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.744 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:28.744 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:10:28.744 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.744 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.745 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.745 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:28.745 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:10:28.745 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.745 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.745 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:28.745 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.745 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:10:28.745 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:10:28.745 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:28.745 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:28.745 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:10:28.745 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:28.745 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.745 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.745 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:10:28.745 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:10:28.745 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:28.745 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:28.746 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.746 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:28.746 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:10:28.746 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.746 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.746 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.746 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:28.746 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:10:28.746 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.746 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.746 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:28.746 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.746 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:10:28.746 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:10:28.746 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:28.746 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:28.746 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:10:28.746 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:28.746 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.746 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.747 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:10:28.747 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:10:28.747 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:28.747 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:28.747 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.747 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:28.747 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:10:28.747 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.747 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.747 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.747 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:28.747 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:10:28.747 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.747 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.747 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:28.747 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.747 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:10:28.747 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:10:28.747 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:28.747 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:28.748 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:10:28.748 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:28.748 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.748 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.748 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:10:28.748 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:10:28.748 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:28.748 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:28.748 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.748 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:28.748 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:10:28.748 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.748 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.748 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.748 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:28.748 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:10:28.748 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.748 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.748 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:28.748 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.748 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:10:28.749 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:10:28.749 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:28.749 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:28.749 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:10:28.749 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:28.749 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.749 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.749 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:10:28.749 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:10:28.749 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:28.749 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:28.749 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.749 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:28.749 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:10:28.749 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.749 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.749 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.749 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:28.749 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:10:28.749 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.749 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.750 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:28.750 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.750 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:10:28.750 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:10:28.750 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:28.750 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:28.750 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:28.750 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:28.750 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.750 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.750 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:10:28.750 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:10:28.750 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:28.750 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:28.750 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.750 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:28.750 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:10:28.750 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.750 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.750 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.750 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:28.750 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:10:28.751 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.751 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.751 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:28.751 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.751 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:10:28.751 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:10:28.751 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:28.751 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:28.751 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:10:28.751 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:28.751 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.751 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.751 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:10:28.751 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:10:28.751 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:28.751 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:28.751 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.751 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:28.751 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:10:28.751 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.751 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.751 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.751 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:28.752 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:10:28.752 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.752 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.752 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:28.752 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.752 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:10:28.752 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:10:28.752 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:28.752 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:28.752 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:28.752 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:28.752 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.752 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.752 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:10:28.752 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:10:28.752 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:28.752 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:28.752 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.752 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:28.752 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:10:28.752 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.752 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.753 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.753 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:28.753 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:10:28.753 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.753 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.753 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:28.753 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.753 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:10:28.753 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:10:28.753 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:28.753 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:28.753 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:10:28.753 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:28.753 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.753 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.753 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:10:28.753 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:10:28.753 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:28.753 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:28.753 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.753 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:28.753 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:10:28.753 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.753 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.753 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.754 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:28.754 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:10:28.754 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.754 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.754 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:28.754 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.754 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:10:28.754 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:10:28.754 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:28.754 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:28.754 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:10:28.754 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:28.754 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.754 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:28.754 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.754 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:10:28.754 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:10:28.754 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.754 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:28.754 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:28.754 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:28.754 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.754 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:28.754 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:10:28.754 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.755 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:28.755 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:28.755 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:28.755 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.755 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:28.755 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:10:28.755 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.755 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:28.755 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:28.755 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:28.755 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.755 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:28.755 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.755 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:10:28.755 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:10:28.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.714+0000 7f2112647640 1 -- 10.20.193.48:0/2414087872 >> v2:10.20.193.111:6812/977811348 conn(0x7f20dc03f800 msgr2=0x7f20dc05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:28.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.714+0000 7f2112647640 1 --2- 10.20.193.48:0/2414087872 >> v2:10.20.193.111:6812/977811348 conn(0x7f20dc03f800 0x7f20dc05fcb0 secure :-1 s=READY pgs=285 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f210c08c720 tx=0x7f210000a2d0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.714+0000 7f2112647640 10 monclient: shutdown 2026-02-12T18:10:28.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.714+0000 7f2112647640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:28.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.714+0000 7f2112647640 1 -- 10.20.193.48:0/2414087872 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f210c05d550 msgr2=0x7f210c08a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:28.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.714+0000 7f2112647640 1 --2- 10.20.193.48:0/2414087872 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f210c05d550 0x7f210c08a680 secure :-1 s=READY pgs=211 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f20f8004740 tx=0x7f20f8004770 comp rx=0 tx=0).stop 2026-02-12T18:10:28.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.714+0000 7f2110bbd640 1 -- 10.20.193.48:0/2414087872 reap_dead start 2026-02-12T18:10:28.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.714+0000 7f2108ff9640 1 -- 10.20.193.48:0/2414087872 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(210..210 src has 1..210) ==== 3897+0+0 (unknown 0 0 0) 0x7f20f8077d40 con 0x7f210c05d550 2026-02-12T18:10:28.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.714+0000 7f2110bbd640 1 -- 10.20.193.48:0/2414087872 reap_dead start 2026-02-12T18:10:28.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.714+0000 7f2112647640 1 -- 10.20.193.48:0/2414087872 shutdown_connections 2026-02-12T18:10:28.756 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.714+0000 7f2112647640 1 -- 10.20.193.48:0/2414087872 >> 10.20.193.48:0/2414087872 conn(0x7f210c0546a0 msgr2=0x7f210c122d00 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:28.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.714+0000 7f2112647640 1 -- 10.20.193.48:0/2414087872 shutdown_connections 2026-02-12T18:10:28.757 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.714+0000 7f2112647640 1 -- 10.20.193.48:0/2414087872 wait complete. 2026-02-12T18:10:28.757 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:10:28.757 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2026-02-12T18:10:28.757 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T18:10:28.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.821+0000 7f8768412640 10 monclient: get_monmap_and_config 2026-02-12T18:10:28.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.821+0000 7f8768412640 10 monclient: build_initial_monmap 2026-02-12T18:10:28.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.821+0000 7f8768412640 10 monclient: monmap: 2026-02-12T18:10:28.822 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:28.822 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:28.822 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:10:28.822321+0000 2026-02-12T18:10:28.822 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:10:28.822321+0000 2026-02-12T18:10:28.822 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:28.823 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.823 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:10:28.823 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:10:28.823 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:28.823 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:28.823 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:28.823 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:28.823 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:28.823 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:28.823 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:28.823 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:10:28.823 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:10:28.823 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.821+0000 7f8768412640 1 Processor -- start 2026-02-12T18:10:28.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.821+0000 7f8768412640 1 -- start start 2026-02-12T18:10:28.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.821+0000 7f8768412640 10 monclient: init 2026-02-12T18:10:28.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.821+0000 7f8768412640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:28.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.821+0000 7f8768412640 10 monclient: _add_conns ranks=[2,8,4,0,5,7,3,6,1,9,10] 2026-02-12T18:10:28.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.821+0000 7f8768412640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f876005c950 0x7f876005cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8768412640 10 monclient(hunting): picked mon.noname-b con 0x7f876005c950 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:10:28.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8768412640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f876005e490 0x7f876005d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8768412640 10 monclient(hunting): picked mon.noname-e con 0x7f876005e490 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:10:28.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8768412640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f876013db70 0x7f876013dfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8768412640 10 monclient(hunting): picked mon.noname-c con 0x7f876013db70 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:10:28.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8768412640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8768412640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f876005ddd0 con 0x7f876005c950 2026-02-12T18:10:28.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8768412640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8768412640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f876005d7a0 con 0x7f876013db70 2026-02-12T18:10:28.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8768412640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8768412640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f8760092990 con 0x7f876005e490 2026-02-12T18:10:28.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8768412640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:28.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8768412640 10 monclient(hunting): authenticate will time out at 867.548033s 2026-02-12T18:10:28.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766187640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f876005c950 0x7f876005cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8765986640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f876005e490 0x7f876005d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766988640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f876013db70 0x7f876013dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8765986640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f876005e490 0x7f876005d260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:56958/0 (socket says 10.20.193.48:56958) 2026-02-12T18:10:28.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8765986640 1 -- 10.20.193.48:0/737949521 learned_addr learned my addr 10.20.193.48:0/737949521 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:28.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766187640 10 monclient(hunting): get_auth_request con 0x7f876005c950 auth_method 0 2026-02-12T18:10:28.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766187640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766187640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766187640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766988640 10 monclient(hunting): get_auth_request con 0x7f876013db70 auth_method 0 2026-02-12T18:10:28.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766988640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766988640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766988640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8765986640 10 monclient(hunting): get_auth_request con 0x7f876005e490 auth_method 0 2026-02-12T18:10:28.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8765986640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8765986640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8765986640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766187640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:28.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766187640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:28.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766187640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:28.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8765986640 1 -- 10.20.193.48:0/737949521 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f876005e490 msgr2=0x7f876005d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:10:28.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8765986640 1 -- 10.20.193.48:0/737949521 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f876005e490 msgr2=0x7f876005d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:28.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8765986640 1 --2- 10.20.193.48:0/737949521 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f876005e490 0x7f876005d260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:28.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766988640 1 -- 10.20.193.48:0/737949521 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f876013db70 msgr2=0x7f876013dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-12T18:10:28.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766988640 1 -- 10.20.193.48:0/737949521 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f876013db70 msgr2=0x7f876013dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:28.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766988640 1 --2- 10.20.193.48:0/737949521 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f876013db70 0x7f876013dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:28.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8765986640 1 --2- 10.20.193.48:0/737949521 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f876005e490 0x7f876005d260 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:28.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766988640 1 --2- 10.20.193.48:0/737949521 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f876013db70 0x7f876013dfc0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:28.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766187640 10 monclient(hunting): handle_auth_done global_id 35633 payload 274 2026-02-12T18:10:28.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766187640 1 -- 10.20.193.48:0/737949521 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f876005e490 msgr2=0x7f876005d260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:10:28.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766187640 1 --2- 10.20.193.48:0/737949521 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f876005e490 0x7f876005d260 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766187640 1 -- 10.20.193.48:0/737949521 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f876013db70 msgr2=0x7f876013dfc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:10:28.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766187640 1 --2- 10.20.193.48:0/737949521 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f876013db70 0x7f876013dfc0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766187640 10 monclient: _finish_hunting 0 2026-02-12T18:10:28.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766187640 1 monclient: found mon.noname-b 2026-02-12T18:10:28.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766187640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:28.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766187640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:10:28.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.822+0000 7f8766187640 1 -- 10.20.193.48:0/737949521 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876004dc20 con 0x7f876005c950 2026-02-12T18:10:28.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.824+0000 7f8766187640 1 -- 10.20.193.48:0/737949521 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f876005c950 msgr2=0x7f876005cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:28.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.824+0000 7f8766187640 1 --2- 10.20.193.48:0/737949521 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f876005c950 0x7f876005cd20 secure :-1 s=READY pgs=212 gs=2 cs=0 l=1 c_cookie=17416099509187014263 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8750009800 tx=0x7f875002ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1b26a3aa9f26e77 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:28.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8765185640 1 -- 10.20.193.48:0/737949521 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f875002fe90 con 0x7f876005c950 2026-02-12T18:10:28.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8765185640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:28.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8765185640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:10:28.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8765185640 10 monclient: dump: 2026-02-12T18:10:28.833 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:28.833 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:28.833 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.833 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.833 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:28.833 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.833 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:28.833 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:28.833 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:28.833 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:28.833 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:28.833 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:28.833 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:28.833 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:28.833 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:28.833 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8765185640 10 monclient: _finish_auth 0 2026-02-12T18:10:28.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8765185640 10 monclient: _check_auth_tickets 2026-02-12T18:10:28.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8765185640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:28.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8768412640 5 monclient: authenticate success, global_id 35633 2026-02-12T18:10:28.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8768412640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:10:28.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8765185640 1 -- 10.20.193.48:0/737949521 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8750035340 con 0x7f876005c950 2026-02-12T18:10:28.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8765185640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:28.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8768412640 10 monclient: get_monmap_and_config success 2026-02-12T18:10:28.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8768412640 4 set_mon_vals no callback set 2026-02-12T18:10:28.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8765185640 1 -- 10.20.193.48:0/737949521 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f87500354b0 con 0x7f876005c950 2026-02-12T18:10:28.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8765185640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:28.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8765185640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:10:28.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8765185640 10 monclient: dump: 2026-02-12T18:10:28.834 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:28.834 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:28.834 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.834 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.834 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:28.834 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.834 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:28.835 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:28.835 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:28.835 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:28.835 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:28.835 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:28.835 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:28.835 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:28.835 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:28.835 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8768412640 10 monclient: shutdown 2026-02-12T18:10:28.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8768412640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:28.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8768412640 1 -- 10.20.193.48:0/737949521 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f876005c950 msgr2=0x7f876005cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:28.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8768412640 1 --2- 10.20.193.48:0/737949521 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f876005c950 0x7f876005cd20 secure :-1 s=READY pgs=212 gs=2 cs=0 l=1 c_cookie=17416099509187014263 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8750009800 tx=0x7f875002ed50 comp rx=0 tx=0).stop 2026-02-12T18:10:28.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8768412640 1 -- 10.20.193.48:0/737949521 shutdown_connections 2026-02-12T18:10:28.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8768412640 1 --2- 10.20.193.48:0/737949521 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f876013db70 0x7f876013dfc0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8768412640 1 --2- 10.20.193.48:0/737949521 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f876005e490 0x7f876005d260 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8768412640 1 --2- 10.20.193.48:0/737949521 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f876005c950 0x7f876005cd20 unknown :-1 s=CLOSED pgs=212 gs=2 cs=0 l=1 c_cookie=17416099509187014263 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8768412640 1 -- 10.20.193.48:0/737949521 >> 10.20.193.48:0/737949521 conn(0x7f87600548a0 msgr2=0x7f8760097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:28.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8768412640 1 -- 10.20.193.48:0/737949521 shutdown_connections 2026-02-12T18:10:28.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8768412640 1 -- 10.20.193.48:0/737949521 wait complete. 2026-02-12T18:10:28.836 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8768412640 10 monclient: build_initial_monmap 2026-02-12T18:10:28.836 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.825+0000 7f8768412640 10 monclient: monmap: 2026-02-12T18:10:28.836 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:28.836 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:10:28.836 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:10:28.836 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:10:28.836 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:28.836 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.836 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:10:28.836 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:10:28.836 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:28.836 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:28.836 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:28.836 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:28.836 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:28.836 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:28.836 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:28.836 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.836 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8768412640 1 Processor -- start 2026-02-12T18:10:28.836 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8768412640 1 -- start start 2026-02-12T18:10:28.836 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8768412640 10 monclient: init 2026-02-12T18:10:28.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8768412640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:28.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8768412640 10 monclient: _add_conns ranks=[3,1,8,6,2,5,4,7,0] 2026-02-12T18:10:28.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8768412640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f876005c950 0x7f8760141020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8768412640 10 monclient(hunting): picked mon.noname-g con 0x7f876005c950 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:10:28.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8768412640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f876005e490 0x7f876008d290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8768412640 10 monclient(hunting): picked mon.noname-f con 0x7f876005e490 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:10:28.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8768412640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f876013db70 0x7f876008d7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8768412640 10 monclient(hunting): picked mon.noname-e con 0x7f876013db70 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:10:28.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8768412640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8768412640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f876012d9c0 con 0x7f876005e490 2026-02-12T18:10:28.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8768412640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8768412640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f876012cf20 con 0x7f876005c950 2026-02-12T18:10:28.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8768412640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8768412640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f876013e740 con 0x7f876013db70 2026-02-12T18:10:28.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8768412640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:28.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8768412640 10 monclient(hunting): authenticate will time out at 867.552399s 2026-02-12T18:10:28.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8766988640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f876013db70 0x7f876008d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8766988640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f876013db70 0x7f876008d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:56972/0 (socket says 10.20.193.48:56972) 2026-02-12T18:10:28.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8766988640 1 -- 10.20.193.48:0/2148344647 learned_addr learned my addr 10.20.193.48:0/2148344647 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:28.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8766988640 10 monclient(hunting): get_auth_request con 0x7f876013db70 auth_method 0 2026-02-12T18:10:28.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8766988640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8766988640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8766988640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8766988640 1 -- 10.20.193.48:0/2148344647 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f876013db70 msgr2=0x7f876008d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-12T18:10:28.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8766988640 1 -- 10.20.193.48:0/2148344647 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f876013db70 msgr2=0x7f876008d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:10:28.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8766988640 1 --2- 10.20.193.48:0/2148344647 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f876013db70 0x7f876008d7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:28.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8766187640 1 --2- 10.20.193.48:0/2148344647 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f876005c950 0x7f8760141020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8766988640 1 --2- 10.20.193.48:0/2148344647 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f876013db70 0x7f876008d7d0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:28.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8766187640 10 monclient(hunting): get_auth_request con 0x7f876005c950 auth_method 0 2026-02-12T18:10:28.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8766187640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8766187640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8766187640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8765986640 1 --2- 10.20.193.48:0/2148344647 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f876005e490 0x7f876008d290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8765986640 10 monclient(hunting): get_auth_request con 0x7f876005e490 auth_method 0 2026-02-12T18:10:28.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8765986640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8765986640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8765986640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8766187640 1 -- 10.20.193.48:0/2148344647 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f876005c950 msgr2=0x7f8760141020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-12T18:10:28.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8766187640 1 -- 10.20.193.48:0/2148344647 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f876005c950 msgr2=0x7f8760141020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:10:28.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8766187640 1 --2- 10.20.193.48:0/2148344647 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f876005c950 0x7f8760141020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:28.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8766187640 1 --2- 10.20.193.48:0/2148344647 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f876005c950 0x7f8760141020 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:28.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8765986640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:28.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8765986640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:28.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.826+0000 7f8765986640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:28.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.827+0000 7f8765986640 10 monclient(hunting): handle_auth_done global_id 5635 payload 824 2026-02-12T18:10:28.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.827+0000 7f8765986640 1 -- 10.20.193.48:0/2148344647 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f876013db70 msgr2=0x7f876008d7d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:10:28.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.827+0000 7f8765986640 1 --2- 10.20.193.48:0/2148344647 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f876013db70 0x7f876008d7d0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.827+0000 7f8765986640 1 -- 10.20.193.48:0/2148344647 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f876005c950 msgr2=0x7f8760141020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:10:28.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.827+0000 7f8765986640 1 --2- 10.20.193.48:0/2148344647 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f876005c950 0x7f8760141020 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.827+0000 7f8765986640 10 monclient: _finish_hunting 0 2026-02-12T18:10:28.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.827+0000 7f8765986640 1 monclient: found mon.noname-f 2026-02-12T18:10:28.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.827+0000 7f8765986640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:28.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.827+0000 7f8765986640 10 monclient: _send_mon_message to mon.noname-f at v2:10.20.193.111:3300/0 2026-02-12T18:10:28.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.827+0000 7f8765986640 1 -- 10.20.193.48:0/2148344647 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8750009420 con 0x7f876005e490 2026-02-12T18:10:28.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.829+0000 7f8765986640 1 -- 10.20.193.48:0/2148344647 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f876005e490 msgr2=0x7f876008d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:28.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.829+0000 7f8765986640 1 --2- 10.20.193.48:0/2148344647 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f876005e490 0x7f876008d290 secure :-1 s=READY pgs=299 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8754004740 tx=0x7f875400ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:28.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.829+0000 7f8746ffd640 1 -- 10.20.193.48:0/2148344647 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f875400ee80 con 0x7f876005e490 2026-02-12T18:10:28.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.829+0000 7f8746ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:28.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.829+0000 7f8746ffd640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2026-02-12T18:10:28.840 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.829+0000 7f8746ffd640 10 monclient: dump: 2026-02-12T18:10:28.840 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:28.840 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:28.840 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.840 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.840 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:28.840 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.840 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:28.840 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:28.840 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:28.840 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:28.840 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:28.840 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:28.840 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:28.840 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:28.840 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:28.840 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.840 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.829+0000 7f8746ffd640 10 monclient: _finish_auth 0 2026-02-12T18:10:28.840 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.829+0000 7f8746ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:10:28.840 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.829+0000 7f8746ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:28.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.829+0000 7f8746ffd640 1 -- 10.20.193.48:0/2148344647 <== mon.1 v2:10.20.193.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f875400cd70 con 0x7f876005e490 2026-02-12T18:10:28.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.829+0000 7f8746ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:28.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.829+0000 7f8746ffd640 1 -- 10.20.193.48:0/2148344647 <== mon.1 v2:10.20.193.111:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f87540138d0 con 0x7f876005e490 2026-02-12T18:10:28.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.829+0000 7f8768412640 5 monclient: authenticate success, global_id 5635 2026-02-12T18:10:28.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.829+0000 7f8746ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:28.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.829+0000 7f8764984640 4 set_mon_vals no callback set 2026-02-12T18:10:28.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.829+0000 7f8746ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:10:28.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.829+0000 7f8746ffd640 10 monclient: dump: 2026-02-12T18:10:28.841 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:28.841 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:28.841 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.841 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.841 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:28.841 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.841 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:28.841 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:28.841 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:28.841 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:28.841 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:28.841 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:28.841 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:28.842 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:28.842 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:28.842 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.829+0000 7f8768412640 10 monclient: _renew_subs 2026-02-12T18:10:28.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.829+0000 7f8768412640 10 monclient: _send_mon_message to mon.f at v2:10.20.193.111:3300/0 2026-02-12T18:10:28.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.829+0000 7f8768412640 1 -- 10.20.193.48:0/2148344647 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8760143e60 con 0x7f876005e490 2026-02-12T18:10:28.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.829+0000 7f8768412640 10 monclient: _renew_subs 2026-02-12T18:10:28.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.829+0000 7f8768412640 10 monclient: _send_mon_message to mon.f at v2:10.20.193.111:3300/0 2026-02-12T18:10:28.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.829+0000 7f8768412640 1 -- 10.20.193.48:0/2148344647 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8760141930 con 0x7f876005e490 2026-02-12T18:10:28.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.830+0000 7f8768412640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:28.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.830+0000 7f8768412640 1 --2- 10.20.193.48:0/2148344647 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f8760090000 0x7f876013ce40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.830+0000 7f8768412640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.830+0000 7f8768412640 1 -- 10.20.193.48:0/2148344647 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f876005f140 con 0x7f8760090000 2026-02-12T18:10:28.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.830+0000 7f8766187640 1 --2- 10.20.193.48:0/2148344647 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f8760090000 0x7f876013ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.830+0000 7f8766187640 10 monclient: get_auth_request con 0x7f8760090000 auth_method 0 2026-02-12T18:10:28.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.830+0000 7f8766187640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.830+0000 7f8766187640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.830+0000 7f8766187640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.830+0000 7f8766187640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:28.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.830+0000 7f8766187640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:28.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.830+0000 7f8766187640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:28.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.830+0000 7f8766187640 10 monclient(hunting): handle_auth_done global_id 35642 payload 824 2026-02-12T18:10:28.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.830+0000 7f8766187640 1 -- 10.20.193.48:0/2148344647 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8760097de0 con 0x7f8760090000 2026-02-12T18:10:28.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.830+0000 7f8746ffd640 1 -- 10.20.193.48:0/2148344647 <== mon.1 v2:10.20.193.111:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f8754022020 con 0x7f876005e490 2026-02-12T18:10:28.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.831+0000 7f8746ffd640 1 --2- 10.20.193.48:0/2148344647 >> v2:10.20.193.111:6812/977811348 conn(0x7f873003f800 0x7f873005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.831+0000 7f8746ffd640 1 -- 10.20.193.48:0/2148344647 <== mon.1 v2:10.20.193.111:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 3897+0+0 (secure 0 0 0) 0x7f8754052570 con 0x7f876005e490 2026-02-12T18:10:28.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.831+0000 7f8766988640 1 --2- 10.20.193.48:0/2148344647 >> v2:10.20.193.111:6812/977811348 conn(0x7f873003f800 0x7f873005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.831+0000 7f8766988640 10 monclient: get_auth_request con 0x7f873003f800 auth_method 0 2026-02-12T18:10:28.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.832+0000 7f8766187640 1 -- 10.20.193.48:0/2148344647 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f8760090000 msgr2=0x7f876013ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:28.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.832+0000 7f8766187640 1 --2- 10.20.193.48:0/2148344647 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f8760090000 0x7f876013ce40 secure :-1 s=READY pgs=213 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f87500090b0 tx=0x7f87500047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:28.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.832+0000 7f8746ffd640 1 -- 10.20.193.48:0/2148344647 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8750003da0 con 0x7f8760090000 2026-02-12T18:10:28.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.832+0000 7f8746ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:28.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.832+0000 7f8746ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:10:28.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.832+0000 7f8746ffd640 10 monclient: dump: 2026-02-12T18:10:28.845 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:28.845 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:28.845 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.845 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.845 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:28.845 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.845 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:28.845 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:28.845 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:28.845 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:28.845 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:28.846 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:28.846 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:28.846 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:28.846 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:28.846 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.833+0000 7f8746ffd640 1 -- 10.20.193.48:0/2148344647 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f87500038e0 con 0x7f8760090000 2026-02-12T18:10:28.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.833+0000 7f8746ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:28.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.833+0000 7f8746ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:10:28.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.833+0000 7f8746ffd640 1 -- 10.20.193.48:0/2148344647 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f8760090000 msgr2=0x7f876013ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:28.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.833+0000 7f8746ffd640 1 --2- 10.20.193.48:0/2148344647 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f8760090000 0x7f876013ce40 secure :-1 s=READY pgs=213 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f87500090b0 tx=0x7f87500047e0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.833+0000 7f8746ffd640 1 -- 10.20.193.48:0/2148344647 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f8760090000 msgr2=0x7f876013ce40 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:28.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.833+0000 7f8746ffd640 1 --2- 10.20.193.48:0/2148344647 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f8760090000 0x7f876013ce40 secure :-1 s=CLOSED pgs=213 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f87500090b0 tx=0x7f87500047e0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.833+0000 7f8766988640 1 --2- 10.20.193.48:0/2148344647 >> v2:10.20.193.111:6812/977811348 conn(0x7f873003f800 0x7f873005fcb0 secure :-1 s=READY pgs=286 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f876008a230 tx=0x7f875c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:28.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.836+0000 7f8768412640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:10:28.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.836+0000 7f8768412640 1 --2- 10.20.193.48:0/2148344647 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f8760091480 0x7f876013d380 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.836+0000 7f8768412640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.836+0000 7f8768412640 1 -- 10.20.193.48:0/2148344647 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f876005fd90 con 0x7f8760091480 2026-02-12T18:10:28.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.836+0000 7f8766187640 1 --2- 10.20.193.48:0/2148344647 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f8760091480 0x7f876013d380 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.836+0000 7f8766187640 10 monclient: get_auth_request con 0x7f8760091480 auth_method 0 2026-02-12T18:10:28.847 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.836+0000 7f8766187640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.847 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.836+0000 7f8766187640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.847 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.836+0000 7f8766187640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.847 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.836+0000 7f8766187640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:28.847 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.836+0000 7f8766187640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:28.847 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.836+0000 7f8766187640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:28.847 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.836+0000 7f8766187640 10 monclient(hunting): handle_auth_done global_id 35651 payload 824 2026-02-12T18:10:28.847 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.836+0000 7f8766187640 1 -- 10.20.193.48:0/2148344647 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f876005cd20 con 0x7f8760091480 2026-02-12T18:10:28.847 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.839+0000 7f8766187640 1 -- 10.20.193.48:0/2148344647 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f8760091480 msgr2=0x7f876013d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:28.847 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.839+0000 7f8766187640 1 --2- 10.20.193.48:0/2148344647 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f8760091480 0x7f876013d380 secure :-1 s=READY pgs=214 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8750009750 tx=0x7f8750004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:28.847 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.839+0000 7f8746ffd640 1 -- 10.20.193.48:0/2148344647 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8750003c00 con 0x7f8760091480 2026-02-12T18:10:28.847 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.839+0000 7f8746ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:28.847 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.839+0000 7f8746ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:10:28.847 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.839+0000 7f8746ffd640 10 monclient: dump: 2026-02-12T18:10:28.847 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:28.847 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:28.847 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.847 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.847 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:28.847 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.847 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:28.848 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:28.848 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:28.848 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:28.848 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:28.848 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:28.848 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:28.848 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:28.848 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:28.848 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.848 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.839+0000 7f8746ffd640 1 -- 10.20.193.48:0/2148344647 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10349 (secure 0 0 0) 0x7f87500358d0 con 0x7f8760091480 2026-02-12T18:10:28.848 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.839+0000 7f8746ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:10:28.848 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.839+0000 7f8746ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:10:28.848 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.839+0000 7f8746ffd640 1 -- 10.20.193.48:0/2148344647 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f8760091480 msgr2=0x7f876013d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:28.848 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.839+0000 7f8746ffd640 1 --2- 10.20.193.48:0/2148344647 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f8760091480 0x7f876013d380 secure :-1 s=READY pgs=214 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8750009750 tx=0x7f8750004770 comp rx=0 tx=0).stop 2026-02-12T18:10:28.848 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.839+0000 7f8746ffd640 1 -- 10.20.193.48:0/2148344647 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f8760091480 msgr2=0x7f876013d380 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:28.848 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.839+0000 7f8746ffd640 1 --2- 10.20.193.48:0/2148344647 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f8760091480 0x7f876013d380 secure :-1 s=CLOSED pgs=214 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8750009750 tx=0x7f8750004770 comp rx=0 tx=0).stop 2026-02-12T18:10:28.848 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:10:28.849 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:10:28.849 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:10:28.849 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:10:28.849 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 46, 2026-02-12T18:10:28.849 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 283673, 2026-02-12T18:10:28.849 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:10:28.849 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:10:28.849 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:10:28.849 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:10:28.849 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:10:28.849 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:10:28.849 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:10:28.849 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:10:28.849 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:10:28.849 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:10:28.849 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:28.849 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 3, 2026-02-12T18:10:28.849 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:28.850 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:10:28.850 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:10:28.850 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:28.850 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:28.850 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:28.850 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:28.850 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:28.850 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:28.850 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:28.850 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:28.850 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:28.850 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:28.850 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:28.850 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:28.850 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:28.850 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:28.850 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:10:28.850 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:10:28.850 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:28.851 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:28.851 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:28.851 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:28.851 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:28.851 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:28.851 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:28.851 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:28.851 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:28.851 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:28.851 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:28.851 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:28.851 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:28.851 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:28.851 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.851 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:10:28.851 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:10:28.851 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:10:28.851 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:10:28.851 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:10:28.851 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:10:28.851 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:28.852 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:28.852 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:10:28.852 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:10:28.852 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:10:28.852 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:10:28.852 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:10:28.852 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:10:28.852 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:10:28.852 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:28.852 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:10:28.852 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:28.852 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:28.852 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:28.852 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:28.852 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:28.852 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:28.852 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:28.852 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:28.852 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:28.852 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:28.853 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:28.853 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:28.853 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:28.853 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:28.853 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:10:28.853 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.853 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:10:28.853 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.853 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:10:28.853 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:10:28.853 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:28.853 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:28.853 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.853 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:28.853 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:10:28.853 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.853 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.853 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.853 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:28.853 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:10:28.854 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.854 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.854 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:28.854 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.854 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:10:28.854 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:10:28.854 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:28.854 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:28.854 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:10:28.854 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:28.854 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.854 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.854 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:10:28.854 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:10:28.854 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:28.854 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:28.854 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.854 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:28.854 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:10:28.854 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.854 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.854 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.855 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:28.855 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:10:28.855 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.855 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.855 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:28.855 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.855 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:10:28.855 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:10:28.855 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:28.855 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:28.855 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:10:28.855 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:28.855 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.855 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.855 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:10:28.855 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:10:28.855 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:28.855 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:28.855 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.855 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:28.855 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:10:28.856 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.856 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.856 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.856 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:28.856 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:10:28.856 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.856 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.856 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:28.856 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.856 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:10:28.856 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:10:28.856 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:28.856 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:28.856 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:10:28.856 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:28.856 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.856 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.856 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:10:28.856 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:10:28.856 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:28.856 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:28.856 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.856 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:28.857 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:10:28.857 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.857 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.857 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.857 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:28.857 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:10:28.857 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.857 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.857 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:28.857 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.857 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:10:28.857 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:10:28.857 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:28.857 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:28.857 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:10:28.857 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:28.857 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.857 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.857 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:10:28.857 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:10:28.857 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:28.857 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:28.857 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.857 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:28.858 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:10:28.858 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.858 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.858 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.858 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:28.858 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:10:28.858 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.858 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.858 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:28.858 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.858 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:10:28.858 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:10:28.858 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:28.858 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:28.858 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:28.858 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:28.858 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.858 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.858 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:10:28.858 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:10:28.858 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:28.858 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:28.858 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.859 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:28.859 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:10:28.859 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.859 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.859 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.859 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:28.859 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:10:28.859 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.859 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.859 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:28.859 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.859 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:10:28.859 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:10:28.859 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:28.859 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:28.859 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:10:28.859 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:28.859 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.859 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.859 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:10:28.859 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:10:28.859 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:28.859 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:28.859 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.860 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:28.860 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:10:28.860 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.860 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.860 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.860 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:28.860 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:10:28.860 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.860 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.860 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:28.860 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.860 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:10:28.860 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:10:28.860 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:28.860 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:28.860 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:28.860 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:28.860 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.860 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.860 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:10:28.860 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:10:28.860 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:28.860 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:28.860 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.860 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:28.861 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:10:28.861 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.861 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.861 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.861 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:28.861 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:10:28.861 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.861 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.861 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:28.861 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.861 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:10:28.861 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:10:28.861 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:28.861 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:28.861 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:10:28.861 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:28.861 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.861 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.861 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:10:28.861 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:10:28.861 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:28.861 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:28.861 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.862 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:28.862 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:10:28.862 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.862 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.862 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.862 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:28.862 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:10:28.862 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:28.862 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.862 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:28.862 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.862 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:10:28.862 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:10:28.862 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:28.862 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:28.862 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:10:28.862 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:28.862 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.862 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:28.862 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.862 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:10:28.862 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:10:28.862 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.862 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:28.862 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:28.862 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:28.863 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.863 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:28.863 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:10:28.863 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.863 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:28.863 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:28.863 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:28.863 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.863 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:28.863 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:10:28.863 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.863 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:28.863 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:28.863 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:28.863 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.863 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:28.863 INFO:teuthology.orchestra.run.trial048.stdout: "mgr": [ 2026-02-12T18:10:28.863 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:28.863 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:28.863 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:28.863 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:28.863 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:28.863 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:28.863 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:28.863 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:10:28.863 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:10:28.864 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.839+0000 7f8768412640 1 -- 10.20.193.48:0/2148344647 >> v2:10.20.193.111:6812/977811348 conn(0x7f873003f800 msgr2=0x7f873005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:28.864 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.839+0000 7f8768412640 1 --2- 10.20.193.48:0/2148344647 >> v2:10.20.193.111:6812/977811348 conn(0x7f873003f800 0x7f873005fcb0 secure :-1 s=READY pgs=286 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f876008a230 tx=0x7f875c009040 comp rx=0 tx=0).stop 2026-02-12T18:10:28.864 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.839+0000 7f8768412640 10 monclient: shutdown 2026-02-12T18:10:28.864 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.839+0000 7f8768412640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:28.864 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.839+0000 7f8768412640 1 -- 10.20.193.48:0/2148344647 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f876005e490 msgr2=0x7f876008d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:28.864 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.839+0000 7f8768412640 1 --2- 10.20.193.48:0/2148344647 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f876005e490 0x7f876008d290 secure :-1 s=READY pgs=299 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8754004740 tx=0x7f875400ec80 comp rx=0 tx=0).stop 2026-02-12T18:10:28.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.839+0000 7f8766988640 1 -- 10.20.193.48:0/2148344647 reap_dead start 2026-02-12T18:10:28.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.839+0000 7f8768412640 1 -- 10.20.193.48:0/2148344647 shutdown_connections 2026-02-12T18:10:28.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.839+0000 7f8768412640 1 --2- 10.20.193.48:0/2148344647 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f876005e490 0x7f876008d290 unknown :-1 s=CLOSED pgs=299 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.839+0000 7f8768412640 1 -- 10.20.193.48:0/2148344647 >> 10.20.193.48:0/2148344647 conn(0x7f87600548a0 msgr2=0x7f8760093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:28.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.839+0000 7f8768412640 1 -- 10.20.193.48:0/2148344647 shutdown_connections 2026-02-12T18:10:28.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.839+0000 7f8768412640 1 -- 10.20.193.48:0/2148344647 wait complete. 2026-02-12T18:10:28.865 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:10:28.865 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2026-02-12T18:10:28.865 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T18:10:28.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.928+0000 7f2705e1b640 10 monclient: get_monmap_and_config 2026-02-12T18:10:28.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.928+0000 7f2705e1b640 10 monclient: build_initial_monmap 2026-02-12T18:10:28.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.928+0000 7f2705e1b640 10 monclient: monmap: 2026-02-12T18:10:28.929 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:28.929 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:28.929 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:10:28.929333+0000 2026-02-12T18:10:28.929 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:10:28.929333+0000 2026-02-12T18:10:28.929 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:28.930 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.930 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:10:28.930 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:10:28.930 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:28.930 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:28.930 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:28.930 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:28.930 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:28.930 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:28.930 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:28.930 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:10:28.930 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:10:28.930 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.928+0000 7f2705e1b640 1 Processor -- start 2026-02-12T18:10:28.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.928+0000 7f2705e1b640 1 -- start start 2026-02-12T18:10:28.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.928+0000 7f2705e1b640 10 monclient: init 2026-02-12T18:10:28.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.928+0000 7f2705e1b640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:28.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.928+0000 7f2705e1b640 10 monclient: _add_conns ranks=[6,4,0,3,9,2,10,7,5,1,8] 2026-02-12T18:10:28.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.928+0000 7f2705e1b640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f270005c950 0x7f270005cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.928+0000 7f2705e1b640 10 monclient(hunting): picked mon.noname-d con 0x7f270005c950 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:10:28.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.928+0000 7f2705e1b640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270005e490 0x7f270005d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.928+0000 7f2705e1b640 10 monclient(hunting): picked mon.noname-c con 0x7f270005e490 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:10:28.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.928+0000 7f2705e1b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f270013db70 addr v1:10.20.193.48:6789/0 2026-02-12T18:10:28.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.928+0000 7f2705e1b640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f270004dc20 con 0x7f270013db70 2026-02-12T18:10:28.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.928+0000 7f2705e1b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.928+0000 7f2705e1b640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f270005ddd0 con 0x7f270005e490 2026-02-12T18:10:28.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f2705e1b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f2705e1b640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f270005d7a0 con 0x7f270005c950 2026-02-12T18:10:28.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f2705e1b640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:28.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f2705e1b640 10 monclient(hunting): authenticate will time out at 867.655006s 2026-02-12T18:10:28.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26feffd640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270005e490 0x7f270005d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26ff7fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f270005c950 0x7f270005cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26feffd640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270005e490 0x7f270005d260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:53146/0 (socket says 10.20.193.48:53146) 2026-02-12T18:10:28.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26feffd640 1 -- 10.20.193.48:0/3238837376 learned_addr learned my addr 10.20.193.48:0/3238837376 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:28.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26feffd640 10 monclient(hunting): get_auth_request con 0x7f270005e490 auth_method 0 2026-02-12T18:10:28.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26feffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26feffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26feffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26ff7fe640 10 monclient(hunting): get_auth_request con 0x7f270005c950 auth_method 0 2026-02-12T18:10:28.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26ff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26ff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:28.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26ff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:28.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26feffd640 1 -- 10.20.193.48:0/3238837376 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270005e490 msgr2=0x7f270005d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:10:28.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26feffd640 1 -- 10.20.193.48:0/3238837376 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270005e490 msgr2=0x7f270005d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:28.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26feffd640 1 --2- 10.20.193.48:0/3238837376 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270005e490 0x7f270005d260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:28.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26ff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:28.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26feffd640 1 --2- 10.20.193.48:0/3238837376 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270005e490 0x7f270005d260 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:28.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26ff7fe640 10 monclient(hunting): handle_auth_done global_id 5496 payload 274 2026-02-12T18:10:28.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26ff7fe640 1 -- 10.20.193.48:0/3238837376 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270005e490 msgr2=0x7f270005d260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:10:28.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26ff7fe640 1 --2- 10.20.193.48:0/3238837376 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270005e490 0x7f270005d260 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26ff7fe640 1 -- 10.20.193.48:0/3238837376 >> v1:10.20.193.48:6789/0 conn(0x7f270013db70 legacy=0x7f270013dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:28.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26ff7fe640 10 monclient: _finish_hunting 0 2026-02-12T18:10:28.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26ff7fe640 1 monclient: found mon.noname-d 2026-02-12T18:10:28.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26ff7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:28.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26ff7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:10:28.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.929+0000 7f26ff7fe640 1 -- 10.20.193.48:0/3238837376 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2700092990 con 0x7f270005c950 2026-02-12T18:10:28.936 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.931+0000 7f26ff7fe640 1 -- 10.20.193.48:0/3238837376 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f270005c950 msgr2=0x7f270005cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:28.936 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.931+0000 7f26ff7fe640 1 --2- 10.20.193.48:0/3238837376 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f270005c950 0x7f270005cd20 secure :-1 s=READY pgs=189 gs=3 cs=0 l=1 c_cookie=3630738374663403968 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26ec009800 tx=0x7f26ec02ed50 comp rx=0 tx=0).ready entity=mon.6 client_cookie=3262f950b630f9c0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:28.936 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f26fe7fc640 1 -- 10.20.193.48:0/3238837376 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f26ec02fe90 con 0x7f270005c950 2026-02-12T18:10:28.936 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f26fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:28.936 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f26fe7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:10:28.936 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f26fe7fc640 10 monclient: dump: 2026-02-12T18:10:28.936 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:28.936 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:28.936 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.936 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.936 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:28.936 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.936 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:28.936 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:28.936 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:28.936 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:28.937 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:28.937 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:28.937 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:28.937 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:28.937 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:28.937 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.937 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f26fe7fc640 10 monclient: _finish_auth 0 2026-02-12T18:10:28.937 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f26fe7fc640 10 monclient: _check_auth_tickets 2026-02-12T18:10:28.937 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f26fe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:28.937 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f2705e1b640 5 monclient: authenticate success, global_id 5496 2026-02-12T18:10:28.937 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f2705e1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:10:28.937 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f26fe7fc640 1 -- 10.20.193.48:0/3238837376 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26ec035340 con 0x7f270005c950 2026-02-12T18:10:28.937 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f26fe7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:28.937 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f26fe7fc640 1 -- 10.20.193.48:0/3238837376 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f26ec035970 con 0x7f270005c950 2026-02-12T18:10:28.937 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f2705e1b640 10 monclient: get_monmap_and_config success 2026-02-12T18:10:28.937 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f2705e1b640 4 set_mon_vals no callback set 2026-02-12T18:10:28.937 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f26fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:28.937 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f26fe7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:10:28.937 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f26fe7fc640 10 monclient: dump: 2026-02-12T18:10:28.937 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:28.937 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:28.937 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.937 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.938 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:28.938 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.938 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:28.938 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:28.938 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:28.938 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:28.938 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:28.938 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:28.938 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:28.938 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:28.938 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:28.938 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.938 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f2705e1b640 10 monclient: shutdown 2026-02-12T18:10:28.938 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f2705e1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:28.938 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f2705e1b640 1 -- 10.20.193.48:0/3238837376 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f270005c950 msgr2=0x7f270005cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:28.938 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f2705e1b640 1 --2- 10.20.193.48:0/3238837376 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f270005c950 0x7f270005cd20 secure :-1 s=READY pgs=189 gs=3 cs=0 l=1 c_cookie=3630738374663403968 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26ec009800 tx=0x7f26ec02ed50 comp rx=0 tx=0).stop 2026-02-12T18:10:28.938 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f2705e1b640 1 -- 10.20.193.48:0/3238837376 shutdown_connections 2026-02-12T18:10:28.938 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f2705e1b640 1 --2- 10.20.193.48:0/3238837376 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270005e490 0x7f270005d260 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.938 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f2705e1b640 1 --2- 10.20.193.48:0/3238837376 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f270005c950 0x7f270005cd20 unknown :-1 s=CLOSED pgs=189 gs=3 cs=0 l=1 c_cookie=3630738374663403968 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.938 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f2705e1b640 1 -- 10.20.193.48:0/3238837376 >> 10.20.193.48:0/3238837376 conn(0x7f27000548a0 msgr2=0x7f2700097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:28.938 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f2705e1b640 1 -- 10.20.193.48:0/3238837376 shutdown_connections 2026-02-12T18:10:28.938 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f2705e1b640 1 -- 10.20.193.48:0/3238837376 wait complete. 2026-02-12T18:10:28.938 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f2705e1b640 10 monclient: build_initial_monmap 2026-02-12T18:10:28.939 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f2705e1b640 10 monclient: monmap: 2026-02-12T18:10:28.939 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:28.939 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:10:28.939 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:10:28.939 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:10:28.939 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:28.939 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.939 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:10:28.939 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:10:28.939 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:28.939 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:28.939 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:28.939 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:28.939 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:28.939 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:28.939 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:28.939 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.939 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.932+0000 7f2705e1b640 1 Processor -- start 2026-02-12T18:10:28.939 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f2705e1b640 1 -- start start 2026-02-12T18:10:28.939 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f2705e1b640 10 monclient: init 2026-02-12T18:10:28.939 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f2705e1b640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:28.939 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f2705e1b640 10 monclient: _add_conns ranks=[7,1,5,3,8,2,4,6,0] 2026-02-12T18:10:28.939 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f2705e1b640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f270005c950 0x7f270008d450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.940 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f2705e1b640 10 monclient(hunting): picked mon.noname-i con 0x7f270005c950 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:10:28.940 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f2705e1b640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f270005e490 0x7f270013ce00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.940 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f2705e1b640 10 monclient(hunting): picked mon.noname-f con 0x7f270005e490 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:10:28.940 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f2705e1b640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f270013db70 0x7f270013d340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.940 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f2705e1b640 10 monclient(hunting): picked mon.noname-h con 0x7f270013db70 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:10:28.940 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f2705e1b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.940 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f2705e1b640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2700090aa0 con 0x7f270005e490 2026-02-12T18:10:28.940 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f2705e1b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.940 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f2705e1b640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f270008a670 con 0x7f270013db70 2026-02-12T18:10:28.940 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f2705e1b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.940 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f2705e1b640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f2700143e40 con 0x7f270005c950 2026-02-12T18:10:28.940 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f2705e1b640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:28.940 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f2705e1b640 10 monclient(hunting): authenticate will time out at 867.659257s 2026-02-12T18:10:28.940 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26feffd640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f270005e490 0x7f270013ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.940 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26fffff640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f270013db70 0x7f270013d340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.940 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26feffd640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f270005e490 0x7f270013ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3300/0 says I am v2:10.20.193.48:37802/0 (socket says 10.20.193.48:37802) 2026-02-12T18:10:28.940 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26feffd640 1 -- 10.20.193.48:0/1494039054 learned_addr learned my addr 10.20.193.48:0/1494039054 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:28.940 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26feffd640 10 monclient(hunting): get_auth_request con 0x7f270005e490 auth_method 0 2026-02-12T18:10:28.940 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26feffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.940 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26feffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.940 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26feffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.940 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26fffff640 10 monclient(hunting): get_auth_request con 0x7f270013db70 auth_method 0 2026-02-12T18:10:28.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26fffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26fffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26fffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26ff7fe640 1 --2- 10.20.193.48:0/1494039054 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f270005c950 0x7f270008d450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26ff7fe640 10 monclient(hunting): get_auth_request con 0x7f270005c950 auth_method 0 2026-02-12T18:10:28.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26ff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26fffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:28.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26fffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:28.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26fffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:28.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26feffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:28.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26feffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:28.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26feffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:28.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26ff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:28.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26ff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:28.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26ff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:28.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26fffff640 10 monclient(hunting): handle_auth_done global_id 5612 payload 824 2026-02-12T18:10:28.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26fffff640 1 -- 10.20.193.48:0/1494039054 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f270005c950 msgr2=0x7f270008d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:28.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26fffff640 1 --2- 10.20.193.48:0/1494039054 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f270005c950 0x7f270008d450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26fffff640 1 -- 10.20.193.48:0/1494039054 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f270005e490 msgr2=0x7f270013ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:28.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26fffff640 1 --2- 10.20.193.48:0/1494039054 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f270005e490 0x7f270013ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:28.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26fffff640 10 monclient: _finish_hunting 0 2026-02-12T18:10:28.942 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26fffff640 1 monclient: found mon.noname-h 2026-02-12T18:10:28.942 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26fffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:28.942 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26fffff640 10 monclient: _send_mon_message to mon.noname-h at v2:10.20.193.111:3302/0 2026-02-12T18:10:28.942 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.933+0000 7f26fffff640 1 -- 10.20.193.48:0/1494039054 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26ec009420 con 0x7f270013db70 2026-02-12T18:10:28.943 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.936+0000 7f26fffff640 1 -- 10.20.193.48:0/1494039054 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f270013db70 msgr2=0x7f270013d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:28.943 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.936+0000 7f26fffff640 1 --2- 10.20.193.48:0/1494039054 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f270013db70 0x7f270013d340 secure :-1 s=READY pgs=226 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26f400d430 tx=0x7f26f400d900 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:28.943 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.936+0000 7f26dbfff640 1 -- 10.20.193.48:0/1494039054 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f26f4007e30 con 0x7f270013db70 2026-02-12T18:10:28.943 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.936+0000 7f26dbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:28.943 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.936+0000 7f26dbfff640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2026-02-12T18:10:28.943 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.936+0000 7f26dbfff640 10 monclient: dump: 2026-02-12T18:10:28.943 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:28.943 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:28.943 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.944 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.944 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:28.944 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.944 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:28.944 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:28.944 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:28.944 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:28.944 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:28.944 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:28.944 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:28.944 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:28.944 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:28.944 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.944 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.936+0000 7f26dbfff640 10 monclient: _finish_auth 0 2026-02-12T18:10:28.944 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.936+0000 7f26dbfff640 10 monclient: _check_auth_tickets 2026-02-12T18:10:28.944 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.936+0000 7f26dbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:28.944 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.936+0000 7f2705e1b640 5 monclient: authenticate success, global_id 5612 2026-02-12T18:10:28.944 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.936+0000 7f2705e1b640 10 monclient: _renew_subs 2026-02-12T18:10:28.944 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.936+0000 7f2705e1b640 10 monclient: _send_mon_message to mon.h at v2:10.20.193.111:3302/0 2026-02-12T18:10:28.944 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.936+0000 7f2705e1b640 1 -- 10.20.193.48:0/1494039054 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2700142310 con 0x7f270013db70 2026-02-12T18:10:28.944 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.936+0000 7f26dbfff640 1 -- 10.20.193.48:0/1494039054 <== mon.5 v2:10.20.193.111:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26f4007970 con 0x7f270013db70 2026-02-12T18:10:28.944 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.936+0000 7f26dbfff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:28.944 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.936+0000 7f26dbfff640 1 -- 10.20.193.48:0/1494039054 <== mon.5 v2:10.20.193.111:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f26f4007ae0 con 0x7f270013db70 2026-02-12T18:10:28.945 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.936+0000 7f26dbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:28.945 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.936+0000 7f26dbfff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:10:28.945 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.936+0000 7f26fdffb640 4 set_mon_vals no callback set 2026-02-12T18:10:28.945 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.936+0000 7f26dbfff640 10 monclient: dump: 2026-02-12T18:10:28.945 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:28.945 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:28.945 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.945 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:28.945 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:28.945 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:28.945 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:28.945 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:28.945 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:28.945 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:28.945 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:28.945 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:28.945 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:28.945 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:28.945 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:28.945 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:28.945 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.936+0000 7f2705e1b640 10 monclient: _renew_subs 2026-02-12T18:10:28.945 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.936+0000 7f2705e1b640 10 monclient: _send_mon_message to mon.h at v2:10.20.193.111:3302/0 2026-02-12T18:10:28.945 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.936+0000 7f2705e1b640 1 -- 10.20.193.48:0/1494039054 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f270008af10 con 0x7f270013db70 2026-02-12T18:10:28.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.937+0000 7f2705e1b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:28.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.937+0000 7f2705e1b640 1 --2- 10.20.193.48:0/1494039054 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270008d990 0x7f2700129470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.937+0000 7f2705e1b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:28.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.937+0000 7f2705e1b640 1 -- 10.20.193.48:0/1494039054 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f270005f140 con 0x7f270008d990 2026-02-12T18:10:28.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.937+0000 7f26ff7fe640 1 --2- 10.20.193.48:0/1494039054 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270008d990 0x7f2700129470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.937+0000 7f26ff7fe640 10 monclient: get_auth_request con 0x7f270008d990 auth_method 0 2026-02-12T18:10:28.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.937+0000 7f26ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:28.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.937+0000 7f26ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:28.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.937+0000 7f26ff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:28.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.937+0000 7f26ff7fe640 1 -- 10.20.193.48:0/1494039054 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270008d990 msgr2=0x7f2700129470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-12T18:10:28.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.937+0000 7f26ff7fe640 1 -- 10.20.193.48:0/1494039054 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270008d990 msgr2=0x7f2700129470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:10:28.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.937+0000 7f26ff7fe640 1 --2- 10.20.193.48:0/1494039054 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270008d990 0x7f2700129470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:28.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.937+0000 7f26ff7fe640 1 --2- 10.20.193.48:0/1494039054 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270008d990 0x7f2700129470 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:28.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.937+0000 7f26dbfff640 1 -- 10.20.193.48:0/1494039054 <== mon.5 v2:10.20.193.111:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f26f40127a0 con 0x7f270013db70 2026-02-12T18:10:28.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.938+0000 7f26dbfff640 1 --2- 10.20.193.48:0/1494039054 >> v2:10.20.193.111:6812/977811348 conn(0x7f26d003f800 0x7f26d005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:28.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.938+0000 7f26dbfff640 1 -- 10.20.193.48:0/1494039054 <== mon.5 v2:10.20.193.111:3302/0 5 ==== osd_map(210..210 src has 1..210) ==== 3897+0+0 (secure 0 0 0) 0x7f26f4053050 con 0x7f270013db70 2026-02-12T18:10:28.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.938+0000 7f26feffd640 1 --2- 10.20.193.48:0/1494039054 >> v2:10.20.193.111:6812/977811348 conn(0x7f26d003f800 0x7f26d005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:28.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.938+0000 7f26feffd640 10 monclient: get_auth_request con 0x7f26d003f800 auth_method 0 2026-02-12T18:10:28.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:28.940+0000 7f26feffd640 1 --2- 10.20.193.48:0/1494039054 >> v2:10.20.193.111:6812/977811348 conn(0x7f26d003f800 0x7f26d005fcb0 secure :-1 s=READY pgs=287 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2700090580 tx=0x7f26f0008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:29.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.138+0000 7f26ff7fe640 1 --2- 10.20.193.48:0/1494039054 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270008d990 0x7f2700129470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.138+0000 7f26ff7fe640 10 monclient: get_auth_request con 0x7f270008d990 auth_method 0 2026-02-12T18:10:29.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.138+0000 7f26ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.138+0000 7f26ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.138+0000 7f26ff7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:29.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.138+0000 7f26ff7fe640 1 -- 10.20.193.48:0/1494039054 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270008d990 msgr2=0x7f2700129470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-12T18:10:29.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.138+0000 7f26ff7fe640 1 -- 10.20.193.48:0/1494039054 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270008d990 msgr2=0x7f2700129470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:10:29.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.138+0000 7f26ff7fe640 1 --2- 10.20.193.48:0/1494039054 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270008d990 0x7f2700129470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:29.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.138+0000 7f26ff7fe640 1 --2- 10.20.193.48:0/1494039054 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270008d990 0x7f2700129470 unknown :-1 s=START_CONNECT pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:10:29.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.539+0000 7f26ff7fe640 1 --2- 10.20.193.48:0/1494039054 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270008d990 0x7f2700129470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.539+0000 7f26ff7fe640 10 monclient: get_auth_request con 0x7f270008d990 auth_method 0 2026-02-12T18:10:29.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.539+0000 7f26ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.539+0000 7f26ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.539+0000 7f26ff7fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:29.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.539+0000 7f26ff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.539+0000 7f26ff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.539+0000 7f26ff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.539+0000 7f26ff7fe640 10 monclient(hunting): handle_auth_done global_id 64102 payload 824 2026-02-12T18:10:29.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.539+0000 7f26ff7fe640 1 -- 10.20.193.48:0/1494039054 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2700097de0 con 0x7f270008d990 2026-02-12T18:10:29.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.541+0000 7f26ff7fe640 1 -- 10.20.193.48:0/1494039054 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270008d990 msgr2=0x7f2700129470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:29.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.541+0000 7f26ff7fe640 1 --2- 10.20.193.48:0/1494039054 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270008d990 0x7f2700129470 secure :-1 s=READY pgs=13 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26ec0090b0 tx=0x7f26ec004770 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:29.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.541+0000 7f26dbfff640 1 -- 10.20.193.48:0/1494039054 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f26ec0045d0 con 0x7f270008d990 2026-02-12T18:10:29.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.541+0000 7f26dbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:29.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.541+0000 7f26dbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:10:29.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.541+0000 7f26dbfff640 10 monclient: dump: 2026-02-12T18:10:29.544 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:29.544 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.544 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.544 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.544 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:29.544 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.544 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:29.545 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:29.545 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:29.545 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:29.545 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:29.545 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:29.545 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:29.545 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:29.545 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:29.545 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.541+0000 7f26dbfff640 1 -- 10.20.193.48:0/1494039054 <== mon.4 v2:10.20.193.48:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f26ec003af0 con 0x7f270008d990 2026-02-12T18:10:29.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.541+0000 7f26dbfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:29.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.541+0000 7f26dbfff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:10:29.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.541+0000 7f26dbfff640 1 -- 10.20.193.48:0/1494039054 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270008d990 msgr2=0x7f2700129470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.541+0000 7f26dbfff640 1 --2- 10.20.193.48:0/1494039054 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270008d990 0x7f2700129470 secure :-1 s=READY pgs=13 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26ec0090b0 tx=0x7f26ec004770 comp rx=0 tx=0).stop 2026-02-12T18:10:29.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.541+0000 7f26dbfff640 1 -- 10.20.193.48:0/1494039054 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270008d990 msgr2=0x7f2700129470 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:29.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.541+0000 7f26dbfff640 1 --2- 10.20.193.48:0/1494039054 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f270008d990 0x7f2700129470 secure :-1 s=CLOSED pgs=13 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26ec0090b0 tx=0x7f26ec004770 comp rx=0 tx=0).stop 2026-02-12T18:10:29.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.545+0000 7f2705e1b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:10:29.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.545+0000 7f2705e1b640 1 --2- 10.20.193.48:0/1494039054 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f27000914d0 0x7f27001299b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.545+0000 7f2705e1b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.545+0000 7f2705e1b640 1 -- 10.20.193.48:0/1494039054 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f270005fd90 con 0x7f27000914d0 2026-02-12T18:10:29.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.545+0000 7f26ff7fe640 1 --2- 10.20.193.48:0/1494039054 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f27000914d0 0x7f27001299b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=10 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.545+0000 7f26ff7fe640 10 monclient: get_auth_request con 0x7f27000914d0 auth_method 0 2026-02-12T18:10:29.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.545+0000 7f26ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.545+0000 7f26ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.545+0000 7f26ff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.545+0000 7f26ff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.545+0000 7f26ff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.545+0000 7f26ff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.545+0000 7f26ff7fe640 10 monclient(hunting): handle_auth_done global_id 64111 payload 824 2026-02-12T18:10:29.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.545+0000 7f26ff7fe640 1 -- 10.20.193.48:0/1494039054 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f270005cd20 con 0x7f27000914d0 2026-02-12T18:10:29.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.547+0000 7f26ff7fe640 1 -- 10.20.193.48:0/1494039054 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f27000914d0 msgr2=0x7f27001299b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:29.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.547+0000 7f26ff7fe640 1 --2- 10.20.193.48:0/1494039054 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f27000914d0 0x7f27001299b0 secure :-1 s=READY pgs=14 gs=10 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26ec02ed90 tx=0x7f26ec009210 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:29.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.547+0000 7f26dbfff640 1 -- 10.20.193.48:0/1494039054 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f26ec003e70 con 0x7f27000914d0 2026-02-12T18:10:29.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.547+0000 7f26dbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:29.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.547+0000 7f26dbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:10:29.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.547+0000 7f26dbfff640 10 monclient: dump: 2026-02-12T18:10:29.550 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:29.550 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.551 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.551 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.551 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:29.551 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.551 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:29.551 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:29.551 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:29.551 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:29.551 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:29.551 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:29.551 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:29.551 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:29.552 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:29.552 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.547+0000 7f26dbfff640 1 -- 10.20.193.48:0/1494039054 <== mon.4 v2:10.20.193.48:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7f26ec04fd20 con 0x7f27000914d0 2026-02-12T18:10:29.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.547+0000 7f26dbfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:10:29.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.547+0000 7f26dbfff640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:10:29.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.547+0000 7f26dbfff640 1 -- 10.20.193.48:0/1494039054 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f27000914d0 msgr2=0x7f27001299b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.547+0000 7f26dbfff640 1 --2- 10.20.193.48:0/1494039054 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f27000914d0 0x7f27001299b0 secure :-1 s=READY pgs=14 gs=10 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26ec02ed90 tx=0x7f26ec009210 comp rx=0 tx=0).stop 2026-02-12T18:10:29.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.547+0000 7f26dbfff640 1 -- 10.20.193.48:0/1494039054 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f27000914d0 msgr2=0x7f27001299b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:29.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.547+0000 7f26dbfff640 1 --2- 10.20.193.48:0/1494039054 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f27000914d0 0x7f27001299b0 secure :-1 s=CLOSED pgs=14 gs=10 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26ec02ed90 tx=0x7f26ec009210 comp rx=0 tx=0).stop 2026-02-12T18:10:29.553 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:10:29.553 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:10:29.553 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:10:29.553 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:10:29.553 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 46, 2026-02-12T18:10:29.553 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 10334, 2026-02-12T18:10:29.553 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:10:29.553 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:10:29.553 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:10:29.554 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:10:29.554 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:10:29.554 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:10:29.554 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:10:29.554 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:10:29.554 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:10:29.554 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:10:29.554 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:29.554 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 4, 2026-02-12T18:10:29.554 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:29.554 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:10:29.554 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:10:29.555 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:29.555 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:29.555 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:29.555 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:29.555 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:29.555 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:29.555 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:29.555 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:29.555 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:29.555 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:29.555 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:29.555 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:29.556 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:29.556 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:29.556 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:10:29.556 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:10:29.556 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:29.556 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:29.556 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:29.556 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:29.556 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:29.556 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:29.556 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:29.556 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:29.557 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:29.557 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:29.557 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:29.557 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:29.557 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:29.557 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.557 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.557 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:10:29.557 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:10:29.557 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:10:29.557 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:10:29.557 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:10:29.558 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:10:29.558 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:29.558 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:29.558 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:10:29.558 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:10:29.558 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:10:29.558 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:10:29.558 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:10:29.558 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:10:29.558 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:10:29.558 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:29.558 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:10:29.559 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:29.559 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:29.559 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:29.559 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:29.559 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:29.559 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:29.559 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:29.559 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:29.559 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:29.559 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:29.559 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:29.559 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:29.559 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:29.560 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:29.560 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:10:29.560 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.560 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:10:29.560 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.560 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:10:29.560 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:10:29.560 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.560 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.560 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.560 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.561 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:10:29.561 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.561 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.561 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.561 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.561 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:10:29.561 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.561 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.561 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.561 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.561 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:10:29.561 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:10:29.561 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.562 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.562 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:10:29.562 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.562 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.562 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.562 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:10:29.562 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:10:29.562 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.562 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.562 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.562 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.562 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:10:29.563 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.563 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.563 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.563 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.563 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:10:29.563 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.563 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.563 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.563 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.563 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:10:29.563 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:10:29.563 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.563 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.564 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:10:29.564 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.564 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.564 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.564 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:10:29.564 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:10:29.564 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.564 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.564 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.564 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.564 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:10:29.564 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.565 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.565 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.565 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.565 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:10:29.565 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.565 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.565 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.565 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.565 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:10:29.565 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:10:29.565 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.565 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.566 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:10:29.566 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.566 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.566 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.566 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:10:29.566 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:10:29.566 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.566 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.566 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.566 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.566 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:10:29.566 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.566 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.567 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.567 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.567 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:10:29.567 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.567 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.567 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.567 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.567 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:10:29.567 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:10:29.567 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.567 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.567 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:10:29.568 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.568 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.568 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.568 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:10:29.568 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:10:29.568 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.568 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.568 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.568 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.568 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:10:29.568 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.568 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.568 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.569 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.569 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:10:29.569 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.569 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.569 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.569 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.569 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:10:29.569 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:10:29.569 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.569 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.569 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:29.569 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.569 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.570 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.570 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:10:29.570 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:10:29.570 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.570 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.570 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.570 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.570 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:10:29.570 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.570 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.570 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.570 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.571 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:10:29.571 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.571 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.571 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.571 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.571 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:10:29.571 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:10:29.571 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.571 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.571 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:10:29.571 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.571 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.572 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.572 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:10:29.572 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:10:29.572 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.572 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.572 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.572 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.572 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:10:29.572 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.572 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.572 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.572 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.572 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:10:29.573 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.573 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.573 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.573 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.573 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:10:29.573 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:10:29.573 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.573 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.573 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:29.573 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.573 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.573 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.573 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:10:29.574 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:10:29.574 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.574 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.574 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.574 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.574 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:10:29.574 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.574 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.574 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.574 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.574 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:10:29.574 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.575 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.575 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.575 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.575 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:10:29.575 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:10:29.575 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.575 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.575 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:10:29.575 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.575 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.575 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.575 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:10:29.576 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:10:29.576 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.576 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.576 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.576 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.576 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:10:29.576 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.576 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.576 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.576 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.576 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:10:29.576 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.576 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.577 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.577 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.577 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:10:29.577 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:10:29.577 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.577 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.577 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:10:29.577 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.577 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.577 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.577 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.577 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:10:29.577 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:10:29.578 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.578 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:29.578 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:29.578 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:29.578 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.578 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:29.578 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:10:29.578 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.578 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:29.578 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:29.578 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:29.578 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.578 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.579 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.579 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:10:29.579 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:10:29.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.548+0000 7f2705e1b640 1 -- 10.20.193.48:0/1494039054 >> v2:10.20.193.111:6812/977811348 conn(0x7f26d003f800 msgr2=0x7f26d005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.548+0000 7f2705e1b640 1 --2- 10.20.193.48:0/1494039054 >> v2:10.20.193.111:6812/977811348 conn(0x7f26d003f800 0x7f26d005fcb0 secure :-1 s=READY pgs=287 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2700090580 tx=0x7f26f0008040 comp rx=0 tx=0).stop 2026-02-12T18:10:29.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.548+0000 7f2705e1b640 10 monclient: shutdown 2026-02-12T18:10:29.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.548+0000 7f2705e1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:29.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.548+0000 7f2705e1b640 1 -- 10.20.193.48:0/1494039054 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f270013db70 msgr2=0x7f270013d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.548+0000 7f2705e1b640 1 --2- 10.20.193.48:0/1494039054 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f270013db70 0x7f270013d340 secure :-1 s=READY pgs=226 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f26f400d430 tx=0x7f26f400d900 comp rx=0 tx=0).stop 2026-02-12T18:10:29.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.548+0000 7f26fffff640 1 -- 10.20.193.48:0/1494039054 reap_dead start 2026-02-12T18:10:29.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.548+0000 7f2705e1b640 1 -- 10.20.193.48:0/1494039054 shutdown_connections 2026-02-12T18:10:29.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.548+0000 7f2705e1b640 1 --2- 10.20.193.48:0/1494039054 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f270013db70 0x7f270013d340 unknown :-1 s=CLOSED pgs=226 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.548+0000 7f2705e1b640 1 -- 10.20.193.48:0/1494039054 >> 10.20.193.48:0/1494039054 conn(0x7f27000548a0 msgr2=0x7f2700093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:29.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.548+0000 7f2705e1b640 1 -- 10.20.193.48:0/1494039054 shutdown_connections 2026-02-12T18:10:29.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.548+0000 7f2705e1b640 1 -- 10.20.193.48:0/1494039054 wait complete. 2026-02-12T18:10:29.581 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:10:29.581 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2026-02-12T18:10:29.582 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2026-02-12T18:10:29.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.646+0000 7ff44494c640 10 monclient: get_monmap_and_config 2026-02-12T18:10:29.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.646+0000 7ff44494c640 10 monclient: build_initial_monmap 2026-02-12T18:10:29.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.646+0000 7ff44494c640 10 monclient: monmap: 2026-02-12T18:10:29.650 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:29.650 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.651 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:10:29.647317+0000 2026-02-12T18:10:29.651 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:10:29.647317+0000 2026-02-12T18:10:29.651 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:29.651 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.651 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:10:29.651 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:10:29.651 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:29.651 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:29.651 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:29.651 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:29.651 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:29.651 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:29.652 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:29.652 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:10:29.652 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:10:29.652 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.646+0000 7ff44494c640 1 Processor -- start 2026-02-12T18:10:29.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.646+0000 7ff44494c640 1 -- start start 2026-02-12T18:10:29.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.646+0000 7ff44494c640 10 monclient: init 2026-02-12T18:10:29.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.646+0000 7ff44494c640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:29.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.646+0000 7ff44494c640 10 monclient: _add_conns ranks=[4,1,9,0,7,5,3,6,8,10,2] 2026-02-12T18:10:29.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.646+0000 7ff44494c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff43c05c950 0x7ff43c05cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.646+0000 7ff44494c640 10 monclient(hunting): picked mon.noname-c con 0x7ff43c05c950 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:10:29.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff44494c640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7ff43c05e490 addr v1:10.20.193.111:6789/0 2026-02-12T18:10:29.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff44494c640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7ff43c05d260 0x7ff43c13e280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.653 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff44494c640 10 monclient(hunting): picked mon.noname-a con 0x7ff43c05d260 addr v2:10.20.193.48:3300/0 2026-02-12T18:10:29.653 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff44494c640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff43c04dc20 con 0x7ff43c05e490 2026-02-12T18:10:29.653 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff44494c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.653 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff44494c640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7ff43c05ddd0 con 0x7ff43c05d260 2026-02-12T18:10:29.653 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff44494c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.653 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff44494c640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7ff43c092990 con 0x7ff43c05c950 2026-02-12T18:10:29.653 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff44494c640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:29.653 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff44494c640 10 monclient(hunting): authenticate will time out at 868.373028s 2026-02-12T18:10:29.653 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff4426c1640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff43c05c950 0x7ff43c05cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.653 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff442ec2640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7ff43c05d260 0x7ff43c13e280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.653 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff4426c1640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff43c05c950 0x7ff43c05cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:53184/0 (socket says 10.20.193.48:53184) 2026-02-12T18:10:29.653 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff4426c1640 1 -- 10.20.193.48:0/2076422873 learned_addr learned my addr 10.20.193.48:0/2076422873 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:29.653 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff442ec2640 10 monclient(hunting): get_auth_request con 0x7ff43c05d260 auth_method 0 2026-02-12T18:10:29.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff442ec2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff442ec2640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff442ec2640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff4426c1640 10 monclient(hunting): get_auth_request con 0x7ff43c05c950 auth_method 0 2026-02-12T18:10:29.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff4426c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff4426c1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff4426c1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff4426c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff4426c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff4426c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff442ec2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff442ec2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff442ec2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff4426c1640 10 monclient(hunting): handle_auth_done global_id 64120 payload 274 2026-02-12T18:10:29.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff4426c1640 1 -- 10.20.193.48:0/2076422873 >> v2:10.20.193.48:3300/0 conn(0x7ff43c05d260 msgr2=0x7ff43c13e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:29.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff4426c1640 1 --2- 10.20.193.48:0/2076422873 >> v2:10.20.193.48:3300/0 conn(0x7ff43c05d260 0x7ff43c13e280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff4426c1640 1 -- 10.20.193.48:0/2076422873 >> v1:10.20.193.111:6789/0 conn(0x7ff43c05e490 legacy=0x7ff43c13db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:29.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff4426c1640 10 monclient: _finish_hunting 0 2026-02-12T18:10:29.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff4426c1640 1 monclient: found mon.noname-c 2026-02-12T18:10:29.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff4426c1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:29.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff4426c1640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:10:29.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.647+0000 7ff4426c1640 1 -- 10.20.193.48:0/2076422873 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff43c092c70 con 0x7ff43c05c950 2026-02-12T18:10:29.663 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.649+0000 7ff4426c1640 1 -- 10.20.193.48:0/2076422873 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff43c05c950 msgr2=0x7ff43c05cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:29.663 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.649+0000 7ff4426c1640 1 --2- 10.20.193.48:0/2076422873 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff43c05c950 0x7ff43c05cd20 secure :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=437065017457539657 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff434009060 tx=0x7ff43402edf0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=610c451554e7a49 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:29.663 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff4416bf640 1 -- 10.20.193.48:0/2076422873 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff434035340 con 0x7ff43c05c950 2026-02-12T18:10:29.663 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff4416bf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:29.663 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff4416bf640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:10:29.663 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff4416bf640 10 monclient: dump: 2026-02-12T18:10:29.663 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:29.663 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.663 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.663 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.663 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:29.663 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.664 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:29.664 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:29.664 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:29.664 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:29.664 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:29.664 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:29.664 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:29.664 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:29.664 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:29.664 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff4416bf640 10 monclient: _finish_auth 0 2026-02-12T18:10:29.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff4416bf640 10 monclient: _check_auth_tickets 2026-02-12T18:10:29.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff4416bf640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:29.665 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff4416bf640 1 -- 10.20.193.48:0/2076422873 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4340354c0 con 0x7ff43c05c950 2026-02-12T18:10:29.665 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff4416bf640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:29.665 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff4416bf640 1 -- 10.20.193.48:0/2076422873 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff434035af0 con 0x7ff43c05c950 2026-02-12T18:10:29.665 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff44494c640 5 monclient: authenticate success, global_id 64120 2026-02-12T18:10:29.665 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff44494c640 10 monclient: get_monmap_and_config success 2026-02-12T18:10:29.665 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff44494c640 4 set_mon_vals no callback set 2026-02-12T18:10:29.665 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff4416bf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:29.665 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff4416bf640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:10:29.665 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff4416bf640 10 monclient: dump: 2026-02-12T18:10:29.665 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:29.665 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.665 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.665 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.665 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:29.666 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.666 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:29.666 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:29.666 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:29.666 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:29.666 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:29.666 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:29.666 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:29.666 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:29.666 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:29.666 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff44494c640 10 monclient: shutdown 2026-02-12T18:10:29.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff44494c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:29.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff44494c640 1 -- 10.20.193.48:0/2076422873 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff43c05c950 msgr2=0x7ff43c05cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff44494c640 1 --2- 10.20.193.48:0/2076422873 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff43c05c950 0x7ff43c05cd20 secure :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=437065017457539657 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff434009060 tx=0x7ff43402edf0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff44494c640 1 -- 10.20.193.48:0/2076422873 shutdown_connections 2026-02-12T18:10:29.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff44494c640 1 --2- 10.20.193.48:0/2076422873 >> v2:10.20.193.48:3300/0 conn(0x7ff43c05d260 0x7ff43c13e280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff44494c640 1 --2- 10.20.193.48:0/2076422873 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff43c05c950 0x7ff43c05cd20 unknown :-1 s=CLOSED pgs=15 gs=2 cs=0 l=1 c_cookie=437065017457539657 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff44494c640 1 -- 10.20.193.48:0/2076422873 >> 10.20.193.48:0/2076422873 conn(0x7ff43c0548a0 msgr2=0x7ff43c097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:29.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff44494c640 1 -- 10.20.193.48:0/2076422873 shutdown_connections 2026-02-12T18:10:29.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff44494c640 1 -- 10.20.193.48:0/2076422873 wait complete. 2026-02-12T18:10:29.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff44494c640 10 monclient: build_initial_monmap 2026-02-12T18:10:29.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff44494c640 10 monclient: monmap: 2026-02-12T18:10:29.667 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:29.667 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:10:29.667 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:10:29.667 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:10:29.667 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:29.668 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.668 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:10:29.668 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:10:29.668 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:29.668 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:29.668 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:29.668 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:29.668 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:29.668 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:29.668 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:29.668 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.650+0000 7ff44494c640 1 Processor -- start 2026-02-12T18:10:29.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff44494c640 1 -- start start 2026-02-12T18:10:29.668 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff44494c640 10 monclient: init 2026-02-12T18:10:29.669 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff44494c640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:29.669 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff44494c640 10 monclient: _add_conns ranks=[3,0,4,8,5,1,2,7,6] 2026-02-12T18:10:29.669 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff44494c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff43c05c950 0x7ff43c12d990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.669 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff44494c640 10 monclient(hunting): picked mon.noname-g con 0x7ff43c05c950 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:10:29.669 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff44494c640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff43c05d260 0x7ff43c08d540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.669 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff44494c640 10 monclient(hunting): picked mon.noname-a con 0x7ff43c05d260 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:10:29.669 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff44494c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff43c05e490 0x7ff43c13ddc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.669 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff44494c640 10 monclient(hunting): picked mon.noname-c con 0x7ff43c05e490 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:10:29.669 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff44494c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.669 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff44494c640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7ff43c08ba50 con 0x7ff43c05d260 2026-02-12T18:10:29.669 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff44494c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.669 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff44494c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff43c141ac0 con 0x7ff43c05c950 2026-02-12T18:10:29.669 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff44494c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff44494c640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7ff43c08ac50 con 0x7ff43c05e490 2026-02-12T18:10:29.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff44494c640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:29.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff44494c640 10 monclient(hunting): authenticate will time out at 868.377273s 2026-02-12T18:10:29.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff441ec0640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff43c05d260 0x7ff43c08d540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff442ec2640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff43c05e490 0x7ff43c13ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff441ec0640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff43c05d260 0x7ff43c08d540 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:58068/0 (socket says 10.20.193.48:58068) 2026-02-12T18:10:29.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff441ec0640 1 -- 10.20.193.48:0/3028485256 learned_addr learned my addr 10.20.193.48:0/3028485256 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:29.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff441ec0640 10 monclient(hunting): get_auth_request con 0x7ff43c05d260 auth_method 0 2026-02-12T18:10:29.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff441ec0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff441ec0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff441ec0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff442ec2640 10 monclient(hunting): get_auth_request con 0x7ff43c05e490 auth_method 0 2026-02-12T18:10:29.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff442ec2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff442ec2640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff442ec2640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff441ec0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff441ec0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff441ec0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff442ec2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff442ec2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff442ec2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff4426c1640 1 --2- 10.20.193.48:0/3028485256 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff43c05c950 0x7ff43c12d990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff4426c1640 10 monclient(hunting): get_auth_request con 0x7ff43c05c950 auth_method 0 2026-02-12T18:10:29.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff4426c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff4426c1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff4426c1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff441ec0640 10 monclient(hunting): handle_auth_done global_id 5832 payload 824 2026-02-12T18:10:29.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff441ec0640 1 -- 10.20.193.48:0/3028485256 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff43c05e490 msgr2=0x7ff43c13ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff441ec0640 1 --2- 10.20.193.48:0/3028485256 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff43c05e490 0x7ff43c13ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff441ec0640 1 -- 10.20.193.48:0/3028485256 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff43c05c950 msgr2=0x7ff43c12d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff441ec0640 1 --2- 10.20.193.48:0/3028485256 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff43c05c950 0x7ff43c12d990 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff441ec0640 10 monclient: _finish_hunting 0 2026-02-12T18:10:29.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff441ec0640 1 monclient: found mon.noname-a 2026-02-12T18:10:29.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff441ec0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:29.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff441ec0640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:10:29.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff441ec0640 1 -- 10.20.193.48:0/3028485256 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4340094f0 con 0x7ff43c05d260 2026-02-12T18:10:29.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.651+0000 7ff442ec2640 1 --2- 10.20.193.48:0/3028485256 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff43c05e490 0x7ff43c13ddc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:10:29.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.653+0000 7ff441ec0640 1 -- 10.20.193.48:0/3028485256 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff43c05d260 msgr2=0x7ff43c08d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:29.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.653+0000 7ff441ec0640 1 --2- 10.20.193.48:0/3028485256 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff43c05d260 0x7ff43c08d540 secure :-1 s=READY pgs=352 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff42800c480 tx=0x7ff42800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:29.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.653+0000 7ff426ffd640 1 -- 10.20.193.48:0/3028485256 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff428006d50 con 0x7ff43c05d260 2026-02-12T18:10:29.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.653+0000 7ff426ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:29.673 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.653+0000 7ff426ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:10:29.673 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.653+0000 7ff426ffd640 10 monclient: dump: 2026-02-12T18:10:29.673 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:29.673 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.673 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.673 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.673 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:29.673 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.673 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:29.673 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:29.673 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:29.673 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:29.673 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:29.673 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:29.674 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:29.674 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:29.674 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:29.674 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.674 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.653+0000 7ff426ffd640 10 monclient: _finish_auth 0 2026-02-12T18:10:29.674 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.653+0000 7ff426ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:10:29.674 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.653+0000 7ff426ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:29.674 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.653+0000 7ff426ffd640 1 -- 10.20.193.48:0/3028485256 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff428007030 con 0x7ff43c05d260 2026-02-12T18:10:29.674 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.653+0000 7ff426ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:29.674 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.653+0000 7ff426ffd640 1 -- 10.20.193.48:0/3028485256 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff428007660 con 0x7ff43c05d260 2026-02-12T18:10:29.674 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.653+0000 7ff426ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:29.674 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.653+0000 7ff426ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:10:29.674 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.653+0000 7ff440ebe640 4 set_mon_vals no callback set 2026-02-12T18:10:29.675 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.653+0000 7ff426ffd640 10 monclient: dump: 2026-02-12T18:10:29.675 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:29.675 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.675 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.675 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.675 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:29.675 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.675 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:29.675 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:29.675 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:29.675 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:29.675 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:29.675 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:29.675 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:29.676 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:29.676 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:29.676 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.653+0000 7ff44494c640 5 monclient: authenticate success, global_id 5832 2026-02-12T18:10:29.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.653+0000 7ff44494c640 10 monclient: _renew_subs 2026-02-12T18:10:29.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.653+0000 7ff44494c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:10:29.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.653+0000 7ff44494c640 1 -- 10.20.193.48:0/3028485256 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff43c08b770 con 0x7ff43c05d260 2026-02-12T18:10:29.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.653+0000 7ff44494c640 10 monclient: _renew_subs 2026-02-12T18:10:29.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.653+0000 7ff44494c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:10:29.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.653+0000 7ff44494c640 1 -- 10.20.193.48:0/3028485256 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff43c12e5e0 con 0x7ff43c05d260 2026-02-12T18:10:29.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.654+0000 7ff44494c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:29.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.654+0000 7ff44494c640 1 --2- 10.20.193.48:0/3028485256 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff43c08a810 0x7ff43c12a410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.654+0000 7ff44494c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.654+0000 7ff44494c640 1 -- 10.20.193.48:0/3028485256 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7ff43c08b900 con 0x7ff43c08a810 2026-02-12T18:10:29.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.654+0000 7ff4426c1640 1 --2- 10.20.193.48:0/3028485256 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff43c08a810 0x7ff43c12a410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.654+0000 7ff4426c1640 10 monclient: get_auth_request con 0x7ff43c08a810 auth_method 0 2026-02-12T18:10:29.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.654+0000 7ff4426c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.654+0000 7ff4426c1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.654+0000 7ff4426c1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.654+0000 7ff426ffd640 1 -- 10.20.193.48:0/3028485256 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7ff4280071a0 con 0x7ff43c05d260 2026-02-12T18:10:29.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.654+0000 7ff4426c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.654+0000 7ff4426c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.654+0000 7ff4426c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.654+0000 7ff426ffd640 1 --2- 10.20.193.48:0/3028485256 >> v2:10.20.193.111:6812/977811348 conn(0x7ff40c03f800 0x7ff40c05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.654+0000 7ff426ffd640 1 -- 10.20.193.48:0/3028485256 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(210..210 src has 1..210) ==== 3897+0+0 (secure 0 0 0) 0x7ff428051fb0 con 0x7ff43c05d260 2026-02-12T18:10:29.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.654+0000 7ff4426c1640 10 monclient(hunting): handle_auth_done global_id 5505 payload 824 2026-02-12T18:10:29.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.654+0000 7ff4426c1640 1 -- 10.20.193.48:0/3028485256 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff43c097de0 con 0x7ff43c08a810 2026-02-12T18:10:29.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.654+0000 7ff442ec2640 1 --2- 10.20.193.48:0/3028485256 >> v2:10.20.193.111:6812/977811348 conn(0x7ff40c03f800 0x7ff40c05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.654+0000 7ff442ec2640 10 monclient: get_auth_request con 0x7ff40c03f800 auth_method 0 2026-02-12T18:10:29.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.657+0000 7ff4426c1640 1 -- 10.20.193.48:0/3028485256 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff43c08a810 msgr2=0x7ff43c12a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:29.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.657+0000 7ff4426c1640 1 --2- 10.20.193.48:0/3028485256 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff43c08a810 0x7ff43c12a410 secure :-1 s=READY pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff434004740 tx=0x7ff4340047e0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:29.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.657+0000 7ff426ffd640 1 -- 10.20.193.48:0/3028485256 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff434035de0 con 0x7ff43c08a810 2026-02-12T18:10:29.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.657+0000 7ff426ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:29.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.657+0000 7ff426ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:10:29.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.657+0000 7ff426ffd640 10 monclient: dump: 2026-02-12T18:10:29.678 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:29.678 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.678 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.678 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.678 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:29.678 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.679 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:29.679 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:29.679 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:29.679 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:29.679 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:29.679 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:29.679 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:29.679 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:29.679 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:29.679 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.657+0000 7ff426ffd640 1 -- 10.20.193.48:0/3028485256 <== mon.6 v2:10.20.193.48:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7ff434037440 con 0x7ff43c08a810 2026-02-12T18:10:29.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.657+0000 7ff426ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:29.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.657+0000 7ff426ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:10:29.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.657+0000 7ff426ffd640 1 -- 10.20.193.48:0/3028485256 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff43c08a810 msgr2=0x7ff43c12a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.657+0000 7ff426ffd640 1 --2- 10.20.193.48:0/3028485256 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff43c08a810 0x7ff43c12a410 secure :-1 s=READY pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff434004740 tx=0x7ff4340047e0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.657+0000 7ff426ffd640 1 -- 10.20.193.48:0/3028485256 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff43c08a810 msgr2=0x7ff43c12a410 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:29.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.657+0000 7ff426ffd640 1 --2- 10.20.193.48:0/3028485256 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff43c08a810 0x7ff43c12a410 secure :-1 s=CLOSED pgs=190 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff434004740 tx=0x7ff4340047e0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.657+0000 7ff442ec2640 1 --2- 10.20.193.48:0/3028485256 >> v2:10.20.193.111:6812/977811348 conn(0x7ff40c03f800 0x7ff40c05fcb0 secure :-1 s=READY pgs=288 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff43c08b200 tx=0x7ff43000a2d0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:29.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.660+0000 7ff44494c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:10:29.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.660+0000 7ff44494c640 1 --2- 10.20.193.48:0/3028485256 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff43c12a950 0x7ff43c12ad50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.660+0000 7ff44494c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.660+0000 7ff44494c640 1 -- 10.20.193.48:0/3028485256 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7ff43c050410 con 0x7ff43c12a950 2026-02-12T18:10:29.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.660+0000 7ff4426c1640 1 --2- 10.20.193.48:0/3028485256 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff43c12a950 0x7ff43c12ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.660+0000 7ff4426c1640 10 monclient: get_auth_request con 0x7ff43c12a950 auth_method 0 2026-02-12T18:10:29.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.660+0000 7ff4426c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.660+0000 7ff4426c1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.660+0000 7ff4426c1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.660+0000 7ff4426c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.660+0000 7ff4426c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.660+0000 7ff4426c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.660+0000 7ff4426c1640 10 monclient(hunting): handle_auth_done global_id 5514 payload 824 2026-02-12T18:10:29.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.660+0000 7ff4426c1640 1 -- 10.20.193.48:0/3028485256 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff43c12b290 con 0x7ff43c12a950 2026-02-12T18:10:29.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.663+0000 7ff4426c1640 1 -- 10.20.193.48:0/3028485256 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff43c12a950 msgr2=0x7ff43c12ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:29.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.663+0000 7ff4426c1640 1 --2- 10.20.193.48:0/3028485256 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff43c12a950 0x7ff43c12ad50 secure :-1 s=READY pgs=191 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff43402ffd0 tx=0x7ff434004770 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:29.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.663+0000 7ff426ffd640 1 -- 10.20.193.48:0/3028485256 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff434050070 con 0x7ff43c12a950 2026-02-12T18:10:29.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.663+0000 7ff426ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:29.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.663+0000 7ff426ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:10:29.682 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.663+0000 7ff426ffd640 10 monclient: dump: 2026-02-12T18:10:29.682 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:29.682 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.682 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.682 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.682 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:29.682 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.682 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:29.683 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:29.683 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:29.683 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:29.683 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:29.683 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:29.683 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:29.683 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:29.683 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:29.683 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.683 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.663+0000 7ff426ffd640 1 -- 10.20.193.48:0/3028485256 <== mon.6 v2:10.20.193.48:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10015 (secure 0 0 0) 0x7ff434041700 con 0x7ff43c12a950 2026-02-12T18:10:29.683 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.663+0000 7ff426ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:10:29.683 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.663+0000 7ff426ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:10:29.683 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.663+0000 7ff426ffd640 1 -- 10.20.193.48:0/3028485256 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff43c12a950 msgr2=0x7ff43c12ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.683 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.663+0000 7ff426ffd640 1 --2- 10.20.193.48:0/3028485256 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff43c12a950 0x7ff43c12ad50 secure :-1 s=READY pgs=191 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff43402ffd0 tx=0x7ff434004770 comp rx=0 tx=0).stop 2026-02-12T18:10:29.683 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.663+0000 7ff426ffd640 1 -- 10.20.193.48:0/3028485256 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff43c12a950 msgr2=0x7ff43c12ad50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:29.683 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.663+0000 7ff426ffd640 1 --2- 10.20.193.48:0/3028485256 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff43c12a950 0x7ff43c12ad50 secure :-1 s=CLOSED pgs=191 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff43402ffd0 tx=0x7ff434004770 comp rx=0 tx=0).stop 2026-02-12T18:10:29.684 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:10:29.684 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:10:29.684 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:10:29.684 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:10:29.684 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 46, 2026-02-12T18:10:29.684 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 284490, 2026-02-12T18:10:29.684 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:10:29.684 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:10:29.684 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:10:29.684 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:10:29.684 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:10:29.684 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:10:29.685 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:10:29.685 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:10:29.685 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:10:29.685 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:10:29.685 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:29.685 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 4, 2026-02-12T18:10:29.685 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:29.685 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:10:29.685 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:10:29.685 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:29.685 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:29.685 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:29.685 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:29.685 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:29.685 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:29.685 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:29.685 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:29.686 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:29.686 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:29.686 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:29.686 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:29.686 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:29.686 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:29.686 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:10:29.686 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:10:29.686 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:29.686 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:29.686 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:29.686 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:29.686 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:29.686 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:29.686 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:29.686 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:29.686 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:29.686 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:29.687 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:29.687 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:29.687 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:29.687 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.687 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.687 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:10:29.687 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:10:29.687 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:10:29.687 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:10:29.687 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:10:29.687 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:10:29.687 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:29.687 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:29.687 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:10:29.687 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:10:29.687 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:10:29.687 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:10:29.687 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:10:29.688 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:10:29.688 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:10:29.688 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:29.688 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:10:29.688 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:29.688 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:29.688 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:29.688 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:29.688 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:29.688 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:29.688 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:29.688 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:29.688 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:29.688 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:29.688 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:29.688 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:29.688 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:29.688 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:29.688 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:10:29.688 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.689 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:10:29.689 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.689 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:10:29.689 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:10:29.689 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.689 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.689 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.689 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.689 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:10:29.689 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.689 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.689 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.689 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.689 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:10:29.689 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.689 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.689 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.689 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.689 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:10:29.689 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:10:29.690 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.690 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.690 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:10:29.690 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.690 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.690 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.690 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:10:29.690 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:10:29.690 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.690 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.690 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.690 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.690 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:10:29.690 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.690 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.690 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.690 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.690 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:10:29.690 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.690 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.691 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.691 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.691 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:10:29.691 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:10:29.691 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.691 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.691 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:10:29.691 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.691 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.691 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.691 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:10:29.691 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:10:29.691 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.691 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.691 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.691 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.691 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:10:29.691 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.691 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.691 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.691 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.691 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:10:29.692 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.692 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.692 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.692 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.692 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:10:29.692 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:10:29.692 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.692 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.692 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:10:29.692 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.692 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.692 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.692 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:10:29.692 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:10:29.692 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.692 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.692 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.692 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.692 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:10:29.692 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.692 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.692 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.693 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.693 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:10:29.693 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.693 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.693 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.693 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.693 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:10:29.693 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:10:29.693 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.693 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.693 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:10:29.693 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.693 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.693 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.693 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:10:29.693 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:10:29.693 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.693 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.693 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.693 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.693 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:10:29.693 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.694 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.694 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.694 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.694 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:10:29.694 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.694 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.694 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.694 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.694 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:10:29.694 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:10:29.694 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.694 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.694 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:29.694 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.694 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.694 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.694 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:10:29.694 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:10:29.694 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.694 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.694 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.695 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.695 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:10:29.695 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.695 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.695 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.695 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.695 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:10:29.695 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.695 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.695 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.695 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.695 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:10:29.695 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:10:29.695 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.695 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.695 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:10:29.695 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.695 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.695 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.695 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:10:29.695 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:10:29.695 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.695 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.696 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.696 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.696 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:10:29.696 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.696 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.696 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.696 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.696 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:10:29.696 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.696 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.696 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.696 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.696 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:10:29.696 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:10:29.696 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.696 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.696 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:29.696 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.696 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.696 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.696 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:10:29.696 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:10:29.696 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.697 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.697 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.697 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.697 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:10:29.697 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.697 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.697 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.697 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.697 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:10:29.697 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.697 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.697 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.697 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.697 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:10:29.697 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:10:29.697 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.697 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.697 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:10:29.697 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.697 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.697 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.697 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:10:29.698 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:10:29.698 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.698 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.698 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.698 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.698 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:10:29.698 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.698 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.698 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.698 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.698 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:10:29.698 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.698 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.698 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.698 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.698 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:10:29.698 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:10:29.698 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.698 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.698 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:10:29.698 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.698 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.698 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.698 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.698 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:10:29.699 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:10:29.699 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.699 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:29.699 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:29.699 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:29.699 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.699 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:29.699 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:10:29.699 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.699 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:29.699 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:29.699 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:10:29.699 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.699 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.699 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.699 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:10:29.699 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:10:29.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.663+0000 7ff44494c640 1 -- 10.20.193.48:0/3028485256 >> v2:10.20.193.111:6812/977811348 conn(0x7ff40c03f800 msgr2=0x7ff40c05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.663+0000 7ff44494c640 1 --2- 10.20.193.48:0/3028485256 >> v2:10.20.193.111:6812/977811348 conn(0x7ff40c03f800 0x7ff40c05fcb0 secure :-1 s=READY pgs=288 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff43c08b200 tx=0x7ff43000a2d0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.663+0000 7ff44494c640 10 monclient: shutdown 2026-02-12T18:10:29.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.663+0000 7ff44494c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:29.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.663+0000 7ff44494c640 1 -- 10.20.193.48:0/3028485256 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff43c05d260 msgr2=0x7ff43c08d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.663+0000 7ff442ec2640 1 -- 10.20.193.48:0/3028485256 reap_dead start 2026-02-12T18:10:29.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.663+0000 7ff44494c640 1 --2- 10.20.193.48:0/3028485256 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff43c05d260 0x7ff43c08d540 secure :-1 s=READY pgs=352 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff42800c480 tx=0x7ff42800c950 comp rx=0 tx=0).stop 2026-02-12T18:10:29.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.663+0000 7ff44494c640 1 -- 10.20.193.48:0/3028485256 shutdown_connections 2026-02-12T18:10:29.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.663+0000 7ff44494c640 1 --2- 10.20.193.48:0/3028485256 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff43c05d260 0x7ff43c08d540 unknown :-1 s=CLOSED pgs=352 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.663+0000 7ff44494c640 1 -- 10.20.193.48:0/3028485256 >> 10.20.193.48:0/3028485256 conn(0x7ff43c0548a0 msgr2=0x7ff43c122e50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:29.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.663+0000 7ff44494c640 1 -- 10.20.193.48:0/3028485256 shutdown_connections 2026-02-12T18:10:29.700 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.663+0000 7ff44494c640 1 -- 10.20.193.48:0/3028485256 wait complete. 2026-02-12T18:10:29.701 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:10:29.701 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2026-02-12T18:10:29.701 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2026-02-12T18:10:29.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.764+0000 7f95d75f6640 10 monclient: get_monmap_and_config 2026-02-12T18:10:29.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.764+0000 7f95d75f6640 10 monclient: build_initial_monmap 2026-02-12T18:10:29.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.764+0000 7f95d75f6640 10 monclient: monmap: 2026-02-12T18:10:29.766 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:29.766 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.766 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:10:29.765589+0000 2026-02-12T18:10:29.766 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:10:29.765589+0000 2026-02-12T18:10:29.766 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:29.766 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.766 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:10:29.766 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:10:29.766 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:29.766 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:29.766 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:29.766 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:29.766 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:29.766 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:29.766 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:29.766 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:10:29.766 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:10:29.767 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.764+0000 7f95d75f6640 1 Processor -- start 2026-02-12T18:10:29.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.764+0000 7f95d75f6640 1 -- start start 2026-02-12T18:10:29.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.764+0000 7f95d75f6640 10 monclient: init 2026-02-12T18:10:29.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d75f6640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:29.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d75f6640 10 monclient: _add_conns ranks=[5,4,9,7,1,10,2,0,3,8,6] 2026-02-12T18:10:29.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d75f6640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f95d005d550 0x7f95d005d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d75f6640 10 monclient(hunting): picked mon.noname-h con 0x7f95d005d550 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:10:29.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d75f6640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f95d005de60 0x7f95d0141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d75f6640 10 monclient(hunting): picked mon.noname-c con 0x7f95d005de60 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:10:29.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d75f6640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f95d013ef60 0x7f95d01424e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d75f6640 10 monclient(hunting): picked mon.noname-a con 0x7f95d013ef60 addr v2:10.20.193.48:3300/0 2026-02-12T18:10:29.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d75f6640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d75f6640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f95d008d390 con 0x7f95d013ef60 2026-02-12T18:10:29.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d75f6640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d75f6640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f95d008d5a0 con 0x7f95d005de60 2026-02-12T18:10:29.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d75f6640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d75f6640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f95d00580e0 con 0x7f95d005d550 2026-02-12T18:10:29.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d75f6640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:29.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d75f6640 10 monclient(hunting): authenticate will time out at 868.491271s 2026-02-12T18:10:29.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d4b6a640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f95d005de60 0x7f95d0141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d5b6c640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f95d013ef60 0x7f95d01424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d4b6a640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f95d005de60 0x7f95d0141fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:53192/0 (socket says 10.20.193.48:53192) 2026-02-12T18:10:29.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d4b6a640 1 -- 10.20.193.48:0/343216578 learned_addr learned my addr 10.20.193.48:0/343216578 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:29.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d5b6c640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f95d013ef60 0x7f95d01424e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:58070/0 (socket says 10.20.193.48:58070) 2026-02-12T18:10:29.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d5b6c640 10 monclient(hunting): get_auth_request con 0x7f95d013ef60 auth_method 0 2026-02-12T18:10:29.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d5b6c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d5b6c640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d5b6c640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d4b6a640 10 monclient(hunting): get_auth_request con 0x7f95d005de60 auth_method 0 2026-02-12T18:10:29.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d4b6a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d4b6a640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d4b6a640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d4b6a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d4b6a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d4b6a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d5b6c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d5b6c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d536b640 1 --2- 10.20.193.48:0/343216578 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f95d005d550 0x7f95d005d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d5b6c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d536b640 10 monclient(hunting): get_auth_request con 0x7f95d005d550 auth_method 0 2026-02-12T18:10:29.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d536b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d536b640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d536b640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d4b6a640 10 monclient(hunting): handle_auth_done global_id 64138 payload 274 2026-02-12T18:10:29.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d4b6a640 1 -- 10.20.193.48:0/343216578 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f95d005d550 msgr2=0x7f95d005d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:29.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d4b6a640 1 --2- 10.20.193.48:0/343216578 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f95d005d550 0x7f95d005d920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d4b6a640 1 -- 10.20.193.48:0/343216578 >> v2:10.20.193.48:3300/0 conn(0x7f95d013ef60 msgr2=0x7f95d01424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:29.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d4b6a640 1 --2- 10.20.193.48:0/343216578 >> v2:10.20.193.48:3300/0 conn(0x7f95d013ef60 0x7f95d01424e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d4b6a640 10 monclient: _finish_hunting 0 2026-02-12T18:10:29.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d4b6a640 1 monclient: found mon.noname-c 2026-02-12T18:10:29.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d4b6a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:29.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d4b6a640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:10:29.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.765+0000 7f95d4b6a640 1 -- 10.20.193.48:0/343216578 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95d004dc20 con 0x7f95d005de60 2026-02-12T18:10:29.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95d4b6a640 1 -- 10.20.193.48:0/343216578 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f95d005de60 msgr2=0x7f95d0141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:29.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95d4b6a640 1 --2- 10.20.193.48:0/343216578 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f95d005de60 0x7f95d0141fa0 secure :-1 s=READY pgs=16 gs=2 cs=0 l=1 c_cookie=11529455711075671204 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95c4009060 tx=0x7f95c402edf0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=a000dae230439ca4 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:29.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95bffff640 1 -- 10.20.193.48:0/343216578 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f95c4035340 con 0x7f95d005de60 2026-02-12T18:10:29.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95bffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:29.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95bffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:10:29.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95bffff640 10 monclient: dump: 2026-02-12T18:10:29.773 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:29.773 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.773 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.773 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.773 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:29.773 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.773 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:29.773 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:29.773 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:29.773 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:29.773 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:29.773 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:29.773 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:29.773 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:29.774 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:29.774 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95bffff640 10 monclient: _finish_auth 0 2026-02-12T18:10:29.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95bffff640 10 monclient: _check_auth_tickets 2026-02-12T18:10:29.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95bffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:29.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95bffff640 1 -- 10.20.193.48:0/343216578 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95c40354c0 con 0x7f95d005de60 2026-02-12T18:10:29.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95bffff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:29.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95d75f6640 5 monclient: authenticate success, global_id 64138 2026-02-12T18:10:29.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95bffff640 1 -- 10.20.193.48:0/343216578 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f95c4035af0 con 0x7f95d005de60 2026-02-12T18:10:29.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95d75f6640 10 monclient: get_monmap_and_config success 2026-02-12T18:10:29.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95bffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:29.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95d75f6640 4 set_mon_vals no callback set 2026-02-12T18:10:29.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95bffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:10:29.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95bffff640 10 monclient: dump: 2026-02-12T18:10:29.774 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:29.774 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.774 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.774 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.774 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:29.774 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.774 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:29.774 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:29.774 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:29.774 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:29.775 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:29.775 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:29.775 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:29.775 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:29.775 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:29.775 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95d75f6640 10 monclient: shutdown 2026-02-12T18:10:29.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95d75f6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:29.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95d75f6640 1 -- 10.20.193.48:0/343216578 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f95d005de60 msgr2=0x7f95d0141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95d75f6640 1 --2- 10.20.193.48:0/343216578 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f95d005de60 0x7f95d0141fa0 secure :-1 s=READY pgs=16 gs=2 cs=0 l=1 c_cookie=11529455711075671204 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95c4009060 tx=0x7f95c402edf0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95d75f6640 1 -- 10.20.193.48:0/343216578 shutdown_connections 2026-02-12T18:10:29.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95d75f6640 1 --2- 10.20.193.48:0/343216578 >> v2:10.20.193.48:3300/0 conn(0x7f95d013ef60 0x7f95d01424e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95d75f6640 1 --2- 10.20.193.48:0/343216578 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f95d005de60 0x7f95d0141fa0 unknown :-1 s=CLOSED pgs=16 gs=2 cs=0 l=1 c_cookie=11529455711075671204 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95d75f6640 1 --2- 10.20.193.48:0/343216578 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f95d005d550 0x7f95d005d920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95d75f6640 1 -- 10.20.193.48:0/343216578 >> 10.20.193.48:0/343216578 conn(0x7f95d00546a0 msgr2=0x7f95d0054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:29.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95d75f6640 1 -- 10.20.193.48:0/343216578 shutdown_connections 2026-02-12T18:10:29.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.768+0000 7f95d75f6640 1 -- 10.20.193.48:0/343216578 wait complete. 2026-02-12T18:10:29.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d75f6640 10 monclient: build_initial_monmap 2026-02-12T18:10:29.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d75f6640 10 monclient: monmap: 2026-02-12T18:10:29.775 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:29.775 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:10:29.775 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:10:29.775 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:10:29.776 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:29.776 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.776 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:10:29.776 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:10:29.776 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:29.776 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:29.776 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:29.776 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:29.776 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:29.776 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:29.776 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:29.776 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d75f6640 1 Processor -- start 2026-02-12T18:10:29.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d75f6640 1 -- start start 2026-02-12T18:10:29.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d75f6640 10 monclient: init 2026-02-12T18:10:29.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d75f6640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:29.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d75f6640 10 monclient: _add_conns ranks=[1,0,6,7,8,4,5,3,2] 2026-02-12T18:10:29.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d75f6640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f95d005d550 0x7f95d012f720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d75f6640 10 monclient(hunting): picked mon.noname-f con 0x7f95d005d550 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:10:29.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d75f6640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f95d005de60 0x7f95d0109760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d75f6640 10 monclient(hunting): picked mon.noname-a con 0x7f95d005de60 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:10:29.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d75f6640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f95d013ef60 0x7f95d0109ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d75f6640 10 monclient(hunting): picked mon.noname-d con 0x7f95d013ef60 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:10:29.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d75f6640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d75f6640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f95d010c8a0 con 0x7f95d005de60 2026-02-12T18:10:29.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d75f6640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d75f6640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f95d010cb80 con 0x7f95d005d550 2026-02-12T18:10:29.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d75f6640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d75f6640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f95d010ce60 con 0x7f95d013ef60 2026-02-12T18:10:29.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d75f6640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:29.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d75f6640 10 monclient(hunting): authenticate will time out at 868.495698s 2026-02-12T18:10:29.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d4b6a640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f95d005de60 0x7f95d0109760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d5b6c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f95d013ef60 0x7f95d0109ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d4b6a640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f95d005de60 0x7f95d0109760 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:58084/0 (socket says 10.20.193.48:58084) 2026-02-12T18:10:29.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d4b6a640 1 -- 10.20.193.48:0/2581101092 learned_addr learned my addr 10.20.193.48:0/2581101092 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:29.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d4b6a640 10 monclient(hunting): get_auth_request con 0x7f95d005de60 auth_method 0 2026-02-12T18:10:29.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d4b6a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d4b6a640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d4b6a640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d5b6c640 10 monclient(hunting): get_auth_request con 0x7f95d013ef60 auth_method 0 2026-02-12T18:10:29.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d5b6c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d5b6c640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d5b6c640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d4b6a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d4b6a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d4b6a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d5b6c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d5b6c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d5b6c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d536b640 1 --2- 10.20.193.48:0/2581101092 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f95d005d550 0x7f95d012f720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d536b640 10 monclient(hunting): get_auth_request con 0x7f95d005d550 auth_method 0 2026-02-12T18:10:29.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d536b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d536b640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d536b640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d5b6c640 10 monclient(hunting): handle_auth_done global_id 5523 payload 824 2026-02-12T18:10:29.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d5b6c640 1 -- 10.20.193.48:0/2581101092 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f95d005d550 msgr2=0x7f95d012f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d5b6c640 1 --2- 10.20.193.48:0/2581101092 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f95d005d550 0x7f95d012f720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d5b6c640 1 -- 10.20.193.48:0/2581101092 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f95d005de60 msgr2=0x7f95d0109760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.769+0000 7f95d5b6c640 1 --2- 10.20.193.48:0/2581101092 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f95d005de60 0x7f95d0109760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.770+0000 7f95d5b6c640 10 monclient: _finish_hunting 0 2026-02-12T18:10:29.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.770+0000 7f95d5b6c640 1 monclient: found mon.noname-d 2026-02-12T18:10:29.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.770+0000 7f95d5b6c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:29.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.770+0000 7f95d5b6c640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:10:29.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.770+0000 7f95d5b6c640 1 -- 10.20.193.48:0/2581101092 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c40094f0 con 0x7f95d013ef60 2026-02-12T18:10:29.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.770+0000 7f95d4b6a640 1 --2- 10.20.193.48:0/2581101092 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f95d005de60 0x7f95d0109760 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:10:29.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95d5b6c640 1 -- 10.20.193.48:0/2581101092 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f95d013ef60 msgr2=0x7f95d0109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:29.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95d5b6c640 1 --2- 10.20.193.48:0/2581101092 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f95d013ef60 0x7f95d0109ca0 secure :-1 s=READY pgs=192 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95cc00afd0 tx=0x7f95cc00fcd0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:29.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95bdffb640 1 -- 10.20.193.48:0/2581101092 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f95cc00db50 con 0x7f95d013ef60 2026-02-12T18:10:29.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95bdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:29.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95bdffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:10:29.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95bdffb640 10 monclient: dump: 2026-02-12T18:10:29.781 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:29.781 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.781 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.781 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.781 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:29.781 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.781 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:29.781 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:29.781 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:29.781 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:29.781 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:29.781 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:29.781 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:29.782 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:29.782 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:29.782 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95bdffb640 10 monclient: _finish_auth 0 2026-02-12T18:10:29.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95bdffb640 10 monclient: _check_auth_tickets 2026-02-12T18:10:29.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95bdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:29.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95bdffb640 1 -- 10.20.193.48:0/2581101092 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95cc00dcd0 con 0x7f95d013ef60 2026-02-12T18:10:29.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95d75f6640 5 monclient: authenticate success, global_id 5523 2026-02-12T18:10:29.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95d75f6640 10 monclient: _renew_subs 2026-02-12T18:10:29.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95d75f6640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:10:29.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95d75f6640 1 -- 10.20.193.48:0/2581101092 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95d0124180 con 0x7f95d013ef60 2026-02-12T18:10:29.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95bdffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:29.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95bdffb640 1 -- 10.20.193.48:0/2581101092 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f95cc00de40 con 0x7f95d013ef60 2026-02-12T18:10:29.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95bdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:29.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95bdffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:10:29.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95bf7fe640 4 set_mon_vals no callback set 2026-02-12T18:10:29.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95bdffb640 10 monclient: dump: 2026-02-12T18:10:29.782 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:29.782 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.782 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.782 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.782 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:29.782 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.783 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:29.783 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:29.783 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:29.783 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:29.783 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:29.783 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:29.783 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:29.783 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:29.783 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:29.783 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95d75f6640 10 monclient: _renew_subs 2026-02-12T18:10:29.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95d75f6640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:10:29.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95d75f6640 1 -- 10.20.193.48:0/2581101092 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f95d0120640 con 0x7f95d013ef60 2026-02-12T18:10:29.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95d75f6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:29.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95d75f6640 1 --2- 10.20.193.48:0/2581101092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f95d0091010 0x7f95d010a1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95d75f6640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.772+0000 7f95d75f6640 1 -- 10.20.193.48:0/2581101092 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f95d0055e20 con 0x7f95d0091010 2026-02-12T18:10:29.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.773+0000 7f95d5b6c640 1 --2- 10.20.193.48:0/2581101092 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f95d013ef60 0x7f95d0109ca0 secure :-1 s=READY pgs=192 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95cc00afd0 tx=0x7f95cc00fcd0 comp rx=0 tx=0).queue_received will delay after 1.77092e+09 on 0x7f95cc023020 mgrmap(e 5) 2026-02-12T18:10:29.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.773+0000 7f95d536b640 1 --2- 10.20.193.48:0/2581101092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f95d0091010 0x7f95d010a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.773+0000 7f95bdffb640 1 -- 10.20.193.48:0/2581101092 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f95cc023020 con 0x7f95d013ef60 2026-02-12T18:10:29.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.773+0000 7f95d536b640 10 monclient: get_auth_request con 0x7f95d0091010 auth_method 0 2026-02-12T18:10:29.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.773+0000 7f95d536b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.773+0000 7f95d536b640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.773+0000 7f95d536b640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.773+0000 7f95d536b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.773+0000 7f95d536b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.773+0000 7f95d536b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.773+0000 7f95d536b640 10 monclient(hunting): handle_auth_done global_id 64106 payload 824 2026-02-12T18:10:29.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.773+0000 7f95bdffb640 1 --2- 10.20.193.48:0/2581101092 >> v2:10.20.193.111:6812/977811348 conn(0x7f95a003f800 0x7f95a005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.773+0000 7f95d536b640 1 -- 10.20.193.48:0/2581101092 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f95d010ca10 con 0x7f95d0091010 2026-02-12T18:10:29.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.773+0000 7f95d4b6a640 1 --2- 10.20.193.48:0/2581101092 >> v2:10.20.193.111:6812/977811348 conn(0x7f95a003f800 0x7f95a005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.773+0000 7f95d4b6a640 10 monclient: get_auth_request con 0x7f95a003f800 auth_method 0 2026-02-12T18:10:29.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.775+0000 7f95d536b640 1 -- 10.20.193.48:0/2581101092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f95d0091010 msgr2=0x7f95d010a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:29.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.775+0000 7f95d536b640 1 --2- 10.20.193.48:0/2581101092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f95d0091010 0x7f95d010a1e0 secure :-1 s=READY pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95c000bfd0 tx=0x7f95c000f920 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:29.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.775+0000 7f95bdffb640 1 -- 10.20.193.48:0/2581101092 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f95c00044f0 con 0x7f95d0091010 2026-02-12T18:10:29.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.775+0000 7f95bdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:29.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.775+0000 7f95bdffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:10:29.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.775+0000 7f95bdffb640 10 monclient: dump: 2026-02-12T18:10:29.784 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:29.784 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.784 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.784 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.784 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:29.784 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.784 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:29.784 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:29.784 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:29.785 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:29.785 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:29.785 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:29.785 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:29.785 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:29.785 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:29.785 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.775+0000 7f95bdffb640 1 -- 10.20.193.48:0/2581101092 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f95c0004030 con 0x7f95d0091010 2026-02-12T18:10:29.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.775+0000 7f95bdffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:29.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.775+0000 7f95bdffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:10:29.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.775+0000 7f95bdffb640 1 -- 10.20.193.48:0/2581101092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f95d0091010 msgr2=0x7f95d010a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.775+0000 7f95bdffb640 1 --2- 10.20.193.48:0/2581101092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f95d0091010 0x7f95d010a1e0 secure :-1 s=READY pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95c000bfd0 tx=0x7f95c000f920 comp rx=0 tx=0).stop 2026-02-12T18:10:29.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.775+0000 7f95bdffb640 1 -- 10.20.193.48:0/2581101092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f95d0091010 msgr2=0x7f95d010a1e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:29.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.775+0000 7f95bdffb640 1 --2- 10.20.193.48:0/2581101092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f95d0091010 0x7f95d010a1e0 secure :-1 s=CLOSED pgs=14 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95c000bfd0 tx=0x7f95c000f920 comp rx=0 tx=0).stop 2026-02-12T18:10:29.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.776+0000 7f95d4b6a640 1 --2- 10.20.193.48:0/2581101092 >> v2:10.20.193.111:6812/977811348 conn(0x7f95a003f800 0x7f95a005fcb0 secure :-1 s=READY pgs=289 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95d005c640 tx=0x7f95c4039040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:29.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.779+0000 7f95d75f6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:10:29.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.779+0000 7f95d75f6640 1 --2- 10.20.193.48:0/2581101092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f95d010a720 0x7f95d0058850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.779+0000 7f95d75f6640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.779+0000 7f95d75f6640 1 -- 10.20.193.48:0/2581101092 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f95d005f140 con 0x7f95d010a720 2026-02-12T18:10:29.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.779+0000 7f95d536b640 1 --2- 10.20.193.48:0/2581101092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f95d010a720 0x7f95d0058850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.779+0000 7f95d536b640 10 monclient: get_auth_request con 0x7f95d010a720 auth_method 0 2026-02-12T18:10:29.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.779+0000 7f95d536b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.779+0000 7f95d536b640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.779+0000 7f95d536b640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.779+0000 7f95d536b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.779+0000 7f95d536b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.779+0000 7f95d536b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.779+0000 7f95d536b640 10 monclient(hunting): handle_auth_done global_id 64115 payload 824 2026-02-12T18:10:29.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.779+0000 7f95d536b640 1 -- 10.20.193.48:0/2581101092 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f95d010b940 con 0x7f95d010a720 2026-02-12T18:10:29.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.782+0000 7f95d536b640 1 -- 10.20.193.48:0/2581101092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f95d010a720 msgr2=0x7f95d0058850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:29.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.782+0000 7f95d536b640 1 --2- 10.20.193.48:0/2581101092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f95d010a720 0x7f95d0058850 secure :-1 s=READY pgs=15 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95c0004000 tx=0x7f95c0004770 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:29.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.782+0000 7f95bdffb640 1 -- 10.20.193.48:0/2581101092 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f95c0014d60 con 0x7f95d010a720 2026-02-12T18:10:29.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.782+0000 7f95bdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:29.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.782+0000 7f95bdffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:10:29.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.782+0000 7f95bdffb640 10 monclient: dump: 2026-02-12T18:10:29.787 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:29.787 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.787 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.787 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.787 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:29.787 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.787 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:29.787 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:29.787 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:29.787 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:29.787 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:29.787 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:29.787 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:29.787 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:29.787 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:29.787 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.782+0000 7f95bdffb640 1 -- 10.20.193.48:0/2581101092 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7f95c00036d0 con 0x7f95d010a720 2026-02-12T18:10:29.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.782+0000 7f95bdffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:10:29.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.782+0000 7f95bdffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:10:29.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.782+0000 7f95bdffb640 1 -- 10.20.193.48:0/2581101092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f95d010a720 msgr2=0x7f95d0058850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.782+0000 7f95bdffb640 1 --2- 10.20.193.48:0/2581101092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f95d010a720 0x7f95d0058850 secure :-1 s=READY pgs=15 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95c0004000 tx=0x7f95c0004770 comp rx=0 tx=0).stop 2026-02-12T18:10:29.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.782+0000 7f95bdffb640 1 -- 10.20.193.48:0/2581101092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f95d010a720 msgr2=0x7f95d0058850 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:29.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.782+0000 7f95bdffb640 1 --2- 10.20.193.48:0/2581101092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f95d010a720 0x7f95d0058850 secure :-1 s=CLOSED pgs=15 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95c0004000 tx=0x7f95c0004770 comp rx=0 tx=0).stop 2026-02-12T18:10:29.788 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:10:29.788 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:10:29.788 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:10:29.788 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:10:29.788 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 46, 2026-02-12T18:10:29.788 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 10583, 2026-02-12T18:10:29.788 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:10:29.788 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:10:29.788 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:10:29.788 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:10:29.788 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:10:29.788 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:10:29.788 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:10:29.788 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:10:29.789 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:10:29.789 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:10:29.789 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:29.789 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 4, 2026-02-12T18:10:29.789 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:29.789 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:10:29.789 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:10:29.789 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:29.789 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:29.789 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:29.789 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:29.789 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:29.789 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:29.789 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:29.789 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:29.789 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:29.789 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:29.789 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:29.789 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:29.789 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:29.789 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:29.789 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:10:29.790 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:10:29.790 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:29.790 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:29.790 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:29.790 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:29.790 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:29.790 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:29.790 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:29.790 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:29.790 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:29.790 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:29.790 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:29.790 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:29.790 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:29.790 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.790 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.790 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:10:29.790 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:10:29.790 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:10:29.790 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:10:29.790 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:10:29.790 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:10:29.791 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:29.791 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:29.791 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:10:29.791 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:10:29.791 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:10:29.791 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:10:29.791 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:10:29.791 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:10:29.791 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:10:29.791 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:29.791 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:10:29.791 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:29.791 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:29.791 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:29.791 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:29.791 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:29.791 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:29.791 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:29.791 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:29.791 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:29.791 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:29.791 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:29.791 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:29.792 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:29.792 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:29.792 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:10:29.792 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.792 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:10:29.792 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.792 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:10:29.792 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:10:29.792 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.792 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.792 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.792 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.792 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:10:29.792 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.792 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.792 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.792 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.792 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:10:29.792 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.792 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.792 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.792 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.792 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:10:29.793 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:10:29.793 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.793 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.793 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:10:29.793 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.793 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.793 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.793 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:10:29.793 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:10:29.793 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.793 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.793 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.793 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.793 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:10:29.793 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.793 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.793 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.793 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.793 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:10:29.793 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.793 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.793 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.793 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.793 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:10:29.794 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:10:29.794 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.794 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.794 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:10:29.794 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.794 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.794 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.794 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:10:29.794 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:10:29.794 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.794 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.794 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.794 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.794 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:10:29.794 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.794 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.794 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.794 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.794 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:10:29.794 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.794 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.794 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.794 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.794 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:10:29.795 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:10:29.795 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.795 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.795 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:10:29.795 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.795 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.795 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.795 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:10:29.795 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:10:29.795 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.795 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.795 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.795 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.795 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:10:29.795 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.795 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.795 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.795 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.795 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:10:29.795 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.795 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.795 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.795 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.795 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:10:29.796 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:10:29.796 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.796 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.796 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:10:29.796 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.796 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.796 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.796 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:10:29.796 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:10:29.796 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.796 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.796 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.796 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.796 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:10:29.796 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.796 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.796 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.796 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.796 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:10:29.796 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.796 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.796 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.796 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.796 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:10:29.797 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:10:29.797 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.797 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.797 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:29.797 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.797 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.797 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.797 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:10:29.797 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:10:29.797 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.797 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.797 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.797 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.797 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:10:29.797 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.797 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.797 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.797 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.797 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:10:29.797 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.797 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.797 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.797 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.797 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:10:29.797 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:10:29.798 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.798 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.798 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:10:29.798 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.798 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.798 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.798 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:10:29.798 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:10:29.798 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.798 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.798 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.798 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.798 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:10:29.798 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.798 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.798 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.798 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.798 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:10:29.798 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.798 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.798 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.798 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.798 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:10:29.799 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:10:29.799 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.799 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.799 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:29.799 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.799 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.799 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.799 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:10:29.799 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:10:29.799 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.799 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.799 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.799 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.799 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:10:29.799 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.799 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.799 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.799 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.799 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:10:29.799 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.799 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.799 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.799 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.800 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:10:29.800 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:10:29.800 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.800 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.800 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:10:29.800 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.800 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.800 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.800 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:10:29.800 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:10:29.800 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.800 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.800 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.800 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.800 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:10:29.800 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.800 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.800 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.800 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.800 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:10:29.800 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.800 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.800 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.800 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.801 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:10:29.801 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:10:29.801 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.801 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.801 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:10:29.801 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.801 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.801 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.801 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.801 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:10:29.801 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:10:29.801 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.801 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:29.801 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:29.801 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:29.801 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.801 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:29.801 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:10:29.801 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.801 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:29.801 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:29.801 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:29.801 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.801 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.801 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.802 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:10:29.802 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:10:29.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.782+0000 7f95d75f6640 1 -- 10.20.193.48:0/2581101092 >> v2:10.20.193.111:6812/977811348 conn(0x7f95a003f800 msgr2=0x7f95a005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.782+0000 7f95d75f6640 1 --2- 10.20.193.48:0/2581101092 >> v2:10.20.193.111:6812/977811348 conn(0x7f95a003f800 0x7f95a005fcb0 secure :-1 s=READY pgs=289 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95d005c640 tx=0x7f95c4039040 comp rx=0 tx=0).stop 2026-02-12T18:10:29.802 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.782+0000 7f95d75f6640 10 monclient: shutdown 2026-02-12T18:10:29.803 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.782+0000 7f95d75f6640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:29.803 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.782+0000 7f95d75f6640 1 -- 10.20.193.48:0/2581101092 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f95d013ef60 msgr2=0x7f95d0109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.803 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.782+0000 7f95d75f6640 1 --2- 10.20.193.48:0/2581101092 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f95d013ef60 0x7f95d0109ca0 secure :-1 s=READY pgs=192 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f95cc00afd0 tx=0x7f95cc00fcd0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.803 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.782+0000 7f95d5b6c640 1 -- 10.20.193.48:0/2581101092 reap_dead start 2026-02-12T18:10:29.803 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.782+0000 7f95bdffb640 1 -- 10.20.193.48:0/2581101092 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(210..210 src has 1..210) ==== 3897+0+0 (unknown 0 0 0) 0x7f95cc053de0 con 0x7f95d013ef60 2026-02-12T18:10:29.803 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.782+0000 7f95d75f6640 1 -- 10.20.193.48:0/2581101092 shutdown_connections 2026-02-12T18:10:29.803 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.782+0000 7f95d75f6640 1 --2- 10.20.193.48:0/2581101092 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f95d013ef60 0x7f95d0109ca0 unknown :-1 s=CLOSED pgs=192 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.803 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.782+0000 7f95d75f6640 1 -- 10.20.193.48:0/2581101092 >> 10.20.193.48:0/2581101092 conn(0x7f95d00546a0 msgr2=0x7f95d0120ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:29.803 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.782+0000 7f95d75f6640 1 -- 10.20.193.48:0/2581101092 shutdown_connections 2026-02-12T18:10:29.803 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.782+0000 7f95d75f6640 1 -- 10.20.193.48:0/2581101092 wait complete. 2026-02-12T18:10:29.803 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:10:29.803 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2026-02-12T18:10:29.803 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2026-02-12T18:10:29.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.868+0000 7f8f72ecc640 10 monclient: get_monmap_and_config 2026-02-12T18:10:29.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.868+0000 7f8f72ecc640 10 monclient: build_initial_monmap 2026-02-12T18:10:29.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.868+0000 7f8f72ecc640 10 monclient: monmap: 2026-02-12T18:10:29.870 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:29.870 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.870 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:10:29.869766+0000 2026-02-12T18:10:29.870 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:10:29.869766+0000 2026-02-12T18:10:29.871 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:29.871 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.871 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:10:29.871 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:10:29.871 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:29.871 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:29.871 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:29.871 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:29.871 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:29.871 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:29.871 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:29.871 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:10:29.871 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:10:29.871 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f72ecc640 1 Processor -- start 2026-02-12T18:10:29.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f72ecc640 1 -- start start 2026-02-12T18:10:29.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f72ecc640 10 monclient: init 2026-02-12T18:10:29.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f72ecc640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:29.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f72ecc640 10 monclient: _add_conns ranks=[7,3,5,6,2,9,10,0,8,4,1] 2026-02-12T18:10:29.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f72ecc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f8f6c090730 0x7f8f6c08fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f72ecc640 10 monclient(hunting): picked mon.noname-i con 0x7f8f6c090730 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:10:29.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f72ecc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f8f6c090b00 0x7f8f6c090f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f72ecc640 10 monclient(hunting): picked mon.noname-g con 0x7f8f6c090b00 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:10:29.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f72ecc640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f8f6c1442e0 0x7f8f6c144750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f72ecc640 10 monclient(hunting): picked mon.noname-h con 0x7f8f6c1442e0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:10:29.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f72ecc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f72ecc640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f8f6c091810 con 0x7f8f6c090b00 2026-02-12T18:10:29.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f72ecc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f72ecc640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f8f6c0914d0 con 0x7f8f6c1442e0 2026-02-12T18:10:29.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f72ecc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f72ecc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f8f6c0570c0 con 0x7f8f6c090730 2026-02-12T18:10:29.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f72ecc640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:29.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f72ecc640 10 monclient(hunting): authenticate will time out at 868.595484s 2026-02-12T18:10:29.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f71442640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f8f6c1442e0 0x7f8f6c144750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f70c41640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f8f6c090730 0x7f8f6c08fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f71442640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f8f6c1442e0 0x7f8f6c144750 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3302/0 says I am v2:10.20.193.48:59004/0 (socket says 10.20.193.48:59004) 2026-02-12T18:10:29.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f71442640 1 -- 10.20.193.48:0/2389490272 learned_addr learned my addr 10.20.193.48:0/2389490272 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:29.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f63fff640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f8f6c090b00 0x7f8f6c090f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f70c41640 1 --2- 10.20.193.48:0/2389490272 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f8f6c090730 0x7f8f6c08fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3303/0 says I am v2:10.20.193.48:33198/0 (socket says 10.20.193.48:33198) 2026-02-12T18:10:29.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f70c41640 10 monclient(hunting): get_auth_request con 0x7f8f6c090730 auth_method 0 2026-02-12T18:10:29.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f70c41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f70c41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f70c41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f71442640 10 monclient(hunting): get_auth_request con 0x7f8f6c1442e0 auth_method 0 2026-02-12T18:10:29.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f71442640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f71442640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f71442640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f63fff640 10 monclient(hunting): get_auth_request con 0x7f8f6c090b00 auth_method 0 2026-02-12T18:10:29.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f63fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f63fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f63fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f70c41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f70c41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f70c41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f71442640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f71442640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f71442640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f63fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f63fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f63fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f71442640 10 monclient(hunting): handle_auth_done global_id 5630 payload 274 2026-02-12T18:10:29.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f71442640 1 -- 10.20.193.48:0/2389490272 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f8f6c090730 msgr2=0x7f8f6c08fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:29.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.869+0000 7f8f71442640 1 --2- 10.20.193.48:0/2389490272 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f8f6c090730 0x7f8f6c08fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.870+0000 7f8f71442640 1 -- 10.20.193.48:0/2389490272 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f8f6c090b00 msgr2=0x7f8f6c090f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:29.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.870+0000 7f8f71442640 1 --2- 10.20.193.48:0/2389490272 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f8f6c090b00 0x7f8f6c090f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.870+0000 7f8f71442640 10 monclient: _finish_hunting 0 2026-02-12T18:10:29.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.870+0000 7f8f71442640 1 monclient: found mon.noname-h 2026-02-12T18:10:29.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.870+0000 7f8f71442640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:29.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.870+0000 7f8f71442640 10 monclient: _send_mon_message to mon.noname-h at v2:10.20.193.111:3302/0 2026-02-12T18:10:29.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.870+0000 7f8f71442640 1 -- 10.20.193.48:0/2389490272 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f6c04dc20 con 0x7f8f6c1442e0 2026-02-12T18:10:29.875 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.870+0000 7f8f70c41640 1 --2- 10.20.193.48:0/2389490272 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f8f6c090730 0x7f8f6c08fca0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:10:29.877 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.872+0000 7f8f71442640 1 -- 10.20.193.48:0/2389490272 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f8f6c1442e0 msgr2=0x7f8f6c144750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:29.877 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.872+0000 7f8f71442640 1 --2- 10.20.193.48:0/2389490272 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f8f6c1442e0 0x7f8f6c144750 secure :-1 s=READY pgs=227 gs=2 cs=0 l=1 c_cookie=4553196874328488243 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f6800a9b0 tx=0x7f8f6802fef0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=3f30346eeec4b933 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:29.877 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.872+0000 7f8f637fe640 1 -- 10.20.193.48:0/2389490272 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8f68030b70 con 0x7f8f6c1442e0 2026-02-12T18:10:29.877 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.872+0000 7f8f637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:29.877 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.872+0000 7f8f637fe640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2026-02-12T18:10:29.877 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.872+0000 7f8f637fe640 10 monclient: dump: 2026-02-12T18:10:29.877 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:29.877 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.877 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.877 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.877 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:29.877 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.877 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:29.877 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:29.877 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:29.877 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:29.877 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:29.878 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:29.878 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:29.878 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:29.878 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:29.878 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.872+0000 7f8f637fe640 10 monclient: _finish_auth 0 2026-02-12T18:10:29.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.872+0000 7f8f637fe640 10 monclient: _check_auth_tickets 2026-02-12T18:10:29.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.872+0000 7f8f637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:29.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.872+0000 7f8f637fe640 1 -- 10.20.193.48:0/2389490272 <== mon.5 v2:10.20.193.111:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f68030cf0 con 0x7f8f6c1442e0 2026-02-12T18:10:29.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.872+0000 7f8f72ecc640 5 monclient: authenticate success, global_id 5630 2026-02-12T18:10:29.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.872+0000 7f8f72ecc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:10:29.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.872+0000 7f8f637fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:29.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.872+0000 7f8f637fe640 1 -- 10.20.193.48:0/2389490272 <== mon.5 v2:10.20.193.111:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8f68030e60 con 0x7f8f6c1442e0 2026-02-12T18:10:29.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.872+0000 7f8f72ecc640 10 monclient: get_monmap_and_config success 2026-02-12T18:10:29.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.872+0000 7f8f637fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:29.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.872+0000 7f8f72ecc640 4 set_mon_vals no callback set 2026-02-12T18:10:29.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.872+0000 7f8f637fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:10:29.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.872+0000 7f8f637fe640 10 monclient: dump: 2026-02-12T18:10:29.878 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:29.878 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.878 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.878 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.878 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:29.878 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.879 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:29.879 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:29.879 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:29.879 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:29.879 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:29.879 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:29.879 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:29.879 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:29.879 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:29.879 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.873+0000 7f8f72ecc640 10 monclient: shutdown 2026-02-12T18:10:29.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.873+0000 7f8f72ecc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:29.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.873+0000 7f8f72ecc640 1 -- 10.20.193.48:0/2389490272 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f8f6c1442e0 msgr2=0x7f8f6c144750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.873+0000 7f8f72ecc640 1 --2- 10.20.193.48:0/2389490272 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f8f6c1442e0 0x7f8f6c144750 secure :-1 s=READY pgs=227 gs=2 cs=0 l=1 c_cookie=4553196874328488243 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f6800a9b0 tx=0x7f8f6802fef0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.873+0000 7f8f72ecc640 1 -- 10.20.193.48:0/2389490272 shutdown_connections 2026-02-12T18:10:29.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.873+0000 7f8f72ecc640 1 --2- 10.20.193.48:0/2389490272 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f8f6c1442e0 0x7f8f6c144750 unknown :-1 s=CLOSED pgs=227 gs=2 cs=0 l=1 c_cookie=4553196874328488243 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.873+0000 7f8f72ecc640 1 --2- 10.20.193.48:0/2389490272 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f8f6c090b00 0x7f8f6c090f30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.873+0000 7f8f72ecc640 1 --2- 10.20.193.48:0/2389490272 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f8f6c090730 0x7f8f6c08fca0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.873+0000 7f8f72ecc640 1 -- 10.20.193.48:0/2389490272 >> 10.20.193.48:0/2389490272 conn(0x7f8f6c054e50 msgr2=0x7f8f6c0952a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:29.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.873+0000 7f8f72ecc640 1 -- 10.20.193.48:0/2389490272 shutdown_connections 2026-02-12T18:10:29.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.873+0000 7f8f72ecc640 1 -- 10.20.193.48:0/2389490272 wait complete. 2026-02-12T18:10:29.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.873+0000 7f8f72ecc640 10 monclient: build_initial_monmap 2026-02-12T18:10:29.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.873+0000 7f8f72ecc640 10 monclient: monmap: 2026-02-12T18:10:29.879 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:29.879 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:10:29.880 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:10:29.880 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:10:29.880 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:29.880 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.880 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:10:29.880 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:10:29.880 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:29.880 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:29.880 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:29.880 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:29.880 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:29.880 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:29.880 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:29.880 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.873+0000 7f8f72ecc640 1 Processor -- start 2026-02-12T18:10:29.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.873+0000 7f8f72ecc640 1 -- start start 2026-02-12T18:10:29.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.873+0000 7f8f72ecc640 10 monclient: init 2026-02-12T18:10:29.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f72ecc640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:29.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f72ecc640 10 monclient: _add_conns ranks=[1,6,7,3,8,0,5,4,2] 2026-02-12T18:10:29.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f72ecc640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f8f6c090730 0x7f8f6c12e340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f72ecc640 10 monclient(hunting): picked mon.noname-f con 0x7f8f6c090730 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:10:29.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f72ecc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8f6c090b00 0x7f8f6c12e880 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f72ecc640 10 monclient(hunting): picked mon.noname-d con 0x7f8f6c090b00 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:10:29.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f72ecc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f8f6c1442e0 0x7f8f6c10b8f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f72ecc640 10 monclient(hunting): picked mon.noname-i con 0x7f8f6c1442e0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:10:29.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f72ecc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f72ecc640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8f6c123100 con 0x7f8f6c090730 2026-02-12T18:10:29.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f72ecc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f72ecc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f8f6c12edc0 con 0x7f8f6c090b00 2026-02-12T18:10:29.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f72ecc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f72ecc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f8f6c095530 con 0x7f8f6c1442e0 2026-02-12T18:10:29.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f72ecc640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:29.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f72ecc640 10 monclient(hunting): authenticate will time out at 868.600208s 2026-02-12T18:10:29.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f63fff640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8f6c090b00 0x7f8f6c12e880 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f63fff640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8f6c090b00 0x7f8f6c12e880 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:36652/0 (socket says 10.20.193.48:36652) 2026-02-12T18:10:29.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f63fff640 1 -- 10.20.193.48:0/2742330797 learned_addr learned my addr 10.20.193.48:0/2742330797 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:29.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f63fff640 10 monclient(hunting): get_auth_request con 0x7f8f6c090b00 auth_method 0 2026-02-12T18:10:29.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f63fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f63fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f63fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f63fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f63fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f63fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f71442640 1 --2- 10.20.193.48:0/2742330797 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f8f6c1442e0 0x7f8f6c10b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f70c41640 1 --2- 10.20.193.48:0/2742330797 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f8f6c090730 0x7f8f6c12e340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f71442640 10 monclient(hunting): get_auth_request con 0x7f8f6c1442e0 auth_method 0 2026-02-12T18:10:29.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f71442640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f71442640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f71442640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f70c41640 10 monclient(hunting): get_auth_request con 0x7f8f6c090730 auth_method 0 2026-02-12T18:10:29.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f70c41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f70c41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f70c41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f71442640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f71442640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f71442640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f63fff640 10 monclient(hunting): handle_auth_done global_id 5532 payload 824 2026-02-12T18:10:29.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f63fff640 1 -- 10.20.193.48:0/2742330797 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f8f6c1442e0 msgr2=0x7f8f6c10b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f63fff640 1 --2- 10.20.193.48:0/2742330797 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f8f6c1442e0 0x7f8f6c10b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f63fff640 1 -- 10.20.193.48:0/2742330797 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f8f6c090730 msgr2=0x7f8f6c12e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f63fff640 1 --2- 10.20.193.48:0/2742330797 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f8f6c090730 0x7f8f6c12e340 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f63fff640 10 monclient: _finish_hunting 0 2026-02-12T18:10:29.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f63fff640 1 monclient: found mon.noname-d 2026-02-12T18:10:29.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f63fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:29.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f63fff640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:10:29.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f63fff640 1 -- 10.20.193.48:0/2742330797 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f5c009420 con 0x7f8f6c090b00 2026-02-12T18:10:29.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.874+0000 7f8f70c41640 1 --2- 10.20.193.48:0/2742330797 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f8f6c090730 0x7f8f6c12e340 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:10:29.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.876+0000 7f8f63fff640 1 -- 10.20.193.48:0/2742330797 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8f6c090b00 msgr2=0x7f8f6c12e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:29.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.876+0000 7f8f63fff640 1 --2- 10.20.193.48:0/2742330797 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8f6c090b00 0x7f8f6c12e880 secure :-1 s=READY pgs=193 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f5400e8b0 tx=0x7f8f5400ed80 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:29.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.876+0000 7f8f617fa640 1 -- 10.20.193.48:0/2742330797 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8f5400cb50 con 0x7f8f6c090b00 2026-02-12T18:10:29.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.876+0000 7f8f617fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:29.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.876+0000 7f8f617fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:10:29.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.876+0000 7f8f617fa640 10 monclient: dump: 2026-02-12T18:10:29.884 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:29.884 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.884 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.884 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.884 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:29.885 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.885 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:29.885 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:29.885 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:29.885 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:29.885 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:29.885 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:29.885 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:29.885 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:29.885 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:29.885 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.876+0000 7f8f617fa640 10 monclient: _finish_auth 0 2026-02-12T18:10:29.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.876+0000 7f8f617fa640 10 monclient: _check_auth_tickets 2026-02-12T18:10:29.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.876+0000 7f8f617fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:29.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.876+0000 7f8f617fa640 1 -- 10.20.193.48:0/2742330797 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f5400ccd0 con 0x7f8f6c090b00 2026-02-12T18:10:29.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.876+0000 7f8f617fa640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:29.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.876+0000 7f8f617fa640 1 -- 10.20.193.48:0/2742330797 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8f5400ce40 con 0x7f8f6c090b00 2026-02-12T18:10:29.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.876+0000 7f8f617fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:29.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.876+0000 7f8f617fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:10:29.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.876+0000 7f8f62ffd640 4 set_mon_vals no callback set 2026-02-12T18:10:29.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.876+0000 7f8f617fa640 10 monclient: dump: 2026-02-12T18:10:29.885 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:29.885 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.885 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.885 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.886 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:29.886 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.886 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:29.886 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:29.886 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:29.886 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:29.886 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:29.886 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:29.886 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:29.886 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:29.886 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:29.886 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.876+0000 7f8f72ecc640 5 monclient: authenticate success, global_id 5532 2026-02-12T18:10:29.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.877+0000 7f8f72ecc640 10 monclient: _renew_subs 2026-02-12T18:10:29.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.877+0000 7f8f72ecc640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:10:29.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.877+0000 7f8f72ecc640 1 -- 10.20.193.48:0/2742330797 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f6800a5d0 con 0x7f8f6c090b00 2026-02-12T18:10:29.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.877+0000 7f8f72ecc640 10 monclient: _renew_subs 2026-02-12T18:10:29.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.877+0000 7f8f72ecc640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:10:29.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.877+0000 7f8f72ecc640 1 -- 10.20.193.48:0/2742330797 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f6c08f000 con 0x7f8f6c090b00 2026-02-12T18:10:29.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.877+0000 7f8f72ecc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:29.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.877+0000 7f8f72ecc640 1 --2- 10.20.193.48:0/2742330797 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f8f6c10c5f0 0x7f8f6c13ec10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.877+0000 7f8f72ecc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.877+0000 7f8f72ecc640 1 -- 10.20.193.48:0/2742330797 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8f6c08fca0 con 0x7f8f6c10c5f0 2026-02-12T18:10:29.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.877+0000 7f8f617fa640 1 -- 10.20.193.48:0/2742330797 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f8f54011070 con 0x7f8f6c090b00 2026-02-12T18:10:29.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.877+0000 7f8f70c41640 1 --2- 10.20.193.48:0/2742330797 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f8f6c10c5f0 0x7f8f6c13ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.877+0000 7f8f70c41640 10 monclient: get_auth_request con 0x7f8f6c10c5f0 auth_method 0 2026-02-12T18:10:29.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.877+0000 7f8f70c41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.877+0000 7f8f70c41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.877+0000 7f8f70c41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.877+0000 7f8f70c41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.877+0000 7f8f70c41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.877+0000 7f8f70c41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.877+0000 7f8f617fa640 1 --2- 10.20.193.48:0/2742330797 >> v2:10.20.193.111:6812/977811348 conn(0x7f8f3c03f800 0x7f8f3c05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.877+0000 7f8f617fa640 1 -- 10.20.193.48:0/2742330797 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(210..210 src has 1..210) ==== 3897+0+0 (secure 0 0 0) 0x7f8f54052b00 con 0x7f8f6c090b00 2026-02-12T18:10:29.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.878+0000 7f8f71442640 1 --2- 10.20.193.48:0/2742330797 >> v2:10.20.193.111:6812/977811348 conn(0x7f8f3c03f800 0x7f8f3c05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.878+0000 7f8f71442640 10 monclient: get_auth_request con 0x7f8f3c03f800 auth_method 0 2026-02-12T18:10:29.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.878+0000 7f8f70c41640 10 monclient(hunting): handle_auth_done global_id 5671 payload 824 2026-02-12T18:10:29.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.878+0000 7f8f70c41640 1 -- 10.20.193.48:0/2742330797 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8f6c0564d0 con 0x7f8f6c10c5f0 2026-02-12T18:10:29.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.880+0000 7f8f70c41640 1 -- 10.20.193.48:0/2742330797 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f8f6c10c5f0 msgr2=0x7f8f6c13ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:29.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.880+0000 7f8f70c41640 1 --2- 10.20.193.48:0/2742330797 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f8f6c10c5f0 0x7f8f6c13ec10 secure :-1 s=READY pgs=301 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f5c011870 tx=0x7f8f5c011d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:29.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.880+0000 7f8f71442640 1 --2- 10.20.193.48:0/2742330797 >> v2:10.20.193.111:6812/977811348 conn(0x7f8f3c03f800 0x7f8f3c05fcb0 secure :-1 s=READY pgs=290 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f6802ff30 tx=0x7f8f68007f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:29.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.880+0000 7f8f617fa640 1 -- 10.20.193.48:0/2742330797 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8f5c00fd30 con 0x7f8f6c10c5f0 2026-02-12T18:10:29.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.880+0000 7f8f617fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:29.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.880+0000 7f8f617fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:10:29.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.880+0000 7f8f617fa640 10 monclient: dump: 2026-02-12T18:10:29.887 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:29.887 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.887 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.887 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.888 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:29.888 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.888 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:29.888 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:29.888 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:29.888 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:29.888 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:29.888 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:29.888 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:29.888 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:29.888 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:29.888 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.880+0000 7f8f617fa640 1 -- 10.20.193.48:0/2742330797 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f8f5c00fe90 con 0x7f8f6c10c5f0 2026-02-12T18:10:29.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.880+0000 7f8f617fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:29.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.880+0000 7f8f617fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:10:29.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.880+0000 7f8f617fa640 1 -- 10.20.193.48:0/2742330797 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f8f6c10c5f0 msgr2=0x7f8f6c13ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.880+0000 7f8f617fa640 1 --2- 10.20.193.48:0/2742330797 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f8f6c10c5f0 0x7f8f6c13ec10 secure :-1 s=READY pgs=301 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f5c011870 tx=0x7f8f5c011d40 comp rx=0 tx=0).stop 2026-02-12T18:10:29.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.880+0000 7f8f617fa640 1 -- 10.20.193.48:0/2742330797 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f8f6c10c5f0 msgr2=0x7f8f6c13ec10 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:29.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.880+0000 7f8f617fa640 1 --2- 10.20.193.48:0/2742330797 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f8f6c10c5f0 0x7f8f6c13ec10 secure :-1 s=CLOSED pgs=301 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f5c011870 tx=0x7f8f5c011d40 comp rx=0 tx=0).stop 2026-02-12T18:10:29.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.884+0000 7f8f72ecc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:10:29.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.884+0000 7f8f72ecc640 1 --2- 10.20.193.48:0/2742330797 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f8f6c13f150 0x7f8f6c13f550 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.884+0000 7f8f72ecc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.884+0000 7f8f72ecc640 1 -- 10.20.193.48:0/2742330797 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f8f6c050410 con 0x7f8f6c13f150 2026-02-12T18:10:29.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.884+0000 7f8f70c41640 1 --2- 10.20.193.48:0/2742330797 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f8f6c13f150 0x7f8f6c13f550 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.884+0000 7f8f70c41640 10 monclient: get_auth_request con 0x7f8f6c13f150 auth_method 0 2026-02-12T18:10:29.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.884+0000 7f8f70c41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.884+0000 7f8f70c41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.884+0000 7f8f70c41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.885+0000 7f8f70c41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.885+0000 7f8f70c41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.885+0000 7f8f70c41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.885+0000 7f8f70c41640 10 monclient(hunting): handle_auth_done global_id 5680 payload 824 2026-02-12T18:10:29.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.885+0000 7f8f70c41640 1 -- 10.20.193.48:0/2742330797 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8f6c144c90 con 0x7f8f6c13f150 2026-02-12T18:10:29.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.887+0000 7f8f70c41640 1 -- 10.20.193.48:0/2742330797 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f8f6c13f150 msgr2=0x7f8f6c13f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:29.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.887+0000 7f8f70c41640 1 --2- 10.20.193.48:0/2742330797 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f8f6c13f150 0x7f8f6c13f550 secure :-1 s=READY pgs=302 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f5c0023d0 tx=0x7f8f5c0047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:29.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.887+0000 7f8f617fa640 1 -- 10.20.193.48:0/2742330797 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8f5c003030 con 0x7f8f6c13f150 2026-02-12T18:10:29.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.887+0000 7f8f617fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:29.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.887+0000 7f8f617fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:10:29.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.887+0000 7f8f617fa640 10 monclient: dump: 2026-02-12T18:10:29.890 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:29.890 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.890 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.890 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.890 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:29.890 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.890 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:29.890 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:29.890 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:29.890 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:29.890 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:29.891 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:29.891 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:29.891 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:29.891 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:29.891 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.887+0000 7f8f617fa640 1 -- 10.20.193.48:0/2742330797 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10182 (secure 0 0 0) 0x7f8f5c022560 con 0x7f8f6c13f150 2026-02-12T18:10:29.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.887+0000 7f8f617fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:10:29.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.887+0000 7f8f617fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:10:29.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.888+0000 7f8f617fa640 1 -- 10.20.193.48:0/2742330797 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f8f6c13f150 msgr2=0x7f8f6c13f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.888+0000 7f8f617fa640 1 --2- 10.20.193.48:0/2742330797 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f8f6c13f150 0x7f8f6c13f550 secure :-1 s=READY pgs=302 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f5c0023d0 tx=0x7f8f5c0047e0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.888+0000 7f8f617fa640 1 -- 10.20.193.48:0/2742330797 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f8f6c13f150 msgr2=0x7f8f6c13f550 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:29.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.888+0000 7f8f617fa640 1 --2- 10.20.193.48:0/2742330797 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f8f6c13f150 0x7f8f6c13f550 secure :-1 s=CLOSED pgs=302 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f5c0023d0 tx=0x7f8f5c0047e0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.891 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:10:29.891 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:10:29.891 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:10:29.891 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:10:29.892 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 46, 2026-02-12T18:10:29.892 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 284685, 2026-02-12T18:10:29.892 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:10:29.892 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:10:29.892 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:10:29.892 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:10:29.892 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:10:29.892 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:10:29.893 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:10:29.893 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:10:29.893 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:10:29.893 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:10:29.893 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:29.893 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 4, 2026-02-12T18:10:29.893 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:29.893 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:10:29.893 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:10:29.893 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:29.893 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:29.893 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:29.893 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:29.893 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:29.893 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:29.893 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:29.893 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:29.893 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:29.893 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:29.893 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:29.893 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:29.893 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:29.893 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:29.893 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:10:29.893 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:10:29.894 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:29.894 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:29.894 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:29.894 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:29.894 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:29.894 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:29.894 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:29.894 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:29.894 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:29.894 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:29.894 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:29.894 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:29.894 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:29.894 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.894 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.894 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:10:29.894 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:10:29.894 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:10:29.894 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:10:29.894 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:10:29.894 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:10:29.894 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:29.894 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:29.894 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:10:29.895 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:10:29.895 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:10:29.895 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:10:29.895 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:10:29.895 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:10:29.895 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:10:29.895 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:29.895 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:10:29.895 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:29.895 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:29.895 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:29.895 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:29.895 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:29.895 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:29.895 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:29.895 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:29.895 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:29.895 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:29.895 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:29.895 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:29.895 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:29.895 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:29.895 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:10:29.895 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.895 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:10:29.896 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.896 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:10:29.896 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:10:29.896 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.896 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.896 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.896 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.896 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:10:29.896 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.896 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.896 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.896 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.896 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:10:29.896 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.896 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.896 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.896 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.896 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:10:29.896 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:10:29.896 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.896 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.896 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:10:29.896 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.896 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.896 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.897 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:10:29.897 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:10:29.897 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.897 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.897 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.897 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.897 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:10:29.897 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.897 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.897 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.897 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.897 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:10:29.897 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.897 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.897 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.897 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.897 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:10:29.897 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:10:29.897 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.897 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.897 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:10:29.897 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.897 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.897 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.897 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:10:29.898 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:10:29.898 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.898 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.898 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.898 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.898 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:10:29.898 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.898 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.898 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.898 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.898 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:10:29.898 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.898 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.898 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.898 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.898 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:10:29.898 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:10:29.898 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.898 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.898 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:10:29.898 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.898 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.898 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.898 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:10:29.898 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:10:29.899 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.899 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.899 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.899 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.899 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:10:29.899 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.899 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.899 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.899 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.899 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:10:29.899 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.899 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.899 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.899 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.899 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:10:29.899 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:10:29.899 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.899 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.899 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:10:29.899 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.899 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.899 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.899 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:10:29.899 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:10:29.899 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.900 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.900 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.900 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.900 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:10:29.900 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.900 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.900 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.900 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.900 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:10:29.900 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.900 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.900 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.900 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.900 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:10:29.900 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:10:29.900 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.900 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.900 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:29.900 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.900 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.900 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.900 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:10:29.900 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:10:29.900 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.900 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.900 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.901 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.901 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:10:29.901 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.901 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.901 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.901 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.901 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:10:29.901 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.901 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.901 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.901 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.901 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:10:29.901 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:10:29.901 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.901 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.901 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:10:29.901 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.901 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.901 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.901 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:10:29.901 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:10:29.901 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.901 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.901 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.901 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.901 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:10:29.902 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.902 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.902 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.902 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.902 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:10:29.902 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.902 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.902 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.902 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.902 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:10:29.902 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:10:29.902 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.902 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.902 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:29.902 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.902 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.902 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.902 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:10:29.902 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:10:29.902 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.902 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.902 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.902 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.902 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:10:29.902 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.903 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.903 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.903 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.903 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:10:29.903 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.903 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.903 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.903 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.903 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:10:29.903 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:10:29.903 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.903 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.903 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:10:29.903 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.903 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.903 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.903 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:10:29.903 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:10:29.903 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.903 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.903 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.903 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.903 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:10:29.903 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.903 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.903 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:29.904 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:29.905 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:10:29.905 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.905 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:29.905 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:10:29.905 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.905 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:29.905 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:29.905 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:10:29.905 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.905 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.905 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.905 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:10:29.905 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:10:29.906 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.888+0000 7f8f72ecc640 1 -- 10.20.193.48:0/2742330797 >> v2:10.20.193.111:6812/977811348 conn(0x7f8f3c03f800 msgr2=0x7f8f3c05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.906 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.888+0000 7f8f72ecc640 1 --2- 10.20.193.48:0/2742330797 >> v2:10.20.193.111:6812/977811348 conn(0x7f8f3c03f800 0x7f8f3c05fcb0 secure :-1 s=READY pgs=290 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f6802ff30 tx=0x7f8f68007f90 comp rx=0 tx=0).stop 2026-02-12T18:10:29.906 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.888+0000 7f8f72ecc640 10 monclient: shutdown 2026-02-12T18:10:29.906 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.888+0000 7f8f72ecc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:29.906 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.888+0000 7f8f72ecc640 1 -- 10.20.193.48:0/2742330797 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8f6c090b00 msgr2=0x7f8f6c12e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.888+0000 7f8f72ecc640 1 --2- 10.20.193.48:0/2742330797 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8f6c090b00 0x7f8f6c12e880 secure :-1 s=READY pgs=193 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f8f5400e8b0 tx=0x7f8f5400ed80 comp rx=0 tx=0).stop 2026-02-12T18:10:29.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.888+0000 7f8f71442640 1 -- 10.20.193.48:0/2742330797 reap_dead start 2026-02-12T18:10:29.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.888+0000 7f8f72ecc640 1 -- 10.20.193.48:0/2742330797 shutdown_connections 2026-02-12T18:10:29.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.888+0000 7f8f72ecc640 1 --2- 10.20.193.48:0/2742330797 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8f6c090b00 0x7f8f6c12e880 unknown :-1 s=CLOSED pgs=193 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.888+0000 7f8f72ecc640 1 -- 10.20.193.48:0/2742330797 >> 10.20.193.48:0/2742330797 conn(0x7f8f6c054e50 msgr2=0x7f8f6c142d40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:29.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.888+0000 7f8f72ecc640 1 -- 10.20.193.48:0/2742330797 shutdown_connections 2026-02-12T18:10:29.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.888+0000 7f8f72ecc640 1 -- 10.20.193.48:0/2742330797 wait complete. 2026-02-12T18:10:29.907 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:10:29.907 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2026-02-12T18:10:29.907 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2026-02-12T18:10:29.973 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.971+0000 7fd89bb0c640 10 monclient: get_monmap_and_config 2026-02-12T18:10:29.973 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.971+0000 7fd89bb0c640 10 monclient: build_initial_monmap 2026-02-12T18:10:29.973 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89bb0c640 10 monclient: monmap: 2026-02-12T18:10:29.973 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:29.973 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.973 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:10:29.973051+0000 2026-02-12T18:10:29.973 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:10:29.973051+0000 2026-02-12T18:10:29.973 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:29.973 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.973 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:10:29.973 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:10:29.973 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:29.973 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:29.973 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:29.974 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:29.974 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:29.974 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:29.974 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:29.974 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:10:29.974 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:10:29.974 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.975 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89bb0c640 1 Processor -- start 2026-02-12T18:10:29.975 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89bb0c640 1 -- start start 2026-02-12T18:10:29.975 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89bb0c640 10 monclient: init 2026-02-12T18:10:29.975 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89bb0c640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:29.975 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89bb0c640 10 monclient: _add_conns ranks=[5,1,9,2,4,8,6,3,0,7,10] 2026-02-12T18:10:29.975 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89bb0c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd8940951a0 0x7fd894093850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.975 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89bb0c640 10 monclient(hunting): picked mon.noname-h con 0x7fd8940951a0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:10:29.975 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89bb0c640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fd894096ad0 addr v1:10.20.193.111:6789/0 2026-02-12T18:10:29.975 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89bb0c640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fd894095c80 0x7fd8941a5bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.975 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89bb0c640 10 monclient(hunting): picked mon.noname-a con 0x7fd894095c80 addr v2:10.20.193.48:3300/0 2026-02-12T18:10:29.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89bb0c640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd89404dc20 con 0x7fd894096ad0 2026-02-12T18:10:29.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89bb0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89bb0c640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7fd894096900 con 0x7fd894095c80 2026-02-12T18:10:29.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89bb0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89bb0c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fd894092260 con 0x7fd8940951a0 2026-02-12T18:10:29.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89bb0c640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:29.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89bb0c640 10 monclient(hunting): authenticate will time out at 868.698770s 2026-02-12T18:10:29.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89a082640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fd894095c80 0x7fd8941a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89a082640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fd894095c80 0x7fd8941a5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:58092/0 (socket says 10.20.193.48:58092) 2026-02-12T18:10:29.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89a082640 1 -- 10.20.193.48:0/3779064335 learned_addr learned my addr 10.20.193.48:0/3779064335 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:29.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89a082640 10 monclient(hunting): get_auth_request con 0x7fd894095c80 auth_method 0 2026-02-12T18:10:29.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89a082640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89a082640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89a082640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd899881640 1 --2- 10.20.193.48:0/3779064335 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd8940951a0 0x7fd894093850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd899881640 10 monclient(hunting): get_auth_request con 0x7fd8940951a0 auth_method 0 2026-02-12T18:10:29.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd899881640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd899881640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd899881640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89a082640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89a082640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.972+0000 7fd89a082640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.973+0000 7fd899881640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.973+0000 7fd899881640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.973+0000 7fd899881640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.973+0000 7fd89a082640 10 monclient(hunting): handle_auth_done global_id 5859 payload 274 2026-02-12T18:10:29.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.973+0000 7fd89a082640 1 -- 10.20.193.48:0/3779064335 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd8940951a0 msgr2=0x7fd894093850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:29.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.973+0000 7fd89a082640 1 --2- 10.20.193.48:0/3779064335 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd8940951a0 0x7fd894093850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.973+0000 7fd89a082640 1 -- 10.20.193.48:0/3779064335 >> v1:10.20.193.111:6789/0 conn(0x7fd894096ad0 legacy=0x7fd894095570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:29.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.973+0000 7fd89a082640 10 monclient: _finish_hunting 0 2026-02-12T18:10:29.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.973+0000 7fd89a082640 1 monclient: found mon.noname-a 2026-02-12T18:10:29.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.973+0000 7fd89a082640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:29.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.973+0000 7fd89a082640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:10:29.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.973+0000 7fd89a082640 1 -- 10.20.193.48:0/3779064335 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd894093070 con 0x7fd894095c80 2026-02-12T18:10:29.979 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.975+0000 7fd89a082640 1 -- 10.20.193.48:0/3779064335 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd894095c80 msgr2=0x7fd8941a5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:29.979 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.975+0000 7fd89a082640 1 --2- 10.20.193.48:0/3779064335 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd894095c80 0x7fd8941a5bb0 secure :-1 s=READY pgs=353 gs=2 cs=0 l=1 c_cookie=17685283515510959219 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd89000a140 tx=0x7fd89002fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f56ebfa81e1a2c73 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:29.979 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.975+0000 7fd89887f640 1 -- 10.20.193.48:0/3779064335 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd890030b50 con 0x7fd894095c80 2026-02-12T18:10:29.979 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.975+0000 7fd89887f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:29.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.975+0000 7fd89887f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:10:29.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.975+0000 7fd89887f640 10 monclient: dump: 2026-02-12T18:10:29.980 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:29.980 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.980 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.980 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.980 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:29.980 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.980 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:29.980 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:29.980 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:29.980 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:29.980 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:29.980 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:29.980 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:29.980 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:29.980 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:29.980 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.975+0000 7fd89887f640 10 monclient: _finish_auth 0 2026-02-12T18:10:29.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.975+0000 7fd89887f640 10 monclient: _check_auth_tickets 2026-02-12T18:10:29.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.975+0000 7fd89887f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:29.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.975+0000 7fd89887f640 1 -- 10.20.193.48:0/3779064335 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd890030cd0 con 0x7fd894095c80 2026-02-12T18:10:29.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.975+0000 7fd89bb0c640 5 monclient: authenticate success, global_id 5859 2026-02-12T18:10:29.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.975+0000 7fd89887f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:29.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.975+0000 7fd89887f640 1 -- 10.20.193.48:0/3779064335 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd890030e40 con 0x7fd894095c80 2026-02-12T18:10:29.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.975+0000 7fd89887f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:29.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.975+0000 7fd89887f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:10:29.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.975+0000 7fd89887f640 10 monclient: dump: 2026-02-12T18:10:29.981 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:29.981 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.981 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.981 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.981 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:29.981 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.981 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:29.981 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:29.981 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:29.981 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:29.981 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:29.981 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:29.981 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:29.981 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:29.981 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:29.981 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.975+0000 7fd89bb0c640 10 monclient: get_monmap_and_config success 2026-02-12T18:10:29.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.975+0000 7fd89bb0c640 4 set_mon_vals no callback set 2026-02-12T18:10:29.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.976+0000 7fd89bb0c640 10 monclient: shutdown 2026-02-12T18:10:29.981 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.976+0000 7fd89bb0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:29.982 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.976+0000 7fd89bb0c640 1 -- 10.20.193.48:0/3779064335 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd894095c80 msgr2=0x7fd8941a5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.982 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.976+0000 7fd89bb0c640 1 --2- 10.20.193.48:0/3779064335 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd894095c80 0x7fd8941a5bb0 secure :-1 s=READY pgs=353 gs=2 cs=0 l=1 c_cookie=17685283515510959219 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd89000a140 tx=0x7fd89002fed0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.982 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.976+0000 7fd89bb0c640 1 -- 10.20.193.48:0/3779064335 shutdown_connections 2026-02-12T18:10:29.982 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.976+0000 7fd89bb0c640 1 --2- 10.20.193.48:0/3779064335 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd894095c80 0x7fd8941a5bb0 unknown :-1 s=CLOSED pgs=353 gs=2 cs=0 l=1 c_cookie=17685283515510959219 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.982 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.976+0000 7fd89bb0c640 1 --2- 10.20.193.48:0/3779064335 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd8940951a0 0x7fd894093850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.982 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.976+0000 7fd89bb0c640 1 -- 10.20.193.48:0/3779064335 >> 10.20.193.48:0/3779064335 conn(0x7fd8940548c0 msgr2=0x7fd8940973a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:29.982 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.976+0000 7fd89bb0c640 1 -- 10.20.193.48:0/3779064335 shutdown_connections 2026-02-12T18:10:29.982 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.976+0000 7fd89bb0c640 1 -- 10.20.193.48:0/3779064335 wait complete. 2026-02-12T18:10:29.982 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.976+0000 7fd89bb0c640 10 monclient: build_initial_monmap 2026-02-12T18:10:29.982 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.976+0000 7fd89bb0c640 10 monclient: monmap: 2026-02-12T18:10:29.982 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:29.982 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:10:29.982 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:10:29.982 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:10:29.982 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:29.982 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.982 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:10:29.982 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:10:29.982 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:29.982 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:29.982 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:29.982 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:29.982 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:29.982 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:29.982 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:29.983 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.983 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.976+0000 7fd89bb0c640 1 Processor -- start 2026-02-12T18:10:29.983 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.976+0000 7fd89bb0c640 1 -- start start 2026-02-12T18:10:29.983 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.976+0000 7fd89bb0c640 10 monclient: init 2026-02-12T18:10:29.983 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd89bb0c640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:29.983 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd89bb0c640 10 monclient: _add_conns ranks=[2,6,4,5,7,0,8,1,3] 2026-02-12T18:10:29.983 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd89bb0c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd8940951a0 0x7fd8941d7b00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.983 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd89bb0c640 10 monclient(hunting): picked mon.noname-b con 0x7fd8940951a0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:10:29.983 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd89bb0c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd894095c80 0x7fd8941b0d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.983 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd89bb0c640 10 monclient(hunting): picked mon.noname-d con 0x7fd894095c80 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:10:29.983 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd89bb0c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd894096ad0 0x7fd8941b12d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.983 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd89bb0c640 10 monclient(hunting): picked mon.noname-c con 0x7fd894096ad0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:10:29.983 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd89bb0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.983 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd89bb0c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fd89408d090 con 0x7fd8940951a0 2026-02-12T18:10:29.983 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd89bb0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.983 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd89bb0c640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fd89419be90 con 0x7fd894096ad0 2026-02-12T18:10:29.983 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd89bb0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.983 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd89bb0c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fd894090130 con 0x7fd894095c80 2026-02-12T18:10:29.983 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd89bb0c640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:29.983 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd89bb0c640 10 monclient(hunting): authenticate will time out at 868.703106s 2026-02-12T18:10:29.983 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899881640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd8940951a0 0x7fd8941d7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.983 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd89a082640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd894096ad0 0x7fd8941b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.983 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899881640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd8940951a0 0x7fd8941d7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:58894/0 (socket says 10.20.193.48:58894) 2026-02-12T18:10:29.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899881640 1 -- 10.20.193.48:0/2478618612 learned_addr learned my addr 10.20.193.48:0/2478618612 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:29.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899881640 10 monclient(hunting): get_auth_request con 0x7fd8940951a0 auth_method 0 2026-02-12T18:10:29.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899881640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899881640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899881640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd89a082640 10 monclient(hunting): get_auth_request con 0x7fd894096ad0 auth_method 0 2026-02-12T18:10:29.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899080640 1 --2- 10.20.193.48:0/2478618612 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd894095c80 0x7fd8941b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd89a082640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd89a082640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd89a082640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899080640 10 monclient(hunting): get_auth_request con 0x7fd894095c80 auth_method 0 2026-02-12T18:10:29.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899080640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899080640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899080640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899881640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899881640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899881640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd89a082640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd89a082640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd89a082640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899080640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899080640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899080640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899881640 10 monclient(hunting): handle_auth_done global_id 35660 payload 824 2026-02-12T18:10:29.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899881640 1 -- 10.20.193.48:0/2478618612 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd894095c80 msgr2=0x7fd8941b0d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899881640 1 --2- 10.20.193.48:0/2478618612 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd894095c80 0x7fd8941b0d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899881640 1 -- 10.20.193.48:0/2478618612 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd894096ad0 msgr2=0x7fd8941b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899881640 1 --2- 10.20.193.48:0/2478618612 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd894096ad0 0x7fd8941b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899881640 10 monclient: _finish_hunting 0 2026-02-12T18:10:29.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899881640 1 monclient: found mon.noname-b 2026-02-12T18:10:29.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899881640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:29.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899881640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:10:29.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd899881640 1 -- 10.20.193.48:0/2478618612 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd89000a5d0 con 0x7fd8940951a0 2026-02-12T18:10:29.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.977+0000 7fd89a082640 1 --2- 10.20.193.48:0/2478618612 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd894096ad0 0x7fd8941b12d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:10:29.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.979+0000 7fd899881640 1 -- 10.20.193.48:0/2478618612 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd8940951a0 msgr2=0x7fd8941d7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:29.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.979+0000 7fd899881640 1 --2- 10.20.193.48:0/2478618612 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd8940951a0 0x7fd8941d7b00 secure :-1 s=READY pgs=215 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8840093f0 tx=0x7fd88400ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:29.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.979+0000 7fd8827fc640 1 -- 10.20.193.48:0/2478618612 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd88400cb50 con 0x7fd8940951a0 2026-02-12T18:10:29.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.979+0000 7fd8827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:29.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.979+0000 7fd8827fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:10:29.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.979+0000 7fd8827fc640 10 monclient: dump: 2026-02-12T18:10:29.987 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:29.987 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.987 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.987 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.987 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:29.987 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.987 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:29.987 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:29.987 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:29.987 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:29.987 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:29.987 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:29.987 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:29.987 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:29.987 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:29.987 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.979+0000 7fd8827fc640 10 monclient: _finish_auth 0 2026-02-12T18:10:29.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.979+0000 7fd8827fc640 10 monclient: _check_auth_tickets 2026-02-12T18:10:29.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.979+0000 7fd8827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:29.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.979+0000 7fd89bb0c640 5 monclient: authenticate success, global_id 35660 2026-02-12T18:10:29.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.979+0000 7fd89bb0c640 10 monclient: _renew_subs 2026-02-12T18:10:29.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.979+0000 7fd89bb0c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:10:29.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.979+0000 7fd89bb0c640 1 -- 10.20.193.48:0/2478618612 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd894098010 con 0x7fd8940951a0 2026-02-12T18:10:29.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.979+0000 7fd8827fc640 1 -- 10.20.193.48:0/2478618612 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd88400ccb0 con 0x7fd8940951a0 2026-02-12T18:10:29.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.979+0000 7fd8827fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:29.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.979+0000 7fd8827fc640 1 -- 10.20.193.48:0/2478618612 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd88400ce20 con 0x7fd8940951a0 2026-02-12T18:10:29.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.979+0000 7fd8827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:29.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.979+0000 7fd8827fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:10:29.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.979+0000 7fd883fff640 4 set_mon_vals no callback set 2026-02-12T18:10:29.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.979+0000 7fd8827fc640 10 monclient: dump: 2026-02-12T18:10:29.988 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:29.988 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.988 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.988 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.988 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:29.988 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.988 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:29.988 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:29.988 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:29.988 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:29.988 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:29.989 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:29.989 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:29.989 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:29.989 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:29.989 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.979+0000 7fd89bb0c640 10 monclient: _renew_subs 2026-02-12T18:10:29.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.979+0000 7fd89bb0c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:10:29.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.979+0000 7fd89bb0c640 1 -- 10.20.193.48:0/2478618612 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd89419c730 con 0x7fd8940951a0 2026-02-12T18:10:29.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.980+0000 7fd89bb0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:29.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.980+0000 7fd89bb0c640 1 --2- 10.20.193.48:0/2478618612 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd89419af30 0x7fd8941db040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.980+0000 7fd89bb0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.980+0000 7fd89bb0c640 1 -- 10.20.193.48:0/2478618612 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd89405f140 con 0x7fd89419af30 2026-02-12T18:10:29.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.980+0000 7fd899080640 1 --2- 10.20.193.48:0/2478618612 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd89419af30 0x7fd8941db040 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.980+0000 7fd899080640 10 monclient: get_auth_request con 0x7fd89419af30 auth_method 0 2026-02-12T18:10:29.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.980+0000 7fd899080640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.980+0000 7fd899080640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.980+0000 7fd899080640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.980+0000 7fd899080640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.980+0000 7fd899080640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.980+0000 7fd899080640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.980+0000 7fd8827fc640 1 -- 10.20.193.48:0/2478618612 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fd884011070 con 0x7fd8940951a0 2026-02-12T18:10:29.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.980+0000 7fd899080640 10 monclient(hunting): handle_auth_done global_id 64119 payload 824 2026-02-12T18:10:29.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.980+0000 7fd899080640 1 -- 10.20.193.48:0/2478618612 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd894097e90 con 0x7fd89419af30 2026-02-12T18:10:29.989 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.980+0000 7fd8827fc640 1 --2- 10.20.193.48:0/2478618612 >> v2:10.20.193.111:6812/977811348 conn(0x7fd86403f800 0x7fd86405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.980+0000 7fd8827fc640 1 -- 10.20.193.48:0/2478618612 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(210..210 src has 1..210) ==== 3897+0+0 (secure 0 0 0) 0x7fd884052f00 con 0x7fd8940951a0 2026-02-12T18:10:29.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.981+0000 7fd89a082640 1 --2- 10.20.193.48:0/2478618612 >> v2:10.20.193.111:6812/977811348 conn(0x7fd86403f800 0x7fd86405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.981+0000 7fd89a082640 10 monclient: get_auth_request con 0x7fd86403f800 auth_method 0 2026-02-12T18:10:29.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.983+0000 7fd899080640 1 -- 10.20.193.48:0/2478618612 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd89419af30 msgr2=0x7fd8941db040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:29.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.983+0000 7fd899080640 1 --2- 10.20.193.48:0/2478618612 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd89419af30 0x7fd8941db040 secure :-1 s=READY pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd894198b30 tx=0x7fd88800fc10 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:29.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.983+0000 7fd8827fc640 1 -- 10.20.193.48:0/2478618612 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd88800fe30 con 0x7fd89419af30 2026-02-12T18:10:29.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.983+0000 7fd8827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:29.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.983+0000 7fd8827fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:10:29.990 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.983+0000 7fd8827fc640 10 monclient: dump: 2026-02-12T18:10:29.990 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:29.990 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.990 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.990 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.990 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:29.990 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.990 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:29.990 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:29.990 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:29.990 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:29.990 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:29.990 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:29.990 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:29.990 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:29.990 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:29.990 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.983+0000 7fd89a082640 1 --2- 10.20.193.48:0/2478618612 >> v2:10.20.193.111:6812/977811348 conn(0x7fd86403f800 0x7fd86405fcb0 secure :-1 s=READY pgs=291 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd89002ff10 tx=0x7fd890007f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:29.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.983+0000 7fd8827fc640 1 -- 10.20.193.48:0/2478618612 <== mon.3 v2:10.20.193.111:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fd88800db90 con 0x7fd89419af30 2026-02-12T18:10:29.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.983+0000 7fd8827fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:29.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.983+0000 7fd8827fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:10:29.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.983+0000 7fd8827fc640 1 -- 10.20.193.48:0/2478618612 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd89419af30 msgr2=0x7fd8941db040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.983+0000 7fd8827fc640 1 --2- 10.20.193.48:0/2478618612 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd89419af30 0x7fd8941db040 secure :-1 s=READY pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd894198b30 tx=0x7fd88800fc10 comp rx=0 tx=0).stop 2026-02-12T18:10:29.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.983+0000 7fd8827fc640 1 -- 10.20.193.48:0/2478618612 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd89419af30 msgr2=0x7fd8941db040 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:29.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.983+0000 7fd8827fc640 1 --2- 10.20.193.48:0/2478618612 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd89419af30 0x7fd8941db040 unknown :-1 s=CLOSED pgs=13 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.987+0000 7fd89bb0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:10:29.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.987+0000 7fd89bb0c640 1 --2- 10.20.193.48:0/2478618612 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd8941db580 0x7fd8941db980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:29.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.987+0000 7fd89bb0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:29.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.987+0000 7fd89bb0c640 1 -- 10.20.193.48:0/2478618612 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd89405fd90 con 0x7fd8941db580 2026-02-12T18:10:29.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.987+0000 7fd899080640 1 --2- 10.20.193.48:0/2478618612 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd8941db580 0x7fd8941db980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:29.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.987+0000 7fd899080640 10 monclient: get_auth_request con 0x7fd8941db580 auth_method 0 2026-02-12T18:10:29.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.987+0000 7fd899080640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:29.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.987+0000 7fd899080640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:29.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.987+0000 7fd899080640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:29.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.987+0000 7fd899080640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:29.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.987+0000 7fd899080640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:29.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.987+0000 7fd899080640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:29.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.987+0000 7fd899080640 10 monclient(hunting): handle_auth_done global_id 64128 payload 824 2026-02-12T18:10:29.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.987+0000 7fd899080640 1 -- 10.20.193.48:0/2478618612 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd89405dc10 con 0x7fd8941db580 2026-02-12T18:10:29.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.989+0000 7fd899080640 1 -- 10.20.193.48:0/2478618612 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd8941db580 msgr2=0x7fd8941db980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:29.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.989+0000 7fd899080640 1 --2- 10.20.193.48:0/2478618612 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd8941db580 0x7fd8941db980 secure :-1 s=READY pgs=14 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd888016000 tx=0x7fd8880037e0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:29.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.990+0000 7fd8827fc640 1 -- 10.20.193.48:0/2478618612 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd888014e10 con 0x7fd8941db580 2026-02-12T18:10:29.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.990+0000 7fd8827fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:29.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.990+0000 7fd8827fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:10:29.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.990+0000 7fd8827fc640 10 monclient: dump: 2026-02-12T18:10:29.993 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:29.993 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:29.993 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.993 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:29.993 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:29.993 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:29.993 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:29.993 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:29.993 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:29.993 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:29.993 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:29.993 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:29.993 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:29.993 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:29.993 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:29.993 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:29.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.990+0000 7fd8827fc640 1 -- 10.20.193.48:0/2478618612 <== mon.3 v2:10.20.193.111:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7fd888014950 con 0x7fd8941db580 2026-02-12T18:10:29.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.990+0000 7fd8827fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:10:29.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.990+0000 7fd8827fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:10:29.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.990+0000 7fd8827fc640 1 -- 10.20.193.48:0/2478618612 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd8941db580 msgr2=0x7fd8941db980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:29.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.990+0000 7fd8827fc640 1 --2- 10.20.193.48:0/2478618612 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd8941db580 0x7fd8941db980 secure :-1 s=READY pgs=14 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd888016000 tx=0x7fd8880037e0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.990+0000 7fd8827fc640 1 -- 10.20.193.48:0/2478618612 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd8941db580 msgr2=0x7fd8941db980 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:29.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.990+0000 7fd8827fc640 1 --2- 10.20.193.48:0/2478618612 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd8941db580 0x7fd8941db980 secure :-1 s=CLOSED pgs=14 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd888016000 tx=0x7fd8880037e0 comp rx=0 tx=0).stop 2026-02-12T18:10:29.994 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:10:29.994 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:10:29.994 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:10:29.994 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:10:29.994 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 46, 2026-02-12T18:10:29.994 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 10792, 2026-02-12T18:10:29.994 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:10:29.994 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:10:29.994 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:10:29.994 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:10:29.994 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:10:29.994 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:10:29.994 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:10:29.994 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:10:29.994 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:10:29.994 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:10:29.995 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:29.995 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 4, 2026-02-12T18:10:29.995 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:29.995 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:10:29.995 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:10:29.995 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:29.995 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:29.995 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:29.995 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:29.995 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:29.995 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:29.995 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:29.995 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:29.995 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:29.995 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:29.995 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:29.995 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:29.995 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:29.995 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:29.995 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:10:29.995 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:10:29.995 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:29.995 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:29.996 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:29.996 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:29.996 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:29.996 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:29.996 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:29.996 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:29.996 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:29.996 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:29.996 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:29.996 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:29.996 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:29.996 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.996 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.996 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:10:29.996 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:10:29.996 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:10:29.996 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:10:29.996 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:10:29.996 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:10:29.996 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:29.996 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:29.996 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:10:29.996 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:10:29.996 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:10:29.997 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:10:29.997 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:10:29.997 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:10:29.997 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:10:29.997 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:29.997 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:10:29.997 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:29.997 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:29.997 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:29.997 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:29.997 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:29.997 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:29.997 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:29.997 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:29.997 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:29.997 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:29.997 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:29.997 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:29.997 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:29.997 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:29.997 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:10:29.997 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.997 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:10:29.997 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.997 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:10:29.997 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:10:29.998 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.998 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.998 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.998 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.998 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:10:29.998 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.998 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.998 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.998 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.998 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:10:29.998 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.998 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.998 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.998 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.998 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:10:29.998 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:10:29.998 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.998 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.998 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:10:29.998 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.998 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.998 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.998 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:10:29.998 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:10:29.998 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.999 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:29.999 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.999 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:29.999 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:10:29.999 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.999 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.999 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.999 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:29.999 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:10:29.999 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:29.999 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:29.999 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:29.999 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.999 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:10:29.999 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:10:29.999 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:29.999 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:29.999 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:10:29.999 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:29.999 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:29.999 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:29.999 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:10:29.999 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:10:29.999 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:29.999 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:30.000 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.000 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:30.000 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:10:30.000 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.000 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.000 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.000 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:30.000 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:10:30.000 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.000 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.000 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.000 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.000 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:10:30.000 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:10:30.000 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:30.000 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:30.000 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:10:30.000 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:30.000 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.000 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.000 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:10:30.000 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:10:30.000 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:30.000 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:30.000 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.001 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:30.001 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:10:30.001 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.001 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.001 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.001 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:30.001 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:10:30.001 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.001 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.001 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.001 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.001 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:10:30.001 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:10:30.001 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:30.001 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:30.001 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:10:30.001 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:30.001 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.001 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.001 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:10:30.001 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:10:30.001 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:30.001 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:30.001 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.001 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:30.002 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:10:30.002 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.002 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.002 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.002 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:30.002 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:10:30.002 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.002 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.002 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.002 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.002 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:10:30.002 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:10:30.002 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:30.002 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:30.002 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:30.002 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:30.002 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.002 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.002 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:10:30.002 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:10:30.002 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:30.002 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:30.002 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.002 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:30.002 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:10:30.003 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.003 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.003 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.003 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:30.003 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:10:30.003 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.003 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.003 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.003 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.003 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:10:30.003 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:10:30.003 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:30.003 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:30.003 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:10:30.003 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:30.003 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.003 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.003 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:10:30.003 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:10:30.003 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:30.003 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:30.003 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.003 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:30.003 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:10:30.003 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.004 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.004 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.004 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:30.004 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:10:30.004 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.004 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.004 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.004 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.004 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:10:30.004 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:10:30.004 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:30.004 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:30.004 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:30.004 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:30.004 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.004 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.004 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:10:30.004 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:10:30.004 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:30.004 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:30.004 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.004 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:30.004 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:10:30.004 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.004 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:30.005 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:10:30.006 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.006 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.006 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.006 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.006 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:10:30.006 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:10:30.006 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:30.006 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:30.006 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:10:30.006 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:30.006 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.006 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.006 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.006 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:10:30.006 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:10:30.006 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.006 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:30.006 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:30.006 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:30.006 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.006 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:30.006 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:10:30.007 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.007 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:30.007 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:30.007 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:30.007 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.007 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.007 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.007 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:10:30.007 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:10:30.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.990+0000 7fd89bb0c640 1 -- 10.20.193.48:0/2478618612 >> v2:10.20.193.111:6812/977811348 conn(0x7fd86403f800 msgr2=0x7fd86405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:30.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.990+0000 7fd89bb0c640 1 --2- 10.20.193.48:0/2478618612 >> v2:10.20.193.111:6812/977811348 conn(0x7fd86403f800 0x7fd86405fcb0 secure :-1 s=READY pgs=291 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd89002ff10 tx=0x7fd890007f90 comp rx=0 tx=0).stop 2026-02-12T18:10:30.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.990+0000 7fd89bb0c640 10 monclient: shutdown 2026-02-12T18:10:30.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.990+0000 7fd89bb0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:30.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.990+0000 7fd89bb0c640 1 -- 10.20.193.48:0/2478618612 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd8940951a0 msgr2=0x7fd8941d7b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:30.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.990+0000 7fd89a082640 1 -- 10.20.193.48:0/2478618612 reap_dead start 2026-02-12T18:10:30.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.990+0000 7fd89bb0c640 1 --2- 10.20.193.48:0/2478618612 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd8940951a0 0x7fd8941d7b00 secure :-1 s=READY pgs=215 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd8840093f0 tx=0x7fd88400ed50 comp rx=0 tx=0).stop 2026-02-12T18:10:30.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.990+0000 7fd89bb0c640 1 -- 10.20.193.48:0/2478618612 shutdown_connections 2026-02-12T18:10:30.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.990+0000 7fd89bb0c640 1 --2- 10.20.193.48:0/2478618612 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd8940951a0 0x7fd8941d7b00 unknown :-1 s=CLOSED pgs=215 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:30.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.990+0000 7fd89bb0c640 1 -- 10.20.193.48:0/2478618612 >> 10.20.193.48:0/2478618612 conn(0x7fd8940548c0 msgr2=0x7fd89408f620 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:30.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.990+0000 7fd89bb0c640 1 -- 10.20.193.48:0/2478618612 shutdown_connections 2026-02-12T18:10:30.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:29.990+0000 7fd89bb0c640 1 -- 10.20.193.48:0/2478618612 wait complete. 2026-02-12T18:10:30.008 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:10:30.009 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2026-02-12T18:10:30.009 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2026-02-12T18:10:30.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.072+0000 7f3e12fae640 10 monclient: get_monmap_and_config 2026-02-12T18:10:30.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.072+0000 7f3e12fae640 10 monclient: build_initial_monmap 2026-02-12T18:10:30.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.072+0000 7f3e12fae640 10 monclient: monmap: 2026-02-12T18:10:30.074 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:30.074 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:30.074 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:10:30.073994+0000 2026-02-12T18:10:30.074 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:10:30.073994+0000 2026-02-12T18:10:30.074 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:30.074 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:30.074 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:10:30.074 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:10:30.074 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:30.074 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:30.074 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:30.074 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:30.074 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:30.075 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:30.075 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:30.075 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:10:30.075 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:10:30.075 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:30.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.073+0000 7f3e12fae640 1 Processor -- start 2026-02-12T18:10:30.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.073+0000 7f3e12fae640 1 -- start start 2026-02-12T18:10:30.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.073+0000 7f3e12fae640 10 monclient: init 2026-02-12T18:10:30.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.073+0000 7f3e12fae640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:30.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.073+0000 7f3e12fae640 10 monclient: _add_conns ranks=[6,4,0,9,7,5,2,3,10,8,1] 2026-02-12T18:10:30.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.073+0000 7f3e12fae640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3e0c05d550 0x7f3e0c05d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:30.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.073+0000 7f3e12fae640 10 monclient(hunting): picked mon.noname-d con 0x7f3e0c05d550 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:10:30.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.073+0000 7f3e12fae640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3e0c05de60 0x7f3e0c141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:30.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.073+0000 7f3e12fae640 10 monclient(hunting): picked mon.noname-c con 0x7f3e0c05de60 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:10:30.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.073+0000 7f3e12fae640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3e0c13ef60 addr v1:10.20.193.48:6789/0 2026-02-12T18:10:30.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.073+0000 7f3e12fae640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e0c04dc20 con 0x7f3e0c13ef60 2026-02-12T18:10:30.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.073+0000 7f3e12fae640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:30.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.073+0000 7f3e12fae640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f3e0c08d390 con 0x7f3e0c05de60 2026-02-12T18:10:30.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.073+0000 7f3e12fae640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:30.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.073+0000 7f3e12fae640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f3e0c08d5a0 con 0x7f3e0c05d550 2026-02-12T18:10:30.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.073+0000 7f3e12fae640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:30.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.073+0000 7f3e12fae640 10 monclient(hunting): authenticate will time out at 868.799977s 2026-02-12T18:10:30.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e10d23640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3e0c05d550 0x7f3e0c05d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:30.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e10d23640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3e0c05d550 0x7f3e0c05d920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:36658/0 (socket says 10.20.193.48:36658) 2026-02-12T18:10:30.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e10d23640 1 -- 10.20.193.48:0/3952851281 learned_addr learned my addr 10.20.193.48:0/3952851281 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:30.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e10d23640 10 monclient(hunting): get_auth_request con 0x7f3e0c05d550 auth_method 0 2026-02-12T18:10:30.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e10d23640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:30.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e10d23640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:30.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e10d23640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:30.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e03fff640 1 --2- 10.20.193.48:0/3952851281 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3e0c05de60 0x7f3e0c141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:30.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e03fff640 10 monclient(hunting): get_auth_request con 0x7f3e0c05de60 auth_method 0 2026-02-12T18:10:30.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e03fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:30.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e03fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:30.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e03fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:30.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e10d23640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:30.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e10d23640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:30.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e10d23640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:30.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e03fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:30.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e03fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:30.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e03fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:30.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e03fff640 10 monclient(hunting): handle_auth_done global_id 64156 payload 274 2026-02-12T18:10:30.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e03fff640 1 -- 10.20.193.48:0/3952851281 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3e0c05d550 msgr2=0x7f3e0c05d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:30.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e03fff640 1 --2- 10.20.193.48:0/3952851281 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3e0c05d550 0x7f3e0c05d920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:30.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e03fff640 1 -- 10.20.193.48:0/3952851281 >> v1:10.20.193.48:6789/0 conn(0x7f3e0c13ef60 legacy=0x7f3e0c1424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:30.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e03fff640 10 monclient: _finish_hunting 0 2026-02-12T18:10:30.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e03fff640 1 monclient: found mon.noname-c 2026-02-12T18:10:30.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e03fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:30.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e03fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:10:30.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e03fff640 1 -- 10.20.193.48:0/3952851281 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0c0580e0 con 0x7f3e0c05de60 2026-02-12T18:10:30.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.074+0000 7f3e10d23640 1 --2- 10.20.193.48:0/3952851281 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3e0c05d550 0x7f3e0c05d920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:10:30.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.076+0000 7f3e03fff640 1 -- 10.20.193.48:0/3952851281 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3e0c05de60 msgr2=0x7f3e0c141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:30.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.076+0000 7f3e03fff640 1 --2- 10.20.193.48:0/3952851281 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3e0c05de60 0x7f3e0c141fa0 secure :-1 s=READY pgs=17 gs=2 cs=0 l=1 c_cookie=207445745579431884 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3df4009800 tx=0x7f3df402ed50 comp rx=0 tx=0).ready entity=mon.4 client_cookie=2e0fece776d97cc server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:30.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.076+0000 7f3e037fe640 1 -- 10.20.193.48:0/3952851281 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3df402fe90 con 0x7f3e0c05de60 2026-02-12T18:10:30.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.077+0000 7f3e037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:30.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.077+0000 7f3e037fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:10:30.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.077+0000 7f3e037fe640 10 monclient: dump: 2026-02-12T18:10:30.079 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:30.079 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:30.079 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.079 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.079 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:30.079 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:30.079 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:30.079 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:30.080 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:30.080 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:30.080 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:30.080 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:30.080 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:30.080 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:30.080 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:30.080 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:30.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.077+0000 7f3e037fe640 10 monclient: _finish_auth 0 2026-02-12T18:10:30.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.077+0000 7f3e037fe640 10 monclient: _check_auth_tickets 2026-02-12T18:10:30.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.077+0000 7f3e037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:30.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.077+0000 7f3e037fe640 1 -- 10.20.193.48:0/3952851281 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3df4035340 con 0x7f3e0c05de60 2026-02-12T18:10:30.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.077+0000 7f3e12fae640 5 monclient: authenticate success, global_id 64156 2026-02-12T18:10:30.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.077+0000 7f3e12fae640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:10:30.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.077+0000 7f3e037fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:30.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.077+0000 7f3e037fe640 1 -- 10.20.193.48:0/3952851281 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3df4035970 con 0x7f3e0c05de60 2026-02-12T18:10:30.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.077+0000 7f3e12fae640 10 monclient: get_monmap_and_config success 2026-02-12T18:10:30.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.077+0000 7f3e12fae640 4 set_mon_vals no callback set 2026-02-12T18:10:30.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.077+0000 7f3e037fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:30.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.077+0000 7f3e037fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:10:30.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.077+0000 7f3e037fe640 10 monclient: dump: 2026-02-12T18:10:30.080 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:30.080 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:30.080 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.080 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.081 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:30.081 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:30.081 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:30.081 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:30.081 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:30.081 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:30.081 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:30.081 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:30.081 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:30.081 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:30.081 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:30.081 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:30.081 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.077+0000 7f3e12fae640 10 monclient: shutdown 2026-02-12T18:10:30.081 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.077+0000 7f3e12fae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:30.081 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.077+0000 7f3e12fae640 1 -- 10.20.193.48:0/3952851281 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3e0c05de60 msgr2=0x7f3e0c141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:30.081 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.077+0000 7f3e12fae640 1 --2- 10.20.193.48:0/3952851281 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3e0c05de60 0x7f3e0c141fa0 secure :-1 s=READY pgs=17 gs=2 cs=0 l=1 c_cookie=207445745579431884 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3df4009800 tx=0x7f3df402ed50 comp rx=0 tx=0).stop 2026-02-12T18:10:30.081 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.077+0000 7f3e12fae640 1 -- 10.20.193.48:0/3952851281 shutdown_connections 2026-02-12T18:10:30.081 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.077+0000 7f3e12fae640 1 --2- 10.20.193.48:0/3952851281 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3e0c05de60 0x7f3e0c141fa0 unknown :-1 s=CLOSED pgs=17 gs=2 cs=0 l=1 c_cookie=207445745579431884 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:30.081 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.077+0000 7f3e12fae640 1 --2- 10.20.193.48:0/3952851281 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3e0c05d550 0x7f3e0c05d920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:30.081 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.077+0000 7f3e12fae640 1 -- 10.20.193.48:0/3952851281 >> 10.20.193.48:0/3952851281 conn(0x7f3e0c0546a0 msgr2=0x7f3e0c054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:30.081 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.077+0000 7f3e12fae640 1 -- 10.20.193.48:0/3952851281 shutdown_connections 2026-02-12T18:10:30.081 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.077+0000 7f3e12fae640 1 -- 10.20.193.48:0/3952851281 wait complete. 2026-02-12T18:10:30.082 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.078+0000 7f3e12fae640 10 monclient: build_initial_monmap 2026-02-12T18:10:30.082 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.078+0000 7f3e12fae640 10 monclient: monmap: 2026-02-12T18:10:30.082 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:30.082 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:10:30.082 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:10:30.083 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:10:30.083 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:30.083 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:30.083 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:10:30.083 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:10:30.083 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:30.083 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:30.083 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:30.083 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:30.083 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:30.083 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:30.083 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:30.083 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:30.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.078+0000 7f3e12fae640 1 Processor -- start 2026-02-12T18:10:30.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.078+0000 7f3e12fae640 1 -- start start 2026-02-12T18:10:30.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.078+0000 7f3e12fae640 10 monclient: init 2026-02-12T18:10:30.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.078+0000 7f3e12fae640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:30.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.078+0000 7f3e12fae640 10 monclient: _add_conns ranks=[4,0,8,6,7,2,1,3,5] 2026-02-12T18:10:30.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e12fae640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3e0c05d550 0x7f3e0c12f4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:30.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e12fae640 10 monclient(hunting): picked mon.noname-c con 0x7f3e0c05d550 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:10:30.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e12fae640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3e0c05de60 0x7f3e0c11c890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:30.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e12fae640 10 monclient(hunting): picked mon.noname-a con 0x7f3e0c05de60 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:10:30.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e12fae640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3e0c13ef60 0x7f3e0c11cdd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:30.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e12fae640 10 monclient(hunting): picked mon.noname-e con 0x7f3e0c13ef60 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:10:30.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e12fae640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:30.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e12fae640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c130470 con 0x7f3e0c05de60 2026-02-12T18:10:30.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e12fae640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:30.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e12fae640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f3e0c13c5a0 con 0x7f3e0c05d550 2026-02-12T18:10:30.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e12fae640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:30.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e12fae640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f3e0c13c7d0 con 0x7f3e0c13ef60 2026-02-12T18:10:30.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e12fae640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:30.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e12fae640 10 monclient(hunting): authenticate will time out at 868.805168s 2026-02-12T18:10:30.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e10d23640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3e0c05d550 0x7f3e0c12f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:30.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e10d23640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3e0c05d550 0x7f3e0c12f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:53226/0 (socket says 10.20.193.48:53226) 2026-02-12T18:10:30.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e10d23640 1 -- 10.20.193.48:0/1555233961 learned_addr learned my addr 10.20.193.48:0/1555233961 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:30.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e10d23640 10 monclient(hunting): get_auth_request con 0x7f3e0c05d550 auth_method 0 2026-02-12T18:10:30.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e10d23640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:30.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e10d23640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:30.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e10d23640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:30.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e10d23640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:30.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e10d23640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:30.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e10d23640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:30.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e03fff640 1 --2- 10.20.193.48:0/1555233961 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3e0c05de60 0x7f3e0c11c890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:30.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e03fff640 10 monclient(hunting): get_auth_request con 0x7f3e0c05de60 auth_method 0 2026-02-12T18:10:30.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e03fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:30.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e03fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:30.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e03fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:30.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e11524640 1 --2- 10.20.193.48:0/1555233961 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3e0c13ef60 0x7f3e0c11cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:30.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e03fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:30.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e03fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:30.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e03fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:30.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e10d23640 10 monclient(hunting): handle_auth_done global_id 64165 payload 824 2026-02-12T18:10:30.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e10d23640 1 -- 10.20.193.48:0/1555233961 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3e0c13ef60 msgr2=0x7f3e0c11cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:30.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e10d23640 1 --2- 10.20.193.48:0/1555233961 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3e0c13ef60 0x7f3e0c11cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:30.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e10d23640 1 -- 10.20.193.48:0/1555233961 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3e0c05de60 msgr2=0x7f3e0c11c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:30.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e10d23640 1 --2- 10.20.193.48:0/1555233961 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3e0c05de60 0x7f3e0c11c890 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:30.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e10d23640 10 monclient: _finish_hunting 0 2026-02-12T18:10:30.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e10d23640 1 monclient: found mon.noname-c 2026-02-12T18:10:30.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e10d23640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:30.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e10d23640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:10:30.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e10d23640 1 -- 10.20.193.48:0/1555233961 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dfc0094f0 con 0x7f3e0c05d550 2026-02-12T18:10:30.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e11524640 10 monclient: get_auth_request con 0x7f3e0c13ef60 auth_method 0 2026-02-12T18:10:30.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.079+0000 7f3e11524640 1 --2- 10.20.193.48:0/1555233961 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3e0c13ef60 0x7f3e0c11cdd0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-12T18:10:30.086 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.081+0000 7f3e10d23640 1 -- 10.20.193.48:0/1555233961 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3e0c05d550 msgr2=0x7f3e0c12f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:30.086 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.081+0000 7f3e10d23640 1 --2- 10.20.193.48:0/1555233961 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3e0c05d550 0x7f3e0c12f4a0 secure :-1 s=READY pgs=18 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3dfc006f70 tx=0x7f3dfc00c520 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:30.086 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.081+0000 7f3e017fa640 1 -- 10.20.193.48:0/1555233961 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3dfc00ee90 con 0x7f3e0c05d550 2026-02-12T18:10:30.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.081+0000 7f3e017fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:30.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.081+0000 7f3e017fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:10:30.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.081+0000 7f3e017fa640 10 monclient: dump: 2026-02-12T18:10:30.087 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:30.087 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:30.087 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.087 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.087 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:30.087 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:30.087 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:30.087 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:30.087 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:30.087 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:30.087 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:30.087 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:30.087 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:30.087 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:30.087 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:30.087 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:30.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.081+0000 7f3e017fa640 10 monclient: _finish_auth 0 2026-02-12T18:10:30.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.081+0000 7f3e017fa640 10 monclient: _check_auth_tickets 2026-02-12T18:10:30.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.081+0000 7f3e017fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:30.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.081+0000 7f3e017fa640 1 -- 10.20.193.48:0/1555233961 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3dfc00ce20 con 0x7f3e0c05d550 2026-02-12T18:10:30.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.081+0000 7f3e017fa640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:30.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.081+0000 7f3e017fa640 1 -- 10.20.193.48:0/1555233961 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3dfc0044f0 con 0x7f3e0c05d550 2026-02-12T18:10:30.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.081+0000 7f3e12fae640 5 monclient: authenticate success, global_id 64165 2026-02-12T18:10:30.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.081+0000 7f3e12fae640 10 monclient: _renew_subs 2026-02-12T18:10:30.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.081+0000 7f3e12fae640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:10:30.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.081+0000 7f3e12fae640 1 -- 10.20.193.48:0/1555233961 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3df4009420 con 0x7f3e0c05d550 2026-02-12T18:10:30.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.081+0000 7f3e02ffd640 4 set_mon_vals no callback set 2026-02-12T18:10:30.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.081+0000 7f3e017fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:30.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.081+0000 7f3e017fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:10:30.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.081+0000 7f3e017fa640 10 monclient: dump: 2026-02-12T18:10:30.088 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:30.088 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:30.088 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.088 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.088 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:30.088 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:30.088 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:30.088 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:30.088 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:30.088 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:30.088 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:30.088 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:30.088 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:30.088 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:30.088 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:30.088 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:30.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.081+0000 7f3e12fae640 10 monclient: _renew_subs 2026-02-12T18:10:30.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.081+0000 7f3e12fae640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:10:30.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.081+0000 7f3e12fae640 1 -- 10.20.193.48:0/1555233961 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e0c05ceb0 con 0x7f3e0c05d550 2026-02-12T18:10:30.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.082+0000 7f3e12fae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:30.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.082+0000 7f3e12fae640 1 --2- 10.20.193.48:0/1555233961 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f3e0c091010 0x7f3e0c11d310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:30.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.082+0000 7f3e12fae640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:30.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.082+0000 7f3e12fae640 1 -- 10.20.193.48:0/1555233961 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f3e0c0631f0 con 0x7f3e0c091010 2026-02-12T18:10:30.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.082+0000 7f3e017fa640 1 -- 10.20.193.48:0/1555233961 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f3dfc011070 con 0x7f3e0c05d550 2026-02-12T18:10:30.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.083+0000 7f3e017fa640 1 --2- 10.20.193.48:0/1555233961 >> v2:10.20.193.111:6812/977811348 conn(0x7f3ddc03f800 0x7f3ddc05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:30.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.083+0000 7f3e017fa640 1 -- 10.20.193.48:0/1555233961 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(211..211 src has 1..211) ==== 3897+0+0 (secure 0 0 0) 0x7f3dfc052dc0 con 0x7f3e0c05d550 2026-02-12T18:10:30.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.083+0000 7f3e11524640 1 --2- 10.20.193.48:0/1555233961 >> v2:10.20.193.111:6812/977811348 conn(0x7f3ddc03f800 0x7f3ddc05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:30.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.083+0000 7f3e03fff640 1 --2- 10.20.193.48:0/1555233961 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f3e0c091010 0x7f3e0c11d310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:30.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.083+0000 7f3e11524640 10 monclient: get_auth_request con 0x7f3ddc03f800 auth_method 0 2026-02-12T18:10:30.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.083+0000 7f3e03fff640 10 monclient: get_auth_request con 0x7f3e0c091010 auth_method 0 2026-02-12T18:10:30.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.083+0000 7f3e03fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:30.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.083+0000 7f3e03fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:30.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.083+0000 7f3e03fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:30.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.083+0000 7f3e03fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:30.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.083+0000 7f3e03fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:30.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.083+0000 7f3e03fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:30.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.083+0000 7f3e03fff640 10 monclient(hunting): handle_auth_done global_id 5648 payload 824 2026-02-12T18:10:30.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.083+0000 7f3e03fff640 1 -- 10.20.193.48:0/1555233961 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3e0c08d060 con 0x7f3e0c091010 2026-02-12T18:10:30.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.085+0000 7f3e11524640 1 --2- 10.20.193.48:0/1555233961 >> v2:10.20.193.111:6812/977811348 conn(0x7f3ddc03f800 0x7f3ddc05fcb0 secure :-1 s=READY pgs=292 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e08004850 tx=0x7f3e0800a040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:30.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.086+0000 7f3e03fff640 1 -- 10.20.193.48:0/1555233961 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f3e0c091010 msgr2=0x7f3e0c11d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:30.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.086+0000 7f3e03fff640 1 --2- 10.20.193.48:0/1555233961 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f3e0c091010 0x7f3e0c11d310 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3df40090b0 tx=0x7f3df4004770 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:30.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.086+0000 7f3e017fa640 1 -- 10.20.193.48:0/1555233961 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3df4035df0 con 0x7f3e0c091010 2026-02-12T18:10:30.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.086+0000 7f3e017fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:30.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.086+0000 7f3e017fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:10:30.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.086+0000 7f3e017fa640 10 monclient: dump: 2026-02-12T18:10:30.090 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:30.090 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:30.090 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.091 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.091 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:30.091 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:30.091 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:30.091 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:30.091 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:30.091 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:30.091 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:30.091 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:30.091 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:30.091 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:30.091 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:30.091 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:30.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.086+0000 7f3e017fa640 1 -- 10.20.193.48:0/1555233961 <== mon.5 v2:10.20.193.111:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f3df4049400 con 0x7f3e0c091010 2026-02-12T18:10:30.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.086+0000 7f3e017fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:30.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.086+0000 7f3e017fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:10:30.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.086+0000 7f3e017fa640 1 -- 10.20.193.48:0/1555233961 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f3e0c091010 msgr2=0x7f3e0c11d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:30.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.086+0000 7f3e017fa640 1 --2- 10.20.193.48:0/1555233961 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f3e0c091010 0x7f3e0c11d310 secure :-1 s=READY pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3df40090b0 tx=0x7f3df4004770 comp rx=0 tx=0).stop 2026-02-12T18:10:30.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.086+0000 7f3e017fa640 1 -- 10.20.193.48:0/1555233961 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f3e0c091010 msgr2=0x7f3e0c11d310 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:30.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.086+0000 7f3e017fa640 1 --2- 10.20.193.48:0/1555233961 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f3e0c091010 0x7f3e0c11d310 unknown :-1 s=CLOSED pgs=228 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:30.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.090+0000 7f3e12fae640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:10:30.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.090+0000 7f3e12fae640 1 --2- 10.20.193.48:0/1555233961 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f3e0c12cf90 0x7f3e0c12d390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:30.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.090+0000 7f3e12fae640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:30.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.090+0000 7f3e12fae640 1 -- 10.20.193.48:0/1555233961 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f3e0c05f140 con 0x7f3e0c12cf90 2026-02-12T18:10:30.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.090+0000 7f3e03fff640 1 --2- 10.20.193.48:0/1555233961 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f3e0c12cf90 0x7f3e0c12d390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:30.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.090+0000 7f3e03fff640 10 monclient: get_auth_request con 0x7f3e0c12cf90 auth_method 0 2026-02-12T18:10:30.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.090+0000 7f3e03fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:30.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.090+0000 7f3e03fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:30.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.090+0000 7f3e03fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:30.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.090+0000 7f3e03fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:30.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.090+0000 7f3e03fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:30.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.090+0000 7f3e03fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:30.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.091+0000 7f3e03fff640 10 monclient(hunting): handle_auth_done global_id 5657 payload 824 2026-02-12T18:10:30.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.091+0000 7f3e03fff640 1 -- 10.20.193.48:0/1555233961 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3e0c05e310 con 0x7f3e0c12cf90 2026-02-12T18:10:30.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.093+0000 7f3e03fff640 1 -- 10.20.193.48:0/1555233961 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f3e0c12cf90 msgr2=0x7f3e0c12d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:30.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.093+0000 7f3e03fff640 1 --2- 10.20.193.48:0/1555233961 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f3e0c12cf90 0x7f3e0c12d390 secure :-1 s=READY pgs=229 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3df4009800 tx=0x7f3df4009210 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:30.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.093+0000 7f3e017fa640 1 -- 10.20.193.48:0/1555233961 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3df404e6e0 con 0x7f3e0c12cf90 2026-02-12T18:10:30.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.093+0000 7f3e017fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:30.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.093+0000 7f3e017fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:10:30.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.093+0000 7f3e017fa640 10 monclient: dump: 2026-02-12T18:10:30.095 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:30.095 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:30.096 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.096 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.096 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:30.096 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:30.096 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:30.096 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:30.096 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:30.096 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:30.096 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:30.096 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:30.096 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:30.096 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:30.096 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:30.096 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:30.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.093+0000 7f3e017fa640 1 -- 10.20.193.48:0/1555233961 <== mon.5 v2:10.20.193.111:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10182 (secure 0 0 0) 0x7f3df404e840 con 0x7f3e0c12cf90 2026-02-12T18:10:30.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.093+0000 7f3e017fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:10:30.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.093+0000 7f3e017fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:10:30.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.093+0000 7f3e017fa640 1 -- 10.20.193.48:0/1555233961 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f3e0c12cf90 msgr2=0x7f3e0c12d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:30.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.093+0000 7f3e017fa640 1 --2- 10.20.193.48:0/1555233961 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f3e0c12cf90 0x7f3e0c12d390 secure :-1 s=READY pgs=229 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3df4009800 tx=0x7f3df4009210 comp rx=0 tx=0).stop 2026-02-12T18:10:30.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.093+0000 7f3e017fa640 1 -- 10.20.193.48:0/1555233961 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f3e0c12cf90 msgr2=0x7f3e0c12d390 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:30.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.093+0000 7f3e017fa640 1 --2- 10.20.193.48:0/1555233961 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f3e0c12cf90 0x7f3e0c12d390 secure :-1 s=CLOSED pgs=229 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3df4009800 tx=0x7f3df4009210 comp rx=0 tx=0).stop 2026-02-12T18:10:30.097 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:10:30.097 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:10:30.097 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:10:30.097 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:10:30.097 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 46, 2026-02-12T18:10:30.097 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 284888, 2026-02-12T18:10:30.097 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:10:30.097 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:10:30.097 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:10:30.097 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:10:30.097 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:10:30.097 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:10:30.097 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:10:30.097 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:10:30.097 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:10:30.097 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:10:30.097 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:30.097 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 4, 2026-02-12T18:10:30.098 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:30.098 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:10:30.098 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:10:30.098 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:30.098 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:30.098 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:30.098 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:30.098 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:30.098 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:30.098 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:30.098 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:30.098 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:30.098 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:30.098 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:30.098 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:30.098 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:30.098 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:30.098 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:10:30.098 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:10:30.098 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:30.098 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:30.098 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:30.098 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:30.099 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:30.099 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:30.099 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:30.099 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:30.099 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:30.099 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:30.099 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:30.099 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:30.099 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:30.099 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.099 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.099 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:10:30.099 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:10:30.099 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:10:30.099 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:10:30.099 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:10:30.099 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:10:30.099 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:30.099 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:30.099 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:10:30.099 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:10:30.099 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:10:30.099 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:10:30.100 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:10:30.100 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:10:30.100 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:10:30.100 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:30.100 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:10:30.100 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:30.100 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:30.100 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:30.100 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:30.100 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:30.100 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:30.100 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:30.100 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:30.100 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:30.100 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:30.100 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:30.100 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:30.100 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:30.100 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:30.100 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:10:30.100 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.100 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:10:30.100 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.101 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:10:30.101 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:10:30.101 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:30.101 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:30.101 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.101 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:30.101 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:10:30.101 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.101 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.101 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.101 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:30.101 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:10:30.101 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.101 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.101 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.101 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.101 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:10:30.101 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:10:30.101 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:30.101 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:30.101 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:10:30.101 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:30.101 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.101 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.102 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:10:30.102 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:10:30.102 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:30.102 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:30.102 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.102 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:30.102 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:10:30.102 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.102 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.102 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.102 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:30.102 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:10:30.102 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.102 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.102 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.102 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.102 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:10:30.102 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:10:30.102 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:30.102 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:30.102 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:10:30.102 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:30.102 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.103 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.103 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:10:30.103 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:10:30.103 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:30.103 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:30.103 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.103 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:30.103 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:10:30.103 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.103 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.103 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.103 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:30.103 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:10:30.103 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.103 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.103 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.103 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.103 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:10:30.103 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:10:30.103 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:30.103 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:30.103 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:10:30.103 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:30.103 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.104 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.104 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:10:30.104 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:10:30.104 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:30.104 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:30.104 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.104 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:30.104 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:10:30.104 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.104 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.104 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.104 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:30.104 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:10:30.104 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.104 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.104 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.104 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.104 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:10:30.104 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:10:30.104 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:30.104 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:30.104 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:10:30.104 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:30.104 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.105 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.105 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:10:30.105 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:10:30.105 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:30.105 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:30.105 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.105 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:30.105 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:10:30.105 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.105 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.105 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.105 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:30.105 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:10:30.105 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.105 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.105 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.105 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.105 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:10:30.105 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:10:30.105 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:30.105 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:30.105 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:30.105 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:30.105 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.106 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.106 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:10:30.106 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:10:30.106 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:30.106 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:30.106 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.106 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:30.106 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:10:30.106 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.106 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.106 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.106 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:30.106 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:10:30.106 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.106 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.106 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.106 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.106 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:10:30.106 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:10:30.106 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:30.106 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:30.106 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:10:30.106 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:30.106 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.107 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.107 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:10:30.107 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:10:30.107 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:30.107 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:30.107 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.107 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:30.107 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:10:30.107 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.107 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.107 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.107 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:30.107 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:10:30.107 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.107 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.107 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.107 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.107 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:10:30.107 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:10:30.107 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:30.107 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:30.107 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:30.107 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:30.107 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.108 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.108 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:10:30.108 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:10:30.108 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:30.108 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:30.108 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.108 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:30.108 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:10:30.108 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.108 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.108 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.108 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:30.108 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:10:30.108 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.108 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.108 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.108 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.108 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:10:30.108 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:10:30.108 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:30.108 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:30.109 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:10:30.109 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:30.109 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.109 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.109 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:10:30.109 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:10:30.109 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:30.109 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:30.109 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.109 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:30.109 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:10:30.109 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.109 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.109 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.109 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:30.109 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:10:30.109 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.109 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.109 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.109 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.109 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:10:30.109 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:10:30.109 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:30.109 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:30.110 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:10:30.110 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:30.110 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.110 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.110 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.110 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:10:30.110 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:10:30.110 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.110 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:30.110 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:30.110 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:30.110 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.110 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:30.110 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:10:30.110 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.110 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:30.110 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:30.110 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:30.110 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.110 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:30.110 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:10:30.110 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.110 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:30.110 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:30.111 INFO:teuthology.orchestra.run.trial048.stdout: "num": 4 2026-02-12T18:10:30.111 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.111 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.111 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.111 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:10:30.111 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:10:30.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.093+0000 7f3e12fae640 1 -- 10.20.193.48:0/1555233961 >> v2:10.20.193.111:6812/977811348 conn(0x7f3ddc03f800 msgr2=0x7f3ddc05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:30.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.093+0000 7f3e12fae640 1 --2- 10.20.193.48:0/1555233961 >> v2:10.20.193.111:6812/977811348 conn(0x7f3ddc03f800 0x7f3ddc05fcb0 secure :-1 s=READY pgs=292 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3e08004850 tx=0x7f3e0800a040 comp rx=0 tx=0).stop 2026-02-12T18:10:30.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.093+0000 7f3e12fae640 10 monclient: shutdown 2026-02-12T18:10:30.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.093+0000 7f3e12fae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:30.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.093+0000 7f3e12fae640 1 -- 10.20.193.48:0/1555233961 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3e0c05d550 msgr2=0x7f3e0c12f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:30.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.093+0000 7f3e12fae640 1 --2- 10.20.193.48:0/1555233961 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3e0c05d550 0x7f3e0c12f4a0 secure :-1 s=READY pgs=18 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3dfc006f70 tx=0x7f3dfc00c520 comp rx=0 tx=0).stop 2026-02-12T18:10:30.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.093+0000 7f3e11524640 1 -- 10.20.193.48:0/1555233961 reap_dead start 2026-02-12T18:10:30.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.094+0000 7f3e12fae640 1 -- 10.20.193.48:0/1555233961 shutdown_connections 2026-02-12T18:10:30.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.094+0000 7f3e12fae640 1 --2- 10.20.193.48:0/1555233961 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3e0c05d550 0x7f3e0c12f4a0 unknown :-1 s=CLOSED pgs=18 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:30.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.094+0000 7f3e12fae640 1 -- 10.20.193.48:0/1555233961 >> 10.20.193.48:0/1555233961 conn(0x7f3e0c0546a0 msgr2=0x7f3e0c08a680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:30.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.094+0000 7f3e12fae640 1 -- 10.20.193.48:0/1555233961 shutdown_connections 2026-02-12T18:10:30.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.094+0000 7f3e12fae640 1 -- 10.20.193.48:0/1555233961 wait complete. 2026-02-12T18:10:30.112 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:10:30.113 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2026-02-12T18:10:30.113 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2026-02-12T18:10:30.136 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30251]: starting. 2026-02-12T18:10:30.136 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30251]: creating pool ceph_test_rados_delete_pools_parallel.trial111-30250 2026-02-12T18:10:30.136 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30251]: created object 0... 2026-02-12T18:10:30.136 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30251]: created object 25... 2026-02-12T18:10:30.136 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30251]: created object 49... 2026-02-12T18:10:30.136 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30251]: finishing. 2026-02-12T18:10:30.136 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30251]: shutting down. 2026-02-12T18:10:30.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.176+0000 7f30a185b640 10 monclient: get_monmap_and_config 2026-02-12T18:10:30.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.176+0000 7f30a185b640 10 monclient: build_initial_monmap 2026-02-12T18:10:30.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.176+0000 7f30a185b640 10 monclient: monmap: 2026-02-12T18:10:30.177 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:30.177 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:30.177 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:10:30.177244+0000 2026-02-12T18:10:30.177 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:10:30.177244+0000 2026-02-12T18:10:30.177 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:30.177 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:30.178 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:10:30.178 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:10:30.178 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:30.178 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:30.178 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:30.178 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:30.178 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:30.178 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:30.178 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:30.178 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:10:30.178 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:10:30.178 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:30.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.176+0000 7f30a185b640 1 Processor -- start 2026-02-12T18:10:30.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.176+0000 7f30a185b640 1 -- start start 2026-02-12T18:10:30.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.176+0000 7f30a185b640 10 monclient: init 2026-02-12T18:10:30.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.176+0000 7f30a185b640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:30.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.176+0000 7f30a185b640 10 monclient: _add_conns ranks=[2,10,0,3,4,1,6,8,9,7,5] 2026-02-12T18:10:30.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.176+0000 7f30a185b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f309c057db0 0x7f309c141140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:30.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.176+0000 7f30a185b640 10 monclient(hunting): picked mon.noname-b con 0x7f309c057db0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:10:30.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.176+0000 7f30a185b640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f309c090c40 0x7f309c1441e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:30.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.176+0000 7f30a185b640 10 monclient(hunting): picked mon.noname-f con 0x7f309c090c40 addr v2:10.20.193.111:3300/0 2026-02-12T18:10:30.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.176+0000 7f30a185b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f309c091010 addr v1:10.20.193.48:6789/0 2026-02-12T18:10:30.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.176+0000 7f30a185b640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f309c04dc20 con 0x7f309c091010 2026-02-12T18:10:30.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.176+0000 7f30a185b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:30.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.176+0000 7f30a185b640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f309c058180 con 0x7f309c090c40 2026-02-12T18:10:30.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.176+0000 7f30a185b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:30.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.176+0000 7f30a185b640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f309c091a60 con 0x7f309c057db0 2026-02-12T18:10:30.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.176+0000 7f30a185b640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:30.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.176+0000 7f30a185b640 10 monclient(hunting): authenticate will time out at 868.902964s 2026-02-12T18:10:30.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.177+0000 7f309affd640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f309c057db0 0x7f309c141140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:30.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.177+0000 7f309b7fe640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f309c091010 0x7f309c144720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:56738/0 (socket says 10.20.193.48:56738) 2026-02-12T18:10:30.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.177+0000 7f309b7fe640 1 -- 10.20.193.48:0/2171666215 learned_addr learned my addr 10.20.193.48:0/2171666215 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:10:30.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.177+0000 7f309affd640 10 monclient(hunting): get_auth_request con 0x7f309c057db0 auth_method 0 2026-02-12T18:10:30.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.177+0000 7f309affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:30.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.177+0000 7f309affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:30.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.177+0000 7f309affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:30.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.177+0000 7f309affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:30.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.177+0000 7f309affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:30.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.177+0000 7f309a7fc640 1 --2- 10.20.193.48:0/2171666215 >> v2:10.20.193.111:3300/0 conn(0x7f309c090c40 0x7f309c1441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:30.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.177+0000 7f309affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:30.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.177+0000 7f309a7fc640 10 monclient(hunting): get_auth_request con 0x7f309c090c40 auth_method 0 2026-02-12T18:10:30.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.177+0000 7f309a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:30.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.177+0000 7f309a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:30.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.177+0000 7f309a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:30.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.177+0000 7f309affd640 10 monclient(hunting): handle_auth_done global_id 35669 payload 274 2026-02-12T18:10:30.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.177+0000 7f309affd640 1 -- 10.20.193.48:0/2171666215 >> v2:10.20.193.111:3300/0 conn(0x7f309c090c40 msgr2=0x7f309c1441e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:30.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.177+0000 7f309affd640 1 --2- 10.20.193.48:0/2171666215 >> v2:10.20.193.111:3300/0 conn(0x7f309c090c40 0x7f309c1441e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:30.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.177+0000 7f309affd640 1 -- 10.20.193.48:0/2171666215 >> v1:10.20.193.48:6789/0 conn(0x7f309c091010 legacy=0x7f309c144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:30.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.177+0000 7f309affd640 10 monclient: _finish_hunting 0 2026-02-12T18:10:30.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.177+0000 7f309affd640 1 monclient: found mon.noname-b 2026-02-12T18:10:30.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.177+0000 7f309affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:30.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.177+0000 7f309affd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:10:30.180 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.177+0000 7f309affd640 1 -- 10.20.193.48:0/2171666215 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f309c056ff0 con 0x7f309c057db0 2026-02-12T18:10:30.181 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.179+0000 7f309affd640 1 -- 10.20.193.48:0/2171666215 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f309c057db0 msgr2=0x7f309c141140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:30.181 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.179+0000 7f309affd640 1 --2- 10.20.193.48:0/2171666215 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f309c057db0 0x7f309c141140 secure :-1 s=READY pgs=216 gs=2 cs=0 l=1 c_cookie=4381772824604812992 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3090004740 tx=0x7f309002ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ccf2f2b1907a6c0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:30.181 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f3099ffb640 1 -- 10.20.193.48:0/2171666215 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f309002fe50 con 0x7f309c057db0 2026-02-12T18:10:30.181 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f3099ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:30.181 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f3099ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:10:30.181 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f3099ffb640 10 monclient: dump: 2026-02-12T18:10:30.181 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:30.181 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:30.181 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.181 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.181 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:30.181 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:30.181 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:30.181 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:30.181 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:30.181 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:30.181 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:30.181 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:30.181 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:30.181 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:30.181 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f3099ffb640 10 monclient: _finish_auth 0 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f3099ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f3099ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f3099ffb640 1 -- 10.20.193.48:0/2171666215 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3090035340 con 0x7f309c057db0 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f30a185b640 5 monclient: authenticate success, global_id 35669 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f30a185b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f3099ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f3099ffb640 1 -- 10.20.193.48:0/2171666215 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3090035970 con 0x7f309c057db0 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f3099ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f3099ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f3099ffb640 10 monclient: dump: 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f30a185b640 10 monclient: get_monmap_and_config success 2026-02-12T18:10:30.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f30a185b640 4 set_mon_vals no callback set 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f30a185b640 10 monclient: shutdown 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f30a185b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f30a185b640 1 -- 10.20.193.48:0/2171666215 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f309c057db0 msgr2=0x7f309c141140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f30a185b640 1 --2- 10.20.193.48:0/2171666215 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f309c057db0 0x7f309c141140 secure :-1 s=READY pgs=216 gs=2 cs=0 l=1 c_cookie=4381772824604812992 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3090004740 tx=0x7f309002ed10 comp rx=0 tx=0).stop 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f30a185b640 1 -- 10.20.193.48:0/2171666215 shutdown_connections 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f30a185b640 1 --2- 10.20.193.48:0/2171666215 >> v2:10.20.193.111:3300/0 conn(0x7f309c090c40 0x7f309c1441e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f30a185b640 1 --2- 10.20.193.48:0/2171666215 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f309c057db0 0x7f309c141140 unknown :-1 s=CLOSED pgs=216 gs=2 cs=0 l=1 c_cookie=4381772824604812992 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f30a185b640 1 -- 10.20.193.48:0/2171666215 >> 10.20.193.48:0/2171666215 conn(0x7f309c054de0 msgr2=0x7f309c095230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f30a185b640 1 -- 10.20.193.48:0/2171666215 shutdown_connections 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f30a185b640 1 -- 10.20.193.48:0/2171666215 wait complete. 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f30a185b640 10 monclient: build_initial_monmap 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.180+0000 7f30a185b640 10 monclient: monmap: 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f30a185b640 1 Processor -- start 2026-02-12T18:10:30.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f30a185b640 1 -- start start 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f30a185b640 10 monclient: init 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f30a185b640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f30a185b640 10 monclient: _add_conns ranks=[7,4,5,0,2,8,1,6,3] 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f30a185b640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f309c057db0 0x7f309c10c1a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f30a185b640 10 monclient(hunting): picked mon.noname-i con 0x7f309c057db0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f30a185b640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f309c090c40 0x7f309c12e390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f30a185b640 10 monclient(hunting): picked mon.noname-c con 0x7f309c090c40 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f30a185b640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f309c091010 0x7f309c12e8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f30a185b640 10 monclient(hunting): picked mon.noname-h con 0x7f309c091010 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f30a185b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f30a185b640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f309c10bd90 con 0x7f309c090c40 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f30a185b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f30a185b640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f309c140340 con 0x7f309c091010 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f30a185b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f30a185b640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f309c144af0 con 0x7f309c057db0 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f30a185b640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f30a185b640 10 monclient(hunting): authenticate will time out at 868.907490s 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309a7fc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f309c090c40 0x7f309c12e390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309a7fc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f309c090c40 0x7f309c12e390 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:53234/0 (socket says 10.20.193.48:53234) 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309a7fc640 1 -- 10.20.193.48:0/1088062943 learned_addr learned my addr 10.20.193.48:0/1088062943 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309a7fc640 10 monclient(hunting): get_auth_request con 0x7f309c090c40 auth_method 0 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309affd640 1 --2- 10.20.193.48:0/1088062943 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f309c057db0 0x7f309c10c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309b7fe640 1 --2- 10.20.193.48:0/1088062943 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f309c091010 0x7f309c12e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309affd640 10 monclient(hunting): get_auth_request con 0x7f309c057db0 auth_method 0 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309b7fe640 10 monclient(hunting): get_auth_request con 0x7f309c091010 auth_method 0 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:30.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:30.186 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309a7fc640 10 monclient(hunting): handle_auth_done global_id 64174 payload 824 2026-02-12T18:10:30.186 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309a7fc640 1 -- 10.20.193.48:0/1088062943 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f309c057db0 msgr2=0x7f309c10c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:30.186 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309a7fc640 1 --2- 10.20.193.48:0/1088062943 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f309c057db0 0x7f309c10c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:30.186 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309a7fc640 1 -- 10.20.193.48:0/1088062943 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f309c091010 msgr2=0x7f309c12e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:30.186 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309a7fc640 1 --2- 10.20.193.48:0/1088062943 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f309c091010 0x7f309c12e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:30.186 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309a7fc640 10 monclient: _finish_hunting 0 2026-02-12T18:10:30.186 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309a7fc640 1 monclient: found mon.noname-c 2026-02-12T18:10:30.186 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:30.186 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309a7fc640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:10:30.186 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.181+0000 7f309a7fc640 1 -- 10.20.193.48:0/1088062943 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3090009420 con 0x7f309c090c40 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f309a7fc640 1 -- 10.20.193.48:0/1088062943 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f309c090c40 msgr2=0x7f309c12e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f309a7fc640 1 --2- 10.20.193.48:0/1088062943 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f309c090c40 0x7f309c12e390 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3084006f30 tx=0x7f308400ebd0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f3073fff640 1 -- 10.20.193.48:0/1088062943 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f308400ee30 con 0x7f309c090c40 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f3073fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f3073fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f3073fff640 10 monclient: dump: 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f3073fff640 10 monclient: _finish_auth 0 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f3073fff640 10 monclient: _check_auth_tickets 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f3073fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f3073fff640 1 -- 10.20.193.48:0/1088062943 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f308400cda0 con 0x7f309c090c40 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f3073fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:30.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f3073fff640 1 -- 10.20.193.48:0/1088062943 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f30840138d0 con 0x7f309c090c40 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f30a185b640 5 monclient: authenticate success, global_id 64174 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f30a185b640 10 monclient: _renew_subs 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f30a185b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f30997fa640 4 set_mon_vals no callback set 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f30a185b640 1 -- 10.20.193.48:0/1088062943 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f309c056430 con 0x7f309c090c40 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f3073fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f3073fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f3073fff640 10 monclient: dump: 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f30a185b640 10 monclient: _renew_subs 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f30a185b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f30a185b640 1 -- 10.20.193.48:0/1088062943 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f309c10e320 con 0x7f309c090c40 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f30a185b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f30a185b640 1 --2- 10.20.193.48:0/1088062943 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f309c10d0e0 0x7f309c12ee10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f30a185b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f30a185b640 1 -- 10.20.193.48:0/1088062943 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f309c094410 con 0x7f309c10d0e0 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f309affd640 1 --2- 10.20.193.48:0/1088062943 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f309c10d0e0 0x7f309c12ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f309affd640 10 monclient: get_auth_request con 0x7f309c10d0e0 auth_method 0 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f309affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f309affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:30.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f309affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:30.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.184+0000 7f309a7fc640 1 --2- 10.20.193.48:0/1088062943 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f309c090c40 0x7f309c12e390 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3084006f30 tx=0x7f308400ebd0 comp rx=0 tx=0).queue_received will delay after 1.77092e+09 on 0x7f3084052c50 osd_map(211..211 src has 1..211) 2026-02-12T18:10:30.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.185+0000 7f3073fff640 1 -- 10.20.193.48:0/1088062943 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f3084013410 con 0x7f309c090c40 2026-02-12T18:10:30.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.185+0000 7f309affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:30.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.185+0000 7f309affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:30.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.185+0000 7f309affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:30.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.185+0000 7f3073fff640 1 --2- 10.20.193.48:0/1088062943 >> v2:10.20.193.111:6812/977811348 conn(0x7f306c03f800 0x7f306c05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:30.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.185+0000 7f309affd640 10 monclient(hunting): handle_auth_done global_id 44863 payload 824 2026-02-12T18:10:30.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.185+0000 7f309affd640 1 -- 10.20.193.48:0/1088062943 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f309c0562b0 con 0x7f309c10d0e0 2026-02-12T18:10:30.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.185+0000 7f309b7fe640 1 --2- 10.20.193.48:0/1088062943 >> v2:10.20.193.111:6812/977811348 conn(0x7f306c03f800 0x7f306c05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:30.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.185+0000 7f309b7fe640 10 monclient: get_auth_request con 0x7f306c03f800 auth_method 0 2026-02-12T18:10:30.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.187+0000 7f309affd640 1 -- 10.20.193.48:0/1088062943 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f309c10d0e0 msgr2=0x7f309c12ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:30.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.187+0000 7f309affd640 1 --2- 10.20.193.48:0/1088062943 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f309c10d0e0 0x7f309c12ee10 secure :-1 s=READY pgs=107 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3090009750 tx=0x7f30900047e0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:30.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.187+0000 7f3073fff640 1 -- 10.20.193.48:0/1088062943 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3090003da0 con 0x7f309c10d0e0 2026-02-12T18:10:30.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.187+0000 7f3073fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:30.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.187+0000 7f3073fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:10:30.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.187+0000 7f3073fff640 10 monclient: dump: 2026-02-12T18:10:30.189 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:30.189 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:30.189 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.189 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.189 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:30.189 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:30.190 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:30.190 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:30.190 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:30.190 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:30.190 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:30.190 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:30.190 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:30.190 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:30.190 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:30.190 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:30.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.188+0000 7f309b7fe640 1 --2- 10.20.193.48:0/1088062943 >> v2:10.20.193.111:6812/977811348 conn(0x7f306c03f800 0x7f306c05fcb0 secure :-1 s=READY pgs=293 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f309c13eee0 tx=0x7f308c00a040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:30.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.188+0000 7f3073fff640 1 -- 10.20.193.48:0/1088062943 <== mon.7 v2:10.20.193.111:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f30900038e0 con 0x7f309c10d0e0 2026-02-12T18:10:30.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.188+0000 7f3073fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:30.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.188+0000 7f3073fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:10:30.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.188+0000 7f3073fff640 1 -- 10.20.193.48:0/1088062943 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f309c10d0e0 msgr2=0x7f309c12ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:30.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.188+0000 7f3073fff640 1 --2- 10.20.193.48:0/1088062943 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f309c10d0e0 0x7f309c12ee10 secure :-1 s=READY pgs=107 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3090009750 tx=0x7f30900047e0 comp rx=0 tx=0).stop 2026-02-12T18:10:30.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.188+0000 7f3073fff640 1 -- 10.20.193.48:0/1088062943 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f309c10d0e0 msgr2=0x7f309c12ee10 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:30.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.188+0000 7f3073fff640 1 --2- 10.20.193.48:0/1088062943 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f309c10d0e0 0x7f309c12ee10 secure :-1 s=CLOSED pgs=107 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3090009750 tx=0x7f30900047e0 comp rx=0 tx=0).stop 2026-02-12T18:10:30.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.191+0000 7f30a185b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:10:30.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.191+0000 7f30a185b640 1 --2- 10.20.193.48:0/1088062943 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f309c10c6e0 0x7f309c08cc20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:30.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.191+0000 7f30a185b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:30.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.191+0000 7f30a185b640 1 -- 10.20.193.48:0/1088062943 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f309c050410 con 0x7f309c10c6e0 2026-02-12T18:10:30.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.191+0000 7f309affd640 1 --2- 10.20.193.48:0/1088062943 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f309c10c6e0 0x7f309c08cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:30.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.191+0000 7f309affd640 10 monclient: get_auth_request con 0x7f309c10c6e0 auth_method 0 2026-02-12T18:10:30.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.191+0000 7f309affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:30.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.191+0000 7f309affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:30.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.191+0000 7f309affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:30.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.191+0000 7f309affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:30.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.191+0000 7f309affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:30.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.191+0000 7f309affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:30.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.191+0000 7f309affd640 10 monclient(hunting): handle_auth_done global_id 44872 payload 824 2026-02-12T18:10:30.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.191+0000 7f309affd640 1 -- 10.20.193.48:0/1088062943 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f309c0575b0 con 0x7f309c10c6e0 2026-02-12T18:10:30.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.194+0000 7f309affd640 1 -- 10.20.193.48:0/1088062943 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f309c10c6e0 msgr2=0x7f309c08cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:30.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.194+0000 7f309affd640 1 --2- 10.20.193.48:0/1088062943 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f309c10c6e0 0x7f309c08cc20 secure :-1 s=READY pgs=108 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30900090b0 tx=0x7f3090008030 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:30.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.194+0000 7f3073fff640 1 -- 10.20.193.48:0/1088062943 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3090051040 con 0x7f309c10c6e0 2026-02-12T18:10:30.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.194+0000 7f3073fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.194+0000 7f3073fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.194+0000 7f3073fff640 10 monclient: dump: 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.194+0000 7f3073fff640 1 -- 10.20.193.48:0/1088062943 <== mon.7 v2:10.20.193.111:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10015 (secure 0 0 0) 0x7f3090035e80 con 0x7f309c10c6e0 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.194+0000 7f3073fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.194+0000 7f3073fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.194+0000 7f3073fff640 1 -- 10.20.193.48:0/1088062943 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f309c10c6e0 msgr2=0x7f309c08cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.194+0000 7f3073fff640 1 --2- 10.20.193.48:0/1088062943 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f309c10c6e0 0x7f309c08cc20 secure :-1 s=READY pgs=108 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30900090b0 tx=0x7f3090008030 comp rx=0 tx=0).stop 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.194+0000 7f3073fff640 1 -- 10.20.193.48:0/1088062943 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f309c10c6e0 msgr2=0x7f309c08cc20 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.194+0000 7f3073fff640 1 --2- 10.20.193.48:0/1088062943 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f309c10c6e0 0x7f309c08cc20 secure :-1 s=CLOSED pgs=108 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f30900090b0 tx=0x7f3090008030 comp rx=0 tx=0).stop 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:10:30.196 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 46, 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 142077, 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 4, 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:30.197 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:30.198 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:30.199 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.200 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:10:30.201 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.202 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:30.203 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.204 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:10:30.205 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:10:30.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.194+0000 7f30a185b640 1 -- 10.20.193.48:0/1088062943 >> v2:10.20.193.111:6812/977811348 conn(0x7f306c03f800 msgr2=0x7f306c05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:30.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.194+0000 7f30a185b640 1 --2- 10.20.193.48:0/1088062943 >> v2:10.20.193.111:6812/977811348 conn(0x7f306c03f800 0x7f306c05fcb0 secure :-1 s=READY pgs=293 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f309c13eee0 tx=0x7f308c00a040 comp rx=0 tx=0).stop 2026-02-12T18:10:30.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.194+0000 7f30a185b640 10 monclient: shutdown 2026-02-12T18:10:30.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.194+0000 7f30a185b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:30.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.194+0000 7f30a185b640 1 -- 10.20.193.48:0/1088062943 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f309c090c40 msgr2=0x7f309c12e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:30.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.194+0000 7f309b7fe640 1 -- 10.20.193.48:0/1088062943 reap_dead start 2026-02-12T18:10:30.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.194+0000 7f30a185b640 1 --2- 10.20.193.48:0/1088062943 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f309c090c40 0x7f309c12e390 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3084006f30 tx=0x7f308400ebd0 comp rx=0 tx=0).stop 2026-02-12T18:10:30.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.194+0000 7f3073fff640 1 -- 10.20.193.48:0/1088062943 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(211..211 src has 1..211) ==== 3897+0+0 (unknown 0 0 0) 0x7f3084052c50 con 0x7f309c090c40 2026-02-12T18:10:30.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.194+0000 7f30a185b640 1 -- 10.20.193.48:0/1088062943 shutdown_connections 2026-02-12T18:10:30.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.194+0000 7f30a185b640 1 --2- 10.20.193.48:0/1088062943 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f309c090c40 0x7f309c12e390 unknown :-1 s=CLOSED pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:30.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.194+0000 7f30a185b640 1 -- 10.20.193.48:0/1088062943 >> 10.20.193.48:0/1088062943 conn(0x7f309c054de0 msgr2=0x7f309c140960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:30.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.194+0000 7f30a185b640 1 -- 10.20.193.48:0/1088062943 shutdown_connections 2026-02-12T18:10:30.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.194+0000 7f30a185b640 1 -- 10.20.193.48:0/1088062943 wait complete. 2026-02-12T18:10:30.207 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:10:30.207 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-12T18:10:30.207 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-12T18:10:30.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.270+0000 7f48b68af640 10 monclient: get_monmap_and_config 2026-02-12T18:10:30.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.270+0000 7f48b68af640 10 monclient: build_initial_monmap 2026-02-12T18:10:30.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.270+0000 7f48b68af640 10 monclient: monmap: 2026-02-12T18:10:30.271 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:30.271 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:30.271 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:10:30.271434+0000 2026-02-12T18:10:30.272 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:10:30.271434+0000 2026-02-12T18:10:30.272 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:30.272 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:30.272 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:10:30.272 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:10:30.272 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:30.272 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:30.272 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:30.272 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:30.272 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:30.272 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:30.272 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:30.272 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:10:30.272 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:10:30.272 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:30.273 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.270+0000 7f48b68af640 1 Processor -- start 2026-02-12T18:10:30.274 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.270+0000 7f48b68af640 1 -- start start 2026-02-12T18:10:30.274 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.270+0000 7f48b68af640 10 monclient: init 2026-02-12T18:10:30.274 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48b68af640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:30.274 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48b68af640 10 monclient: _add_conns ranks=[4,5,10,7,3,1,0,9,6,8,2] 2026-02-12T18:10:30.274 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48b68af640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f48b0056a80 0x7f48b01442e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:30.274 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48b68af640 10 monclient(hunting): picked mon.noname-c con 0x7f48b0056a80 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:10:30.274 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48b68af640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f48b005e380 0x7f48b0144820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:30.274 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48b68af640 10 monclient(hunting): picked mon.noname-h con 0x7f48b005e380 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:10:30.274 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48b68af640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f48b0089df0 0x7f48b008a260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:30.274 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48b68af640 10 monclient(hunting): picked mon.noname-f con 0x7f48b0089df0 addr v2:10.20.193.111:3300/0 2026-02-12T18:10:30.274 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48b68af640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:30.274 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48b68af640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f48b0144d60 con 0x7f48b0089df0 2026-02-12T18:10:30.274 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48b68af640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:30.274 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48b68af640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f48b0056e50 con 0x7f48b0056a80 2026-02-12T18:10:30.274 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48b68af640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:30.274 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48b68af640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f48b0092300 con 0x7f48b005e380 2026-02-12T18:10:30.274 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48b68af640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:30.274 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48b68af640 10 monclient(hunting): authenticate will time out at 868.997126s 2026-02-12T18:10:30.274 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48affff640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f48b0056a80 0x7f48b01442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:30.274 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48affff640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f48b0056a80 0x7f48b01442e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:53248/0 (socket says 10.20.193.48:53248) 2026-02-12T18:10:30.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48affff640 1 -- 10.20.193.48:0/2812446309 learned_addr learned my addr 10.20.193.48:0/2812446309 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:30.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48affff640 10 monclient(hunting): get_auth_request con 0x7f48b0056a80 auth_method 0 2026-02-12T18:10:30.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:30.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48affff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:30.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48affff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:30.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48af7fe640 1 --2- 10.20.193.48:0/2812446309 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f48b005e380 0x7f48b0144820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:30.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48af7fe640 10 monclient(hunting): get_auth_request con 0x7f48b005e380 auth_method 0 2026-02-12T18:10:30.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48af7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:30.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48af7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:30.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48af7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:30.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48b4e25640 1 --2- 10.20.193.48:0/2812446309 >> v2:10.20.193.111:3300/0 conn(0x7f48b0089df0 0x7f48b008a260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:30.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48affff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:30.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48affff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:30.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48affff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:30.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48af7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:30.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48af7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:30.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48af7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:30.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48b4e25640 10 monclient(hunting): get_auth_request con 0x7f48b0089df0 auth_method 0 2026-02-12T18:10:30.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48b4e25640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:30.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48b4e25640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:30.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48b4e25640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:30.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48affff640 10 monclient(hunting): handle_auth_done global_id 64183 payload 274 2026-02-12T18:10:30.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48affff640 1 -- 10.20.193.48:0/2812446309 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f48b005e380 msgr2=0x7f48b0144820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:30.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48affff640 1 --2- 10.20.193.48:0/2812446309 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f48b005e380 0x7f48b0144820 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:30.276 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48affff640 1 -- 10.20.193.48:0/2812446309 >> v2:10.20.193.111:3300/0 conn(0x7f48b0089df0 msgr2=0x7f48b008a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:30.276 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48affff640 1 --2- 10.20.193.48:0/2812446309 >> v2:10.20.193.111:3300/0 conn(0x7f48b0089df0 0x7f48b008a260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:30.276 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48affff640 10 monclient: _finish_hunting 0 2026-02-12T18:10:30.276 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48affff640 1 monclient: found mon.noname-c 2026-02-12T18:10:30.276 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48affff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:30.276 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48affff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:10:30.276 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.271+0000 7f48affff640 1 -- 10.20.193.48:0/2812446309 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48b0060390 con 0x7f48b0056a80 2026-02-12T18:10:30.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.273+0000 7f48affff640 1 -- 10.20.193.48:0/2812446309 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f48b0056a80 msgr2=0x7f48b01442e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:30.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.273+0000 7f48affff640 1 --2- 10.20.193.48:0/2812446309 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f48b0056a80 0x7f48b01442e0 secure :-1 s=READY pgs=20 gs=1 cs=0 l=1 c_cookie=336183134221053595 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f489c009060 tx=0x7f489c02edf0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=4aa5cc786b92e9b server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:30.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48aeffd640 1 -- 10.20.193.48:0/2812446309 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f489c035340 con 0x7f48b0056a80 2026-02-12T18:10:30.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:30.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48aeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:10:30.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48aeffd640 10 monclient: dump: 2026-02-12T18:10:30.278 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:30.278 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:30.279 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.279 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.279 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:30.279 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:30.279 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:30.279 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:30.279 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:30.279 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:30.279 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:30.279 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:30.279 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:30.279 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:30.279 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:30.279 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:30.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48aeffd640 10 monclient: _finish_auth 0 2026-02-12T18:10:30.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48aeffd640 10 monclient: _check_auth_tickets 2026-02-12T18:10:30.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48aeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:30.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48aeffd640 1 -- 10.20.193.48:0/2812446309 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f489c0354c0 con 0x7f48b0056a80 2026-02-12T18:10:30.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48b68af640 5 monclient: authenticate success, global_id 64183 2026-02-12T18:10:30.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48b68af640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:10:30.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48aeffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:30.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48aeffd640 1 -- 10.20.193.48:0/2812446309 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f489c035af0 con 0x7f48b0056a80 2026-02-12T18:10:30.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:30.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48aeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:10:30.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48aeffd640 10 monclient: dump: 2026-02-12T18:10:30.280 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:30.280 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:30.280 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.280 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.280 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:30.280 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:30.280 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:30.280 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:30.280 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:30.280 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:30.280 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:30.280 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:30.280 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:30.280 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:30.280 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:30.280 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:30.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48b68af640 10 monclient: get_monmap_and_config success 2026-02-12T18:10:30.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48b68af640 4 set_mon_vals no callback set 2026-02-12T18:10:30.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48b68af640 10 monclient: shutdown 2026-02-12T18:10:30.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48b68af640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:30.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48b68af640 1 -- 10.20.193.48:0/2812446309 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f48b0056a80 msgr2=0x7f48b01442e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:30.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48b68af640 1 --2- 10.20.193.48:0/2812446309 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f48b0056a80 0x7f48b01442e0 secure :-1 s=READY pgs=20 gs=1 cs=0 l=1 c_cookie=336183134221053595 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f489c009060 tx=0x7f489c02edf0 comp rx=0 tx=0).stop 2026-02-12T18:10:30.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48b68af640 1 -- 10.20.193.48:0/2812446309 shutdown_connections 2026-02-12T18:10:30.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48b68af640 1 --2- 10.20.193.48:0/2812446309 >> v2:10.20.193.111:3300/0 conn(0x7f48b0089df0 0x7f48b008a260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:30.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48b68af640 1 --2- 10.20.193.48:0/2812446309 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f48b005e380 0x7f48b0144820 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:30.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48b68af640 1 --2- 10.20.193.48:0/2812446309 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f48b0056a80 0x7f48b01442e0 unknown :-1 s=CLOSED pgs=20 gs=1 cs=0 l=1 c_cookie=336183134221053595 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:30.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48b68af640 1 -- 10.20.193.48:0/2812446309 >> 10.20.193.48:0/2812446309 conn(0x7f48b0096410 msgr2=0x7f48b0097a40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:30.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48b68af640 1 -- 10.20.193.48:0/2812446309 shutdown_connections 2026-02-12T18:10:30.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48b68af640 1 -- 10.20.193.48:0/2812446309 wait complete. 2026-02-12T18:10:30.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48b68af640 10 monclient: build_initial_monmap 2026-02-12T18:10:30.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.274+0000 7f48b68af640 10 monclient: monmap: 2026-02-12T18:10:30.281 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:30.281 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:10:30.281 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:10:30.281 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:10:30.281 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:30.281 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:30.281 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:10:30.281 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:10:30.281 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:30.281 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:30.281 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:30.281 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:30.281 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:30.281 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:30.281 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:30.281 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:30.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b68af640 1 Processor -- start 2026-02-12T18:10:30.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b68af640 1 -- start start 2026-02-12T18:10:30.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b68af640 10 monclient: init 2026-02-12T18:10:30.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b68af640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:30.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b68af640 10 monclient: _add_conns ranks=[0,4,6,2,1,7,3,8,5] 2026-02-12T18:10:30.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b68af640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f48b0056a80 0x7f48b01338e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:30.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b68af640 10 monclient(hunting): picked mon.noname-a con 0x7f48b0056a80 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:10:30.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b68af640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f48b005e380 0x7f48b010daf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:30.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b68af640 10 monclient(hunting): picked mon.noname-c con 0x7f48b005e380 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:10:30.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b68af640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f48b0089df0 0x7f48b010e030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:30.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b68af640 10 monclient(hunting): picked mon.noname-d con 0x7f48b0089df0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:10:30.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b68af640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:30.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b68af640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f48b01115a0 con 0x7f48b0056a80 2026-02-12T18:10:30.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b68af640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:30.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b68af640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f48b00940c0 con 0x7f48b005e380 2026-02-12T18:10:30.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b68af640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:30.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b68af640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f48b010f240 con 0x7f48b0089df0 2026-02-12T18:10:30.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b68af640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:30.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b68af640 10 monclient(hunting): authenticate will time out at 869.001475s 2026-02-12T18:10:30.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48af7fe640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f48b005e380 0x7f48b010daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:30.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48affff640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f48b0056a80 0x7f48b01338e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:30.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b4e25640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f48b0089df0 0x7f48b010e030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:30.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48affff640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f48b0056a80 0x7f48b01338e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:58114/0 (socket says 10.20.193.48:58114) 2026-02-12T18:10:30.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48affff640 1 -- 10.20.193.48:0/4106254501 learned_addr learned my addr 10.20.193.48:0/4106254501 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:30.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48af7fe640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f48b005e380 0x7f48b010daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:53264/0 (socket says 10.20.193.48:53264) 2026-02-12T18:10:30.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48affff640 10 monclient(hunting): get_auth_request con 0x7f48b0056a80 auth_method 0 2026-02-12T18:10:30.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48affff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:30.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48affff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:30.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48affff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:30.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b4e25640 10 monclient(hunting): get_auth_request con 0x7f48b0089df0 auth_method 0 2026-02-12T18:10:30.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b4e25640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:30.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b4e25640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:30.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b4e25640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:30.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48af7fe640 10 monclient(hunting): get_auth_request con 0x7f48b005e380 auth_method 0 2026-02-12T18:10:30.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48af7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:30.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48af7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:30.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48af7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:30.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48affff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:30.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48affff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:30.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48affff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:30.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48af7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:30.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48af7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:30.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48af7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:30.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b4e25640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:30.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b4e25640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:30.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48b4e25640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:30.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48affff640 10 monclient(hunting): handle_auth_done global_id 5877 payload 824 2026-02-12T18:10:30.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48affff640 1 -- 10.20.193.48:0/4106254501 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f48b0089df0 msgr2=0x7f48b010e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:30.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48affff640 1 --2- 10.20.193.48:0/4106254501 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f48b0089df0 0x7f48b010e030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:30.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48affff640 1 -- 10.20.193.48:0/4106254501 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f48b005e380 msgr2=0x7f48b010daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:30.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48affff640 1 --2- 10.20.193.48:0/4106254501 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f48b005e380 0x7f48b010daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:30.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48affff640 10 monclient: _finish_hunting 0 2026-02-12T18:10:30.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48affff640 1 monclient: found mon.noname-a 2026-02-12T18:10:30.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48affff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:30.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48affff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:10:30.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48affff640 1 -- 10.20.193.48:0/4106254501 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f489c0094f0 con 0x7f48b0056a80 2026-02-12T18:10:30.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.275+0000 7f48af7fe640 1 --2- 10.20.193.48:0/4106254501 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f48b005e380 0x7f48b010daf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:10:30.285 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48affff640 1 -- 10.20.193.48:0/4106254501 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f48b0056a80 msgr2=0x7f48b01338e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:30.285 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48affff640 1 --2- 10.20.193.48:0/4106254501 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f48b0056a80 0x7f48b01338e0 secure :-1 s=READY pgs=356 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f489c004740 tx=0x7f489c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:30.285 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48acff9640 1 -- 10.20.193.48:0/4106254501 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f489c035340 con 0x7f48b0056a80 2026-02-12T18:10:30.285 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48acff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:30.285 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48acff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:10:30.285 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48acff9640 10 monclient: dump: 2026-02-12T18:10:30.285 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:30.285 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:30.285 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.285 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.286 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:30.286 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:30.286 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:30.286 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:30.286 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:30.286 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:30.286 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:30.286 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:30.286 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:30.286 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:30.286 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:30.287 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:30.287 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48acff9640 10 monclient: _finish_auth 0 2026-02-12T18:10:30.287 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48acff9640 10 monclient: _check_auth_tickets 2026-02-12T18:10:30.287 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48acff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:30.287 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48acff9640 1 -- 10.20.193.48:0/4106254501 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f489c0044f0 con 0x7f48b0056a80 2026-02-12T18:10:30.287 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48b68af640 5 monclient: authenticate success, global_id 5877 2026-02-12T18:10:30.287 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48b68af640 10 monclient: _renew_subs 2026-02-12T18:10:30.287 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48b68af640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:10:30.287 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48b68af640 1 -- 10.20.193.48:0/4106254501 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48b0124be0 con 0x7f48b0056a80 2026-02-12T18:10:30.287 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48acff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:30.287 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48acff9640 1 -- 10.20.193.48:0/4106254501 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f489c035d80 con 0x7f48b0056a80 2026-02-12T18:10:30.287 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48acff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:30.287 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48acff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:10:30.287 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48ae7fc640 4 set_mon_vals no callback set 2026-02-12T18:10:30.287 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48acff9640 10 monclient: dump: 2026-02-12T18:10:30.287 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:30.287 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:30.287 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.287 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:30.287 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:30.288 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:30.288 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:30.288 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:30.288 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:30.288 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:30.288 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:30.288 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:30.288 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:30.288 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:30.288 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:30.288 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:30.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48b68af640 10 monclient: _renew_subs 2026-02-12T18:10:30.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48b68af640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:10:30.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48b68af640 1 -- 10.20.193.48:0/4106254501 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48b01244e0 con 0x7f48b0056a80 2026-02-12T18:10:30.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48b68af640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:30.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48b68af640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:30.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48b68af640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:10:30.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48b68af640 1 -- 10.20.193.48:0/4106254501 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48b01442e0 con 0x7f48b0056a80 2026-02-12T18:10:30.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48affff640 1 --2- 10.20.193.48:0/4106254501 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f48b0056a80 0x7f48b01338e0 secure :-1 s=READY pgs=356 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f489c004740 tx=0x7f489c004770 comp rx=0 tx=0).queue_received will delay after 1.77092e+09 on 0x7f489c004030 mgrmap(e 5) 2026-02-12T18:10:30.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.278+0000 7f48acff9640 1 -- 10.20.193.48:0/4106254501 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f489c004030 con 0x7f48b0056a80 2026-02-12T18:10:30.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.279+0000 7f48acff9640 1 --2- 10.20.193.48:0/4106254501 >> v2:10.20.193.111:6812/977811348 conn(0x7f488003f800 0x7f488005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:30.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.279+0000 7f48af7fe640 1 --2- 10.20.193.48:0/4106254501 >> v2:10.20.193.111:6812/977811348 conn(0x7f488003f800 0x7f488005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:30.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.279+0000 7f48af7fe640 10 monclient: get_auth_request con 0x7f488003f800 auth_method 0 2026-02-12T18:10:30.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.281+0000 7f48acff9640 1 -- 10.20.193.48:0/4106254501 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(211..211 src has 1..211) ==== 3897+0+0 (secure 0 0 0) 0x7f489c077f30 con 0x7f48b0056a80 2026-02-12T18:10:30.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:30.282+0000 7f48af7fe640 1 --2- 10.20.193.48:0/4106254501 >> v2:10.20.193.111:6812/977811348 conn(0x7f488003f800 0x7f488005fcb0 secure :-1 s=READY pgs=294 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f48b008e4d0 tx=0x7f48a0009210 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:31.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:31.107+0000 7f48acff9640 1 -- 10.20.193.48:0/4106254501 <== mon.0 v2:10.20.193.48:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f489c0036d0 con 0x7f48b0056a80 2026-02-12T18:10:31.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:31.107+0000 7f48acff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:31.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:31.107+0000 7f48acff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:10:31.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:31.253+0000 7f48b68af640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-12T18:10:31.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:31.253+0000 7f48b68af640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-12T18:10:31.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:31.253+0000 7f48b68af640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:10:31.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:31.253+0000 7f48b68af640 1 -- 10.20.193.48:0/4106254501 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f48b0110e70 con 0x7f48b0056a80 2026-02-12T18:10:31.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:31.254+0000 7f48acff9640 1 -- 10.20.193.48:0/4106254501 <== mon.0 v2:10.20.193.48:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7f489c03c020 con 0x7f48b0056a80 2026-02-12T18:10:31.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:31.254+0000 7f48acff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-12T18:10:31.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:31.254+0000 7f48acff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:10:31.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:31.256+0000 7f48b68af640 1 -- 10.20.193.48:0/4106254501 >> v2:10.20.193.111:6812/977811348 conn(0x7f488003f800 msgr2=0x7f488005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:31.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:31.256+0000 7f48b68af640 1 --2- 10.20.193.48:0/4106254501 >> v2:10.20.193.111:6812/977811348 conn(0x7f488003f800 0x7f488005fcb0 secure :-1 s=READY pgs=294 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f48b008e4d0 tx=0x7f48a0009210 comp rx=0 tx=0).stop 2026-02-12T18:10:31.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:31.256+0000 7f48b68af640 10 monclient: shutdown 2026-02-12T18:10:31.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:31.256+0000 7f48b68af640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:31.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:31.256+0000 7f48b68af640 1 -- 10.20.193.48:0/4106254501 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f48b0056a80 msgr2=0x7f48b01338e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:31.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:31.256+0000 7f48b68af640 1 --2- 10.20.193.48:0/4106254501 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f48b0056a80 0x7f48b01338e0 secure :-1 s=READY pgs=356 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f489c004740 tx=0x7f489c004770 comp rx=0 tx=0).stop 2026-02-12T18:10:31.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:31.256+0000 7f48b68af640 1 -- 10.20.193.48:0/4106254501 shutdown_connections 2026-02-12T18:10:31.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:31.256+0000 7f48b68af640 1 --2- 10.20.193.48:0/4106254501 >> v2:10.20.193.111:6812/977811348 conn(0x7f488003f800 0x7f488005fcb0 unknown :-1 s=CLOSED pgs=294 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:31.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:31.256+0000 7f48b68af640 1 --2- 10.20.193.48:0/4106254501 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f48b0089df0 0x7f48b010e030 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:31.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:31.256+0000 7f48b68af640 1 --2- 10.20.193.48:0/4106254501 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f48b005e380 0x7f48b010daf0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:31.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:31.256+0000 7f48b68af640 1 --2- 10.20.193.48:0/4106254501 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f48b0056a80 0x7f48b01338e0 unknown :-1 s=CLOSED pgs=356 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:31.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:31.256+0000 7f48b68af640 1 -- 10.20.193.48:0/4106254501 >> 10.20.193.48:0/4106254501 conn(0x7f48b0096410 msgr2=0x7f48b00912f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:31.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:31.256+0000 7f48b68af640 1 -- 10.20.193.48:0/4106254501 shutdown_connections 2026-02-12T18:10:31.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:31.256+0000 7f48b68af640 1 -- 10.20.193.48:0/4106254501 wait complete. 2026-02-12T18:10:31.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.261+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.261+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=12,logm=60} crc {auth=4222744203,config=1618278320,health=2234524483,kv=2857826951,logm=3740936190}) 2026-02-12T18:10:31.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.261+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=15,config=2,health=13,kv=11,logm=59} crc {auth=987646288,config=1618278320,health=1637909784,kv=84047893,logm=1007802726}) 2026-02-12T18:10:31.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.261+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.261+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=12,logm=60} crc {auth=4222744203,config=1618278320,health=2234524483,kv=2857826951,logm=3740936190}) 2026-02-12T18:10:31.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.261+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=15,config=1,health=12,kv=11,logm=61} crc {auth=987646288,config=2457401934,health=497838649,kv=1024714632,logm=2275066493}) 2026-02-12T18:10:31.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.261+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.261+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=12,logm=60} crc {auth=4222744203,config=1618278320,health=2234524483,kv=2857826951,logm=3740936190}) 2026-02-12T18:10:31.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.261+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=15,config=2,health=12,kv=12,logm=59} crc {auth=987646288,config=1618278320,health=497838649,kv=2857826951,logm=1081387535}) 2026-02-12T18:10:31.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.261+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.261+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=12,logm=60} crc {auth=4222744203,config=1618278320,health=2234524483,kv=2857826951,logm=3740936190}) 2026-02-12T18:10:31.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.261+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=14,config=2,health=13,kv=12,logm=59} crc {auth=2221441633,config=1618278320,health=900190302,kv=2857826951,logm=2506809195}) 2026-02-12T18:10:31.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.261+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.261+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=12,logm=60} crc {auth=4222744203,config=1618278320,health=2234524483,kv=2857826951,logm=3740936190}) 2026-02-12T18:10:31.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.261+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=13,config=2,health=12,kv=12,logm=61} crc {auth=556877510,config=1618278320,health=497838649,kv=2857826951,logm=2125745921}) 2026-02-12T18:10:31.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.261+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.261+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=12,logm=60} crc {auth=4222744203,config=1618278320,health=2234524483,kv=2857826951,logm=3740936190}) 2026-02-12T18:10:31.264 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.261+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=15,config=2,health=13,kv=12,logm=58} crc {auth=987646288,config=1618278320,health=900190302,kv=3454882238,logm=3132654472}) 2026-02-12T18:10:31.264 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.261+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.264 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.261+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=12,logm=60} crc {auth=4222744203,config=1618278320,health=2234524483,kv=2857826951,logm=3740936190}) 2026-02-12T18:10:31.264 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.261+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=14,config=2,health=13,kv=12,logm=59} crc {auth=2077048980,config=1618278320,health=900190302,kv=2857826951,logm=3613453288}) 2026-02-12T18:10:31.264 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.261+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.264 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.261+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=14,config=2,health=12,kv=12,logm=60} crc {auth=4222744203,config=1618278320,health=2234524483,kv=2857826951,logm=3740936190}) 2026-02-12T18:10:31.264 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.261+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=14,config=2,health=12,kv=12,logm=60} crc {auth=1236953593,config=1618278320,health=3977944326,kv=2857826951,logm=1754253103}) 2026-02-12T18:10:31.266 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-12T18:10:31.268 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.266+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.268 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.266+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1321717327}) 2026-02-12T18:10:31.268 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.266+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3333207286}) 2026-02-12T18:10:31.268 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.266+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.268 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.266+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1321717327}) 2026-02-12T18:10:31.268 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.266+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3582057992}) 2026-02-12T18:10:31.268 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.266+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.268 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.266+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1321717327}) 2026-02-12T18:10:31.268 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.266+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1086295375}) 2026-02-12T18:10:31.268 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.266+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.268 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.266+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1321717327}) 2026-02-12T18:10:31.268 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.266+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4021226967}) 2026-02-12T18:10:31.268 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.266+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.268 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.266+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1321717327}) 2026-02-12T18:10:31.268 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.266+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2557387811}) 2026-02-12T18:10:31.268 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.266+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.268 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.266+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1321717327}) 2026-02-12T18:10:31.268 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.266+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3189050072}) 2026-02-12T18:10:31.268 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.266+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.268 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.266+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1321717327}) 2026-02-12T18:10:31.268 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.266+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1868612230}) 2026-02-12T18:10:31.268 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.266+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.268 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.266+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1321717327}) 2026-02-12T18:10:31.268 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.266+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1498369626}) 2026-02-12T18:10:31.269 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[30252]: starting. 2026-02-12T18:10:31.269 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[30252]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-30250 2026-02-12T18:10:31.269 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[30252]: shutting down. 2026-02-12T18:10:31.572 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.570+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.572 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.570+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=997686903}) 2026-02-12T18:10:31.572 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.570+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1829824512}) 2026-02-12T18:10:31.572 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.570+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.572 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.570+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=997686903}) 2026-02-12T18:10:31.572 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.570+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1197351049}) 2026-02-12T18:10:31.572 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.570+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.572 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.570+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=997686903}) 2026-02-12T18:10:31.572 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.570+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3890279511}) 2026-02-12T18:10:31.572 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.570+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.572 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.570+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=997686903}) 2026-02-12T18:10:31.572 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.570+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=880982559}) 2026-02-12T18:10:31.572 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.570+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.572 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.570+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=997686903}) 2026-02-12T18:10:31.572 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.570+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=592561461}) 2026-02-12T18:10:31.572 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.570+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.572 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.570+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=997686903}) 2026-02-12T18:10:31.572 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.570+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=298008152}) 2026-02-12T18:10:31.572 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.570+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.572 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.570+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=997686903}) 2026-02-12T18:10:31.572 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.570+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3334267640}) 2026-02-12T18:10:31.572 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.570+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.573 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.570+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=997686903}) 2026-02-12T18:10:31.573 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.570+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1627249284}) 2026-02-12T18:10:31.573 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.571+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.573 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.571+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1055278458}) 2026-02-12T18:10:31.573 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.571+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=547358600}) 2026-02-12T18:10:31.573 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.571+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.573 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.571+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1055278458}) 2026-02-12T18:10:31.573 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.571+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2590984313}) 2026-02-12T18:10:31.574 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.571+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.574 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.571+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1055278458}) 2026-02-12T18:10:31.574 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.571+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1356259256}) 2026-02-12T18:10:31.574 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.571+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.574 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.571+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1055278458}) 2026-02-12T18:10:31.574 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.571+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2129044141}) 2026-02-12T18:10:31.574 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.571+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.574 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.571+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1055278458}) 2026-02-12T18:10:31.574 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.571+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=994774817}) 2026-02-12T18:10:31.574 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.571+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.574 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.571+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1055278458}) 2026-02-12T18:10:31.574 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.571+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1609421281}) 2026-02-12T18:10:31.574 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.571+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.574 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.571+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1055278458}) 2026-02-12T18:10:31.574 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.571+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1178819372}) 2026-02-12T18:10:31.574 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.571+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.574 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.571+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1055278458}) 2026-02-12T18:10:31.574 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.571+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1594127146}) 2026-02-12T18:10:31.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.579+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.579+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3837309757}) 2026-02-12T18:10:31.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.579+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1571512376}) 2026-02-12T18:10:31.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.579+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.579+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3837309757}) 2026-02-12T18:10:31.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.579+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3332811260}) 2026-02-12T18:10:31.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.579+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.579+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3837309757}) 2026-02-12T18:10:31.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.579+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=590868731}) 2026-02-12T18:10:31.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.579+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.579+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3837309757}) 2026-02-12T18:10:31.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.579+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3793322198}) 2026-02-12T18:10:31.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.579+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.579+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3837309757}) 2026-02-12T18:10:31.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.579+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1961688036}) 2026-02-12T18:10:31.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.579+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.579+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3837309757}) 2026-02-12T18:10:31.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.579+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=388166020}) 2026-02-12T18:10:31.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.579+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.579+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3837309757}) 2026-02-12T18:10:31.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.579+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3770516833}) 2026-02-12T18:10:31.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.579+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.579+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3837309757}) 2026-02-12T18:10:31.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.580+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=143977550}) 2026-02-12T18:10:31.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.580+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.580+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2021077870}) 2026-02-12T18:10:31.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.580+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3869068674}) 2026-02-12T18:10:31.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.580+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.580+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2021077870}) 2026-02-12T18:10:31.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.580+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=569680159}) 2026-02-12T18:10:31.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.580+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.580+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2021077870}) 2026-02-12T18:10:31.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.580+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4255164578}) 2026-02-12T18:10:31.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.580+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.580+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2021077870}) 2026-02-12T18:10:31.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.581+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1827465822}) 2026-02-12T18:10:31.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.581+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.581+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2021077870}) 2026-02-12T18:10:31.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.581+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3067719749}) 2026-02-12T18:10:31.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.581+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.581+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2021077870}) 2026-02-12T18:10:31.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.581+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2479547993}) 2026-02-12T18:10:31.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.581+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.581+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2021077870}) 2026-02-12T18:10:31.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.581+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1665877412}) 2026-02-12T18:10:31.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.581+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.581+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2021077870}) 2026-02-12T18:10:31.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.581+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3221593386}) 2026-02-12T18:10:31.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.581+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.581+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=586661052}) 2026-02-12T18:10:31.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.581+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1764593389}) 2026-02-12T18:10:31.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.581+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.581+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=586661052}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.581+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1845262928}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.581+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.581+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=586661052}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.581+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=43317303}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=586661052}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=925052711}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=586661052}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3911175596}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=586661052}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2612509612}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=586661052}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1905081805}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=586661052}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1243192902}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1995200239}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4101554207}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1995200239}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1951330027}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1995200239}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3311068870}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1995200239}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=907371808}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1995200239}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3157459497}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1995200239}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3839198888}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.582+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1995200239}) 2026-02-12T18:10:31.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1229531547}) 2026-02-12T18:10:31.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1995200239}) 2026-02-12T18:10:31.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2277317649}) 2026-02-12T18:10:31.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3549354634}) 2026-02-12T18:10:31.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3992957623}) 2026-02-12T18:10:31.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3549354634}) 2026-02-12T18:10:31.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2275282130}) 2026-02-12T18:10:31.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3549354634}) 2026-02-12T18:10:31.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3005367890}) 2026-02-12T18:10:31.587 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.587 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3549354634}) 2026-02-12T18:10:31.587 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3043607110}) 2026-02-12T18:10:31.587 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.587 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3549354634}) 2026-02-12T18:10:31.587 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3030762343}) 2026-02-12T18:10:31.587 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.587 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3549354634}) 2026-02-12T18:10:31.587 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=45618662}) 2026-02-12T18:10:31.587 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.587 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3549354634}) 2026-02-12T18:10:31.587 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4139712124}) 2026-02-12T18:10:31.587 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.587 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3549354634}) 2026-02-12T18:10:31.587 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.583+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1592619857}) 2026-02-12T18:10:31.753 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.751+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.753 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.751+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1586008965}) 2026-02-12T18:10:31.754 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.751+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3817776832}) 2026-02-12T18:10:31.754 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.751+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.754 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.751+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1586008965}) 2026-02-12T18:10:31.754 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.751+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4041979758}) 2026-02-12T18:10:31.754 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.751+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.754 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.752+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1586008965}) 2026-02-12T18:10:31.754 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.752+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=790344629}) 2026-02-12T18:10:31.754 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.752+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.754 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.752+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1586008965}) 2026-02-12T18:10:31.754 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.752+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3789802456}) 2026-02-12T18:10:31.754 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.752+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.754 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.752+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1586008965}) 2026-02-12T18:10:31.754 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.752+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3110604908}) 2026-02-12T18:10:31.754 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.752+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.754 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.752+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1586008965}) 2026-02-12T18:10:31.754 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.752+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=420718191}) 2026-02-12T18:10:31.754 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.752+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.754 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.752+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1586008965}) 2026-02-12T18:10:31.754 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.752+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=736885449}) 2026-02-12T18:10:31.754 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.752+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.754 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.752+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1586008965}) 2026-02-12T18:10:31.754 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.752+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1133602696}) 2026-02-12T18:10:31.758 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.756+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.758 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.756+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3990766462}) 2026-02-12T18:10:31.758 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.756+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2766186092}) 2026-02-12T18:10:31.758 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.756+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.758 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.756+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3990766462}) 2026-02-12T18:10:31.758 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.756+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=212679281}) 2026-02-12T18:10:31.758 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.756+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.758 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.756+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3990766462}) 2026-02-12T18:10:31.759 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.757+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2781583771}) 2026-02-12T18:10:31.759 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.757+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.759 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.757+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3990766462}) 2026-02-12T18:10:31.759 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.757+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=122627857}) 2026-02-12T18:10:31.759 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.757+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.759 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.757+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3990766462}) 2026-02-12T18:10:31.759 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.757+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1169955444}) 2026-02-12T18:10:31.759 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.757+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.759 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.757+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3990766462}) 2026-02-12T18:10:31.759 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.757+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3804712668}) 2026-02-12T18:10:31.759 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.757+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.759 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.757+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3990766462}) 2026-02-12T18:10:31.759 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.757+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4012778619}) 2026-02-12T18:10:31.759 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.757+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:31.759 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.757+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3990766462}) 2026-02-12T18:10:31.759 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:31.757+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4251653104}) 2026-02-12T18:10:32.079 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.077+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.079 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.077+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3742755038}) 2026-02-12T18:10:32.079 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.077+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1083982665}) 2026-02-12T18:10:32.079 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.077+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.079 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.077+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3742755038}) 2026-02-12T18:10:32.079 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.077+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4130394984}) 2026-02-12T18:10:32.079 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.077+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.079 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.077+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3742755038}) 2026-02-12T18:10:32.079 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.077+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2467424089}) 2026-02-12T18:10:32.079 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.077+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.080 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.077+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3742755038}) 2026-02-12T18:10:32.080 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.077+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2594236289}) 2026-02-12T18:10:32.080 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.077+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.080 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.077+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3742755038}) 2026-02-12T18:10:32.080 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.077+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=926469895}) 2026-02-12T18:10:32.080 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.077+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.080 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.077+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3742755038}) 2026-02-12T18:10:32.080 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.077+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1955001233}) 2026-02-12T18:10:32.080 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.077+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.080 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.077+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3742755038}) 2026-02-12T18:10:32.080 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.077+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3535321679}) 2026-02-12T18:10:32.080 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.077+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.080 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.077+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3742755038}) 2026-02-12T18:10:32.080 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.077+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=150765942}) 2026-02-12T18:10:32.259 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.257+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.259 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.257+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950418628}) 2026-02-12T18:10:32.259 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.257+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3277722411}) 2026-02-12T18:10:32.259 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.257+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.259 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.257+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950418628}) 2026-02-12T18:10:32.259 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.257+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=815490341}) 2026-02-12T18:10:32.259 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.257+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.259 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.257+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950418628}) 2026-02-12T18:10:32.259 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.257+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1937819943}) 2026-02-12T18:10:32.259 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.257+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.259 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.257+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950418628}) 2026-02-12T18:10:32.259 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.257+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1570405489}) 2026-02-12T18:10:32.259 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.257+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.259 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.257+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950418628}) 2026-02-12T18:10:32.259 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.257+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3890157984}) 2026-02-12T18:10:32.259 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.257+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.259 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.257+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950418628}) 2026-02-12T18:10:32.259 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.257+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1003078599}) 2026-02-12T18:10:32.259 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.257+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.259 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.257+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950418628}) 2026-02-12T18:10:32.260 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.257+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3371343703}) 2026-02-12T18:10:32.260 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.257+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.260 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.257+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950418628}) 2026-02-12T18:10:32.260 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.257+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3928934863}) 2026-02-12T18:10:32.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.264+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.264+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2288374466}) 2026-02-12T18:10:32.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.264+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2054299422}) 2026-02-12T18:10:32.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.265+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.265+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2288374466}) 2026-02-12T18:10:32.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.265+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1055815364}) 2026-02-12T18:10:32.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.265+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.265+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2288374466}) 2026-02-12T18:10:32.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.265+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4044017154}) 2026-02-12T18:10:32.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.265+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.265+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2288374466}) 2026-02-12T18:10:32.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.265+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2878709028}) 2026-02-12T18:10:32.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.265+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.265+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2288374466}) 2026-02-12T18:10:32.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.265+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=187052067}) 2026-02-12T18:10:32.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.265+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.267 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.265+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2288374466}) 2026-02-12T18:10:32.267 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.265+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2180160689}) 2026-02-12T18:10:32.267 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.265+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.267 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.265+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2288374466}) 2026-02-12T18:10:32.267 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.265+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=33547335}) 2026-02-12T18:10:32.267 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.265+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.267 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.265+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2288374466}) 2026-02-12T18:10:32.267 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.265+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3473766168}) 2026-02-12T18:10:32.267 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2026-02-12T18:10:32.267 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T18:10:32.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3043354010}) 2026-02-12T18:10:32.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3820392733}) 2026-02-12T18:10:32.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3043354010}) 2026-02-12T18:10:32.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1565191787}) 2026-02-12T18:10:32.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3043354010}) 2026-02-12T18:10:32.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2330315153}) 2026-02-12T18:10:32.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3043354010}) 2026-02-12T18:10:32.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3559109347}) 2026-02-12T18:10:32.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3043354010}) 2026-02-12T18:10:32.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1168530650}) 2026-02-12T18:10:32.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3043354010}) 2026-02-12T18:10:32.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2165027116}) 2026-02-12T18:10:32.272 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.272 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3043354010}) 2026-02-12T18:10:32.272 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=108599167}) 2026-02-12T18:10:32.272 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:32.272 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3043354010}) 2026-02-12T18:10:32.272 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:32.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3397321376}) 2026-02-12T18:10:32.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.332+0000 7fdade8cc640 10 monclient: get_monmap_and_config 2026-02-12T18:10:32.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.332+0000 7fdade8cc640 10 monclient: build_initial_monmap 2026-02-12T18:10:32.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.332+0000 7fdade8cc640 10 monclient: monmap: 2026-02-12T18:10:32.333 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:32.333 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:32.333 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:10:32.333371+0000 2026-02-12T18:10:32.333 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:10:32.333371+0000 2026-02-12T18:10:32.333 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:32.333 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:32.333 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:10:32.333 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:10:32.333 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:32.334 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:32.334 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:32.334 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:32.334 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:32.334 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:32.334 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:32.334 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:10:32.334 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:10:32.334 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.332+0000 7fdade8cc640 1 Processor -- start 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.332+0000 7fdade8cc640 1 -- start start 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.332+0000 7fdade8cc640 10 monclient: init 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.332+0000 7fdade8cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdade8cc640 10 monclient: _add_conns ranks=[0,3,4,6,1,2,9,7,10,8,5] 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdade8cc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdad8093ac0 addr v1:10.20.193.48:6789/0 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdade8cc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fdad813e990 0x7fdad81831b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdade8cc640 10 monclient(hunting): picked mon.noname-g con 0x7fdad813e990 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdade8cc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdad805dd20 0x7fdad81a3700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdade8cc640 10 monclient(hunting): picked mon.noname-c con 0x7fdad805dd20 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdade8cc640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdad8060390 con 0x7fdad8093ac0 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdade8cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdade8cc640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fdad80580a0 con 0x7fdad813e990 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdade8cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdade8cc640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fdad805e3f0 con 0x7fdad805dd20 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdade8cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdade8cc640 10 monclient(hunting): authenticate will time out at 871.059060s 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdad7fff640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7fdad8093ac0 0x7fdad805d610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:56754/0 (socket says 10.20.193.48:56754) 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdad7fff640 1 -- 10.20.193.48:0/1505555490 learned_addr learned my addr 10.20.193.48:0/1505555490 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdadce42640 1 --2- 10.20.193.48:0/1505555490 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdad805dd20 0x7fdad81a3700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdadce42640 10 monclient(hunting): get_auth_request con 0x7fdad805dd20 auth_method 0 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdadce42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdadce42640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdadce42640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdad77fe640 1 --2- 10.20.193.48:0/1505555490 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fdad813e990 0x7fdad81831b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdadce42640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdadce42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdadce42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdad77fe640 10 monclient(hunting): get_auth_request con 0x7fdad813e990 auth_method 0 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdad77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdad77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdad77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:32.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdadce42640 10 monclient(hunting): handle_auth_done global_id 64228 payload 274 2026-02-12T18:10:32.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdadce42640 1 -- 10.20.193.48:0/1505555490 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fdad813e990 msgr2=0x7fdad81831b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:32.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdadce42640 1 --2- 10.20.193.48:0/1505555490 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fdad813e990 0x7fdad81831b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:32.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdadce42640 1 -- 10.20.193.48:0/1505555490 >> v1:10.20.193.48:6789/0 conn(0x7fdad8093ac0 legacy=0x7fdad805d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:32.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdadce42640 10 monclient: _finish_hunting 0 2026-02-12T18:10:32.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdadce42640 1 monclient: found mon.noname-c 2026-02-12T18:10:32.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdadce42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:32.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdadce42640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:10:32.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdadce42640 1 -- 10.20.193.48:0/1505555490 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdad8093e90 con 0x7fdad805dd20 2026-02-12T18:10:32.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.333+0000 7fdad77fe640 1 --2- 10.20.193.48:0/1505555490 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fdad813e990 0x7fdad81831b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:10:32.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdadce42640 1 -- 10.20.193.48:0/1505555490 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdad805dd20 msgr2=0x7fdad81a3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:32.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdadce42640 1 --2- 10.20.193.48:0/1505555490 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdad805dd20 0x7fdad81a3700 secure :-1 s=READY pgs=21 gs=2 cs=0 l=1 c_cookie=771654659097356449 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdacc00a910 tx=0x7fdacc02fdb0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=ab577d2f4c5e8a1 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:32.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdad6ffd640 1 -- 10.20.193.48:0/1505555490 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fdacc036340 con 0x7fdad805dd20 2026-02-12T18:10:32.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdad6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:32.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdad6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdad6ffd640 10 monclient: dump: 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdad6ffd640 10 monclient: _finish_auth 0 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdad6ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdad6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdad6ffd640 1 -- 10.20.193.48:0/1505555490 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdacc0364c0 con 0x7fdad805dd20 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdade8cc640 5 monclient: authenticate success, global_id 64228 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdade8cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdad6ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdad6ffd640 1 -- 10.20.193.48:0/1505555490 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fdacc036af0 con 0x7fdad805dd20 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdade8cc640 10 monclient: get_monmap_and_config success 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdade8cc640 4 set_mon_vals no callback set 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdad6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdad6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdad6ffd640 10 monclient: dump: 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:32.338 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:32.339 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:32.339 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:32.339 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:32.339 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:32.339 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:32.339 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:32.339 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:32.339 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:32.339 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:32.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdade8cc640 10 monclient: shutdown 2026-02-12T18:10:32.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdade8cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:32.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdade8cc640 1 -- 10.20.193.48:0/1505555490 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdad805dd20 msgr2=0x7fdad81a3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:32.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdade8cc640 1 --2- 10.20.193.48:0/1505555490 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdad805dd20 0x7fdad81a3700 secure :-1 s=READY pgs=21 gs=2 cs=0 l=1 c_cookie=771654659097356449 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdacc00a910 tx=0x7fdacc02fdb0 comp rx=0 tx=0).stop 2026-02-12T18:10:32.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdade8cc640 1 -- 10.20.193.48:0/1505555490 shutdown_connections 2026-02-12T18:10:32.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdade8cc640 1 --2- 10.20.193.48:0/1505555490 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdad805dd20 0x7fdad81a3700 unknown :-1 s=CLOSED pgs=21 gs=2 cs=0 l=1 c_cookie=771654659097356449 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:32.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdade8cc640 1 --2- 10.20.193.48:0/1505555490 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fdad813e990 0x7fdad81831b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:32.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdade8cc640 1 -- 10.20.193.48:0/1505555490 >> 10.20.193.48:0/1505555490 conn(0x7fdad8054b30 msgr2=0x7fdad8093070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:32.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdade8cc640 1 -- 10.20.193.48:0/1505555490 shutdown_connections 2026-02-12T18:10:32.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdade8cc640 1 -- 10.20.193.48:0/1505555490 wait complete. 2026-02-12T18:10:32.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdade8cc640 10 monclient: build_initial_monmap 2026-02-12T18:10:32.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.336+0000 7fdade8cc640 10 monclient: monmap: 2026-02-12T18:10:32.340 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:32.340 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:10:32.340 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:10:32.340 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:10:32.340 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:32.340 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:32.340 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:10:32.340 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:10:32.340 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:32.340 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:32.340 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:32.340 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:32.340 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:32.340 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdade8cc640 1 Processor -- start 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdade8cc640 1 -- start start 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdade8cc640 10 monclient: init 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdade8cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdade8cc640 10 monclient: _add_conns ranks=[0,3,4,1,6,5,2,8,7] 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdade8cc640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fdad805dd20 0x7fdad812d6a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdade8cc640 10 monclient(hunting): picked mon.noname-a con 0x7fdad805dd20 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdade8cc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fdad8093ac0 0x7fdad81096c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdade8cc640 10 monclient(hunting): picked mon.noname-g con 0x7fdad8093ac0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdade8cc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdad813e990 0x7fdad8109c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdade8cc640 10 monclient(hunting): picked mon.noname-c con 0x7fdad813e990 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdade8cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdade8cc640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fdad813c770 con 0x7fdad805dd20 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdade8cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdade8cc640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fdad813dcf0 con 0x7fdad8093ac0 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdade8cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdade8cc640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fdad810d100 con 0x7fdad813e990 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdade8cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdade8cc640 10 monclient(hunting): authenticate will time out at 871.063632s 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdad7fff640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fdad805dd20 0x7fdad812d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdadce42640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdad813e990 0x7fdad8109c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdad7fff640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fdad805dd20 0x7fdad812d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:58118/0 (socket says 10.20.193.48:58118) 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdadce42640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdad813e990 0x7fdad8109c00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:53296/0 (socket says 10.20.193.48:53296) 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdad7fff640 1 -- 10.20.193.48:0/2799251876 learned_addr learned my addr 10.20.193.48:0/2799251876 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdad7fff640 10 monclient(hunting): get_auth_request con 0x7fdad805dd20 auth_method 0 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdad7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdad7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdad7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdadce42640 10 monclient(hunting): get_auth_request con 0x7fdad813e990 auth_method 0 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdadce42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdadce42640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdadce42640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdadce42640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdadce42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:32.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdadce42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:32.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdad7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:32.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdad7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:32.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdad7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:32.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdad77fe640 1 --2- 10.20.193.48:0/2799251876 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fdad8093ac0 0x7fdad81096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:32.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdad77fe640 10 monclient(hunting): get_auth_request con 0x7fdad8093ac0 auth_method 0 2026-02-12T18:10:32.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdad77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:32.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdad77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:32.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdad77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:32.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdad77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:32.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdad77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:32.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdad77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:32.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdadce42640 10 monclient(hunting): handle_auth_done global_id 64237 payload 824 2026-02-12T18:10:32.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdadce42640 1 -- 10.20.193.48:0/2799251876 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fdad8093ac0 msgr2=0x7fdad81096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:32.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdadce42640 1 --2- 10.20.193.48:0/2799251876 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fdad8093ac0 0x7fdad81096c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:32.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdadce42640 1 -- 10.20.193.48:0/2799251876 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fdad805dd20 msgr2=0x7fdad812d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:32.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdadce42640 1 --2- 10.20.193.48:0/2799251876 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fdad805dd20 0x7fdad812d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:32.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdadce42640 10 monclient: _finish_hunting 0 2026-02-12T18:10:32.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdadce42640 1 monclient: found mon.noname-c 2026-02-12T18:10:32.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdadce42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:32.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdadce42640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:10:32.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.337+0000 7fdadce42640 1 -- 10.20.193.48:0/2799251876 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdacc00a500 con 0x7fdad813e990 2026-02-12T18:10:32.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.340+0000 7fdadce42640 1 -- 10.20.193.48:0/2799251876 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdad813e990 msgr2=0x7fdad8109c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:32.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.340+0000 7fdadce42640 1 --2- 10.20.193.48:0/2799251876 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdad813e990 0x7fdad8109c00 secure :-1 s=READY pgs=22 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdacc00a910 tx=0x7fdacc005850 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:32.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.340+0000 7fdad4ff9640 1 -- 10.20.193.48:0/2799251876 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fdacc036a50 con 0x7fdad813e990 2026-02-12T18:10:32.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.340+0000 7fdad4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:32.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.340+0000 7fdad4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:10:32.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.340+0000 7fdad4ff9640 10 monclient: dump: 2026-02-12T18:10:32.343 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:32.343 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:32.343 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:32.343 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:32.343 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:32.343 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:32.343 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:32.343 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:32.343 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:32.343 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:32.343 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:32.343 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:32.343 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:32.343 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:32.343 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:32.343 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:32.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.340+0000 7fdad4ff9640 10 monclient: _finish_auth 0 2026-02-12T18:10:32.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.340+0000 7fdad4ff9640 10 monclient: _check_auth_tickets 2026-02-12T18:10:32.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.340+0000 7fdad4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.340+0000 7fdad4ff9640 1 -- 10.20.193.48:0/2799251876 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdacc038900 con 0x7fdad813e990 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.340+0000 7fdad4ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.340+0000 7fdad4ff9640 1 -- 10.20.193.48:0/2799251876 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fdacc041410 con 0x7fdad813e990 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.340+0000 7fdad4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.340+0000 7fdad67fc640 4 set_mon_vals no callback set 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.340+0000 7fdad4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.340+0000 7fdad4ff9640 10 monclient: dump: 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.340+0000 7fdade8cc640 5 monclient: authenticate success, global_id 64237 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.340+0000 7fdade8cc640 10 monclient: _renew_subs 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.340+0000 7fdade8cc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.340+0000 7fdade8cc640 1 -- 10.20.193.48:0/2799251876 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdad813d910 con 0x7fdad813e990 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.340+0000 7fdade8cc640 10 monclient: _renew_subs 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.340+0000 7fdade8cc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.340+0000 7fdade8cc640 1 -- 10.20.193.48:0/2799251876 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fdad810b480 con 0x7fdad813e990 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.341+0000 7fdade8cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.341+0000 7fdade8cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.341+0000 7fdade8cc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.341+0000 7fdade8cc640 1 -- 10.20.193.48:0/2799251876 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdad808cb60 con 0x7fdad813e990 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.341+0000 7fdadce42640 1 --2- 10.20.193.48:0/2799251876 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdad813e990 0x7fdad8109c00 secure :-1 s=READY pgs=22 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdacc00a910 tx=0x7fdacc005850 comp rx=0 tx=0).queue_received will delay after 1.77092e+09 on 0x7fdacc078c40 osd_map(213..213 src has 1..213) 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.341+0000 7fdad4ff9640 1 -- 10.20.193.48:0/2799251876 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fdacc050020 con 0x7fdad813e990 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.341+0000 7fdad4ff9640 1 --2- 10.20.193.48:0/2799251876 >> v2:10.20.193.111:6812/977811348 conn(0x7fdaa803f7f0 0x7fdaa805fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.341+0000 7fdad7fff640 1 --2- 10.20.193.48:0/2799251876 >> v2:10.20.193.111:6812/977811348 conn(0x7fdaa803f7f0 0x7fdaa805fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:32.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.341+0000 7fdad7fff640 10 monclient: get_auth_request con 0x7fdaa803f7f0 auth_method 0 2026-02-12T18:10:32.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.343+0000 7fdad4ff9640 1 -- 10.20.193.48:0/2799251876 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(213..213 src has 1..213) ==== 3897+0+0 (secure 0 0 0) 0x7fdacc078c40 con 0x7fdad813e990 2026-02-12T18:10:32.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:32.344+0000 7fdad7fff640 1 --2- 10.20.193.48:0/2799251876 >> v2:10.20.193.111:6812/977811348 conn(0x7fdaa803f7f0 0x7fdaa805fca0 secure :-1 s=READY pgs=298 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdac4007df0 tx=0x7fdac4004b50 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:33.171 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.169+0000 7fdad4ff9640 1 -- 10.20.193.48:0/2799251876 <== mon.4 v2:10.20.193.48:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fdacc041780 con 0x7fdad813e990 2026-02-12T18:10:33.171 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.169+0000 7fdad4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:33.171 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.169+0000 7fdad4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:10:33.213 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.209+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.213 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.209+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4251499155}) 2026-02-12T18:10:33.213 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.209+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1302152358}) 2026-02-12T18:10:33.213 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.209+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.213 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.209+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4251499155}) 2026-02-12T18:10:33.213 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.209+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1660102422}) 2026-02-12T18:10:33.213 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.209+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.213 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.209+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4251499155}) 2026-02-12T18:10:33.213 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.209+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3868961393}) 2026-02-12T18:10:33.213 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.209+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.214 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.209+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4251499155}) 2026-02-12T18:10:33.214 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.209+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2722818883}) 2026-02-12T18:10:33.214 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.209+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.214 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.209+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4251499155}) 2026-02-12T18:10:33.214 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.209+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1255374276}) 2026-02-12T18:10:33.214 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.209+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.214 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.209+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4251499155}) 2026-02-12T18:10:33.214 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.209+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2325075115}) 2026-02-12T18:10:33.214 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.209+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.214 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.209+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4251499155}) 2026-02-12T18:10:33.214 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.209+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2514823741}) 2026-02-12T18:10:33.214 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.209+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.215 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.209+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4251499155}) 2026-02-12T18:10:33.215 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.209+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1933442582}) 2026-02-12T18:10:33.229 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.225+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.229 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.225+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2003308367}) 2026-02-12T18:10:33.229 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.225+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3085168612}) 2026-02-12T18:10:33.229 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.225+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.229 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.225+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2003308367}) 2026-02-12T18:10:33.229 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.225+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2964873067}) 2026-02-12T18:10:33.230 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.226+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.230 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.226+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2003308367}) 2026-02-12T18:10:33.230 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.226+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1674401925}) 2026-02-12T18:10:33.230 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.226+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.230 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.226+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2003308367}) 2026-02-12T18:10:33.230 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.226+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2624070828}) 2026-02-12T18:10:33.230 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.226+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.230 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.226+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2003308367}) 2026-02-12T18:10:33.230 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.226+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1785132522}) 2026-02-12T18:10:33.230 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.226+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.230 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.226+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2003308367}) 2026-02-12T18:10:33.230 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.226+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1159017845}) 2026-02-12T18:10:33.231 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.226+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.231 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.226+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2003308367}) 2026-02-12T18:10:33.231 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.226+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=894849753}) 2026-02-12T18:10:33.231 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.226+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.231 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.226+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2003308367}) 2026-02-12T18:10:33.231 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.226+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1664179448}) 2026-02-12T18:10:33.261 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.252+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.261 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.252+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2711269509}) 2026-02-12T18:10:33.261 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.252+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1826136457}) 2026-02-12T18:10:33.261 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.252+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.261 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.252+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2711269509}) 2026-02-12T18:10:33.261 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.252+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2000291740}) 2026-02-12T18:10:33.261 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.252+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.261 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.252+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2711269509}) 2026-02-12T18:10:33.261 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.252+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3046128765}) 2026-02-12T18:10:33.261 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.252+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.262 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.252+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2711269509}) 2026-02-12T18:10:33.262 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.252+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4154137423}) 2026-02-12T18:10:33.262 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.252+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.262 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.252+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2711269509}) 2026-02-12T18:10:33.262 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.252+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2586833392}) 2026-02-12T18:10:33.262 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.252+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.262 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.252+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2711269509}) 2026-02-12T18:10:33.262 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.252+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2363808803}) 2026-02-12T18:10:33.262 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.252+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.262 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.252+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2711269509}) 2026-02-12T18:10:33.262 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.252+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1214391509}) 2026-02-12T18:10:33.262 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.253+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.253+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2711269509}) 2026-02-12T18:10:33.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.253+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=864440752}) 2026-02-12T18:10:33.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.254+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.254+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=33,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=21} crc {logm=3646285551,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=2227179287,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=1993256531,osd_snap=841190635,osdmap=1237857708}) 2026-02-12T18:10:33.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.254+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=28,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=27} crc {logm=128350359,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=2227179287,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=935146538,osd_metadata=3278263878,osd_pg_creating=1993256531,osd_snap=841190635,osdmap=3617905346}) 2026-02-12T18:10:33.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.254+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.254+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=33,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=21} crc {logm=3646285551,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=2227179287,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=1993256531,osd_snap=841190635,osdmap=1237857708}) 2026-02-12T18:10:33.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.254+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=31,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=25} crc {logm=2141288852,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=2561508905,mon_config_key=1580463513,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=2807342558,osd_pg_creating=1993256531,osd_snap=841190635,osdmap=3932313128}) 2026-02-12T18:10:33.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.254+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.254+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=33,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=21} crc {logm=3646285551,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=2227179287,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=1993256531,osd_snap=841190635,osdmap=1237857708}) 2026-02-12T18:10:33.263 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.254+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=30,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=23} crc {logm=3836358380,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=1436838549,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=2171349011,osd_metadata=1232835945,osd_pg_creating=1993256531,osd_snap=841190635,osdmap=3396089065}) 2026-02-12T18:10:33.264 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.254+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.264 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.254+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=33,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=21} crc {logm=3646285551,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=2227179287,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=1993256531,osd_snap=841190635,osdmap=1237857708}) 2026-02-12T18:10:33.264 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.254+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=31,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=8,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=26} crc {logm=3538907852,mdsmap=3465989318,mgr=3790985830,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=1436838549,mon_config_key=3244789448,monmap=2848783498,nvmeofgw=935146538,osd_metadata=1232835945,osd_pg_creating=1993256531,osd_snap=841190635,osdmap=1795800324}) 2026-02-12T18:10:33.264 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.254+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.264 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.254+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=33,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=21} crc {logm=3646285551,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=2227179287,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=1993256531,osd_snap=841190635,osdmap=1237857708}) 2026-02-12T18:10:33.264 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.254+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=31,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,nvmeofgw=2,osd_metadata=6,osd_snap=2,osdmap=24} crc {logm=3817274105,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=3496689651,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=935146538,osd_metadata=1232835945,osd_snap=841190635,osdmap=757452176}) 2026-02-12T18:10:33.264 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.254+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.264 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.254+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=33,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=21} crc {logm=3646285551,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=2227179287,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=1993256531,osd_snap=841190635,osdmap=1237857708}) 2026-02-12T18:10:33.264 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.254+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=30,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=24} crc {logm=1321838941,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=852960614,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=1993256531,osd_snap=841190635,osdmap=2685997133}) 2026-02-12T18:10:33.264 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.254+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.264 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.254+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=33,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=21} crc {logm=3646285551,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=2227179287,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=1993256531,osd_snap=841190635,osdmap=1237857708}) 2026-02-12T18:10:33.265 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.254+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=32,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=21} crc {logm=2873661050,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=1436838549,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835946,osd_pg_creating=1993256531,osd_snap=841190635,osdmap=1352981963}) 2026-02-12T18:10:33.265 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.254+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.265 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.254+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=33,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=21} crc {logm=3646285551,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=2227179287,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=1993256531,osd_snap=841190635,osdmap=1237857708}) 2026-02-12T18:10:33.265 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.254+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=30,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=25} crc {logm=3734390513,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=1436838549,mon_config_key=752066894,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1679651515,osd_pg_creating=1993256531,osd_snap=841190635,osdmap=2509848496}) 2026-02-12T18:10:33.265 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.255+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.265 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.255+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2590718626}) 2026-02-12T18:10:33.265 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.255+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2711684590}) 2026-02-12T18:10:33.265 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.255+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.265 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.255+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2590718626}) 2026-02-12T18:10:33.265 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.255+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2547188332}) 2026-02-12T18:10:33.265 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.255+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.265 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.255+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2590718626}) 2026-02-12T18:10:33.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.255+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=3372975684}) 2026-02-12T18:10:33.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.255+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.255+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2590718626}) 2026-02-12T18:10:33.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.255+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=1817774419}) 2026-02-12T18:10:33.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.255+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.255+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2590718626}) 2026-02-12T18:10:33.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.255+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=361627197}) 2026-02-12T18:10:33.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.255+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.255+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2590718626}) 2026-02-12T18:10:33.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.255+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=1233101292}) 2026-02-12T18:10:33.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.255+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.255+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2590718626}) 2026-02-12T18:10:33.266 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.255+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=4003128495}) 2026-02-12T18:10:33.267 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.255+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.267 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.255+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2590718626}) 2026-02-12T18:10:33.267 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.255+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=2768857213}) 2026-02-12T18:10:33.269 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.260+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.270 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.260+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=54808194}) 2026-02-12T18:10:33.270 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.260+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=757485024}) 2026-02-12T18:10:33.270 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.260+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.270 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.260+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=54808194}) 2026-02-12T18:10:33.270 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.260+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3769980737}) 2026-02-12T18:10:33.270 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.260+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.270 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.260+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=54808194}) 2026-02-12T18:10:33.270 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.260+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=672815242}) 2026-02-12T18:10:33.270 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.260+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.270 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.260+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=54808194}) 2026-02-12T18:10:33.270 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.260+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=3569844410}) 2026-02-12T18:10:33.270 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.260+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.260+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=54808194}) 2026-02-12T18:10:33.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.260+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=1583984306}) 2026-02-12T18:10:33.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.260+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.260+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=54808194}) 2026-02-12T18:10:33.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.260+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=1959800840}) 2026-02-12T18:10:33.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.260+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.260+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=54808194}) 2026-02-12T18:10:33.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.260+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=2355475761}) 2026-02-12T18:10:33.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.260+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.260+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=54808194}) 2026-02-12T18:10:33.271 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.260+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=2043552429}) 2026-02-12T18:10:33.274 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.268+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.274 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.268+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1513533064}) 2026-02-12T18:10:33.274 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.268+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=697076768}) 2026-02-12T18:10:33.274 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.268+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.274 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.268+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1513533064}) 2026-02-12T18:10:33.274 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.268+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=99} crc {osdmap=2139118252}) 2026-02-12T18:10:33.274 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.275 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1513533064}) 2026-02-12T18:10:33.275 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2659700516}) 2026-02-12T18:10:33.275 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.275 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1513533064}) 2026-02-12T18:10:33.275 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=2911954365}) 2026-02-12T18:10:33.275 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.275 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1513533064}) 2026-02-12T18:10:33.275 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=98} crc {osdmap=853374689}) 2026-02-12T18:10:33.275 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.275 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1513533064}) 2026-02-12T18:10:33.275 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=98} crc {osdmap=3869836071}) 2026-02-12T18:10:33.275 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.276 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1513533064}) 2026-02-12T18:10:33.276 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=2637407997}) 2026-02-12T18:10:33.276 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:10:33.276 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1513533064}) 2026-02-12T18:10:33.276 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:10:33.269+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=4154466023}) 2026-02-12T18:10:33.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.319+0000 7fdade8cc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T18:10:33.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.319+0000 7fdade8cc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T18:10:33.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.319+0000 7fdade8cc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:10:33.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.319+0000 7fdade8cc640 1 -- 10.20.193.48:0/2799251876 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdad805d610 con 0x7fdad813e990 2026-02-12T18:10:33.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.319+0000 7fdad4ff9640 1 -- 10.20.193.48:0/2799251876 <== mon.4 v2:10.20.193.48:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3660 (secure 0 0 0) 0x7fdacc03de60 con 0x7fdad813e990 2026-02-12T18:10:33.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.319+0000 7fdad4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T18:10:33.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.319+0000 7fdad4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:10:33.322 INFO:teuthology.orchestra.run.trial048.stdout:{"election_epoch":46,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","modified":"2026-02-12T18:05:32.850777Z","created":"2026-02-12T18:05:32.850777Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3300","nonce":0},{"type":"v1","addr":"10.20.193.48:6789","nonce":0}]},"addr":"10.20.193.48:6789/0","public_addr":"10.20.193.48:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850827+0000","crush_location":[]},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3300","nonce":0},{"type":"v1","addr":"10.20.193.111:6789","nonce":0}]},"addr":"10.20.193.111:6789/0","public_addr":"10.20.193.111:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850829+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3301","nonce":0},{"type":"v1","addr":"10.20.193.48:6790","nonce":0}]},"addr":"10.20.193.48:6790/0","public_addr":"10.20.193.48:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850830+0000","crush_location":[]},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3301","nonce":0},{"type":"v1","addr":"10.20.193.111:6790","nonce":0}]},"addr":"10.20.193.111:6790/0","public_addr":"10.20.193.111:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850833+0000","crush_location":[]},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3302","nonce":0},{"type":"v1","addr":"10.20.193.48:6791","nonce":0}]},"addr":"10.20.193.48:6791/0","public_addr":"10.20.193.48:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3302","nonce":0},{"type":"v1","addr":"10.20.193.111:6791","nonce":0}]},"addr":"10.20.193.111:6791/0","public_addr":"10.20.193.111:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850834+0000","crush_location":[]},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3303","nonce":0},{"type":"v1","addr":"10.20.193.48:6792","nonce":0}]},"addr":"10.20.193.48:6792/0","public_addr":"10.20.193.48:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3303","nonce":0},{"type":"v1","addr":"10.20.193.111:6792","nonce":0}]},"addr":"10.20.193.111:6792/0","public_addr":"10.20.193.111:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850835+0000","crush_location":[]},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3304","nonce":0},{"type":"v1","addr":"10.20.193.48:6793","nonce":0}]},"addr":"10.20.193.48:6793/0","public_addr":"10.20.193.48:6793/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850832+0000","crush_location":[]}]}} 2026-02-12T18:10:33.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.321+0000 7fdade8cc640 1 -- 10.20.193.48:0/2799251876 >> v2:10.20.193.111:6812/977811348 conn(0x7fdaa803f7f0 msgr2=0x7fdaa805fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.321+0000 7fdade8cc640 1 --2- 10.20.193.48:0/2799251876 >> v2:10.20.193.111:6812/977811348 conn(0x7fdaa803f7f0 0x7fdaa805fca0 secure :-1 s=READY pgs=298 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdac4007df0 tx=0x7fdac4004b50 comp rx=0 tx=0).stop 2026-02-12T18:10:33.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.321+0000 7fdade8cc640 10 monclient: shutdown 2026-02-12T18:10:33.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.321+0000 7fdade8cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:33.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.321+0000 7fdade8cc640 1 -- 10.20.193.48:0/2799251876 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdad813e990 msgr2=0x7fdad8109c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.321+0000 7fdade8cc640 1 --2- 10.20.193.48:0/2799251876 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdad813e990 0x7fdad8109c00 secure :-1 s=READY pgs=22 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdacc00a910 tx=0x7fdacc005850 comp rx=0 tx=0).stop 2026-02-12T18:10:33.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.321+0000 7fdade8cc640 1 -- 10.20.193.48:0/2799251876 shutdown_connections 2026-02-12T18:10:33.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.321+0000 7fdade8cc640 1 --2- 10.20.193.48:0/2799251876 >> v2:10.20.193.111:6812/977811348 conn(0x7fdaa803f7f0 0x7fdaa805fca0 unknown :-1 s=CLOSED pgs=298 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.321+0000 7fdade8cc640 1 --2- 10.20.193.48:0/2799251876 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdad813e990 0x7fdad8109c00 unknown :-1 s=CLOSED pgs=22 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.321+0000 7fdade8cc640 1 --2- 10.20.193.48:0/2799251876 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fdad8093ac0 0x7fdad81096c0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.321+0000 7fdade8cc640 1 --2- 10.20.193.48:0/2799251876 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fdad805dd20 0x7fdad812d6a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.321+0000 7fdade8cc640 1 -- 10.20.193.48:0/2799251876 >> 10.20.193.48:0/2799251876 conn(0x7fdad8054b30 msgr2=0x7fdad813d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:33.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.321+0000 7fdade8cc640 1 -- 10.20.193.48:0/2799251876 shutdown_connections 2026-02-12T18:10:33.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.321+0000 7fdade8cc640 1 -- 10.20.193.48:0/2799251876 wait complete. 2026-02-12T18:10:33.332 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2026-02-12T18:10:33.332 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-12T18:10:33.332 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2026-02-12T18:10:33.333 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T18:10:33.424 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:10:33.424 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30285]: starting. 2026-02-12T18:10:33.424 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30285]: creating pool ceph_test_rados_delete_pools_parallel.trial111-30250 2026-02-12T18:10:33.424 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30285]: created object 0... 2026-02-12T18:10:33.424 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30285]: created object 25... 2026-02-12T18:10:33.424 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30285]: created object 49... 2026-02-12T18:10:33.425 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30285]: finishing. 2026-02-12T18:10:33.425 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30285]: shutting down. 2026-02-12T18:10:33.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.436+0000 7fca4b48c640 10 monclient: get_monmap_and_config 2026-02-12T18:10:33.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.436+0000 7fca4b48c640 10 monclient: build_initial_monmap 2026-02-12T18:10:33.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.436+0000 7fca4b48c640 10 monclient: monmap: 2026-02-12T18:10:33.438 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:33.438 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.439 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:10:33.437733+0000 2026-02-12T18:10:33.439 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:10:33.437733+0000 2026-02-12T18:10:33.439 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:33.439 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.439 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:10:33.439 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:10:33.439 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:33.439 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:33.439 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:33.439 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:33.439 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:33.439 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:33.440 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:33.440 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:10:33.440 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:10:33.440 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca4b48c640 1 Processor -- start 2026-02-12T18:10:33.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca4b48c640 1 -- start start 2026-02-12T18:10:33.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca4b48c640 10 monclient: init 2026-02-12T18:10:33.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca4b48c640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:33.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca4b48c640 10 monclient: _add_conns ranks=[4,6,0,8,1,3,2,9,5,7,10] 2026-02-12T18:10:33.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca4b48c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fca4405c950 0x7fca4405cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca4b48c640 10 monclient(hunting): picked mon.noname-c con 0x7fca4405c950 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:10:33.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca4b48c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fca4405e490 0x7fca4405d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca4b48c640 10 monclient(hunting): picked mon.noname-d con 0x7fca4405e490 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:10:33.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca4b48c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fca4413db70 addr v1:10.20.193.48:6789/0 2026-02-12T18:10:33.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca4b48c640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca4404dc20 con 0x7fca4413db70 2026-02-12T18:10:33.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca4b48c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca4b48c640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fca4405ddd0 con 0x7fca4405c950 2026-02-12T18:10:33.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca4b48c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca4b48c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fca4405d7a0 con 0x7fca4405e490 2026-02-12T18:10:33.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca4b48c640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:33.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca4b48c640 10 monclient(hunting): authenticate will time out at 872.163639s 2026-02-12T18:10:33.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca49201640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fca4405c950 0x7fca4405cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca49201640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fca4405c950 0x7fca4405cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:53310/0 (socket says 10.20.193.48:53310) 2026-02-12T18:10:33.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca49201640 1 -- 10.20.193.48:0/826673217 learned_addr learned my addr 10.20.193.48:0/826673217 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:33.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca48a00640 1 --2- 10.20.193.48:0/826673217 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fca4405e490 0x7fca4405d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca49201640 10 monclient(hunting): get_auth_request con 0x7fca4405c950 auth_method 0 2026-02-12T18:10:33.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca49a02640 1 --1- 10.20.193.48:0/826673217 >> v1:10.20.193.48:6789/0 conn(0x7fca4413db70 0x7fca4413dfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:56760/0 (socket says 10.20.193.48:56760) 2026-02-12T18:10:33.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca49201640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca49201640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca49201640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca48a00640 10 monclient(hunting): get_auth_request con 0x7fca4405e490 auth_method 0 2026-02-12T18:10:33.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca48a00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca48a00640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca48a00640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca49201640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca49201640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca49201640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca48a00640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca48a00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca48a00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca49201640 10 monclient(hunting): handle_auth_done global_id 64246 payload 274 2026-02-12T18:10:33.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca49201640 1 -- 10.20.193.48:0/826673217 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fca4405e490 msgr2=0x7fca4405d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:33.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca49201640 1 --2- 10.20.193.48:0/826673217 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fca4405e490 0x7fca4405d260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca49201640 1 -- 10.20.193.48:0/826673217 >> v1:10.20.193.48:6789/0 conn(0x7fca4413db70 legacy=0x7fca4413dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:33.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca49201640 10 monclient: _finish_hunting 0 2026-02-12T18:10:33.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca49201640 1 monclient: found mon.noname-c 2026-02-12T18:10:33.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca49201640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:33.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca49201640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:10:33.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.437+0000 7fca49201640 1 -- 10.20.193.48:0/826673217 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca44092990 con 0x7fca4405c950 2026-02-12T18:10:33.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.440+0000 7fca49201640 1 -- 10.20.193.48:0/826673217 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fca4405c950 msgr2=0x7fca4405cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:33.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.440+0000 7fca49201640 1 --2- 10.20.193.48:0/826673217 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fca4405c950 0x7fca4405cd20 secure :-1 s=READY pgs=23 gs=2 cs=0 l=1 c_cookie=9856851165226647605 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca340098d0 tx=0x7fca3402ee20 comp rx=0 tx=0).ready entity=mon.4 client_cookie=88ca91e9333ac035 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:33.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.440+0000 7fca33fff640 1 -- 10.20.193.48:0/826673217 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fca34035340 con 0x7fca4405c950 2026-02-12T18:10:33.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.440+0000 7fca33fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.440+0000 7fca33fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:10:33.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.440+0000 7fca33fff640 10 monclient: dump: 2026-02-12T18:10:33.455 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.455 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.455 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.455 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.455 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.456 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.456 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.456 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.456 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.456 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.456 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.456 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.456 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.456 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.456 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.456 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.440+0000 7fca33fff640 10 monclient: _finish_auth 0 2026-02-12T18:10:33.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.440+0000 7fca33fff640 10 monclient: _check_auth_tickets 2026-02-12T18:10:33.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.440+0000 7fca33fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:33.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.440+0000 7fca33fff640 1 -- 10.20.193.48:0/826673217 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca340354c0 con 0x7fca4405c950 2026-02-12T18:10:33.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.440+0000 7fca4b48c640 5 monclient: authenticate success, global_id 64246 2026-02-12T18:10:33.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.440+0000 7fca4b48c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:10:33.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.440+0000 7fca33fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:33.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.440+0000 7fca33fff640 1 -- 10.20.193.48:0/826673217 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fca34035af0 con 0x7fca4405c950 2026-02-12T18:10:33.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.440+0000 7fca33fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.440+0000 7fca33fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:10:33.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.440+0000 7fca33fff640 10 monclient: dump: 2026-02-12T18:10:33.457 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.457 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.458 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.458 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.458 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.458 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.458 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.458 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.458 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.458 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.458 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.458 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.458 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.458 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.459 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.459 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.440+0000 7fca4b48c640 10 monclient: get_monmap_and_config success 2026-02-12T18:10:33.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.440+0000 7fca4b48c640 4 set_mon_vals no callback set 2026-02-12T18:10:33.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.441+0000 7fca4b48c640 10 monclient: shutdown 2026-02-12T18:10:33.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.441+0000 7fca4b48c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:33.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.441+0000 7fca4b48c640 1 -- 10.20.193.48:0/826673217 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fca4405c950 msgr2=0x7fca4405cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.441+0000 7fca4b48c640 1 --2- 10.20.193.48:0/826673217 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fca4405c950 0x7fca4405cd20 secure :-1 s=READY pgs=23 gs=2 cs=0 l=1 c_cookie=9856851165226647605 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca340098d0 tx=0x7fca3402ee20 comp rx=0 tx=0).stop 2026-02-12T18:10:33.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.441+0000 7fca4b48c640 1 -- 10.20.193.48:0/826673217 shutdown_connections 2026-02-12T18:10:33.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.441+0000 7fca4b48c640 1 --2- 10.20.193.48:0/826673217 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fca4405e490 0x7fca4405d260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.441+0000 7fca4b48c640 1 --2- 10.20.193.48:0/826673217 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fca4405c950 0x7fca4405cd20 unknown :-1 s=CLOSED pgs=23 gs=2 cs=0 l=1 c_cookie=9856851165226647605 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.441+0000 7fca4b48c640 1 -- 10.20.193.48:0/826673217 >> 10.20.193.48:0/826673217 conn(0x7fca440548a0 msgr2=0x7fca44097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:33.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.441+0000 7fca4b48c640 1 -- 10.20.193.48:0/826673217 shutdown_connections 2026-02-12T18:10:33.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.441+0000 7fca4b48c640 1 -- 10.20.193.48:0/826673217 wait complete. 2026-02-12T18:10:33.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.441+0000 7fca4b48c640 10 monclient: build_initial_monmap 2026-02-12T18:10:33.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.441+0000 7fca4b48c640 10 monclient: monmap: 2026-02-12T18:10:33.460 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:33.460 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:10:33.460 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:10:33.460 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:10:33.460 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:33.460 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.460 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:10:33.460 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:10:33.461 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:33.461 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:33.461 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:33.461 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:33.461 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:33.461 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:33.461 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:33.461 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.441+0000 7fca4b48c640 1 Processor -- start 2026-02-12T18:10:33.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.441+0000 7fca4b48c640 1 -- start start 2026-02-12T18:10:33.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.441+0000 7fca4b48c640 10 monclient: init 2026-02-12T18:10:33.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca4b48c640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:33.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca4b48c640 10 monclient: _add_conns ranks=[3,4,5,2,7,6,8,1,0] 2026-02-12T18:10:33.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca4b48c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fca4405c950 0x7fca4413cde0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca4b48c640 10 monclient(hunting): picked mon.noname-g con 0x7fca4405c950 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:10:33.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca4b48c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fca4405e490 0x7fca4413d320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca4b48c640 10 monclient(hunting): picked mon.noname-c con 0x7fca4405e490 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:10:33.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca4b48c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fca4413db70 0x7fca44129430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca4b48c640 10 monclient(hunting): picked mon.noname-h con 0x7fca4413db70 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:10:33.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca4b48c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca4b48c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fca44090740 con 0x7fca4405c950 2026-02-12T18:10:33.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca4b48c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca4b48c640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fca4408af10 con 0x7fca4405e490 2026-02-12T18:10:33.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca4b48c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca4b48c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fca4413e830 con 0x7fca4413db70 2026-02-12T18:10:33.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca4b48c640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:33.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca4b48c640 10 monclient(hunting): authenticate will time out at 872.168090s 2026-02-12T18:10:33.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca48a00640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fca4405e490 0x7fca4413d320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca48a00640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fca4405e490 0x7fca4413d320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:53326/0 (socket says 10.20.193.48:53326) 2026-02-12T18:10:33.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca48a00640 1 -- 10.20.193.48:0/2083228742 learned_addr learned my addr 10.20.193.48:0/2083228742 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:33.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca48a00640 10 monclient(hunting): get_auth_request con 0x7fca4405e490 auth_method 0 2026-02-12T18:10:33.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca48a00640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca48a00640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca48a00640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca48a00640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca48a00640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca48a00640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca49201640 1 --2- 10.20.193.48:0/2083228742 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fca4405c950 0x7fca4413cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca49201640 10 monclient(hunting): get_auth_request con 0x7fca4405c950 auth_method 0 2026-02-12T18:10:33.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca49201640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca49201640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca49201640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca49a02640 1 --2- 10.20.193.48:0/2083228742 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fca4413db70 0x7fca44129430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca49a02640 10 monclient(hunting): get_auth_request con 0x7fca4413db70 auth_method 0 2026-02-12T18:10:33.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca49a02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca49a02640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca49a02640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca49201640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca49201640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca49201640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca48a00640 10 monclient(hunting): handle_auth_done global_id 64255 payload 824 2026-02-12T18:10:33.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca48a00640 1 -- 10.20.193.48:0/2083228742 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fca4413db70 msgr2=0x7fca44129430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca48a00640 1 --2- 10.20.193.48:0/2083228742 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fca4413db70 0x7fca44129430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca48a00640 1 -- 10.20.193.48:0/2083228742 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fca4405c950 msgr2=0x7fca4413cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca48a00640 1 --2- 10.20.193.48:0/2083228742 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fca4405c950 0x7fca4413cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca48a00640 10 monclient: _finish_hunting 0 2026-02-12T18:10:33.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca48a00640 1 monclient: found mon.noname-c 2026-02-12T18:10:33.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca48a00640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:33.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca48a00640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:10:33.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca48a00640 1 -- 10.20.193.48:0/2083228742 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca340094f0 con 0x7fca4405e490 2026-02-12T18:10:33.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.442+0000 7fca49a02640 1 --2- 10.20.193.48:0/2083228742 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fca4413db70 0x7fca44129430 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:10:33.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.444+0000 7fca48a00640 1 -- 10.20.193.48:0/2083228742 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fca4405e490 msgr2=0x7fca4413d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:33.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.444+0000 7fca48a00640 1 --2- 10.20.193.48:0/2083228742 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fca4405e490 0x7fca4413d320 secure :-1 s=READY pgs=24 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca380093f0 tx=0x7fca3800ed30 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:33.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.444+0000 7fca31ffb640 1 -- 10.20.193.48:0/2083228742 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fca3800cb50 con 0x7fca4405e490 2026-02-12T18:10:33.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.444+0000 7fca31ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.444+0000 7fca31ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:10:33.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.444+0000 7fca31ffb640 10 monclient: dump: 2026-02-12T18:10:33.466 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.466 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.466 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.466 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.466 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.466 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.466 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.466 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.466 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.466 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.466 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.466 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.466 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.467 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.467 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.467 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.444+0000 7fca31ffb640 10 monclient: _finish_auth 0 2026-02-12T18:10:33.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.444+0000 7fca31ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:10:33.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.444+0000 7fca31ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:33.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.444+0000 7fca4b48c640 5 monclient: authenticate success, global_id 64255 2026-02-12T18:10:33.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.444+0000 7fca4b48c640 10 monclient: _renew_subs 2026-02-12T18:10:33.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.444+0000 7fca4b48c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:10:33.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.444+0000 7fca4b48c640 1 -- 10.20.193.48:0/2083228742 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca4413e3e0 con 0x7fca4405e490 2026-02-12T18:10:33.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.444+0000 7fca31ffb640 1 -- 10.20.193.48:0/2083228742 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca3800ccb0 con 0x7fca4405e490 2026-02-12T18:10:33.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.444+0000 7fca31ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:33.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.444+0000 7fca31ffb640 1 -- 10.20.193.48:0/2083228742 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fca3800ce20 con 0x7fca4405e490 2026-02-12T18:10:33.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.444+0000 7fca31ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.444+0000 7fca31ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:10:33.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.444+0000 7fca31ffb640 10 monclient: dump: 2026-02-12T18:10:33.468 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.468 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.468 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.468 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.468 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.468 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.468 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.468 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.468 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.468 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.468 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.468 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.469 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.469 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.469 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.469 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.444+0000 7fca337fe640 4 set_mon_vals no callback set 2026-02-12T18:10:33.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.444+0000 7fca4b48c640 10 monclient: _renew_subs 2026-02-12T18:10:33.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.444+0000 7fca4b48c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:10:33.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.444+0000 7fca4b48c640 1 -- 10.20.193.48:0/2083228742 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fca4408ac30 con 0x7fca4405e490 2026-02-12T18:10:33.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.445+0000 7fca4b48c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:33.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.445+0000 7fca4b48c640 1 --2- 10.20.193.48:0/2083228742 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fca44129970 0x7fca44129d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.445+0000 7fca4b48c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.445+0000 7fca4b48c640 1 -- 10.20.193.48:0/2083228742 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fca44063180 con 0x7fca44129970 2026-02-12T18:10:33.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.445+0000 7fca49201640 1 --2- 10.20.193.48:0/2083228742 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fca44129970 0x7fca44129d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.445+0000 7fca49201640 10 monclient: get_auth_request con 0x7fca44129970 auth_method 0 2026-02-12T18:10:33.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.445+0000 7fca49201640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.445+0000 7fca49201640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.445+0000 7fca49201640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.445+0000 7fca49201640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.445+0000 7fca49201640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.445+0000 7fca49201640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.445+0000 7fca49201640 10 monclient(hunting): handle_auth_done global_id 5913 payload 824 2026-02-12T18:10:33.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.445+0000 7fca49201640 1 -- 10.20.193.48:0/2083228742 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca44097de0 con 0x7fca44129970 2026-02-12T18:10:33.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.445+0000 7fca31ffb640 1 -- 10.20.193.48:0/2083228742 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fca38011070 con 0x7fca4405e490 2026-02-12T18:10:33.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.445+0000 7fca31ffb640 1 --2- 10.20.193.48:0/2083228742 >> v2:10.20.193.111:6812/977811348 conn(0x7fca1403f800 0x7fca1405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.445+0000 7fca31ffb640 1 -- 10.20.193.48:0/2083228742 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(214..214 src has 1..214) ==== 3897+0+0 (secure 0 0 0) 0x7fca38052ad0 con 0x7fca4405e490 2026-02-12T18:10:33.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.445+0000 7fca49a02640 1 --2- 10.20.193.48:0/2083228742 >> v2:10.20.193.111:6812/977811348 conn(0x7fca1403f800 0x7fca1405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.445+0000 7fca49a02640 10 monclient: get_auth_request con 0x7fca1403f800 auth_method 0 2026-02-12T18:10:33.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.447+0000 7fca49201640 1 -- 10.20.193.48:0/2083228742 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fca44129970 msgr2=0x7fca44129d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:33.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.447+0000 7fca49201640 1 --2- 10.20.193.48:0/2083228742 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fca44129970 0x7fca44129d40 secure :-1 s=READY pgs=363 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca34004740 tx=0x7fca340047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:33.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.447+0000 7fca31ffb640 1 -- 10.20.193.48:0/2083228742 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fca34035ea0 con 0x7fca44129970 2026-02-12T18:10:33.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.447+0000 7fca31ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.447+0000 7fca31ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:10:33.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.447+0000 7fca31ffb640 10 monclient: dump: 2026-02-12T18:10:33.471 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.471 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.471 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.471 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.471 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.471 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.471 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.471 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.471 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.471 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.471 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.471 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.472 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.472 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.472 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.472 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.448+0000 7fca31ffb640 1 -- 10.20.193.48:0/2083228742 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fca34042480 con 0x7fca44129970 2026-02-12T18:10:33.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.448+0000 7fca31ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:33.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.448+0000 7fca31ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:10:33.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.448+0000 7fca31ffb640 1 -- 10.20.193.48:0/2083228742 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fca44129970 msgr2=0x7fca44129d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.448+0000 7fca31ffb640 1 --2- 10.20.193.48:0/2083228742 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fca44129970 0x7fca44129d40 secure :-1 s=READY pgs=363 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca34004740 tx=0x7fca340047e0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.448+0000 7fca31ffb640 1 -- 10.20.193.48:0/2083228742 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fca44129970 msgr2=0x7fca44129d40 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:33.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.448+0000 7fca31ffb640 1 --2- 10.20.193.48:0/2083228742 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fca44129970 0x7fca44129d40 secure :-1 s=CLOSED pgs=363 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca34004740 tx=0x7fca340047e0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.448+0000 7fca49a02640 1 --2- 10.20.193.48:0/2083228742 >> v2:10.20.193.111:6812/977811348 conn(0x7fca1403f800 0x7fca1405fcb0 secure :-1 s=READY pgs=299 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca4408a880 tx=0x7fca4000a040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:33.473 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:10:33.473 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30287]: starting. 2026-02-12T18:10:33.473 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30287]: listing objects. 2026-02-12T18:10:33.473 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30287]: listed object 0... 2026-02-12T18:10:33.473 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30287]: listed object 25... 2026-02-12T18:10:33.473 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30287]: saw 50 objects 2026-02-12T18:10:33.473 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30287]: shutting down. 2026-02-12T18:10:33.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.451+0000 7fca4b48c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:10:33.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.451+0000 7fca4b48c640 1 --2- 10.20.193.48:0/2083228742 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fca4412c9b0 0x7fca4412cdb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.451+0000 7fca4b48c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.451+0000 7fca4b48c640 1 -- 10.20.193.48:0/2083228742 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fca4405fd90 con 0x7fca4412c9b0 2026-02-12T18:10:33.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.451+0000 7fca49201640 1 --2- 10.20.193.48:0/2083228742 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fca4412c9b0 0x7fca4412cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.451+0000 7fca49201640 10 monclient: get_auth_request con 0x7fca4412c9b0 auth_method 0 2026-02-12T18:10:33.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.451+0000 7fca49201640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.451+0000 7fca49201640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.451+0000 7fca49201640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.451+0000 7fca49201640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.451+0000 7fca49201640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.451+0000 7fca49201640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.451+0000 7fca49201640 10 monclient(hunting): handle_auth_done global_id 5922 payload 824 2026-02-12T18:10:33.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.451+0000 7fca49201640 1 -- 10.20.193.48:0/2083228742 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fca4405f140 con 0x7fca4412c9b0 2026-02-12T18:10:33.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.453+0000 7fca49201640 1 -- 10.20.193.48:0/2083228742 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fca4412c9b0 msgr2=0x7fca4412cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:33.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.453+0000 7fca49201640 1 --2- 10.20.193.48:0/2083228742 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fca4412c9b0 0x7fca4412cdb0 secure :-1 s=READY pgs=364 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca34009820 tx=0x7fca34004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:33.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.453+0000 7fca31ffb640 1 -- 10.20.193.48:0/2083228742 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fca34052070 con 0x7fca4412c9b0 2026-02-12T18:10:33.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.453+0000 7fca31ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.453+0000 7fca31ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:10:33.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.453+0000 7fca31ffb640 10 monclient: dump: 2026-02-12T18:10:33.476 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.476 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.476 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.476 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.476 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.476 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.476 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.476 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.476 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.476 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.476 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.476 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.477 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.477 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.477 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.477 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.454+0000 7fca31ffb640 1 -- 10.20.193.48:0/2083228742 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10184 (secure 0 0 0) 0x7fca3404d740 con 0x7fca4412c9b0 2026-02-12T18:10:33.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.454+0000 7fca31ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:10:33.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.454+0000 7fca31ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:10:33.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.454+0000 7fca31ffb640 1 -- 10.20.193.48:0/2083228742 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fca4412c9b0 msgr2=0x7fca4412cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.454+0000 7fca31ffb640 1 --2- 10.20.193.48:0/2083228742 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fca4412c9b0 0x7fca4412cdb0 secure :-1 s=READY pgs=364 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca34009820 tx=0x7fca34004770 comp rx=0 tx=0).stop 2026-02-12T18:10:33.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.454+0000 7fca31ffb640 1 -- 10.20.193.48:0/2083228742 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fca4412c9b0 msgr2=0x7fca4412cdb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:33.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.454+0000 7fca31ffb640 1 --2- 10.20.193.48:0/2083228742 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fca4412c9b0 0x7fca4412cdb0 secure :-1 s=CLOSED pgs=364 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca34009820 tx=0x7fca34004770 comp rx=0 tx=0).stop 2026-02-12T18:10:33.477 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:10:33.477 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:10:33.477 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:10:33.478 INFO:teuthology.orchestra.run.trial048.stdout: "state": "leader", 2026-02-12T18:10:33.478 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 46, 2026-02-12T18:10:33.478 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 288288, 2026-02-12T18:10:33.478 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:10:33.478 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:10:33.478 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:10:33.478 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:10:33.478 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:10:33.478 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:10:33.478 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:10:33.478 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:10:33.478 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:10:33.478 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:10:33.478 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:33.478 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 8, 2026-02-12T18:10:33.478 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:33.478 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:10:33.478 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:10:33.478 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:33.479 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:33.479 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:33.479 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:33.479 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:33.479 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:33.479 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:33.479 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:33.479 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:33.479 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:33.479 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:33.479 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:33.479 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:33.479 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:33.479 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:10:33.479 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:10:33.479 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:33.479 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:33.479 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:33.479 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:33.479 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:33.480 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:33.480 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:33.480 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:33.480 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:33.480 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:33.480 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:33.480 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:33.480 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:33.480 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.480 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.480 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:10:33.480 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:10:33.480 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:10:33.480 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:10:33.480 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:10:33.480 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:10:33.480 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:33.480 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:33.480 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:10:33.480 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:10:33.481 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:10:33.481 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:10:33.481 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:10:33.481 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:10:33.481 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:10:33.481 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:33.481 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:10:33.481 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:33.481 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:33.481 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:33.481 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:33.481 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:33.481 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:33.481 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:33.481 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:33.481 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:33.481 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:33.481 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:33.481 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:33.481 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:33.481 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:33.481 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:10:33.482 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.482 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:10:33.482 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.482 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:10:33.482 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:10:33.482 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.482 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.482 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.482 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.482 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:10:33.482 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.482 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.482 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.482 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.482 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:10:33.482 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.482 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.482 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.482 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.482 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:10:33.482 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:10:33.482 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.483 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.483 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:10:33.483 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.483 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.483 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.483 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:10:33.483 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:10:33.483 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.483 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.483 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.483 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.483 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:10:33.483 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.483 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.483 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.483 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.483 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:10:33.483 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.483 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.483 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.483 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.483 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:10:33.484 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:10:33.484 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.484 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.484 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:10:33.484 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.484 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.484 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.484 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:10:33.484 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:10:33.484 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.484 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.484 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.484 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.484 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:10:33.484 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.484 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.484 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.484 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.484 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:10:33.484 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.484 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.484 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.484 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.485 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:10:33.485 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:10:33.485 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.485 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.485 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:10:33.485 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.485 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.485 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.485 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:10:33.485 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:10:33.485 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.485 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.485 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.485 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.485 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:10:33.485 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.485 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.485 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.485 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.485 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:10:33.485 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.485 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.485 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.486 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.486 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:10:33.486 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:10:33.486 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.486 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.486 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:10:33.486 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.486 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.486 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.486 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:10:33.486 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:10:33.486 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.486 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.486 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.486 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.486 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:10:33.486 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.486 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.486 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.486 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.486 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:10:33.486 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.487 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.487 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.487 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.487 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:10:33.487 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:10:33.487 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.487 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.487 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:33.487 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.487 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.487 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.487 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:10:33.487 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:10:33.487 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.487 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.487 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.487 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.487 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:10:33.487 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.487 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.487 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.487 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.487 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:10:33.488 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.488 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.488 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.488 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.488 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:10:33.488 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:10:33.488 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.488 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.488 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:10:33.488 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.488 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.488 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.488 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:10:33.488 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:10:33.488 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.488 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.488 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.488 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.488 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:10:33.488 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.488 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.488 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.489 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.489 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:10:33.489 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.489 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.489 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.489 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.489 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:10:33.489 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:10:33.489 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.489 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.489 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:33.489 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.489 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.489 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.489 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:10:33.489 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:10:33.489 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.489 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.489 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.489 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.489 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:10:33.489 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.490 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.490 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.490 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.490 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:10:33.490 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.490 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.490 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.490 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.490 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:10:33.490 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:10:33.490 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.490 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.490 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:10:33.490 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.490 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.490 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.490 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:10:33.490 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:10:33.490 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.490 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.490 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.490 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.490 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:10:33.491 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.491 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.491 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.491 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.491 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:10:33.491 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.491 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.491 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.491 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.491 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:10:33.491 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:10:33.491 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.491 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.491 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:10:33.491 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.491 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.491 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.491 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.491 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:10:33.491 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:10:33.491 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.491 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:33.491 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:33.492 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:33.492 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.492 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:33.492 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:10:33.492 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.492 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:33.492 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:33.492 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:33.492 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.492 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:33.492 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:10:33.492 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.492 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:33.492 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:33.492 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:33.492 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.492 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.492 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.492 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:10:33.492 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:10:33.493 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.454+0000 7fca4b48c640 1 -- 10.20.193.48:0/2083228742 >> v2:10.20.193.111:6812/977811348 conn(0x7fca1403f800 msgr2=0x7fca1405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.493 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.454+0000 7fca4b48c640 1 --2- 10.20.193.48:0/2083228742 >> v2:10.20.193.111:6812/977811348 conn(0x7fca1403f800 0x7fca1405fcb0 secure :-1 s=READY pgs=299 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca4408a880 tx=0x7fca4000a040 comp rx=0 tx=0).stop 2026-02-12T18:10:33.493 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.454+0000 7fca4b48c640 10 monclient: shutdown 2026-02-12T18:10:33.493 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.454+0000 7fca4b48c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:33.493 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.454+0000 7fca4b48c640 1 -- 10.20.193.48:0/2083228742 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fca4405e490 msgr2=0x7fca4413d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.493 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.454+0000 7fca4b48c640 1 --2- 10.20.193.48:0/2083228742 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fca4405e490 0x7fca4413d320 secure :-1 s=READY pgs=24 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fca380093f0 tx=0x7fca3800ed30 comp rx=0 tx=0).stop 2026-02-12T18:10:33.493 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.454+0000 7fca49a02640 1 -- 10.20.193.48:0/2083228742 reap_dead start 2026-02-12T18:10:33.493 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.454+0000 7fca49a02640 1 -- 10.20.193.48:0/2083228742 reap_dead start 2026-02-12T18:10:33.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.454+0000 7fca4b48c640 1 -- 10.20.193.48:0/2083228742 shutdown_connections 2026-02-12T18:10:33.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.454+0000 7fca4b48c640 1 -- 10.20.193.48:0/2083228742 >> 10.20.193.48:0/2083228742 conn(0x7fca440548a0 msgr2=0x7fca44093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:33.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.454+0000 7fca4b48c640 1 -- 10.20.193.48:0/2083228742 shutdown_connections 2026-02-12T18:10:33.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.454+0000 7fca4b48c640 1 -- 10.20.193.48:0/2083228742 wait complete. 2026-02-12T18:10:33.494 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:10:33.494 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2026-02-12T18:10:33.494 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T18:10:33.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.557+0000 7fbeb32cc640 10 monclient: get_monmap_and_config 2026-02-12T18:10:33.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.557+0000 7fbeb32cc640 10 monclient: build_initial_monmap 2026-02-12T18:10:33.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.557+0000 7fbeb32cc640 10 monclient: monmap: 2026-02-12T18:10:33.559 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:33.559 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.559 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:10:33.558352+0000 2026-02-12T18:10:33.559 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:10:33.558352+0000 2026-02-12T18:10:33.559 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:33.559 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.559 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:10:33.559 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:10:33.559 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:33.559 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:33.559 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:33.559 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:33.559 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:33.559 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:33.559 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:33.559 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:10:33.559 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:10:33.559 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.557+0000 7fbeb32cc640 1 Processor -- start 2026-02-12T18:10:33.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.557+0000 7fbeb32cc640 1 -- start start 2026-02-12T18:10:33.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.557+0000 7fbeb32cc640 10 monclient: init 2026-02-12T18:10:33.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb32cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:33.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb32cc640 10 monclient: _add_conns ranks=[9,1,5,10,0,7,8,2,3,4,6] 2026-02-12T18:10:33.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb32cc640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fbeac05d550 0x7fbeac05d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb32cc640 10 monclient(hunting): picked mon.noname-a con 0x7fbeac05d550 addr v2:10.20.193.48:3300/0 2026-02-12T18:10:33.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb32cc640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fbeac05de60 addr v1:10.20.193.111:6789/0 2026-02-12T18:10:33.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb32cc640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fbeac13ef60 0x7fbeac1426b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb32cc640 10 monclient(hunting): picked mon.noname-h con 0x7fbeac13ef60 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:10:33.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb32cc640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeac04dc20 con 0x7fbeac05de60 2026-02-12T18:10:33.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb32cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb32cc640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7fbeac08d390 con 0x7fbeac05d550 2026-02-12T18:10:33.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb32cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb32cc640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fbeac08d5a0 con 0x7fbeac13ef60 2026-02-12T18:10:33.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb32cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:33.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb32cc640 10 monclient(hunting): authenticate will time out at 872.284072s 2026-02-12T18:10:33.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb1041640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fbeac05d550 0x7fbeac05d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb1041640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fbeac05d550 0x7fbeac05d920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:58152/0 (socket says 10.20.193.48:58152) 2026-02-12T18:10:33.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb1041640 1 -- 10.20.193.48:0/2714769476 learned_addr learned my addr 10.20.193.48:0/2714769476 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:33.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb1041640 10 monclient(hunting): get_auth_request con 0x7fbeac05d550 auth_method 0 2026-02-12T18:10:33.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb1041640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb1041640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb1041640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb1041640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb1041640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb1041640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb1842640 1 --2- 10.20.193.48:0/2714769476 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fbeac13ef60 0x7fbeac1426b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb1842640 10 monclient(hunting): get_auth_request con 0x7fbeac13ef60 auth_method 0 2026-02-12T18:10:33.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb1842640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb1842640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb1842640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb1041640 10 monclient(hunting): handle_auth_done global_id 5931 payload 274 2026-02-12T18:10:33.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb1041640 1 -- 10.20.193.48:0/2714769476 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fbeac13ef60 msgr2=0x7fbeac1426b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:33.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb1041640 1 --2- 10.20.193.48:0/2714769476 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fbeac13ef60 0x7fbeac1426b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb1041640 1 -- 10.20.193.48:0/2714769476 >> v1:10.20.193.111:6789/0 conn(0x7fbeac05de60 legacy=0x7fbeac141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:33.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb1041640 10 monclient: _finish_hunting 0 2026-02-12T18:10:33.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb1041640 1 monclient: found mon.noname-a 2026-02-12T18:10:33.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb1041640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:33.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb1041640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:10:33.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.558+0000 7fbeb1041640 1 -- 10.20.193.48:0/2714769476 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeac0580e0 con 0x7fbeac05d550 2026-02-12T18:10:33.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.560+0000 7fbeb1041640 1 -- 10.20.193.48:0/2714769476 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbeac05d550 msgr2=0x7fbeac05d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:33.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.560+0000 7fbeb1041640 1 --2- 10.20.193.48:0/2714769476 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbeac05d550 0x7fbeac05d920 secure :-1 s=READY pgs=365 gs=2 cs=0 l=1 c_cookie=14608432651787631275 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe9c009060 tx=0x7fbe9c02edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cabb94191704faab server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:33.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbe9bfff640 1 -- 10.20.193.48:0/2714769476 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fbe9c035340 con 0x7fbeac05d550 2026-02-12T18:10:33.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbe9bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbe9bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:10:33.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbe9bfff640 10 monclient: dump: 2026-02-12T18:10:33.568 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.568 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.568 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.568 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.568 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.568 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.568 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.568 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.568 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.568 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.568 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.568 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.569 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.569 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.569 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.569 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbe9bfff640 10 monclient: _finish_auth 0 2026-02-12T18:10:33.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbe9bfff640 10 monclient: _check_auth_tickets 2026-02-12T18:10:33.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbe9bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:33.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbe9bfff640 1 -- 10.20.193.48:0/2714769476 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe9c0354c0 con 0x7fbeac05d550 2026-02-12T18:10:33.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbeb32cc640 5 monclient: authenticate success, global_id 5931 2026-02-12T18:10:33.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbeb32cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:10:33.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbe9bfff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:33.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbe9bfff640 1 -- 10.20.193.48:0/2714769476 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fbe9c035af0 con 0x7fbeac05d550 2026-02-12T18:10:33.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbeb32cc640 10 monclient: get_monmap_and_config success 2026-02-12T18:10:33.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbeb32cc640 4 set_mon_vals no callback set 2026-02-12T18:10:33.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbe9bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbe9bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:10:33.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbe9bfff640 10 monclient: dump: 2026-02-12T18:10:33.569 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.569 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.569 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.570 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.570 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.570 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.570 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.570 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.570 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.570 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.570 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.570 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.570 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.570 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.570 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.570 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbeb32cc640 10 monclient: shutdown 2026-02-12T18:10:33.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbeb32cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:33.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbeb32cc640 1 -- 10.20.193.48:0/2714769476 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbeac05d550 msgr2=0x7fbeac05d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbeb32cc640 1 --2- 10.20.193.48:0/2714769476 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbeac05d550 0x7fbeac05d920 secure :-1 s=READY pgs=365 gs=2 cs=0 l=1 c_cookie=14608432651787631275 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe9c009060 tx=0x7fbe9c02edf0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbeb32cc640 1 -- 10.20.193.48:0/2714769476 shutdown_connections 2026-02-12T18:10:33.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbeb32cc640 1 --2- 10.20.193.48:0/2714769476 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fbeac13ef60 0x7fbeac1426b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbeb32cc640 1 --2- 10.20.193.48:0/2714769476 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbeac05d550 0x7fbeac05d920 unknown :-1 s=CLOSED pgs=365 gs=2 cs=0 l=1 c_cookie=14608432651787631275 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbeb32cc640 1 -- 10.20.193.48:0/2714769476 >> 10.20.193.48:0/2714769476 conn(0x7fbeac0546a0 msgr2=0x7fbeac054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:33.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbeb32cc640 1 -- 10.20.193.48:0/2714769476 shutdown_connections 2026-02-12T18:10:33.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.561+0000 7fbeb32cc640 1 -- 10.20.193.48:0/2714769476 wait complete. 2026-02-12T18:10:33.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb32cc640 10 monclient: build_initial_monmap 2026-02-12T18:10:33.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb32cc640 10 monclient: monmap: 2026-02-12T18:10:33.571 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:33.571 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:10:33.571 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:10:33.571 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:10:33.571 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:33.571 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.571 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:10:33.571 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:10:33.571 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:33.571 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:33.571 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:33.571 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:33.571 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:33.571 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:33.571 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:33.572 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb32cc640 1 Processor -- start 2026-02-12T18:10:33.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb32cc640 1 -- start start 2026-02-12T18:10:33.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb32cc640 10 monclient: init 2026-02-12T18:10:33.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb32cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:33.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb32cc640 10 monclient: _add_conns ranks=[5,0,3,1,8,7,6,4,2] 2026-02-12T18:10:33.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb32cc640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fbeac05d550 0x7fbeac131540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb32cc640 10 monclient(hunting): picked mon.noname-h con 0x7fbeac05d550 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:10:33.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb32cc640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbeac05de60 0x7fbeac08a680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb32cc640 10 monclient(hunting): picked mon.noname-a con 0x7fbeac05de60 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:10:33.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb32cc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fbeac13ef60 0x7fbeac08abc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb32cc640 10 monclient(hunting): picked mon.noname-g con 0x7fbeac13ef60 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:10:33.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb32cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb32cc640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fbeac1208b0 con 0x7fbeac05de60 2026-02-12T18:10:33.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb32cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb32cc640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fbeac13dd10 con 0x7fbeac13ef60 2026-02-12T18:10:33.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb32cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb32cc640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fbeac132410 con 0x7fbeac05d550 2026-02-12T18:10:33.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb32cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:33.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb32cc640 10 monclient(hunting): authenticate will time out at 872.288591s 2026-02-12T18:10:33.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb0840640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbeac05de60 0x7fbeac08a680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb0840640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbeac05de60 0x7fbeac08a680 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:58168/0 (socket says 10.20.193.48:58168) 2026-02-12T18:10:33.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb0840640 1 -- 10.20.193.48:0/711688017 learned_addr learned my addr 10.20.193.48:0/711688017 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:33.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb0840640 10 monclient(hunting): get_auth_request con 0x7fbeac05de60 auth_method 0 2026-02-12T18:10:33.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb0840640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb0840640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb0840640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb1041640 1 --2- 10.20.193.48:0/711688017 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fbeac05d550 0x7fbeac131540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb0840640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb0840640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb1842640 1 --2- 10.20.193.48:0/711688017 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fbeac13ef60 0x7fbeac08abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb0840640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb1041640 10 monclient(hunting): get_auth_request con 0x7fbeac05d550 auth_method 0 2026-02-12T18:10:33.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb1041640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb1041640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb1041640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb1842640 10 monclient(hunting): get_auth_request con 0x7fbeac13ef60 auth_method 0 2026-02-12T18:10:33.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb1842640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.573 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb1842640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb1842640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb1041640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb1041640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb1041640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb1842640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb1842640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb1842640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb0840640 10 monclient(hunting): handle_auth_done global_id 5940 payload 824 2026-02-12T18:10:33.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb0840640 1 -- 10.20.193.48:0/711688017 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fbeac05d550 msgr2=0x7fbeac131540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb0840640 1 --2- 10.20.193.48:0/711688017 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fbeac05d550 0x7fbeac131540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb0840640 1 -- 10.20.193.48:0/711688017 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fbeac13ef60 msgr2=0x7fbeac08abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb0840640 1 --2- 10.20.193.48:0/711688017 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fbeac13ef60 0x7fbeac08abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb0840640 10 monclient: _finish_hunting 0 2026-02-12T18:10:33.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb0840640 1 monclient: found mon.noname-a 2026-02-12T18:10:33.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb0840640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:33.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb0840640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:10:33.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.562+0000 7fbeb0840640 1 -- 10.20.193.48:0/711688017 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9c0094f0 con 0x7fbeac05de60 2026-02-12T18:10:33.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbeb0840640 1 -- 10.20.193.48:0/711688017 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbeac05de60 msgr2=0x7fbeac08a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:33.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbeb0840640 1 --2- 10.20.193.48:0/711688017 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbeac05de60 0x7fbeac08a680 secure :-1 s=READY pgs=366 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbea000c480 tx=0x7fbea000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:33.574 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbe99ffb640 1 -- 10.20.193.48:0/711688017 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fbea0006d50 con 0x7fbeac05de60 2026-02-12T18:10:33.575 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbe99ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.575 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbe99ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:10:33.575 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbe99ffb640 10 monclient: dump: 2026-02-12T18:10:33.575 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.575 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.575 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.575 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.575 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.575 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.575 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.575 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.575 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.575 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.575 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.575 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.575 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.575 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.575 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.575 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.575 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbe99ffb640 10 monclient: _finish_auth 0 2026-02-12T18:10:33.575 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbe99ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:10:33.576 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbe99ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:33.576 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbe99ffb640 1 -- 10.20.193.48:0/711688017 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbea0007030 con 0x7fbeac05de60 2026-02-12T18:10:33.576 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbeb32cc640 5 monclient: authenticate success, global_id 5940 2026-02-12T18:10:33.576 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbeb32cc640 10 monclient: _renew_subs 2026-02-12T18:10:33.576 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbeb32cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:10:33.576 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbeb32cc640 1 -- 10.20.193.48:0/711688017 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeac10f730 con 0x7fbeac05de60 2026-02-12T18:10:33.576 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbe99ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:33.576 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbe99ffb640 1 -- 10.20.193.48:0/711688017 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fbea0007660 con 0x7fbeac05de60 2026-02-12T18:10:33.576 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbe99ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.576 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbe9b7fe640 4 set_mon_vals no callback set 2026-02-12T18:10:33.576 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbe99ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:10:33.576 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbe99ffb640 10 monclient: dump: 2026-02-12T18:10:33.576 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.576 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.576 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.576 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.576 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.576 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.576 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.577 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.577 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.577 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.577 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.577 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.577 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.577 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.577 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.577 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbeb32cc640 10 monclient: _renew_subs 2026-02-12T18:10:33.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbeb32cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:10:33.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbeb32cc640 1 -- 10.20.193.48:0/711688017 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeac08c730 con 0x7fbeac05de60 2026-02-12T18:10:33.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbeb32cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:33.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbeb32cc640 1 --2- 10.20.193.48:0/711688017 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fbeac091010 0x7fbeac08b100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbeb32cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbeb32cc640 1 -- 10.20.193.48:0/711688017 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fbeac0631f0 con 0x7fbeac091010 2026-02-12T18:10:33.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbeb1041640 1 --2- 10.20.193.48:0/711688017 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fbeac091010 0x7fbeac08b100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbeb1041640 10 monclient: get_auth_request con 0x7fbeac091010 auth_method 0 2026-02-12T18:10:33.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbeb1041640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.577 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbeb1041640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbeb1041640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbeb1041640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbeb1041640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.565+0000 7fbeb1041640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.566+0000 7fbe99ffb640 1 -- 10.20.193.48:0/711688017 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fbea00071a0 con 0x7fbeac05de60 2026-02-12T18:10:33.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.566+0000 7fbeb1041640 10 monclient(hunting): handle_auth_done global_id 35696 payload 824 2026-02-12T18:10:33.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.566+0000 7fbeb1041640 1 -- 10.20.193.48:0/711688017 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbeac05e310 con 0x7fbeac091010 2026-02-12T18:10:33.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.566+0000 7fbe99ffb640 1 --2- 10.20.193.48:0/711688017 >> v2:10.20.193.111:6812/977811348 conn(0x7fbe7c03f800 0x7fbe7c05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.566+0000 7fbe99ffb640 1 -- 10.20.193.48:0/711688017 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(214..214 src has 1..214) ==== 3897+0+0 (secure 0 0 0) 0x7fbea0052030 con 0x7fbeac05de60 2026-02-12T18:10:33.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.566+0000 7fbeb1842640 1 --2- 10.20.193.48:0/711688017 >> v2:10.20.193.111:6812/977811348 conn(0x7fbe7c03f800 0x7fbe7c05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.566+0000 7fbeb1842640 10 monclient: get_auth_request con 0x7fbe7c03f800 auth_method 0 2026-02-12T18:10:33.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.568+0000 7fbeb1041640 1 -- 10.20.193.48:0/711688017 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fbeac091010 msgr2=0x7fbeac08b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:33.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.568+0000 7fbeb1041640 1 --2- 10.20.193.48:0/711688017 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fbeac091010 0x7fbeac08b100 secure :-1 s=READY pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe9c004740 tx=0x7fbe9c0047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:33.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.568+0000 7fbe99ffb640 1 -- 10.20.193.48:0/711688017 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fbe9c035ea0 con 0x7fbeac091010 2026-02-12T18:10:33.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.568+0000 7fbe99ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.568+0000 7fbe99ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:10:33.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.568+0000 7fbe99ffb640 10 monclient: dump: 2026-02-12T18:10:33.580 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.581 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.581 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.581 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.581 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.581 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.581 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.581 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.581 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.581 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.581 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.581 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.581 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.581 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.581 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.581 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.568+0000 7fbe99ffb640 1 -- 10.20.193.48:0/711688017 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fbe9c042480 con 0x7fbeac091010 2026-02-12T18:10:33.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.568+0000 7fbe99ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:33.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.568+0000 7fbe99ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:10:33.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.568+0000 7fbe99ffb640 1 -- 10.20.193.48:0/711688017 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fbeac091010 msgr2=0x7fbeac08b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.568+0000 7fbe99ffb640 1 --2- 10.20.193.48:0/711688017 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fbeac091010 0x7fbeac08b100 secure :-1 s=READY pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe9c004740 tx=0x7fbe9c0047e0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.568+0000 7fbe99ffb640 1 -- 10.20.193.48:0/711688017 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fbeac091010 msgr2=0x7fbeac08b100 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:33.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.568+0000 7fbe99ffb640 1 --2- 10.20.193.48:0/711688017 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fbeac091010 0x7fbeac08b100 secure :-1 s=CLOSED pgs=220 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe9c004740 tx=0x7fbe9c0047e0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.568+0000 7fbeb1842640 1 --2- 10.20.193.48:0/711688017 >> v2:10.20.193.111:6812/977811348 conn(0x7fbe7c03f800 0x7fbe7c05fcb0 secure :-1 s=READY pgs=300 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbea8005820 tx=0x7fbea8009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:33.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.572+0000 7fbeb32cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:10:33.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.572+0000 7fbeb32cc640 1 --2- 10.20.193.48:0/711688017 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fbeac058a10 0x7fbeac058e10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.572+0000 7fbeb32cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.572+0000 7fbeb32cc640 1 -- 10.20.193.48:0/711688017 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fbeac050410 con 0x7fbeac058a10 2026-02-12T18:10:33.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.572+0000 7fbeb1041640 1 --2- 10.20.193.48:0/711688017 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fbeac058a10 0x7fbeac058e10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.572+0000 7fbeb1041640 10 monclient: get_auth_request con 0x7fbeac058a10 auth_method 0 2026-02-12T18:10:33.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.572+0000 7fbeb1041640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.572+0000 7fbeb1041640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.572+0000 7fbeb1041640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.572+0000 7fbeb1041640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.572+0000 7fbeb1041640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.572+0000 7fbeb1041640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.572+0000 7fbeb1041640 10 monclient(hunting): handle_auth_done global_id 35705 payload 824 2026-02-12T18:10:33.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.572+0000 7fbeb1041640 1 -- 10.20.193.48:0/711688017 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbeac057e00 con 0x7fbeac058a10 2026-02-12T18:10:33.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.574+0000 7fbeb1041640 1 -- 10.20.193.48:0/711688017 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fbeac058a10 msgr2=0x7fbeac058e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:33.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.574+0000 7fbeb1041640 1 --2- 10.20.193.48:0/711688017 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fbeac058a10 0x7fbeac058e10 secure :-1 s=READY pgs=221 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe9c0023d0 tx=0x7fbe9c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:33.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.574+0000 7fbe99ffb640 1 -- 10.20.193.48:0/711688017 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fbe9c052070 con 0x7fbeac058a10 2026-02-12T18:10:33.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.574+0000 7fbe99ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.574+0000 7fbe99ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:10:33.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.574+0000 7fbe99ffb640 10 monclient: dump: 2026-02-12T18:10:33.583 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.583 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.583 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.583 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.583 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.583 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.583 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.583 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.583 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.583 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.583 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.583 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.583 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.583 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.583 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.583 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.575+0000 7fbe99ffb640 1 -- 10.20.193.48:0/711688017 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10349 (secure 0 0 0) 0x7fbe9c04d740 con 0x7fbeac058a10 2026-02-12T18:10:33.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.575+0000 7fbe99ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:10:33.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.575+0000 7fbe99ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:10:33.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.575+0000 7fbe99ffb640 1 -- 10.20.193.48:0/711688017 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fbeac058a10 msgr2=0x7fbeac058e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.575+0000 7fbe99ffb640 1 --2- 10.20.193.48:0/711688017 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fbeac058a10 0x7fbeac058e10 secure :-1 s=READY pgs=221 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe9c0023d0 tx=0x7fbe9c004770 comp rx=0 tx=0).stop 2026-02-12T18:10:33.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.575+0000 7fbe99ffb640 1 -- 10.20.193.48:0/711688017 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fbeac058a10 msgr2=0x7fbeac058e10 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:33.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.575+0000 7fbe99ffb640 1 --2- 10.20.193.48:0/711688017 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fbeac058a10 0x7fbeac058e10 secure :-1 s=CLOSED pgs=221 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbe9c0023d0 tx=0x7fbe9c004770 comp rx=0 tx=0).stop 2026-02-12T18:10:33.584 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:10:33.584 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:10:33.584 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:10:33.584 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:10:33.584 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 46, 2026-02-12T18:10:33.584 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 288408, 2026-02-12T18:10:33.585 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:10:33.585 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:10:33.585 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:10:33.585 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:10:33.585 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:10:33.585 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:10:33.585 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:10:33.585 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:10:33.585 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:10:33.585 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:10:33.585 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:33.585 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 8, 2026-02-12T18:10:33.585 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:33.585 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:10:33.585 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:10:33.585 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:33.585 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:33.585 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:33.585 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:33.586 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:33.586 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:33.586 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:33.586 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:33.586 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:33.586 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:33.586 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:33.586 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:33.586 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:33.586 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:33.586 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:10:33.586 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:10:33.586 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:33.586 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:33.586 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:33.586 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:33.586 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:33.586 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:33.586 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:33.587 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:33.587 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:33.587 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:33.587 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:33.587 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:33.587 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:33.587 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.587 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.587 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:10:33.587 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:10:33.587 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:10:33.587 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:10:33.587 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:10:33.587 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:10:33.587 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:33.587 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:33.587 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:10:33.587 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:10:33.587 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:10:33.587 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:10:33.588 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:10:33.588 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:10:33.588 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:10:33.588 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:33.588 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:10:33.588 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:33.588 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:33.588 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:33.588 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:33.588 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:33.588 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:33.588 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:33.588 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:33.588 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:33.588 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:33.588 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:33.588 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:33.588 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:33.588 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:33.588 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:10:33.589 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.589 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:10:33.589 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.589 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:10:33.589 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:10:33.589 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.589 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.589 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.589 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.589 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:10:33.589 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.589 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.589 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.589 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.589 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:10:33.589 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.589 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.589 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.589 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.589 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:10:33.589 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:10:33.590 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.590 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.590 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:10:33.590 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.590 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.590 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.590 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:10:33.590 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:10:33.590 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.590 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.590 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.590 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.590 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:10:33.590 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.590 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.590 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.590 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.590 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:10:33.590 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.590 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.590 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.591 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.591 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:10:33.591 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:10:33.591 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.591 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.591 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:10:33.591 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.591 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.591 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.591 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:10:33.591 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:10:33.591 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.591 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.591 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.591 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.591 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:10:33.591 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.591 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.591 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.591 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.591 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:10:33.591 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.591 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.592 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.592 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.592 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:10:33.592 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:10:33.592 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.592 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.592 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:10:33.592 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.592 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.592 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.592 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:10:33.592 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:10:33.592 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.592 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.592 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.592 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.592 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:10:33.592 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.592 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.592 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.592 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.592 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:10:33.593 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.593 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.593 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.593 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.593 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:10:33.593 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:10:33.593 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.593 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.593 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:10:33.593 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.593 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.593 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.593 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:10:33.593 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:10:33.593 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.593 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.593 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.593 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.593 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:10:33.593 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.593 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.593 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.593 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.594 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:10:33.594 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.594 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.594 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.594 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.594 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:10:33.594 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:10:33.594 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.594 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.594 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:33.594 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.594 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.594 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.594 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:10:33.594 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:10:33.594 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.594 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.594 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.594 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.594 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:10:33.594 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.594 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.594 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.594 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.595 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:10:33.595 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.595 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.595 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.595 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.595 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:10:33.595 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:10:33.595 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.595 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.595 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:10:33.595 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.595 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.595 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.595 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:10:33.595 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:10:33.595 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.595 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.595 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.595 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.595 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:10:33.595 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.595 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.595 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.596 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.596 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:10:33.596 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.596 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.596 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.596 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.596 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:10:33.596 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:10:33.596 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.596 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.596 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:33.596 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.596 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.596 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.596 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:10:33.596 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:10:33.596 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.596 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.596 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.596 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.596 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:10:33.596 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.596 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.596 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.597 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.597 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:10:33.597 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.597 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.597 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.597 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.597 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:10:33.597 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:10:33.597 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.597 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.597 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:10:33.597 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.597 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.597 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.597 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:10:33.597 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:10:33.597 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.597 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.597 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.597 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.597 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:10:33.597 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.597 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.597 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.597 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.598 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:10:33.598 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.598 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.598 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.598 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.598 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:10:33.598 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:10:33.598 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.598 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.598 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:10:33.598 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.598 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.598 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.598 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.598 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:10:33.598 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:10:33.598 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.598 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:33.598 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:33.598 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:33.598 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.598 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:33.598 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:10:33.598 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.598 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:33.598 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:33.599 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:33.599 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.599 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:33.599 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:10:33.599 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.599 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:33.599 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:33.599 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:10:33.599 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.599 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:33.599 INFO:teuthology.orchestra.run.trial048.stdout: "mgr": [ 2026-02-12T18:10:33.599 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.599 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:33.599 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:33.599 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:33.599 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.599 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.599 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.599 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:10:33.599 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:10:33.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.575+0000 7fbeb32cc640 1 -- 10.20.193.48:0/711688017 >> v2:10.20.193.111:6812/977811348 conn(0x7fbe7c03f800 msgr2=0x7fbe7c05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.575+0000 7fbeb32cc640 1 --2- 10.20.193.48:0/711688017 >> v2:10.20.193.111:6812/977811348 conn(0x7fbe7c03f800 0x7fbe7c05fcb0 secure :-1 s=READY pgs=300 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbea8005820 tx=0x7fbea8009040 comp rx=0 tx=0).stop 2026-02-12T18:10:33.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.575+0000 7fbeb32cc640 10 monclient: shutdown 2026-02-12T18:10:33.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.575+0000 7fbeb32cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:33.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.575+0000 7fbeb32cc640 1 -- 10.20.193.48:0/711688017 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbeac05de60 msgr2=0x7fbeac08a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.575+0000 7fbeb32cc640 1 --2- 10.20.193.48:0/711688017 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbeac05de60 0x7fbeac08a680 secure :-1 s=READY pgs=366 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbea000c480 tx=0x7fbea000c950 comp rx=0 tx=0).stop 2026-02-12T18:10:33.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.575+0000 7fbeb1842640 1 -- 10.20.193.48:0/711688017 reap_dead start 2026-02-12T18:10:33.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.575+0000 7fbeb32cc640 1 -- 10.20.193.48:0/711688017 shutdown_connections 2026-02-12T18:10:33.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.575+0000 7fbeb32cc640 1 --2- 10.20.193.48:0/711688017 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbeac05de60 0x7fbeac08a680 unknown :-1 s=CLOSED pgs=366 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.575+0000 7fbeb32cc640 1 -- 10.20.193.48:0/711688017 >> 10.20.193.48:0/711688017 conn(0x7fbeac0546a0 msgr2=0x7fbeac13d190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:33.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.575+0000 7fbeb32cc640 1 -- 10.20.193.48:0/711688017 shutdown_connections 2026-02-12T18:10:33.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.575+0000 7fbeb32cc640 1 -- 10.20.193.48:0/711688017 wait complete. 2026-02-12T18:10:33.601 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:10:33.601 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2026-02-12T18:10:33.601 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T18:10:33.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.666+0000 7fdf0c01b640 10 monclient: get_monmap_and_config 2026-02-12T18:10:33.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.666+0000 7fdf0c01b640 10 monclient: build_initial_monmap 2026-02-12T18:10:33.667 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.666+0000 7fdf0c01b640 10 monclient: monmap: 2026-02-12T18:10:33.668 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:33.668 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.668 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:10:33.667379+0000 2026-02-12T18:10:33.668 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:10:33.667379+0000 2026-02-12T18:10:33.668 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:33.668 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.668 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:10:33.668 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:10:33.668 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:33.668 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:33.668 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:33.668 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:33.668 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:33.668 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:33.668 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:33.668 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:10:33.668 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:10:33.668 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.666+0000 7fdf0c01b640 1 Processor -- start 2026-02-12T18:10:33.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.666+0000 7fdf0c01b640 1 -- start start 2026-02-12T18:10:33.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.666+0000 7fdf0c01b640 10 monclient: init 2026-02-12T18:10:33.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0c01b640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:33.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0c01b640 10 monclient: _add_conns ranks=[0,2,9,5,4,7,6,10,8,1,3] 2026-02-12T18:10:33.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0c01b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdf0405c950 addr v1:10.20.193.48:6789/0 2026-02-12T18:10:33.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0c01b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fdf0405e490 0x7fdf041857b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0c01b640 10 monclient(hunting): picked mon.noname-b con 0x7fdf0405e490 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:10:33.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0c01b640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fdf0405d430 0x7fdf041a5d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0c01b640 10 monclient(hunting): picked mon.noname-a con 0x7fdf0405d430 addr v2:10.20.193.48:3300/0 2026-02-12T18:10:33.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0c01b640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf0404dc20 con 0x7fdf0405c950 2026-02-12T18:10:33.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0c01b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0c01b640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7fdf0405ddd0 con 0x7fdf0405d430 2026-02-12T18:10:33.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0c01b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0c01b640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fdf04092990 con 0x7fdf0405e490 2026-02-12T18:10:33.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0c01b640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:33.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0c01b640 10 monclient(hunting): authenticate will time out at 872.393099s 2026-02-12T18:10:33.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf09d90640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7fdf0405c950 0x7fdf0405cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:56764/0 (socket says 10.20.193.48:56764) 2026-02-12T18:10:33.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf09d90640 1 -- 10.20.193.48:0/1304281439 learned_addr learned my addr 10.20.193.48:0/1304281439 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:10:33.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0a591640 1 --2- 10.20.193.48:0/1304281439 >> v2:10.20.193.48:3300/0 conn(0x7fdf0405d430 0x7fdf041a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0a591640 10 monclient(hunting): get_auth_request con 0x7fdf0405d430 auth_method 0 2026-02-12T18:10:33.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0a591640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0a591640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0a591640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0958f640 1 --2- 10.20.193.48:0/1304281439 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fdf0405e490 0x7fdf041857b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0958f640 10 monclient(hunting): get_auth_request con 0x7fdf0405e490 auth_method 0 2026-02-12T18:10:33.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0958f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0958f640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0958f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0a591640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0a591640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0a591640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0958f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0958f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0958f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0a591640 10 monclient(hunting): handle_auth_done global_id 5949 payload 274 2026-02-12T18:10:33.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0a591640 1 -- 10.20.193.48:0/1304281439 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fdf0405e490 msgr2=0x7fdf041857b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:33.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0a591640 1 --2- 10.20.193.48:0/1304281439 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fdf0405e490 0x7fdf041857b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0a591640 1 -- 10.20.193.48:0/1304281439 >> v1:10.20.193.48:6789/0 conn(0x7fdf0405c950 legacy=0x7fdf0405cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:33.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0a591640 10 monclient: _finish_hunting 0 2026-02-12T18:10:33.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0a591640 1 monclient: found mon.noname-a 2026-02-12T18:10:33.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0a591640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:33.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0a591640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:10:33.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.667+0000 7fdf0a591640 1 -- 10.20.193.48:0/1304281439 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf04092c70 con 0x7fdf0405d430 2026-02-12T18:10:33.674 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf0a591640 1 -- 10.20.193.48:0/1304281439 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fdf0405d430 msgr2=0x7fdf041a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:33.674 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf0a591640 1 --2- 10.20.193.48:0/1304281439 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fdf0405d430 0x7fdf041a5d00 secure :-1 s=READY pgs=368 gs=3 cs=0 l=1 c_cookie=14239356135013451852 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf00005820 tx=0x7fdf0002fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c59c5af621c1884c server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:33.674 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf08d8e640 1 -- 10.20.193.48:0/1304281439 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fdf00036340 con 0x7fdf0405d430 2026-02-12T18:10:33.674 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf08d8e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.674 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf08d8e640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:10:33.674 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf08d8e640 10 monclient: dump: 2026-02-12T18:10:33.675 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.675 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.675 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.675 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.675 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.675 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.675 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.675 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.675 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.675 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.675 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.675 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.675 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.675 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.675 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.675 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.675 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf08d8e640 10 monclient: _finish_auth 0 2026-02-12T18:10:33.675 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf08d8e640 10 monclient: _check_auth_tickets 2026-02-12T18:10:33.675 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf08d8e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:33.675 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf0c01b640 5 monclient: authenticate success, global_id 5949 2026-02-12T18:10:33.675 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf08d8e640 1 -- 10.20.193.48:0/1304281439 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf000364c0 con 0x7fdf0405d430 2026-02-12T18:10:33.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf0c01b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:10:33.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf08d8e640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:33.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf0c01b640 10 monclient: get_monmap_and_config success 2026-02-12T18:10:33.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf08d8e640 1 -- 10.20.193.48:0/1304281439 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fdf00036af0 con 0x7fdf0405d430 2026-02-12T18:10:33.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf0c01b640 4 set_mon_vals no callback set 2026-02-12T18:10:33.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf08d8e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf08d8e640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:10:33.676 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf08d8e640 10 monclient: dump: 2026-02-12T18:10:33.676 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.676 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.676 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.676 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.676 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.676 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.676 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.676 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.676 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.676 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.676 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.676 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.676 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.676 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.676 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.677 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf0c01b640 10 monclient: shutdown 2026-02-12T18:10:33.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf0c01b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:33.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf0c01b640 1 -- 10.20.193.48:0/1304281439 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fdf0405d430 msgr2=0x7fdf041a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf0c01b640 1 --2- 10.20.193.48:0/1304281439 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fdf0405d430 0x7fdf041a5d00 secure :-1 s=READY pgs=368 gs=3 cs=0 l=1 c_cookie=14239356135013451852 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf00005820 tx=0x7fdf0002fdf0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf0c01b640 1 -- 10.20.193.48:0/1304281439 shutdown_connections 2026-02-12T18:10:33.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf0c01b640 1 --2- 10.20.193.48:0/1304281439 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fdf0405d430 0x7fdf041a5d00 unknown :-1 s=CLOSED pgs=368 gs=3 cs=0 l=1 c_cookie=14239356135013451852 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf0c01b640 1 --2- 10.20.193.48:0/1304281439 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fdf0405e490 0x7fdf041857b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf0c01b640 1 -- 10.20.193.48:0/1304281439 >> 10.20.193.48:0/1304281439 conn(0x7fdf040548a0 msgr2=0x7fdf04097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:33.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf0c01b640 1 -- 10.20.193.48:0/1304281439 shutdown_connections 2026-02-12T18:10:33.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf0c01b640 1 -- 10.20.193.48:0/1304281439 wait complete. 2026-02-12T18:10:33.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf0c01b640 10 monclient: build_initial_monmap 2026-02-12T18:10:33.677 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.670+0000 7fdf0c01b640 10 monclient: monmap: 2026-02-12T18:10:33.677 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:33.677 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:10:33.677 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:10:33.677 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:10:33.677 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:33.677 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.677 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:10:33.677 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:10:33.677 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:33.677 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:33.678 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:33.678 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:33.678 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:33.678 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:33.678 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:33.678 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0c01b640 1 Processor -- start 2026-02-12T18:10:33.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0c01b640 1 -- start start 2026-02-12T18:10:33.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0c01b640 10 monclient: init 2026-02-12T18:10:33.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0c01b640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:33.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0c01b640 10 monclient: _add_conns ranks=[7,3,8,6,2,0,1,5,4] 2026-02-12T18:10:33.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0c01b640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fdf0405c950 0x7fdf0412d950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0c01b640 10 monclient(hunting): picked mon.noname-i con 0x7fdf0405c950 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:10:33.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0c01b640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fdf0405d430 0x7fdf0408d540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0c01b640 10 monclient(hunting): picked mon.noname-g con 0x7fdf0405d430 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:10:33.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0c01b640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdf0405e490 0x7fdf041a55b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0c01b640 10 monclient(hunting): picked mon.noname-e con 0x7fdf0405e490 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:10:33.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0c01b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0c01b640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fdf04141950 con 0x7fdf0405d430 2026-02-12T18:10:33.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0c01b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0c01b640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fdf0408bae0 con 0x7fdf0405c950 2026-02-12T18:10:33.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0c01b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.678 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0c01b640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fdf0408c010 con 0x7fdf0405e490 2026-02-12T18:10:33.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0c01b640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:33.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0c01b640 10 monclient(hunting): authenticate will time out at 872.397436s 2026-02-12T18:10:33.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0a591640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdf0405e490 0x7fdf041a55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0a591640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdf0405e490 0x7fdf041a55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:57012/0 (socket says 10.20.193.48:57012) 2026-02-12T18:10:33.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0a591640 1 -- 10.20.193.48:0/4010200848 learned_addr learned my addr 10.20.193.48:0/4010200848 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:33.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0a591640 10 monclient(hunting): get_auth_request con 0x7fdf0405e490 auth_method 0 2026-02-12T18:10:33.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0a591640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0a591640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0a591640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0a591640 1 -- 10.20.193.48:0/4010200848 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdf0405e490 msgr2=0x7fdf041a55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-12T18:10:33.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0a591640 1 -- 10.20.193.48:0/4010200848 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdf0405e490 msgr2=0x7fdf041a55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:10:33.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0a591640 1 --2- 10.20.193.48:0/4010200848 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdf0405e490 0x7fdf041a55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:33.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0a591640 1 --2- 10.20.193.48:0/4010200848 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdf0405e490 0x7fdf041a55b0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:33.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0958f640 1 --2- 10.20.193.48:0/4010200848 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fdf0405d430 0x7fdf0408d540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf09d90640 1 --2- 10.20.193.48:0/4010200848 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fdf0405c950 0x7fdf0412d950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf09d90640 10 monclient(hunting): get_auth_request con 0x7fdf0405c950 auth_method 0 2026-02-12T18:10:33.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf09d90640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf09d90640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf09d90640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0958f640 10 monclient(hunting): get_auth_request con 0x7fdf0405d430 auth_method 0 2026-02-12T18:10:33.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0958f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0958f640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.679 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0958f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf09d90640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf09d90640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf09d90640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0958f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0958f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0958f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.671+0000 7fdf0958f640 10 monclient(hunting): handle_auth_done global_id 64200 payload 824 2026-02-12T18:10:33.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.672+0000 7fdf0958f640 1 -- 10.20.193.48:0/4010200848 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdf0405e490 msgr2=0x7fdf041a55b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:10:33.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.672+0000 7fdf0958f640 1 --2- 10.20.193.48:0/4010200848 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdf0405e490 0x7fdf041a55b0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.672+0000 7fdf0958f640 1 -- 10.20.193.48:0/4010200848 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fdf0405c950 msgr2=0x7fdf0412d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.672+0000 7fdf0958f640 1 --2- 10.20.193.48:0/4010200848 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fdf0405c950 0x7fdf0412d950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.672+0000 7fdf0958f640 10 monclient: _finish_hunting 0 2026-02-12T18:10:33.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.672+0000 7fdf0958f640 1 monclient: found mon.noname-g 2026-02-12T18:10:33.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.672+0000 7fdf0958f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:33.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.672+0000 7fdf0958f640 10 monclient: _send_mon_message to mon.noname-g at v2:10.20.193.111:3301/0 2026-02-12T18:10:33.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.672+0000 7fdf0958f640 1 -- 10.20.193.48:0/4010200848 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf0000a500 con 0x7fdf0405d430 2026-02-12T18:10:33.683 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.674+0000 7fdf0958f640 1 -- 10.20.193.48:0/4010200848 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fdf0405d430 msgr2=0x7fdf0408d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:33.683 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.674+0000 7fdf0958f640 1 --2- 10.20.193.48:0/4010200848 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fdf0405d430 0x7fdf0408d540 secure :-1 s=READY pgs=16 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdef8004740 tx=0x7fdef800ec60 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:33.683 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.674+0000 7fdef27fc640 1 -- 10.20.193.48:0/4010200848 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fdef80044f0 con 0x7fdf0405d430 2026-02-12T18:10:33.683 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.674+0000 7fdef27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.683 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.674+0000 7fdef27fc640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2026-02-12T18:10:33.683 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.674+0000 7fdef27fc640 10 monclient: dump: 2026-02-12T18:10:33.683 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.683 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.683 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.683 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.683 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.683 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.683 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.683 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.683 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.684 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.684 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.684 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.684 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.684 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.684 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.684 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.674+0000 7fdef27fc640 10 monclient: _finish_auth 0 2026-02-12T18:10:33.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.674+0000 7fdef27fc640 10 monclient: _check_auth_tickets 2026-02-12T18:10:33.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.674+0000 7fdef27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:33.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.674+0000 7fdf0c01b640 5 monclient: authenticate success, global_id 64200 2026-02-12T18:10:33.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.674+0000 7fdf0c01b640 10 monclient: _renew_subs 2026-02-12T18:10:33.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.674+0000 7fdf0c01b640 10 monclient: _send_mon_message to mon.g at v2:10.20.193.111:3301/0 2026-02-12T18:10:33.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.674+0000 7fdf0c01b640 1 -- 10.20.193.48:0/4010200848 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf0408ac50 con 0x7fdf0405d430 2026-02-12T18:10:33.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.674+0000 7fdef27fc640 1 -- 10.20.193.48:0/4010200848 <== mon.3 v2:10.20.193.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdef800cb50 con 0x7fdf0405d430 2026-02-12T18:10:33.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.674+0000 7fdef27fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:33.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.674+0000 7fdef27fc640 1 -- 10.20.193.48:0/4010200848 <== mon.3 v2:10.20.193.111:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fdef800ccc0 con 0x7fdf0405d430 2026-02-12T18:10:33.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.674+0000 7fdef27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.674+0000 7fdef27fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:10:33.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.674+0000 7fdef3fff640 4 set_mon_vals no callback set 2026-02-12T18:10:33.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.674+0000 7fdef27fc640 10 monclient: dump: 2026-02-12T18:10:33.684 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.684 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.685 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.685 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.685 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.685 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.685 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.685 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.685 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.685 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.685 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.685 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.685 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.685 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.685 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.685 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.674+0000 7fdf0c01b640 10 monclient: _renew_subs 2026-02-12T18:10:33.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.674+0000 7fdf0c01b640 10 monclient: _send_mon_message to mon.g at v2:10.20.193.111:3301/0 2026-02-12T18:10:33.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.674+0000 7fdf0c01b640 1 -- 10.20.193.48:0/4010200848 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf0408a990 con 0x7fdf0405d430 2026-02-12T18:10:33.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.675+0000 7fdf0c01b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:33.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.675+0000 7fdf0c01b640 1 --2- 10.20.193.48:0/4010200848 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdf041a5af0 0x7fdf0413dd80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.675+0000 7fdf0c01b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.675+0000 7fdf0c01b640 1 -- 10.20.193.48:0/4010200848 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fdf0405f140 con 0x7fdf041a5af0 2026-02-12T18:10:33.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.675+0000 7fdf09d90640 1 --2- 10.20.193.48:0/4010200848 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdf041a5af0 0x7fdf0413dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.675+0000 7fdf09d90640 10 monclient: get_auth_request con 0x7fdf041a5af0 auth_method 0 2026-02-12T18:10:33.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.675+0000 7fdf09d90640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.675+0000 7fdf09d90640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.675+0000 7fdf09d90640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.675+0000 7fdf09d90640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.675+0000 7fdf09d90640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.675+0000 7fdf09d90640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.675+0000 7fdef27fc640 1 -- 10.20.193.48:0/4010200848 <== mon.3 v2:10.20.193.111:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fdef8011070 con 0x7fdf0405d430 2026-02-12T18:10:33.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.675+0000 7fdf09d90640 10 monclient(hunting): handle_auth_done global_id 64264 payload 824 2026-02-12T18:10:33.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.675+0000 7fdf09d90640 1 -- 10.20.193.48:0/4010200848 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf0408bc50 con 0x7fdf041a5af0 2026-02-12T18:10:33.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.675+0000 7fdef27fc640 1 --2- 10.20.193.48:0/4010200848 >> v2:10.20.193.111:6812/977811348 conn(0x7fded403f7f0 0x7fded405fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.675+0000 7fdef27fc640 1 -- 10.20.193.48:0/4010200848 <== mon.3 v2:10.20.193.111:3301/0 5 ==== osd_map(214..214 src has 1..214) ==== 3897+0+0 (secure 0 0 0) 0x7fdef8052c30 con 0x7fdf0405d430 2026-02-12T18:10:33.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.675+0000 7fdf0a591640 1 --2- 10.20.193.48:0/4010200848 >> v2:10.20.193.111:6812/977811348 conn(0x7fded403f7f0 0x7fded405fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.675+0000 7fdf0a591640 10 monclient: get_auth_request con 0x7fded403f7f0 auth_method 0 2026-02-12T18:10:33.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.677+0000 7fdf09d90640 1 -- 10.20.193.48:0/4010200848 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdf041a5af0 msgr2=0x7fdf0413dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:33.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.677+0000 7fdf09d90640 1 --2- 10.20.193.48:0/4010200848 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdf041a5af0 0x7fdf0413dd80 secure :-1 s=READY pgs=25 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdef400cad0 tx=0x7fdef4007860 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:33.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.677+0000 7fdef27fc640 1 -- 10.20.193.48:0/4010200848 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fdef400eca0 con 0x7fdf041a5af0 2026-02-12T18:10:33.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.677+0000 7fdef27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.677+0000 7fdef27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:10:33.686 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.677+0000 7fdef27fc640 10 monclient: dump: 2026-02-12T18:10:33.686 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.686 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.686 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.686 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.687 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.687 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.687 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.687 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.687 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.687 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.687 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.687 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.687 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.687 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.687 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.687 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.687 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.678+0000 7fdef27fc640 1 -- 10.20.193.48:0/4010200848 <== mon.4 v2:10.20.193.48:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fdef400ee00 con 0x7fdf041a5af0 2026-02-12T18:10:33.687 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.678+0000 7fdef27fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:33.687 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.678+0000 7fdef27fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:10:33.687 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.678+0000 7fdef27fc640 1 -- 10.20.193.48:0/4010200848 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdf041a5af0 msgr2=0x7fdf0413dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.687 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.678+0000 7fdef27fc640 1 --2- 10.20.193.48:0/4010200848 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdf041a5af0 0x7fdf0413dd80 secure :-1 s=READY pgs=25 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdef400cad0 tx=0x7fdef4007860 comp rx=0 tx=0).stop 2026-02-12T18:10:33.687 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.678+0000 7fdef27fc640 1 -- 10.20.193.48:0/4010200848 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdf041a5af0 msgr2=0x7fdf0413dd80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:33.687 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.678+0000 7fdef27fc640 1 --2- 10.20.193.48:0/4010200848 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdf041a5af0 0x7fdf0413dd80 secure :-1 s=CLOSED pgs=25 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdef400cad0 tx=0x7fdef4007860 comp rx=0 tx=0).stop 2026-02-12T18:10:33.687 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.678+0000 7fdf0a591640 1 --2- 10.20.193.48:0/4010200848 >> v2:10.20.193.111:6812/977811348 conn(0x7fded403f7f0 0x7fded405fca0 secure :-1 s=READY pgs=301 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf0408a5a0 tx=0x7fdf00034000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:33.687 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.681+0000 7fdf0c01b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:10:33.687 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.681+0000 7fdf0c01b640 1 --2- 10.20.193.48:0/4010200848 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdf041a5ec0 0x7fdf0413e2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.688 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.681+0000 7fdf0c01b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.688 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.681+0000 7fdf0c01b640 1 -- 10.20.193.48:0/4010200848 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fdf0405fd90 con 0x7fdf041a5ec0 2026-02-12T18:10:33.688 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.681+0000 7fdf09d90640 1 --2- 10.20.193.48:0/4010200848 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdf041a5ec0 0x7fdf0413e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.688 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.681+0000 7fdf09d90640 10 monclient: get_auth_request con 0x7fdf041a5ec0 auth_method 0 2026-02-12T18:10:33.688 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.681+0000 7fdf09d90640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.688 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.681+0000 7fdf09d90640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.688 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.681+0000 7fdf09d90640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.688 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.681+0000 7fdf09d90640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.688 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.681+0000 7fdf09d90640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.688 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.681+0000 7fdf09d90640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.688 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.681+0000 7fdf09d90640 10 monclient(hunting): handle_auth_done global_id 64273 payload 824 2026-02-12T18:10:33.688 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.681+0000 7fdf09d90640 1 -- 10.20.193.48:0/4010200848 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdf0405cd20 con 0x7fdf041a5ec0 2026-02-12T18:10:33.689 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.684+0000 7fdf09d90640 1 -- 10.20.193.48:0/4010200848 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdf041a5ec0 msgr2=0x7fdf0413e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:33.689 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.684+0000 7fdf09d90640 1 --2- 10.20.193.48:0/4010200848 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdf041a5ec0 0x7fdf0413e2c0 secure :-1 s=READY pgs=26 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdef4016040 tx=0x7fdef4004a00 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:33.689 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.684+0000 7fdef27fc640 1 -- 10.20.193.48:0/4010200848 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fdef40034f0 con 0x7fdf041a5ec0 2026-02-12T18:10:33.689 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.684+0000 7fdef27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.689 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.684+0000 7fdef27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:10:33.689 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.684+0000 7fdef27fc640 10 monclient: dump: 2026-02-12T18:10:33.689 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.689 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.689 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.689 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.689 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.689 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.689 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.689 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.689 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.689 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.689 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.689 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.690 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.690 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.690 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.690 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.684+0000 7fdef27fc640 1 -- 10.20.193.48:0/4010200848 <== mon.4 v2:10.20.193.48:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7fdef4003030 con 0x7fdf041a5ec0 2026-02-12T18:10:33.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.684+0000 7fdef27fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:10:33.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.684+0000 7fdef27fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:10:33.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.684+0000 7fdef27fc640 1 -- 10.20.193.48:0/4010200848 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdf041a5ec0 msgr2=0x7fdf0413e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.684+0000 7fdef27fc640 1 --2- 10.20.193.48:0/4010200848 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdf041a5ec0 0x7fdf0413e2c0 secure :-1 s=READY pgs=26 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdef4016040 tx=0x7fdef4004a00 comp rx=0 tx=0).stop 2026-02-12T18:10:33.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.684+0000 7fdef27fc640 1 -- 10.20.193.48:0/4010200848 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdf041a5ec0 msgr2=0x7fdf0413e2c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:33.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.684+0000 7fdef27fc640 1 --2- 10.20.193.48:0/4010200848 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fdf041a5ec0 0x7fdf0413e2c0 secure :-1 s=CLOSED pgs=26 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdef4016040 tx=0x7fdef4004a00 comp rx=0 tx=0).stop 2026-02-12T18:10:33.690 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:10:33.690 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:10:33.690 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:10:33.690 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:10:33.690 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 46, 2026-02-12T18:10:33.690 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 14471, 2026-02-12T18:10:33.691 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:10:33.691 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:10:33.691 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:10:33.691 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:10:33.691 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:10:33.691 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:10:33.691 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:10:33.691 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:10:33.691 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:10:33.691 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:10:33.691 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:33.691 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 8, 2026-02-12T18:10:33.691 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:33.691 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:10:33.691 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:10:33.691 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:33.691 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:33.691 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:33.691 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:33.691 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:33.691 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:33.691 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:33.691 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:33.691 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:33.692 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:33.692 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:33.692 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:33.692 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:33.692 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:33.692 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:10:33.692 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:10:33.692 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:33.692 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:33.692 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:33.692 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:33.692 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:33.692 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:33.692 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:33.692 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:33.692 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:33.692 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:33.692 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:33.692 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:33.692 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:33.692 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.692 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.692 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:10:33.693 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:10:33.693 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:10:33.693 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:10:33.693 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:10:33.693 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:10:33.693 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:33.693 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:33.693 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:10:33.693 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:10:33.693 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:10:33.693 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:10:33.693 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:10:33.693 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:10:33.693 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:10:33.693 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:33.693 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:10:33.693 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:33.693 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:33.693 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:33.693 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:33.693 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:33.693 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:33.693 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:33.694 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:33.694 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:33.694 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:33.694 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:33.694 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:33.694 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:33.694 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:33.694 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:10:33.694 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.694 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:10:33.694 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.694 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:10:33.694 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:10:33.694 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.694 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.694 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.694 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.694 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:10:33.694 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.694 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.694 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.694 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.695 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:10:33.695 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.695 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.695 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.695 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.695 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:10:33.695 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:10:33.695 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.695 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.695 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:10:33.695 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.695 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.695 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.695 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:10:33.695 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:10:33.695 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.695 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.695 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.695 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.695 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:10:33.695 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.695 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.695 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.696 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.696 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:10:33.696 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.696 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.696 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.696 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.696 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:10:33.696 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:10:33.696 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.696 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.696 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:10:33.696 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.696 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.696 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.696 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:10:33.696 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:10:33.696 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.696 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.696 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.696 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.696 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:10:33.696 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.696 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.697 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.697 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.697 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:10:33.697 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.697 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.697 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.697 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.697 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:10:33.697 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:10:33.697 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.697 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.697 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:10:33.697 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.697 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.697 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.697 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:10:33.697 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:10:33.697 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.697 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.697 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.697 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.697 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:10:33.697 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.697 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.697 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.698 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.698 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:10:33.698 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.698 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.698 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.698 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.698 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:10:33.698 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:10:33.698 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.698 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.698 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:10:33.698 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.698 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.698 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.698 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:10:33.698 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:10:33.698 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.698 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.698 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.698 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.698 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:10:33.698 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.698 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.698 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.698 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.699 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:10:33.699 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.699 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.699 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.699 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.699 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:10:33.699 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:10:33.699 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.699 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.699 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:33.699 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.699 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.699 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.699 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:10:33.699 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:10:33.699 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.699 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.699 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.699 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.699 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:10:33.699 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.699 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.699 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.699 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.699 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:10:33.700 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.700 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.700 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.700 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.700 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:10:33.700 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:10:33.700 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.700 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.700 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:10:33.700 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.700 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.700 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.700 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:10:33.700 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:10:33.700 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.700 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.700 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.700 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.700 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:10:33.700 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.700 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.700 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.700 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.700 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:10:33.700 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.700 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.701 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.701 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.701 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:10:33.701 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:10:33.701 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.701 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.701 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:33.701 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.701 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.701 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.701 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:10:33.701 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:10:33.701 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.701 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.701 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.701 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.701 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:10:33.701 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.701 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.701 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.701 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.701 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:10:33.701 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.701 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.701 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:10:33.702 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.703 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.703 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:10:33.703 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.703 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.703 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.703 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.703 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:10:33.703 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:10:33.703 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.703 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:33.703 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:33.703 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:33.703 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.703 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:33.703 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:10:33.703 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.703 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:33.703 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:33.703 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:33.703 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.703 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.703 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.703 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:10:33.703 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:10:33.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.684+0000 7fdf0c01b640 1 -- 10.20.193.48:0/4010200848 >> v2:10.20.193.111:6812/977811348 conn(0x7fded403f7f0 msgr2=0x7fded405fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.684+0000 7fdf0c01b640 1 --2- 10.20.193.48:0/4010200848 >> v2:10.20.193.111:6812/977811348 conn(0x7fded403f7f0 0x7fded405fca0 secure :-1 s=READY pgs=301 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdf0408a5a0 tx=0x7fdf00034000 comp rx=0 tx=0).stop 2026-02-12T18:10:33.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.684+0000 7fdf0c01b640 10 monclient: shutdown 2026-02-12T18:10:33.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.684+0000 7fdf0c01b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:33.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.684+0000 7fdf0c01b640 1 -- 10.20.193.48:0/4010200848 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fdf0405d430 msgr2=0x7fdf0408d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.684+0000 7fdf0c01b640 1 --2- 10.20.193.48:0/4010200848 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fdf0405d430 0x7fdf0408d540 secure :-1 s=READY pgs=16 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdef8004740 tx=0x7fdef800ec60 comp rx=0 tx=0).stop 2026-02-12T18:10:33.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.684+0000 7fdf0a591640 1 -- 10.20.193.48:0/4010200848 reap_dead start 2026-02-12T18:10:33.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.684+0000 7fdf0a591640 1 -- 10.20.193.48:0/4010200848 reap_dead start 2026-02-12T18:10:33.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.684+0000 7fdf0c01b640 1 -- 10.20.193.48:0/4010200848 shutdown_connections 2026-02-12T18:10:33.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.684+0000 7fdf0c01b640 1 -- 10.20.193.48:0/4010200848 >> 10.20.193.48:0/4010200848 conn(0x7fdf040548a0 msgr2=0x7fdf0413f120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:33.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.684+0000 7fdf0c01b640 1 -- 10.20.193.48:0/4010200848 shutdown_connections 2026-02-12T18:10:33.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.684+0000 7fdf0c01b640 1 -- 10.20.193.48:0/4010200848 wait complete. 2026-02-12T18:10:33.705 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:10:33.705 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2026-02-12T18:10:33.705 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2026-02-12T18:10:33.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.769+0000 7fd06c70c640 10 monclient: get_monmap_and_config 2026-02-12T18:10:33.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.769+0000 7fd06c70c640 10 monclient: build_initial_monmap 2026-02-12T18:10:33.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.769+0000 7fd06c70c640 10 monclient: monmap: 2026-02-12T18:10:33.771 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:33.771 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.771 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:10:33.771038+0000 2026-02-12T18:10:33.771 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:10:33.771038+0000 2026-02-12T18:10:33.772 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:33.772 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.772 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:10:33.772 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:10:33.772 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:33.772 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:33.772 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:33.772 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:33.772 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:33.772 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:33.772 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:33.772 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:10:33.772 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:10:33.772 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.770+0000 7fd06c70c640 1 Processor -- start 2026-02-12T18:10:33.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.770+0000 7fd06c70c640 1 -- start start 2026-02-12T18:10:33.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.770+0000 7fd06c70c640 10 monclient: init 2026-02-12T18:10:33.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.770+0000 7fd06c70c640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:33.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.770+0000 7fd06c70c640 10 monclient: _add_conns ranks=[0,8,5,7,10,6,4,1,2,9,3] 2026-02-12T18:10:33.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.770+0000 7fd06c70c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd06405c950 addr v1:10.20.193.48:6789/0 2026-02-12T18:10:33.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.770+0000 7fd06c70c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd06405e490 0x7fd0641857b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.770+0000 7fd06c70c640 10 monclient(hunting): picked mon.noname-e con 0x7fd06405e490 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:10:33.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.770+0000 7fd06c70c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd06405d430 0x7fd0641a5d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.770+0000 7fd06c70c640 10 monclient(hunting): picked mon.noname-h con 0x7fd06405d430 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:10:33.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.770+0000 7fd06c70c640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd06404dc20 con 0x7fd06405c950 2026-02-12T18:10:33.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.770+0000 7fd06c70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.770+0000 7fd06c70c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fd06405ddd0 con 0x7fd06405d430 2026-02-12T18:10:33.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.770+0000 7fd06c70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.770+0000 7fd06c70c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fd064092990 con 0x7fd06405e490 2026-02-12T18:10:33.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.770+0000 7fd06c70c640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:33.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.770+0000 7fd06c70c640 10 monclient(hunting): authenticate will time out at 872.496823s 2026-02-12T18:10:33.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.770+0000 7fd06a481640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7fd06405c950 0x7fd06405cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:56778/0 (socket says 10.20.193.48:56778) 2026-02-12T18:10:33.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.770+0000 7fd06a481640 1 -- 10.20.193.48:0/3720429189 learned_addr learned my addr 10.20.193.48:0/3720429189 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:10:33.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.770+0000 7fd069c80640 1 --2- 10.20.193.48:0/3720429189 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd06405e490 0x7fd0641857b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.770+0000 7fd069c80640 10 monclient(hunting): get_auth_request con 0x7fd06405e490 auth_method 0 2026-02-12T18:10:33.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.770+0000 7fd069c80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.770+0000 7fd069c80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.770+0000 7fd069c80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.771+0000 7fd06ac82640 1 --2- 10.20.193.48:0/3720429189 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd06405d430 0x7fd0641a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.771+0000 7fd069c80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.771+0000 7fd069c80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.771+0000 7fd069c80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.771+0000 7fd06ac82640 10 monclient(hunting): get_auth_request con 0x7fd06405d430 auth_method 0 2026-02-12T18:10:33.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.771+0000 7fd06ac82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.771+0000 7fd06ac82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.771+0000 7fd06ac82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.771+0000 7fd06ac82640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.771+0000 7fd06ac82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.771+0000 7fd06ac82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.771+0000 7fd069c80640 10 monclient(hunting): handle_auth_done global_id 64133 payload 274 2026-02-12T18:10:33.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.771+0000 7fd069c80640 1 -- 10.20.193.48:0/3720429189 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd06405d430 msgr2=0x7fd0641a5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:33.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.771+0000 7fd069c80640 1 --2- 10.20.193.48:0/3720429189 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd06405d430 0x7fd0641a5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.771+0000 7fd069c80640 1 -- 10.20.193.48:0/3720429189 >> v1:10.20.193.48:6789/0 conn(0x7fd06405c950 legacy=0x7fd06405cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:33.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.771+0000 7fd069c80640 10 monclient: _finish_hunting 0 2026-02-12T18:10:33.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.771+0000 7fd069c80640 1 monclient: found mon.noname-e 2026-02-12T18:10:33.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.771+0000 7fd069c80640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:33.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.771+0000 7fd069c80640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:10:33.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.771+0000 7fd069c80640 1 -- 10.20.193.48:0/3720429189 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd064092c70 con 0x7fd06405e490 2026-02-12T18:10:33.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.773+0000 7fd069c80640 1 -- 10.20.193.48:0/3720429189 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd06405e490 msgr2=0x7fd0641857b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:33.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.773+0000 7fd069c80640 1 --2- 10.20.193.48:0/3720429189 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd06405e490 0x7fd0641857b0 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=16778100504399072124 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd058009800 tx=0x7fd05802ed50 comp rx=0 tx=0).ready entity=mon.8 client_cookie=e8d7c983ba824b7c server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:33.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.773+0000 7fd06947f640 1 -- 10.20.193.48:0/3720429189 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd05802fe90 con 0x7fd06405e490 2026-02-12T18:10:33.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.773+0000 7fd06947f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.773+0000 7fd06947f640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:10:33.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.773+0000 7fd06947f640 10 monclient: dump: 2026-02-12T18:10:33.782 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.782 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.782 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.782 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.782 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.782 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.782 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.782 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.782 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.782 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.782 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.782 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.782 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.782 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.782 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.782 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.773+0000 7fd06947f640 10 monclient: _finish_auth 0 2026-02-12T18:10:33.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.773+0000 7fd06947f640 10 monclient: _check_auth_tickets 2026-02-12T18:10:33.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.773+0000 7fd06947f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:33.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.773+0000 7fd06947f640 1 -- 10.20.193.48:0/3720429189 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd058035340 con 0x7fd06405e490 2026-02-12T18:10:33.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.773+0000 7fd06947f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:33.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.773+0000 7fd06947f640 1 -- 10.20.193.48:0/3720429189 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd058035970 con 0x7fd06405e490 2026-02-12T18:10:33.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.773+0000 7fd06c70c640 5 monclient: authenticate success, global_id 64133 2026-02-12T18:10:33.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.773+0000 7fd06c70c640 10 monclient: get_monmap_and_config success 2026-02-12T18:10:33.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.773+0000 7fd06c70c640 4 set_mon_vals no callback set 2026-02-12T18:10:33.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.773+0000 7fd06947f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.773+0000 7fd06947f640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:10:33.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.773+0000 7fd06947f640 10 monclient: dump: 2026-02-12T18:10:33.783 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.783 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.783 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.783 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.783 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.783 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.783 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.783 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.783 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.783 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.783 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.784 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.784 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.784 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.784 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.784 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.774+0000 7fd06c70c640 10 monclient: shutdown 2026-02-12T18:10:33.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.774+0000 7fd06c70c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:33.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.774+0000 7fd06c70c640 1 -- 10.20.193.48:0/3720429189 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd06405e490 msgr2=0x7fd0641857b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.774+0000 7fd06c70c640 1 --2- 10.20.193.48:0/3720429189 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd06405e490 0x7fd0641857b0 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=16778100504399072124 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd058009800 tx=0x7fd05802ed50 comp rx=0 tx=0).stop 2026-02-12T18:10:33.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.774+0000 7fd06c70c640 1 -- 10.20.193.48:0/3720429189 shutdown_connections 2026-02-12T18:10:33.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.774+0000 7fd06c70c640 1 --2- 10.20.193.48:0/3720429189 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd06405d430 0x7fd0641a5d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.774+0000 7fd06c70c640 1 --2- 10.20.193.48:0/3720429189 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd06405e490 0x7fd0641857b0 unknown :-1 s=CLOSED pgs=18 gs=2 cs=0 l=1 c_cookie=16778100504399072124 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.774+0000 7fd06c70c640 1 -- 10.20.193.48:0/3720429189 >> 10.20.193.48:0/3720429189 conn(0x7fd0640548a0 msgr2=0x7fd064097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:33.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.774+0000 7fd06c70c640 1 -- 10.20.193.48:0/3720429189 shutdown_connections 2026-02-12T18:10:33.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.774+0000 7fd06c70c640 1 -- 10.20.193.48:0/3720429189 wait complete. 2026-02-12T18:10:33.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.774+0000 7fd06c70c640 10 monclient: build_initial_monmap 2026-02-12T18:10:33.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.774+0000 7fd06c70c640 10 monclient: monmap: 2026-02-12T18:10:33.784 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:33.784 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:10:33.784 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:10:33.785 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:10:33.785 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:33.785 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.785 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:10:33.785 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:10:33.785 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:33.785 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:33.785 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:33.785 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:33.785 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:33.785 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:33.785 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:33.785 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.774+0000 7fd06c70c640 1 Processor -- start 2026-02-12T18:10:33.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.774+0000 7fd06c70c640 1 -- start start 2026-02-12T18:10:33.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.774+0000 7fd06c70c640 10 monclient: init 2026-02-12T18:10:33.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06c70c640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:33.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06c70c640 10 monclient: _add_conns ranks=[6,0,2,7,4,1,5,8,3] 2026-02-12T18:10:33.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06c70c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd06405c950 0x7fd06412da00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06c70c640 10 monclient(hunting): picked mon.noname-d con 0x7fd06405c950 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:10:33.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06c70c640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd06405d430 0x7fd06408d500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06c70c640 10 monclient(hunting): picked mon.noname-a con 0x7fd06405d430 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:10:33.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06c70c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd06405e490 0x7fd0641a55b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06c70c640 10 monclient(hunting): picked mon.noname-b con 0x7fd06405e490 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:10:33.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06c70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06c70c640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fd06408ba10 con 0x7fd06405d430 2026-02-12T18:10:33.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06c70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06c70c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fd06408ab80 con 0x7fd06405e490 2026-02-12T18:10:33.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06c70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06c70c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fd064141960 con 0x7fd06405c950 2026-02-12T18:10:33.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06c70c640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:33.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06c70c640 10 monclient(hunting): authenticate will time out at 872.501189s 2026-02-12T18:10:33.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd069c80640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd06405d430 0x7fd06408d500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06ac82640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd06405e490 0x7fd0641a55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06a481640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd06405c950 0x7fd06412da00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd069c80640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd06405d430 0x7fd06408d500 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:58188/0 (socket says 10.20.193.48:58188) 2026-02-12T18:10:33.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd069c80640 1 -- 10.20.193.48:0/605067542 learned_addr learned my addr 10.20.193.48:0/605067542 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:33.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd069c80640 10 monclient(hunting): get_auth_request con 0x7fd06405d430 auth_method 0 2026-02-12T18:10:33.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd069c80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd069c80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd069c80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06ac82640 10 monclient(hunting): get_auth_request con 0x7fd06405e490 auth_method 0 2026-02-12T18:10:33.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06ac82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06ac82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06ac82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06a481640 10 monclient(hunting): get_auth_request con 0x7fd06405c950 auth_method 0 2026-02-12T18:10:33.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06a481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06a481640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06a481640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06ac82640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06ac82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06ac82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd069c80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd069c80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd069c80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06a481640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06a481640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06a481640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06ac82640 10 monclient(hunting): handle_auth_done global_id 35723 payload 824 2026-02-12T18:10:33.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06ac82640 1 -- 10.20.193.48:0/605067542 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd06405c950 msgr2=0x7fd06412da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06ac82640 1 --2- 10.20.193.48:0/605067542 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd06405c950 0x7fd06412da00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06ac82640 1 -- 10.20.193.48:0/605067542 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd06405d430 msgr2=0x7fd06408d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06ac82640 1 --2- 10.20.193.48:0/605067542 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd06405d430 0x7fd06408d500 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06ac82640 10 monclient: _finish_hunting 0 2026-02-12T18:10:33.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06ac82640 1 monclient: found mon.noname-b 2026-02-12T18:10:33.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06ac82640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:33.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06ac82640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:10:33.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.775+0000 7fd06ac82640 1 -- 10.20.193.48:0/605067542 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd058009420 con 0x7fd06405e490 2026-02-12T18:10:33.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.777+0000 7fd06ac82640 1 -- 10.20.193.48:0/605067542 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd06405e490 msgr2=0x7fd0641a55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:33.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.777+0000 7fd06ac82640 1 --2- 10.20.193.48:0/605067542 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd06405e490 0x7fd0641a55b0 secure :-1 s=READY pgs=222 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd06000afd0 tx=0x7fd06000fcd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:33.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.777+0000 7fd04affd640 1 -- 10.20.193.48:0/605067542 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd06000db50 con 0x7fd06405e490 2026-02-12T18:10:33.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.777+0000 7fd04affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.777+0000 7fd04affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:10:33.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.777+0000 7fd04affd640 10 monclient: dump: 2026-02-12T18:10:33.788 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.788 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.788 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.788 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.788 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.788 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.789 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.789 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.789 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.789 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.789 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.789 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.789 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.789 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.789 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.789 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.777+0000 7fd04affd640 10 monclient: _finish_auth 0 2026-02-12T18:10:33.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.777+0000 7fd04affd640 10 monclient: _check_auth_tickets 2026-02-12T18:10:33.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.777+0000 7fd04affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:33.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.777+0000 7fd04affd640 1 -- 10.20.193.48:0/605067542 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd06000dcd0 con 0x7fd06405e490 2026-02-12T18:10:33.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.777+0000 7fd06c70c640 5 monclient: authenticate success, global_id 35723 2026-02-12T18:10:33.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.777+0000 7fd06c70c640 10 monclient: _renew_subs 2026-02-12T18:10:33.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.777+0000 7fd06c70c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:10:33.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.777+0000 7fd06c70c640 1 -- 10.20.193.48:0/605067542 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd06408b730 con 0x7fd06405e490 2026-02-12T18:10:33.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.777+0000 7fd04affd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:33.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.777+0000 7fd04affd640 1 -- 10.20.193.48:0/605067542 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd06000de40 con 0x7fd06405e490 2026-02-12T18:10:33.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.777+0000 7fd04affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.777+0000 7fd068c7e640 4 set_mon_vals no callback set 2026-02-12T18:10:33.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.777+0000 7fd04affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:10:33.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.777+0000 7fd04affd640 10 monclient: dump: 2026-02-12T18:10:33.790 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.790 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.790 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.790 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.790 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.790 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.790 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.790 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.790 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.790 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.790 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.790 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.790 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.790 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.790 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.790 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.777+0000 7fd06c70c640 10 monclient: _renew_subs 2026-02-12T18:10:33.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.777+0000 7fd06c70c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:10:33.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.777+0000 7fd06c70c640 1 -- 10.20.193.48:0/605067542 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd06412e460 con 0x7fd06405e490 2026-02-12T18:10:33.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.778+0000 7fd06c70c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:33.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.778+0000 7fd06c70c640 1 --2- 10.20.193.48:0/605067542 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd0641a5af0 0x7fd06413de30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.778+0000 7fd06c70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.778+0000 7fd06c70c640 1 -- 10.20.193.48:0/605067542 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fd064063180 con 0x7fd0641a5af0 2026-02-12T18:10:33.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.778+0000 7fd06a481640 1 --2- 10.20.193.48:0/605067542 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd0641a5af0 0x7fd06413de30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.778+0000 7fd06a481640 10 monclient: get_auth_request con 0x7fd0641a5af0 auth_method 0 2026-02-12T18:10:33.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.778+0000 7fd06a481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.778+0000 7fd06a481640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.778+0000 7fd06a481640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.778+0000 7fd06a481640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.778+0000 7fd06a481640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.778+0000 7fd06a481640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.778+0000 7fd04affd640 1 -- 10.20.193.48:0/605067542 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fd060023020 con 0x7fd06405e490 2026-02-12T18:10:33.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.778+0000 7fd06a481640 10 monclient(hunting): handle_auth_done global_id 5604 payload 824 2026-02-12T18:10:33.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.778+0000 7fd06a481640 1 -- 10.20.193.48:0/605067542 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd06405cd20 con 0x7fd0641a5af0 2026-02-12T18:10:33.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.778+0000 7fd04affd640 1 --2- 10.20.193.48:0/605067542 >> v2:10.20.193.111:6812/977811348 conn(0x7fd03403f800 0x7fd03405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.778+0000 7fd04affd640 1 -- 10.20.193.48:0/605067542 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(214..214 src has 1..214) ==== 3897+0+0 (secure 0 0 0) 0x7fd060053e80 con 0x7fd06405e490 2026-02-12T18:10:33.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.779+0000 7fd069c80640 1 --2- 10.20.193.48:0/605067542 >> v2:10.20.193.111:6812/977811348 conn(0x7fd03403f800 0x7fd03405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.779+0000 7fd069c80640 10 monclient: get_auth_request con 0x7fd03403f800 auth_method 0 2026-02-12T18:10:33.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.780+0000 7fd06a481640 1 -- 10.20.193.48:0/605067542 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd0641a5af0 msgr2=0x7fd06413de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:33.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.780+0000 7fd06a481640 1 --2- 10.20.193.48:0/605067542 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd0641a5af0 0x7fd06413de30 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd05400cad0 tx=0x7fd054007860 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:33.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.780+0000 7fd04affd640 1 -- 10.20.193.48:0/605067542 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd05400eca0 con 0x7fd0641a5af0 2026-02-12T18:10:33.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.780+0000 7fd04affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.780+0000 7fd04affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:10:33.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.780+0000 7fd04affd640 10 monclient: dump: 2026-02-12T18:10:33.794 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.794 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.794 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.794 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.794 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.794 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.794 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.794 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.794 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.794 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.795 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.795 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.795 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.795 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.795 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.795 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.781+0000 7fd04affd640 1 -- 10.20.193.48:0/605067542 <== mon.6 v2:10.20.193.48:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fd05400ee00 con 0x7fd0641a5af0 2026-02-12T18:10:33.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.781+0000 7fd04affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:33.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.781+0000 7fd04affd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:10:33.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.781+0000 7fd04affd640 1 -- 10.20.193.48:0/605067542 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd0641a5af0 msgr2=0x7fd06413de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.781+0000 7fd04affd640 1 --2- 10.20.193.48:0/605067542 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd0641a5af0 0x7fd06413de30 secure :-1 s=READY pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd05400cad0 tx=0x7fd054007860 comp rx=0 tx=0).stop 2026-02-12T18:10:33.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.781+0000 7fd04affd640 1 -- 10.20.193.48:0/605067542 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd0641a5af0 msgr2=0x7fd06413de30 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:33.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.781+0000 7fd04affd640 1 --2- 10.20.193.48:0/605067542 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd0641a5af0 0x7fd06413de30 secure :-1 s=CLOSED pgs=195 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd05400cad0 tx=0x7fd054007860 comp rx=0 tx=0).stop 2026-02-12T18:10:33.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.781+0000 7fd069c80640 1 --2- 10.20.193.48:0/605067542 >> v2:10.20.193.111:6812/977811348 conn(0x7fd03403f800 0x7fd03405fcb0 secure :-1 s=READY pgs=302 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0580023d0 tx=0x7fd058039040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:33.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.784+0000 7fd06c70c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:10:33.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.784+0000 7fd06c70c640 1 --2- 10.20.193.48:0/605067542 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd0641a5ec0 0x7fd06413e370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.784+0000 7fd06c70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.784+0000 7fd06c70c640 1 -- 10.20.193.48:0/605067542 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fd06405f140 con 0x7fd0641a5ec0 2026-02-12T18:10:33.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.784+0000 7fd06a481640 1 --2- 10.20.193.48:0/605067542 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd0641a5ec0 0x7fd06413e370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.784+0000 7fd06a481640 10 monclient: get_auth_request con 0x7fd0641a5ec0 auth_method 0 2026-02-12T18:10:33.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.784+0000 7fd06a481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.784+0000 7fd06a481640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.784+0000 7fd06a481640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.785+0000 7fd06a481640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.785+0000 7fd06a481640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.785+0000 7fd06a481640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.785+0000 7fd06a481640 10 monclient(hunting): handle_auth_done global_id 5613 payload 824 2026-02-12T18:10:33.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.785+0000 7fd06a481640 1 -- 10.20.193.48:0/605067542 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd06408bdf0 con 0x7fd0641a5ec0 2026-02-12T18:10:33.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.787+0000 7fd06a481640 1 -- 10.20.193.48:0/605067542 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd0641a5ec0 msgr2=0x7fd06413e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:33.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.787+0000 7fd06a481640 1 --2- 10.20.193.48:0/605067542 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd0641a5ec0 0x7fd06413e370 secure :-1 s=READY pgs=196 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd05400cad0 tx=0x7fd054004a00 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:33.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.787+0000 7fd04affd640 1 -- 10.20.193.48:0/605067542 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd05401e320 con 0x7fd0641a5ec0 2026-02-12T18:10:33.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.787+0000 7fd04affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.787+0000 7fd04affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:10:33.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.787+0000 7fd04affd640 10 monclient: dump: 2026-02-12T18:10:33.796 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.796 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.796 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.796 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.796 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.797 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.797 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.797 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.797 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.797 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.797 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.797 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.797 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.797 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.797 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.797 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.787+0000 7fd04affd640 1 -- 10.20.193.48:0/605067542 <== mon.6 v2:10.20.193.48:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10015 (secure 0 0 0) 0x7fd054014990 con 0x7fd0641a5ec0 2026-02-12T18:10:33.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.787+0000 7fd04affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:10:33.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.787+0000 7fd04affd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:10:33.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.787+0000 7fd04affd640 1 -- 10.20.193.48:0/605067542 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd0641a5ec0 msgr2=0x7fd06413e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.787+0000 7fd04affd640 1 --2- 10.20.193.48:0/605067542 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd0641a5ec0 0x7fd06413e370 secure :-1 s=READY pgs=196 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd05400cad0 tx=0x7fd054004a00 comp rx=0 tx=0).stop 2026-02-12T18:10:33.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.787+0000 7fd04affd640 1 -- 10.20.193.48:0/605067542 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd0641a5ec0 msgr2=0x7fd06413e370 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:33.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.787+0000 7fd04affd640 1 --2- 10.20.193.48:0/605067542 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd0641a5ec0 0x7fd06413e370 secure :-1 s=CLOSED pgs=196 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd05400cad0 tx=0x7fd054004a00 comp rx=0 tx=0).stop 2026-02-12T18:10:33.798 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:10:33.798 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:10:33.798 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:10:33.798 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:10:33.798 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 46, 2026-02-12T18:10:33.798 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 288614, 2026-02-12T18:10:33.798 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:10:33.798 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:10:33.798 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:10:33.798 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:10:33.798 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:10:33.798 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:10:33.798 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:10:33.798 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:10:33.798 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:10:33.798 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:10:33.799 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:33.799 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 8, 2026-02-12T18:10:33.799 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:33.799 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:10:33.799 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:10:33.799 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:33.799 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:33.799 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:33.799 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:33.799 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:33.799 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:33.799 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:33.799 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:33.799 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:33.799 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:33.799 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:33.799 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:33.799 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:33.799 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:33.799 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:10:33.800 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:10:33.800 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:33.800 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:33.800 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:33.800 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:33.800 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:33.800 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:33.800 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:33.800 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:33.800 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:33.800 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:33.800 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:33.800 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:33.800 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:33.800 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.800 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.800 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:10:33.800 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:10:33.800 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:10:33.800 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:10:33.800 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:10:33.801 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:10:33.801 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:33.801 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:33.801 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:10:33.801 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:10:33.801 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:10:33.801 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:10:33.801 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:10:33.801 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:10:33.801 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:10:33.801 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:33.801 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:10:33.801 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:33.801 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:33.801 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:33.801 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:33.801 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:33.801 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:33.801 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:33.801 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:33.801 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:33.802 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:33.802 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:33.802 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:33.802 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:33.802 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:33.802 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:10:33.802 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.802 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:10:33.802 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.802 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:10:33.802 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:10:33.802 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.802 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.802 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.802 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.802 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:10:33.802 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.802 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.802 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.802 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.802 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:10:33.803 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.803 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.803 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.803 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.803 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:10:33.803 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:10:33.803 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.803 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.803 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:10:33.803 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.803 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.803 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.803 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:10:33.803 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:10:33.803 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.803 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.803 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.803 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.803 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:10:33.803 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.803 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.804 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.804 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.804 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:10:33.804 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.804 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.804 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.804 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.804 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:10:33.804 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:10:33.804 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.804 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.804 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:10:33.804 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.804 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.804 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.804 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:10:33.804 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:10:33.804 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.804 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.804 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.804 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.804 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:10:33.804 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.805 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.805 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.805 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.805 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:10:33.805 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.805 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.805 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.805 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.805 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:10:33.805 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:10:33.805 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.805 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.805 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:10:33.805 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.805 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.805 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.805 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:10:33.805 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:10:33.805 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.805 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.805 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.805 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.806 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:10:33.806 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.806 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.806 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.806 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.806 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:10:33.806 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.806 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.806 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.806 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.806 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:10:33.806 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:10:33.806 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.806 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.806 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:10:33.806 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.806 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.806 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.806 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:10:33.806 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:10:33.806 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.806 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.806 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.806 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.806 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:10:33.807 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.807 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.807 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.807 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.807 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:10:33.807 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.807 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.807 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.807 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.807 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:10:33.807 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:10:33.807 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.807 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.807 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:33.807 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.807 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.807 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.807 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:10:33.807 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:10:33.807 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.807 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.807 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.807 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.807 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:10:33.807 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.808 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.808 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.808 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.808 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:10:33.808 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.808 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.808 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.808 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.808 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:10:33.808 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:10:33.808 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.808 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.808 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:10:33.808 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.808 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.808 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.808 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:10:33.808 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:10:33.808 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.808 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.808 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.808 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.808 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:10:33.808 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.808 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.809 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.809 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.809 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:10:33.809 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.809 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.809 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.809 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.809 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:10:33.809 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:10:33.809 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.809 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.809 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:33.809 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.809 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.809 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.809 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:10:33.809 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:10:33.809 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.809 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.809 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.809 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.809 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:10:33.809 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.809 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.809 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.810 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.810 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:10:33.810 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.810 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.810 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.810 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.810 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:10:33.810 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:10:33.810 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.810 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.810 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:10:33.810 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.810 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.810 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.810 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:10:33.810 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:10:33.810 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:33.810 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:33.810 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.810 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:33.810 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:10:33.810 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.810 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.810 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.810 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:33.810 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:10:33.811 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:33.812 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:33.812 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:33.812 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:10:33.812 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:10:33.812 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.787+0000 7fd06c70c640 1 -- 10.20.193.48:0/605067542 >> v2:10.20.193.111:6812/977811348 conn(0x7fd03403f800 msgr2=0x7fd03405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.812 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.787+0000 7fd06c70c640 1 --2- 10.20.193.48:0/605067542 >> v2:10.20.193.111:6812/977811348 conn(0x7fd03403f800 0x7fd03405fcb0 secure :-1 s=READY pgs=302 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd0580023d0 tx=0x7fd058039040 comp rx=0 tx=0).stop 2026-02-12T18:10:33.812 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.787+0000 7fd06c70c640 10 monclient: shutdown 2026-02-12T18:10:33.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.787+0000 7fd06c70c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:33.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.787+0000 7fd06c70c640 1 -- 10.20.193.48:0/605067542 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd06405e490 msgr2=0x7fd0641a55b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.787+0000 7fd06ac82640 1 -- 10.20.193.48:0/605067542 reap_dead start 2026-02-12T18:10:33.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.787+0000 7fd06c70c640 1 --2- 10.20.193.48:0/605067542 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd06405e490 0x7fd0641a55b0 secure :-1 s=READY pgs=222 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd06000afd0 tx=0x7fd06000fcd0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.788+0000 7fd06c70c640 1 -- 10.20.193.48:0/605067542 shutdown_connections 2026-02-12T18:10:33.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.788+0000 7fd06c70c640 1 --2- 10.20.193.48:0/605067542 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd06405e490 0x7fd0641a55b0 unknown :-1 s=CLOSED pgs=222 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.788+0000 7fd06c70c640 1 -- 10.20.193.48:0/605067542 >> 10.20.193.48:0/605067542 conn(0x7fd0640548a0 msgr2=0x7fd06413f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:33.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.788+0000 7fd06c70c640 1 -- 10.20.193.48:0/605067542 shutdown_connections 2026-02-12T18:10:33.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.788+0000 7fd06c70c640 1 -- 10.20.193.48:0/605067542 wait complete. 2026-02-12T18:10:33.813 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:10:33.813 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2026-02-12T18:10:33.813 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2026-02-12T18:10:33.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.878+0000 7fe4ec8c3640 10 monclient: get_monmap_and_config 2026-02-12T18:10:33.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.878+0000 7fe4ec8c3640 10 monclient: build_initial_monmap 2026-02-12T18:10:33.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.878+0000 7fe4ec8c3640 10 monclient: monmap: 2026-02-12T18:10:33.880 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:33.880 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.880 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:10:33.879627+0000 2026-02-12T18:10:33.880 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:10:33.879627+0000 2026-02-12T18:10:33.880 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:33.881 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.881 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:10:33.881 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:10:33.881 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:33.881 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:33.881 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:33.881 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:33.881 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:33.881 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:33.881 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:33.881 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:10:33.881 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:10:33.881 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.878+0000 7fe4ec8c3640 1 Processor -- start 2026-02-12T18:10:33.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.878+0000 7fe4ec8c3640 1 -- start start 2026-02-12T18:10:33.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.878+0000 7fe4ec8c3640 10 monclient: init 2026-02-12T18:10:33.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ec8c3640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:33.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ec8c3640 10 monclient: _add_conns ranks=[2,6,3,1,7,8,0,5,9,4,10] 2026-02-12T18:10:33.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ec8c3640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe4e4090070 0x7fe4e4145660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ec8c3640 10 monclient(hunting): picked mon.noname-b con 0x7fe4e4090070 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:10:33.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ec8c3640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe4e4145ba0 0x7fe4e4148820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ec8c3640 10 monclient(hunting): picked mon.noname-d con 0x7fe4e4145ba0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:10:33.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ec8c3640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe4e4145f90 0x7fe4e4148d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ec8c3640 10 monclient(hunting): picked mon.noname-g con 0x7fe4e4145f90 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:10:33.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ec8c3640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ec8c3640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fe4e4090440 con 0x7fe4e4090070 2026-02-12T18:10:33.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ec8c3640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ec8c3640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe4e408b120 con 0x7fe4e4145f90 2026-02-12T18:10:33.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ec8c3640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ec8c3640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fe4e408b400 con 0x7fe4e4145ba0 2026-02-12T18:10:33.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ec8c3640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:33.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ec8c3640 10 monclient(hunting): authenticate will time out at 872.605309s 2026-02-12T18:10:33.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ea638640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe4e4090070 0x7fe4e4145660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4e9e37640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe4e4145ba0 0x7fe4e4148820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ea638640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe4e4090070 0x7fe4e4145660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:58952/0 (socket says 10.20.193.48:58952) 2026-02-12T18:10:33.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ea638640 1 -- 10.20.193.48:0/430322300 learned_addr learned my addr 10.20.193.48:0/430322300 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:33.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ea638640 10 monclient(hunting): get_auth_request con 0x7fe4e4090070 auth_method 0 2026-02-12T18:10:33.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ea638640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ea638640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ea638640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4e9e37640 10 monclient(hunting): get_auth_request con 0x7fe4e4145ba0 auth_method 0 2026-02-12T18:10:33.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4e9e37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4e9e37640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4e9e37640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ea638640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ea638640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ea638640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4e9e37640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4e9e37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4e9e37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4eae39640 1 --2- 10.20.193.48:0/430322300 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe4e4145f90 0x7fe4e4148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4eae39640 10 monclient(hunting): get_auth_request con 0x7fe4e4145f90 auth_method 0 2026-02-12T18:10:33.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4eae39640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4eae39640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4eae39640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ea638640 10 monclient(hunting): handle_auth_done global_id 35732 payload 274 2026-02-12T18:10:33.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ea638640 1 -- 10.20.193.48:0/430322300 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe4e4145ba0 msgr2=0x7fe4e4148820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:33.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ea638640 1 --2- 10.20.193.48:0/430322300 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe4e4145ba0 0x7fe4e4148820 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ea638640 1 -- 10.20.193.48:0/430322300 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe4e4145f90 msgr2=0x7fe4e4148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:33.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ea638640 1 --2- 10.20.193.48:0/430322300 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe4e4145f90 0x7fe4e4148d60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ea638640 10 monclient: _finish_hunting 0 2026-02-12T18:10:33.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ea638640 1 monclient: found mon.noname-b 2026-02-12T18:10:33.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ea638640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:33.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ea638640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:10:33.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.879+0000 7fe4ea638640 1 -- 10.20.193.48:0/430322300 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4e404dc20 con 0x7fe4e4090070 2026-02-12T18:10:33.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4ea638640 1 -- 10.20.193.48:0/430322300 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe4e4090070 msgr2=0x7fe4e4145660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:33.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4ea638640 1 --2- 10.20.193.48:0/430322300 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe4e4090070 0x7fe4e4145660 secure :-1 s=READY pgs=223 gs=1 cs=0 l=1 c_cookie=13443193528577305074 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4dc0098d0 tx=0x7fe4dc02ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba8fd14a05ae29f2 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:33.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4e9636640 1 -- 10.20.193.48:0/430322300 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe4dc035340 con 0x7fe4e4090070 2026-02-12T18:10:33.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4e9636640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4e9636640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:10:33.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4e9636640 10 monclient: dump: 2026-02-12T18:10:33.890 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.890 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.890 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.890 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.890 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.890 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.890 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.890 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.891 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.891 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.891 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.891 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.891 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.891 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.891 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.891 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4e9636640 10 monclient: _finish_auth 0 2026-02-12T18:10:33.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4e9636640 10 monclient: _check_auth_tickets 2026-02-12T18:10:33.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4e9636640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:33.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4e9636640 1 -- 10.20.193.48:0/430322300 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4dc0354c0 con 0x7fe4e4090070 2026-02-12T18:10:33.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4ec8c3640 5 monclient: authenticate success, global_id 35732 2026-02-12T18:10:33.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4ec8c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:10:33.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4e9636640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:33.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4e9636640 1 -- 10.20.193.48:0/430322300 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe4dc035af0 con 0x7fe4e4090070 2026-02-12T18:10:33.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4ec8c3640 10 monclient: get_monmap_and_config success 2026-02-12T18:10:33.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4ec8c3640 4 set_mon_vals no callback set 2026-02-12T18:10:33.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4e9636640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4e9636640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:10:33.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4e9636640 10 monclient: dump: 2026-02-12T18:10:33.892 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.892 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.892 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.892 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.892 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.892 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.892 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.892 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.892 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.892 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.892 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.892 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.892 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.892 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.892 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.892 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4ec8c3640 10 monclient: shutdown 2026-02-12T18:10:33.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4ec8c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:33.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4ec8c3640 1 -- 10.20.193.48:0/430322300 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe4e4090070 msgr2=0x7fe4e4145660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4ec8c3640 1 --2- 10.20.193.48:0/430322300 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe4e4090070 0x7fe4e4145660 secure :-1 s=READY pgs=223 gs=1 cs=0 l=1 c_cookie=13443193528577305074 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4dc0098d0 tx=0x7fe4dc02ee20 comp rx=0 tx=0).stop 2026-02-12T18:10:33.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4ec8c3640 1 -- 10.20.193.48:0/430322300 shutdown_connections 2026-02-12T18:10:33.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4ec8c3640 1 --2- 10.20.193.48:0/430322300 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe4e4145f90 0x7fe4e4148d60 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4ec8c3640 1 --2- 10.20.193.48:0/430322300 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe4e4145ba0 0x7fe4e4148820 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4ec8c3640 1 --2- 10.20.193.48:0/430322300 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe4e4090070 0x7fe4e4145660 unknown :-1 s=CLOSED pgs=223 gs=1 cs=0 l=1 c_cookie=13443193528577305074 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4ec8c3640 1 -- 10.20.193.48:0/430322300 >> 10.20.193.48:0/430322300 conn(0x7fe4e40546a0 msgr2=0x7fe4e4054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:33.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4ec8c3640 1 -- 10.20.193.48:0/430322300 shutdown_connections 2026-02-12T18:10:33.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.882+0000 7fe4ec8c3640 1 -- 10.20.193.48:0/430322300 wait complete. 2026-02-12T18:10:33.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4ec8c3640 10 monclient: build_initial_monmap 2026-02-12T18:10:33.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4ec8c3640 10 monclient: monmap: 2026-02-12T18:10:33.893 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:33.893 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:10:33.893 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:10:33.893 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:10:33.893 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:33.893 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.893 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:10:33.893 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:10:33.893 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:33.893 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:33.894 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:33.894 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:33.894 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:33.894 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:33.894 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:33.894 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4ec8c3640 1 Processor -- start 2026-02-12T18:10:33.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4ec8c3640 1 -- start start 2026-02-12T18:10:33.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4ec8c3640 10 monclient: init 2026-02-12T18:10:33.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4ec8c3640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:33.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4ec8c3640 10 monclient: _add_conns ranks=[7,1,6,0,8,3,4,2,5] 2026-02-12T18:10:33.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4ec8c3640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe4e4090070 0x7fe4e4057b60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4ec8c3640 10 monclient(hunting): picked mon.noname-i con 0x7fe4e4090070 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:10:33.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4ec8c3640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe4e4145ba0 0x7fe4e40580a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4ec8c3640 10 monclient(hunting): picked mon.noname-f con 0x7fe4e4145ba0 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:10:33.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4ec8c3640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe4e4145f90 0x7fe4e40585e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4ec8c3640 10 monclient(hunting): picked mon.noname-d con 0x7fe4e4145f90 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:10:33.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4ec8c3640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.894 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4ec8c3640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe4e405b7a0 con 0x7fe4e4145ba0 2026-02-12T18:10:33.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4ec8c3640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4ec8c3640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fe4e4129560 con 0x7fe4e4145f90 2026-02-12T18:10:33.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4ec8c3640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4ec8c3640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fe4e4146620 con 0x7fe4e4090070 2026-02-12T18:10:33.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4ec8c3640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:33.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4ec8c3640 10 monclient(hunting): authenticate will time out at 872.609815s 2026-02-12T18:10:33.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4eae39640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe4e4145f90 0x7fe4e40585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4eae39640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe4e4145f90 0x7fe4e40585e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:36728/0 (socket says 10.20.193.48:36728) 2026-02-12T18:10:33.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4eae39640 1 -- 10.20.193.48:0/3399798464 learned_addr learned my addr 10.20.193.48:0/3399798464 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:33.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4eae39640 10 monclient(hunting): get_auth_request con 0x7fe4e4145f90 auth_method 0 2026-02-12T18:10:33.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4eae39640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4eae39640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4eae39640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4eae39640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4eae39640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4eae39640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.883+0000 7fe4e9e37640 1 --2- 10.20.193.48:0/3399798464 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe4e4145ba0 0x7fe4e40580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.884+0000 7fe4e9e37640 10 monclient(hunting): get_auth_request con 0x7fe4e4145ba0 auth_method 0 2026-02-12T18:10:33.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.884+0000 7fe4e9e37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.884+0000 7fe4e9e37640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.884+0000 7fe4e9e37640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.884+0000 7fe4ea638640 1 --2- 10.20.193.48:0/3399798464 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe4e4090070 0x7fe4e4057b60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.884+0000 7fe4eae39640 10 monclient(hunting): handle_auth_done global_id 5631 payload 824 2026-02-12T18:10:33.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.884+0000 7fe4eae39640 1 -- 10.20.193.48:0/3399798464 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe4e4090070 msgr2=0x7fe4e4057b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.884+0000 7fe4eae39640 1 --2- 10.20.193.48:0/3399798464 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe4e4090070 0x7fe4e4057b60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.884+0000 7fe4eae39640 1 -- 10.20.193.48:0/3399798464 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe4e4145ba0 msgr2=0x7fe4e40580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.884+0000 7fe4eae39640 1 --2- 10.20.193.48:0/3399798464 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe4e4145ba0 0x7fe4e40580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.884+0000 7fe4eae39640 10 monclient: _finish_hunting 0 2026-02-12T18:10:33.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.884+0000 7fe4eae39640 1 monclient: found mon.noname-d 2026-02-12T18:10:33.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.884+0000 7fe4eae39640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:33.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.884+0000 7fe4eae39640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:10:33.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.884+0000 7fe4eae39640 1 -- 10.20.193.48:0/3399798464 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4dc0094f0 con 0x7fe4e4145f90 2026-02-12T18:10:33.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4eae39640 1 -- 10.20.193.48:0/3399798464 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe4e4145f90 msgr2=0x7fe4e40585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:33.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4eae39640 1 --2- 10.20.193.48:0/3399798464 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe4e4145f90 0x7fe4e40585e0 secure :-1 s=READY pgs=197 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4d800f7e0 tx=0x7fe4d800fcb0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:33.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4ceffd640 1 -- 10.20.193.48:0/3399798464 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe4d800dda0 con 0x7fe4e4145f90 2026-02-12T18:10:33.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4ceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4ceffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:10:33.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4ceffd640 10 monclient: dump: 2026-02-12T18:10:33.896 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.897 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.897 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.897 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.897 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.897 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.897 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.897 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.897 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.897 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.897 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.897 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.897 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.897 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.897 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.897 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4ceffd640 10 monclient: _finish_auth 0 2026-02-12T18:10:33.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4ceffd640 10 monclient: _check_auth_tickets 2026-02-12T18:10:33.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4ceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:33.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4ceffd640 1 -- 10.20.193.48:0/3399798464 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4d8014410 con 0x7fe4e4145f90 2026-02-12T18:10:33.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4ceffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:33.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4ceffd640 1 -- 10.20.193.48:0/3399798464 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe4d8014a40 con 0x7fe4e4145f90 2026-02-12T18:10:33.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4ceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4ceffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:10:33.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4e8e35640 4 set_mon_vals no callback set 2026-02-12T18:10:33.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4ceffd640 10 monclient: dump: 2026-02-12T18:10:33.898 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.898 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.898 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.898 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.898 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.898 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.898 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.898 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.898 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.898 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.898 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.898 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.898 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.898 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.898 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.899 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4ec8c3640 5 monclient: authenticate success, global_id 5631 2026-02-12T18:10:33.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4ec8c3640 10 monclient: _renew_subs 2026-02-12T18:10:33.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4ec8c3640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:10:33.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4ec8c3640 1 -- 10.20.193.48:0/3399798464 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4e408ab50 con 0x7fe4e4145f90 2026-02-12T18:10:33.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4ec8c3640 10 monclient: _renew_subs 2026-02-12T18:10:33.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4ec8c3640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:10:33.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4ec8c3640 1 -- 10.20.193.48:0/3399798464 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4e405af00 con 0x7fe4e4145f90 2026-02-12T18:10:33.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4ec8c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:33.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4ec8c3640 1 --2- 10.20.193.48:0/3399798464 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe4e4059fa0 0x7fe4e4058b20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4ec8c3640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.886+0000 7fe4ec8c3640 1 -- 10.20.193.48:0/3399798464 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fe4e405f140 con 0x7fe4e4059fa0 2026-02-12T18:10:33.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.887+0000 7fe4ea638640 1 --2- 10.20.193.48:0/3399798464 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe4e4059fa0 0x7fe4e4058b20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.887+0000 7fe4ea638640 10 monclient: get_auth_request con 0x7fe4e4059fa0 auth_method 0 2026-02-12T18:10:33.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.887+0000 7fe4ea638640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.887+0000 7fe4ea638640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.887+0000 7fe4ea638640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.887+0000 7fe4ea638640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.887+0000 7fe4ea638640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.887+0000 7fe4ea638640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.887+0000 7fe4ceffd640 1 -- 10.20.193.48:0/3399798464 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fe4d8023060 con 0x7fe4e4145f90 2026-02-12T18:10:33.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.887+0000 7fe4ea638640 10 monclient(hunting): handle_auth_done global_id 64142 payload 824 2026-02-12T18:10:33.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.887+0000 7fe4ea638640 1 -- 10.20.193.48:0/3399798464 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe4e408a9d0 con 0x7fe4e4059fa0 2026-02-12T18:10:33.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.887+0000 7fe4ceffd640 1 --2- 10.20.193.48:0/3399798464 >> v2:10.20.193.111:6812/977811348 conn(0x7fe4b403f800 0x7fe4b405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.887+0000 7fe4ceffd640 1 -- 10.20.193.48:0/3399798464 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(214..214 src has 1..214) ==== 3897+0+0 (secure 0 0 0) 0x7fe4d8053300 con 0x7fe4e4145f90 2026-02-12T18:10:33.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.887+0000 7fe4e9e37640 1 --2- 10.20.193.48:0/3399798464 >> v2:10.20.193.111:6812/977811348 conn(0x7fe4b403f800 0x7fe4b405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.887+0000 7fe4e9e37640 10 monclient: get_auth_request con 0x7fe4b403f800 auth_method 0 2026-02-12T18:10:33.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.889+0000 7fe4ea638640 1 -- 10.20.193.48:0/3399798464 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe4e4059fa0 msgr2=0x7fe4e4058b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:33.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.889+0000 7fe4ea638640 1 --2- 10.20.193.48:0/3399798464 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe4e4059fa0 0x7fe4e4058b20 secure :-1 s=READY pgs=19 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4dc0023d0 tx=0x7fe4dc0047e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:33.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.889+0000 7fe4ceffd640 1 -- 10.20.193.48:0/3399798464 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe4dc035340 con 0x7fe4e4059fa0 2026-02-12T18:10:33.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.889+0000 7fe4ceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:33.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.889+0000 7fe4ceffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:10:33.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.889+0000 7fe4ceffd640 10 monclient: dump: 2026-02-12T18:10:33.902 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:33.902 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:33.902 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.902 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:33.902 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:33.902 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:33.902 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:33.902 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:33.902 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:33.902 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:33.902 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:33.902 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:33.902 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:33.902 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:33.902 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:33.902 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:33.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.889+0000 7fe4ceffd640 1 -- 10.20.193.48:0/3399798464 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fe4dc035d00 con 0x7fe4e4059fa0 2026-02-12T18:10:33.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.889+0000 7fe4ceffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:33.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.889+0000 7fe4ceffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:10:33.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.889+0000 7fe4ceffd640 1 -- 10.20.193.48:0/3399798464 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe4e4059fa0 msgr2=0x7fe4e4058b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:33.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.889+0000 7fe4ceffd640 1 --2- 10.20.193.48:0/3399798464 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe4e4059fa0 0x7fe4e4058b20 secure :-1 s=READY pgs=19 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4dc0023d0 tx=0x7fe4dc0047e0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.889+0000 7fe4ceffd640 1 -- 10.20.193.48:0/3399798464 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe4e4059fa0 msgr2=0x7fe4e4058b20 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:33.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.889+0000 7fe4ceffd640 1 --2- 10.20.193.48:0/3399798464 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe4e4059fa0 0x7fe4e4058b20 secure :-1 s=CLOSED pgs=19 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4dc0023d0 tx=0x7fe4dc0047e0 comp rx=0 tx=0).stop 2026-02-12T18:10:33.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.890+0000 7fe4e9e37640 1 --2- 10.20.193.48:0/3399798464 >> v2:10.20.193.111:6812/977811348 conn(0x7fe4b403f800 0x7fe4b405fcb0 secure :-1 s=READY pgs=303 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4e40591a0 tx=0x7fe4d0008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:33.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.893+0000 7fe4ec8c3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:10:33.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.893+0000 7fe4ec8c3640 1 --2- 10.20.193.48:0/3399798464 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe4e4091010 0x7fe4e4147cc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:33.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.893+0000 7fe4ec8c3640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:33.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.893+0000 7fe4ec8c3640 1 -- 10.20.193.48:0/3399798464 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fe4e405fd90 con 0x7fe4e4091010 2026-02-12T18:10:33.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.893+0000 7fe4ea638640 1 --2- 10.20.193.48:0/3399798464 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe4e4091010 0x7fe4e4147cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:33.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.893+0000 7fe4ea638640 10 monclient: get_auth_request con 0x7fe4e4091010 auth_method 0 2026-02-12T18:10:33.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.893+0000 7fe4ea638640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:33.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.893+0000 7fe4ea638640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:33.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.893+0000 7fe4ea638640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:33.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.893+0000 7fe4ea638640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:33.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.893+0000 7fe4ea638640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:33.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.893+0000 7fe4ea638640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:33.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.893+0000 7fe4ea638640 10 monclient(hunting): handle_auth_done global_id 64151 payload 824 2026-02-12T18:10:33.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.893+0000 7fe4ea638640 1 -- 10.20.193.48:0/3399798464 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe4e41452b0 con 0x7fe4e4091010 2026-02-12T18:10:33.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.896+0000 7fe4ea638640 1 -- 10.20.193.48:0/3399798464 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe4e4091010 msgr2=0x7fe4e4147cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-12T18:10:33.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.896+0000 7fe4ea638640 1 -- 10.20.193.48:0/3399798464 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe4e4091010 msgr2=0x7fe4e4147cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:10:33.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.896+0000 7fe4ea638640 1 --2- 10.20.193.48:0/3399798464 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe4e4091010 0x7fe4e4147cc0 secure :-1 s=SESSION_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4dc009820 tx=0x7fe4dc004770 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:33.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:33.896+0000 7fe4ea638640 1 --2- 10.20.193.48:0/3399798464 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe4e4091010 0x7fe4e4147cc0 unknown :-1 s=START_CONNECT pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:34.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.097+0000 7fe4ea638640 1 --2- 10.20.193.48:0/3399798464 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe4e4091010 0x7fe4e4147cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.097+0000 7fe4ea638640 10 monclient: get_auth_request con 0x7fe4e4091010 auth_method 0 2026-02-12T18:10:34.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.097+0000 7fe4ea638640 10 monclient: get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.097+0000 7fe4ea638640 10 monclient: _init_auth method 2 2026-02-12T18:10:34.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.097+0000 7fe4ea638640 10 monclient: _init_auth already have auth, reseting 2026-02-12T18:10:34.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.097+0000 7fe4ea638640 10 monclient: handle_auth_reply_more payload 9 2026-02-12T18:10:34.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.097+0000 7fe4ea638640 10 monclient: handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.097+0000 7fe4ea638640 10 monclient: handle_auth_reply_more responding with 132 bytes 2026-02-12T18:10:34.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.097+0000 7fe4ea638640 10 monclient: handle_auth_done global_id 64151 payload 293 2026-02-12T18:10:34.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.099+0000 7fe4ea638640 1 -- 10.20.193.48:0/3399798464 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe4e4091010 msgr2=0x7fe4e4147cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:34.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.099+0000 7fe4ea638640 1 --2- 10.20.193.48:0/3399798464 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe4e4091010 0x7fe4e4147cc0 secure :-1 s=READY pgs=21 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4dc051000 tx=0x7fe4dc043000 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.100+0000 7fe4ceffd640 1 -- 10.20.193.48:0/3399798464 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe4dc037440 con 0x7fe4e4091010 2026-02-12T18:10:34.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.100+0000 7fe4ceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.100+0000 7fe4ceffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:10:34.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.100+0000 7fe4ceffd640 10 monclient: dump: 2026-02-12T18:10:34.102 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.102 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.103 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.103 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.103 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.103 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.103 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.103 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.103 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.103 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.103 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.103 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.103 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.103 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.104 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.104 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.100+0000 7fe4ceffd640 1 -- 10.20.193.48:0/3399798464 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7fe4dc052070 con 0x7fe4e4091010 2026-02-12T18:10:34.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.100+0000 7fe4ceffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:10:34.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.100+0000 7fe4ceffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:10:34.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.100+0000 7fe4ceffd640 1 -- 10.20.193.48:0/3399798464 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe4e4091010 msgr2=0x7fe4e4147cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.100+0000 7fe4ceffd640 1 --2- 10.20.193.48:0/3399798464 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe4e4091010 0x7fe4e4147cc0 secure :-1 s=READY pgs=21 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4dc051000 tx=0x7fe4dc043000 comp rx=0 tx=0).stop 2026-02-12T18:10:34.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.100+0000 7fe4ceffd640 1 -- 10.20.193.48:0/3399798464 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe4e4091010 msgr2=0x7fe4e4147cc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:34.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.100+0000 7fe4ceffd640 1 --2- 10.20.193.48:0/3399798464 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe4e4091010 0x7fe4e4147cc0 secure :-1 s=CLOSED pgs=21 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4dc051000 tx=0x7fe4dc043000 comp rx=0 tx=0).stop 2026-02-12T18:10:34.105 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:10:34.105 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:10:34.105 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:10:34.105 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:10:34.105 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 46, 2026-02-12T18:10:34.105 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 14901, 2026-02-12T18:10:34.105 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:10:34.105 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:10:34.105 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:10:34.106 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:10:34.106 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:10:34.106 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:10:34.106 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:10:34.106 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:10:34.106 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:10:34.106 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:10:34.106 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:34.106 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 8, 2026-02-12T18:10:34.106 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:34.106 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:10:34.106 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:10:34.107 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:34.107 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:34.107 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:34.107 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:34.107 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:34.107 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:34.107 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:34.107 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:34.107 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:34.107 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:34.107 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:34.107 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:34.108 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:34.108 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:34.108 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:10:34.108 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:10:34.108 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:34.108 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:34.108 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:34.108 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:34.108 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:34.108 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:34.108 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:34.108 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:34.109 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:34.109 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:34.109 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:34.109 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:34.109 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:34.109 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.109 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.109 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:10:34.109 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:10:34.109 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:10:34.109 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:10:34.109 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:10:34.110 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:10:34.110 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:34.110 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:34.110 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:10:34.110 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:10:34.110 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:10:34.110 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:10:34.110 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:10:34.110 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:10:34.110 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:10:34.110 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:34.110 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:10:34.110 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:34.111 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:34.111 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:34.111 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:34.111 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:34.111 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:34.111 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:34.111 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:34.111 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:34.111 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:34.111 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:34.111 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:34.111 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:34.112 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:34.112 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:10:34.112 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.112 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:10:34.112 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.112 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:10:34.112 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:10:34.112 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.112 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.112 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.112 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.112 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:10:34.113 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.113 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.113 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.113 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.113 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:10:34.113 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.113 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.113 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.113 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.113 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:10:34.113 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:10:34.113 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.113 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.114 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:10:34.114 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.114 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.114 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.114 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:10:34.114 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:10:34.114 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.114 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.114 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.114 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.114 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:10:34.114 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.115 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.115 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.115 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.115 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:10:34.115 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.115 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.115 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.115 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.115 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:10:34.115 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:10:34.115 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.115 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.115 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:10:34.116 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.116 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.116 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.116 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:10:34.116 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:10:34.116 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.116 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.116 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.116 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.116 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:10:34.116 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.116 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.117 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.117 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.117 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:10:34.117 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.117 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.117 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.117 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.117 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:10:34.117 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:10:34.117 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.117 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.117 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:10:34.118 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.118 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.118 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.118 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:10:34.118 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:10:34.118 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.118 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.118 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.118 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.118 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:10:34.118 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.118 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.118 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.119 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.119 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:10:34.119 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.119 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.119 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.119 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.119 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:10:34.119 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:10:34.119 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.119 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.119 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:10:34.119 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.119 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.120 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.120 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:10:34.120 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:10:34.120 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.120 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.120 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.120 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.120 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:10:34.120 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.120 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.120 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.120 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.121 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:10:34.121 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.121 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.121 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.121 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.121 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:10:34.121 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:10:34.121 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.121 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.121 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:34.121 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.121 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.121 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.122 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:10:34.122 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:10:34.122 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.122 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.122 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.122 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.122 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:10:34.122 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.122 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.122 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.123 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.123 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:10:34.123 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.123 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.123 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.123 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.123 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:10:34.123 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:10:34.123 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.123 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.123 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:10:34.123 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.123 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.124 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.124 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:10:34.124 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:10:34.124 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.124 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.124 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.124 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.124 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:10:34.124 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.124 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.124 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.124 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.124 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:10:34.125 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.125 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.125 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.125 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.125 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:10:34.125 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:10:34.125 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.125 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.125 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:34.125 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.125 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.125 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.126 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:10:34.126 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:10:34.126 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.126 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.126 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.126 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.126 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:10:34.126 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.126 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.126 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.126 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.126 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:10:34.127 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.127 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.127 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.127 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.127 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:10:34.127 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:10:34.127 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.127 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.127 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:10:34.127 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.127 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.127 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.127 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:10:34.128 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:10:34.128 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.128 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.128 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.128 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.128 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:10:34.128 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.128 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.128 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.128 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.128 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:10:34.128 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.128 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.129 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.129 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.129 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:10:34.129 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:10:34.129 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.129 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.129 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:10:34.129 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.129 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.129 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.129 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.129 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:10:34.129 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:10:34.130 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.130 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:34.130 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:34.130 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:34.130 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.130 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:34.130 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:10:34.130 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.130 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:34.130 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:34.130 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:34.130 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.131 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.131 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.131 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:10:34.131 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:10:34.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.100+0000 7fe4ec8c3640 1 -- 10.20.193.48:0/3399798464 >> v2:10.20.193.111:6812/977811348 conn(0x7fe4b403f800 msgr2=0x7fe4b405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.100+0000 7fe4ec8c3640 1 --2- 10.20.193.48:0/3399798464 >> v2:10.20.193.111:6812/977811348 conn(0x7fe4b403f800 0x7fe4b405fcb0 secure :-1 s=READY pgs=303 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4e40591a0 tx=0x7fe4d0008040 comp rx=0 tx=0).stop 2026-02-12T18:10:34.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.100+0000 7fe4ec8c3640 10 monclient: shutdown 2026-02-12T18:10:34.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.100+0000 7fe4ec8c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:34.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.100+0000 7fe4ec8c3640 1 -- 10.20.193.48:0/3399798464 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe4e4145f90 msgr2=0x7fe4e40585e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.100+0000 7fe4ec8c3640 1 --2- 10.20.193.48:0/3399798464 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe4e4145f90 0x7fe4e40585e0 secure :-1 s=READY pgs=197 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe4d800f7e0 tx=0x7fe4d800fcb0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.100+0000 7fe4eae39640 1 -- 10.20.193.48:0/3399798464 reap_dead start 2026-02-12T18:10:34.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.100+0000 7fe4eae39640 1 -- 10.20.193.48:0/3399798464 reap_dead start 2026-02-12T18:10:34.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.100+0000 7fe4ec8c3640 1 -- 10.20.193.48:0/3399798464 shutdown_connections 2026-02-12T18:10:34.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.100+0000 7fe4ec8c3640 1 -- 10.20.193.48:0/3399798464 >> 10.20.193.48:0/3399798464 conn(0x7fe4e40546a0 msgr2=0x7fe4e4144b20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:34.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.100+0000 7fe4ec8c3640 1 -- 10.20.193.48:0/3399798464 shutdown_connections 2026-02-12T18:10:34.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.100+0000 7fe4ec8c3640 1 -- 10.20.193.48:0/3399798464 wait complete. 2026-02-12T18:10:34.134 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:10:34.134 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2026-02-12T18:10:34.134 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2026-02-12T18:10:34.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.200+0000 7f188bf4c640 10 monclient: get_monmap_and_config 2026-02-12T18:10:34.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.200+0000 7f188bf4c640 10 monclient: build_initial_monmap 2026-02-12T18:10:34.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.200+0000 7f188bf4c640 10 monclient: monmap: 2026-02-12T18:10:34.202 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:34.202 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.202 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:10:34.201417+0000 2026-02-12T18:10:34.203 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:10:34.201417+0000 2026-02-12T18:10:34.203 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:34.203 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.203 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:10:34.203 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:10:34.203 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:34.203 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:34.203 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:34.203 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:34.203 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:34.203 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:34.204 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:34.204 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:10:34.204 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:10:34.204 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.200+0000 7f188bf4c640 1 Processor -- start 2026-02-12T18:10:34.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.200+0000 7f188bf4c640 1 -- start start 2026-02-12T18:10:34.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.200+0000 7f188bf4c640 10 monclient: init 2026-02-12T18:10:34.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f188bf4c640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:34.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f188bf4c640 10 monclient: _add_conns ranks=[9,1,10,6,7,2,5,4,3,8,0] 2026-02-12T18:10:34.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f188bf4c640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f188405c950 0x7f188405cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f188bf4c640 10 monclient(hunting): picked mon.noname-a con 0x7f188405c950 addr v2:10.20.193.48:3300/0 2026-02-12T18:10:34.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f188bf4c640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f188405e490 addr v1:10.20.193.111:6789/0 2026-02-12T18:10:34.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f188bf4c640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f188405d260 0x7f188413e280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f188bf4c640 10 monclient(hunting): picked mon.noname-f con 0x7f188405d260 addr v2:10.20.193.111:3300/0 2026-02-12T18:10:34.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f188bf4c640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f188404dc20 con 0x7f188405e490 2026-02-12T18:10:34.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f188bf4c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f188bf4c640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f188405ddd0 con 0x7f188405c950 2026-02-12T18:10:34.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f188bf4c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f188bf4c640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f1884092990 con 0x7f188405d260 2026-02-12T18:10:34.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f188bf4c640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:34.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f188bf4c640 10 monclient(hunting): authenticate will time out at 872.927117s 2026-02-12T18:10:34.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f1889cc1640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f188405c950 0x7f188405cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f1889cc1640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f188405c950 0x7f188405cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:42496/0 (socket says 10.20.193.48:42496) 2026-02-12T18:10:34.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f1889cc1640 1 -- 10.20.193.48:0/3929367553 learned_addr learned my addr 10.20.193.48:0/3929367553 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:34.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f1889cc1640 10 monclient(hunting): get_auth_request con 0x7f188405c950 auth_method 0 2026-02-12T18:10:34.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f1889cc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f1889cc1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f1889cc1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f188a4c2640 1 --2- 10.20.193.48:0/3929367553 >> v2:10.20.193.111:3300/0 conn(0x7f188405d260 0x7f188413e280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f1889cc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f1889cc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f1889cc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f188a4c2640 10 monclient(hunting): get_auth_request con 0x7f188405d260 auth_method 0 2026-02-12T18:10:34.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f188a4c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f188a4c2640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f188a4c2640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f1889cc1640 10 monclient(hunting): handle_auth_done global_id 5967 payload 274 2026-02-12T18:10:34.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f1889cc1640 1 -- 10.20.193.48:0/3929367553 >> v2:10.20.193.111:3300/0 conn(0x7f188405d260 msgr2=0x7f188413e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:34.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f1889cc1640 1 --2- 10.20.193.48:0/3929367553 >> v2:10.20.193.111:3300/0 conn(0x7f188405d260 0x7f188413e280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f1889cc1640 1 -- 10.20.193.48:0/3929367553 >> v1:10.20.193.111:6789/0 conn(0x7f188405e490 legacy=0x7f188413db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:34.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f1889cc1640 10 monclient: _finish_hunting 0 2026-02-12T18:10:34.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f1889cc1640 1 monclient: found mon.noname-a 2026-02-12T18:10:34.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f1889cc1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:34.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f1889cc1640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:10:34.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.201+0000 7f1889cc1640 1 -- 10.20.193.48:0/3929367553 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1884092c70 con 0x7f188405c950 2026-02-12T18:10:34.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f1889cc1640 1 -- 10.20.193.48:0/3929367553 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f188405c950 msgr2=0x7f188405cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:34.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f1889cc1640 1 --2- 10.20.193.48:0/3929367553 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f188405c950 0x7f188405cd20 secure :-1 s=READY pgs=370 gs=2 cs=0 l=1 c_cookie=3554976160712263450 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18840981f0 tx=0x7f187402edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3155cffbac3c871a server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f1888cbf640 1 -- 10.20.193.48:0/3929367553 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1874035340 con 0x7f188405c950 2026-02-12T18:10:34.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f1888cbf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f1888cbf640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:10:34.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f1888cbf640 10 monclient: dump: 2026-02-12T18:10:34.217 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.218 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.218 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.218 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.218 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.218 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.218 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.218 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.218 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.218 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.218 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.218 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.218 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.218 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.219 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.219 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f1888cbf640 10 monclient: _finish_auth 0 2026-02-12T18:10:34.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f1888cbf640 10 monclient: _check_auth_tickets 2026-02-12T18:10:34.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f1888cbf640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:34.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f188bf4c640 5 monclient: authenticate success, global_id 5967 2026-02-12T18:10:34.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f188bf4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:10:34.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f1888cbf640 1 -- 10.20.193.48:0/3929367553 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18740354c0 con 0x7f188405c950 2026-02-12T18:10:34.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f1888cbf640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:34.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f188bf4c640 10 monclient: get_monmap_and_config success 2026-02-12T18:10:34.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f188bf4c640 4 set_mon_vals no callback set 2026-02-12T18:10:34.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f1888cbf640 1 -- 10.20.193.48:0/3929367553 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1874035630 con 0x7f188405c950 2026-02-12T18:10:34.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f1888cbf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f1888cbf640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:10:34.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f1888cbf640 10 monclient: dump: 2026-02-12T18:10:34.220 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.220 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.220 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.220 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.220 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.220 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.220 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.220 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.220 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.221 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.221 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.221 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.221 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.221 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.221 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.221 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f188bf4c640 10 monclient: shutdown 2026-02-12T18:10:34.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f188bf4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:34.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f188bf4c640 1 -- 10.20.193.48:0/3929367553 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f188405c950 msgr2=0x7f188405cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f188bf4c640 1 --2- 10.20.193.48:0/3929367553 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f188405c950 0x7f188405cd20 secure :-1 s=READY pgs=370 gs=2 cs=0 l=1 c_cookie=3554976160712263450 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18840981f0 tx=0x7f187402edb0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f188bf4c640 1 -- 10.20.193.48:0/3929367553 shutdown_connections 2026-02-12T18:10:34.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f188bf4c640 1 --2- 10.20.193.48:0/3929367553 >> v2:10.20.193.111:3300/0 conn(0x7f188405d260 0x7f188413e280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f188bf4c640 1 --2- 10.20.193.48:0/3929367553 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f188405c950 0x7f188405cd20 unknown :-1 s=CLOSED pgs=370 gs=2 cs=0 l=1 c_cookie=3554976160712263450 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f188bf4c640 1 -- 10.20.193.48:0/3929367553 >> 10.20.193.48:0/3929367553 conn(0x7f18840548a0 msgr2=0x7f1884097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:34.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f188bf4c640 1 -- 10.20.193.48:0/3929367553 shutdown_connections 2026-02-12T18:10:34.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f188bf4c640 1 -- 10.20.193.48:0/3929367553 wait complete. 2026-02-12T18:10:34.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f188bf4c640 10 monclient: build_initial_monmap 2026-02-12T18:10:34.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.204+0000 7f188bf4c640 10 monclient: monmap: 2026-02-12T18:10:34.222 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:34.222 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:10:34.222 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:10:34.222 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:10:34.222 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:34.223 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.223 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:10:34.223 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:10:34.223 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:34.223 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:34.223 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:34.223 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:34.223 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:34.223 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:34.223 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:34.224 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188bf4c640 1 Processor -- start 2026-02-12T18:10:34.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188bf4c640 1 -- start start 2026-02-12T18:10:34.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188bf4c640 10 monclient: init 2026-02-12T18:10:34.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188bf4c640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:34.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188bf4c640 10 monclient: _add_conns ranks=[8,4,6,5,3,0,1,7,2] 2026-02-12T18:10:34.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188bf4c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f188405c950 0x7f188412d970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188bf4c640 10 monclient(hunting): picked mon.noname-e con 0x7f188405c950 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:10:34.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188bf4c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f188405d260 0x7f188408d420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188bf4c640 10 monclient(hunting): picked mon.noname-c con 0x7f188405d260 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:10:34.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188bf4c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f188405e490 0x7f188413dda0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188bf4c640 10 monclient(hunting): picked mon.noname-d con 0x7f188405e490 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:10:34.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188bf4c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188bf4c640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f188408b650 con 0x7f188405d260 2026-02-12T18:10:34.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188bf4c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188bf4c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f188412e3d0 con 0x7f188405e490 2026-02-12T18:10:34.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188bf4c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188bf4c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f18841428d0 con 0x7f188405c950 2026-02-12T18:10:34.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188bf4c640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:34.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188bf4c640 10 monclient(hunting): authenticate will time out at 872.931428s 2026-02-12T18:10:34.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f1889cc1640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f188405c950 0x7f188412d970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f18894c0640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f188405d260 0x7f188408d420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f1889cc1640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f188405c950 0x7f188412d970 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:60656/0 (socket says 10.20.193.48:60656) 2026-02-12T18:10:34.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188a4c2640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f188405e490 0x7f188413dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f1889cc1640 1 -- 10.20.193.48:0/3951392333 learned_addr learned my addr 10.20.193.48:0/3951392333 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:34.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f1889cc1640 10 monclient(hunting): get_auth_request con 0x7f188405c950 auth_method 0 2026-02-12T18:10:34.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f1889cc1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f1889cc1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f1889cc1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f18894c0640 10 monclient(hunting): get_auth_request con 0x7f188405d260 auth_method 0 2026-02-12T18:10:34.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f18894c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f18894c0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f18894c0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188a4c2640 10 monclient(hunting): get_auth_request con 0x7f188405e490 auth_method 0 2026-02-12T18:10:34.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188a4c2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188a4c2640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188a4c2640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f1889cc1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f1889cc1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f1889cc1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f18894c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f18894c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f18894c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188a4c2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188a4c2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f188a4c2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f1889cc1640 10 monclient(hunting): handle_auth_done global_id 64160 payload 824 2026-02-12T18:10:34.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f1889cc1640 1 -- 10.20.193.48:0/3951392333 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f188405e490 msgr2=0x7f188413dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f1889cc1640 1 --2- 10.20.193.48:0/3951392333 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f188405e490 0x7f188413dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f1889cc1640 1 -- 10.20.193.48:0/3951392333 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f188405d260 msgr2=0x7f188408d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f1889cc1640 1 --2- 10.20.193.48:0/3951392333 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f188405d260 0x7f188408d420 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f1889cc1640 10 monclient: _finish_hunting 0 2026-02-12T18:10:34.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f1889cc1640 1 monclient: found mon.noname-e 2026-02-12T18:10:34.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f1889cc1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:34.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f1889cc1640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:10:34.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.205+0000 7f1889cc1640 1 -- 10.20.193.48:0/3951392333 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18740094f0 con 0x7f188405c950 2026-02-12T18:10:34.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.207+0000 7f1889cc1640 1 -- 10.20.193.48:0/3951392333 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f188405c950 msgr2=0x7f188412d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:34.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.207+0000 7f1889cc1640 1 --2- 10.20.193.48:0/3951392333 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f188405c950 0x7f188412d970 secure :-1 s=READY pgs=22 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f187402f2c0 tx=0x7f1874004770 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f18727fc640 1 -- 10.20.193.48:0/3951392333 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1874035340 con 0x7f188405c950 2026-02-12T18:10:34.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f18727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f18727fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:10:34.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f18727fc640 10 monclient: dump: 2026-02-12T18:10:34.229 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.229 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.229 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.229 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.229 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.229 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.229 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.229 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.229 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.229 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.229 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.229 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.230 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.230 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.230 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.230 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f18727fc640 10 monclient: _finish_auth 0 2026-02-12T18:10:34.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f18727fc640 10 monclient: _check_auth_tickets 2026-02-12T18:10:34.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f18727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:34.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f18727fc640 1 -- 10.20.193.48:0/3951392333 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1874035e60 con 0x7f188405c950 2026-02-12T18:10:34.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f18727fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:34.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f18727fc640 1 -- 10.20.193.48:0/3951392333 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1874037dc0 con 0x7f188405c950 2026-02-12T18:10:34.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f18727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f1873fff640 4 set_mon_vals no callback set 2026-02-12T18:10:34.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f18727fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:10:34.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f18727fc640 10 monclient: dump: 2026-02-12T18:10:34.231 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.231 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.231 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.231 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.231 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.231 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.231 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.231 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.231 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.231 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.231 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.231 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.231 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.231 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.232 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.232 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f188bf4c640 5 monclient: authenticate success, global_id 64160 2026-02-12T18:10:34.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f188bf4c640 10 monclient: _renew_subs 2026-02-12T18:10:34.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f188bf4c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:10:34.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f188bf4c640 1 -- 10.20.193.48:0/3951392333 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f188408bef0 con 0x7f188405c950 2026-02-12T18:10:34.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f188bf4c640 10 monclient: _renew_subs 2026-02-12T18:10:34.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f188bf4c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:10:34.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f188bf4c640 1 -- 10.20.193.48:0/3951392333 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f1884091220 con 0x7f188405c950 2026-02-12T18:10:34.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f188bf4c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:34.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f188bf4c640 1 --2- 10.20.193.48:0/3951392333 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f188408d960 0x7f188413e2e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f188bf4c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f188bf4c640 1 -- 10.20.193.48:0/3951392333 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f188405f140 con 0x7f188408d960 2026-02-12T18:10:34.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f18894c0640 1 --2- 10.20.193.48:0/3951392333 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f188408d960 0x7f188413e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f18894c0640 10 monclient: get_auth_request con 0x7f188408d960 auth_method 0 2026-02-12T18:10:34.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f18894c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f18894c0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f18894c0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.208+0000 7f18727fc640 1 -- 10.20.193.48:0/3951392333 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f1874046020 con 0x7f188405c950 2026-02-12T18:10:34.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.209+0000 7f18894c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.209+0000 7f18894c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.209+0000 7f18894c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.209+0000 7f18727fc640 1 --2- 10.20.193.48:0/3951392333 >> v2:10.20.193.111:6812/977811348 conn(0x7f185403f800 0x7f185405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.209+0000 7f18727fc640 1 -- 10.20.193.48:0/3951392333 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(214..214 src has 1..214) ==== 3897+0+0 (secure 0 0 0) 0x7f1874077e70 con 0x7f188405c950 2026-02-12T18:10:34.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.209+0000 7f18894c0640 10 monclient(hunting): handle_auth_done global_id 5734 payload 824 2026-02-12T18:10:34.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.209+0000 7f18894c0640 1 -- 10.20.193.48:0/3951392333 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f188408bc70 con 0x7f188408d960 2026-02-12T18:10:34.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.209+0000 7f188a4c2640 1 --2- 10.20.193.48:0/3951392333 >> v2:10.20.193.111:6812/977811348 conn(0x7f185403f800 0x7f185405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.209+0000 7f188a4c2640 10 monclient: get_auth_request con 0x7f185403f800 auth_method 0 2026-02-12T18:10:34.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.211+0000 7f18894c0640 1 -- 10.20.193.48:0/3951392333 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f188408d960 msgr2=0x7f188413e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:34.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.211+0000 7f18894c0640 1 --2- 10.20.193.48:0/3951392333 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f188408d960 0x7f188413e2e0 secure :-1 s=READY pgs=312 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f188408a200 tx=0x7f187800fc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.211+0000 7f18727fc640 1 -- 10.20.193.48:0/3951392333 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f187800db90 con 0x7f188408d960 2026-02-12T18:10:34.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.211+0000 7f18727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.211+0000 7f18727fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:10:34.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.211+0000 7f18727fc640 10 monclient: dump: 2026-02-12T18:10:34.234 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.234 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.234 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.234 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.234 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.234 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.235 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.235 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.235 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.235 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.235 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.235 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.235 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.235 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.235 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.235 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.235 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.211+0000 7f188a4c2640 1 --2- 10.20.193.48:0/3951392333 >> v2:10.20.193.111:6812/977811348 conn(0x7f185403f800 0x7f185405fcb0 secure :-1 s=READY pgs=304 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f188408c3e0 tx=0x7f1880009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.235 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.212+0000 7f18727fc640 1 -- 10.20.193.48:0/3951392333 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f187800dcf0 con 0x7f188408d960 2026-02-12T18:10:34.235 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.212+0000 7f18727fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:34.235 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.212+0000 7f18727fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:10:34.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.212+0000 7f18727fc640 1 -- 10.20.193.48:0/3951392333 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f188408d960 msgr2=0x7f188413e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.212+0000 7f18727fc640 1 --2- 10.20.193.48:0/3951392333 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f188408d960 0x7f188413e2e0 secure :-1 s=READY pgs=312 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f188408a200 tx=0x7f187800fc10 comp rx=0 tx=0).stop 2026-02-12T18:10:34.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.212+0000 7f18727fc640 1 -- 10.20.193.48:0/3951392333 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f188408d960 msgr2=0x7f188413e2e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:34.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.212+0000 7f18727fc640 1 --2- 10.20.193.48:0/3951392333 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f188408d960 0x7f188413e2e0 unknown :-1 s=CLOSED pgs=312 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.215+0000 7f188bf4c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:10:34.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.215+0000 7f188bf4c640 1 --2- 10.20.193.48:0/3951392333 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f188413e820 0x7f188412a3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.215+0000 7f188bf4c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.215+0000 7f188bf4c640 1 -- 10.20.193.48:0/3951392333 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f188413ec20 con 0x7f188413e820 2026-02-12T18:10:34.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.215+0000 7f18894c0640 1 --2- 10.20.193.48:0/3951392333 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f188413e820 0x7f188412a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.215+0000 7f18894c0640 10 monclient: get_auth_request con 0x7f188413e820 auth_method 0 2026-02-12T18:10:34.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.215+0000 7f18894c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.215+0000 7f18894c0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.215+0000 7f18894c0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.215+0000 7f18894c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.215+0000 7f18894c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.215+0000 7f18894c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.215+0000 7f18894c0640 10 monclient(hunting): handle_auth_done global_id 5743 payload 824 2026-02-12T18:10:34.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.215+0000 7f18894c0640 1 -- 10.20.193.48:0/3951392333 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1884097de0 con 0x7f188413e820 2026-02-12T18:10:34.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.218+0000 7f18894c0640 1 -- 10.20.193.48:0/3951392333 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f188413e820 msgr2=0x7f188412a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:34.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.218+0000 7f18894c0640 1 --2- 10.20.193.48:0/3951392333 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f188413e820 0x7f188412a3f0 secure :-1 s=READY pgs=313 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1878016000 tx=0x7f1878003810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.218+0000 7f18727fc640 1 -- 10.20.193.48:0/3951392333 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f187800de60 con 0x7f188413e820 2026-02-12T18:10:34.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.218+0000 7f18727fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.218+0000 7f18727fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:10:34.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.218+0000 7f18727fc640 10 monclient: dump: 2026-02-12T18:10:34.240 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.240 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.240 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.240 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.240 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.240 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.240 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.240 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.240 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.240 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.240 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.240 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.240 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.240 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.241 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.241 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.218+0000 7f18727fc640 1 -- 10.20.193.48:0/3951392333 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10182 (secure 0 0 0) 0x7f1878014b90 con 0x7f188413e820 2026-02-12T18:10:34.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.218+0000 7f18727fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:10:34.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.218+0000 7f18727fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:10:34.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.218+0000 7f18727fc640 1 -- 10.20.193.48:0/3951392333 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f188413e820 msgr2=0x7f188412a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.218+0000 7f18727fc640 1 --2- 10.20.193.48:0/3951392333 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f188413e820 0x7f188412a3f0 secure :-1 s=READY pgs=313 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1878016000 tx=0x7f1878003810 comp rx=0 tx=0).stop 2026-02-12T18:10:34.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.218+0000 7f18727fc640 1 -- 10.20.193.48:0/3951392333 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f188413e820 msgr2=0x7f188412a3f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:34.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.218+0000 7f18727fc640 1 --2- 10.20.193.48:0/3951392333 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f188413e820 0x7f188412a3f0 secure :-1 s=CLOSED pgs=313 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1878016000 tx=0x7f1878003810 comp rx=0 tx=0).stop 2026-02-12T18:10:34.241 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:10:34.242 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:10:34.242 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:10:34.242 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:10:34.242 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 46, 2026-02-12T18:10:34.242 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 289015, 2026-02-12T18:10:34.242 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:10:34.242 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:10:34.242 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:10:34.242 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:10:34.242 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:10:34.242 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:10:34.242 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:10:34.242 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:10:34.242 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:10:34.242 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:10:34.242 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:34.243 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 8, 2026-02-12T18:10:34.243 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:34.243 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:10:34.243 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:10:34.243 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:34.243 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:34.243 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:34.243 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:34.243 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:34.243 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:34.243 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:34.243 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:34.243 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:34.243 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:34.243 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:34.243 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:34.244 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:34.244 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:34.244 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:10:34.244 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:10:34.244 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:34.244 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:34.244 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:34.244 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:34.244 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:34.244 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:34.244 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:34.244 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:34.244 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:34.244 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:34.244 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:34.244 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:34.244 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:34.245 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.245 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.245 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:10:34.245 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:10:34.245 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:10:34.245 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:10:34.245 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:10:34.245 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:10:34.245 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:34.245 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:34.245 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:10:34.245 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:10:34.245 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:10:34.245 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:10:34.245 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:10:34.245 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:10:34.245 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:10:34.245 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:34.246 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:10:34.246 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:34.246 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:34.246 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:34.246 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:34.246 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:34.246 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:34.246 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:34.246 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:34.246 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:34.246 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:34.246 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:34.246 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:34.246 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:34.246 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:34.246 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:10:34.246 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.246 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:10:34.247 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.247 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:10:34.247 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:10:34.247 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.247 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.247 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.247 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.247 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:10:34.247 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.247 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.247 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.247 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.247 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:10:34.247 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.247 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.247 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.248 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.248 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:10:34.248 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:10:34.248 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.248 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.248 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:10:34.248 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.248 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.248 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.248 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:10:34.248 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:10:34.248 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.248 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.248 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.248 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.248 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:10:34.248 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.248 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.248 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.249 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.249 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:10:34.249 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.249 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.249 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.249 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.249 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:10:34.249 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:10:34.249 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.249 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.249 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:10:34.249 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.249 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.249 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.249 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:10:34.249 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:10:34.249 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.249 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.249 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.249 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.250 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:10:34.250 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.250 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.250 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.250 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.250 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:10:34.250 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.250 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.250 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.250 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.250 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:10:34.250 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:10:34.250 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.250 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.250 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:10:34.250 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.250 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.250 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.251 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:10:34.251 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:10:34.251 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.251 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.251 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.251 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.251 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:10:34.251 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.251 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.251 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.251 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.251 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:10:34.251 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.251 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.251 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.251 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.251 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:10:34.251 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:10:34.251 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.251 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.251 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:10:34.251 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.252 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.252 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.252 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:10:34.252 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:10:34.252 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.252 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.252 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.252 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.252 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:10:34.252 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.252 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.252 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.252 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.252 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:10:34.252 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.252 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.252 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.252 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.252 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:10:34.252 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:10:34.252 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.253 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.253 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:34.253 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.253 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.253 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.253 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:10:34.253 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:10:34.253 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.253 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.253 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.253 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.253 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:10:34.253 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.253 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.253 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.253 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.253 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:10:34.253 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.253 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.253 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.253 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.253 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:10:34.254 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:10:34.254 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.254 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.254 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:10:34.254 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.254 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.254 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.254 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:10:34.254 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:10:34.254 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.254 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.254 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.254 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.254 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:10:34.254 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.254 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.254 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.254 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.254 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:10:34.254 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.254 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.254 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.254 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.255 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:10:34.255 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:10:34.255 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.255 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.255 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:34.255 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.255 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.255 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.255 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:10:34.255 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:10:34.255 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.255 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.255 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.255 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.255 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:10:34.255 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.255 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.255 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.255 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.255 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:10:34.255 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.256 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.256 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.256 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.256 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:10:34.256 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:10:34.256 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.256 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.256 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:10:34.256 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.256 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.256 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.256 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:10:34.256 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:10:34.256 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.256 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.256 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.256 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.256 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:10:34.256 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.256 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.256 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.256 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.256 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:10:34.256 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.256 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.257 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.257 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.257 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:10:34.257 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:10:34.257 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.257 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.257 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:10:34.257 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.257 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.257 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.257 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.257 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:10:34.257 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:10:34.257 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.257 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:34.257 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:34.257 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:34.257 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.257 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:34.257 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:10:34.257 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.257 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:34.257 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:34.258 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:10:34.258 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.258 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:34.258 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:10:34.258 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.258 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:34.258 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:34.258 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:10:34.258 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.258 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.258 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.258 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:10:34.258 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:10:34.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.218+0000 7f188bf4c640 1 -- 10.20.193.48:0/3951392333 >> v2:10.20.193.111:6812/977811348 conn(0x7f185403f800 msgr2=0x7f185405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.218+0000 7f188bf4c640 1 --2- 10.20.193.48:0/3951392333 >> v2:10.20.193.111:6812/977811348 conn(0x7f185403f800 0x7f185405fcb0 secure :-1 s=READY pgs=304 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f188408c3e0 tx=0x7f1880009040 comp rx=0 tx=0).stop 2026-02-12T18:10:34.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.218+0000 7f188bf4c640 10 monclient: shutdown 2026-02-12T18:10:34.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.218+0000 7f188bf4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:34.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.218+0000 7f188bf4c640 1 -- 10.20.193.48:0/3951392333 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f188405c950 msgr2=0x7f188412d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.218+0000 7f188a4c2640 1 -- 10.20.193.48:0/3951392333 reap_dead start 2026-02-12T18:10:34.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.218+0000 7f188bf4c640 1 --2- 10.20.193.48:0/3951392333 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f188405c950 0x7f188412d970 secure :-1 s=READY pgs=22 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f187402f2c0 tx=0x7f1874004770 comp rx=0 tx=0).stop 2026-02-12T18:10:34.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.218+0000 7f188bf4c640 1 -- 10.20.193.48:0/3951392333 shutdown_connections 2026-02-12T18:10:34.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.218+0000 7f188bf4c640 1 --2- 10.20.193.48:0/3951392333 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f188405c950 0x7f188412d970 unknown :-1 s=CLOSED pgs=22 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.218+0000 7f188bf4c640 1 -- 10.20.193.48:0/3951392333 >> 10.20.193.48:0/3951392333 conn(0x7f18840548a0 msgr2=0x7f1884122f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:34.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.218+0000 7f188bf4c640 1 -- 10.20.193.48:0/3951392333 shutdown_connections 2026-02-12T18:10:34.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.218+0000 7f188bf4c640 1 -- 10.20.193.48:0/3951392333 wait complete. 2026-02-12T18:10:34.260 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:10:34.260 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2026-02-12T18:10:34.260 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2026-02-12T18:10:34.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.326+0000 7fd3e170c640 10 monclient: get_monmap_and_config 2026-02-12T18:10:34.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.326+0000 7fd3e170c640 10 monclient: build_initial_monmap 2026-02-12T18:10:34.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.326+0000 7fd3e170c640 10 monclient: monmap: 2026-02-12T18:10:34.329 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:34.329 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.329 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:10:34.327584+0000 2026-02-12T18:10:34.329 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:10:34.327584+0000 2026-02-12T18:10:34.329 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:34.329 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.329 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:10:34.329 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:10:34.329 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:34.329 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:34.329 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:34.329 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:34.329 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:34.329 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:34.329 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:34.329 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:10:34.329 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:10:34.329 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.326+0000 7fd3e170c640 1 Processor -- start 2026-02-12T18:10:34.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.326+0000 7fd3e170c640 1 -- start start 2026-02-12T18:10:34.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.326+0000 7fd3e170c640 10 monclient: init 2026-02-12T18:10:34.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3e170c640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:34.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3e170c640 10 monclient: _add_conns ranks=[9,3,5,10,6,8,1,2,7,4,0] 2026-02-12T18:10:34.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3e170c640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fd3dc05c950 0x7fd3dc05cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3e170c640 10 monclient(hunting): picked mon.noname-a con 0x7fd3dc05c950 addr v2:10.20.193.48:3300/0 2026-02-12T18:10:34.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3e170c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd3dc05e490 0x7fd3dc05d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3e170c640 10 monclient(hunting): picked mon.noname-g con 0x7fd3dc05e490 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:10:34.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3e170c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd3dc13db70 0x7fd3dc13e010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3e170c640 10 monclient(hunting): picked mon.noname-h con 0x7fd3dc13db70 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:10:34.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3e170c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3e170c640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7fd3dc05ddd0 con 0x7fd3dc05c950 2026-02-12T18:10:34.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3e170c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3e170c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd3dc05d7a0 con 0x7fd3dc05e490 2026-02-12T18:10:34.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3e170c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3e170c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fd3dc092990 con 0x7fd3dc13db70 2026-02-12T18:10:34.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3e170c640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:34.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3e170c640 10 monclient(hunting): authenticate will time out at 873.053442s 2026-02-12T18:10:34.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3daffd640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fd3dc05c950 0x7fd3dc05cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3daffd640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fd3dc05c950 0x7fd3dc05cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:42498/0 (socket says 10.20.193.48:42498) 2026-02-12T18:10:34.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3daffd640 1 -- 10.20.193.48:0/1033335638 learned_addr learned my addr 10.20.193.48:0/1033335638 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:34.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3daffd640 10 monclient(hunting): get_auth_request con 0x7fd3dc05c950 auth_method 0 2026-02-12T18:10:34.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3daffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3daffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3daffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3daffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3daffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3db7fe640 1 --2- 10.20.193.48:0/1033335638 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd3dc13db70 0x7fd3dc13e010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3db7fe640 10 monclient(hunting): get_auth_request con 0x7fd3dc13db70 auth_method 0 2026-02-12T18:10:34.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3db7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3da7fc640 1 --2- 10.20.193.48:0/1033335638 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd3dc05e490 0x7fd3dc05d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3da7fc640 10 monclient(hunting): get_auth_request con 0x7fd3dc05e490 auth_method 0 2026-02-12T18:10:34.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3da7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3daffd640 10 monclient(hunting): handle_auth_done global_id 5976 payload 274 2026-02-12T18:10:34.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3daffd640 1 -- 10.20.193.48:0/1033335638 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd3dc13db70 msgr2=0x7fd3dc13e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:34.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3daffd640 1 --2- 10.20.193.48:0/1033335638 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd3dc13db70 0x7fd3dc13e010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3daffd640 1 -- 10.20.193.48:0/1033335638 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd3dc05e490 msgr2=0x7fd3dc05d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:34.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3daffd640 1 --2- 10.20.193.48:0/1033335638 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd3dc05e490 0x7fd3dc05d260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3daffd640 10 monclient: _finish_hunting 0 2026-02-12T18:10:34.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3daffd640 1 monclient: found mon.noname-a 2026-02-12T18:10:34.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3daffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:34.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3daffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:10:34.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.327+0000 7fd3daffd640 1 -- 10.20.193.48:0/1033335638 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3dc04dc20 con 0x7fd3dc05c950 2026-02-12T18:10:34.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3daffd640 1 -- 10.20.193.48:0/1033335638 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd3dc05c950 msgr2=0x7fd3dc05cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:34.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3daffd640 1 --2- 10.20.193.48:0/1033335638 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd3dc05c950 0x7fd3dc05cd20 secure :-1 s=READY pgs=371 gs=1 cs=0 l=1 c_cookie=14863625404894363423 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3d0009060 tx=0x7fd3d002edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce46348e0d333f1f server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3d9ffb640 1 -- 10.20.193.48:0/1033335638 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd3d0035340 con 0x7fd3dc05c950 2026-02-12T18:10:34.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3d9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:10:34.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3d9ffb640 10 monclient: dump: 2026-02-12T18:10:34.337 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.337 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.337 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.337 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.337 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.338 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.338 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.338 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.338 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.338 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.338 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.338 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.338 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.338 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.338 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.338 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3d9ffb640 10 monclient: _finish_auth 0 2026-02-12T18:10:34.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3d9ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:10:34.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3d9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:34.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3d9ffb640 1 -- 10.20.193.48:0/1033335638 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3d00354c0 con 0x7fd3dc05c950 2026-02-12T18:10:34.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3e170c640 5 monclient: authenticate success, global_id 5976 2026-02-12T18:10:34.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3e170c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:10:34.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3d9ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:34.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3d9ffb640 1 -- 10.20.193.48:0/1033335638 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd3d0035af0 con 0x7fd3dc05c950 2026-02-12T18:10:34.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3d9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:10:34.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3d9ffb640 10 monclient: dump: 2026-02-12T18:10:34.339 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.339 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.339 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.339 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.339 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.339 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.339 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.339 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.339 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.339 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.339 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.339 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.339 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.339 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.339 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.339 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3e170c640 10 monclient: get_monmap_and_config success 2026-02-12T18:10:34.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3e170c640 4 set_mon_vals no callback set 2026-02-12T18:10:34.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3e170c640 10 monclient: shutdown 2026-02-12T18:10:34.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3e170c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:34.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3e170c640 1 -- 10.20.193.48:0/1033335638 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd3dc05c950 msgr2=0x7fd3dc05cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3e170c640 1 --2- 10.20.193.48:0/1033335638 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd3dc05c950 0x7fd3dc05cd20 secure :-1 s=READY pgs=371 gs=1 cs=0 l=1 c_cookie=14863625404894363423 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3d0009060 tx=0x7fd3d002edf0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3e170c640 1 -- 10.20.193.48:0/1033335638 shutdown_connections 2026-02-12T18:10:34.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3e170c640 1 --2- 10.20.193.48:0/1033335638 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd3dc13db70 0x7fd3dc13e010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3e170c640 1 --2- 10.20.193.48:0/1033335638 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd3dc05e490 0x7fd3dc05d260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3e170c640 1 --2- 10.20.193.48:0/1033335638 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd3dc05c950 0x7fd3dc05cd20 unknown :-1 s=CLOSED pgs=371 gs=1 cs=0 l=1 c_cookie=14863625404894363423 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3e170c640 1 -- 10.20.193.48:0/1033335638 >> 10.20.193.48:0/1033335638 conn(0x7fd3dc0548a0 msgr2=0x7fd3dc097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:34.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.330+0000 7fd3e170c640 1 -- 10.20.193.48:0/1033335638 shutdown_connections 2026-02-12T18:10:34.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3e170c640 1 -- 10.20.193.48:0/1033335638 wait complete. 2026-02-12T18:10:34.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3e170c640 10 monclient: build_initial_monmap 2026-02-12T18:10:34.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3e170c640 10 monclient: monmap: 2026-02-12T18:10:34.340 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:34.340 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:10:34.340 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:10:34.340 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:10:34.340 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:34.340 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.340 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:10:34.341 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:10:34.341 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:34.341 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:34.341 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:34.341 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:34.341 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:34.341 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:34.341 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:34.341 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3e170c640 1 Processor -- start 2026-02-12T18:10:34.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3e170c640 1 -- start start 2026-02-12T18:10:34.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3e170c640 10 monclient: init 2026-02-12T18:10:34.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3e170c640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:34.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3e170c640 10 monclient: _add_conns ranks=[7,5,2,0,4,6,1,3,8] 2026-02-12T18:10:34.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3e170c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd3dc05c950 0x7fd3dc13f3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3e170c640 10 monclient(hunting): picked mon.noname-i con 0x7fd3dc05c950 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:10:34.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3e170c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd3dc05e490 0x7fd3dc13f930 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3e170c640 10 monclient(hunting): picked mon.noname-h con 0x7fd3dc05e490 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:10:34.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3e170c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd3dc13db70 0x7fd3dc13fe70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3e170c640 10 monclient(hunting): picked mon.noname-b con 0x7fd3dc13db70 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:10:34.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3e170c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3e170c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fd3dc08aea0 con 0x7fd3dc13db70 2026-02-12T18:10:34.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3e170c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3e170c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fd3dc089e60 con 0x7fd3dc05e490 2026-02-12T18:10:34.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3e170c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3e170c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fd3dc143f20 con 0x7fd3dc05c950 2026-02-12T18:10:34.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3e170c640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:34.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3e170c640 10 monclient(hunting): authenticate will time out at 873.057875s 2026-02-12T18:10:34.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3db7fe640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd3dc13db70 0x7fd3dc13fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3db7fe640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd3dc13db70 0x7fd3dc13fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:35350/0 (socket says 10.20.193.48:35350) 2026-02-12T18:10:34.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3db7fe640 1 -- 10.20.193.48:0/2524129895 learned_addr learned my addr 10.20.193.48:0/2524129895 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:34.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3db7fe640 10 monclient(hunting): get_auth_request con 0x7fd3dc13db70 auth_method 0 2026-02-12T18:10:34.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3db7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3db7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.331+0000 7fd3db7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3da7fc640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd3dc05e490 0x7fd3dc13f930 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3daffd640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd3dc05c950 0x7fd3dc13f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3db7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3db7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3db7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3da7fc640 10 monclient(hunting): get_auth_request con 0x7fd3dc05e490 auth_method 0 2026-02-12T18:10:34.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3da7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3da7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3daffd640 10 monclient(hunting): get_auth_request con 0x7fd3dc05c950 auth_method 0 2026-02-12T18:10:34.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3daffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3daffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3da7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3da7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3da7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3daffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3daffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3daffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3db7fe640 10 monclient(hunting): handle_auth_done global_id 35741 payload 824 2026-02-12T18:10:34.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3db7fe640 1 -- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd3dc05c950 msgr2=0x7fd3dc13f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3db7fe640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd3dc05c950 0x7fd3dc13f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3db7fe640 1 -- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd3dc05e490 msgr2=0x7fd3dc13f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3db7fe640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd3dc05e490 0x7fd3dc13f930 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3db7fe640 10 monclient: _finish_hunting 0 2026-02-12T18:10:34.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3db7fe640 1 monclient: found mon.noname-b 2026-02-12T18:10:34.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3db7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:34.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3db7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:10:34.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.332+0000 7fd3db7fe640 1 -- 10.20.193.48:0/2524129895 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3d00094f0 con 0x7fd3dc13db70 2026-02-12T18:10:34.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3db7fe640 1 -- 10.20.193.48:0/2524129895 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd3dc13db70 msgr2=0x7fd3dc13fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:34.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3db7fe640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd3dc13db70 0x7fd3dc13fe70 secure :-1 s=READY pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3cc00a340 tx=0x7fd3cc00fc80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3bb7fe640 1 -- 10.20.193.48:0/2524129895 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd3cc00fe80 con 0x7fd3dc13db70 2026-02-12T18:10:34.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3bb7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:10:34.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3bb7fe640 10 monclient: dump: 2026-02-12T18:10:34.350 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.350 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.350 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.350 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.350 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.350 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.350 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.350 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.350 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.350 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.350 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.350 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.350 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.350 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.350 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.350 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3bb7fe640 10 monclient: _finish_auth 0 2026-02-12T18:10:34.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3bb7fe640 10 monclient: _check_auth_tickets 2026-02-12T18:10:34.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3bb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:34.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3bb7fe640 1 -- 10.20.193.48:0/2524129895 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3cc00dd70 con 0x7fd3dc13db70 2026-02-12T18:10:34.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3e170c640 5 monclient: authenticate success, global_id 35741 2026-02-12T18:10:34.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3e170c640 10 monclient: _renew_subs 2026-02-12T18:10:34.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3e170c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:10:34.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3e170c640 1 -- 10.20.193.48:0/2524129895 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3dc08abc0 con 0x7fd3dc13db70 2026-02-12T18:10:34.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3bb7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:34.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3bb7fe640 1 -- 10.20.193.48:0/2524129895 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd3cc0148d0 con 0x7fd3dc13db70 2026-02-12T18:10:34.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3d97fa640 4 set_mon_vals no callback set 2026-02-12T18:10:34.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3bb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:10:34.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3bb7fe640 10 monclient: dump: 2026-02-12T18:10:34.351 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.351 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.351 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.351 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.351 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.351 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.352 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.352 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.352 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.352 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.352 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.352 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.352 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.352 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.352 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.352 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3e170c640 10 monclient: _renew_subs 2026-02-12T18:10:34.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3e170c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:10:34.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3e170c640 1 -- 10.20.193.48:0/2524129895 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3dc08a8e0 con 0x7fd3dc13db70 2026-02-12T18:10:34.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3db7fe640 1 -- 10.20.193.48:0/2524129895 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd3dc13db70 msgr2=0x7fd3dc13fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-12T18:10:34.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3db7fe640 1 -- 10.20.193.48:0/2524129895 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd3dc13db70 msgr2=0x7fd3dc13fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:10:34.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3db7fe640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd3dc13db70 0x7fd3dc13fe70 secure :-1 s=READY pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3cc00a340 tx=0x7fd3cc00fc80 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:34.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3db7fe640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd3dc13db70 0x7fd3dc13fe70 secure :-1 s=READY pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3cc00a340 tx=0x7fd3cc00fc80 comp rx=0 tx=0).stop 2026-02-12T18:10:34.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3bb7fe640 10 monclient: ms_handle_reset current mon [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:10:34.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3bb7fe640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:34.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3bb7fe640 1 -- 10.20.193.48:0/2524129895 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd3dc13db70 msgr2=0x7fd3dc13fe70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:34.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.334+0000 7fd3bb7fe640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd3dc13db70 0x7fd3dc13fe70 unknown :-1 s=CLOSED pgs=224 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3bb7fe640 10 monclient: _add_conns ranks=[6,8,5,1,3,7,2,4,0] 2026-02-12T18:10:34.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3bb7fe640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd3a8004db0 0x7fd3a8025190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3bb7fe640 10 monclient(hunting): picked mon.d con 0x7fd3a8004db0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:10:34.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3bb7fe640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd3a80258e0 0x7fd3a8045d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3bb7fe640 10 monclient(hunting): picked mon.e con 0x7fd3a80258e0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:10:34.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3bb7fe640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd3dc05e490 0x7fd3a8066820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3e170c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:34.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3bb7fe640 10 monclient(hunting): picked mon.h con 0x7fd3dc05e490 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:10:34.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3bb7fe640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3bb7fe640 1 -- 10.20.193.48:0/2524129895 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fd3a8067280 con 0x7fd3dc05e490 2026-02-12T18:10:34.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3bb7fe640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3bb7fe640 1 -- 10.20.193.48:0/2524129895 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fd3a80673c0 con 0x7fd3a8004db0 2026-02-12T18:10:34.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3bb7fe640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3bb7fe640 1 -- 10.20.193.48:0/2524129895 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fd3a8067530 con 0x7fd3a80258e0 2026-02-12T18:10:34.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3bb7fe640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:34.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3e170c640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd3dc13f930 0x7fd3dc1403b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3e170c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3e170c640 1 -- 10.20.193.48:0/2524129895 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd3dc063180 con 0x7fd3dc13f930 2026-02-12T18:10:34.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3da7fc640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd3a80258e0 0x7fd3a8045d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3da7fc640 10 monclient(hunting): get_auth_request con 0x7fd3a80258e0 auth_method 0 2026-02-12T18:10:34.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3da7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3da7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3da7fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:34.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3daffd640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd3a8004db0 0x7fd3a8025190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3daffd640 10 monclient(hunting): get_auth_request con 0x7fd3a8004db0 auth_method 0 2026-02-12T18:10:34.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3daffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3daffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3daffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:34.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3da7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3da7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3da7fc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:10:34.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3daffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3daffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3db7fe640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd3dc05e490 0x7fd3a8066820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3daffd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:10:34.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3daffd640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd3dc13f930 0x7fd3dc1403b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3da7fc640 10 monclient(hunting): handle_auth_done global_id 35741 payload 293 2026-02-12T18:10:34.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3da7fc640 1 -- 10.20.193.48:0/2524129895 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd3a8004db0 msgr2=0x7fd3a8025190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3da7fc640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd3a8004db0 0x7fd3a8025190 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3da7fc640 1 -- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd3dc05e490 msgr2=0x7fd3a8066820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3da7fc640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd3dc05e490 0x7fd3a8066820 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3da7fc640 10 monclient: _finish_hunting 0 2026-02-12T18:10:34.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3da7fc640 1 monclient: found mon.e 2026-02-12T18:10:34.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3da7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:34.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3da7fc640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:10:34.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3da7fc640 1 -- 10.20.193.48:0/2524129895 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) -- 0x7fd3a8003fd0 con 0x7fd3a80258e0 2026-02-12T18:10:34.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3da7fc640 10 monclient: _finish_auth 0 2026-02-12T18:10:34.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3da7fc640 10 monclient: _check_auth_tickets 2026-02-12T18:10:34.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3da7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:34.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3daffd640 10 monclient: get_auth_request con 0x7fd3dc13f930 auth_method 0 2026-02-12T18:10:34.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3daffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3daffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3daffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3daffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3daffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3daffd640 10 monclient(hunting): handle_auth_done global_id 64227 payload 824 2026-02-12T18:10:34.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.335+0000 7fd3daffd640 1 -- 10.20.193.48:0/2524129895 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd3dc13fd00 con 0x7fd3dc13f930 2026-02-12T18:10:34.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.337+0000 7fd3da7fc640 1 -- 10.20.193.48:0/2524129895 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd3a80258e0 msgr2=0x7fd3a8045d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:34.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.337+0000 7fd3da7fc640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd3a80258e0 0x7fd3a8045d00 secure :-1 s=READY pgs=23 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3dc140b10 tx=0x7fd3cc009040 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.337+0000 7fd3bb7fe640 1 -- 10.20.193.48:0/2524129895 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd3c400c070 con 0x7fd3a80258e0 2026-02-12T18:10:34.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.337+0000 7fd3bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.337+0000 7fd3bb7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:10:34.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.337+0000 7fd3bb7fe640 10 monclient: dump: 2026-02-12T18:10:34.356 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.356 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.356 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.356 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.356 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.356 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.356 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.356 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.356 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.356 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.356 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.356 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.356 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.357 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.357 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.357 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.337+0000 7fd3bb7fe640 1 -- 10.20.193.48:0/2524129895 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3c40044f0 con 0x7fd3a80258e0 2026-02-12T18:10:34.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.337+0000 7fd3bb7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:34.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.337+0000 7fd3d8ff9640 4 set_mon_vals no callback set 2026-02-12T18:10:34.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.338+0000 7fd3daffd640 1 -- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd3dc13f930 msgr2=0x7fd3dc1403b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:34.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.338+0000 7fd3daffd640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd3dc13f930 0x7fd3dc1403b0 secure :-1 s=READY pgs=17 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3d0009060 tx=0x7fd3d00047e0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.338+0000 7fd3bb7fe640 1 -- 10.20.193.48:0/2524129895 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fd3c4004030 con 0x7fd3a80258e0 2026-02-12T18:10:34.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.338+0000 7fd3bb7fe640 1 --2- 10.20.193.48:0/2524129895 >> v2:10.20.193.111:6812/977811348 conn(0x7fd3a80a2c90 0x7fd3a80c3140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.338+0000 7fd3bb7fe640 1 -- 10.20.193.48:0/2524129895 <== mon.8 v2:10.20.193.48:3304/0 4 ==== osd_map(214..214 src has 1..214) ==== 3897+0+0 (secure 0 0 0) 0x7fd3c4051060 con 0x7fd3a80258e0 2026-02-12T18:10:34.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.338+0000 7fd3bb7fe640 1 -- 10.20.193.48:0/2524129895 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd3d0003da0 con 0x7fd3dc13f930 2026-02-12T18:10:34.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.338+0000 7fd3bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.338+0000 7fd3bb7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:10:34.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.338+0000 7fd3bb7fe640 10 monclient: dump: 2026-02-12T18:10:34.357 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.357 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.357 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.357 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.357 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.357 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.358 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.358 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.358 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.358 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.358 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.358 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.358 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.358 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.358 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.358 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.338+0000 7fd3bb7fe640 1 -- 10.20.193.48:0/2524129895 <== mon.3 v2:10.20.193.111:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fd3d00038e0 con 0x7fd3dc13f930 2026-02-12T18:10:34.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.338+0000 7fd3bb7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:34.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.338+0000 7fd3bb7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:10:34.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.338+0000 7fd3bb7fe640 1 -- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd3dc13f930 msgr2=0x7fd3dc1403b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.338+0000 7fd3bb7fe640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd3dc13f930 0x7fd3dc1403b0 secure :-1 s=READY pgs=17 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3d0009060 tx=0x7fd3d00047e0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.338+0000 7fd3bb7fe640 1 -- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd3dc13f930 msgr2=0x7fd3dc1403b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:34.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.338+0000 7fd3bb7fe640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd3dc13f930 0x7fd3dc1403b0 secure :-1 s=CLOSED pgs=17 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3d0009060 tx=0x7fd3d00047e0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.338+0000 7fd3db7fe640 1 -- 10.20.193.48:0/2524129895 reap_dead start 2026-02-12T18:10:34.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.338+0000 7fd3db7fe640 1 --2- 10.20.193.48:0/2524129895 >> v2:10.20.193.111:6812/977811348 conn(0x7fd3a80a2c90 0x7fd3a80c3140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.338+0000 7fd3db7fe640 10 monclient: get_auth_request con 0x7fd3a80a2c90 auth_method 0 2026-02-12T18:10:34.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.341+0000 7fd3db7fe640 1 --2- 10.20.193.48:0/2524129895 >> v2:10.20.193.111:6812/977811348 conn(0x7fd3a80a2c90 0x7fd3a80c3140 secure :-1 s=READY pgs=305 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3cc0057f0 tx=0x7fd3cc015000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.341+0000 7fd3e170c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:10:34.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.341+0000 7fd3e170c640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd3dc13f3f0 0x7fd3dc13fe70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.341+0000 7fd3e170c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.341+0000 7fd3e170c640 1 -- 10.20.193.48:0/2524129895 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd3dc13e7a0 con 0x7fd3dc13f3f0 2026-02-12T18:10:34.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.342+0000 7fd3daffd640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd3dc13f3f0 0x7fd3dc13fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.342+0000 7fd3daffd640 10 monclient: get_auth_request con 0x7fd3dc13f3f0 auth_method 0 2026-02-12T18:10:34.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.342+0000 7fd3daffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.342+0000 7fd3daffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.342+0000 7fd3daffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.342+0000 7fd3daffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.342+0000 7fd3daffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.342+0000 7fd3daffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.342+0000 7fd3daffd640 10 monclient(hunting): handle_auth_done global_id 64236 payload 824 2026-02-12T18:10:34.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.342+0000 7fd3daffd640 1 -- 10.20.193.48:0/2524129895 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd3dc13f7c0 con 0x7fd3dc13f3f0 2026-02-12T18:10:34.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.344+0000 7fd3daffd640 1 -- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd3dc13f3f0 msgr2=0x7fd3dc13fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:34.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.344+0000 7fd3daffd640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd3dc13f3f0 0x7fd3dc13fe70 secure :-1 s=READY pgs=18 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3d0009820 tx=0x7fd3d0004770 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.344+0000 7fd3bb7fe640 1 -- 10.20.193.48:0/2524129895 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd3d0037440 con 0x7fd3dc13f3f0 2026-02-12T18:10:34.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.344+0000 7fd3bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.344+0000 7fd3bb7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:10:34.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.344+0000 7fd3bb7fe640 10 monclient: dump: 2026-02-12T18:10:34.360 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.360 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.360 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.360 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.360 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.360 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.360 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.360 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.360 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.360 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.360 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.360 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.360 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.360 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.360 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.360 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.345+0000 7fd3bb7fe640 1 -- 10.20.193.48:0/2524129895 <== mon.3 v2:10.20.193.111:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7fd3d0035a50 con 0x7fd3dc13f3f0 2026-02-12T18:10:34.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.345+0000 7fd3bb7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:10:34.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.345+0000 7fd3bb7fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:10:34.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.345+0000 7fd3bb7fe640 1 -- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd3dc13f3f0 msgr2=0x7fd3dc13fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.345+0000 7fd3bb7fe640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd3dc13f3f0 0x7fd3dc13fe70 secure :-1 s=READY pgs=18 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3d0009820 tx=0x7fd3d0004770 comp rx=0 tx=0).stop 2026-02-12T18:10:34.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.345+0000 7fd3bb7fe640 1 -- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd3dc13f3f0 msgr2=0x7fd3dc13fe70 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:34.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.345+0000 7fd3bb7fe640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd3dc13f3f0 0x7fd3dc13fe70 secure :-1 s=CLOSED pgs=18 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3d0009820 tx=0x7fd3d0004770 comp rx=0 tx=0).stop 2026-02-12T18:10:34.361 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:10:34.361 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:10:34.361 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:10:34.361 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:10:34.361 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 46, 2026-02-12T18:10:34.361 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 15147, 2026-02-12T18:10:34.361 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:10:34.361 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:10:34.361 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:10:34.362 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:10:34.362 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:10:34.362 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:10:34.362 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:10:34.362 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:10:34.362 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:10:34.362 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:10:34.362 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:34.362 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 8, 2026-02-12T18:10:34.362 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:34.362 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:10:34.362 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:10:34.362 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:34.362 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:34.362 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:34.362 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:34.362 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:34.362 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:34.362 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:34.362 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:34.363 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:34.363 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:34.363 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:34.363 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:34.363 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:34.363 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:34.363 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:10:34.363 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:10:34.363 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:34.363 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:34.363 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:34.363 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:34.363 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:34.363 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:34.363 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:34.363 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:34.363 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:34.363 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:34.363 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:34.363 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:34.363 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:34.363 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.364 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.364 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:10:34.364 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:10:34.364 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:10:34.364 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:10:34.364 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:10:34.364 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:10:34.364 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:34.364 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:34.364 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:10:34.364 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:10:34.364 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:10:34.364 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:10:34.364 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:10:34.364 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:10:34.364 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:10:34.364 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:34.364 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:10:34.364 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:34.364 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:34.364 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:34.365 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:34.365 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:34.365 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:34.365 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:34.365 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:34.365 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:34.365 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:34.365 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:34.365 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:34.365 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:34.365 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:34.365 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:10:34.365 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.365 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:10:34.365 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.365 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:10:34.365 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:10:34.365 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.365 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.365 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.365 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.365 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:10:34.365 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.366 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.366 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.366 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.366 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:10:34.366 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.366 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.366 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.366 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.366 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:10:34.366 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:10:34.366 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.366 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.366 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:10:34.366 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.366 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.366 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.366 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:10:34.366 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:10:34.366 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.366 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.366 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.366 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.366 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:10:34.366 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.367 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.367 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.367 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.367 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:10:34.367 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.367 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.367 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.367 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.367 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:10:34.367 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:10:34.367 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.367 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.367 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:10:34.367 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.367 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.367 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.367 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:10:34.367 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:10:34.367 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.367 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.367 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.367 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.367 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:10:34.367 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.368 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.368 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.368 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.368 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:10:34.368 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.368 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.368 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.368 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.368 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:10:34.368 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:10:34.368 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.368 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.368 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:10:34.368 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.368 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.368 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.368 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:10:34.368 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:10:34.368 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.368 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.368 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.368 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.368 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:10:34.368 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.369 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.369 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.369 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.369 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:10:34.369 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.369 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.369 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.369 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.369 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:10:34.369 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:10:34.369 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.369 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.369 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:10:34.369 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.369 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.369 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.369 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:10:34.369 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:10:34.369 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.369 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.369 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.369 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.369 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:10:34.369 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.369 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.370 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.370 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.370 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:10:34.370 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.370 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.370 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.370 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.370 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:10:34.370 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:10:34.370 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.370 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.370 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:34.370 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.370 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.370 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.370 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:10:34.370 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:10:34.370 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.370 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.370 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.370 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.370 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:10:34.370 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.370 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.371 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.371 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.371 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:10:34.371 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.371 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.371 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.371 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.371 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:10:34.371 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:10:34.371 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.371 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.371 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:10:34.371 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.371 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.371 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.371 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:10:34.371 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:10:34.371 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.371 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.371 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.371 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.371 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:10:34.371 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.371 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.371 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.371 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.372 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:10:34.372 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.372 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.372 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.372 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.372 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:10:34.372 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:10:34.372 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.372 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.372 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:34.372 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.372 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.372 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.372 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:10:34.372 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:10:34.372 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.372 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.372 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.372 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.372 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:10:34.372 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.372 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.372 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.372 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.372 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:10:34.372 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.373 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:10:34.374 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:10:34.374 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.374 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.374 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:10:34.374 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.374 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.374 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.374 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.374 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:10:34.374 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:10:34.374 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.374 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:34.374 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:34.374 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:34.374 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.374 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:34.374 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:10:34.374 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.374 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:34.374 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:34.374 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:34.374 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.374 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.374 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.374 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:10:34.374 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:10:34.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.345+0000 7fd3e170c640 1 -- 10.20.193.48:0/2524129895 >> v2:10.20.193.111:6812/977811348 conn(0x7fd3a80a2c90 msgr2=0x7fd3a80c3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.345+0000 7fd3e170c640 1 --2- 10.20.193.48:0/2524129895 >> v2:10.20.193.111:6812/977811348 conn(0x7fd3a80a2c90 0x7fd3a80c3140 secure :-1 s=READY pgs=305 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3cc0057f0 tx=0x7fd3cc015000 comp rx=0 tx=0).stop 2026-02-12T18:10:34.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.345+0000 7fd3e170c640 10 monclient: shutdown 2026-02-12T18:10:34.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.345+0000 7fd3e170c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:34.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.345+0000 7fd3e170c640 1 -- 10.20.193.48:0/2524129895 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd3a80258e0 msgr2=0x7fd3a8045d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.345+0000 7fd3e170c640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd3a80258e0 0x7fd3a8045d00 secure :-1 s=READY pgs=23 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd3dc140b10 tx=0x7fd3cc009040 comp rx=0 tx=0).stop 2026-02-12T18:10:34.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.345+0000 7fd3e170c640 1 -- 10.20.193.48:0/2524129895 shutdown_connections 2026-02-12T18:10:34.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.345+0000 7fd3e170c640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd3a80258e0 0x7fd3a8045d00 unknown :-1 s=CLOSED pgs=23 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.345+0000 7fd3e170c640 1 --2- 10.20.193.48:0/2524129895 >> v2:10.20.193.111:6812/977811348 conn(0x7fd3a80a2c90 0x7fd3a80c3140 unknown :-1 s=CLOSED pgs=305 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.345+0000 7fd3e170c640 1 --2- 10.20.193.48:0/2524129895 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd3dc13f3f0 0x7fd3dc13fe70 unknown :-1 s=CLOSED pgs=18 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.345+0000 7fd3e170c640 1 -- 10.20.193.48:0/2524129895 >> 10.20.193.48:0/2524129895 conn(0x7fd3dc0548a0 msgr2=0x7fd3dc093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:34.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.345+0000 7fd3e170c640 1 -- 10.20.193.48:0/2524129895 shutdown_connections 2026-02-12T18:10:34.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.345+0000 7fd3e170c640 1 -- 10.20.193.48:0/2524129895 wait complete. 2026-02-12T18:10:34.376 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:10:34.376 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2026-02-12T18:10:34.376 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2026-02-12T18:10:34.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.442+0000 7fa90c50c640 10 monclient: get_monmap_and_config 2026-02-12T18:10:34.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.442+0000 7fa90c50c640 10 monclient: build_initial_monmap 2026-02-12T18:10:34.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.442+0000 7fa90c50c640 10 monclient: monmap: 2026-02-12T18:10:34.444 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:34.445 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.445 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:10:34.443816+0000 2026-02-12T18:10:34.445 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:10:34.443816+0000 2026-02-12T18:10:34.445 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:34.445 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.445 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:10:34.445 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:10:34.445 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:34.445 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:34.445 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:34.445 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:34.446 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:34.446 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:34.446 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:34.446 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:10:34.446 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:10:34.446 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90c50c640 1 Processor -- start 2026-02-12T18:10:34.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90c50c640 1 -- start start 2026-02-12T18:10:34.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90c50c640 10 monclient: init 2026-02-12T18:10:34.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90c50c640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:34.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90c50c640 10 monclient: _add_conns ranks=[5,6,10,1,3,8,7,0,4,2,9] 2026-02-12T18:10:34.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90c50c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa90405c950 0x7fa90405cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90c50c640 10 monclient(hunting): picked mon.noname-h con 0x7fa90405c950 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:10:34.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90c50c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa90405e490 0x7fa90405d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90c50c640 10 monclient(hunting): picked mon.noname-d con 0x7fa90405e490 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:10:34.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90c50c640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7fa90413db70 0x7fa90413dfe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90c50c640 10 monclient(hunting): picked mon.noname-f con 0x7fa90413db70 addr v2:10.20.193.111:3300/0 2026-02-12T18:10:34.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90c50c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90c50c640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7fa90405ddd0 con 0x7fa90413db70 2026-02-12T18:10:34.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90c50c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90c50c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fa90405d7a0 con 0x7fa90405c950 2026-02-12T18:10:34.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90c50c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90c50c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fa904092990 con 0x7fa90405e490 2026-02-12T18:10:34.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90c50c640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:34.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90c50c640 10 monclient(hunting): authenticate will time out at 873.169597s 2026-02-12T18:10:34.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa909a80640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa90405e490 0x7fa90405d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa909a80640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa90405e490 0x7fa90405d260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:52370/0 (socket says 10.20.193.48:52370) 2026-02-12T18:10:34.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa909a80640 1 -- 10.20.193.48:0/3105456074 learned_addr learned my addr 10.20.193.48:0/3105456074 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:34.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa909a80640 10 monclient(hunting): get_auth_request con 0x7fa90405e490 auth_method 0 2026-02-12T18:10:34.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa909a80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa909a80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa909a80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa909a80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa909a80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90a281640 1 --2- 10.20.193.48:0/3105456074 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa90405c950 0x7fa90405cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90aa82640 1 --2- 10.20.193.48:0/3105456074 >> v2:10.20.193.111:3300/0 conn(0x7fa90413db70 0x7fa90413dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa909a80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90a281640 10 monclient(hunting): get_auth_request con 0x7fa90405c950 auth_method 0 2026-02-12T18:10:34.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90a281640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90a281640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90a281640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90aa82640 10 monclient(hunting): get_auth_request con 0x7fa90413db70 auth_method 0 2026-02-12T18:10:34.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90aa82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90aa82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90aa82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa909a80640 10 monclient(hunting): handle_auth_done global_id 5649 payload 274 2026-02-12T18:10:34.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa909a80640 1 -- 10.20.193.48:0/3105456074 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa90405c950 msgr2=0x7fa90405cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:34.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa909a80640 1 --2- 10.20.193.48:0/3105456074 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa90405c950 0x7fa90405cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa909a80640 1 -- 10.20.193.48:0/3105456074 >> v2:10.20.193.111:3300/0 conn(0x7fa90413db70 msgr2=0x7fa90413dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:34.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa909a80640 1 --2- 10.20.193.48:0/3105456074 >> v2:10.20.193.111:3300/0 conn(0x7fa90413db70 0x7fa90413dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa909a80640 10 monclient: _finish_hunting 0 2026-02-12T18:10:34.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa909a80640 1 monclient: found mon.noname-d 2026-02-12T18:10:34.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa909a80640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:34.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa909a80640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:10:34.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa909a80640 1 -- 10.20.193.48:0/3105456074 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa90404dc20 con 0x7fa90405e490 2026-02-12T18:10:34.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.443+0000 7fa90aa82640 1 --2- 10.20.193.48:0/3105456074 >> v2:10.20.193.111:3300/0 conn(0x7fa90413db70 0x7fa90413dfe0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:10:34.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa909a80640 1 -- 10.20.193.48:0/3105456074 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa90405e490 msgr2=0x7fa90405d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:34.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa909a80640 1 --2- 10.20.193.48:0/3105456074 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa90405e490 0x7fa90405d260 secure :-1 s=READY pgs=198 gs=1 cs=0 l=1 c_cookie=10834046281731394452 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8f8009060 tx=0x7fa8f802edf0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=965a43b126bdcb94 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90927f640 1 -- 10.20.193.48:0/3105456074 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa8f8035340 con 0x7fa90405e490 2026-02-12T18:10:34.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90927f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90927f640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:10:34.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90927f640 10 monclient: dump: 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90927f640 10 monclient: _finish_auth 0 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90927f640 10 monclient: _check_auth_tickets 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90927f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90927f640 1 -- 10.20.193.48:0/3105456074 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8f80354c0 con 0x7fa90405e490 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90927f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90c50c640 5 monclient: authenticate success, global_id 5649 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90927f640 1 -- 10.20.193.48:0/3105456074 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa8f8035af0 con 0x7fa90405e490 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90927f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90927f640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90927f640 10 monclient: dump: 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.453 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90c50c640 10 monclient: get_monmap_and_config success 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90c50c640 4 set_mon_vals no callback set 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90c50c640 10 monclient: shutdown 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90c50c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90c50c640 1 -- 10.20.193.48:0/3105456074 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa90405e490 msgr2=0x7fa90405d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90c50c640 1 --2- 10.20.193.48:0/3105456074 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa90405e490 0x7fa90405d260 secure :-1 s=READY pgs=198 gs=1 cs=0 l=1 c_cookie=10834046281731394452 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8f8009060 tx=0x7fa8f802edf0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90c50c640 1 -- 10.20.193.48:0/3105456074 shutdown_connections 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90c50c640 1 --2- 10.20.193.48:0/3105456074 >> v2:10.20.193.111:3300/0 conn(0x7fa90413db70 0x7fa90413dfe0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90c50c640 1 --2- 10.20.193.48:0/3105456074 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa90405e490 0x7fa90405d260 unknown :-1 s=CLOSED pgs=198 gs=1 cs=0 l=1 c_cookie=10834046281731394452 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90c50c640 1 --2- 10.20.193.48:0/3105456074 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa90405c950 0x7fa90405cd20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90c50c640 1 -- 10.20.193.48:0/3105456074 >> 10.20.193.48:0/3105456074 conn(0x7fa9040548a0 msgr2=0x7fa904097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90c50c640 1 -- 10.20.193.48:0/3105456074 shutdown_connections 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.446+0000 7fa90c50c640 1 -- 10.20.193.48:0/3105456074 wait complete. 2026-02-12T18:10:34.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.447+0000 7fa90c50c640 10 monclient: build_initial_monmap 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.447+0000 7fa90c50c640 10 monclient: monmap: 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.447+0000 7fa90c50c640 1 Processor -- start 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.447+0000 7fa90c50c640 1 -- start start 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.447+0000 7fa90c50c640 10 monclient: init 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.447+0000 7fa90c50c640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.447+0000 7fa90c50c640 10 monclient: _add_conns ranks=[2,7,8,5,6,4,0,3,1] 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.447+0000 7fa90c50c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa90405c950 0x7fa90408d7f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.447+0000 7fa90c50c640 10 monclient(hunting): picked mon.noname-b con 0x7fa90405c950 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.447+0000 7fa90c50c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa90405e490 0x7fa90408ef30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.447+0000 7fa90c50c640 10 monclient(hunting): picked mon.noname-i con 0x7fa90405e490 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:10:34.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.447+0000 7fa90c50c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa90413db70 0x7fa90408f470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.447+0000 7fa90c50c640 10 monclient(hunting): picked mon.noname-e con 0x7fa90413db70 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.447+0000 7fa90c50c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.447+0000 7fa90c50c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fa9040913f0 con 0x7fa90405c950 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.447+0000 7fa90c50c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.447+0000 7fa90c50c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fa90413e3b0 con 0x7fa90405e490 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.447+0000 7fa90c50c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.447+0000 7fa90c50c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fa90408cd00 con 0x7fa90413db70 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.447+0000 7fa90c50c640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.447+0000 7fa90c50c640 10 monclient(hunting): authenticate will time out at 873.173917s 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.447+0000 7fa90a281640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa90405c950 0x7fa90408d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.447+0000 7fa90aa82640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa90413db70 0x7fa90408f470 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa90a281640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa90405c950 0x7fa90408d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:35354/0 (socket says 10.20.193.48:35354) 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa90a281640 1 -- 10.20.193.48:0/3916282218 learned_addr learned my addr 10.20.193.48:0/3916282218 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa90a281640 10 monclient(hunting): get_auth_request con 0x7fa90405c950 auth_method 0 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa90a281640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa90a281640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa90a281640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa90aa82640 10 monclient(hunting): get_auth_request con 0x7fa90413db70 auth_method 0 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa90aa82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa90aa82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa90aa82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa90a281640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa90a281640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa90a281640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa90aa82640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa90aa82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa90aa82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa909a80640 1 --2- 10.20.193.48:0/3916282218 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa90405e490 0x7fa90408ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa909a80640 10 monclient(hunting): get_auth_request con 0x7fa90405e490 auth_method 0 2026-02-12T18:10:34.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa909a80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa909a80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa909a80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa90a281640 10 monclient(hunting): handle_auth_done global_id 35750 payload 824 2026-02-12T18:10:34.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa90a281640 1 -- 10.20.193.48:0/3916282218 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa90413db70 msgr2=0x7fa90408f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa90a281640 1 --2- 10.20.193.48:0/3916282218 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa90413db70 0x7fa90408f470 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa90a281640 1 -- 10.20.193.48:0/3916282218 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa90405e490 msgr2=0x7fa90408ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa90a281640 1 --2- 10.20.193.48:0/3916282218 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa90405e490 0x7fa90408ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa90a281640 10 monclient: _finish_hunting 0 2026-02-12T18:10:34.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa90a281640 1 monclient: found mon.noname-b 2026-02-12T18:10:34.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa90a281640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:34.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa90a281640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:10:34.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.448+0000 7fa90a281640 1 -- 10.20.193.48:0/3916282218 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8f80094f0 con 0x7fa90405c950 2026-02-12T18:10:34.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.450+0000 7fa90a281640 1 -- 10.20.193.48:0/3916282218 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa90405c950 msgr2=0x7fa90408d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:34.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.450+0000 7fa90a281640 1 --2- 10.20.193.48:0/3916282218 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa90405c950 0x7fa90408d7f0 secure :-1 s=READY pgs=225 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8f400e730 tx=0x7fa8f400ec00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.450+0000 7fa8eaffd640 1 -- 10.20.193.48:0/3916282218 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa8f400ee60 con 0x7fa90405c950 2026-02-12T18:10:34.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.450+0000 7fa8eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.450+0000 7fa8eaffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:10:34.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.450+0000 7fa8eaffd640 10 monclient: dump: 2026-02-12T18:10:34.459 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.450+0000 7fa8eaffd640 10 monclient: _finish_auth 0 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.450+0000 7fa8eaffd640 10 monclient: _check_auth_tickets 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.450+0000 7fa8eaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.450+0000 7fa8eaffd640 1 -- 10.20.193.48:0/3916282218 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8f400cda0 con 0x7fa90405c950 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.450+0000 7fa90c50c640 5 monclient: authenticate success, global_id 35750 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.450+0000 7fa90c50c640 10 monclient: _renew_subs 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.450+0000 7fa90c50c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.450+0000 7fa90c50c640 1 -- 10.20.193.48:0/3916282218 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa90408ad80 con 0x7fa90405c950 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.450+0000 7fa8eaffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.450+0000 7fa8eaffd640 1 -- 10.20.193.48:0/3916282218 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa8f40138d0 con 0x7fa90405c950 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.450+0000 7fa8eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.450+0000 7fa908a7e640 4 set_mon_vals no callback set 2026-02-12T18:10:34.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.450+0000 7fa8eaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:10:34.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.450+0000 7fa8eaffd640 10 monclient: dump: 2026-02-12T18:10:34.461 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.461 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.461 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.461 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.461 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.461 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.461 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.461 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.461 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.461 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.461 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.461 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.461 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.461 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.461 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.461 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.450+0000 7fa90c50c640 10 monclient: _renew_subs 2026-02-12T18:10:34.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.450+0000 7fa90c50c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:10:34.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.450+0000 7fa90c50c640 1 -- 10.20.193.48:0/3916282218 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa904143aa0 con 0x7fa90405c950 2026-02-12T18:10:34.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.450+0000 7fa90c50c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:34.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.451+0000 7fa90c50c640 1 --2- 10.20.193.48:0/3916282218 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa90408f9b0 0x7fa90411fc80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.451+0000 7fa90c50c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.451+0000 7fa90c50c640 1 -- 10.20.193.48:0/3916282218 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fa90405f140 con 0x7fa90408f9b0 2026-02-12T18:10:34.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.451+0000 7fa909a80640 1 --2- 10.20.193.48:0/3916282218 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa90408f9b0 0x7fa90411fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.451+0000 7fa909a80640 10 monclient: get_auth_request con 0x7fa90408f9b0 auth_method 0 2026-02-12T18:10:34.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.451+0000 7fa909a80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.451+0000 7fa909a80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.451+0000 7fa909a80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.451+0000 7fa909a80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.451+0000 7fa909a80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.451+0000 7fa909a80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.451+0000 7fa8eaffd640 1 -- 10.20.193.48:0/3916282218 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fa8f4013410 con 0x7fa90405c950 2026-02-12T18:10:34.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.451+0000 7fa909a80640 10 monclient(hunting): handle_auth_done global_id 5747 payload 824 2026-02-12T18:10:34.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.451+0000 7fa909a80640 1 -- 10.20.193.48:0/3916282218 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa904097de0 con 0x7fa90408f9b0 2026-02-12T18:10:34.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.451+0000 7fa8eaffd640 1 --2- 10.20.193.48:0/3916282218 >> v2:10.20.193.111:6812/977811348 conn(0x7fa8d403f800 0x7fa8d405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.451+0000 7fa8eaffd640 1 -- 10.20.193.48:0/3916282218 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(214..214 src has 1..214) ==== 3897+0+0 (secure 0 0 0) 0x7fa8f4052cb0 con 0x7fa90405c950 2026-02-12T18:10:34.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.451+0000 7fa90aa82640 1 --2- 10.20.193.48:0/3916282218 >> v2:10.20.193.111:6812/977811348 conn(0x7fa8d403f800 0x7fa8d405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.451+0000 7fa90aa82640 10 monclient: get_auth_request con 0x7fa8d403f800 auth_method 0 2026-02-12T18:10:34.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.453+0000 7fa909a80640 1 -- 10.20.193.48:0/3916282218 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa90408f9b0 msgr2=0x7fa90411fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:34.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.453+0000 7fa909a80640 1 --2- 10.20.193.48:0/3916282218 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa90408f9b0 0x7fa90411fc80 secure :-1 s=READY pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8f8009820 tx=0x7fa8f80047e0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.454+0000 7fa8eaffd640 1 -- 10.20.193.48:0/3916282218 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa8f8035d00 con 0x7fa90408f9b0 2026-02-12T18:10:34.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.454+0000 7fa8eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.454+0000 7fa8eaffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:10:34.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.454+0000 7fa8eaffd640 10 monclient: dump: 2026-02-12T18:10:34.462 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.462 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.462 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.462 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.462 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.462 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.454+0000 7fa8eaffd640 1 -- 10.20.193.48:0/3916282218 <== mon.5 v2:10.20.193.111:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fa8f8035e60 con 0x7fa90408f9b0 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.454+0000 7fa8eaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.454+0000 7fa90aa82640 1 --2- 10.20.193.48:0/3916282218 >> v2:10.20.193.111:6812/977811348 conn(0x7fa8d403f800 0x7fa8d405fcb0 secure :-1 s=READY pgs=306 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa904090960 tx=0x7fa900009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.454+0000 7fa8eaffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.454+0000 7fa8eaffd640 1 -- 10.20.193.48:0/3916282218 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa90408f9b0 msgr2=0x7fa90411fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.454+0000 7fa8eaffd640 1 --2- 10.20.193.48:0/3916282218 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa90408f9b0 0x7fa90411fc80 secure :-1 s=READY pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8f8009820 tx=0x7fa8f80047e0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.454+0000 7fa8eaffd640 1 -- 10.20.193.48:0/3916282218 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa90408f9b0 msgr2=0x7fa90411fc80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.454+0000 7fa8eaffd640 1 --2- 10.20.193.48:0/3916282218 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa90408f9b0 0x7fa90411fc80 secure :-1 s=CLOSED pgs=231 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8f8009820 tx=0x7fa8f80047e0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.457+0000 7fa90c50c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.457+0000 7fa90c50c640 1 --2- 10.20.193.48:0/3916282218 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa9041201c0 0x7fa9041205c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.457+0000 7fa90c50c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.457+0000 7fa90c50c640 1 -- 10.20.193.48:0/3916282218 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fa90405fd90 con 0x7fa9041201c0 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.457+0000 7fa909a80640 1 --2- 10.20.193.48:0/3916282218 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa9041201c0 0x7fa9041205c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.457+0000 7fa909a80640 10 monclient: get_auth_request con 0x7fa9041201c0 auth_method 0 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.457+0000 7fa909a80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.457+0000 7fa909a80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.457+0000 7fa909a80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.457+0000 7fa909a80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.457+0000 7fa909a80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.457+0000 7fa909a80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.458+0000 7fa909a80640 10 monclient(hunting): handle_auth_done global_id 5756 payload 824 2026-02-12T18:10:34.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.458+0000 7fa909a80640 1 -- 10.20.193.48:0/3916282218 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa90408fd80 con 0x7fa9041201c0 2026-02-12T18:10:34.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.460+0000 7fa909a80640 1 -- 10.20.193.48:0/3916282218 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa9041201c0 msgr2=0x7fa9041205c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:34.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.460+0000 7fa909a80640 1 --2- 10.20.193.48:0/3916282218 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa9041201c0 0x7fa9041205c0 secure :-1 s=READY pgs=232 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8f8009820 tx=0x7fa8f8004770 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.460+0000 7fa8eaffd640 1 -- 10.20.193.48:0/3916282218 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa8f8052070 con 0x7fa9041201c0 2026-02-12T18:10:34.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.460+0000 7fa8eaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.460+0000 7fa8eaffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:10:34.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.460+0000 7fa8eaffd640 10 monclient: dump: 2026-02-12T18:10:34.464 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.464 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.465 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.465 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.465 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.465 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.465 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.465 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.465 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.465 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.465 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.465 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.465 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.465 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.465 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.465 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.460+0000 7fa8eaffd640 1 -- 10.20.193.48:0/3916282218 <== mon.5 v2:10.20.193.111:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10182 (secure 0 0 0) 0x7fa8f8003e20 con 0x7fa9041201c0 2026-02-12T18:10:34.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.460+0000 7fa8eaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:10:34.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.460+0000 7fa8eaffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:10:34.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.460+0000 7fa8eaffd640 1 -- 10.20.193.48:0/3916282218 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa9041201c0 msgr2=0x7fa9041205c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.460+0000 7fa8eaffd640 1 --2- 10.20.193.48:0/3916282218 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa9041201c0 0x7fa9041205c0 secure :-1 s=READY pgs=232 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8f8009820 tx=0x7fa8f8004770 comp rx=0 tx=0).stop 2026-02-12T18:10:34.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.460+0000 7fa8eaffd640 1 -- 10.20.193.48:0/3916282218 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa9041201c0 msgr2=0x7fa9041205c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:34.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.460+0000 7fa8eaffd640 1 --2- 10.20.193.48:0/3916282218 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa9041201c0 0x7fa9041205c0 unknown :-1 s=CLOSED pgs=232 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.465 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 46, 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 289255, 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 9, 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:34.466 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:10:34.467 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:34.468 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.469 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:10:34.470 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.471 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.472 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.473 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.474 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.475 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:10:34.476 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.477 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:34.477 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:34.477 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:34.477 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.477 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:34.477 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:10:34.477 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.477 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:34.477 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:34.477 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:34.477 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.477 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:34.477 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:10:34.477 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.477 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:34.477 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:34.477 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:10:34.477 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.477 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.477 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.477 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:10:34.477 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:10:34.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.460+0000 7fa90c50c640 1 -- 10.20.193.48:0/3916282218 >> v2:10.20.193.111:6812/977811348 conn(0x7fa8d403f800 msgr2=0x7fa8d405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.460+0000 7fa90c50c640 1 --2- 10.20.193.48:0/3916282218 >> v2:10.20.193.111:6812/977811348 conn(0x7fa8d403f800 0x7fa8d405fcb0 secure :-1 s=READY pgs=306 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa904090960 tx=0x7fa900009040 comp rx=0 tx=0).stop 2026-02-12T18:10:34.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.461+0000 7fa90c50c640 10 monclient: shutdown 2026-02-12T18:10:34.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.461+0000 7fa90c50c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:34.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.461+0000 7fa90c50c640 1 -- 10.20.193.48:0/3916282218 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa90405c950 msgr2=0x7fa90408d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.461+0000 7fa90c50c640 1 --2- 10.20.193.48:0/3916282218 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa90405c950 0x7fa90408d7f0 secure :-1 s=READY pgs=225 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8f400e730 tx=0x7fa8f400ec00 comp rx=0 tx=0).stop 2026-02-12T18:10:34.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.461+0000 7fa90aa82640 1 -- 10.20.193.48:0/3916282218 reap_dead start 2026-02-12T18:10:34.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.461+0000 7fa90c50c640 1 -- 10.20.193.48:0/3916282218 shutdown_connections 2026-02-12T18:10:34.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.461+0000 7fa90c50c640 1 --2- 10.20.193.48:0/3916282218 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa90405c950 0x7fa90408d7f0 unknown :-1 s=CLOSED pgs=225 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.461+0000 7fa90c50c640 1 -- 10.20.193.48:0/3916282218 >> 10.20.193.48:0/3916282218 conn(0x7fa9040548a0 msgr2=0x7fa904093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:34.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.461+0000 7fa90c50c640 1 -- 10.20.193.48:0/3916282218 shutdown_connections 2026-02-12T18:10:34.479 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.461+0000 7fa90c50c640 1 -- 10.20.193.48:0/3916282218 wait complete. 2026-02-12T18:10:34.479 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:10:34.479 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2026-02-12T18:10:34.479 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2026-02-12T18:10:34.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.542+0000 7f9673ccc640 10 monclient: get_monmap_and_config 2026-02-12T18:10:34.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.542+0000 7f9673ccc640 10 monclient: build_initial_monmap 2026-02-12T18:10:34.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.542+0000 7f9673ccc640 10 monclient: monmap: 2026-02-12T18:10:34.544 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:34.544 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.544 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:10:34.543788+0000 2026-02-12T18:10:34.544 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:10:34.543788+0000 2026-02-12T18:10:34.544 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:34.544 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.544 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:10:34.544 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:10:34.544 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:34.544 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:34.545 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:34.545 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:34.545 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:34.545 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:34.545 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:34.545 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:10:34.545 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:10:34.545 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9673ccc640 1 Processor -- start 2026-02-12T18:10:34.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9673ccc640 1 -- start start 2026-02-12T18:10:34.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9673ccc640 10 monclient: init 2026-02-12T18:10:34.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9673ccc640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:34.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9673ccc640 10 monclient: _add_conns ranks=[8,0,9,3,2,6,4,5,7,1,10] 2026-02-12T18:10:34.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9673ccc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f966c0951a0 0x7f966c093850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9673ccc640 10 monclient(hunting): picked mon.noname-e con 0x7f966c0951a0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:10:34.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9673ccc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f966c096ad0 addr v1:10.20.193.48:6789/0 2026-02-12T18:10:34.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9673ccc640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f966c095c80 0x7f966c1a5bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9673ccc640 10 monclient(hunting): picked mon.noname-a con 0x7f966c095c80 addr v2:10.20.193.48:3300/0 2026-02-12T18:10:34.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9673ccc640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f966c04dc20 con 0x7f966c096ad0 2026-02-12T18:10:34.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9673ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9673ccc640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f966c096900 con 0x7f966c095c80 2026-02-12T18:10:34.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9673ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9673ccc640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f966c092260 con 0x7f966c0951a0 2026-02-12T18:10:34.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9673ccc640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:34.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9673ccc640 10 monclient(hunting): authenticate will time out at 873.269515s 2026-02-12T18:10:34.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9671a41640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f966c0951a0 0x7f966c093850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9671240640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f966c096ad0 0x7f966c095570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:39466/0 (socket says 10.20.193.48:39466) 2026-02-12T18:10:34.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9671240640 1 -- 10.20.193.48:0/3955506101 learned_addr learned my addr 10.20.193.48:0/3955506101 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:10:34.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9671a41640 10 monclient(hunting): get_auth_request con 0x7f966c0951a0 auth_method 0 2026-02-12T18:10:34.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9671a41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9671a41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9671a41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9672242640 1 --2- 10.20.193.48:0/3955506101 >> v2:10.20.193.48:3300/0 conn(0x7f966c095c80 0x7f966c1a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9671a41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9671a41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9671a41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9672242640 10 monclient(hunting): get_auth_request con 0x7f966c095c80 auth_method 0 2026-02-12T18:10:34.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9672242640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9672242640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9672242640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9671a41640 10 monclient(hunting): handle_auth_done global_id 64178 payload 274 2026-02-12T18:10:34.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9671a41640 1 -- 10.20.193.48:0/3955506101 >> v2:10.20.193.48:3300/0 conn(0x7f966c095c80 msgr2=0x7f966c1a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:34.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9671a41640 1 --2- 10.20.193.48:0/3955506101 >> v2:10.20.193.48:3300/0 conn(0x7f966c095c80 0x7f966c1a5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9671a41640 1 -- 10.20.193.48:0/3955506101 >> v1:10.20.193.48:6789/0 conn(0x7f966c096ad0 legacy=0x7f966c095570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:34.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9671a41640 10 monclient: _finish_hunting 0 2026-02-12T18:10:34.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9671a41640 1 monclient: found mon.noname-e 2026-02-12T18:10:34.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9671a41640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:34.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9671a41640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:10:34.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.543+0000 7f9671a41640 1 -- 10.20.193.48:0/3955506101 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f966c093070 con 0x7f966c0951a0 2026-02-12T18:10:34.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9671a41640 1 -- 10.20.193.48:0/3955506101 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f966c0951a0 msgr2=0x7f966c093850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:34.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9671a41640 1 --2- 10.20.193.48:0/3955506101 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f966c0951a0 0x7f966c093850 secure :-1 s=READY pgs=24 gs=2 cs=0 l=1 c_cookie=15570910876819546649 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f965c004740 tx=0x7f965c02ecb0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=d816fcf1ba186219 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9670a3f640 1 -- 10.20.193.48:0/3955506101 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f965c02fdf0 con 0x7f966c0951a0 2026-02-12T18:10:34.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9670a3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9670a3f640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:10:34.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9670a3f640 10 monclient: dump: 2026-02-12T18:10:34.551 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.551 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.551 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.551 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.551 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.551 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.551 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.551 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.551 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.551 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.551 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.551 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.551 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.551 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.551 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.551 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9670a3f640 10 monclient: _finish_auth 0 2026-02-12T18:10:34.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9670a3f640 10 monclient: _check_auth_tickets 2026-02-12T18:10:34.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9670a3f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:34.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9670a3f640 1 -- 10.20.193.48:0/3955506101 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f965c035340 con 0x7f966c0951a0 2026-02-12T18:10:34.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9673ccc640 5 monclient: authenticate success, global_id 64178 2026-02-12T18:10:34.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9670a3f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:34.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9670a3f640 1 -- 10.20.193.48:0/3955506101 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f965c035970 con 0x7f966c0951a0 2026-02-12T18:10:34.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9670a3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9670a3f640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:10:34.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9670a3f640 10 monclient: dump: 2026-02-12T18:10:34.552 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.552 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.552 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.552 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.552 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.552 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.552 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.552 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.552 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.552 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.552 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.552 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.552 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.552 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.552 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.552 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9673ccc640 10 monclient: get_monmap_and_config success 2026-02-12T18:10:34.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9673ccc640 4 set_mon_vals no callback set 2026-02-12T18:10:34.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9673ccc640 10 monclient: shutdown 2026-02-12T18:10:34.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9673ccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:34.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9673ccc640 1 -- 10.20.193.48:0/3955506101 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f966c0951a0 msgr2=0x7f966c093850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9673ccc640 1 --2- 10.20.193.48:0/3955506101 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f966c0951a0 0x7f966c093850 secure :-1 s=READY pgs=24 gs=2 cs=0 l=1 c_cookie=15570910876819546649 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f965c004740 tx=0x7f965c02ecb0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9673ccc640 1 -- 10.20.193.48:0/3955506101 shutdown_connections 2026-02-12T18:10:34.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9673ccc640 1 --2- 10.20.193.48:0/3955506101 >> v2:10.20.193.48:3300/0 conn(0x7f966c095c80 0x7f966c1a5bb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9673ccc640 1 --2- 10.20.193.48:0/3955506101 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f966c0951a0 0x7f966c093850 unknown :-1 s=CLOSED pgs=24 gs=2 cs=0 l=1 c_cookie=15570910876819546649 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9673ccc640 1 -- 10.20.193.48:0/3955506101 >> 10.20.193.48:0/3955506101 conn(0x7f966c0548c0 msgr2=0x7f966c0973a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:34.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.546+0000 7f9673ccc640 1 -- 10.20.193.48:0/3955506101 shutdown_connections 2026-02-12T18:10:34.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.547+0000 7f9673ccc640 1 -- 10.20.193.48:0/3955506101 wait complete. 2026-02-12T18:10:34.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.547+0000 7f9673ccc640 10 monclient: build_initial_monmap 2026-02-12T18:10:34.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.547+0000 7f9673ccc640 10 monclient: monmap: 2026-02-12T18:10:34.553 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:34.553 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:10:34.553 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:10:34.553 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:10:34.553 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:34.553 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.553 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:10:34.553 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:10:34.553 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:34.553 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:34.553 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:34.553 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:34.553 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:34.553 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:34.553 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:34.553 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.547+0000 7f9673ccc640 1 Processor -- start 2026-02-12T18:10:34.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.547+0000 7f9673ccc640 1 -- start start 2026-02-12T18:10:34.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.547+0000 7f9673ccc640 10 monclient: init 2026-02-12T18:10:34.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.547+0000 7f9673ccc640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:34.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9673ccc640 10 monclient: _add_conns ranks=[8,7,0,2,1,6,3,5,4] 2026-02-12T18:10:34.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9673ccc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f966c0951a0 0x7f966c1d7b70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9673ccc640 10 monclient(hunting): picked mon.noname-e con 0x7f966c0951a0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:10:34.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9673ccc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f966c095c80 0x7f966c1b0e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9673ccc640 10 monclient(hunting): picked mon.noname-i con 0x7f966c095c80 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:10:34.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9673ccc640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f966c096ad0 0x7f966c1db0d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9673ccc640 10 monclient(hunting): picked mon.noname-a con 0x7f966c096ad0 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:10:34.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9673ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9673ccc640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f966c19bf20 con 0x7f966c096ad0 2026-02-12T18:10:34.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9673ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9673ccc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f966c08d0d0 con 0x7f966c095c80 2026-02-12T18:10:34.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9673ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9673ccc640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f966c090170 con 0x7f966c0951a0 2026-02-12T18:10:34.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9673ccc640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:34.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9673ccc640 10 monclient(hunting): authenticate will time out at 873.274042s 2026-02-12T18:10:34.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9672242640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f966c096ad0 0x7f966c1db0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9671a41640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f966c0951a0 0x7f966c1d7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9671a41640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f966c0951a0 0x7f966c1d7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:60690/0 (socket says 10.20.193.48:60690) 2026-02-12T18:10:34.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9672242640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f966c096ad0 0x7f966c1db0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:42526/0 (socket says 10.20.193.48:42526) 2026-02-12T18:10:34.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9671a41640 1 -- 10.20.193.48:0/1194956135 learned_addr learned my addr 10.20.193.48:0/1194956135 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:34.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9671a41640 10 monclient(hunting): get_auth_request con 0x7f966c0951a0 auth_method 0 2026-02-12T18:10:34.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9671a41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9671a41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9671a41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9672242640 10 monclient(hunting): get_auth_request con 0x7f966c096ad0 auth_method 0 2026-02-12T18:10:34.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9672242640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9672242640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9672242640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9671a41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9671a41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9671a41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9672242640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9672242640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9672242640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9671240640 1 --2- 10.20.193.48:0/1194956135 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f966c095c80 0x7f966c1b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9671240640 10 monclient(hunting): get_auth_request con 0x7f966c095c80 auth_method 0 2026-02-12T18:10:34.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9671240640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9671240640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9671240640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9671a41640 10 monclient(hunting): handle_auth_done global_id 64187 payload 824 2026-02-12T18:10:34.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9671a41640 1 -- 10.20.193.48:0/1194956135 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f966c095c80 msgr2=0x7f966c1b0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9671a41640 1 --2- 10.20.193.48:0/1194956135 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f966c095c80 0x7f966c1b0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9671a41640 1 -- 10.20.193.48:0/1194956135 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f966c096ad0 msgr2=0x7f966c1db0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9671a41640 1 --2- 10.20.193.48:0/1194956135 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f966c096ad0 0x7f966c1db0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9671a41640 10 monclient: _finish_hunting 0 2026-02-12T18:10:34.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9671a41640 1 monclient: found mon.noname-e 2026-02-12T18:10:34.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9671a41640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:34.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9671a41640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:10:34.556 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.548+0000 7f9671a41640 1 -- 10.20.193.48:0/1194956135 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f965c009420 con 0x7f966c0951a0 2026-02-12T18:10:34.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.550+0000 7f9671a41640 1 -- 10.20.193.48:0/1194956135 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f966c0951a0 msgr2=0x7f966c1d7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:34.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.550+0000 7f9671a41640 1 --2- 10.20.193.48:0/1194956135 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f966c0951a0 0x7f966c1d7b70 secure :-1 s=READY pgs=25 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f965c0098d0 tx=0x7f965c0047e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.550+0000 7f965a7fc640 1 -- 10.20.193.48:0/1194956135 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f965c0044f0 con 0x7f966c0951a0 2026-02-12T18:10:34.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.550+0000 7f965a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.550+0000 7f965a7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:10:34.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.550+0000 7f965a7fc640 10 monclient: dump: 2026-02-12T18:10:34.558 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.558 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.558 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.558 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.558 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.558 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.558 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.558 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.558 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.558 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.558 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.558 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.558 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.558 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.558 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.558 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.550+0000 7f965a7fc640 10 monclient: _finish_auth 0 2026-02-12T18:10:34.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.550+0000 7f965a7fc640 10 monclient: _check_auth_tickets 2026-02-12T18:10:34.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.550+0000 7f965a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:34.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.550+0000 7f965a7fc640 1 -- 10.20.193.48:0/1194956135 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f965c02fd50 con 0x7f966c0951a0 2026-02-12T18:10:34.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.550+0000 7f965a7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:34.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.550+0000 7f965a7fc640 1 -- 10.20.193.48:0/1194956135 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f965c003b90 con 0x7f966c0951a0 2026-02-12T18:10:34.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.550+0000 7f965a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.550+0000 7f965bfff640 4 set_mon_vals no callback set 2026-02-12T18:10:34.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.550+0000 7f965a7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:10:34.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.550+0000 7f965a7fc640 10 monclient: dump: 2026-02-12T18:10:34.559 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.559 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.559 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.559 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.559 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.559 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.559 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.559 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.559 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.559 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.559 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.559 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.559 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.559 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.559 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.559 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.550+0000 7f9673ccc640 5 monclient: authenticate success, global_id 64187 2026-02-12T18:10:34.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.550+0000 7f9673ccc640 10 monclient: _renew_subs 2026-02-12T18:10:34.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.550+0000 7f9673ccc640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:10:34.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.550+0000 7f9673ccc640 1 -- 10.20.193.48:0/1194956135 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f966c098010 con 0x7f966c0951a0 2026-02-12T18:10:34.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.550+0000 7f9673ccc640 10 monclient: _renew_subs 2026-02-12T18:10:34.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.550+0000 7f9673ccc640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:10:34.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.550+0000 7f9673ccc640 1 -- 10.20.193.48:0/1194956135 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f966c19c7c0 con 0x7f966c0951a0 2026-02-12T18:10:34.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.551+0000 7f9673ccc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:34.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.551+0000 7f9673ccc640 1 --2- 10.20.193.48:0/1194956135 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f966c1b1360 0x7f966c1db610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.551+0000 7f9673ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.551+0000 7f9673ccc640 1 -- 10.20.193.48:0/1194956135 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f966c05f140 con 0x7f966c1b1360 2026-02-12T18:10:34.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.551+0000 7f9671240640 1 --2- 10.20.193.48:0/1194956135 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f966c1b1360 0x7f966c1db610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.551+0000 7f9671240640 10 monclient: get_auth_request con 0x7f966c1b1360 auth_method 0 2026-02-12T18:10:34.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.551+0000 7f9671240640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.551+0000 7f9671240640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.551+0000 7f9671240640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.551+0000 7f9671240640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.551+0000 7f9671240640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.551+0000 7f9671240640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.551+0000 7f965a7fc640 1 -- 10.20.193.48:0/1194956135 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f965c003cf0 con 0x7f966c0951a0 2026-02-12T18:10:34.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.551+0000 7f9671240640 10 monclient(hunting): handle_auth_done global_id 44926 payload 824 2026-02-12T18:10:34.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.551+0000 7f9671240640 1 -- 10.20.193.48:0/1194956135 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f966c097e90 con 0x7f966c1b1360 2026-02-12T18:10:34.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.551+0000 7f965a7fc640 1 --2- 10.20.193.48:0/1194956135 >> v2:10.20.193.111:6812/977811348 conn(0x7f963c03f800 0x7f963c05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.551+0000 7f965a7fc640 1 -- 10.20.193.48:0/1194956135 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(214..214 src has 1..214) ==== 3897+0+0 (secure 0 0 0) 0x7f965c077e40 con 0x7f966c0951a0 2026-02-12T18:10:34.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.552+0000 7f9672242640 1 --2- 10.20.193.48:0/1194956135 >> v2:10.20.193.111:6812/977811348 conn(0x7f963c03f800 0x7f963c05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.552+0000 7f9672242640 10 monclient: get_auth_request con 0x7f963c03f800 auth_method 0 2026-02-12T18:10:34.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.554+0000 7f9671240640 1 -- 10.20.193.48:0/1194956135 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f966c1b1360 msgr2=0x7f966c1db610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:34.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.554+0000 7f9671240640 1 --2- 10.20.193.48:0/1194956135 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f966c1b1360 0x7f966c1db610 secure :-1 s=READY pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f966c19aad0 tx=0x7f966000e970 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.554+0000 7f965a7fc640 1 -- 10.20.193.48:0/1194956135 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9660006590 con 0x7f966c1b1360 2026-02-12T18:10:34.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.554+0000 7f965a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.554+0000 7f965a7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:10:34.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.554+0000 7f965a7fc640 10 monclient: dump: 2026-02-12T18:10:34.561 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.561 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.561 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.561 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.561 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.561 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.561 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.561 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.561 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.561 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.561 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.561 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.561 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.561 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.561 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.561 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.554+0000 7f9672242640 1 --2- 10.20.193.48:0/1194956135 >> v2:10.20.193.111:6812/977811348 conn(0x7f963c03f800 0x7f963c05fcb0 secure :-1 s=READY pgs=307 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f966c19a0a0 tx=0x7f9668009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.554+0000 7f965a7fc640 1 -- 10.20.193.48:0/1194956135 <== mon.7 v2:10.20.193.111:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f96600066f0 con 0x7f966c1b1360 2026-02-12T18:10:34.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.554+0000 7f965a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:34.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.554+0000 7f965a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:10:34.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.554+0000 7f965a7fc640 1 -- 10.20.193.48:0/1194956135 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f966c1b1360 msgr2=0x7f966c1db610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.554+0000 7f965a7fc640 1 --2- 10.20.193.48:0/1194956135 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f966c1b1360 0x7f966c1db610 secure :-1 s=READY pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f966c19aad0 tx=0x7f966000e970 comp rx=0 tx=0).stop 2026-02-12T18:10:34.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.554+0000 7f965a7fc640 1 -- 10.20.193.48:0/1194956135 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f966c1b1360 msgr2=0x7f966c1db610 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:34.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.554+0000 7f965a7fc640 1 --2- 10.20.193.48:0/1194956135 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f966c1b1360 0x7f966c1db610 secure :-1 s=CLOSED pgs=112 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f966c19aad0 tx=0x7f966000e970 comp rx=0 tx=0).stop 2026-02-12T18:10:34.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.557+0000 7f9673ccc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:10:34.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.557+0000 7f9673ccc640 1 --2- 10.20.193.48:0/1194956135 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f966c19afc0 0x7f966c1dbb50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.557+0000 7f9673ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.557+0000 7f9673ccc640 1 -- 10.20.193.48:0/1194956135 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f966c05fd90 con 0x7f966c19afc0 2026-02-12T18:10:34.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.557+0000 7f9671240640 1 --2- 10.20.193.48:0/1194956135 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f966c19afc0 0x7f966c1dbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.557+0000 7f9671240640 10 monclient: get_auth_request con 0x7f966c19afc0 auth_method 0 2026-02-12T18:10:34.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.557+0000 7f9671240640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.557+0000 7f9671240640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.557+0000 7f9671240640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.557+0000 7f9671240640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.557+0000 7f9671240640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.557+0000 7f9671240640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.558+0000 7f9671240640 10 monclient(hunting): handle_auth_done global_id 44935 payload 824 2026-02-12T18:10:34.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.558+0000 7f9671240640 1 -- 10.20.193.48:0/1194956135 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f966c05dc10 con 0x7f966c19afc0 2026-02-12T18:10:34.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.560+0000 7f9671240640 1 -- 10.20.193.48:0/1194956135 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f966c19afc0 msgr2=0x7f966c1dbb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:34.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.560+0000 7f9671240640 1 --2- 10.20.193.48:0/1194956135 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f966c19afc0 0x7f966c1dbb50 secure :-1 s=READY pgs=113 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f966c19aad0 tx=0x7f9660004a00 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.560+0000 7f965a7fc640 1 -- 10.20.193.48:0/1194956135 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9660022070 con 0x7f966c19afc0 2026-02-12T18:10:34.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.560+0000 7f965a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.560+0000 7f965a7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:10:34.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.560+0000 7f965a7fc640 10 monclient: dump: 2026-02-12T18:10:34.563 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.564 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.564 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.564 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.564 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.564 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.564 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.564 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.564 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.564 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.564 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.564 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.564 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.564 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.564 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.564 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.564 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.560+0000 7f965a7fc640 1 -- 10.20.193.48:0/1194956135 <== mon.7 v2:10.20.193.111:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10015 (secure 0 0 0) 0x7f9660013420 con 0x7f966c19afc0 2026-02-12T18:10:34.564 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.560+0000 7f965a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:10:34.564 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.560+0000 7f965a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:10:34.564 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.560+0000 7f965a7fc640 1 -- 10.20.193.48:0/1194956135 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f966c19afc0 msgr2=0x7f966c1dbb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.564 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.560+0000 7f965a7fc640 1 --2- 10.20.193.48:0/1194956135 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f966c19afc0 0x7f966c1dbb50 secure :-1 s=READY pgs=113 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f966c19aad0 tx=0x7f9660004a00 comp rx=0 tx=0).stop 2026-02-12T18:10:34.564 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.560+0000 7f965a7fc640 1 -- 10.20.193.48:0/1194956135 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f966c19afc0 msgr2=0x7f966c1dbb50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:34.564 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.560+0000 7f965a7fc640 1 --2- 10.20.193.48:0/1194956135 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f966c19afc0 0x7f966c1dbb50 secure :-1 s=CLOSED pgs=113 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f966c19aad0 tx=0x7f9660004a00 comp rx=0 tx=0).stop 2026-02-12T18:10:34.565 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:10:34.565 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:10:34.565 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:10:34.565 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:10:34.565 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 46, 2026-02-12T18:10:34.565 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 146443, 2026-02-12T18:10:34.565 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:10:34.565 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:10:34.565 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:10:34.565 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:10:34.565 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:10:34.565 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:10:34.565 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:10:34.565 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:10:34.565 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:10:34.565 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:10:34.565 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:34.565 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 9, 2026-02-12T18:10:34.565 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:34.565 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:10:34.565 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:10:34.565 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:34.566 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:34.566 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:34.566 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:34.566 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:34.566 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:34.566 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:34.566 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:34.566 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:34.566 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:34.566 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:34.566 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:34.566 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:34.566 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:34.566 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:10:34.566 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:10:34.566 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:34.566 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:34.566 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:34.566 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:34.566 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:34.566 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:34.566 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:34.566 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:34.566 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:34.566 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:34.567 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:34.567 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:34.567 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:34.567 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.567 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.567 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:10:34.567 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:10:34.567 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:10:34.567 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:10:34.567 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:10:34.567 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:10:34.567 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:34.567 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:10:34.567 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:10:34.567 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:10:34.567 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:10:34.567 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:10:34.567 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:10:34.567 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:10:34.567 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:10:34.567 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:10:34.567 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:10:34.567 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:10:34.567 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:10:34.567 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:10:34.568 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:10:34.568 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:10:34.568 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:10:34.568 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:10:34.568 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:10:34.568 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:10:34.568 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:10:34.568 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:10:34.568 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:10:34.568 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:10:34.568 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:34.568 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:10:34.568 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.568 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:10:34.568 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.568 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:10:34.568 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:10:34.568 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.568 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.568 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.568 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.568 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:10:34.568 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.568 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.568 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.568 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.569 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:10:34.569 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.569 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.569 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.569 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.569 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:10:34.569 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:10:34.569 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.569 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.569 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:10:34.569 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.569 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.569 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.569 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:10:34.569 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:10:34.569 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.569 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.569 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.569 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.569 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:10:34.569 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.569 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.569 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.569 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.569 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:10:34.569 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.570 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.570 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.570 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.570 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:10:34.570 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:10:34.570 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.570 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.570 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:10:34.570 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.570 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.570 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.570 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:10:34.570 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:10:34.570 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.570 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.570 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.570 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.570 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:10:34.570 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.570 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.570 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.570 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.570 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:10:34.570 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.570 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.570 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.571 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.571 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:10:34.571 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:10:34.571 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.571 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.571 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:10:34.571 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.571 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.571 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.571 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:10:34.571 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:10:34.571 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.571 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.571 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.571 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.571 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:10:34.571 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.571 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.571 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.571 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.571 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:10:34.571 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.571 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.571 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.571 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.571 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:10:34.572 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:10:34.572 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.572 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.572 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:10:34.572 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.572 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.572 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.572 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:10:34.572 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:10:34.572 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.572 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.572 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.572 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.572 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:10:34.572 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.572 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.572 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.572 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.572 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:10:34.572 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.572 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.572 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.572 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.572 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:10:34.572 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:10:34.572 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.573 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.573 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:34.573 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.573 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.573 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.573 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:10:34.573 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:10:34.573 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.573 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.573 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.573 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.573 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:10:34.573 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.573 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.573 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.573 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.573 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:10:34.573 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.573 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.573 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.573 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.573 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:10:34.573 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:10:34.573 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.573 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.573 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:10:34.574 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.574 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.574 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.574 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:10:34.574 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:10:34.574 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.574 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.574 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.574 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.574 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:10:34.574 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.574 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.574 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.574 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.574 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:10:34.574 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.574 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.574 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.574 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.574 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:10:34.574 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:10:34.574 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.574 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.574 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:10:34.574 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.574 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.575 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.575 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:10:34.575 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:10:34.575 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.575 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.575 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.575 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.575 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:10:34.575 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.575 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.575 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.575 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.575 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:10:34.575 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.575 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.575 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.575 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.575 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:10:34.575 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:10:34.575 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.575 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.575 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:10:34.575 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.575 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.575 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:10:34.576 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.577 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:34.577 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:34.577 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:34.577 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.577 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:10:34.577 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:10:34.577 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:10:34.577 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:10:34.577 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:10:34.577 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:10:34.577 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:10:34.577 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:10:34.577 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:10:34.577 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:10:34.577 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:10:34.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.561+0000 7f9673ccc640 1 -- 10.20.193.48:0/1194956135 >> v2:10.20.193.111:6812/977811348 conn(0x7f963c03f800 msgr2=0x7f963c05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.561+0000 7f9673ccc640 1 --2- 10.20.193.48:0/1194956135 >> v2:10.20.193.111:6812/977811348 conn(0x7f963c03f800 0x7f963c05fcb0 secure :-1 s=READY pgs=307 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f966c19a0a0 tx=0x7f9668009040 comp rx=0 tx=0).stop 2026-02-12T18:10:34.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.561+0000 7f9673ccc640 10 monclient: shutdown 2026-02-12T18:10:34.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.561+0000 7f9673ccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:34.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.561+0000 7f9673ccc640 1 -- 10.20.193.48:0/1194956135 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f966c0951a0 msgr2=0x7f966c1d7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.561+0000 7f9673ccc640 1 --2- 10.20.193.48:0/1194956135 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f966c0951a0 0x7f966c1d7b70 secure :-1 s=READY pgs=25 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f965c0098d0 tx=0x7f965c0047e0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.561+0000 7f9672242640 1 -- 10.20.193.48:0/1194956135 reap_dead start 2026-02-12T18:10:34.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.561+0000 7f9672242640 1 -- 10.20.193.48:0/1194956135 reap_dead start 2026-02-12T18:10:34.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.561+0000 7f9673ccc640 1 -- 10.20.193.48:0/1194956135 shutdown_connections 2026-02-12T18:10:34.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.561+0000 7f9673ccc640 1 -- 10.20.193.48:0/1194956135 >> 10.20.193.48:0/1194956135 conn(0x7f966c0548c0 msgr2=0x7f966c08d830 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:34.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.561+0000 7f9673ccc640 1 -- 10.20.193.48:0/1194956135 shutdown_connections 2026-02-12T18:10:34.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.561+0000 7f9673ccc640 1 -- 10.20.193.48:0/1194956135 wait complete. 2026-02-12T18:10:34.579 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:10:34.579 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['i', 'e', 'f', 'h'] 2026-02-12T18:10:34.579 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['g'] 2026-02-12T18:10:34.579 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.i 2026-02-12T18:10:34.579 INFO:tasks.mon_thrash.mon_thrasher:killing mon.i 2026-02-12T18:10:34.580 DEBUG:tasks.ceph.mon.i:waiting for process to exit 2026-02-12T18:10:34.580 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:10:34.589 INFO:tasks.ceph.mon.i:Stopped 2026-02-12T18:10:34.589 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.e 2026-02-12T18:10:34.589 INFO:tasks.mon_thrash.mon_thrasher:killing mon.e 2026-02-12T18:10:34.589 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2026-02-12T18:10:34.589 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:10:34.598 INFO:tasks.ceph.mon.e:Stopped 2026-02-12T18:10:34.598 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.f 2026-02-12T18:10:34.598 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.f store 2026-02-12T18:10:34.598 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f sync_force --yes-i-really-mean-it 2026-02-12T18:10:34.638 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:10:34.638 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[30286]: starting. 2026-02-12T18:10:34.638 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[30286]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-30250 2026-02-12T18:10:34.638 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[30286]: shutting down. 2026-02-12T18:10:34.639 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:10:34.639 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:10:34.639 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:10:34.641 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:10:34.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.705+0000 7f0786047640 10 monclient: get_monmap_and_config 2026-02-12T18:10:34.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.705+0000 7f0786047640 10 monclient: build_initial_monmap 2026-02-12T18:10:34.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.705+0000 7f0786047640 10 monclient: monmap: 2026-02-12T18:10:34.707 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:34.707 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.707 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:10:34.706762+0000 2026-02-12T18:10:34.707 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:10:34.706762+0000 2026-02-12T18:10:34.708 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:34.708 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.708 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:10:34.708 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:10:34.708 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:34.708 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:34.708 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:34.708 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:34.708 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:34.708 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:34.708 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:34.708 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:10:34.708 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:10:34.709 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f0786047640 1 Processor -- start 2026-02-12T18:10:34.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f0786047640 1 -- start start 2026-02-12T18:10:34.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f0786047640 10 monclient: init 2026-02-12T18:10:34.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f0786047640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:34.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f0786047640 10 monclient: _add_conns ranks=[1,8,9,7,4,0,10,5,2,6,3] 2026-02-12T18:10:34.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f0786047640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f078008fca0 addr v1:10.20.193.111:6789/0 2026-02-12T18:10:34.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f0786047640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f078008f2c0 0x7f0780183aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f0786047640 10 monclient(hunting): picked mon.noname-e con 0x7f078008f2c0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:10:34.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f0786047640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f0780090780 0x7f07801a3ff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f0786047640 10 monclient(hunting): picked mon.noname-a con 0x7f0780090780 addr v2:10.20.193.48:3300/0 2026-02-12T18:10:34.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f0786047640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f078004dc20 con 0x7f078008fca0 2026-02-12T18:10:34.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f0786047640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f0786047640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f078005e360 con 0x7f0780090780 2026-02-12T18:10:34.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f0786047640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f0786047640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f078008b9a0 con 0x7f078008f2c0 2026-02-12T18:10:34.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f0786047640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:34.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f0786047640 10 monclient(hunting): authenticate will time out at 873.432533s 2026-02-12T18:10:34.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f077effd640 1 -- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f078008f2c0 msgr2=0x7f0780183aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.48:3304/0 2026-02-12T18:10:34.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f077effd640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f078008f2c0 0x7f0780183aa0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:34.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f077ffff640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f0780090780 0x7f07801a3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f077ffff640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f0780090780 0x7f07801a3ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:42540/0 (socket says 10.20.193.48:42540) 2026-02-12T18:10:34.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f077ffff640 1 -- 10.20.193.48:0/189819262 learned_addr learned my addr 10.20.193.48:0/189819262 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:34.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f077ffff640 10 monclient(hunting): get_auth_request con 0x7f0780090780 auth_method 0 2026-02-12T18:10:34.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f077ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f077ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f077ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f077ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f077ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f077ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f077ffff640 10 monclient(hunting): handle_auth_done global_id 6039 payload 274 2026-02-12T18:10:34.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f077ffff640 1 -- 10.20.193.48:0/189819262 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f078008f2c0 msgr2=0x7f0780183aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:10:34.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f077ffff640 1 --2- 10.20.193.48:0/189819262 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f078008f2c0 0x7f0780183aa0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f077ffff640 1 -- 10.20.193.48:0/189819262 >> v1:10.20.193.111:6789/0 conn(0x7f078008fca0 legacy=0x7f0780090070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:10:34.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f077ffff640 10 monclient: _finish_hunting 0 2026-02-12T18:10:34.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f077ffff640 1 monclient: found mon.noname-a 2026-02-12T18:10:34.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f077ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:34.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f077ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:10:34.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.706+0000 7f077ffff640 1 -- 10.20.193.48:0/189819262 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f078008a740 con 0x7f0780090780 2026-02-12T18:10:34.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f077ffff640 1 -- 10.20.193.48:0/189819262 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f0780090780 msgr2=0x7f07801a3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:34.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f077ffff640 1 --2- 10.20.193.48:0/189819262 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f0780090780 0x7f07801a3ff0 secure :-1 s=READY pgs=376 gs=3 cs=0 l=1 c_cookie=16049116752320462814 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f077400a9b0 tx=0x7f077402fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb9eaa784d4ffde server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f077e7fc640 1 -- 10.20.193.48:0/189819262 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f0774030c30 con 0x7f0780090780 2026-02-12T18:10:34.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f077e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f077e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:10:34.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f077e7fc640 10 monclient: dump: 2026-02-12T18:10:34.720 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.720 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.720 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.720 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.720 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.720 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.720 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.720 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.720 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.721 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.721 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.721 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.721 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.721 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.721 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.721 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f077e7fc640 10 monclient: _finish_auth 0 2026-02-12T18:10:34.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f077e7fc640 10 monclient: _check_auth_tickets 2026-02-12T18:10:34.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f077e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:34.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f077e7fc640 1 -- 10.20.193.48:0/189819262 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0774030db0 con 0x7f0780090780 2026-02-12T18:10:34.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f0786047640 5 monclient: authenticate success, global_id 6039 2026-02-12T18:10:34.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f0786047640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:10:34.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f077e7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:34.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f077e7fc640 1 -- 10.20.193.48:0/189819262 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f0774036cc0 con 0x7f0780090780 2026-02-12T18:10:34.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f077e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f077e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:10:34.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f077e7fc640 10 monclient: dump: 2026-02-12T18:10:34.722 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.722 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.722 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.722 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.722 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.722 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.722 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.722 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.722 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.722 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.722 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.722 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.722 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.722 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.722 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.722 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f0786047640 10 monclient: get_monmap_and_config success 2026-02-12T18:10:34.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f0786047640 4 set_mon_vals no callback set 2026-02-12T18:10:34.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f0786047640 10 monclient: shutdown 2026-02-12T18:10:34.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f0786047640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:34.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f0786047640 1 -- 10.20.193.48:0/189819262 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f0780090780 msgr2=0x7f07801a3ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f0786047640 1 --2- 10.20.193.48:0/189819262 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f0780090780 0x7f07801a3ff0 secure :-1 s=READY pgs=376 gs=3 cs=0 l=1 c_cookie=16049116752320462814 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f077400a9b0 tx=0x7f077402fed0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f0786047640 1 -- 10.20.193.48:0/189819262 shutdown_connections 2026-02-12T18:10:34.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f0786047640 1 --2- 10.20.193.48:0/189819262 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f0780090780 0x7f07801a3ff0 unknown :-1 s=CLOSED pgs=376 gs=3 cs=0 l=1 c_cookie=16049116752320462814 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f0786047640 1 --2- 10.20.193.48:0/189819262 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f078008f2c0 0x7f0780183aa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f0786047640 1 -- 10.20.193.48:0/189819262 >> 10.20.193.48:0/189819262 conn(0x7f0780054e10 msgr2=0x7f07800952a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:34.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f0786047640 1 -- 10.20.193.48:0/189819262 shutdown_connections 2026-02-12T18:10:34.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.709+0000 7f0786047640 1 -- 10.20.193.48:0/189819262 wait complete. 2026-02-12T18:10:34.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f0786047640 10 monclient: build_initial_monmap 2026-02-12T18:10:34.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f0786047640 10 monclient: monmap: 2026-02-12T18:10:34.723 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:34.723 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:10:34.723 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:10:34.723 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:10:34.723 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:34.724 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.724 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:10:34.724 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:10:34.724 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:34.724 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:34.724 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:34.724 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:34.724 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:34.724 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:34.724 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:34.724 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f0786047640 1 Processor -- start 2026-02-12T18:10:34.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f0786047640 1 -- start start 2026-02-12T18:10:34.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f0786047640 10 monclient: init 2026-02-12T18:10:34.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f0786047640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:34.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f0786047640 10 monclient: _add_conns ranks=[4,2,1,6,3,5,8,7,0] 2026-02-12T18:10:34.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f0786047640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f078008f2c0 0x7f07800561b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f0786047640 10 monclient(hunting): picked mon.noname-c con 0x7f078008f2c0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:10:34.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f0786047640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f078008fca0 0x7f07800566f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f0786047640 10 monclient(hunting): picked mon.noname-b con 0x7f078008fca0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:10:34.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f0786047640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f0780090780 0x7f0780056c30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f0786047640 10 monclient(hunting): picked mon.noname-f con 0x7f0780090780 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:10:34.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f0786047640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f0786047640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f0780058260 con 0x7f0780090780 2026-02-12T18:10:34.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f0786047640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f0786047640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f0780198020 con 0x7f078008fca0 2026-02-12T18:10:34.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f0786047640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f0786047640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f0780198380 con 0x7f078008f2c0 2026-02-12T18:10:34.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f0786047640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:34.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f0786047640 10 monclient(hunting): authenticate will time out at 873.436843s 2026-02-12T18:10:34.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f077effd640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f078008fca0 0x7f07800566f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f077effd640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f078008fca0 0x7f07800566f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:35362/0 (socket says 10.20.193.48:35362) 2026-02-12T18:10:34.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f077effd640 1 -- 10.20.193.48:0/2337968662 learned_addr learned my addr 10.20.193.48:0/2337968662 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:34.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f077effd640 10 monclient(hunting): get_auth_request con 0x7f078008fca0 auth_method 0 2026-02-12T18:10:34.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f077effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f077effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f077effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f077f7fe640 1 --2- 10.20.193.48:0/2337968662 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f078008f2c0 0x7f07800561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f077f7fe640 10 monclient(hunting): get_auth_request con 0x7f078008f2c0 auth_method 0 2026-02-12T18:10:34.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f077f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f077f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f077f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f077effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f077effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f077ffff640 1 --2- 10.20.193.48:0/2337968662 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f0780090780 0x7f0780056c30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.710+0000 7f077effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.711+0000 7f077ffff640 10 monclient(hunting): get_auth_request con 0x7f0780090780 auth_method 0 2026-02-12T18:10:34.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.711+0000 7f077ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.711+0000 7f077ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.711+0000 7f077ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.711+0000 7f077f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.711+0000 7f077f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.711+0000 7f077f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.711+0000 7f077ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.711+0000 7f077ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.711+0000 7f077ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.711+0000 7f077effd640 10 monclient(hunting): handle_auth_done global_id 35759 payload 824 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.711+0000 7f077effd640 1 -- 10.20.193.48:0/2337968662 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f078008f2c0 msgr2=0x7f07800561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.711+0000 7f077effd640 1 --2- 10.20.193.48:0/2337968662 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f078008f2c0 0x7f07800561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.711+0000 7f077effd640 1 -- 10.20.193.48:0/2337968662 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f0780090780 msgr2=0x7f0780056c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.711+0000 7f077effd640 1 --2- 10.20.193.48:0/2337968662 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f0780090780 0x7f0780056c30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.711+0000 7f077effd640 10 monclient: _finish_hunting 0 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.711+0000 7f077effd640 1 monclient: found mon.noname-b 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.711+0000 7f077effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.711+0000 7f077effd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.711+0000 7f077effd640 1 -- 10.20.193.48:0/2337968662 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f077400a5d0 con 0x7f078008fca0 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f077effd640 1 -- 10.20.193.48:0/2337968662 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f078008fca0 msgr2=0x7f07800566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f077effd640 1 --2- 10.20.193.48:0/2337968662 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f078008fca0 0x7f07800566f0 secure :-1 s=READY pgs=226 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f077000b520 tx=0x7f077000b9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f075bfff640 1 -- 10.20.193.48:0/2337968662 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f0770003e60 con 0x7f078008fca0 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f075bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f075bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f075bfff640 10 monclient: dump: 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.727 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f075bfff640 10 monclient: _finish_auth 0 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f075bfff640 10 monclient: _check_auth_tickets 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f075bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f075bfff640 1 -- 10.20.193.48:0/2337968662 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0770006590 con 0x7f078008fca0 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f075bfff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f075bfff640 1 -- 10.20.193.48:0/2337968662 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f0770006700 con 0x7f078008fca0 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f075bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f075bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f075bfff640 10 monclient: dump: 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f077dffb640 4 set_mon_vals no callback set 2026-02-12T18:10:34.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f0786047640 5 monclient: authenticate success, global_id 35759 2026-02-12T18:10:34.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f0786047640 10 monclient: _renew_subs 2026-02-12T18:10:34.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f0786047640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:10:34.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f0786047640 1 -- 10.20.193.48:0/2337968662 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f078005da40 con 0x7f078008fca0 2026-02-12T18:10:34.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f0786047640 10 monclient: _renew_subs 2026-02-12T18:10:34.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f0786047640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:10:34.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f0786047640 1 -- 10.20.193.48:0/2337968662 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0780199820 con 0x7f078008fca0 2026-02-12T18:10:34.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f0786047640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:34.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f0786047640 1 --2- 10.20.193.48:0/2337968662 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f0780057170 0x7f078005a9b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f0786047640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.713+0000 7f0786047640 1 -- 10.20.193.48:0/2337968662 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f078005f140 con 0x7f0780057170 2026-02-12T18:10:34.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.714+0000 7f077f7fe640 1 --2- 10.20.193.48:0/2337968662 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f0780057170 0x7f078005a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.714+0000 7f077f7fe640 10 monclient: get_auth_request con 0x7f0780057170 auth_method 0 2026-02-12T18:10:34.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.714+0000 7f077f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.714+0000 7f077f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.714+0000 7f077f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.714+0000 7f075bfff640 1 -- 10.20.193.48:0/2337968662 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f077000d040 con 0x7f078008fca0 2026-02-12T18:10:34.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.714+0000 7f075bfff640 1 --2- 10.20.193.48:0/2337968662 >> v2:10.20.193.111:6812/977811348 conn(0x7f075003f800 0x7f075005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.714+0000 7f075bfff640 1 -- 10.20.193.48:0/2337968662 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(215..215 src has 1..215) ==== 3503+0+0 (secure 0 0 0) 0x7f0770052460 con 0x7f078008fca0 2026-02-12T18:10:34.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.714+0000 7f077f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.714+0000 7f077f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.714+0000 7f077f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.714+0000 7f077ffff640 1 --2- 10.20.193.48:0/2337968662 >> v2:10.20.193.111:6812/977811348 conn(0x7f075003f800 0x7f075005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.714+0000 7f077ffff640 10 monclient: get_auth_request con 0x7f075003f800 auth_method 0 2026-02-12T18:10:34.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.714+0000 7f077f7fe640 10 monclient(hunting): handle_auth_done global_id 5788 payload 824 2026-02-12T18:10:34.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.714+0000 7f077f7fe640 1 -- 10.20.193.48:0/2337968662 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0780057ba0 con 0x7f0780057170 2026-02-12T18:10:34.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.716+0000 7f077ffff640 1 --2- 10.20.193.48:0/2337968662 >> v2:10.20.193.111:6812/977811348 conn(0x7f075003f800 0x7f075005fcb0 secure :-1 s=READY pgs=309 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f077400a9b0 tx=0x7f0774007f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.716+0000 7f077f7fe640 1 -- 10.20.193.48:0/2337968662 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f0780057170 msgr2=0x7f078005a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:34.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.716+0000 7f077f7fe640 1 --2- 10.20.193.48:0/2337968662 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f0780057170 0x7f078005a9b0 secure :-1 s=READY pgs=317 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f076c003770 tx=0x7f076c00fc10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.717+0000 7f075bfff640 1 -- 10.20.193.48:0/2337968662 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f076c00dbc0 con 0x7f0780057170 2026-02-12T18:10:34.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.717+0000 7f075bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.717+0000 7f075bfff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:10:34.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.717+0000 7f075bfff640 10 monclient: dump: 2026-02-12T18:10:34.730 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.730 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.730 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.730 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.717+0000 7f075bfff640 1 -- 10.20.193.48:0/2337968662 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f076c00dd20 con 0x7f0780057170 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.717+0000 7f075bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.717+0000 7f075bfff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.717+0000 7f075bfff640 1 -- 10.20.193.48:0/2337968662 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f0780057170 msgr2=0x7f078005a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.717+0000 7f075bfff640 1 --2- 10.20.193.48:0/2337968662 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f0780057170 0x7f078005a9b0 secure :-1 s=READY pgs=317 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f076c003770 tx=0x7f076c00fc10 comp rx=0 tx=0).stop 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.717+0000 7f075bfff640 1 -- 10.20.193.48:0/2337968662 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f0780057170 msgr2=0x7f078005a9b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.717+0000 7f075bfff640 1 --2- 10.20.193.48:0/2337968662 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f0780057170 0x7f078005a9b0 secure :-1 s=CLOSED pgs=317 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f076c003770 tx=0x7f076c00fc10 comp rx=0 tx=0).stop 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.721+0000 7f0786047640 10 start_mon_command cmd=[{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.721+0000 7f0786047640 1 --2- 10.20.193.48:0/2337968662 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f078005aef0 0x7f078005b2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.721+0000 7f0786047640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.721+0000 7f0786047640 1 -- 10.20.193.48:0/2337968662 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f078005fd90 con 0x7f078005aef0 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.721+0000 7f077f7fe640 1 --2- 10.20.193.48:0/2337968662 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f078005aef0 0x7f078005b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.721+0000 7f077f7fe640 10 monclient: get_auth_request con 0x7f078005aef0 auth_method 0 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.721+0000 7f077f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.721+0000 7f077f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.721+0000 7f077f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.721+0000 7f077f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.721+0000 7f077f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.721+0000 7f077f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.721+0000 7f077f7fe640 10 monclient(hunting): handle_auth_done global_id 5797 payload 824 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.721+0000 7f077f7fe640 1 -- 10.20.193.48:0/2337968662 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 2: {"prefix": "sync_force", "yes_i_really_mean_it": true}) -- 0x7f078008b350 con 0x7f078005aef0 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.724+0000 7f077f7fe640 1 -- 10.20.193.48:0/2337968662 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f078005aef0 msgr2=0x7f078005b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.724+0000 7f077f7fe640 1 --2- 10.20.193.48:0/2337968662 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f078005aef0 0x7f078005b2f0 secure :-1 s=READY pgs=318 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f076c016000 tx=0x7f076c003810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.724+0000 7f075bfff640 1 -- 10.20.193.48:0/2337968662 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f076c014d50 con 0x7f078005aef0 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.724+0000 7f075bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:10:34.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.724+0000 7f075bfff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.724+0000 7f075bfff640 10 monclient: dump: 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.724+0000 7f075bfff640 1 -- 10.20.193.48:0/2337968662 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+83 (secure 0 0 0) 0x7f076c014890 con 0x7f078005aef0 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.724+0000 7f075bfff640 10 monclient: handle_command_reply 2 [{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.724+0000 7f075bfff640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.724+0000 7f075bfff640 1 -- 10.20.193.48:0/2337968662 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f078005aef0 msgr2=0x7f078005b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.724+0000 7f075bfff640 1 --2- 10.20.193.48:0/2337968662 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f078005aef0 0x7f078005b2f0 secure :-1 s=READY pgs=318 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f076c016000 tx=0x7f076c003810 comp rx=0 tx=0).stop 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.724+0000 7f075bfff640 1 -- 10.20.193.48:0/2337968662 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f078005aef0 msgr2=0x7f078005b2f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.724+0000 7f075bfff640 1 --2- 10.20.193.48:0/2337968662 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f078005aef0 0x7f078005b2f0 secure :-1 s=CLOSED pgs=318 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f076c016000 tx=0x7f076c003810 comp rx=0 tx=0).stop 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stdout: "ret": 0, 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stdout: "msg": "forcing store sync the next time the monitor starts" 2026-02-12T18:10:34.732 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:10:34.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.725+0000 7f0786047640 1 -- 10.20.193.48:0/2337968662 >> v2:10.20.193.111:6812/977811348 conn(0x7f075003f800 msgr2=0x7f075005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.725+0000 7f0786047640 1 --2- 10.20.193.48:0/2337968662 >> v2:10.20.193.111:6812/977811348 conn(0x7f075003f800 0x7f075005fcb0 secure :-1 s=READY pgs=309 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f077400a9b0 tx=0x7f0774007f90 comp rx=0 tx=0).stop 2026-02-12T18:10:34.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.725+0000 7f0786047640 10 monclient: shutdown 2026-02-12T18:10:34.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.725+0000 7f0786047640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:10:34.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.725+0000 7f0786047640 1 -- 10.20.193.48:0/2337968662 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f078008fca0 msgr2=0x7f07800566f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:10:34.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.725+0000 7f0786047640 1 --2- 10.20.193.48:0/2337968662 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f078008fca0 0x7f07800566f0 secure :-1 s=READY pgs=226 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f077000b520 tx=0x7f077000b9f0 comp rx=0 tx=0).stop 2026-02-12T18:10:34.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.725+0000 7f077ffff640 1 -- 10.20.193.48:0/2337968662 reap_dead start 2026-02-12T18:10:34.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.725+0000 7f077ffff640 1 -- 10.20.193.48:0/2337968662 reap_dead start 2026-02-12T18:10:34.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.725+0000 7f0786047640 1 -- 10.20.193.48:0/2337968662 shutdown_connections 2026-02-12T18:10:34.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.725+0000 7f0786047640 1 -- 10.20.193.48:0/2337968662 >> 10.20.193.48:0/2337968662 conn(0x7f0780054e10 msgr2=0x7f07801aeaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:10:34.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.725+0000 7f0786047640 1 -- 10.20.193.48:0/2337968662 shutdown_connections 2026-02-12T18:10:34.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:34.725+0000 7f0786047640 1 -- 10.20.193.48:0/2337968662 wait complete. 2026-02-12T18:10:34.733 INFO:tasks.mon_thrash.mon_thrasher:killing mon.f 2026-02-12T18:10:34.733 DEBUG:tasks.ceph.mon.f:waiting for process to exit 2026-02-12T18:10:34.734 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:10:34.744 INFO:tasks.ceph.mon.f:Stopped 2026-02-12T18:10:34.744 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.h 2026-02-12T18:10:34.744 INFO:tasks.mon_thrash.mon_thrasher:killing mon.h 2026-02-12T18:10:34.744 DEBUG:tasks.ceph.mon.h:waiting for process to exit 2026-02-12T18:10:34.744 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:10:34.794 INFO:tasks.ceph.mon.h:Stopped 2026-02-12T18:10:34.794 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.g 2026-02-12T18:10:34.794 INFO:tasks.mon_thrash:Sending STOP to mon g 2026-02-12T18:10:34.794 INFO:tasks.ceph.mon.g:Sent signal 19 2026-02-12T18:10:34.794 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-12T18:10:49.794 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.g 2026-02-12T18:10:49.794 INFO:tasks.mon_thrash:Sending CONT to mon g 2026-02-12T18:10:49.795 INFO:tasks.ceph.mon.g:Sent signal 18 2026-02-12T18:10:49.795 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 5 2026-02-12T18:10:49.795 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T18:10:49.862 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.860+0000 7fd27970c640 10 monclient: get_monmap_and_config 2026-02-12T18:10:49.862 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.860+0000 7fd27970c640 10 monclient: build_initial_monmap 2026-02-12T18:10:49.862 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.860+0000 7fd27970c640 10 monclient: monmap: 2026-02-12T18:10:49.862 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:10:49.862 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:10:49.862 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:10:49.861648+0000 2026-02-12T18:10:49.863 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:10:49.861648+0000 2026-02-12T18:10:49.863 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:10:49.863 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:10:49.863 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:10:49.863 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:10:49.863 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:10:49.863 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:10:49.863 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:10:49.863 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:10:49.863 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:10:49.863 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:10:49.863 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:10:49.863 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:10:49.863 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:10:49.863 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:10:49.863 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.860+0000 7fd27970c640 1 Processor -- start 2026-02-12T18:10:49.864 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd27970c640 1 -- start start 2026-02-12T18:10:49.864 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd27970c640 10 monclient: init 2026-02-12T18:10:49.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd27970c640 10 monclient: _reopen_session rank -1 2026-02-12T18:10:49.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd27970c640 10 monclient: _add_conns ranks=[1,3,8,9,10,6,0,5,7,4,2] 2026-02-12T18:10:49.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd27970c640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fd27405d2e0 addr v1:10.20.193.111:6789/0 2026-02-12T18:10:49.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd27970c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd27405ddc0 0x7fd2741857e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:49.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd27970c640 10 monclient(hunting): picked mon.noname-g con 0x7fd27405ddc0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:10:49.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd27970c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd274185d20 0x7fd2741a6100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:49.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd27970c640 10 monclient(hunting): picked mon.noname-e con 0x7fd274185d20 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:10:49.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd27970c640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd274060390 con 0x7fd27405d2e0 2026-02-12T18:10:49.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd27970c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:49.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd27970c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd27405e740 con 0x7fd27405ddc0 2026-02-12T18:10:49.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd27970c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:49.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd27970c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fd27408f730 con 0x7fd274185d20 2026-02-12T18:10:49.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd27970c640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:49.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd27970c640 10 monclient(hunting): authenticate will time out at 888.587303s 2026-02-12T18:10:49.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd2737fe640 1 -- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd274185d20 msgr2=0x7fd2741a6100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.48:3304/0 2026-02-12T18:10:49.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd2737fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd274185d20 0x7fd2741a6100 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:49.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd272ffd640 1 -- >> v1:10.20.193.111:6789/0 conn(0x7fd27405d2e0 legacy=0x7fd27405d6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.111:6789/0 2026-02-12T18:10:49.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd2727fc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd27405ddc0 0x7fd2741857e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:49.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd2727fc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd27405ddc0 0x7fd2741857e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3301/0 says I am v2:10.20.193.48:50030/0 (socket says 10.20.193.48:50030) 2026-02-12T18:10:49.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd2727fc640 1 -- 10.20.193.48:0/1150800620 learned_addr learned my addr 10.20.193.48:0/1150800620 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:10:49.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd2727fc640 10 monclient(hunting): get_auth_request con 0x7fd27405ddc0 auth_method 0 2026-02-12T18:10:49.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd2727fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:49.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd2727fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:49.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd2727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:49.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd2727fc640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd27405ddc0 msgr2=0x7fd2741857e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:10:49.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd2727fc640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd27405ddc0 msgr2=0x7fd2741857e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:49.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd27405ddc0 0x7fd2741857e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:49.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:49.861+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd27405ddc0 0x7fd2741857e0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:50.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:50.062+0000 7fd2737fe640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd274185d20 msgr2=0x7fd2741a6100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.48:3304/0 2026-02-12T18:10:50.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:50.062+0000 7fd2737fe640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd274185d20 0x7fd2741a6100 unknown :-1 s=START_CONNECT pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:10:50.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:50.062+0000 7fd272ffd640 1 -- 10.20.193.48:0/1150800620 >> v1:10.20.193.111:6789/0 conn(0x7fd27405d2e0 legacy=0x7fd27405d6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.111:6789/0 2026-02-12T18:10:50.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:50.062+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd27405ddc0 0x7fd2741857e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=8 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:50.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:50.062+0000 7fd2727fc640 10 monclient(hunting): get_auth_request con 0x7fd27405ddc0 auth_method 0 2026-02-12T18:10:50.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:50.062+0000 7fd2727fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:50.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:50.062+0000 7fd2727fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:50.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:50.062+0000 7fd2727fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:50.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:50.062+0000 7fd2727fc640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd27405ddc0 msgr2=0x7fd2741857e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:10:50.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:50.062+0000 7fd2727fc640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd27405ddc0 msgr2=0x7fd2741857e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:50.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:50.062+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd27405ddc0 0x7fd2741857e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=8 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:50.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:50.062+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd27405ddc0 0x7fd2741857e0 unknown :-1 s=START_CONNECT pgs=0 gs=9 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:10:50.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:50.463+0000 7fd2737fe640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd274185d20 msgr2=0x7fd2741a6100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.48:3304/0 2026-02-12T18:10:50.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:50.463+0000 7fd2737fe640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd274185d20 0x7fd2741a6100 unknown :-1 s=START_CONNECT pgs=0 gs=11 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:10:50.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:50.463+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd27405ddc0 0x7fd2741857e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=10 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:50.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:50.463+0000 7fd2727fc640 10 monclient(hunting): get_auth_request con 0x7fd27405ddc0 auth_method 0 2026-02-12T18:10:50.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:50.463+0000 7fd2727fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:50.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:50.463+0000 7fd2727fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:50.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:50.463+0000 7fd2727fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:50.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:50.463+0000 7fd272ffd640 1 -- 10.20.193.48:0/1150800620 >> v1:10.20.193.111:6789/0 conn(0x7fd27405d2e0 legacy=0x7fd27405d6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.111:6789/0 2026-02-12T18:10:50.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:50.463+0000 7fd2727fc640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd27405ddc0 msgr2=0x7fd2741857e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:10:50.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:50.463+0000 7fd2727fc640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd27405ddc0 msgr2=0x7fd2741857e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:50.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:50.463+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd27405ddc0 0x7fd2741857e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=10 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:50.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:50.463+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd27405ddc0 0x7fd2741857e0 unknown :-1 s=START_CONNECT pgs=0 gs=13 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:10:51.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:51.264+0000 7fd2737fe640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd274185d20 msgr2=0x7fd2741a6100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.48:3304/0 2026-02-12T18:10:51.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:51.264+0000 7fd2737fe640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd274185d20 0x7fd2741a6100 unknown :-1 s=START_CONNECT pgs=0 gs=14 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:10:51.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:51.264+0000 7fd272ffd640 1 -- 10.20.193.48:0/1150800620 >> v1:10.20.193.111:6789/0 conn(0x7fd27405d2e0 legacy=0x7fd27405d6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:10.20.193.111:6789/0 2026-02-12T18:10:51.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:51.264+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd27405ddc0 0x7fd2741857e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=16 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:51.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:51.264+0000 7fd2727fc640 10 monclient(hunting): get_auth_request con 0x7fd27405ddc0 auth_method 0 2026-02-12T18:10:51.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:51.264+0000 7fd2727fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:51.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:51.264+0000 7fd2727fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:51.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:51.264+0000 7fd2727fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:51.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:51.264+0000 7fd2727fc640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd27405ddc0 msgr2=0x7fd2741857e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:10:51.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:51.264+0000 7fd2727fc640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd27405ddc0 msgr2=0x7fd2741857e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:51.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:51.264+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd27405ddc0 0x7fd2741857e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=16 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:51.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:51.264+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd27405ddc0 0x7fd2741857e0 unknown :-1 s=START_CONNECT pgs=0 gs=17 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:10:52.864 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:52.862+0000 7fd270ff9640 10 monclient(hunting): tick 2026-02-12T18:10:52.864 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:52.862+0000 7fd270ff9640 10 monclient(hunting): _check_auth_tickets 2026-02-12T18:10:52.864 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:52.862+0000 7fd270ff9640 1 monclient(hunting): continuing hunt 2026-02-12T18:10:52.864 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:52.862+0000 7fd270ff9640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T18:10:52.864 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:52.862+0000 7fd270ff9640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd274185d20 msgr2=0x7fd2741a6100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:10:52.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:52.862+0000 7fd270ff9640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd274185d20 0x7fd2741a6100 unknown :-1 s=START_CONNECT pgs=0 gs=14 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:52.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:52.862+0000 7fd270ff9640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd27405ddc0 msgr2=0x7fd2741857e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:10:52.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:52.862+0000 7fd270ff9640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd27405ddc0 0x7fd2741857e0 unknown :-1 s=START_CONNECT pgs=0 gs=17 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:52.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:52.862+0000 7fd270ff9640 1 -- 10.20.193.48:0/1150800620 >> v1:10.20.193.111:6789/0 conn(0x7fd27405d2e0 legacy=0x7fd27405d6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:10:52.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:52.862+0000 7fd270ff9640 10 monclient: _add_conns ranks=[0,5,7,9,2,4,6,10] 2026-02-12T18:10:52.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:52.862+0000 7fd270ff9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fd2580038c0 addr v1:10.20.193.48:6789/0 2026-02-12T18:10:52.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:52.862+0000 7fd270ff9640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd2580254e0 0x7fd258045960 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:52.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:52.862+0000 7fd270ff9640 10 monclient(hunting): picked mon.noname-h con 0x7fd2580254e0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:10:52.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:52.862+0000 7fd270ff9640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd258045fc0 0x7fd258066470 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:52.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:52.862+0000 7fd270ff9640 10 monclient(hunting): picked mon.noname-i con 0x7fd258045fc0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:10:52.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:52.862+0000 7fd270ff9640 1 -- 10.20.193.48:0/1150800620 --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd27408f450 con 0x7fd2580038c0 2026-02-12T18:10:52.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:52.862+0000 7fd270ff9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:52.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:52.862+0000 7fd270ff9640 1 -- 10.20.193.48:0/1150800620 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fd27408f730 con 0x7fd2580254e0 2026-02-12T18:10:52.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:52.862+0000 7fd270ff9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:52.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:52.862+0000 7fd270ff9640 1 -- 10.20.193.48:0/1150800620 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fd258067c30 con 0x7fd258045fc0 2026-02-12T18:10:52.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:52.862+0000 7fd270ff9640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:52.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:52.862+0000 7fd2727fc640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd2580254e0 msgr2=0x7fd258045960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:10:52.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:52.862+0000 7fd2737fe640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd258045fc0 msgr2=0x7fd258066470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3303/0 2026-02-12T18:10:52.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:52.862+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd2580254e0 0x7fd258045960 unknown :-1 s=START_CONNECT pgs=0 gs=19 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:52.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:52.862+0000 7fd2737fe640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd258045fc0 0x7fd258066470 unknown :-1 s=START_CONNECT pgs=0 gs=20 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:52.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:52.863+0000 7fd272ffd640 1 -- 10.20.193.48:0/1150800620 >> v1:10.20.193.48:6789/0 conn(0x7fd2580038c0 legacy=0x7fd258023d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:10:53.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:53.063+0000 7fd2737fe640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd258045fc0 msgr2=0x7fd258066470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3303/0 2026-02-12T18:10:53.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:53.063+0000 7fd2737fe640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd258045fc0 0x7fd258066470 unknown :-1 s=START_CONNECT pgs=0 gs=21 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:10:53.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:53.063+0000 7fd2727fc640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd2580254e0 msgr2=0x7fd258045960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:10:53.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:53.063+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd2580254e0 0x7fd258045960 unknown :-1 s=START_CONNECT pgs=0 gs=22 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:10:53.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:53.464+0000 7fd2737fe640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd258045fc0 msgr2=0x7fd258066470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3303/0 2026-02-12T18:10:53.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:53.464+0000 7fd2737fe640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd258045fc0 0x7fd258066470 unknown :-1 s=START_CONNECT pgs=0 gs=23 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:10:53.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:53.464+0000 7fd2727fc640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd2580254e0 msgr2=0x7fd258045960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:10:53.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:53.464+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd2580254e0 0x7fd258045960 unknown :-1 s=START_CONNECT pgs=0 gs=24 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:10:54.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:54.265+0000 7fd2737fe640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd258045fc0 msgr2=0x7fd258066470 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3303/0 2026-02-12T18:10:54.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:54.265+0000 7fd2737fe640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd258045fc0 0x7fd258066470 unknown :-1 s=START_CONNECT pgs=0 gs=25 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:10:54.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:54.265+0000 7fd2727fc640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd2580254e0 msgr2=0x7fd258045960 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:10:54.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:54.265+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd2580254e0 0x7fd258045960 unknown :-1 s=START_CONNECT pgs=0 gs=26 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:10:55.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.198+0000 7fd272ffd640 1 -- 10.20.193.48:0/1150800620 >> v1:10.20.193.48:6789/0 conn(0x7fd2580038c0 legacy=0x7fd258023d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-12T18:10:55.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.198+0000 7fd272ffd640 1 -- 10.20.193.48:0/1150800620 >> v1:10.20.193.48:6789/0 conn(0x7fd2580038c0 legacy=0x7fd258023d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:10:55.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.198+0000 7fd272ffd640 1 --1- 10.20.193.48:0/1150800620 >> v1:10.20.193.48:6789/0 conn(0x7fd2580038c0 0x7fd258023d00 :-1 s=OPENED pgs=403 gs=18 cs=1 l=1).handle_message read tag failed 2026-02-12T18:10:55.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.198+0000 7fd272ffd640 1 --1- 10.20.193.48:0/1150800620 >> v1:10.20.193.48:6789/0 conn(0x7fd2580038c0 0x7fd258023d00 :-1 s=OPENED pgs=403 gs=18 cs=1 l=1).fault on lossy channel, failing 2026-02-12T18:10:55.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.198+0000 7fd271ffb640 10 monclient(hunting): ms_handle_reset hunted mon v1:10.20.193.48:6789/0 2026-02-12T18:10:55.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd270ff9640 10 monclient(hunting): tick 2026-02-12T18:10:55.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd270ff9640 10 monclient(hunting): _check_auth_tickets 2026-02-12T18:10:55.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd270ff9640 1 monclient(hunting): continuing hunt 2026-02-12T18:10:55.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd270ff9640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T18:10:55.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd270ff9640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd258045fc0 msgr2=0x7fd258066470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:10:55.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd270ff9640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd258045fc0 0x7fd258066470 unknown :-1 s=START_CONNECT pgs=0 gs=25 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:55.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd270ff9640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd2580254e0 msgr2=0x7fd258045960 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:10:55.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd270ff9640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd2580254e0 0x7fd258045960 unknown :-1 s=START_CONNECT pgs=0 gs=26 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:55.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd2737fe640 1 -- 10.20.193.48:0/1150800620 reap_dead start 2026-02-12T18:10:55.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd270ff9640 1 -- 10.20.193.48:0/1150800620 >> v1:10.20.193.48:6789/0 conn(0x7fd2580038c0 legacy=0x7fd258023d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:10:55.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd270ff9640 10 monclient: _add_conns ranks=[2,9,4,6,10] 2026-02-12T18:10:55.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd2737fe640 1 -- 10.20.193.48:0/1150800620 reap_dead start 2026-02-12T18:10:55.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd270ff9640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd258066c50 0x7fd2580458e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:55.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd270ff9640 10 monclient(hunting): picked mon.noname-b con 0x7fd258066c50 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:10:55.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd270ff9640 1 --2- 10.20.193.48:0/1150800620 >> v2:10.20.193.48:3300/0 conn(0x7fd258067100 0x7fd258067570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:55.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd270ff9640 10 monclient(hunting): picked mon.noname-a con 0x7fd258067100 addr v2:10.20.193.48:3300/0 2026-02-12T18:10:55.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd270ff9640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd2580663a0 0x7fd258023d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:55.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd270ff9640 10 monclient(hunting): picked mon.noname-c con 0x7fd2580663a0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:10:55.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd270ff9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:55.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd270ff9640 1 -- 10.20.193.48:0/1150800620 --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7fd27408f730 con 0x7fd258067100 2026-02-12T18:10:55.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd270ff9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:55.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd270ff9640 1 -- 10.20.193.48:0/1150800620 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fd258067c30 con 0x7fd258066c50 2026-02-12T18:10:55.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd270ff9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:55.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd270ff9640 1 -- 10.20.193.48:0/1150800620 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fd258024240 con 0x7fd2580663a0 2026-02-12T18:10:55.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd270ff9640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:55.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> v2:10.20.193.48:3300/0 conn(0x7fd258067100 0x7fd258067570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=28 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:55.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd272ffd640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd258066c50 0x7fd2580458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=27 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:55.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd2737fe640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd2580663a0 0x7fd258023d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=29 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:55.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd2727fc640 10 monclient(hunting): get_auth_request con 0x7fd258067100 auth_method 0 2026-02-12T18:10:55.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd2727fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:55.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd2727fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:55.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd2727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:55.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd272ffd640 10 monclient(hunting): get_auth_request con 0x7fd258066c50 auth_method 0 2026-02-12T18:10:55.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd272ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:55.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd272ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:55.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd272ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:55.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd2737fe640 10 monclient(hunting): get_auth_request con 0x7fd2580663a0 auth_method 0 2026-02-12T18:10:55.869 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd2737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:55.869 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd2737fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:55.869 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd2737fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:55.869 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd2727fc640 1 -- 10.20.193.48:0/1150800620 >> v2:10.20.193.48:3300/0 conn(0x7fd258067100 msgr2=0x7fd258067570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:10:55.869 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd2727fc640 1 -- 10.20.193.48:0/1150800620 >> v2:10.20.193.48:3300/0 conn(0x7fd258067100 msgr2=0x7fd258067570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:55.869 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> v2:10.20.193.48:3300/0 conn(0x7fd258067100 0x7fd258067570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=28 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:55.869 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> v2:10.20.193.48:3300/0 conn(0x7fd258067100 0x7fd258067570 unknown :-1 s=START_CONNECT pgs=0 gs=30 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:55.869 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd272ffd640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd258066c50 msgr2=0x7fd2580458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:10:55.869 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd272ffd640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd258066c50 msgr2=0x7fd2580458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:55.869 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd272ffd640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd258066c50 0x7fd2580458e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=27 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:55.869 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd2737fe640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd2580663a0 msgr2=0x7fd258023d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-12T18:10:55.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd2737fe640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd2580663a0 msgr2=0x7fd258023d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:55.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd2737fe640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd2580663a0 0x7fd258023d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=29 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:55.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd272ffd640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd258066c50 0x7fd2580458e0 unknown :-1 s=START_CONNECT pgs=0 gs=31 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:55.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:55.862+0000 7fd2737fe640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd2580663a0 0x7fd258023d00 unknown :-1 s=START_CONNECT pgs=0 gs=32 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:56.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd2737fe640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd2580663a0 0x7fd258023d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=34 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:56.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd272ffd640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd258066c50 0x7fd2580458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=33 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:56.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd2737fe640 10 monclient(hunting): get_auth_request con 0x7fd2580663a0 auth_method 0 2026-02-12T18:10:56.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd2737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:56.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd2737fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:56.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd2737fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:56.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> v2:10.20.193.48:3300/0 conn(0x7fd258067100 0x7fd258067570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=35 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:56.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd2727fc640 10 monclient(hunting): get_auth_request con 0x7fd258067100 auth_method 0 2026-02-12T18:10:56.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd2727fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:56.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd2727fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:56.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd2727fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:56.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd272ffd640 10 monclient(hunting): get_auth_request con 0x7fd258066c50 auth_method 0 2026-02-12T18:10:56.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd272ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:56.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd272ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:56.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd272ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:56.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd2737fe640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd2580663a0 msgr2=0x7fd258023d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:10:56.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd2737fe640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd2580663a0 msgr2=0x7fd258023d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:56.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd2737fe640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd2580663a0 0x7fd258023d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=34 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:56.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd2727fc640 1 -- 10.20.193.48:0/1150800620 >> v2:10.20.193.48:3300/0 conn(0x7fd258067100 msgr2=0x7fd258067570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-12T18:10:56.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd2727fc640 1 -- 10.20.193.48:0/1150800620 >> v2:10.20.193.48:3300/0 conn(0x7fd258067100 msgr2=0x7fd258067570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:56.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> v2:10.20.193.48:3300/0 conn(0x7fd258067100 0x7fd258067570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=35 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:56.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd2737fe640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd2580663a0 0x7fd258023d00 unknown :-1 s=START_CONNECT pgs=0 gs=36 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:10:56.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> v2:10.20.193.48:3300/0 conn(0x7fd258067100 0x7fd258067570 unknown :-1 s=START_CONNECT pgs=0 gs=37 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:10:56.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd272ffd640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd258066c50 msgr2=0x7fd2580458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:10:56.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd272ffd640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd258066c50 msgr2=0x7fd2580458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:56.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd272ffd640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd258066c50 0x7fd2580458e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=33 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:56.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.064+0000 7fd272ffd640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd258066c50 0x7fd2580458e0 unknown :-1 s=START_CONNECT pgs=0 gs=38 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:10:56.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd2737fe640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd2580663a0 0x7fd258023d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=39 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:56.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd2737fe640 10 monclient(hunting): get_auth_request con 0x7fd2580663a0 auth_method 0 2026-02-12T18:10:56.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd2737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:56.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd2737fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:56.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd2737fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:56.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd272ffd640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd258066c50 0x7fd2580458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=40 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:56.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd2737fe640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd2580663a0 msgr2=0x7fd258023d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:10:56.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd2737fe640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd2580663a0 msgr2=0x7fd258023d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:56.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd2737fe640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd2580663a0 0x7fd258023d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=39 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:56.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> v2:10.20.193.48:3300/0 conn(0x7fd258067100 0x7fd258067570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=41 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:56.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd2737fe640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd2580663a0 0x7fd258023d00 unknown :-1 s=START_CONNECT pgs=0 gs=42 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:10:56.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd272ffd640 10 monclient(hunting): get_auth_request con 0x7fd258066c50 auth_method 0 2026-02-12T18:10:56.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd272ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:56.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd272ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:56.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd272ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:56.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd2727fc640 10 monclient(hunting): get_auth_request con 0x7fd258067100 auth_method 0 2026-02-12T18:10:56.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd2727fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:56.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd2727fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:56.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd2727fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:56.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd272ffd640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd258066c50 msgr2=0x7fd2580458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:10:56.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd272ffd640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd258066c50 msgr2=0x7fd2580458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:56.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd272ffd640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd258066c50 0x7fd2580458e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=40 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:56.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd2727fc640 1 -- 10.20.193.48:0/1150800620 >> v2:10.20.193.48:3300/0 conn(0x7fd258067100 msgr2=0x7fd258067570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-12T18:10:56.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd2727fc640 1 -- 10.20.193.48:0/1150800620 >> v2:10.20.193.48:3300/0 conn(0x7fd258067100 msgr2=0x7fd258067570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:56.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> v2:10.20.193.48:3300/0 conn(0x7fd258067100 0x7fd258067570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=41 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:56.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd272ffd640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd258066c50 0x7fd2580458e0 unknown :-1 s=START_CONNECT pgs=0 gs=43 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:10:56.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:56.466+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> v2:10.20.193.48:3300/0 conn(0x7fd258067100 0x7fd258067570 unknown :-1 s=START_CONNECT pgs=0 gs=44 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:10:57.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd2737fe640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd2580663a0 0x7fd258023d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=45 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:57.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd2737fe640 10 monclient(hunting): get_auth_request con 0x7fd2580663a0 auth_method 0 2026-02-12T18:10:57.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd2737fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:57.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd2737fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:57.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd2737fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:57.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> v2:10.20.193.48:3300/0 conn(0x7fd258067100 0x7fd258067570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=46 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:57.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd2737fe640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd2580663a0 msgr2=0x7fd258023d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:10:57.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd2737fe640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd2580663a0 msgr2=0x7fd258023d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:57.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd2737fe640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd2580663a0 0x7fd258023d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=45 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:57.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd2727fc640 10 monclient(hunting): get_auth_request con 0x7fd258067100 auth_method 0 2026-02-12T18:10:57.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd2727fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:57.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd2727fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:57.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd2727fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:57.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd272ffd640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd258066c50 0x7fd2580458e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=47 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:57.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd2737fe640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd2580663a0 0x7fd258023d00 unknown :-1 s=START_CONNECT pgs=0 gs=48 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:10:57.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd272ffd640 10 monclient(hunting): get_auth_request con 0x7fd258066c50 auth_method 0 2026-02-12T18:10:57.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd272ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:57.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd272ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:57.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd272ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:57.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd2727fc640 1 -- 10.20.193.48:0/1150800620 >> v2:10.20.193.48:3300/0 conn(0x7fd258067100 msgr2=0x7fd258067570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:10:57.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd2727fc640 1 -- 10.20.193.48:0/1150800620 >> v2:10.20.193.48:3300/0 conn(0x7fd258067100 msgr2=0x7fd258067570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:57.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> v2:10.20.193.48:3300/0 conn(0x7fd258067100 0x7fd258067570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=46 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:57.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd272ffd640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd258066c50 msgr2=0x7fd2580458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-12T18:10:57.272 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd272ffd640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd258066c50 msgr2=0x7fd2580458e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:57.272 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd272ffd640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd258066c50 0x7fd2580458e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=47 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:57.272 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> v2:10.20.193.48:3300/0 conn(0x7fd258067100 0x7fd258067570 unknown :-1 s=START_CONNECT pgs=0 gs=49 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:10:57.272 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:57.267+0000 7fd272ffd640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd258066c50 0x7fd2580458e0 unknown :-1 s=START_CONNECT pgs=0 gs=50 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:10:58.864 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd270ff9640 10 monclient(hunting): tick 2026-02-12T18:10:58.864 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd270ff9640 10 monclient(hunting): _check_auth_tickets 2026-02-12T18:10:58.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd270ff9640 1 monclient(hunting): continuing hunt 2026-02-12T18:10:58.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd270ff9640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T18:10:58.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd270ff9640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd2580663a0 msgr2=0x7fd258023d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:10:58.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd270ff9640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd2580663a0 0x7fd258023d00 unknown :-1 s=START_CONNECT pgs=0 gs=48 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:58.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd270ff9640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd258066c50 msgr2=0x7fd2580458e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:10:58.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd270ff9640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd258066c50 0x7fd2580458e0 unknown :-1 s=START_CONNECT pgs=0 gs=50 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:58.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd270ff9640 1 -- 10.20.193.48:0/1150800620 >> v2:10.20.193.48:3300/0 conn(0x7fd258067100 msgr2=0x7fd258067570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:10:58.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd270ff9640 1 --2- 10.20.193.48:0/1150800620 >> v2:10.20.193.48:3300/0 conn(0x7fd258067100 0x7fd258067570 unknown :-1 s=START_CONNECT pgs=0 gs=49 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:10:58.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd270ff9640 10 monclient: _add_conns ranks=[6,10] 2026-02-12T18:10:58.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd270ff9640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd2580246e0 0x7fd258024ab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:58.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd270ff9640 10 monclient(hunting): picked mon.noname-d con 0x7fd2580246e0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:10:58.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd270ff9640 1 --2- 10.20.193.48:0/1150800620 >> v2:10.20.193.111:3300/0 conn(0x7fd258087f60 0x7fd2580a8340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:10:58.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd270ff9640 10 monclient(hunting): picked mon.noname-f con 0x7fd258087f60 addr v2:10.20.193.111:3300/0 2026-02-12T18:10:58.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd270ff9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:58.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd270ff9640 1 -- 10.20.193.48:0/1150800620 --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7fd27408f730 con 0x7fd258087f60 2026-02-12T18:10:58.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd270ff9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:10:58.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd270ff9640 1 -- 10.20.193.48:0/1150800620 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fd258067c30 con 0x7fd2580246e0 2026-02-12T18:10:58.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd270ff9640 10 monclient(hunting): _renew_subs 2026-02-12T18:10:58.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd2727fc640 1 -- 10.20.193.48:0/1150800620 >> v2:10.20.193.111:3300/0 conn(0x7fd258087f60 msgr2=0x7fd2580a8340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3300/0 2026-02-12T18:10:58.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd272ffd640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd2580246e0 0x7fd258024ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=51 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:58.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> v2:10.20.193.111:3300/0 conn(0x7fd258087f60 0x7fd2580a8340 unknown :-1 s=START_CONNECT pgs=0 gs=52 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:58.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd272ffd640 10 monclient(hunting): get_auth_request con 0x7fd2580246e0 auth_method 0 2026-02-12T18:10:58.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd272ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:58.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd272ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:58.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd272ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:10:58.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd272ffd640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd2580246e0 msgr2=0x7fd258024ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:10:58.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd272ffd640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd2580246e0 msgr2=0x7fd258024ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:58.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd272ffd640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd2580246e0 0x7fd258024ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=51 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:58.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:58.862+0000 7fd272ffd640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd2580246e0 0x7fd258024ab0 unknown :-1 s=START_CONNECT pgs=0 gs=53 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:10:59.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:59.063+0000 7fd2727fc640 1 -- 10.20.193.48:0/1150800620 >> v2:10.20.193.111:3300/0 conn(0x7fd258087f60 msgr2=0x7fd2580a8340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3300/0 2026-02-12T18:10:59.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:59.063+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> v2:10.20.193.111:3300/0 conn(0x7fd258087f60 0x7fd2580a8340 unknown :-1 s=START_CONNECT pgs=0 gs=54 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:10:59.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:59.063+0000 7fd272ffd640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd2580246e0 0x7fd258024ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=55 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:59.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:59.063+0000 7fd272ffd640 10 monclient(hunting): get_auth_request con 0x7fd2580246e0 auth_method 0 2026-02-12T18:10:59.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:59.063+0000 7fd272ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:59.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:59.063+0000 7fd272ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:59.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:59.063+0000 7fd272ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:59.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:59.063+0000 7fd272ffd640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd2580246e0 msgr2=0x7fd258024ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:10:59.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:59.063+0000 7fd272ffd640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd2580246e0 msgr2=0x7fd258024ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:59.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:59.063+0000 7fd272ffd640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd2580246e0 0x7fd258024ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=55 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:59.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:59.063+0000 7fd272ffd640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd2580246e0 0x7fd258024ab0 unknown :-1 s=START_CONNECT pgs=0 gs=56 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:10:59.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:59.464+0000 7fd2727fc640 1 -- 10.20.193.48:0/1150800620 >> v2:10.20.193.111:3300/0 conn(0x7fd258087f60 msgr2=0x7fd2580a8340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3300/0 2026-02-12T18:10:59.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:59.464+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> v2:10.20.193.111:3300/0 conn(0x7fd258087f60 0x7fd2580a8340 unknown :-1 s=START_CONNECT pgs=0 gs=57 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:10:59.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:59.465+0000 7fd272ffd640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd2580246e0 0x7fd258024ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=58 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:10:59.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:59.465+0000 7fd272ffd640 10 monclient(hunting): get_auth_request con 0x7fd2580246e0 auth_method 0 2026-02-12T18:10:59.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:59.465+0000 7fd272ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:10:59.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:59.465+0000 7fd272ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:10:59.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:59.465+0000 7fd272ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:10:59.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:59.465+0000 7fd272ffd640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd2580246e0 msgr2=0x7fd258024ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:10:59.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:59.465+0000 7fd272ffd640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd2580246e0 msgr2=0x7fd258024ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:10:59.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:59.465+0000 7fd272ffd640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd2580246e0 0x7fd258024ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=58 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:10:59.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:10:59.465+0000 7fd272ffd640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd2580246e0 0x7fd258024ab0 unknown :-1 s=START_CONNECT pgs=0 gs=59 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:11:00.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.266+0000 7fd2727fc640 1 -- 10.20.193.48:0/1150800620 >> v2:10.20.193.111:3300/0 conn(0x7fd258087f60 msgr2=0x7fd2580a8340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3300/0 2026-02-12T18:11:00.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.266+0000 7fd2727fc640 1 --2- 10.20.193.48:0/1150800620 >> v2:10.20.193.111:3300/0 conn(0x7fd258087f60 0x7fd2580a8340 unknown :-1 s=START_CONNECT pgs=0 gs=60 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:11:00.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.266+0000 7fd272ffd640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd2580246e0 0x7fd258024ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=61 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:00.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.266+0000 7fd272ffd640 10 monclient(hunting): get_auth_request con 0x7fd2580246e0 auth_method 0 2026-02-12T18:11:00.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.266+0000 7fd272ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:00.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.266+0000 7fd272ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:00.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.266+0000 7fd272ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:11:00.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.266+0000 7fd272ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:11:00.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.266+0000 7fd272ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:11:00.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.266+0000 7fd272ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:11:00.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.266+0000 7fd272ffd640 10 monclient(hunting): handle_auth_done global_id 5667 payload 274 2026-02-12T18:11:00.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.266+0000 7fd272ffd640 1 -- 10.20.193.48:0/1150800620 >> v2:10.20.193.111:3300/0 conn(0x7fd258087f60 msgr2=0x7fd2580a8340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:11:00.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.266+0000 7fd272ffd640 1 --2- 10.20.193.48:0/1150800620 >> v2:10.20.193.111:3300/0 conn(0x7fd258087f60 0x7fd2580a8340 unknown :-1 s=START_CONNECT pgs=0 gs=60 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:00.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.266+0000 7fd272ffd640 10 monclient: _finish_hunting 0 2026-02-12T18:11:00.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.266+0000 7fd272ffd640 1 monclient: found mon.noname-d 2026-02-12T18:11:00.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.266+0000 7fd272ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:11:00.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.266+0000 7fd272ffd640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:11:00.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.266+0000 7fd272ffd640 1 -- 10.20.193.48:0/1150800620 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd274060390 con 0x7fd2580246e0 2026-02-12T18:11:00.274 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd272ffd640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd2580246e0 msgr2=0x7fd258024ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:11:00.274 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd272ffd640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd2580246e0 0x7fd258024ab0 secure :-1 s=READY pgs=228 gs=61 cs=0 l=1 c_cookie=5318396046131218863 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd268002670 tx=0x7fd268030d60 comp rx=0 tx=0).ready entity=mon.6 client_cookie=49cebd06a07e49af server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:00.274 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd271ffb640 1 -- 10.20.193.48:0/1150800620 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd268031d30 con 0x7fd2580246e0 2026-02-12T18:11:00.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd271ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:00.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd271ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:11:00.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd271ffb640 10 monclient: dump: 2026-02-12T18:11:00.275 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:00.275 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:00.275 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:00.275 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:00.275 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:00.275 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:00.275 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:00.275 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:00.276 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:00.276 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:00.276 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:00.276 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:00.276 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:00.276 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:00.276 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:00.276 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:00.276 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd271ffb640 10 monclient: _finish_auth 0 2026-02-12T18:11:00.276 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd271ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:11:00.276 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd271ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:11:00.276 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd271ffb640 1 -- 10.20.193.48:0/1150800620 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd268016040 con 0x7fd2580246e0 2026-02-12T18:11:00.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd271ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:11:00.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd271ffb640 1 -- 10.20.193.48:0/1150800620 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd268037800 con 0x7fd2580246e0 2026-02-12T18:11:00.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd271ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:00.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd271ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:11:00.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd271ffb640 10 monclient: dump: 2026-02-12T18:11:00.277 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:00.277 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:00.277 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:00.277 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:00.277 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:00.277 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:00.277 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:00.278 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:00.278 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:00.278 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:00.278 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:00.278 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:00.278 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:00.278 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:00.278 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:00.278 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:00.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd27970c640 5 monclient: authenticate success, global_id 5667 2026-02-12T18:11:00.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd27970c640 10 monclient: get_monmap_and_config success 2026-02-12T18:11:00.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd27970c640 4 set_mon_vals no callback set 2026-02-12T18:11:00.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd27970c640 10 monclient: shutdown 2026-02-12T18:11:00.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd27970c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:11:00.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd27970c640 1 -- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd2580246e0 msgr2=0x7fd258024ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:00.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd27970c640 1 --2- 10.20.193.48:0/1150800620 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd2580246e0 0x7fd258024ab0 secure :-1 s=READY pgs=228 gs=61 cs=0 l=1 c_cookie=5318396046131218863 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd268002670 tx=0x7fd268030d60 comp rx=0 tx=0).stop 2026-02-12T18:11:00.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd2737fe640 1 -- 10.20.193.48:0/1150800620 reap_dead start 2026-02-12T18:11:00.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd27970c640 1 -- 10.20.193.48:0/1150800620 shutdown_connections 2026-02-12T18:11:00.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd27970c640 1 -- 10.20.193.48:0/1150800620 >> 10.20.193.48:0/1150800620 conn(0x7fd274092150 msgr2=0x7fd274093910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:11:00.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd27970c640 1 -- 10.20.193.48:0/1150800620 shutdown_connections 2026-02-12T18:11:00.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.269+0000 7fd27970c640 1 -- 10.20.193.48:0/1150800620 wait complete. 2026-02-12T18:11:00.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.270+0000 7fd27970c640 10 monclient: build_initial_monmap 2026-02-12T18:11:00.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.270+0000 7fd27970c640 10 monclient: monmap: 2026-02-12T18:11:00.279 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:11:00.280 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:11:00.280 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:11:00.280 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:11:00.280 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:11:00.280 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:00.280 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:11:00.280 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:11:00.280 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:11:00.280 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:11:00.280 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:11:00.280 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:11:00.280 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:11:00.280 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:11:00.281 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:11:00.281 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:00.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.270+0000 7fd27970c640 1 Processor -- start 2026-02-12T18:11:00.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.270+0000 7fd27970c640 1 -- start start 2026-02-12T18:11:00.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.270+0000 7fd27970c640 10 monclient: init 2026-02-12T18:11:00.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.270+0000 7fd27970c640 10 monclient: _reopen_session rank -1 2026-02-12T18:11:00.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd27970c640 10 monclient: _add_conns ranks=[5,0,1,2,3,4,8,7,6] 2026-02-12T18:11:00.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd27970c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd2580246e0 0x7fd2741389e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:00.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd27970c640 10 monclient(hunting): picked mon.noname-h con 0x7fd2580246e0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:11:00.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd27970c640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd274138f20 0x7fd274139310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:00.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd27970c640 10 monclient(hunting): picked mon.noname-a con 0x7fd274138f20 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:11:00.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd27970c640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd2741545a0 0x7fd274154a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:00.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd27970c640 10 monclient(hunting): picked mon.noname-f con 0x7fd2741545a0 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:11:00.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd27970c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:00.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd27970c640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fd27413b370 con 0x7fd274138f20 2026-02-12T18:11:00.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd27970c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:00.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd27970c640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd274145080 con 0x7fd2741545a0 2026-02-12T18:11:00.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd27970c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:00.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd27970c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fd27413e570 con 0x7fd2580246e0 2026-02-12T18:11:00.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd27970c640 10 monclient(hunting): _renew_subs 2026-02-12T18:11:00.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd27970c640 10 monclient(hunting): authenticate will time out at 898.997059s 2026-02-12T18:11:00.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd272ffd640 1 -- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd2580246e0 msgr2=0x7fd2741389e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:11:00.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd272ffd640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd2580246e0 0x7fd2741389e0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:11:00.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd2737fe640 1 -- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd2741545a0 msgr2=0x7fd274154a10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3300/0 2026-02-12T18:11:00.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd2727fc640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd274138f20 0x7fd274139310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:00.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd2737fe640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd2741545a0 0x7fd274154a10 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:11:00.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd2727fc640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd274138f20 0x7fd274139310 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:51974/0 (socket says 10.20.193.48:51974) 2026-02-12T18:11:00.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd2727fc640 1 -- 10.20.193.48:0/2127142762 learned_addr learned my addr 10.20.193.48:0/2127142762 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:11:00.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd2727fc640 10 monclient(hunting): get_auth_request con 0x7fd274138f20 auth_method 0 2026-02-12T18:11:00.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd2727fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:00.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd2727fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:00.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd2727fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:11:00.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd2727fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:11:00.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd2727fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:11:00.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd2727fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:11:00.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd2727fc640 10 monclient(hunting): handle_auth_done global_id 6048 payload 824 2026-02-12T18:11:00.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd2727fc640 1 -- 10.20.193.48:0/2127142762 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd2580246e0 msgr2=0x7fd2741389e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:11:00.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd2727fc640 1 --2- 10.20.193.48:0/2127142762 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd2580246e0 0x7fd2741389e0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:00.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd2727fc640 1 -- 10.20.193.48:0/2127142762 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd2741545a0 msgr2=0x7fd274154a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:11:00.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd2727fc640 1 --2- 10.20.193.48:0/2127142762 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd2741545a0 0x7fd274154a10 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:00.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd2727fc640 10 monclient: _finish_hunting 0 2026-02-12T18:11:00.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd2727fc640 1 monclient: found mon.noname-a 2026-02-12T18:11:00.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd2727fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:11:00.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd2727fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:11:00.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.271+0000 7fd2727fc640 1 -- 10.20.193.48:0/2127142762 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd27408f450 con 0x7fd274138f20 2026-02-12T18:11:00.287 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.273+0000 7fd2727fc640 1 -- 10.20.193.48:0/2127142762 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd274138f20 msgr2=0x7fd274139310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:11:00.287 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.273+0000 7fd2727fc640 1 --2- 10.20.193.48:0/2127142762 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd274138f20 0x7fd274139310 secure :-1 s=READY pgs=409 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd25c019710 tx=0x7fd25c019be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:00.287 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.273+0000 7fd2537fe640 1 -- 10.20.193.48:0/2127142762 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd25c01e070 con 0x7fd274138f20 2026-02-12T18:11:00.287 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.273+0000 7fd2537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:00.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.273+0000 7fd2537fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:11:00.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.273+0000 7fd2537fe640 10 monclient: dump: 2026-02-12T18:11:00.288 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:00.288 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:00.288 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:00.288 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:00.288 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:00.288 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:00.288 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:00.288 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:00.288 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:00.288 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:00.289 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:00.289 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:00.289 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:00.289 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:00.289 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:00.289 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:00.289 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.273+0000 7fd2537fe640 10 monclient: _finish_auth 0 2026-02-12T18:11:00.289 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.273+0000 7fd2537fe640 10 monclient: _check_auth_tickets 2026-02-12T18:11:00.289 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.273+0000 7fd2537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:11:00.289 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.273+0000 7fd2537fe640 1 -- 10.20.193.48:0/2127142762 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd25c00c040 con 0x7fd274138f20 2026-02-12T18:11:00.289 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.273+0000 7fd2537fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:11:00.289 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.273+0000 7fd2537fe640 1 -- 10.20.193.48:0/2127142762 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd25c019e00 con 0x7fd274138f20 2026-02-12T18:11:00.290 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.273+0000 7fd27970c640 5 monclient: authenticate success, global_id 6048 2026-02-12T18:11:00.290 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.273+0000 7fd27970c640 10 monclient: _renew_subs 2026-02-12T18:11:00.290 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.273+0000 7fd27970c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:11:00.290 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.273+0000 7fd2717fa640 4 set_mon_vals no callback set 2026-02-12T18:11:00.290 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.273+0000 7fd27970c640 1 -- 10.20.193.48:0/2127142762 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd274139850 con 0x7fd274138f20 2026-02-12T18:11:00.290 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.273+0000 7fd2537fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:00.290 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.273+0000 7fd2537fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:11:00.290 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.273+0000 7fd2537fe640 10 monclient: dump: 2026-02-12T18:11:00.290 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:00.290 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:00.290 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:00.290 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:00.291 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:00.291 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:00.291 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:00.291 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:00.291 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:00.291 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:00.291 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:00.291 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:00.291 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:00.291 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:00.291 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:00.291 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:00.291 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.273+0000 7fd27970c640 10 monclient: _renew_subs 2026-02-12T18:11:00.292 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.273+0000 7fd27970c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:11:00.292 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.273+0000 7fd27970c640 1 -- 10.20.193.48:0/2127142762 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd274089910 con 0x7fd274138f20 2026-02-12T18:11:00.292 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.274+0000 7fd27970c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:11:00.292 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.274+0000 7fd27970c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:11:00.292 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.274+0000 7fd27970c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:11:00.292 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.274+0000 7fd27970c640 1 -- 10.20.193.48:0/2127142762 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd27413b0f0 con 0x7fd274138f20 2026-02-12T18:11:00.292 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.274+0000 7fd2537fe640 1 -- 10.20.193.48:0/2127142762 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fd25c0163d0 con 0x7fd274138f20 2026-02-12T18:11:00.292 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.274+0000 7fd2537fe640 1 --2- 10.20.193.48:0/2127142762 >> v2:10.20.193.111:6812/977811348 conn(0x7fd24003f780 0x7fd24005fc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:00.292 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.274+0000 7fd2537fe640 1 -- 10.20.193.48:0/2127142762 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(215..215 src has 190..215) ==== 3503+0+0 (secure 0 0 0) 0x7fd25c053d10 con 0x7fd274138f20 2026-02-12T18:11:00.292 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.275+0000 7fd272ffd640 1 --2- 10.20.193.48:0/2127142762 >> v2:10.20.193.111:6812/977811348 conn(0x7fd24003f780 0x7fd24005fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:00.292 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.275+0000 7fd272ffd640 10 monclient: get_auth_request con 0x7fd24003f780 auth_method 0 2026-02-12T18:11:00.292 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.277+0000 7fd2537fe640 1 -- 10.20.193.48:0/2127142762 <== mon.0 v2:10.20.193.48:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fd25c05a080 con 0x7fd274138f20 2026-02-12T18:11:00.293 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.277+0000 7fd2537fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:11:00.293 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.277+0000 7fd2537fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:11:00.293 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.277+0000 7fd272ffd640 1 --2- 10.20.193.48:0/2127142762 >> v2:10.20.193.111:6812/977811348 conn(0x7fd24003f780 0x7fd24005fc30 secure :-1 s=READY pgs=311 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd268002670 tx=0x7fd26803b040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:00.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.422+0000 7fd27970c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T18:11:00.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.422+0000 7fd27970c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T18:11:00.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.422+0000 7fd27970c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:11:00.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.422+0000 7fd27970c640 1 -- 10.20.193.48:0/2127142762 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd274139850 con 0x7fd274138f20 2026-02-12T18:11:00.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.423+0000 7fd2537fe640 1 -- 10.20.193.48:0/2127142762 <== mon.0 v2:10.20.193.48:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3636 (secure 0 0 0) 0x7fd274139850 con 0x7fd274138f20 2026-02-12T18:11:00.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.423+0000 7fd2537fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T18:11:00.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.423+0000 7fd2537fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:11:00.425 INFO:teuthology.orchestra.run.trial048.stdout:{"election_epoch":54,"quorum":[0,2,3,4,6],"quorum_names":["a","b","g","c","d"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","modified":"2026-02-12T18:05:32.850777Z","created":"2026-02-12T18:05:32.850777Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3300","nonce":0},{"type":"v1","addr":"10.20.193.48:6789","nonce":0}]},"addr":"10.20.193.48:6789/0","public_addr":"10.20.193.48:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850827+0000","crush_location":[]},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3300","nonce":0},{"type":"v1","addr":"10.20.193.111:6789","nonce":0}]},"addr":"10.20.193.111:6789/0","public_addr":"10.20.193.111:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850829+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3301","nonce":0},{"type":"v1","addr":"10.20.193.48:6790","nonce":0}]},"addr":"10.20.193.48:6790/0","public_addr":"10.20.193.48:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850830+0000","crush_location":[]},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3301","nonce":0},{"type":"v1","addr":"10.20.193.111:6790","nonce":0}]},"addr":"10.20.193.111:6790/0","public_addr":"10.20.193.111:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850833+0000","crush_location":[]},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3302","nonce":0},{"type":"v1","addr":"10.20.193.48:6791","nonce":0}]},"addr":"10.20.193.48:6791/0","public_addr":"10.20.193.48:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3302","nonce":0},{"type":"v1","addr":"10.20.193.111:6791","nonce":0}]},"addr":"10.20.193.111:6791/0","public_addr":"10.20.193.111:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850834+0000","crush_location":[]},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3303","nonce":0},{"type":"v1","addr":"10.20.193.48:6792","nonce":0}]},"addr":"10.20.193.48:6792/0","public_addr":"10.20.193.48:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3303","nonce":0},{"type":"v1","addr":"10.20.193.111:6792","nonce":0}]},"addr":"10.20.193.111:6792/0","public_addr":"10.20.193.111:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850835+0000","crush_location":[]},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3304","nonce":0},{"type":"v1","addr":"10.20.193.48:6793","nonce":0}]},"addr":"10.20.193.48:6793/0","public_addr":"10.20.193.48:6793/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850832+0000","crush_location":[]}]}} 2026-02-12T18:11:00.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.424+0000 7fd27970c640 1 -- 10.20.193.48:0/2127142762 >> v2:10.20.193.111:6812/977811348 conn(0x7fd24003f780 msgr2=0x7fd24005fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:00.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.424+0000 7fd27970c640 1 --2- 10.20.193.48:0/2127142762 >> v2:10.20.193.111:6812/977811348 conn(0x7fd24003f780 0x7fd24005fc30 secure :-1 s=READY pgs=311 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd268002670 tx=0x7fd26803b040 comp rx=0 tx=0).stop 2026-02-12T18:11:00.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.424+0000 7fd27970c640 10 monclient: shutdown 2026-02-12T18:11:00.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.424+0000 7fd27970c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:11:00.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.424+0000 7fd27970c640 1 -- 10.20.193.48:0/2127142762 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd274138f20 msgr2=0x7fd274139310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:00.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.424+0000 7fd27970c640 1 --2- 10.20.193.48:0/2127142762 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd274138f20 0x7fd274139310 secure :-1 s=READY pgs=409 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd25c019710 tx=0x7fd25c019be0 comp rx=0 tx=0).stop 2026-02-12T18:11:00.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.424+0000 7fd27970c640 1 -- 10.20.193.48:0/2127142762 shutdown_connections 2026-02-12T18:11:00.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.424+0000 7fd27970c640 1 --2- 10.20.193.48:0/2127142762 >> v2:10.20.193.111:6812/977811348 conn(0x7fd24003f780 0x7fd24005fc30 unknown :-1 s=CLOSED pgs=311 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:00.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.424+0000 7fd27970c640 1 --2- 10.20.193.48:0/2127142762 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd2741545a0 0x7fd274154a10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:00.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.424+0000 7fd27970c640 1 --2- 10.20.193.48:0/2127142762 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd274138f20 0x7fd274139310 unknown :-1 s=CLOSED pgs=409 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:00.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.424+0000 7fd27970c640 1 --2- 10.20.193.48:0/2127142762 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd2580246e0 0x7fd2741389e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:00.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.424+0000 7fd27970c640 1 -- 10.20.193.48:0/2127142762 >> 10.20.193.48:0/2127142762 conn(0x7fd274092150 msgr2=0x7fd2740890f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:11:00.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.424+0000 7fd27970c640 1 -- 10.20.193.48:0/2127142762 shutdown_connections 2026-02-12T18:11:00.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.424+0000 7fd27970c640 1 -- 10.20.193.48:0/2127142762 wait complete. 2026-02-12T18:11:00.434 INFO:tasks.mon_thrash.ceph_manager:quorum is size 5 2026-02-12T18:11:00.434 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon a 2026-02-12T18:11:00.435 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T18:11:00.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.500+0000 7f3b43acc640 10 monclient: get_monmap_and_config 2026-02-12T18:11:00.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.500+0000 7f3b43acc640 10 monclient: build_initial_monmap 2026-02-12T18:11:00.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.500+0000 7f3b43acc640 10 monclient: monmap: 2026-02-12T18:11:00.502 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:11:00.502 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:00.502 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:11:00.501266+0000 2026-02-12T18:11:00.502 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:11:00.501266+0000 2026-02-12T18:11:00.502 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:11:00.502 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:00.502 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:11:00.502 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:11:00.502 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:11:00.502 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:11:00.503 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:11:00.503 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:11:00.503 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:11:00.503 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:11:00.503 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:11:00.503 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:11:00.503 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:11:00.503 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:00.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.500+0000 7f3b43acc640 1 Processor -- start 2026-02-12T18:11:00.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.500+0000 7f3b43acc640 1 -- start start 2026-02-12T18:11:00.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.500+0000 7f3b43acc640 10 monclient: init 2026-02-12T18:11:00.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.500+0000 7f3b43acc640 10 monclient: _reopen_session rank -1 2026-02-12T18:11:00.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.500+0000 7f3b43acc640 10 monclient: _add_conns ranks=[8,6,7,5,4,0,9,3,2,10,1] 2026-02-12T18:11:00.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.500+0000 7f3b43acc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3b3c144280 0x7f3b3c144650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:00.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.500+0000 7f3b43acc640 10 monclient(hunting): picked mon.noname-e con 0x7f3b3c144280 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:11:00.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.500+0000 7f3b43acc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3b3c05e6d0 0x7f3b3c144b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:00.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.500+0000 7f3b43acc640 10 monclient(hunting): picked mon.noname-d con 0x7f3b3c05e6d0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:11:00.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.500+0000 7f3b43acc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f3b3c13db70 0x7f3b3c13df80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:00.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.500+0000 7f3b43acc640 10 monclient(hunting): picked mon.noname-i con 0x7f3b3c13db70 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:11:00.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.500+0000 7f3b43acc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:00.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.500+0000 7f3b43acc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f3b3c05da00 con 0x7f3b3c05e6d0 2026-02-12T18:11:00.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.500+0000 7f3b43acc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:00.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.500+0000 7f3b43acc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f3b3c1450d0 con 0x7f3b3c13db70 2026-02-12T18:11:00.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b43acc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:00.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b43acc640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f3b3c05d720 con 0x7f3b3c144280 2026-02-12T18:11:00.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b43acc640 10 monclient(hunting): _renew_subs 2026-02-12T18:11:00.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b43acc640 10 monclient(hunting): authenticate will time out at 899.227009s 2026-02-12T18:11:00.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b41841640 1 -- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3b3c144280 msgr2=0x7f3b3c144650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.48:3304/0 2026-02-12T18:11:00.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b41841640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3b3c144280 0x7f3b3c144650 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:11:00.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b42042640 1 -- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f3b3c13db70 msgr2=0x7f3b3c13df80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3303/0 2026-02-12T18:11:00.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b41040640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3b3c05e6d0 0x7f3b3c144b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:00.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b42042640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f3b3c13db70 0x7f3b3c13df80 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:11:00.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b41040640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3b3c05e6d0 0x7f3b3c144b90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:56430/0 (socket says 10.20.193.48:56430) 2026-02-12T18:11:00.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b41040640 1 -- 10.20.193.48:0/3457990502 learned_addr learned my addr 10.20.193.48:0/3457990502 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:11:00.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b41040640 10 monclient(hunting): get_auth_request con 0x7f3b3c05e6d0 auth_method 0 2026-02-12T18:11:00.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b41040640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:00.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b41040640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:00.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b41040640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:11:00.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b41040640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:11:00.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b41040640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:11:00.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b41040640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:11:00.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b41040640 10 monclient(hunting): handle_auth_done global_id 5676 payload 274 2026-02-12T18:11:00.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b41040640 1 -- 10.20.193.48:0/3457990502 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3b3c144280 msgr2=0x7f3b3c144650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:11:00.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b41040640 1 --2- 10.20.193.48:0/3457990502 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3b3c144280 0x7f3b3c144650 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:00.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b41040640 1 -- 10.20.193.48:0/3457990502 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f3b3c13db70 msgr2=0x7f3b3c13df80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:11:00.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b41040640 1 --2- 10.20.193.48:0/3457990502 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f3b3c13db70 0x7f3b3c13df80 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:00.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b41040640 10 monclient: _finish_hunting 0 2026-02-12T18:11:00.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b41040640 1 monclient: found mon.noname-d 2026-02-12T18:11:00.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b41040640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:11:00.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b41040640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:11:00.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.501+0000 7f3b41040640 1 -- 10.20.193.48:0/3457990502 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3c04dc20 con 0x7f3b3c05e6d0 2026-02-12T18:11:00.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.503+0000 7f3b41040640 1 -- 10.20.193.48:0/3457990502 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3b3c05e6d0 msgr2=0x7f3b3c144b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:11:00.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.503+0000 7f3b41040640 1 --2- 10.20.193.48:0/3457990502 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3b3c05e6d0 0x7f3b3c144b90 secure :-1 s=READY pgs=231 gs=1 cs=0 l=1 c_cookie=10287481865449027106 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b300098d0 tx=0x7f3b3002ee50 comp rx=0 tx=0).ready entity=mon.6 client_cookie=8ec47a404f5cb622 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:00.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.503+0000 7f3b4083f640 1 -- 10.20.193.48:0/3457990502 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3b3002fbb0 con 0x7f3b3c05e6d0 2026-02-12T18:11:00.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.503+0000 7f3b4083f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:00.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.503+0000 7f3b4083f640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:11:00.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.503+0000 7f3b4083f640 10 monclient: dump: 2026-02-12T18:11:00.518 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:00.518 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:00.518 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:00.518 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:00.518 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:00.518 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:00.518 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:00.518 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:00.519 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:00.519 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:00.519 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:00.519 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:00.519 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:00.519 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:00.519 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:00.519 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:00.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.504+0000 7f3b4083f640 10 monclient: _finish_auth 0 2026-02-12T18:11:00.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.504+0000 7f3b4083f640 10 monclient: _check_auth_tickets 2026-02-12T18:11:00.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.504+0000 7f3b4083f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:11:00.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.504+0000 7f3b4083f640 1 -- 10.20.193.48:0/3457990502 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b3002fd30 con 0x7f3b3c05e6d0 2026-02-12T18:11:00.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.504+0000 7f3b43acc640 5 monclient: authenticate success, global_id 5676 2026-02-12T18:11:00.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.504+0000 7f3b43acc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:11:00.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.504+0000 7f3b4083f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:11:00.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.504+0000 7f3b4083f640 1 -- 10.20.193.48:0/3457990502 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3b3002fea0 con 0x7f3b3c05e6d0 2026-02-12T18:11:00.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.504+0000 7f3b4083f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:00.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.504+0000 7f3b4083f640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:11:00.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.504+0000 7f3b4083f640 10 monclient: dump: 2026-02-12T18:11:00.520 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:00.520 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:00.520 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:00.520 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:00.520 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:00.520 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:00.521 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:00.521 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:00.521 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:00.521 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:00.521 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:00.521 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:00.521 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:00.521 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:00.521 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:00.521 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:00.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.504+0000 7f3b43acc640 10 monclient: get_monmap_and_config success 2026-02-12T18:11:00.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.504+0000 7f3b43acc640 4 set_mon_vals no callback set 2026-02-12T18:11:00.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.504+0000 7f3b43acc640 10 monclient: shutdown 2026-02-12T18:11:00.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.504+0000 7f3b43acc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:11:00.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.504+0000 7f3b43acc640 1 -- 10.20.193.48:0/3457990502 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3b3c05e6d0 msgr2=0x7f3b3c144b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:00.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.504+0000 7f3b43acc640 1 --2- 10.20.193.48:0/3457990502 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3b3c05e6d0 0x7f3b3c144b90 secure :-1 s=READY pgs=231 gs=1 cs=0 l=1 c_cookie=10287481865449027106 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b300098d0 tx=0x7f3b3002ee50 comp rx=0 tx=0).stop 2026-02-12T18:11:00.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.504+0000 7f3b43acc640 1 -- 10.20.193.48:0/3457990502 shutdown_connections 2026-02-12T18:11:00.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.504+0000 7f3b43acc640 1 --2- 10.20.193.48:0/3457990502 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f3b3c13db70 0x7f3b3c13df80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:00.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.504+0000 7f3b43acc640 1 --2- 10.20.193.48:0/3457990502 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3b3c05e6d0 0x7f3b3c144b90 unknown :-1 s=CLOSED pgs=231 gs=1 cs=0 l=1 c_cookie=10287481865449027106 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:00.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.504+0000 7f3b43acc640 1 --2- 10.20.193.48:0/3457990502 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3b3c144280 0x7f3b3c144650 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:00.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.504+0000 7f3b43acc640 1 -- 10.20.193.48:0/3457990502 >> 10.20.193.48:0/3457990502 conn(0x7f3b3c093940 msgr2=0x7f3b3c093d40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:11:00.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.504+0000 7f3b43acc640 1 -- 10.20.193.48:0/3457990502 shutdown_connections 2026-02-12T18:11:00.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.504+0000 7f3b43acc640 1 -- 10.20.193.48:0/3457990502 wait complete. 2026-02-12T18:11:00.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.504+0000 7f3b43acc640 10 monclient: build_initial_monmap 2026-02-12T18:11:00.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.504+0000 7f3b43acc640 10 monclient: monmap: 2026-02-12T18:11:00.523 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:11:00.523 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:11:00.523 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:11:00.523 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:11:00.523 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:11:00.523 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:00.523 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:11:00.523 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:11:00.523 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:11:00.523 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:11:00.523 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:11:00.524 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:11:00.524 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:11:00.524 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:11:00.524 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:11:00.524 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:00.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b43acc640 1 Processor -- start 2026-02-12T18:11:00.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b43acc640 1 -- start start 2026-02-12T18:11:00.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b43acc640 10 monclient: init 2026-02-12T18:11:00.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b43acc640 10 monclient: _reopen_session rank -1 2026-02-12T18:11:00.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b43acc640 10 monclient: _add_conns ranks=[8,5,0,7,3,6,1,2,4] 2026-02-12T18:11:00.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b43acc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3b3c05e6d0 0x7f3b3c141200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:00.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b43acc640 10 monclient(hunting): picked mon.noname-e con 0x7f3b3c05e6d0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:11:00.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b43acc640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f3b3c13db70 0x7f3b3c13cf70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:00.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b43acc640 10 monclient(hunting): picked mon.noname-h con 0x7f3b3c13db70 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:11:00.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b43acc640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3b3c144280 0x7f3b3c13d4b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:00.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b43acc640 10 monclient(hunting): picked mon.noname-a con 0x7f3b3c144280 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:11:00.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b43acc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:00.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b43acc640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3c08d190 con 0x7f3b3c144280 2026-02-12T18:11:00.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b43acc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:00.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b43acc640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f3b3c13d9f0 con 0x7f3b3c13db70 2026-02-12T18:11:00.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b43acc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:00.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b43acc640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f3b3c13e4c0 con 0x7f3b3c05e6d0 2026-02-12T18:11:00.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b43acc640 10 monclient(hunting): _renew_subs 2026-02-12T18:11:00.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b43acc640 10 monclient(hunting): authenticate will time out at 899.231404s 2026-02-12T18:11:00.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b41841640 1 -- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3b3c05e6d0 msgr2=0x7f3b3c141200 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.48:3304/0 2026-02-12T18:11:00.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b41841640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3b3c05e6d0 0x7f3b3c141200 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:11:00.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b41040640 1 -- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f3b3c13db70 msgr2=0x7f3b3c13cf70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:11:00.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b41040640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f3b3c13db70 0x7f3b3c13cf70 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:11:00.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b42042640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3b3c144280 0x7f3b3c13d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:00.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b42042640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3b3c144280 0x7f3b3c13d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:51982/0 (socket says 10.20.193.48:51982) 2026-02-12T18:11:00.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b42042640 1 -- 10.20.193.48:0/690178779 learned_addr learned my addr 10.20.193.48:0/690178779 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:11:00.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b42042640 10 monclient(hunting): get_auth_request con 0x7f3b3c144280 auth_method 0 2026-02-12T18:11:00.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b42042640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:00.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b42042640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:00.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b42042640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:11:00.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b42042640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:11:00.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b42042640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:11:00.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b42042640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:11:00.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b42042640 10 monclient(hunting): handle_auth_done global_id 6057 payload 824 2026-02-12T18:11:00.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b42042640 1 -- 10.20.193.48:0/690178779 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3b3c05e6d0 msgr2=0x7f3b3c141200 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:11:00.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b42042640 1 --2- 10.20.193.48:0/690178779 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3b3c05e6d0 0x7f3b3c141200 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:00.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b42042640 1 -- 10.20.193.48:0/690178779 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f3b3c13db70 msgr2=0x7f3b3c13cf70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:11:00.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b42042640 1 --2- 10.20.193.48:0/690178779 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f3b3c13db70 0x7f3b3c13cf70 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:00.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b42042640 10 monclient: _finish_hunting 0 2026-02-12T18:11:00.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b42042640 1 monclient: found mon.noname-a 2026-02-12T18:11:00.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b42042640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:11:00.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b42042640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:11:00.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.505+0000 7f3b42042640 1 -- 10.20.193.48:0/690178779 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b300094f0 con 0x7f3b3c144280 2026-02-12T18:11:00.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b42042640 1 -- 10.20.193.48:0/690178779 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3b3c144280 msgr2=0x7f3b3c13d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:11:00.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b42042640 1 --2- 10.20.193.48:0/690178779 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3b3c144280 0x7f3b3c13d4b0 secure :-1 s=READY pgs=410 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b3800c550 tx=0x7f3b3800ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:00.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b2a7fc640 1 -- 10.20.193.48:0/690178779 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3b38007610 con 0x7f3b3c144280 2026-02-12T18:11:00.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:00.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b2a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:11:00.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b2a7fc640 10 monclient: dump: 2026-02-12T18:11:00.528 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:00.528 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:00.528 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:00.528 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:00.528 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:00.528 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:00.529 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:00.529 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:00.529 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:00.529 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:00.529 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:00.529 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:00.529 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:00.529 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:00.529 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:00.529 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:00.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b2a7fc640 10 monclient: _finish_auth 0 2026-02-12T18:11:00.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b2a7fc640 10 monclient: _check_auth_tickets 2026-02-12T18:11:00.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b2a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:11:00.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b2a7fc640 1 -- 10.20.193.48:0/690178779 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b38007770 con 0x7f3b3c144280 2026-02-12T18:11:00.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b43acc640 5 monclient: authenticate success, global_id 6057 2026-02-12T18:11:00.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b43acc640 10 monclient: _renew_subs 2026-02-12T18:11:00.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b43acc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:11:00.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b43acc640 1 -- 10.20.193.48:0/690178779 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b3c13e810 con 0x7f3b3c144280 2026-02-12T18:11:00.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b2a7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:11:00.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b2a7fc640 1 -- 10.20.193.48:0/690178779 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3b380078e0 con 0x7f3b3c144280 2026-02-12T18:11:00.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:00.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b2bfff640 4 set_mon_vals no callback set 2026-02-12T18:11:00.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b2a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:11:00.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b2a7fc640 10 monclient: dump: 2026-02-12T18:11:00.530 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:00.530 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:00.531 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:00.531 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:00.531 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:00.531 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:00.531 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:00.531 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:00.531 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:00.531 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:00.531 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:00.531 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:00.531 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:00.531 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:00.531 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:00.532 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:00.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b43acc640 10 monclient: _renew_subs 2026-02-12T18:11:00.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b43acc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:11:00.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b43acc640 1 -- 10.20.193.48:0/690178779 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b3c08c230 con 0x7f3b3c144280 2026-02-12T18:11:00.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b43acc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:11:00.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b43acc640 1 --2- 10.20.193.48:0/690178779 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3b3c129ac0 0x7f3b3c12cb60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:00.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b43acc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:00.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b43acc640 1 -- 10.20.193.48:0/690178779 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3c0912b0 con 0x7f3b3c129ac0 2026-02-12T18:11:00.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b41841640 1 --2- 10.20.193.48:0/690178779 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3b3c129ac0 0x7f3b3c12cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:00.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b41841640 10 monclient: get_auth_request con 0x7f3b3c129ac0 auth_method 0 2026-02-12T18:11:00.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b41841640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:00.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b41841640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:00.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.508+0000 7f3b41841640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:11:00.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.509+0000 7f3b41841640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:11:00.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.509+0000 7f3b41841640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:11:00.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.509+0000 7f3b41841640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:11:00.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.509+0000 7f3b2a7fc640 1 -- 10.20.193.48:0/690178779 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f3b38007150 con 0x7f3b3c144280 2026-02-12T18:11:00.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.509+0000 7f3b41841640 10 monclient(hunting): handle_auth_done global_id 6066 payload 824 2026-02-12T18:11:00.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.509+0000 7f3b41841640 1 -- 10.20.193.48:0/690178779 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b3c05d440 con 0x7f3b3c129ac0 2026-02-12T18:11:00.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.509+0000 7f3b2a7fc640 1 --2- 10.20.193.48:0/690178779 >> v2:10.20.193.111:6812/977811348 conn(0x7f3b0c03f780 0x7f3b0c05fc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:00.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.509+0000 7f3b2a7fc640 1 -- 10.20.193.48:0/690178779 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(215..215 src has 190..215) ==== 3503+0+0 (secure 0 0 0) 0x7f3b38052e10 con 0x7f3b3c144280 2026-02-12T18:11:00.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.509+0000 7f3b41040640 1 --2- 10.20.193.48:0/690178779 >> v2:10.20.193.111:6812/977811348 conn(0x7f3b0c03f780 0x7f3b0c05fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:00.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.509+0000 7f3b41040640 10 monclient: get_auth_request con 0x7f3b0c03f780 auth_method 0 2026-02-12T18:11:00.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.511+0000 7f3b41841640 1 -- 10.20.193.48:0/690178779 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3b3c129ac0 msgr2=0x7f3b3c12cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:11:00.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.511+0000 7f3b41841640 1 --2- 10.20.193.48:0/690178779 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3b3c129ac0 0x7f3b3c12cb60 secure :-1 s=READY pgs=411 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b2c00b450 tx=0x7f3b2c00b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:00.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.511+0000 7f3b2a7fc640 1 -- 10.20.193.48:0/690178779 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3b2c005070 con 0x7f3b3c129ac0 2026-02-12T18:11:00.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.511+0000 7f3b2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:00.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.511+0000 7f3b2a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:11:00.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.511+0000 7f3b2a7fc640 10 monclient: dump: 2026-02-12T18:11:00.534 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:00.534 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:00.534 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:00.534 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:00.534 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:00.534 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:00.535 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:00.535 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:00.535 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:00.535 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:00.535 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:00.535 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:00.535 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:00.535 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:00.535 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:00.535 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:00.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.511+0000 7f3b2a7fc640 1 -- 10.20.193.48:0/690178779 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f3b2c005b00 con 0x7f3b3c129ac0 2026-02-12T18:11:00.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.511+0000 7f3b2a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:11:00.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.511+0000 7f3b2a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:11:00.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.511+0000 7f3b2a7fc640 1 -- 10.20.193.48:0/690178779 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3b3c129ac0 msgr2=0x7f3b3c12cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:00.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.511+0000 7f3b2a7fc640 1 --2- 10.20.193.48:0/690178779 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3b3c129ac0 0x7f3b3c12cb60 secure :-1 s=READY pgs=411 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b2c00b450 tx=0x7f3b2c00b920 comp rx=0 tx=0).stop 2026-02-12T18:11:00.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.511+0000 7f3b2a7fc640 1 -- 10.20.193.48:0/690178779 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3b3c129ac0 msgr2=0x7f3b3c12cb60 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:11:00.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.511+0000 7f3b2a7fc640 1 --2- 10.20.193.48:0/690178779 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3b3c129ac0 0x7f3b3c12cb60 secure :-1 s=CLOSED pgs=411 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b2c00b450 tx=0x7f3b2c00b920 comp rx=0 tx=0).stop 2026-02-12T18:11:00.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.513+0000 7f3b41040640 1 --2- 10.20.193.48:0/690178779 >> v2:10.20.193.111:6812/977811348 conn(0x7f3b0c03f780 0x7f3b0c05fc30 secure :-1 s=READY pgs=312 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b300023d0 tx=0x7f3b30033000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:00.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.515+0000 7f3b43acc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:11:00.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.515+0000 7f3b43acc640 1 --2- 10.20.193.48:0/690178779 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3b3c12d0a0 0x7f3b3c12d4a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:00.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.515+0000 7f3b43acc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:00.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.515+0000 7f3b43acc640 1 -- 10.20.193.48:0/690178779 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f3b3c050410 con 0x7f3b3c12d0a0 2026-02-12T18:11:00.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.515+0000 7f3b41841640 1 --2- 10.20.193.48:0/690178779 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3b3c12d0a0 0x7f3b3c12d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:00.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.515+0000 7f3b41841640 10 monclient: get_auth_request con 0x7f3b3c12d0a0 auth_method 0 2026-02-12T18:11:00.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.515+0000 7f3b41841640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:00.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.515+0000 7f3b41841640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:00.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.515+0000 7f3b41841640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:11:00.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.515+0000 7f3b41841640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:11:00.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.515+0000 7f3b41841640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:11:00.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.515+0000 7f3b41841640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:11:00.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.515+0000 7f3b41841640 10 monclient(hunting): handle_auth_done global_id 6075 payload 824 2026-02-12T18:11:00.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.515+0000 7f3b41841640 1 -- 10.20.193.48:0/690178779 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3b3c05eb70 con 0x7f3b3c12d0a0 2026-02-12T18:11:00.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.517+0000 7f3b41841640 1 -- 10.20.193.48:0/690178779 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3b3c12d0a0 msgr2=0x7f3b3c12d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:11:00.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.517+0000 7f3b41841640 1 --2- 10.20.193.48:0/690178779 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3b3c12d0a0 0x7f3b3c12d4a0 secure :-1 s=READY pgs=412 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b2c00b960 tx=0x7f3b2c003870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:00.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.517+0000 7f3b2a7fc640 1 -- 10.20.193.48:0/690178779 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3b2c01e070 con 0x7f3b3c12d0a0 2026-02-12T18:11:00.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.517+0000 7f3b2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:00.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.517+0000 7f3b2a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:11:00.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.517+0000 7f3b2a7fc640 10 monclient: dump: 2026-02-12T18:11:00.540 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:00.540 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:00.540 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:00.540 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:00.540 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:00.540 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:00.540 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:00.540 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:00.540 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:00.540 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:00.540 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:00.540 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:00.540 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:00.540 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:00.541 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:00.541 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:00.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.518+0000 7f3b2a7fc640 1 -- 10.20.193.48:0/690178779 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10140 (secure 0 0 0) 0x7f3b2c0055f0 con 0x7f3b3c12d0a0 2026-02-12T18:11:00.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.518+0000 7f3b2a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:11:00.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.518+0000 7f3b2a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:11:00.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.518+0000 7f3b2a7fc640 1 -- 10.20.193.48:0/690178779 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3b3c12d0a0 msgr2=0x7f3b3c12d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:00.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.518+0000 7f3b2a7fc640 1 --2- 10.20.193.48:0/690178779 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3b3c12d0a0 0x7f3b3c12d4a0 secure :-1 s=READY pgs=412 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b2c00b960 tx=0x7f3b2c003870 comp rx=0 tx=0).stop 2026-02-12T18:11:00.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.518+0000 7f3b2a7fc640 1 -- 10.20.193.48:0/690178779 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3b3c12d0a0 msgr2=0x7f3b3c12d4a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:11:00.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.518+0000 7f3b2a7fc640 1 --2- 10.20.193.48:0/690178779 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3b3c12d0a0 0x7f3b3c12d4a0 secure :-1 s=CLOSED pgs=412 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b2c00b960 tx=0x7f3b2c003870 comp rx=0 tx=0).stop 2026-02-12T18:11:00.541 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:11:00.542 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:11:00.542 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:11:00.542 INFO:teuthology.orchestra.run.trial048.stdout: "state": "leader", 2026-02-12T18:11:00.542 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 54, 2026-02-12T18:11:00.542 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 315351, 2026-02-12T18:11:00.542 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:11:00.542 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:11:00.542 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:11:00.542 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:11:00.542 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:11:00.542 INFO:teuthology.orchestra.run.trial048.stdout: 6 2026-02-12T18:11:00.542 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:11:00.542 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:11:00.542 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:11:00.543 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:11:00.543 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:11:00.543 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:11:00.543 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:11:00.543 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:11:00.543 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:11:00.543 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:11:00.543 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:11:00.543 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:11:00.543 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:11:00.543 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:11:00.543 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:11:00.543 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:11:00.543 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:11:00.543 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:11:00.544 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:11:00.544 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:11:00.544 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:11:00.544 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:11:00.544 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:11:00.544 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:11:00.544 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:11:00.544 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:11:00.544 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:11:00.544 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:11:00.544 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:11:00.544 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:11:00.544 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:11:00.544 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:11:00.544 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:11:00.544 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:11:00.544 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:00.545 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.545 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:11:00.545 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:11:00.545 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:11:00.545 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:11:00.545 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:11:00.545 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:11:00.545 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:11:00.545 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:11:00.545 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:11:00.545 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:11:00.545 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:11:00.545 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:11:00.545 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:11:00.545 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:11:00.545 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:11:00.546 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:11:00.546 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:11:00.546 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:11:00.546 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:11:00.546 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:11:00.546 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:11:00.546 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:11:00.546 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:11:00.546 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:11:00.546 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:11:00.546 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:11:00.546 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:11:00.546 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:11:00.546 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:11:00.546 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:11:00.546 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:11:00.546 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:11:00.547 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.547 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:11:00.547 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.547 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:11:00.547 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:11:00.547 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:00.547 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:00.547 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.547 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:00.547 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:11:00.547 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:00.547 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.547 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.547 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:00.547 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:11:00.547 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:00.547 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:00.547 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:00.548 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.548 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:11:00.548 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:11:00.548 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:00.548 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:00.548 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:11:00.548 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:00.548 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.548 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.548 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:11:00.548 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:11:00.548 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:00.548 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:00.548 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.548 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:00.548 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:11:00.548 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:00.548 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.549 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.549 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:00.549 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:11:00.549 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:00.549 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:00.549 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:00.549 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.549 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:11:00.549 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:11:00.549 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:00.549 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:00.549 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:11:00.549 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:00.549 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.549 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.549 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:11:00.549 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:11:00.549 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:00.549 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:00.550 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.550 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:00.550 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:11:00.550 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:00.550 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.550 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.550 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:00.550 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:11:00.550 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:00.550 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:00.550 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:00.550 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.550 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:11:00.550 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:11:00.550 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:00.550 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:00.550 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:11:00.550 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:00.550 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.550 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.551 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:11:00.551 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:11:00.551 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:00.551 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:00.551 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.551 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:00.551 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:11:00.551 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:00.551 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.551 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.551 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:00.551 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:11:00.551 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:00.551 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:00.551 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:00.551 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.551 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:11:00.551 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:11:00.551 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:00.551 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:00.552 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:11:00.552 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:00.552 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.552 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.552 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:11:00.552 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:11:00.552 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:00.552 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:00.552 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.552 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:00.552 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:11:00.552 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:00.552 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.552 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.552 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:00.552 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:11:00.552 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:00.552 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:00.552 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:00.552 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.552 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:11:00.553 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:11:00.553 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:00.553 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:00.553 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:11:00.553 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:00.553 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.553 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.553 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:11:00.553 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:11:00.553 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:00.553 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:00.553 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.553 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:00.553 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:11:00.553 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:00.553 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.553 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.553 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:00.553 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:11:00.553 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:00.553 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:00.554 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:00.554 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.554 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:11:00.554 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:11:00.554 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:00.554 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:00.554 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:11:00.554 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:00.554 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.554 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.554 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:11:00.554 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:11:00.554 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:00.554 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:00.554 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.554 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:00.554 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:11:00.554 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:00.554 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.554 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.555 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:00.555 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:11:00.555 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:00.555 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:00.555 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:00.555 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.555 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:11:00.555 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:11:00.555 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:00.555 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:00.555 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:11:00.555 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:00.555 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.555 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.555 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:11:00.555 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:11:00.555 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:00.555 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:00.555 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.555 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:00.555 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:11:00.555 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:00.556 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.556 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.556 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:00.556 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:11:00.556 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:00.556 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:00.556 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:00.556 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.556 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:11:00.556 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:11:00.556 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:00.556 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:00.556 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:11:00.556 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:00.556 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.556 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.556 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:11:00.556 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:11:00.556 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:00.556 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:00.556 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.557 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:00.557 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:11:00.557 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:00.557 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.557 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.557 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:00.557 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:11:00.557 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:00.557 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:00.557 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:00.557 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.557 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:11:00.557 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:11:00.557 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:00.557 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:00.557 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:11:00.557 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:00.557 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:00.557 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:00.557 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.557 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:11:00.557 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:11:00.557 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.557 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:11:00.558 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:11:00.558 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:11:00.558 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:00.558 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:11:00.558 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:11:00.558 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.558 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:11:00.558 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:11:00.558 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:11:00.558 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:00.558 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:11:00.558 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:11:00.558 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:00.558 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:11:00.558 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:11:00.558 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:11:00.558 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:00.558 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:00.558 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:00.558 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:11:00.558 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:11:00.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.518+0000 7f3b43acc640 1 -- 10.20.193.48:0/690178779 >> v2:10.20.193.111:6812/977811348 conn(0x7f3b0c03f780 msgr2=0x7f3b0c05fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:00.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.518+0000 7f3b43acc640 1 --2- 10.20.193.48:0/690178779 >> v2:10.20.193.111:6812/977811348 conn(0x7f3b0c03f780 0x7f3b0c05fc30 secure :-1 s=READY pgs=312 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b300023d0 tx=0x7f3b30033000 comp rx=0 tx=0).stop 2026-02-12T18:11:00.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.518+0000 7f3b43acc640 10 monclient: shutdown 2026-02-12T18:11:00.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.518+0000 7f3b43acc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:11:00.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.518+0000 7f3b43acc640 1 -- 10.20.193.48:0/690178779 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3b3c144280 msgr2=0x7f3b3c13d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:00.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.518+0000 7f3b42042640 1 -- 10.20.193.48:0/690178779 reap_dead start 2026-02-12T18:11:00.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.518+0000 7f3b43acc640 1 --2- 10.20.193.48:0/690178779 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3b3c144280 0x7f3b3c13d4b0 secure :-1 s=READY pgs=410 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3b3800c550 tx=0x7f3b3800ca20 comp rx=0 tx=0).stop 2026-02-12T18:11:00.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.518+0000 7f3b43acc640 1 -- 10.20.193.48:0/690178779 shutdown_connections 2026-02-12T18:11:00.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.518+0000 7f3b43acc640 1 --2- 10.20.193.48:0/690178779 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f3b3c144280 0x7f3b3c13d4b0 unknown :-1 s=CLOSED pgs=410 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:00.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.518+0000 7f3b43acc640 1 -- 10.20.193.48:0/690178779 >> 10.20.193.48:0/690178779 conn(0x7f3b3c093940 msgr2=0x7f3b3c122180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:11:00.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.518+0000 7f3b43acc640 1 -- 10.20.193.48:0/690178779 shutdown_connections 2026-02-12T18:11:00.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.518+0000 7f3b43acc640 1 -- 10.20.193.48:0/690178779 wait complete. 2026-02-12T18:11:00.560 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2026-02-12T18:11:00.560 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon b 2026-02-12T18:11:00.560 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T18:11:00.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.624+0000 7f1907c5b640 10 monclient: get_monmap_and_config 2026-02-12T18:11:00.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.624+0000 7f1907c5b640 10 monclient: build_initial_monmap 2026-02-12T18:11:00.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.625+0000 7f1907c5b640 10 monclient: monmap: 2026-02-12T18:11:00.626 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:11:00.626 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:00.626 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:11:00.626056+0000 2026-02-12T18:11:00.626 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:11:00.626056+0000 2026-02-12T18:11:00.626 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:11:00.626 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:00.626 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:11:00.626 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:11:00.626 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:11:00.626 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:11:00.626 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:11:00.627 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:11:00.627 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:11:00.627 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:11:00.627 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:11:00.627 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:11:00.627 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:11:00.627 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:00.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.625+0000 7f1907c5b640 1 Processor -- start 2026-02-12T18:11:00.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.625+0000 7f1907c5b640 1 -- start start 2026-02-12T18:11:00.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.625+0000 7f1907c5b640 10 monclient: init 2026-02-12T18:11:00.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.625+0000 7f1907c5b640 10 monclient: _reopen_session rank -1 2026-02-12T18:11:00.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.625+0000 7f1907c5b640 10 monclient: _add_conns ranks=[10,0,8,1,3,9,5,6,4,7,2] 2026-02-12T18:11:00.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.625+0000 7f1907c5b640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f19000914d0 0x7f190005c950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:00.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.625+0000 7f1907c5b640 10 monclient(hunting): picked mon.noname-f con 0x7f19000914d0 addr v2:10.20.193.111:3300/0 2026-02-12T18:11:00.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.625+0000 7f1907c5b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f190008e210 addr v1:10.20.193.48:6789/0 2026-02-12T18:11:00.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.625+0000 7f1907c5b640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f190005e4b0 0x7f19001a5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:00.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.625+0000 7f1907c5b640 10 monclient(hunting): picked mon.noname-e con 0x7f190005e4b0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:11:00.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.625+0000 7f1907c5b640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f190004dc20 con 0x7f190008e210 2026-02-12T18:11:00.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.625+0000 7f1907c5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:00.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.625+0000 7f1907c5b640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f1900093d70 con 0x7f19000914d0 2026-02-12T18:11:00.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.625+0000 7f1907c5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:00.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.625+0000 7f1907c5b640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f1900092f90 con 0x7f190005e4b0 2026-02-12T18:11:00.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.625+0000 7f1907c5b640 10 monclient(hunting): _renew_subs 2026-02-12T18:11:00.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.625+0000 7f1907c5b640 10 monclient(hunting): authenticate will time out at 899.351814s 2026-02-12T18:11:00.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.625+0000 7f19061d1640 1 -- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f190005e4b0 msgr2=0x7f19001a5c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.48:3304/0 2026-02-12T18:11:00.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.625+0000 7f19061d1640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f190005e4b0 0x7f19001a5c20 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:11:00.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.625+0000 7f19059d0640 1 -- >> v2:10.20.193.111:3300/0 conn(0x7f19000914d0 msgr2=0x7f190005c950 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3300/0 2026-02-12T18:11:00.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.625+0000 7f19059d0640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f19000914d0 0x7f190005c950 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:11:00.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.625+0000 7f19051cf640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f190008e210 0x7f190005ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:47594/0 (socket says 10.20.193.48:47594) 2026-02-12T18:11:00.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.625+0000 7f19051cf640 1 -- 10.20.193.48:0/1519620446 learned_addr learned my addr 10.20.193.48:0/1519620446 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:11:00.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19051cf640 1 -- 10.20.193.48:0/1519620446 >> v1:10.20.193.48:6789/0 conn(0x7f190008e210 legacy=0x7f190005ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:11:00.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 1 -- 10.20.193.48:0/1519620446 <== mon.0 v1:10.20.193.48:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 609816334 0 0) 0x7f190004dc20 con 0x7f190008e210 2026-02-12T18:11:00.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 10 monclient(hunting): _negotiate 2026-02-12T18:11:00.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:00.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:11:00.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 10 monclient(hunting): my global_id is 6084 2026-02-12T18:11:00.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 1 -- 10.20.193.48:0/1519620446 --> v1:10.20.193.48:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18e80035e0 con 0x7f190008e210 2026-02-12T18:11:00.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 1 -- 10.20.193.48:0/1519620446 <== mon.0 v1:10.20.193.48:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1158886517 0 0) 0x7f18e80035e0 con 0x7f190008e210 2026-02-12T18:11:00.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 1 -- 10.20.193.48:0/1519620446 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f190005e4b0 msgr2=0x7f19001a5c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:11:00.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f190005e4b0 0x7f19001a5c20 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:00.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 1 -- 10.20.193.48:0/1519620446 >> v2:10.20.193.111:3300/0 conn(0x7f19000914d0 msgr2=0x7f190005c950 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:11:00.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 1 --2- 10.20.193.48:0/1519620446 >> v2:10.20.193.111:3300/0 conn(0x7f19000914d0 0x7f190005c950 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:00.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 10 monclient: _finish_hunting 0 2026-02-12T18:11:00.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 1 monclient: found mon.noname-a-legacy 2026-02-12T18:11:00.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:11:00.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.48:6789/0 2026-02-12T18:11:00.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 1 -- 10.20.193.48:0/1519620446 --> v1:10.20.193.48:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19000918a0 con 0x7f190008e210 2026-02-12T18:11:00.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 10 monclient: _finish_auth 0 2026-02-12T18:11:00.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 10 monclient: _check_auth_tickets 2026-02-12T18:11:00.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:11:00.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 1 -- 10.20.193.48:0/1519620446 <== mon.0 v1:10.20.193.48:6789/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (unknown 3750814960 0 0) 0x7f18f4003460 con 0x7f190008e210 2026-02-12T18:11:00.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:00.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-12T18:11:00.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 10 monclient: dump: 2026-02-12T18:11:00.633 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:00.633 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:00.633 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:00.633 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:00.633 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:00.634 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:00.634 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:00.634 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:00.634 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:00.634 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:00.634 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:00.634 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:00.634 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:00.634 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:00.634 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:00.634 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:00.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] but i'm connected to v1:10.20.193.48:6789/0, reconnecting 2026-02-12T18:11:00.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 10 monclient: _reopen_session rank -1 2026-02-12T18:11:00.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 1 -- 10.20.193.48:0/1519620446 >> v1:10.20.193.48:6789/0 conn(0x7f190008e210 legacy=0x7f190005ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:00.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 10 monclient: _add_conns ranks=[5,7,1,6,0,4,8,3,2] 2026-02-12T18:11:00.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f18e8004280 0x7f18e8004850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:00.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 10 monclient(hunting): picked mon.h con 0x7f18e8004280 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:11:00.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f18e8004f90 0x7f18e8045a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:00.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 10 monclient(hunting): picked mon.i con 0x7f18e8004f90 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:11:00.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f18e8045f40 0x7f18e8066320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:00.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 10 monclient(hunting): picked mon.f con 0x7f18e8045f40 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:11:00.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:00.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 1 -- 10.20.193.48:0/1519620446 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1900093d70 con 0x7f18e8045f40 2026-02-12T18:11:00.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:00.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 1 -- 10.20.193.48:0/1519620446 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f1900092f90 con 0x7f18e8004280 2026-02-12T18:11:00.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:00.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 1 -- 10.20.193.48:0/1519620446 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f18e8066b70 con 0x7f18e8004f90 2026-02-12T18:11:00.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 10 monclient(hunting): _renew_subs 2026-02-12T18:11:00.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19049ce640 10 monclient(hunting): _finish_auth 0 2026-02-12T18:11:00.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19059d0640 1 -- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f18e8004280 msgr2=0x7f18e8004850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:11:00.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19059d0640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f18e8004280 0x7f18e8004850 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:11:00.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19051cf640 1 -- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f18e8004f90 msgr2=0x7f18e8045a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3303/0 2026-02-12T18:11:00.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19061d1640 1 -- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f18e8045f40 msgr2=0x7f18e8066320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3300/0 2026-02-12T18:11:00.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19051cf640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f18e8004f90 0x7f18e8045a00 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:11:00.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.628+0000 7f19061d1640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f18e8045f40 0x7f18e8066320 unknown :-1 s=START_CONNECT pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:11:00.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.830+0000 7f19059d0640 1 -- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f18e8004280 msgr2=0x7f18e8004850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:11:00.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.830+0000 7f19061d1640 1 -- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f18e8045f40 msgr2=0x7f18e8066320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3300/0 2026-02-12T18:11:00.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.831+0000 7f19059d0640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f18e8004280 0x7f18e8004850 unknown :-1 s=START_CONNECT pgs=0 gs=7 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:11:00.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.831+0000 7f19051cf640 1 -- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f18e8004f90 msgr2=0x7f18e8045a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3303/0 2026-02-12T18:11:00.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.831+0000 7f19061d1640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f18e8045f40 0x7f18e8066320 unknown :-1 s=START_CONNECT pgs=0 gs=8 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:11:00.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:00.831+0000 7f19051cf640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f18e8004f90 0x7f18e8045a00 unknown :-1 s=START_CONNECT pgs=0 gs=9 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:11:01.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:01.232+0000 7f19061d1640 1 -- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f18e8045f40 msgr2=0x7f18e8066320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3300/0 2026-02-12T18:11:01.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:01.232+0000 7f19061d1640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f18e8045f40 0x7f18e8066320 unknown :-1 s=START_CONNECT pgs=0 gs=10 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:11:01.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:01.232+0000 7f19059d0640 1 -- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f18e8004280 msgr2=0x7f18e8004850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:11:01.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:01.232+0000 7f19051cf640 1 -- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f18e8004f90 msgr2=0x7f18e8045a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3303/0 2026-02-12T18:11:01.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:01.232+0000 7f19059d0640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f18e8004280 0x7f18e8004850 unknown :-1 s=START_CONNECT pgs=0 gs=11 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:11:01.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:01.232+0000 7f19051cf640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f18e8004f90 0x7f18e8045a00 unknown :-1 s=START_CONNECT pgs=0 gs=12 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:11:02.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:02.033+0000 7f19061d1640 1 -- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f18e8045f40 msgr2=0x7f18e8066320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3300/0 2026-02-12T18:11:02.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:02.033+0000 7f19061d1640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f18e8045f40 0x7f18e8066320 unknown :-1 s=START_CONNECT pgs=0 gs=13 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:11:02.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:02.033+0000 7f19059d0640 1 -- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f18e8004280 msgr2=0x7f18e8004850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:11:02.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:02.033+0000 7f19051cf640 1 -- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f18e8004f90 msgr2=0x7f18e8045a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3303/0 2026-02-12T18:11:02.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:02.033+0000 7f19059d0640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f18e8004280 0x7f18e8004850 unknown :-1 s=START_CONNECT pgs=0 gs=14 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:11:02.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:02.033+0000 7f19051cf640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f18e8004f90 0x7f18e8045a00 unknown :-1 s=START_CONNECT pgs=0 gs=15 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:11:03.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.625+0000 7f18ef7fe640 10 monclient(hunting): tick 2026-02-12T18:11:03.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.625+0000 7f18ef7fe640 10 monclient(hunting): _check_auth_tickets 2026-02-12T18:11:03.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.625+0000 7f18ef7fe640 1 monclient(hunting): continuing hunt 2026-02-12T18:11:03.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.625+0000 7f18ef7fe640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T18:11:03.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.625+0000 7f18ef7fe640 1 -- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f18e8004f90 msgr2=0x7f18e8045a00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:11:03.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.625+0000 7f18ef7fe640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f18e8004f90 0x7f18e8045a00 unknown :-1 s=START_CONNECT pgs=0 gs=15 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:03.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.625+0000 7f18ef7fe640 1 -- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f18e8004280 msgr2=0x7f18e8004850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:11:03.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.625+0000 7f18ef7fe640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f18e8004280 0x7f18e8004850 unknown :-1 s=START_CONNECT pgs=0 gs=14 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:03.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.625+0000 7f18ef7fe640 1 -- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f18e8045f40 msgr2=0x7f18e8066320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:11:03.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.625+0000 7f18ef7fe640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f18e8045f40 0x7f18e8066320 unknown :-1 s=START_CONNECT pgs=0 gs=13 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:03.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.625+0000 7f19061d1640 1 -- 10.20.193.48:0/1519620446 reap_dead start 2026-02-12T18:11:03.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.625+0000 7f19061d1640 1 -- 10.20.193.48:0/1519620446 reap_dead start 2026-02-12T18:11:03.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.625+0000 7f18ef7fe640 10 monclient: _add_conns ranks=[2,6,0,8,4,3] 2026-02-12T18:11:03.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.625+0000 7f18ef7fe640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f18e4003820 0x7f18e4023c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:03.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.625+0000 7f18ef7fe640 10 monclient(hunting): picked mon.b con 0x7f18e4003820 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:11:03.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.625+0000 7f18ef7fe640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f18e4024280 0x7f18e4044700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:03.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.625+0000 7f18ef7fe640 10 monclient(hunting): picked mon.d con 0x7f18e4024280 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:11:03.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.625+0000 7f18ef7fe640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f18e4044dc0 0x7f18e4065270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:03.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.625+0000 7f18ef7fe640 10 monclient(hunting): picked mon.a con 0x7f18e4044dc0 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:11:03.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.625+0000 7f18ef7fe640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:03.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.625+0000 7f18ef7fe640 1 -- 10.20.193.48:0/1519620446 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f1900093d70 con 0x7f18e4044dc0 2026-02-12T18:11:03.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.625+0000 7f18ef7fe640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:03.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.625+0000 7f18ef7fe640 1 -- 10.20.193.48:0/1519620446 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f1900092f90 con 0x7f18e4003820 2026-02-12T18:11:03.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.625+0000 7f18ef7fe640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:03.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.625+0000 7f18ef7fe640 1 -- 10.20.193.48:0/1519620446 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f18e8066b70 con 0x7f18e4024280 2026-02-12T18:11:03.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.625+0000 7f18ef7fe640 10 monclient(hunting): _renew_subs 2026-02-12T18:11:03.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19059d0640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f18e4003820 0x7f18e4023c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=16 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:03.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19061d1640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f18e4044dc0 0x7f18e4065270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=18 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:03.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19051cf640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f18e4024280 0x7f18e4044700 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=17 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:03.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19059d0640 10 monclient(hunting): get_auth_request con 0x7f18e4003820 auth_method 0 2026-02-12T18:11:03.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19059d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:03.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19059d0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:03.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19059d0640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:11:03.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19061d1640 10 monclient(hunting): get_auth_request con 0x7f18e4044dc0 auth_method 0 2026-02-12T18:11:03.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19061d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:03.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19061d1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:03.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19061d1640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:11:03.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19051cf640 10 monclient(hunting): get_auth_request con 0x7f18e4024280 auth_method 0 2026-02-12T18:11:03.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19051cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:03.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19051cf640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:03.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19051cf640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:11:03.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19061d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:11:03.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19061d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:11:03.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19061d1640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:11:03.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19051cf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:11:03.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19051cf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:11:03.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19051cf640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:11:03.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19059d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:11:03.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19059d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:11:03.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19059d0640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:11:03.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19061d1640 10 monclient(hunting): handle_auth_done global_id 6084 payload 293 2026-02-12T18:11:03.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19061d1640 1 -- 10.20.193.48:0/1519620446 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f18e4024280 msgr2=0x7f18e4044700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:11:03.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19061d1640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f18e4024280 0x7f18e4044700 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=17 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:03.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19061d1640 1 -- 10.20.193.48:0/1519620446 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f18e4003820 msgr2=0x7f18e4023c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:11:03.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19061d1640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f18e4003820 0x7f18e4023c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=16 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:03.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19061d1640 10 monclient: _finish_hunting 0 2026-02-12T18:11:03.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19061d1640 1 monclient: found mon.a 2026-02-12T18:11:03.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19061d1640 20 monclient: _un_backoff reopen_interval_multipler now 1.5 2026-02-12T18:11:03.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19061d1640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:11:03.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19061d1640 1 -- 10.20.193.48:0/1519620446 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=2+}) -- 0x7f18e80035e0 con 0x7f18e4044dc0 2026-02-12T18:11:03.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19061d1640 10 monclient: _finish_auth 0 2026-02-12T18:11:03.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19061d1640 10 monclient: _check_auth_tickets 2026-02-12T18:11:03.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19061d1640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:11:03.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f1907c5b640 5 monclient: authenticate success, global_id 6084 2026-02-12T18:11:03.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f19051cf640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f18e4024280 0x7f18e4044700 unknown :-1 s=CLOSED pgs=0 gs=17 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:11:03.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.626+0000 7f1907c5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:11:03.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.629+0000 7f19061d1640 1 -- 10.20.193.48:0/1519620446 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f18e4044dc0 msgr2=0x7f18e4065270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:11:03.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.629+0000 7f19061d1640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f18e4044dc0 0x7f18e4065270 secure :-1 s=READY pgs=416 gs=18 cs=0 l=1 c_cookie=7121370001508728248 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1900093cb0 tx=0x7f18fc02ff80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d43049260cfdb8 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:03.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.629+0000 7f19049ce640 1 -- 10.20.193.48:0/1519620446 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f18fc038030 con 0x7f18e4044dc0 2026-02-12T18:11:03.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.629+0000 7f19049ce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:03.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.629+0000 7f19049ce640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:11:03.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.629+0000 7f19049ce640 10 monclient: dump: 2026-02-12T18:11:03.645 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:03.645 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:03.645 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:03.645 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:03.645 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:03.645 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:03.645 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:03.646 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:03.646 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:03.646 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:03.646 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:03.646 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:03.646 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:03.646 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:03.646 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:03.646 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:03.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.629+0000 7f19049ce640 1 -- 10.20.193.48:0/1519620446 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18fc031ab0 con 0x7f18e4044dc0 2026-02-12T18:11:03.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.629+0000 7f1907c5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:11:03.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.629+0000 7f19049ce640 10 monclient: handle_config config(0 keys) 2026-02-12T18:11:03.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.629+0000 7f1907c5b640 10 monclient: get_monmap_and_config success 2026-02-12T18:11:03.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.629+0000 7f1907c5b640 4 set_mon_vals no callback set 2026-02-12T18:11:03.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.629+0000 7f1907c5b640 10 monclient: shutdown 2026-02-12T18:11:03.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.629+0000 7f1907c5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:11:03.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.629+0000 7f1907c5b640 1 -- 10.20.193.48:0/1519620446 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f18e4044dc0 msgr2=0x7f18e4065270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:03.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.629+0000 7f1907c5b640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f18e4044dc0 0x7f18e4065270 secure :-1 s=READY pgs=416 gs=18 cs=0 l=1 c_cookie=7121370001508728248 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1900093cb0 tx=0x7f18fc02ff80 comp rx=0 tx=0).stop 2026-02-12T18:11:03.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.630+0000 7f1907c5b640 1 -- 10.20.193.48:0/1519620446 shutdown_connections 2026-02-12T18:11:03.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.630+0000 7f1907c5b640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f18e4044dc0 0x7f18e4065270 unknown :-1 s=CLOSED pgs=416 gs=18 cs=0 l=1 c_cookie=7121370001508728248 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:03.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.630+0000 7f1907c5b640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f18e4024280 0x7f18e4044700 unknown :-1 s=CLOSED pgs=0 gs=17 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:03.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.630+0000 7f1907c5b640 1 --2- 10.20.193.48:0/1519620446 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f18e4003820 0x7f18e4023c60 unknown :-1 s=CLOSED pgs=0 gs=16 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:03.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.630+0000 7f1907c5b640 1 -- 10.20.193.48:0/1519620446 >> 10.20.193.48:0/1519620446 conn(0x7f19000548a0 msgr2=0x7f1900097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:11:03.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.630+0000 7f1907c5b640 1 -- 10.20.193.48:0/1519620446 shutdown_connections 2026-02-12T18:11:03.648 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.630+0000 7f1907c5b640 1 -- 10.20.193.48:0/1519620446 wait complete. 2026-02-12T18:11:03.648 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.630+0000 7f1907c5b640 10 monclient: build_initial_monmap 2026-02-12T18:11:03.648 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.630+0000 7f1907c5b640 10 monclient: monmap: 2026-02-12T18:11:03.648 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:11:03.648 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:11:03.648 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:11:03.648 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:11:03.648 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:11:03.648 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:03.648 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:11:03.648 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:11:03.648 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:11:03.649 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:11:03.649 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:11:03.649 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:11:03.649 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:11:03.649 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:11:03.649 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:11:03.649 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:03.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f1907c5b640 1 Processor -- start 2026-02-12T18:11:03.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f1907c5b640 1 -- start start 2026-02-12T18:11:03.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f1907c5b640 10 monclient: init 2026-02-12T18:11:03.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f1907c5b640 10 monclient: _reopen_session rank -1 2026-02-12T18:11:03.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f1907c5b640 10 monclient: _add_conns ranks=[7,3,5,0,2,4,1,8,6] 2026-02-12T18:11:03.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f1907c5b640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f18e4003820 0x7f19001ab180 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:03.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f1907c5b640 10 monclient(hunting): picked mon.noname-i con 0x7f18e4003820 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:11:03.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f1907c5b640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f18e4024280 0x7f19001ab6c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:03.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f1907c5b640 10 monclient(hunting): picked mon.noname-g con 0x7f18e4024280 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:11:03.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f1907c5b640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f18e4044dc0 0x7f1900195480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:03.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f1907c5b640 10 monclient(hunting): picked mon.noname-h con 0x7f18e4044dc0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:11:03.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f1907c5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:03.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f1907c5b640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f1900197940 con 0x7f18e4024280 2026-02-12T18:11:03.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f1907c5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:03.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f1907c5b640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f19000942e0 con 0x7f18e4044dc0 2026-02-12T18:11:03.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f1907c5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:03.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f1907c5b640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f19001afd50 con 0x7f18e4003820 2026-02-12T18:11:03.651 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f1907c5b640 10 monclient(hunting): _renew_subs 2026-02-12T18:11:03.651 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f1907c5b640 10 monclient(hunting): authenticate will time out at 902.357514s 2026-02-12T18:11:03.651 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f19059d0640 1 -- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f18e4003820 msgr2=0x7f19001ab180 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3303/0 2026-02-12T18:11:03.651 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f19059d0640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f18e4003820 0x7f19001ab180 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:11:03.651 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f19061d1640 1 -- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f18e4044dc0 msgr2=0x7f1900195480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:11:03.651 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f19061d1640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f18e4044dc0 0x7f1900195480 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:11:03.651 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f19051cf640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f18e4024280 0x7f19001ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:03.651 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f19051cf640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f18e4024280 0x7f19001ab6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3301/0 says I am v2:10.20.193.48:54272/0 (socket says 10.20.193.48:54272) 2026-02-12T18:11:03.651 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f19051cf640 1 -- 10.20.193.48:0/2963334718 learned_addr learned my addr 10.20.193.48:0/2963334718 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:11:03.651 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f19051cf640 10 monclient(hunting): get_auth_request con 0x7f18e4024280 auth_method 0 2026-02-12T18:11:03.651 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f19051cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:03.651 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f19051cf640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:03.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f19051cf640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:11:03.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f19051cf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:11:03.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f19051cf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:11:03.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.631+0000 7f19051cf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:11:03.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.632+0000 7f19051cf640 10 monclient(hunting): handle_auth_done global_id 64245 payload 824 2026-02-12T18:11:03.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.632+0000 7f19051cf640 1 -- 10.20.193.48:0/2963334718 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f18e4003820 msgr2=0x7f19001ab180 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:11:03.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.632+0000 7f19051cf640 1 --2- 10.20.193.48:0/2963334718 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f18e4003820 0x7f19001ab180 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:03.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.632+0000 7f19051cf640 1 -- 10.20.193.48:0/2963334718 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f18e4044dc0 msgr2=0x7f1900195480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:11:03.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.632+0000 7f19051cf640 1 --2- 10.20.193.48:0/2963334718 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f18e4044dc0 0x7f1900195480 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:03.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.632+0000 7f19051cf640 10 monclient: _finish_hunting 0 2026-02-12T18:11:03.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.632+0000 7f19051cf640 1 monclient: found mon.noname-g 2026-02-12T18:11:03.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.632+0000 7f19051cf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:11:03.653 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.632+0000 7f19051cf640 10 monclient: _send_mon_message to mon.noname-g at v2:10.20.193.111:3301/0 2026-02-12T18:11:03.653 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.632+0000 7f19051cf640 1 -- 10.20.193.48:0/2963334718 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19001ac080 con 0x7f18e4024280 2026-02-12T18:11:03.653 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.634+0000 7f19051cf640 1 -- 10.20.193.48:0/2963334718 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f18e4024280 msgr2=0x7f19001ab6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:11:03.653 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.634+0000 7f19051cf640 1 --2- 10.20.193.48:0/2963334718 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f18e4024280 0x7f19001ab6c0 secure :-1 s=READY pgs=52 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18f4002f70 tx=0x7f18f400f530 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:03.653 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.634+0000 7f18ee7fc640 1 -- 10.20.193.48:0/2963334718 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f18f4003460 con 0x7f18e4024280 2026-02-12T18:11:03.653 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.634+0000 7f18ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:03.653 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.634+0000 7f18ee7fc640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2026-02-12T18:11:03.653 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.634+0000 7f18ee7fc640 10 monclient: dump: 2026-02-12T18:11:03.653 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:03.653 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:03.653 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:03.653 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:03.654 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:03.654 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:03.654 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:03.654 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:03.654 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:03.654 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:03.654 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:03.654 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:03.654 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:03.654 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:03.654 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:03.654 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:03.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.634+0000 7f18ee7fc640 10 monclient: _finish_auth 0 2026-02-12T18:11:03.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.634+0000 7f18ee7fc640 10 monclient: _check_auth_tickets 2026-02-12T18:11:03.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.634+0000 7f18ee7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:11:03.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.634+0000 7f1907c5b640 5 monclient: authenticate success, global_id 64245 2026-02-12T18:11:03.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.634+0000 7f18ee7fc640 1 -- 10.20.193.48:0/2963334718 <== mon.3 v2:10.20.193.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f400fe30 con 0x7f18e4024280 2026-02-12T18:11:03.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.634+0000 7f18ee7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:11:03.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.634+0000 7f18ee7fc640 1 -- 10.20.193.48:0/2963334718 <== mon.3 v2:10.20.193.111:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f18f4012c60 con 0x7f18e4024280 2026-02-12T18:11:03.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.634+0000 7f18ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:03.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.634+0000 7f18ee7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:11:03.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.634+0000 7f18effff640 4 set_mon_vals no callback set 2026-02-12T18:11:03.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.634+0000 7f18ee7fc640 10 monclient: dump: 2026-02-12T18:11:03.655 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:03.656 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:03.656 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:03.656 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:03.656 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:03.656 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:03.656 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:03.656 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:03.656 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:03.656 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:03.656 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:03.656 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:03.656 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:03.656 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:03.657 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:03.657 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:03.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.634+0000 7f1907c5b640 10 monclient: _renew_subs 2026-02-12T18:11:03.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.634+0000 7f1907c5b640 10 monclient: _send_mon_message to mon.g at v2:10.20.193.111:3301/0 2026-02-12T18:11:03.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.634+0000 7f1907c5b640 1 -- 10.20.193.48:0/2963334718 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1900198e60 con 0x7f18e4024280 2026-02-12T18:11:03.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.634+0000 7f1907c5b640 10 monclient: _renew_subs 2026-02-12T18:11:03.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.634+0000 7f1907c5b640 10 monclient: _send_mon_message to mon.g at v2:10.20.193.111:3301/0 2026-02-12T18:11:03.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.634+0000 7f1907c5b640 1 -- 10.20.193.48:0/2963334718 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1900196de0 con 0x7f18e4024280 2026-02-12T18:11:03.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.635+0000 7f1907c5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:11:03.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.635+0000 7f1907c5b640 1 --2- 10.20.193.48:0/2963334718 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f19001959c0 0x7f1900195d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:03.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.635+0000 7f1907c5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:03.658 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.635+0000 7f1907c5b640 1 -- 10.20.193.48:0/2963334718 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f190005f140 con 0x7f19001959c0 2026-02-12T18:11:03.658 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.635+0000 7f19059d0640 1 --2- 10.20.193.48:0/2963334718 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f19001959c0 0x7f1900195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:03.658 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.635+0000 7f18ee7fc640 1 -- 10.20.193.48:0/2963334718 <== mon.3 v2:10.20.193.111:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f18f401c020 con 0x7f18e4024280 2026-02-12T18:11:03.658 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.635+0000 7f19059d0640 10 monclient: get_auth_request con 0x7f19001959c0 auth_method 0 2026-02-12T18:11:03.658 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.635+0000 7f19059d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:03.658 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.635+0000 7f19059d0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:03.658 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.635+0000 7f19059d0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:11:03.658 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.635+0000 7f19059d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:11:03.658 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.635+0000 7f19059d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:11:03.658 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.635+0000 7f19059d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:11:03.658 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.635+0000 7f19059d0640 10 monclient(hunting): handle_auth_done global_id 35768 payload 824 2026-02-12T18:11:03.658 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.635+0000 7f19059d0640 1 -- 10.20.193.48:0/2963334718 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f19000929d0 con 0x7f19001959c0 2026-02-12T18:11:03.659 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.635+0000 7f18ee7fc640 1 --2- 10.20.193.48:0/2963334718 >> v2:10.20.193.111:6812/977811348 conn(0x7f18d003f780 0x7f18d005fc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:03.659 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.635+0000 7f18ee7fc640 1 -- 10.20.193.48:0/2963334718 <== mon.3 v2:10.20.193.111:3301/0 5 ==== osd_map(215..215 src has 190..215) ==== 3503+0+0 (secure 0 0 0) 0x7f18f40529a0 con 0x7f18e4024280 2026-02-12T18:11:03.659 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.636+0000 7f19061d1640 1 --2- 10.20.193.48:0/2963334718 >> v2:10.20.193.111:6812/977811348 conn(0x7f18d003f780 0x7f18d005fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:03.659 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.636+0000 7f19061d1640 10 monclient: get_auth_request con 0x7f18d003f780 auth_method 0 2026-02-12T18:11:03.659 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.637+0000 7f19059d0640 1 -- 10.20.193.48:0/2963334718 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f19001959c0 msgr2=0x7f1900195d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:11:03.659 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.637+0000 7f19059d0640 1 --2- 10.20.193.48:0/2963334718 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f19001959c0 0x7f1900195d90 secure :-1 s=READY pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18f00039f0 tx=0x7f18f000ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:03.659 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.638+0000 7f18ee7fc640 1 -- 10.20.193.48:0/2963334718 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f18f0003e90 con 0x7f19001959c0 2026-02-12T18:11:03.659 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.638+0000 7f18ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:03.659 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.638+0000 7f18ee7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:11:03.659 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.638+0000 7f18ee7fc640 10 monclient: dump: 2026-02-12T18:11:03.659 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:03.659 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:03.660 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:03.660 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:03.660 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:03.660 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:03.660 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:03.660 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:03.660 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:03.660 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:03.660 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:03.660 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:03.660 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:03.660 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:03.660 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:03.661 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:03.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.638+0000 7f18ee7fc640 1 -- 10.20.193.48:0/2963334718 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f18f000c950 con 0x7f19001959c0 2026-02-12T18:11:03.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.638+0000 7f18ee7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:11:03.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.638+0000 7f18ee7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:11:03.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.638+0000 7f18ee7fc640 1 -- 10.20.193.48:0/2963334718 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f19001959c0 msgr2=0x7f1900195d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:03.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.638+0000 7f18ee7fc640 1 --2- 10.20.193.48:0/2963334718 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f19001959c0 0x7f1900195d90 secure :-1 s=READY pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18f00039f0 tx=0x7f18f000ee40 comp rx=0 tx=0).stop 2026-02-12T18:11:03.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.638+0000 7f18ee7fc640 1 -- 10.20.193.48:0/2963334718 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f19001959c0 msgr2=0x7f1900195d90 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:11:03.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.638+0000 7f18ee7fc640 1 --2- 10.20.193.48:0/2963334718 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f19001959c0 0x7f1900195d90 secure :-1 s=CLOSED pgs=261 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18f00039f0 tx=0x7f18f000ee40 comp rx=0 tx=0).stop 2026-02-12T18:11:03.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.638+0000 7f19061d1640 1 --2- 10.20.193.48:0/2963334718 >> v2:10.20.193.111:6812/977811348 conn(0x7f18d003f780 0x7f18d005fc30 secure :-1 s=READY pgs=313 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18fc039040 tx=0x7f18fc009000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:03.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.641+0000 7f1907c5b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:11:03.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.641+0000 7f1907c5b640 1 --2- 10.20.193.48:0/2963334718 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f19001962d0 0x7f190008a4b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:03.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.641+0000 7f1907c5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:03.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.641+0000 7f1907c5b640 1 -- 10.20.193.48:0/2963334718 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f1900050410 con 0x7f19001962d0 2026-02-12T18:11:03.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.641+0000 7f19059d0640 1 --2- 10.20.193.48:0/2963334718 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f19001962d0 0x7f190008a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:03.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.641+0000 7f19059d0640 10 monclient: get_auth_request con 0x7f19001962d0 auth_method 0 2026-02-12T18:11:03.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.641+0000 7f19059d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:03.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.641+0000 7f19059d0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:03.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.641+0000 7f19059d0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:11:03.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.641+0000 7f19059d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:11:03.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.641+0000 7f19059d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:11:03.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.641+0000 7f19059d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:11:03.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.641+0000 7f19059d0640 10 monclient(hunting): handle_auth_done global_id 35777 payload 824 2026-02-12T18:11:03.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.641+0000 7f19059d0640 1 -- 10.20.193.48:0/2963334718 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f190005de70 con 0x7f19001962d0 2026-02-12T18:11:03.663 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.644+0000 7f19059d0640 1 -- 10.20.193.48:0/2963334718 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f19001962d0 msgr2=0x7f190008a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:11:03.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.644+0000 7f19059d0640 1 --2- 10.20.193.48:0/2963334718 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f19001962d0 0x7f190008a4b0 secure :-1 s=READY pgs=262 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18f00023d0 tx=0x7f18f0005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:03.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.644+0000 7f18ee7fc640 1 -- 10.20.193.48:0/2963334718 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f18f001c630 con 0x7f19001962d0 2026-02-12T18:11:03.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.644+0000 7f18ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:03.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.644+0000 7f18ee7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:11:03.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.644+0000 7f18ee7fc640 10 monclient: dump: 2026-02-12T18:11:03.664 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:03.664 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:03.664 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:03.664 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:03.664 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:03.664 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:03.664 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:03.665 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:03.665 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:03.665 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:03.665 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:03.665 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:03.665 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:03.665 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:03.665 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:03.665 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:03.665 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.644+0000 7f18ee7fc640 1 -- 10.20.193.48:0/2963334718 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9971 (secure 0 0 0) 0x7f18f001c790 con 0x7f19001962d0 2026-02-12T18:11:03.665 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.644+0000 7f18ee7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:11:03.665 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.644+0000 7f18ee7fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:11:03.665 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.644+0000 7f18ee7fc640 1 -- 10.20.193.48:0/2963334718 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f19001962d0 msgr2=0x7f190008a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:03.665 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.644+0000 7f18ee7fc640 1 --2- 10.20.193.48:0/2963334718 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f19001962d0 0x7f190008a4b0 secure :-1 s=READY pgs=262 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18f00023d0 tx=0x7f18f0005c00 comp rx=0 tx=0).stop 2026-02-12T18:11:03.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.644+0000 7f18ee7fc640 1 -- 10.20.193.48:0/2963334718 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f19001962d0 msgr2=0x7f190008a4b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:11:03.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.644+0000 7f18ee7fc640 1 --2- 10.20.193.48:0/2963334718 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f19001962d0 0x7f190008a4b0 secure :-1 s=CLOSED pgs=262 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18f00023d0 tx=0x7f18f0005c00 comp rx=0 tx=0).stop 2026-02-12T18:11:03.666 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:11:03.666 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:11:03.666 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:11:03.666 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:11:03.666 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 54, 2026-02-12T18:11:03.666 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 318478, 2026-02-12T18:11:03.666 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:11:03.667 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:11:03.667 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:11:03.667 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:11:03.667 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:11:03.667 INFO:teuthology.orchestra.run.trial048.stdout: 6 2026-02-12T18:11:03.667 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:11:03.667 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 4, 2026-02-12T18:11:03.667 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:11:03.667 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:11:03.667 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:11:03.667 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:11:03.667 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:11:03.667 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:11:03.667 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:11:03.667 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:11:03.668 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:11:03.668 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:11:03.668 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:11:03.668 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:11:03.668 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:11:03.668 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:11:03.668 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:11:03.668 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:11:03.668 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:11:03.668 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:11:03.668 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:11:03.668 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:11:03.668 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:11:03.668 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:11:03.668 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:11:03.669 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:11:03.669 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:11:03.669 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:11:03.669 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:11:03.669 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:11:03.669 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:11:03.669 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:11:03.669 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:11:03.669 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:11:03.669 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:03.669 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.669 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:11:03.669 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:11:03.669 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:11:03.669 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:11:03.669 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:11:03.669 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:11:03.670 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:11:03.670 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:11:03.670 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:11:03.670 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:11:03.670 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:11:03.670 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:11:03.670 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:11:03.670 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:11:03.670 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:11:03.670 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:11:03.670 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:11:03.670 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:11:03.670 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:11:03.670 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:11:03.670 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:11:03.670 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:11:03.670 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:11:03.671 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:11:03.671 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:11:03.671 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:11:03.671 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:11:03.671 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:11:03.671 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:11:03.671 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:11:03.671 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:11:03.671 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:11:03.671 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.671 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:11:03.671 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.671 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:11:03.671 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:11:03.671 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:03.671 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:03.671 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.672 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:03.672 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:11:03.672 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.672 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.672 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.672 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:03.672 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:11:03.672 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.672 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:03.672 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:03.672 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.672 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:11:03.672 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:11:03.672 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:03.672 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:03.672 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:11:03.672 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:03.672 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.673 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.673 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:11:03.673 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:11:03.673 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:03.673 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:03.673 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.673 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:03.673 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:11:03.673 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.673 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.673 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.673 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:03.673 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:11:03.673 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.673 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:03.673 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:03.673 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.674 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:11:03.674 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:11:03.674 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:03.674 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:03.674 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:11:03.674 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:03.674 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.674 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.674 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:11:03.674 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:11:03.674 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:03.674 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:03.674 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.674 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:03.674 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:11:03.674 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.674 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.675 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.675 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:03.675 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:11:03.675 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.675 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:03.675 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:03.675 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.675 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:11:03.675 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:11:03.675 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:03.675 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:03.675 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:11:03.675 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:03.675 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.675 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.675 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:11:03.675 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:11:03.675 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:03.676 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:03.676 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.676 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:03.676 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:11:03.676 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.676 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.676 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.676 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:03.676 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:11:03.676 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.676 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:03.676 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:03.676 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.676 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:11:03.676 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:11:03.676 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:03.676 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:03.676 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:11:03.676 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:03.677 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.677 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.677 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:11:03.677 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:11:03.677 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:03.677 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:03.677 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.677 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:03.677 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:11:03.677 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.677 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.677 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.677 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:03.677 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:11:03.677 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.677 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:03.677 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:03.677 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.677 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:11:03.678 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:11:03.678 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:03.678 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:03.678 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:11:03.678 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:03.678 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.678 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.678 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:11:03.678 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:11:03.678 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:03.678 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:03.678 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.678 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:03.678 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:11:03.678 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.678 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.678 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.678 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:03.678 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:11:03.678 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.679 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:03.679 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:03.679 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.679 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:11:03.679 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:11:03.679 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:03.679 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:03.679 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:11:03.679 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:03.679 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.679 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.679 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:11:03.679 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:11:03.679 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:03.679 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:03.679 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.679 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:03.679 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:11:03.679 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.679 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.679 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.680 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:03.680 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:11:03.680 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.680 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:03.680 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:03.680 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.680 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:11:03.680 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:11:03.680 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:03.680 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:03.680 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:11:03.680 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:03.680 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.680 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.680 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:11:03.680 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:11:03.680 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:03.680 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:03.680 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.680 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:03.680 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:11:03.680 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.681 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.681 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.681 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:03.681 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:11:03.681 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.681 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:03.681 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:03.681 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.681 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:11:03.681 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:11:03.681 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:03.681 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:03.681 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:11:03.681 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:03.681 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.681 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.681 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:11:03.681 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:11:03.681 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:03.681 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:03.681 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.682 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:03.682 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:11:03.682 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.682 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.682 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.682 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:03.682 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:11:03.682 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.682 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:03.682 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:03.682 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.682 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:11:03.682 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:11:03.682 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:03.682 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:03.682 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:11:03.682 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:03.682 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:03.682 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:03.682 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.682 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:11:03.682 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:11:03.682 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.683 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:11:03.683 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:11:03.683 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:11:03.683 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:03.683 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:11:03.683 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:11:03.683 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.683 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:11:03.683 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:11:03.683 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:11:03.683 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:03.683 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:03.683 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.683 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:11:03.683 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:11:03.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.644+0000 7f1907c5b640 1 -- 10.20.193.48:0/2963334718 >> v2:10.20.193.111:6812/977811348 conn(0x7f18d003f780 msgr2=0x7f18d005fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:03.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.644+0000 7f1907c5b640 1 --2- 10.20.193.48:0/2963334718 >> v2:10.20.193.111:6812/977811348 conn(0x7f18d003f780 0x7f18d005fc30 secure :-1 s=READY pgs=313 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18fc039040 tx=0x7f18fc009000 comp rx=0 tx=0).stop 2026-02-12T18:11:03.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.644+0000 7f1907c5b640 10 monclient: shutdown 2026-02-12T18:11:03.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.644+0000 7f1907c5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:11:03.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.644+0000 7f1907c5b640 1 -- 10.20.193.48:0/2963334718 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f18e4024280 msgr2=0x7f19001ab6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:03.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.644+0000 7f1907c5b640 1 --2- 10.20.193.48:0/2963334718 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f18e4024280 0x7f19001ab6c0 secure :-1 s=READY pgs=52 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18f4002f70 tx=0x7f18f400f530 comp rx=0 tx=0).stop 2026-02-12T18:11:03.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.644+0000 7f19061d1640 1 -- 10.20.193.48:0/2963334718 reap_dead start 2026-02-12T18:11:03.684 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.644+0000 7f1907c5b640 1 -- 10.20.193.48:0/2963334718 shutdown_connections 2026-02-12T18:11:03.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.644+0000 7f1907c5b640 1 --2- 10.20.193.48:0/2963334718 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f18e4024280 0x7f19001ab6c0 unknown :-1 s=CLOSED pgs=52 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:03.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.644+0000 7f1907c5b640 1 -- 10.20.193.48:0/2963334718 >> 10.20.193.48:0/2963334718 conn(0x7f19000548a0 msgr2=0x7f19001aec40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:11:03.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.644+0000 7f1907c5b640 1 -- 10.20.193.48:0/2963334718 shutdown_connections 2026-02-12T18:11:03.685 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.644+0000 7f1907c5b640 1 -- 10.20.193.48:0/2963334718 wait complete. 2026-02-12T18:11:03.685 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2026-02-12T18:11:03.685 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon c 2026-02-12T18:11:03.685 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T18:11:03.753 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.752+0000 7f452ffb9640 10 monclient: get_monmap_and_config 2026-02-12T18:11:03.753 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.752+0000 7f452ffb9640 10 monclient: build_initial_monmap 2026-02-12T18:11:03.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.752+0000 7f452ffb9640 10 monclient: monmap: 2026-02-12T18:11:03.754 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:11:03.754 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:03.754 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:11:03.753263+0000 2026-02-12T18:11:03.754 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:11:03.753263+0000 2026-02-12T18:11:03.754 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:11:03.754 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:03.754 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:11:03.754 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:11:03.754 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:11:03.754 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:11:03.754 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:11:03.754 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:11:03.754 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:11:03.754 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:11:03.755 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:11:03.755 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:11:03.755 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:11:03.755 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:03.758 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.752+0000 7f452ffb9640 1 Processor -- start 2026-02-12T18:11:03.758 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.752+0000 7f452ffb9640 1 -- start start 2026-02-12T18:11:03.758 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.752+0000 7f452ffb9640 10 monclient: init 2026-02-12T18:11:03.758 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.752+0000 7f452ffb9640 10 monclient: _reopen_session rank -1 2026-02-12T18:11:03.758 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.752+0000 7f452ffb9640 10 monclient: _add_conns ranks=[0,5,4,10,9,1,3,6,8,7,2] 2026-02-12T18:11:03.758 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.752+0000 7f452ffb9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f45280914d0 addr v1:10.20.193.48:6789/0 2026-02-12T18:11:03.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.752+0000 7f452ffb9640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f452808e210 0x7f452805d060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:03.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.752+0000 7f452ffb9640 10 monclient(hunting): picked mon.noname-h con 0x7f452808e210 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:11:03.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.752+0000 7f452ffb9640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f452805e4b0 0x7f45281a5c20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:03.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.752+0000 7f452ffb9640 10 monclient(hunting): picked mon.noname-c con 0x7f452805e4b0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:11:03.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.752+0000 7f452ffb9640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f452804dc20 con 0x7f45280914d0 2026-02-12T18:11:03.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.752+0000 7f452ffb9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:03.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.752+0000 7f452ffb9640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f4528093d70 con 0x7f452805e4b0 2026-02-12T18:11:03.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.752+0000 7f452ffb9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:03.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.752+0000 7f452ffb9640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f4528092f90 con 0x7f452808e210 2026-02-12T18:11:03.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.752+0000 7f452ffb9640 10 monclient(hunting): _renew_subs 2026-02-12T18:11:03.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.752+0000 7f452ffb9640 10 monclient(hunting): authenticate will time out at 902.478981s 2026-02-12T18:11:03.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.753+0000 7f452dd2e640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f45280914d0 0x7f452805c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:47596/0 (socket says 10.20.193.48:47596) 2026-02-12T18:11:03.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.753+0000 7f452dd2e640 1 -- 10.20.193.48:0/4054634559 learned_addr learned my addr 10.20.193.48:0/4054634559 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:11:03.759 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.753+0000 7f452d52d640 1 -- 10.20.193.48:0/4054634559 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f452808e210 msgr2=0x7f452805d060 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:11:03.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.753+0000 7f452d52d640 1 --2- 10.20.193.48:0/4054634559 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f452808e210 0x7f452805d060 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:11:03.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.753+0000 7f452e52f640 1 --2- 10.20.193.48:0/4054634559 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f452805e4b0 0x7f45281a5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:03.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.753+0000 7f452e52f640 10 monclient(hunting): get_auth_request con 0x7f452805e4b0 auth_method 0 2026-02-12T18:11:03.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.753+0000 7f452e52f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:03.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.753+0000 7f452e52f640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:03.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.753+0000 7f452e52f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:11:03.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.753+0000 7f452e52f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:11:03.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.753+0000 7f452e52f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:11:03.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.753+0000 7f452e52f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:11:03.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.753+0000 7f452e52f640 10 monclient(hunting): handle_auth_done global_id 64309 payload 274 2026-02-12T18:11:03.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.753+0000 7f452e52f640 1 -- 10.20.193.48:0/4054634559 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f452808e210 msgr2=0x7f452805d060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:11:03.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.753+0000 7f452e52f640 1 --2- 10.20.193.48:0/4054634559 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f452808e210 0x7f452805d060 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:03.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.753+0000 7f452e52f640 1 -- 10.20.193.48:0/4054634559 >> v1:10.20.193.48:6789/0 conn(0x7f45280914d0 legacy=0x7f452805c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:11:03.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.753+0000 7f452e52f640 10 monclient: _finish_hunting 0 2026-02-12T18:11:03.761 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.753+0000 7f452e52f640 1 monclient: found mon.noname-c 2026-02-12T18:11:03.761 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.753+0000 7f452e52f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:11:03.761 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.753+0000 7f452e52f640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:11:03.761 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.753+0000 7f452e52f640 1 -- 10.20.193.48:0/4054634559 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45280918a0 con 0x7f452805e4b0 2026-02-12T18:11:03.761 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.755+0000 7f452e52f640 1 -- 10.20.193.48:0/4054634559 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f452805e4b0 msgr2=0x7f45281a5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:11:03.761 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.755+0000 7f452e52f640 1 --2- 10.20.193.48:0/4054634559 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f452805e4b0 0x7f45281a5c20 secure :-1 s=READY pgs=62 gs=2 cs=0 l=1 c_cookie=10077069698036181502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f452400a8e0 tx=0x7f452402fe40 comp rx=0 tx=0).ready entity=mon.4 client_cookie=8bd8f17ff04ca9fe server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:03.761 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.755+0000 7f452cd2c640 1 -- 10.20.193.48:0/4054634559 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4524030ba0 con 0x7f452805e4b0 2026-02-12T18:11:03.761 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.755+0000 7f452cd2c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:03.761 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.755+0000 7f452cd2c640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:11:03.761 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.755+0000 7f452cd2c640 10 monclient: dump: 2026-02-12T18:11:03.761 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:03.761 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:03.761 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:03.761 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:03.761 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:03.762 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:03.762 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:03.762 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:03.762 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:03.762 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:03.762 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:03.762 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:03.762 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:03.762 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:03.762 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:03.762 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:03.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.756+0000 7f452cd2c640 10 monclient: _finish_auth 0 2026-02-12T18:11:03.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.756+0000 7f452cd2c640 10 monclient: _check_auth_tickets 2026-02-12T18:11:03.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.756+0000 7f452cd2c640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:11:03.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.756+0000 7f452cd2c640 1 -- 10.20.193.48:0/4054634559 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4524030d20 con 0x7f452805e4b0 2026-02-12T18:11:03.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.756+0000 7f452cd2c640 10 monclient: handle_config config(0 keys) 2026-02-12T18:11:03.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.756+0000 7f452cd2c640 1 -- 10.20.193.48:0/4054634559 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4524036cc0 con 0x7f452805e4b0 2026-02-12T18:11:03.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.756+0000 7f452cd2c640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:03.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.756+0000 7f452cd2c640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:11:03.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.756+0000 7f452cd2c640 10 monclient: dump: 2026-02-12T18:11:03.763 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:03.763 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:03.763 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:03.763 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:03.763 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:03.763 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:03.763 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:03.763 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:03.763 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:03.763 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:03.764 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:03.764 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:03.764 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:03.764 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:03.764 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:03.764 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:03.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.756+0000 7f452ffb9640 5 monclient: authenticate success, global_id 64309 2026-02-12T18:11:03.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.756+0000 7f452ffb9640 10 monclient: get_monmap_and_config success 2026-02-12T18:11:03.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.756+0000 7f452ffb9640 4 set_mon_vals no callback set 2026-02-12T18:11:03.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.756+0000 7f452ffb9640 10 monclient: shutdown 2026-02-12T18:11:03.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.756+0000 7f452ffb9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:11:03.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.756+0000 7f452ffb9640 1 -- 10.20.193.48:0/4054634559 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f452805e4b0 msgr2=0x7f45281a5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:03.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.756+0000 7f452ffb9640 1 --2- 10.20.193.48:0/4054634559 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f452805e4b0 0x7f45281a5c20 secure :-1 s=READY pgs=62 gs=2 cs=0 l=1 c_cookie=10077069698036181502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f452400a8e0 tx=0x7f452402fe40 comp rx=0 tx=0).stop 2026-02-12T18:11:03.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.756+0000 7f452ffb9640 1 -- 10.20.193.48:0/4054634559 shutdown_connections 2026-02-12T18:11:03.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.756+0000 7f452ffb9640 1 --2- 10.20.193.48:0/4054634559 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f452805e4b0 0x7f45281a5c20 unknown :-1 s=CLOSED pgs=62 gs=2 cs=0 l=1 c_cookie=10077069698036181502 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:03.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.756+0000 7f452ffb9640 1 --2- 10.20.193.48:0/4054634559 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f452808e210 0x7f452805d060 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:03.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.756+0000 7f452ffb9640 1 -- 10.20.193.48:0/4054634559 >> 10.20.193.48:0/4054634559 conn(0x7f45280548a0 msgr2=0x7f4528097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:11:03.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.756+0000 7f452ffb9640 1 -- 10.20.193.48:0/4054634559 shutdown_connections 2026-02-12T18:11:03.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.756+0000 7f452ffb9640 1 -- 10.20.193.48:0/4054634559 wait complete. 2026-02-12T18:11:03.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.756+0000 7f452ffb9640 10 monclient: build_initial_monmap 2026-02-12T18:11:03.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.756+0000 7f452ffb9640 10 monclient: monmap: 2026-02-12T18:11:03.765 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:11:03.765 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:11:03.765 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:11:03.765 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:11:03.765 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:11:03.765 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:03.765 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:11:03.765 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:11:03.766 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:11:03.766 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:11:03.766 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:11:03.766 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:11:03.766 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:11:03.766 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:11:03.766 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:11:03.766 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:03.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452ffb9640 1 Processor -- start 2026-02-12T18:11:03.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452ffb9640 1 -- start start 2026-02-12T18:11:03.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452ffb9640 10 monclient: init 2026-02-12T18:11:03.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452ffb9640 10 monclient: _reopen_session rank -1 2026-02-12T18:11:03.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452ffb9640 10 monclient: _add_conns ranks=[2,0,7,3,1,4,5,8,6] 2026-02-12T18:11:03.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452ffb9640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f452805e4b0 0x7f45281b0ec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:03.770 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452ffb9640 10 monclient(hunting): picked mon.noname-b con 0x7f452805e4b0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:11:03.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452ffb9640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f452808e210 0x7f45281db160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:03.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452ffb9640 10 monclient(hunting): picked mon.noname-a con 0x7f452808e210 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:11:03.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452ffb9640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f45280914d0 0x7f45281db6a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:03.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452ffb9640 10 monclient(hunting): picked mon.noname-i con 0x7f45280914d0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:11:03.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452ffb9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:03.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452ffb9640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f4528094410 con 0x7f452808e210 2026-02-12T18:11:03.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452ffb9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:03.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452ffb9640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f45281dbbe0 con 0x7f452805e4b0 2026-02-12T18:11:03.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452ffb9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:03.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452ffb9640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f452819c860 con 0x7f45280914d0 2026-02-12T18:11:03.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452ffb9640 10 monclient(hunting): _renew_subs 2026-02-12T18:11:03.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452ffb9640 10 monclient(hunting): authenticate will time out at 902.483404s 2026-02-12T18:11:03.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452dd2e640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f452805e4b0 0x7f45281b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:03.771 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452dd2e640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f452805e4b0 0x7f45281b0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:48230/0 (socket says 10.20.193.48:48230) 2026-02-12T18:11:03.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452dd2e640 1 -- 10.20.193.48:0/26796219 learned_addr learned my addr 10.20.193.48:0/26796219 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:11:03.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452e52f640 1 -- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f45280914d0 msgr2=0x7f45281db6a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3303/0 2026-02-12T18:11:03.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452dd2e640 10 monclient(hunting): get_auth_request con 0x7f452805e4b0 auth_method 0 2026-02-12T18:11:03.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452dd2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:03.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452dd2e640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:03.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452dd2e640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:11:03.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452d52d640 1 --2- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f452808e210 0x7f45281db160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:03.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452e52f640 1 --2- 10.20.193.48:0/26796219 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f45280914d0 0x7f45281db6a0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:11:03.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452d52d640 10 monclient(hunting): get_auth_request con 0x7f452808e210 auth_method 0 2026-02-12T18:11:03.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452d52d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:03.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452d52d640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:03.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452d52d640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:11:03.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452dd2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:11:03.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452dd2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:11:03.772 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452dd2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:11:03.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452d52d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:11:03.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452d52d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:11:03.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452d52d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:11:03.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452dd2e640 10 monclient(hunting): handle_auth_done global_id 35786 payload 824 2026-02-12T18:11:03.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452dd2e640 1 -- 10.20.193.48:0/26796219 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f45280914d0 msgr2=0x7f45281db6a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:11:03.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452dd2e640 1 --2- 10.20.193.48:0/26796219 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f45280914d0 0x7f45281db6a0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:03.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452dd2e640 1 -- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f452808e210 msgr2=0x7f45281db160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:03.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452dd2e640 1 --2- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f452808e210 0x7f45281db160 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:03.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452dd2e640 10 monclient: _finish_hunting 0 2026-02-12T18:11:03.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452dd2e640 1 monclient: found mon.noname-b 2026-02-12T18:11:03.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452dd2e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:11:03.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452dd2e640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:11:03.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.757+0000 7f452dd2e640 1 -- 10.20.193.48:0/26796219 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f452400a500 con 0x7f452805e4b0 2026-02-12T18:11:03.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.759+0000 7f452dd2e640 1 -- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f452805e4b0 msgr2=0x7f45281b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:11:03.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.759+0000 7f452dd2e640 1 --2- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f452805e4b0 0x7f45281b0ec0 secure :-1 s=READY pgs=263 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4518007fd0 tx=0x7f451800c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:03.773 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.759+0000 7f45167fc640 1 -- 10.20.193.48:0/26796219 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4518005db0 con 0x7f452805e4b0 2026-02-12T18:11:03.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f45167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:03.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f45167fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:11:03.774 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f45167fc640 10 monclient: dump: 2026-02-12T18:11:03.774 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:03.774 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:03.774 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:03.774 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:03.774 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:03.774 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:03.774 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:03.774 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:03.774 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:03.774 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:03.774 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:03.775 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:03.775 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:03.775 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:03.775 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:03.775 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:03.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f45167fc640 10 monclient: _finish_auth 0 2026-02-12T18:11:03.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f45167fc640 10 monclient: _check_auth_tickets 2026-02-12T18:11:03.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f45167fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:11:03.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f45167fc640 1 -- 10.20.193.48:0/26796219 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4518007530 con 0x7f452805e4b0 2026-02-12T18:11:03.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f452ffb9640 5 monclient: authenticate success, global_id 35786 2026-02-12T18:11:03.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f452ffb9640 10 monclient: _renew_subs 2026-02-12T18:11:03.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f452ffb9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:11:03.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f452ffb9640 1 -- 10.20.193.48:0/26796219 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f452819a500 con 0x7f452805e4b0 2026-02-12T18:11:03.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f45167fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:11:03.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f45167fc640 1 -- 10.20.193.48:0/26796219 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f45180076a0 con 0x7f452805e4b0 2026-02-12T18:11:03.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f45167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:03.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f4517fff640 4 set_mon_vals no callback set 2026-02-12T18:11:03.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f45167fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:11:03.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f45167fc640 10 monclient: dump: 2026-02-12T18:11:03.776 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:03.776 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:03.776 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:03.776 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:03.776 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:03.776 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:03.776 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:03.776 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:03.776 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:03.776 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:03.776 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:03.777 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:03.777 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:03.777 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:03.777 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:03.777 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:03.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f452ffb9640 10 monclient: _renew_subs 2026-02-12T18:11:03.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f452ffb9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:11:03.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f452ffb9640 1 -- 10.20.193.48:0/26796219 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f452819c2a0 con 0x7f452805e4b0 2026-02-12T18:11:03.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f452ffb9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:11:03.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f452ffb9640 1 --2- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f45281b1400 0x7f45281d7be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:03.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f452ffb9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:03.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f452ffb9640 1 -- 10.20.193.48:0/26796219 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f4528063130 con 0x7f45281b1400 2026-02-12T18:11:03.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f45167fc640 1 -- 10.20.193.48:0/26796219 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f4518007070 con 0x7f452805e4b0 2026-02-12T18:11:03.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f452d52d640 1 --2- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f45281b1400 0x7f45281d7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:03.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f452d52d640 10 monclient: get_auth_request con 0x7f45281b1400 auth_method 0 2026-02-12T18:11:03.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f452d52d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:03.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f452d52d640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:03.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f452d52d640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:11:03.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f452d52d640 1 -- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f45281b1400 msgr2=0x7f45281d7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-12T18:11:03.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f452d52d640 1 -- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f45281b1400 msgr2=0x7f45281d7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:11:03.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f452d52d640 1 --2- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f45281b1400 0x7f45281d7be0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:11:03.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f452d52d640 1 --2- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f45281b1400 0x7f45281d7be0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:11:03.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f45167fc640 1 --2- 10.20.193.48:0/26796219 >> v2:10.20.193.111:6812/977811348 conn(0x7f44f803f7c0 0x7f44f805fc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:03.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.760+0000 7f45167fc640 1 -- 10.20.193.48:0/26796219 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(215..215 src has 190..215) ==== 3503+0+0 (secure 0 0 0) 0x7f4518051ef0 con 0x7f452805e4b0 2026-02-12T18:11:03.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.761+0000 7f452e52f640 1 --2- 10.20.193.48:0/26796219 >> v2:10.20.193.111:6812/977811348 conn(0x7f44f803f7c0 0x7f44f805fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:03.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.761+0000 7f452e52f640 10 monclient: get_auth_request con 0x7f44f803f7c0 auth_method 0 2026-02-12T18:11:03.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.763+0000 7f452e52f640 1 --2- 10.20.193.48:0/26796219 >> v2:10.20.193.111:6812/977811348 conn(0x7f44f803f7c0 0x7f44f805fc70 secure :-1 s=READY pgs=314 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4524030fd0 tx=0x7f4524034000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:03.963 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.961+0000 7f452d52d640 1 --2- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f45281b1400 0x7f45281d7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:03.963 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.961+0000 7f452d52d640 10 monclient: get_auth_request con 0x7f45281b1400 auth_method 0 2026-02-12T18:11:03.963 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.961+0000 7f452d52d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:03.963 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.961+0000 7f452d52d640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:03.963 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.961+0000 7f452d52d640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:11:03.963 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.961+0000 7f452d52d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:11:03.963 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.961+0000 7f452d52d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:11:03.964 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.961+0000 7f452d52d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:11:03.964 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.961+0000 7f452d52d640 10 monclient(hunting): handle_auth_done global_id 64327 payload 824 2026-02-12T18:11:03.964 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.961+0000 7f452d52d640 1 -- 10.20.193.48:0/26796219 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4528092cb0 con 0x7f45281b1400 2026-02-12T18:11:03.965 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.963+0000 7f452d52d640 1 -- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f45281b1400 msgr2=0x7f45281d7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:11:03.965 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.963+0000 7f452d52d640 1 --2- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f45281b1400 0x7f45281d7be0 secure :-1 s=READY pgs=63 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f451c003900 tx=0x7f451c003f90 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:03.966 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.963+0000 7f45167fc640 1 -- 10.20.193.48:0/26796219 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f451c013dc0 con 0x7f45281b1400 2026-02-12T18:11:03.966 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.963+0000 7f45167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:03.966 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.963+0000 7f45167fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:11:03.966 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.963+0000 7f45167fc640 10 monclient: dump: 2026-02-12T18:11:03.966 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:03.966 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:03.966 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:03.966 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:03.966 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:03.966 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:03.966 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:03.966 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:03.967 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:03.967 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:03.967 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:03.967 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:03.967 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:03.967 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:03.967 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:03.967 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:03.967 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.963+0000 7f45167fc640 1 -- 10.20.193.48:0/26796219 <== mon.4 v2:10.20.193.48:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f451c013900 con 0x7f45281b1400 2026-02-12T18:11:03.967 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.963+0000 7f45167fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:11:03.967 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.963+0000 7f45167fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:11:03.967 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.963+0000 7f45167fc640 1 -- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f45281b1400 msgr2=0x7f45281d7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:03.967 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.963+0000 7f45167fc640 1 --2- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f45281b1400 0x7f45281d7be0 secure :-1 s=READY pgs=63 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f451c003900 tx=0x7f451c003f90 comp rx=0 tx=0).stop 2026-02-12T18:11:03.968 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.963+0000 7f45167fc640 1 -- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f45281b1400 msgr2=0x7f45281d7be0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:11:03.968 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.963+0000 7f45167fc640 1 --2- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f45281b1400 0x7f45281d7be0 secure :-1 s=CLOSED pgs=63 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f451c003900 tx=0x7f451c003f90 comp rx=0 tx=0).stop 2026-02-12T18:11:03.969 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.967+0000 7f452ffb9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:11:03.969 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.967+0000 7f452ffb9640 1 --2- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f45281d8120 0x7f45281d8520 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:03.970 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.967+0000 7f452ffb9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:03.970 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.967+0000 7f452ffb9640 1 -- 10.20.193.48:0/26796219 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f4528050410 con 0x7f45281d8120 2026-02-12T18:11:03.970 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.967+0000 7f452d52d640 1 --2- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f45281d8120 0x7f45281d8520 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:03.970 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.967+0000 7f452d52d640 10 monclient: get_auth_request con 0x7f45281d8120 auth_method 0 2026-02-12T18:11:03.970 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.967+0000 7f452d52d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:03.970 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.967+0000 7f452d52d640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:03.970 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.967+0000 7f452d52d640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:11:03.970 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.967+0000 7f452d52d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:11:03.970 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.967+0000 7f452d52d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:11:03.970 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.967+0000 7f452d52d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:11:03.970 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.967+0000 7f452d52d640 10 monclient(hunting): handle_auth_done global_id 64336 payload 824 2026-02-12T18:11:03.970 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.967+0000 7f452d52d640 1 -- 10.20.193.48:0/26796219 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f45280929d0 con 0x7f45281d8120 2026-02-12T18:11:03.972 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.969+0000 7f452d52d640 1 -- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f45281d8120 msgr2=0x7f45281d8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:11:03.972 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.969+0000 7f452d52d640 1 --2- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f45281d8120 0x7f45281d8520 secure :-1 s=READY pgs=64 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f451c003900 tx=0x7f451c003870 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:03.972 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.970+0000 7f45167fc640 1 -- 10.20.193.48:0/26796219 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f451c025070 con 0x7f45281d8120 2026-02-12T18:11:03.972 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.970+0000 7f45167fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:03.972 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.970+0000 7f45167fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:11:03.972 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.970+0000 7f45167fc640 10 monclient: dump: 2026-02-12T18:11:03.972 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:03.972 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:03.972 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:03.973 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:03.973 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:03.973 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:03.973 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:03.973 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:03.973 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:03.973 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:03.973 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:03.973 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:03.973 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:03.973 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:03.973 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:03.973 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:03.974 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.970+0000 7f45167fc640 1 -- 10.20.193.48:0/26796219 <== mon.4 v2:10.20.193.48:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9970 (secure 0 0 0) 0x7f451c006050 con 0x7f45281d8120 2026-02-12T18:11:03.974 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.970+0000 7f45167fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:11:03.974 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.970+0000 7f45167fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:11:03.974 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.970+0000 7f45167fc640 1 -- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f45281d8120 msgr2=0x7f45281d8520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:03.974 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.970+0000 7f45167fc640 1 --2- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f45281d8120 0x7f45281d8520 secure :-1 s=READY pgs=64 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f451c003900 tx=0x7f451c003870 comp rx=0 tx=0).stop 2026-02-12T18:11:03.974 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.970+0000 7f45167fc640 1 -- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f45281d8120 msgr2=0x7f45281d8520 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:11:03.974 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.970+0000 7f45167fc640 1 --2- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f45281d8120 0x7f45281d8520 secure :-1 s=CLOSED pgs=64 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f451c003900 tx=0x7f451c003870 comp rx=0 tx=0).stop 2026-02-12T18:11:03.974 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:11:03.975 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:11:03.975 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:11:03.975 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:11:03.975 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 54, 2026-02-12T18:11:03.975 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 44757, 2026-02-12T18:11:03.975 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:11:03.975 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:11:03.975 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:11:03.975 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:11:03.975 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:11:03.975 INFO:teuthology.orchestra.run.trial048.stdout: 6 2026-02-12T18:11:03.976 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:11:03.976 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 4, 2026-02-12T18:11:03.976 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:11:03.976 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:11:03.976 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:11:03.976 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:11:03.976 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:11:03.976 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:11:03.976 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:11:03.976 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:11:03.976 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:11:03.976 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:11:03.977 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:11:03.977 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:11:03.977 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:11:03.977 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:11:03.977 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:11:03.977 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:11:03.977 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:11:03.977 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:11:03.977 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:11:03.977 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:11:03.977 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:11:03.977 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:11:03.978 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:11:03.978 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:11:03.978 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:11:03.978 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:11:03.978 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:11:03.978 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:11:03.978 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:11:03.978 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:11:03.978 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:11:03.978 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:11:03.978 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:03.978 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.978 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:11:03.979 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:11:03.979 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:11:03.979 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:11:03.979 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:11:03.979 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:11:03.979 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:11:03.979 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:11:03.979 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:11:03.979 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:11:03.979 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:11:03.979 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:11:03.979 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:11:03.980 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:11:03.980 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:11:03.980 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:11:03.980 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:11:03.980 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:11:03.980 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:11:03.980 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:11:03.980 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:11:03.980 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:11:03.980 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:11:03.980 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:11:03.980 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:11:03.980 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:11:03.981 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:11:03.981 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:11:03.981 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:11:03.981 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:11:03.981 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:11:03.981 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:11:03.981 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.981 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:11:03.981 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.981 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:11:03.981 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:11:03.981 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:03.982 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:03.982 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.982 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:03.982 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:11:03.982 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.982 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.982 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.982 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:03.982 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:11:03.982 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.982 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:03.982 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:03.982 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.983 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:11:03.983 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:11:03.983 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:03.983 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:03.983 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:11:03.983 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:03.983 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.983 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.983 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:11:03.983 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:11:03.983 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:03.983 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:03.983 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.984 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:03.984 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:11:03.984 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.984 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.984 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.984 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:03.984 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:11:03.984 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.984 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:03.984 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:03.984 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.984 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:11:03.984 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:11:03.985 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:03.985 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:03.985 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:11:03.985 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:03.985 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.985 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.985 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:11:03.985 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:11:03.985 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:03.985 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:03.985 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.985 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:03.986 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:11:03.986 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.986 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.986 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.986 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:03.986 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:11:03.986 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.986 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:03.986 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:03.986 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.986 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:11:03.986 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:11:03.986 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:03.987 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:03.987 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:11:03.987 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:03.987 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.987 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.987 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:11:03.987 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:11:03.987 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:03.987 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:03.987 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.987 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:03.987 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:11:03.988 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.988 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.988 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.988 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:03.988 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:11:03.988 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.988 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:03.988 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:03.988 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.988 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:11:03.988 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:11:03.988 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:03.988 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:03.989 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:11:03.989 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:03.989 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.989 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.989 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:11:03.989 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:11:03.989 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:03.989 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:03.989 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.989 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:03.989 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:11:03.989 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.989 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.990 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.990 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:03.990 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:11:03.990 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.990 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:03.990 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:03.990 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.990 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:11:03.990 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:11:03.990 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:03.990 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:03.990 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:11:03.991 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:03.991 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.991 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.991 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:11:03.991 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:11:03.991 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:03.991 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:03.991 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.991 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:03.991 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:11:03.991 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.991 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.991 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.992 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:03.992 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:11:03.992 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.992 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:03.992 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:03.992 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.992 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:11:03.992 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:11:03.992 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:03.992 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:03.992 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:11:03.992 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:03.993 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.993 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.993 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:11:03.993 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:11:03.993 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:03.993 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:03.993 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.993 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:03.993 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:11:03.993 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.993 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.993 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.993 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:03.994 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:11:03.994 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.994 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:03.994 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:03.994 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.994 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:11:03.994 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:11:03.994 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:03.994 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:03.994 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:11:03.994 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:03.994 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.994 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.995 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:11:03.995 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:11:03.995 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:03.995 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:03.995 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.995 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:03.995 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:11:03.995 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.995 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.995 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.995 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:03.995 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:11:03.996 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.996 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:03.996 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:03.996 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.996 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:11:03.996 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:11:03.996 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:03.996 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:03.996 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:11:03.996 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:03.996 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.996 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.997 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:11:03.997 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:11:03.997 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:03.997 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:03.997 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.997 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:03.997 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:11:03.997 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.997 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.997 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.997 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:03.997 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:11:03.997 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:03.997 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:03.998 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:03.998 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.998 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:11:03.998 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:11:03.998 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:03.998 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:03.998 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:11:03.998 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:03.998 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:03.998 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:03.998 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.998 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:11:03.998 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:11:03.998 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.999 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:11:03.999 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:11:03.999 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:11:03.999 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:03.999 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:11:03.999 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:11:03.999 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:03.999 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:11:03.999 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:11:03.999 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:11:03.999 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:03.999 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:03.999 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:03.999 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:11:04.000 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:11:04.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.970+0000 7f452ffb9640 1 -- 10.20.193.48:0/26796219 >> v2:10.20.193.111:6812/977811348 conn(0x7f44f803f7c0 msgr2=0x7f44f805fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:04.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.970+0000 7f452ffb9640 1 --2- 10.20.193.48:0/26796219 >> v2:10.20.193.111:6812/977811348 conn(0x7f44f803f7c0 0x7f44f805fc70 secure :-1 s=READY pgs=314 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4524030fd0 tx=0x7f4524034000 comp rx=0 tx=0).stop 2026-02-12T18:11:04.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.970+0000 7f452ffb9640 10 monclient: shutdown 2026-02-12T18:11:04.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.970+0000 7f452ffb9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:11:04.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.970+0000 7f452ffb9640 1 -- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f452805e4b0 msgr2=0x7f45281b0ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:04.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.970+0000 7f452ffb9640 1 --2- 10.20.193.48:0/26796219 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f452805e4b0 0x7f45281b0ec0 secure :-1 s=READY pgs=263 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4518007fd0 tx=0x7f451800c970 comp rx=0 tx=0).stop 2026-02-12T18:11:04.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.970+0000 7f452e52f640 1 -- 10.20.193.48:0/26796219 reap_dead start 2026-02-12T18:11:04.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.970+0000 7f452e52f640 1 -- 10.20.193.48:0/26796219 reap_dead start 2026-02-12T18:11:04.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.970+0000 7f452ffb9640 1 -- 10.20.193.48:0/26796219 shutdown_connections 2026-02-12T18:11:04.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.970+0000 7f452ffb9640 1 -- 10.20.193.48:0/26796219 >> 10.20.193.48:0/26796219 conn(0x7f45280548a0 msgr2=0x7f452808f900 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:11:04.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.970+0000 7f452ffb9640 1 -- 10.20.193.48:0/26796219 shutdown_connections 2026-02-12T18:11:04.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:03.970+0000 7f452ffb9640 1 -- 10.20.193.48:0/26796219 wait complete. 2026-02-12T18:11:04.002 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2026-02-12T18:11:04.003 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon d 2026-02-12T18:11:04.003 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2026-02-12T18:11:04.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.067+0000 7fc5ba3dd640 10 monclient: get_monmap_and_config 2026-02-12T18:11:04.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.067+0000 7fc5ba3dd640 10 monclient: build_initial_monmap 2026-02-12T18:11:04.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.067+0000 7fc5ba3dd640 10 monclient: monmap: 2026-02-12T18:11:04.072 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:11:04.072 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:04.072 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:11:04.068775+0000 2026-02-12T18:11:04.072 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:11:04.068775+0000 2026-02-12T18:11:04.073 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:11:04.073 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:04.073 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:11:04.073 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:11:04.073 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:11:04.073 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:11:04.073 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:11:04.073 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:11:04.073 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:11:04.073 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:11:04.073 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:11:04.074 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:11:04.074 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:11:04.074 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:04.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5ba3dd640 1 Processor -- start 2026-02-12T18:11:04.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5ba3dd640 1 -- start start 2026-02-12T18:11:04.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5ba3dd640 10 monclient: init 2026-02-12T18:11:04.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5ba3dd640 10 monclient: _reopen_session rank -1 2026-02-12T18:11:04.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5ba3dd640 10 monclient: _add_conns ranks=[2,9,3,7,6,5,1,8,10,0,4] 2026-02-12T18:11:04.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5ba3dd640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc5b405d550 0x7fc5b405d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:04.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5ba3dd640 10 monclient(hunting): picked mon.noname-b con 0x7fc5b405d550 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:11:04.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5ba3dd640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fc5b405de60 0x7fc5b4141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:04.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5ba3dd640 10 monclient(hunting): picked mon.noname-a con 0x7fc5b405de60 addr v2:10.20.193.48:3300/0 2026-02-12T18:11:04.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5ba3dd640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc5b413ef60 0x7fc5b41424e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:04.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5ba3dd640 10 monclient(hunting): picked mon.noname-g con 0x7fc5b413ef60 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:11:04.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5ba3dd640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:04.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5ba3dd640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7fc5b408d390 con 0x7fc5b405de60 2026-02-12T18:11:04.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5ba3dd640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:04.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5ba3dd640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fc5b408d5a0 con 0x7fc5b405d550 2026-02-12T18:11:04.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5ba3dd640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:04.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5ba3dd640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fc5b40580e0 con 0x7fc5b413ef60 2026-02-12T18:11:04.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5ba3dd640 10 monclient(hunting): _renew_subs 2026-02-12T18:11:04.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5ba3dd640 10 monclient(hunting): authenticate will time out at 902.794485s 2026-02-12T18:11:04.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b37fe640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fc5b405de60 0x7fc5b4141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:04.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b3fff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc5b405d550 0x7fc5b405d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:04.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b37fe640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fc5b405de60 0x7fc5b4141fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:42066/0 (socket says 10.20.193.48:42066) 2026-02-12T18:11:04.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b37fe640 1 -- 10.20.193.48:0/2620456840 learned_addr learned my addr 10.20.193.48:0/2620456840 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:11:04.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b37fe640 10 monclient(hunting): get_auth_request con 0x7fc5b405de60 auth_method 0 2026-02-12T18:11:04.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:04.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:04.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:11:04.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b3fff640 10 monclient(hunting): get_auth_request con 0x7fc5b405d550 auth_method 0 2026-02-12T18:11:04.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:04.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:04.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:11:04.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b8953640 1 --2- 10.20.193.48:0/2620456840 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc5b413ef60 0x7fc5b41424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:04.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:11:04.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:11:04.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:11:04.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:11:04.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:11:04.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:11:04.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b8953640 10 monclient(hunting): get_auth_request con 0x7fc5b413ef60 auth_method 0 2026-02-12T18:11:04.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b8953640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:04.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b8953640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:04.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b8953640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:11:04.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b3fff640 10 monclient(hunting): handle_auth_done global_id 35795 payload 274 2026-02-12T18:11:04.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b3fff640 1 -- 10.20.193.48:0/2620456840 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc5b413ef60 msgr2=0x7fc5b41424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:11:04.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b3fff640 1 --2- 10.20.193.48:0/2620456840 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc5b413ef60 0x7fc5b41424e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:04.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b3fff640 1 -- 10.20.193.48:0/2620456840 >> v2:10.20.193.48:3300/0 conn(0x7fc5b405de60 msgr2=0x7fc5b4141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:11:04.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b3fff640 1 --2- 10.20.193.48:0/2620456840 >> v2:10.20.193.48:3300/0 conn(0x7fc5b405de60 0x7fc5b4141fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:04.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b3fff640 10 monclient: _finish_hunting 0 2026-02-12T18:11:04.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b3fff640 1 monclient: found mon.noname-b 2026-02-12T18:11:04.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:11:04.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b3fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:11:04.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b3fff640 1 -- 10.20.193.48:0/2620456840 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5b404dc20 con 0x7fc5b405d550 2026-02-12T18:11:04.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.068+0000 7fc5b37fe640 1 --2- 10.20.193.48:0/2620456840 >> v2:10.20.193.48:3300/0 conn(0x7fc5b405de60 0x7fc5b4141fa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:11:04.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5b3fff640 1 -- 10.20.193.48:0/2620456840 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc5b405d550 msgr2=0x7fc5b405d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:11:04.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5b3fff640 1 --2- 10.20.193.48:0/2620456840 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc5b405d550 0x7fc5b405d920 secure :-1 s=READY pgs=264 gs=1 cs=0 l=1 c_cookie=6978686697679457465 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5a0004740 tx=0x7fc5a002ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=60d94693aded8cb9 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:04.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5b2ffd640 1 -- 10.20.193.48:0/2620456840 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc5a002fe70 con 0x7fc5b405d550 2026-02-12T18:11:04.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:04.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5b2ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:11:04.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5b2ffd640 10 monclient: dump: 2026-02-12T18:11:04.088 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:04.088 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:04.088 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:04.088 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:04.089 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:04.089 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:04.089 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:04.089 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:04.089 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:04.089 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:04.089 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:04.089 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:04.089 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:04.089 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:04.089 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:04.089 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:04.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5b2ffd640 10 monclient: _finish_auth 0 2026-02-12T18:11:04.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5b2ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:11:04.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5b2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:11:04.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5b2ffd640 1 -- 10.20.193.48:0/2620456840 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5a0035340 con 0x7fc5b405d550 2026-02-12T18:11:04.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5b2ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:11:04.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5ba3dd640 5 monclient: authenticate success, global_id 35795 2026-02-12T18:11:04.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5b2ffd640 1 -- 10.20.193.48:0/2620456840 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc5a0035970 con 0x7fc5b405d550 2026-02-12T18:11:04.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:04.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5b2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:11:04.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5b2ffd640 10 monclient: dump: 2026-02-12T18:11:04.090 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:04.090 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:04.091 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:04.091 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:04.091 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:04.091 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:04.091 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:04.091 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:04.091 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:04.091 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:04.091 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:04.091 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:04.091 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:04.091 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:04.091 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:04.092 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:04.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5ba3dd640 10 monclient: get_monmap_and_config success 2026-02-12T18:11:04.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5ba3dd640 4 set_mon_vals no callback set 2026-02-12T18:11:04.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5ba3dd640 10 monclient: shutdown 2026-02-12T18:11:04.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5ba3dd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:11:04.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5ba3dd640 1 -- 10.20.193.48:0/2620456840 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc5b405d550 msgr2=0x7fc5b405d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:04.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5ba3dd640 1 --2- 10.20.193.48:0/2620456840 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc5b405d550 0x7fc5b405d920 secure :-1 s=READY pgs=264 gs=1 cs=0 l=1 c_cookie=6978686697679457465 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5a0004740 tx=0x7fc5a002ed30 comp rx=0 tx=0).stop 2026-02-12T18:11:04.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5ba3dd640 1 -- 10.20.193.48:0/2620456840 shutdown_connections 2026-02-12T18:11:04.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5ba3dd640 1 --2- 10.20.193.48:0/2620456840 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc5b413ef60 0x7fc5b41424e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:04.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5ba3dd640 1 --2- 10.20.193.48:0/2620456840 >> v2:10.20.193.48:3300/0 conn(0x7fc5b405de60 0x7fc5b4141fa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:04.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5ba3dd640 1 --2- 10.20.193.48:0/2620456840 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc5b405d550 0x7fc5b405d920 unknown :-1 s=CLOSED pgs=264 gs=1 cs=0 l=1 c_cookie=6978686697679457465 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:04.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5ba3dd640 1 -- 10.20.193.48:0/2620456840 >> 10.20.193.48:0/2620456840 conn(0x7fc5b40546a0 msgr2=0x7fc5b4054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:11:04.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5ba3dd640 1 -- 10.20.193.48:0/2620456840 shutdown_connections 2026-02-12T18:11:04.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.071+0000 7fc5ba3dd640 1 -- 10.20.193.48:0/2620456840 wait complete. 2026-02-12T18:11:04.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.072+0000 7fc5ba3dd640 10 monclient: build_initial_monmap 2026-02-12T18:11:04.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.072+0000 7fc5ba3dd640 10 monclient: monmap: 2026-02-12T18:11:04.093 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:11:04.093 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:11:04.093 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:11:04.093 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:11:04.093 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:11:04.093 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:04.093 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:11:04.093 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:11:04.094 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:11:04.094 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:11:04.094 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:11:04.094 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:11:04.094 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:11:04.094 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:11:04.094 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:11:04.094 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:04.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.072+0000 7fc5ba3dd640 1 Processor -- start 2026-02-12T18:11:04.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.072+0000 7fc5ba3dd640 1 -- start start 2026-02-12T18:11:04.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.072+0000 7fc5ba3dd640 10 monclient: init 2026-02-12T18:11:04.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.072+0000 7fc5ba3dd640 10 monclient: _reopen_session rank -1 2026-02-12T18:11:04.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.072+0000 7fc5ba3dd640 10 monclient: _add_conns ranks=[6,8,7,3,1,5,4,0,2] 2026-02-12T18:11:04.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.072+0000 7fc5ba3dd640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc5b405d550 0x7fc5b412f440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:04.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.072+0000 7fc5ba3dd640 10 monclient(hunting): picked mon.noname-d con 0x7fc5b405d550 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:11:04.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.072+0000 7fc5ba3dd640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fc5b405de60 0x7fc5b411c890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:04.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.072+0000 7fc5ba3dd640 10 monclient(hunting): picked mon.noname-e con 0x7fc5b405de60 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:11:04.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.072+0000 7fc5ba3dd640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fc5b413ef60 0x7fc5b411cdd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:04.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.072+0000 7fc5ba3dd640 10 monclient(hunting): picked mon.noname-i con 0x7fc5b413ef60 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:11:04.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.072+0000 7fc5ba3dd640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:04.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.072+0000 7fc5ba3dd640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fc5b413c540 con 0x7fc5b405d550 2026-02-12T18:11:04.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.072+0000 7fc5ba3dd640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:04.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.072+0000 7fc5ba3dd640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fc5b408baa0 con 0x7fc5b413ef60 2026-02-12T18:11:04.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.072+0000 7fc5ba3dd640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:04.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.072+0000 7fc5ba3dd640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fc5b41303a0 con 0x7fc5b405de60 2026-02-12T18:11:04.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.072+0000 7fc5ba3dd640 10 monclient(hunting): _renew_subs 2026-02-12T18:11:04.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.072+0000 7fc5ba3dd640 10 monclient(hunting): authenticate will time out at 902.798926s 2026-02-12T18:11:04.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.072+0000 7fc5b37fe640 1 -- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fc5b405de60 msgr2=0x7fc5b411c890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.48:3304/0 2026-02-12T18:11:04.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.072+0000 7fc5b37fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fc5b405de60 0x7fc5b411c890 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:11:04.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.072+0000 7fc5b3fff640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc5b405d550 0x7fc5b412f440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:04.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.072+0000 7fc5b8953640 1 -- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fc5b413ef60 msgr2=0x7fc5b411cdd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3303/0 2026-02-12T18:11:04.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.073+0000 7fc5b8953640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fc5b413ef60 0x7fc5b411cdd0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:11:04.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.073+0000 7fc5b3fff640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc5b405d550 0x7fc5b412f440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:34726/0 (socket says 10.20.193.48:34726) 2026-02-12T18:11:04.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.073+0000 7fc5b3fff640 1 -- 10.20.193.48:0/2856852074 learned_addr learned my addr 10.20.193.48:0/2856852074 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:11:04.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.073+0000 7fc5b3fff640 10 monclient(hunting): get_auth_request con 0x7fc5b405d550 auth_method 0 2026-02-12T18:11:04.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.073+0000 7fc5b3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:04.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.073+0000 7fc5b3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:04.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.073+0000 7fc5b3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:11:04.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.073+0000 7fc5b3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:11:04.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.073+0000 7fc5b3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:11:04.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.073+0000 7fc5b3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:11:04.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.073+0000 7fc5b3fff640 10 monclient(hunting): handle_auth_done global_id 5685 payload 824 2026-02-12T18:11:04.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.073+0000 7fc5b3fff640 1 -- 10.20.193.48:0/2856852074 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fc5b405de60 msgr2=0x7fc5b411c890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:11:04.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.073+0000 7fc5b3fff640 1 --2- 10.20.193.48:0/2856852074 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fc5b405de60 0x7fc5b411c890 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:04.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.073+0000 7fc5b3fff640 1 -- 10.20.193.48:0/2856852074 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fc5b413ef60 msgr2=0x7fc5b411cdd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:11:04.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.073+0000 7fc5b3fff640 1 --2- 10.20.193.48:0/2856852074 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fc5b413ef60 0x7fc5b411cdd0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:04.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.073+0000 7fc5b3fff640 10 monclient: _finish_hunting 0 2026-02-12T18:11:04.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.073+0000 7fc5b3fff640 1 monclient: found mon.noname-d 2026-02-12T18:11:04.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.073+0000 7fc5b3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:11:04.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.073+0000 7fc5b3fff640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:11:04.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.073+0000 7fc5b3fff640 1 -- 10.20.193.48:0/2856852074 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a40094f0 con 0x7fc5b405d550 2026-02-12T18:11:04.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.075+0000 7fc5b3fff640 1 -- 10.20.193.48:0/2856852074 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc5b405d550 msgr2=0x7fc5b412f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:11:04.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.075+0000 7fc5b3fff640 1 --2- 10.20.193.48:0/2856852074 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc5b405d550 0x7fc5b412f440 secure :-1 s=READY pgs=233 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5a002f240 tx=0x7fc5a00047e0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:04.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.075+0000 7fc5b0ff9640 1 -- 10.20.193.48:0/2856852074 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc5a00044f0 con 0x7fc5b405d550 2026-02-12T18:11:04.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.075+0000 7fc5b0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:04.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.075+0000 7fc5b0ff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:11:04.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.075+0000 7fc5b0ff9640 10 monclient: dump: 2026-02-12T18:11:04.098 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:04.098 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:04.098 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:04.098 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:04.098 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:04.099 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:04.099 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:04.099 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:04.099 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:04.099 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:04.099 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:04.099 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:04.099 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:04.099 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:04.099 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:04.099 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:04.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.075+0000 7fc5b0ff9640 10 monclient: _finish_auth 0 2026-02-12T18:11:04.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.075+0000 7fc5b0ff9640 10 monclient: _check_auth_tickets 2026-02-12T18:11:04.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.075+0000 7fc5b0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:11:04.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.075+0000 7fc5b0ff9640 1 -- 10.20.193.48:0/2856852074 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5a0035d40 con 0x7fc5b405d550 2026-02-12T18:11:04.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.075+0000 7fc5b0ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:11:04.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.075+0000 7fc5b0ff9640 1 -- 10.20.193.48:0/2856852074 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc5a0003b90 con 0x7fc5b405d550 2026-02-12T18:11:04.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.075+0000 7fc5b0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:04.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.075+0000 7fc5b27fc640 4 set_mon_vals no callback set 2026-02-12T18:11:04.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.075+0000 7fc5b0ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:11:04.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.075+0000 7fc5b0ff9640 10 monclient: dump: 2026-02-12T18:11:04.100 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:04.100 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:04.100 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:04.100 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:04.100 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:04.100 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:04.101 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:04.101 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:04.101 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:04.101 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:04.101 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:04.101 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:04.101 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:04.101 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:04.101 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:04.101 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:04.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.075+0000 7fc5ba3dd640 5 monclient: authenticate success, global_id 5685 2026-02-12T18:11:04.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.075+0000 7fc5ba3dd640 10 monclient: _renew_subs 2026-02-12T18:11:04.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.075+0000 7fc5ba3dd640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:11:04.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.075+0000 7fc5ba3dd640 1 -- 10.20.193.48:0/2856852074 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5a0009420 con 0x7fc5b405d550 2026-02-12T18:11:04.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.075+0000 7fc5ba3dd640 10 monclient: _renew_subs 2026-02-12T18:11:04.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.075+0000 7fc5ba3dd640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:11:04.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.075+0000 7fc5ba3dd640 1 -- 10.20.193.48:0/2856852074 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5b4130960 con 0x7fc5b405d550 2026-02-12T18:11:04.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.076+0000 7fc5ba3dd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:11:04.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.076+0000 7fc5ba3dd640 1 --2- 10.20.193.48:0/2856852074 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc5b4091010 0x7fc5b411d310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:04.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.076+0000 7fc5ba3dd640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:04.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.076+0000 7fc5ba3dd640 1 -- 10.20.193.48:0/2856852074 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fc5b405f140 con 0x7fc5b4091010 2026-02-12T18:11:04.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.076+0000 7fc5b37fe640 1 --2- 10.20.193.48:0/2856852074 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc5b4091010 0x7fc5b411d310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:04.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.076+0000 7fc5b0ff9640 1 -- 10.20.193.48:0/2856852074 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fc5a0048020 con 0x7fc5b405d550 2026-02-12T18:11:04.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.076+0000 7fc5b37fe640 10 monclient: get_auth_request con 0x7fc5b4091010 auth_method 0 2026-02-12T18:11:04.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.076+0000 7fc5b37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:04.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.076+0000 7fc5b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:04.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.076+0000 7fc5b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:11:04.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.076+0000 7fc5b37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:11:04.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.076+0000 7fc5b37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:11:04.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.076+0000 7fc5b37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:11:04.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.076+0000 7fc5b0ff9640 1 --2- 10.20.193.48:0/2856852074 >> v2:10.20.193.111:6812/977811348 conn(0x7fc58403f780 0x7fc58405fc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:04.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.076+0000 7fc5b0ff9640 1 -- 10.20.193.48:0/2856852074 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(215..215 src has 190..215) ==== 3503+0+0 (secure 0 0 0) 0x7fc5a0077be0 con 0x7fc5b405d550 2026-02-12T18:11:04.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.076+0000 7fc5b37fe640 10 monclient(hunting): handle_auth_done global_id 5694 payload 824 2026-02-12T18:11:04.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.076+0000 7fc5b37fe640 1 -- 10.20.193.48:0/2856852074 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc5b405e310 con 0x7fc5b4091010 2026-02-12T18:11:04.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.076+0000 7fc5b8953640 1 --2- 10.20.193.48:0/2856852074 >> v2:10.20.193.111:6812/977811348 conn(0x7fc58403f780 0x7fc58405fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:04.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.076+0000 7fc5b8953640 10 monclient: get_auth_request con 0x7fc58403f780 auth_method 0 2026-02-12T18:11:04.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.078+0000 7fc5b37fe640 1 -- 10.20.193.48:0/2856852074 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc5b4091010 msgr2=0x7fc5b411d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:11:04.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.078+0000 7fc5b37fe640 1 --2- 10.20.193.48:0/2856852074 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc5b4091010 0x7fc5b411d310 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5a4004740 tx=0x7fc5a400ef80 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:04.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.078+0000 7fc5b0ff9640 1 -- 10.20.193.48:0/2856852074 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc5a400cc70 con 0x7fc5b4091010 2026-02-12T18:11:04.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.078+0000 7fc5b0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:04.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.078+0000 7fc5b0ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:11:04.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.078+0000 7fc5b0ff9640 10 monclient: dump: 2026-02-12T18:11:04.103 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:04.103 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:04.104 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:04.104 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:04.104 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:04.104 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:04.104 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:04.104 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:04.104 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:04.104 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:04.104 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:04.104 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:04.104 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:04.104 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:04.104 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:04.104 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:04.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.079+0000 7fc5b0ff9640 1 -- 10.20.193.48:0/2856852074 <== mon.6 v2:10.20.193.48:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fc5a400cdd0 con 0x7fc5b4091010 2026-02-12T18:11:04.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.079+0000 7fc5b0ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:11:04.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.079+0000 7fc5b0ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:11:04.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.079+0000 7fc5b0ff9640 1 -- 10.20.193.48:0/2856852074 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc5b4091010 msgr2=0x7fc5b411d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:04.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.079+0000 7fc5b0ff9640 1 --2- 10.20.193.48:0/2856852074 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc5b4091010 0x7fc5b411d310 secure :-1 s=READY pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5a4004740 tx=0x7fc5a400ef80 comp rx=0 tx=0).stop 2026-02-12T18:11:04.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.079+0000 7fc5b0ff9640 1 -- 10.20.193.48:0/2856852074 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc5b4091010 msgr2=0x7fc5b411d310 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:11:04.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.079+0000 7fc5b0ff9640 1 --2- 10.20.193.48:0/2856852074 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc5b4091010 0x7fc5b411d310 secure :-1 s=CLOSED pgs=234 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5a4004740 tx=0x7fc5a400ef80 comp rx=0 tx=0).stop 2026-02-12T18:11:04.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.079+0000 7fc5b8953640 1 --2- 10.20.193.48:0/2856852074 >> v2:10.20.193.111:6812/977811348 conn(0x7fc58403f780 0x7fc58405fc30 secure :-1 s=READY pgs=315 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5a8005820 tx=0x7fc5a8009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:04.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.082+0000 7fc5ba3dd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:11:04.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.082+0000 7fc5ba3dd640 1 --2- 10.20.193.48:0/2856852074 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc5b412d740 0x7fc5b4127b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:04.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.082+0000 7fc5ba3dd640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:04.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.082+0000 7fc5ba3dd640 1 -- 10.20.193.48:0/2856852074 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fc5b405fd90 con 0x7fc5b412d740 2026-02-12T18:11:04.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.082+0000 7fc5b37fe640 1 --2- 10.20.193.48:0/2856852074 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc5b412d740 0x7fc5b4127b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:04.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.082+0000 7fc5b37fe640 10 monclient: get_auth_request con 0x7fc5b412d740 auth_method 0 2026-02-12T18:11:04.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.082+0000 7fc5b37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:04.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.082+0000 7fc5b37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:04.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.082+0000 7fc5b37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:11:04.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.082+0000 7fc5b37fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:11:04.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.082+0000 7fc5b37fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:11:04.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.082+0000 7fc5b37fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:11:04.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.082+0000 7fc5b37fe640 10 monclient(hunting): handle_auth_done global_id 5703 payload 824 2026-02-12T18:11:04.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.082+0000 7fc5b37fe640 1 -- 10.20.193.48:0/2856852074 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc5b4057e00 con 0x7fc5b412d740 2026-02-12T18:11:04.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.085+0000 7fc5b37fe640 1 -- 10.20.193.48:0/2856852074 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc5b412d740 msgr2=0x7fc5b4127b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:11:04.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.085+0000 7fc5b37fe640 1 --2- 10.20.193.48:0/2856852074 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc5b412d740 0x7fc5b4127b50 secure :-1 s=READY pgs=235 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5a400cfd0 tx=0x7fc5a40047e0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:04.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.085+0000 7fc5b0ff9640 1 -- 10.20.193.48:0/2856852074 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc5a4023070 con 0x7fc5b412d740 2026-02-12T18:11:04.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.085+0000 7fc5b0ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:04.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.085+0000 7fc5b0ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:11:04.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.085+0000 7fc5b0ff9640 10 monclient: dump: 2026-02-12T18:11:04.106 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:04.106 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:04.106 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:04.106 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:04.106 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:04.107 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:04.107 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:04.107 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:04.107 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:04.107 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:04.107 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:04.107 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:04.107 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:04.107 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:04.107 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:04.107 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:04.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.085+0000 7fc5b0ff9640 1 -- 10.20.193.48:0/2856852074 <== mon.6 v2:10.20.193.48:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10305 (secure 0 0 0) 0x7fc5a4013680 con 0x7fc5b412d740 2026-02-12T18:11:04.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.085+0000 7fc5b0ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:11:04.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.085+0000 7fc5b0ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:11:04.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.085+0000 7fc5b0ff9640 1 -- 10.20.193.48:0/2856852074 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc5b412d740 msgr2=0x7fc5b4127b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:04.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.085+0000 7fc5b0ff9640 1 --2- 10.20.193.48:0/2856852074 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc5b412d740 0x7fc5b4127b50 secure :-1 s=READY pgs=235 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5a400cfd0 tx=0x7fc5a40047e0 comp rx=0 tx=0).stop 2026-02-12T18:11:04.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.085+0000 7fc5b0ff9640 1 -- 10.20.193.48:0/2856852074 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc5b412d740 msgr2=0x7fc5b4127b50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:11:04.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.085+0000 7fc5b0ff9640 1 --2- 10.20.193.48:0/2856852074 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc5b412d740 0x7fc5b4127b50 secure :-1 s=CLOSED pgs=235 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5a400cfd0 tx=0x7fc5a40047e0 comp rx=0 tx=0).stop 2026-02-12T18:11:04.108 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:11:04.108 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:11:04.108 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:11:04.108 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:11:04.108 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 54, 2026-02-12T18:11:04.108 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 318912, 2026-02-12T18:11:04.108 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:11:04.108 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:11:04.108 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:11:04.108 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:11:04.109 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:11:04.109 INFO:teuthology.orchestra.run.trial048.stdout: 6 2026-02-12T18:11:04.109 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:11:04.109 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 4, 2026-02-12T18:11:04.109 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:11:04.109 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:11:04.109 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:11:04.109 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:11:04.109 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:11:04.109 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:11:04.109 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:11:04.109 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:11:04.109 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:11:04.109 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:11:04.109 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:11:04.109 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:11:04.109 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:11:04.110 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:11:04.110 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:11:04.110 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:11:04.110 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:11:04.110 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:11:04.110 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:11:04.110 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:11:04.110 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:11:04.110 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:11:04.110 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:11:04.110 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:11:04.110 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:11:04.110 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:11:04.110 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:11:04.110 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:11:04.110 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:11:04.110 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:11:04.111 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:11:04.111 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:11:04.111 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:04.111 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.111 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:11:04.111 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:11:04.111 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:11:04.111 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:11:04.111 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:11:04.111 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:11:04.111 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:11:04.111 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:11:04.111 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:11:04.111 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:11:04.111 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:11:04.111 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:11:04.111 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:11:04.111 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:11:04.112 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:11:04.112 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:11:04.112 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:11:04.112 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:11:04.112 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:11:04.112 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:11:04.112 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:11:04.112 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:11:04.112 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:11:04.112 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:11:04.112 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:11:04.112 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:11:04.112 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:11:04.112 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:11:04.112 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:11:04.112 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:11:04.112 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:11:04.112 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:11:04.112 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.112 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:11:04.113 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.113 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:11:04.113 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:11:04.113 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:04.113 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:04.113 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.113 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:04.113 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:11:04.113 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.113 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.113 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.113 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:04.113 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:11:04.113 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.113 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.113 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:04.113 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.113 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:11:04.113 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:11:04.114 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:04.114 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:04.114 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:11:04.114 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:04.114 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.114 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.114 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:11:04.114 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:11:04.114 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:04.114 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:04.114 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.114 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:04.114 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:11:04.114 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.114 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.114 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.114 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:04.114 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:11:04.114 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.114 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.114 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:04.115 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.115 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:11:04.115 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:11:04.115 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:04.115 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:04.115 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:11:04.115 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:04.115 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.115 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.115 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:11:04.115 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:11:04.115 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:04.115 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:04.115 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.115 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:04.115 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:11:04.115 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.115 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.115 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.115 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:04.115 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:11:04.115 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.116 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.116 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:04.116 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.116 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:11:04.116 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:11:04.116 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:04.116 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:04.116 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:11:04.116 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:04.116 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.116 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.116 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:11:04.116 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:11:04.116 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:04.116 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:04.116 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.116 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:04.116 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:11:04.116 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.116 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.116 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.117 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:04.117 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:11:04.117 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.117 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.117 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:04.117 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.117 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:11:04.117 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:11:04.117 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:04.117 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:04.117 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:11:04.117 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:04.117 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.117 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.117 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:11:04.117 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:11:04.117 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:04.117 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:04.117 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.117 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:04.117 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:11:04.118 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.118 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.118 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.118 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:04.118 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:11:04.118 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.118 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.118 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:04.118 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.118 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:11:04.118 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:11:04.118 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:04.118 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:04.118 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:11:04.118 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:04.118 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.118 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.118 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:11:04.118 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:11:04.118 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:04.118 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:04.118 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.118 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:04.118 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:11:04.119 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.119 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.119 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.119 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:04.119 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:11:04.119 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.119 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.119 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:04.119 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.119 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:11:04.119 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:11:04.119 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:04.119 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:04.119 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:11:04.119 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:04.119 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.119 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.119 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:11:04.119 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:11:04.119 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:04.119 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:04.119 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.119 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:04.119 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:11:04.120 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.120 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.120 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.120 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:04.120 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:11:04.120 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.120 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.120 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:04.120 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.120 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:11:04.120 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:11:04.120 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:04.120 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:04.120 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:11:04.120 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:04.120 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.120 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.120 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:11:04.120 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:11:04.120 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:04.120 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:04.120 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.120 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:04.120 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:11:04.121 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.121 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.121 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.121 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:04.121 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:11:04.121 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.121 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.121 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:04.121 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.121 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:11:04.121 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:11:04.121 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:04.121 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:04.121 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:11:04.121 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:04.121 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.121 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.121 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:11:04.121 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:11:04.121 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:04.121 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:04.121 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.121 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:04.121 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:11:04.121 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.122 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.122 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.122 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:04.122 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:11:04.122 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.122 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.122 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:04.122 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.122 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:11:04.122 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:11:04.122 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:04.122 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:04.122 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:11:04.122 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:04.122 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.122 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:04.122 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.122 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:11:04.122 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:11:04.122 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.122 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:11:04.122 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:11:04.122 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:11:04.123 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.123 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:11:04.123 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:11:04.123 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.123 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:11:04.123 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:11:04.123 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:11:04.123 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.123 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:11:04.123 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:11:04.123 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.123 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:11:04.123 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:11:04.123 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:11:04.123 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.123 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:11:04.123 INFO:teuthology.orchestra.run.trial048.stdout: "mgr": [ 2026-02-12T18:11:04.123 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.123 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:11:04.123 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:11:04.123 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:11:04.123 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.123 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:04.123 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.123 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:11:04.123 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:11:04.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.085+0000 7fc5ba3dd640 1 -- 10.20.193.48:0/2856852074 >> v2:10.20.193.111:6812/977811348 conn(0x7fc58403f780 msgr2=0x7fc58405fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:04.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.085+0000 7fc5ba3dd640 1 --2- 10.20.193.48:0/2856852074 >> v2:10.20.193.111:6812/977811348 conn(0x7fc58403f780 0x7fc58405fc30 secure :-1 s=READY pgs=315 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5a8005820 tx=0x7fc5a8009040 comp rx=0 tx=0).stop 2026-02-12T18:11:04.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.085+0000 7fc5ba3dd640 10 monclient: shutdown 2026-02-12T18:11:04.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.085+0000 7fc5ba3dd640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:11:04.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.085+0000 7fc5ba3dd640 1 -- 10.20.193.48:0/2856852074 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc5b405d550 msgr2=0x7fc5b412f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:04.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.085+0000 7fc5ba3dd640 1 --2- 10.20.193.48:0/2856852074 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc5b405d550 0x7fc5b412f440 secure :-1 s=READY pgs=233 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5a002f240 tx=0x7fc5a00047e0 comp rx=0 tx=0).stop 2026-02-12T18:11:04.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.085+0000 7fc5b8953640 1 -- 10.20.193.48:0/2856852074 reap_dead start 2026-02-12T18:11:04.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.085+0000 7fc5b8953640 1 -- 10.20.193.48:0/2856852074 reap_dead start 2026-02-12T18:11:04.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.085+0000 7fc5ba3dd640 1 -- 10.20.193.48:0/2856852074 shutdown_connections 2026-02-12T18:11:04.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.085+0000 7fc5ba3dd640 1 -- 10.20.193.48:0/2856852074 >> 10.20.193.48:0/2856852074 conn(0x7fc5b40546a0 msgr2=0x7fc5b408c200 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:11:04.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.085+0000 7fc5ba3dd640 1 -- 10.20.193.48:0/2856852074 shutdown_connections 2026-02-12T18:11:04.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.085+0000 7fc5ba3dd640 1 -- 10.20.193.48:0/2856852074 wait complete. 2026-02-12T18:11:04.125 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2026-02-12T18:11:04.125 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon g 2026-02-12T18:11:04.125 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2026-02-12T18:11:04.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.192+0000 7f54d068c640 10 monclient: get_monmap_and_config 2026-02-12T18:11:04.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.192+0000 7f54d068c640 10 monclient: build_initial_monmap 2026-02-12T18:11:04.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.192+0000 7f54d068c640 10 monclient: monmap: 2026-02-12T18:11:04.193 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:11:04.193 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:04.194 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:11:04.193192+0000 2026-02-12T18:11:04.194 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:11:04.193192+0000 2026-02-12T18:11:04.194 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:11:04.194 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:04.194 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:11:04.194 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:11:04.194 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:11:04.194 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:11:04.194 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:11:04.194 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:11:04.194 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:11:04.194 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:11:04.194 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:11:04.194 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:11:04.194 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:11:04.194 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:04.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.192+0000 7f54d068c640 1 Processor -- start 2026-02-12T18:11:04.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.192+0000 7f54d068c640 1 -- start start 2026-02-12T18:11:04.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.192+0000 7f54d068c640 10 monclient: init 2026-02-12T18:11:04.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.192+0000 7f54d068c640 10 monclient: _reopen_session rank -1 2026-02-12T18:11:04.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.192+0000 7f54d068c640 10 monclient: _add_conns ranks=[5,0,6,7,1,10,2,3,4,9,8] 2026-02-12T18:11:04.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.192+0000 7f54d068c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f54c805c950 0x7f54c805cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:04.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.192+0000 7f54d068c640 10 monclient(hunting): picked mon.noname-h con 0x7f54c805c950 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:11:04.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.192+0000 7f54d068c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f54c805e490 addr v1:10.20.193.48:6789/0 2026-02-12T18:11:04.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.192+0000 7f54d068c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f54c805d260 0x7f54c813e280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:04.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.192+0000 7f54d068c640 10 monclient(hunting): picked mon.noname-d con 0x7f54c805d260 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:11:04.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.192+0000 7f54d068c640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54c804dc20 con 0x7f54c805e490 2026-02-12T18:11:04.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.192+0000 7f54d068c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:04.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.192+0000 7f54d068c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f54c805ddd0 con 0x7f54c805c950 2026-02-12T18:11:04.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.192+0000 7f54d068c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:04.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.192+0000 7f54d068c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f54c8092990 con 0x7f54c805d260 2026-02-12T18:11:04.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.192+0000 7f54d068c640 10 monclient(hunting): _renew_subs 2026-02-12T18:11:04.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.192+0000 7f54d068c640 10 monclient(hunting): authenticate will time out at 902.918919s 2026-02-12T18:11:04.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.192+0000 7f54ce401640 1 -- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f54c805c950 msgr2=0x7f54c805cd20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:11:04.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.192+0000 7f54ce401640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f54c805c950 0x7f54c805cd20 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:11:04.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.193+0000 7f54cdc00640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f54c805e490 0x7f54c813db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:58516/0 (socket says 10.20.193.48:58516) 2026-02-12T18:11:04.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.193+0000 7f54cdc00640 1 -- 10.20.193.48:0/3640026964 learned_addr learned my addr 10.20.193.48:0/3640026964 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:11:04.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.193+0000 7f54cec02640 1 --2- 10.20.193.48:0/3640026964 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f54c805d260 0x7f54c813e280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:04.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.193+0000 7f54cec02640 10 monclient(hunting): get_auth_request con 0x7f54c805d260 auth_method 0 2026-02-12T18:11:04.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.193+0000 7f54cec02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:04.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.193+0000 7f54cec02640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:04.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.193+0000 7f54cec02640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:11:04.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.193+0000 7f54cec02640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:11:04.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.193+0000 7f54cec02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:11:04.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.193+0000 7f54cec02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:11:04.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.193+0000 7f54cec02640 10 monclient(hunting): handle_auth_done global_id 5712 payload 274 2026-02-12T18:11:04.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.193+0000 7f54cec02640 1 -- 10.20.193.48:0/3640026964 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f54c805c950 msgr2=0x7f54c805cd20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:11:04.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.193+0000 7f54cec02640 1 --2- 10.20.193.48:0/3640026964 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f54c805c950 0x7f54c805cd20 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:04.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.193+0000 7f54cec02640 1 -- 10.20.193.48:0/3640026964 >> v1:10.20.193.48:6789/0 conn(0x7f54c805e490 legacy=0x7f54c813db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:11:04.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.193+0000 7f54cec02640 10 monclient: _finish_hunting 0 2026-02-12T18:11:04.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.193+0000 7f54cec02640 1 monclient: found mon.noname-d 2026-02-12T18:11:04.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.193+0000 7f54cec02640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:11:04.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.193+0000 7f54cec02640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:11:04.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.193+0000 7f54cec02640 1 -- 10.20.193.48:0/3640026964 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c8092c70 con 0x7f54c805d260 2026-02-12T18:11:04.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.195+0000 7f54cec02640 1 -- 10.20.193.48:0/3640026964 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f54c805d260 msgr2=0x7f54c813e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:11:04.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.195+0000 7f54cec02640 1 --2- 10.20.193.48:0/3640026964 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f54c805d260 0x7f54c813e280 secure :-1 s=READY pgs=236 gs=2 cs=0 l=1 c_cookie=3573868761588683316 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54c400a910 tx=0x7f54c402fdd0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=3198eeb4185bd234 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:04.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.195+0000 7f54cd3ff640 1 -- 10.20.193.48:0/3640026964 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f54c4036340 con 0x7f54c805d260 2026-02-12T18:11:04.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54cd3ff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:04.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54cd3ff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:11:04.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54cd3ff640 10 monclient: dump: 2026-02-12T18:11:04.204 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:04.204 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:04.205 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:04.205 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:04.205 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:04.205 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:04.205 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:04.205 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:04.205 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:04.205 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:04.205 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:04.205 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:04.205 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:04.205 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:04.205 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:04.205 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:04.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54cd3ff640 10 monclient: _finish_auth 0 2026-02-12T18:11:04.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54cd3ff640 10 monclient: _check_auth_tickets 2026-02-12T18:11:04.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54cd3ff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:11:04.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54d068c640 5 monclient: authenticate success, global_id 5712 2026-02-12T18:11:04.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54cd3ff640 1 -- 10.20.193.48:0/3640026964 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c40364c0 con 0x7f54c805d260 2026-02-12T18:11:04.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54d068c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:11:04.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54cd3ff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:11:04.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54cd3ff640 1 -- 10.20.193.48:0/3640026964 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f54c4036af0 con 0x7f54c805d260 2026-02-12T18:11:04.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54d068c640 10 monclient: get_monmap_and_config success 2026-02-12T18:11:04.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54d068c640 4 set_mon_vals no callback set 2026-02-12T18:11:04.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54cd3ff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:04.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54cd3ff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:11:04.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54cd3ff640 10 monclient: dump: 2026-02-12T18:11:04.206 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:04.206 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:04.206 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:04.206 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:04.206 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:04.206 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:04.206 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:04.206 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:04.206 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:04.206 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:04.206 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:04.207 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:04.207 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:04.207 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:04.207 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:04.207 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:04.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54d068c640 10 monclient: shutdown 2026-02-12T18:11:04.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54d068c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:11:04.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54d068c640 1 -- 10.20.193.48:0/3640026964 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f54c805d260 msgr2=0x7f54c813e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:04.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54d068c640 1 --2- 10.20.193.48:0/3640026964 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f54c805d260 0x7f54c813e280 secure :-1 s=READY pgs=236 gs=2 cs=0 l=1 c_cookie=3573868761588683316 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54c400a910 tx=0x7f54c402fdd0 comp rx=0 tx=0).stop 2026-02-12T18:11:04.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54d068c640 1 -- 10.20.193.48:0/3640026964 shutdown_connections 2026-02-12T18:11:04.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54d068c640 1 --2- 10.20.193.48:0/3640026964 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f54c805d260 0x7f54c813e280 unknown :-1 s=CLOSED pgs=236 gs=2 cs=0 l=1 c_cookie=3573868761588683316 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:04.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54d068c640 1 --2- 10.20.193.48:0/3640026964 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f54c805c950 0x7f54c805cd20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:04.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54d068c640 1 -- 10.20.193.48:0/3640026964 >> 10.20.193.48:0/3640026964 conn(0x7f54c80548a0 msgr2=0x7f54c8097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:11:04.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54d068c640 1 -- 10.20.193.48:0/3640026964 shutdown_connections 2026-02-12T18:11:04.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54d068c640 1 -- 10.20.193.48:0/3640026964 wait complete. 2026-02-12T18:11:04.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54d068c640 10 monclient: build_initial_monmap 2026-02-12T18:11:04.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.196+0000 7f54d068c640 10 monclient: monmap: 2026-02-12T18:11:04.207 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:11:04.207 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:11:04.208 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:11:04.208 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:11:04.208 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:11:04.208 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:04.208 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:11:04.208 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:11:04.208 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:11:04.208 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:11:04.208 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:11:04.208 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:11:04.208 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:11:04.208 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:11:04.208 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:11:04.208 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:04.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54d068c640 1 Processor -- start 2026-02-12T18:11:04.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54d068c640 1 -- start start 2026-02-12T18:11:04.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54d068c640 10 monclient: init 2026-02-12T18:11:04.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54d068c640 10 monclient: _reopen_session rank -1 2026-02-12T18:11:04.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54d068c640 10 monclient: _add_conns ranks=[5,7,3,2,6,8,4,1,0] 2026-02-12T18:11:04.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54d068c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f54c805c950 0x7f54c808d4d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:04.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54d068c640 10 monclient(hunting): picked mon.noname-h con 0x7f54c805c950 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:11:04.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54d068c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f54c805d260 0x7f54c812d950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:04.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54d068c640 10 monclient(hunting): picked mon.noname-i con 0x7f54c805d260 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:11:04.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54d068c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f54c805e490 0x7f54c812de90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:04.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54d068c640 10 monclient(hunting): picked mon.noname-g con 0x7f54c805e490 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:11:04.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54d068c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:04.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54d068c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f54c808bae0 con 0x7f54c805e490 2026-02-12T18:11:04.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54d068c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:04.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54d068c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f54c8143220 con 0x7f54c805c950 2026-02-12T18:11:04.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54d068c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:04.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54d068c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f54c8141b90 con 0x7f54c805d260 2026-02-12T18:11:04.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54d068c640 10 monclient(hunting): _renew_subs 2026-02-12T18:11:04.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54d068c640 10 monclient(hunting): authenticate will time out at 902.923345s 2026-02-12T18:11:04.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54ce401640 1 -- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f54c805c950 msgr2=0x7f54c808d4d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:11:04.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54ce401640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f54c805c950 0x7f54c808d4d0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:11:04.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54cdc00640 1 -- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f54c805d260 msgr2=0x7f54c812d950 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3303/0 2026-02-12T18:11:04.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54cdc00640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f54c805d260 0x7f54c812d950 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:11:04.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54cec02640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f54c805e490 0x7f54c812de90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:04.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54cec02640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f54c805e490 0x7f54c812de90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3301/0 says I am v2:10.20.193.48:59776/0 (socket says 10.20.193.48:59776) 2026-02-12T18:11:04.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54cec02640 1 -- 10.20.193.48:0/855120861 learned_addr learned my addr 10.20.193.48:0/855120861 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:11:04.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54cec02640 10 monclient(hunting): get_auth_request con 0x7f54c805e490 auth_method 0 2026-02-12T18:11:04.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54cec02640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:04.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54cec02640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:04.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54cec02640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:11:04.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54cec02640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:11:04.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54cec02640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:11:04.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54cec02640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:11:04.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54cec02640 10 monclient(hunting): handle_auth_done global_id 64263 payload 824 2026-02-12T18:11:04.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54cec02640 1 -- 10.20.193.48:0/855120861 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f54c805d260 msgr2=0x7f54c812d950 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:11:04.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54cec02640 1 --2- 10.20.193.48:0/855120861 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f54c805d260 0x7f54c812d950 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:04.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54cec02640 1 -- 10.20.193.48:0/855120861 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f54c805c950 msgr2=0x7f54c808d4d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:11:04.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54cec02640 1 --2- 10.20.193.48:0/855120861 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f54c805c950 0x7f54c808d4d0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:11:04.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54cec02640 10 monclient: _finish_hunting 0 2026-02-12T18:11:04.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54cec02640 1 monclient: found mon.noname-g 2026-02-12T18:11:04.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.197+0000 7f54cec02640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:11:04.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.198+0000 7f54cec02640 10 monclient: _send_mon_message to mon.noname-g at v2:10.20.193.111:3301/0 2026-02-12T18:11:04.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.198+0000 7f54cec02640 1 -- 10.20.193.48:0/855120861 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c400a500 con 0x7f54c805e490 2026-02-12T18:11:04.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.200+0000 7f54cec02640 1 -- 10.20.193.48:0/855120861 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f54c805e490 msgr2=0x7f54c812de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:11:04.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.200+0000 7f54cec02640 1 --2- 10.20.193.48:0/855120861 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f54c805e490 0x7f54c812de90 secure :-1 s=READY pgs=53 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54c400a830 tx=0x7f54c4005850 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:04.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.200+0000 7f54aeffd640 1 -- 10.20.193.48:0/855120861 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f54c40054f0 con 0x7f54c805e490 2026-02-12T18:11:04.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.200+0000 7f54aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:04.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.200+0000 7f54aeffd640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2026-02-12T18:11:04.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.200+0000 7f54aeffd640 10 monclient: dump: 2026-02-12T18:11:04.211 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:04.211 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:04.211 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:04.211 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:04.211 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:04.211 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:04.211 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:04.211 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:04.211 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:04.211 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:04.211 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:04.211 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:04.211 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:04.211 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:04.211 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:04.211 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:04.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.200+0000 7f54cec02640 1 --2- 10.20.193.48:0/855120861 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f54c805e490 0x7f54c812de90 secure :-1 s=READY pgs=53 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54c400a830 tx=0x7f54c4005850 comp rx=0 tx=0).queue_received will delay after 1.77092e+09 on 0x7f54c4004c70 mon_map magic: 0 2026-02-12T18:11:04.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.200+0000 7f54aeffd640 10 monclient: _finish_auth 0 2026-02-12T18:11:04.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.200+0000 7f54aeffd640 10 monclient: _check_auth_tickets 2026-02-12T18:11:04.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.200+0000 7f54aeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:11:04.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.200+0000 7f54aeffd640 1 -- 10.20.193.48:0/855120861 <== mon.3 v2:10.20.193.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c4005670 con 0x7f54c805e490 2026-02-12T18:11:04.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.200+0000 7f54d068c640 5 monclient: authenticate success, global_id 64263 2026-02-12T18:11:04.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.200+0000 7f54d068c640 10 monclient: _renew_subs 2026-02-12T18:11:04.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.200+0000 7f54d068c640 10 monclient: _send_mon_message to mon.g at v2:10.20.193.111:3301/0 2026-02-12T18:11:04.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.200+0000 7f54d068c640 1 -- 10.20.193.48:0/855120861 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54c8142c60 con 0x7f54c805e490 2026-02-12T18:11:04.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.200+0000 7f54aeffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:11:04.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.200+0000 7f54ccbfe640 4 set_mon_vals no callback set 2026-02-12T18:11:04.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.200+0000 7f54d068c640 10 monclient: _renew_subs 2026-02-12T18:11:04.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.200+0000 7f54d068c640 10 monclient: _send_mon_message to mon.g at v2:10.20.193.111:3301/0 2026-02-12T18:11:04.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.200+0000 7f54d068c640 1 -- 10.20.193.48:0/855120861 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f54c808b700 con 0x7f54c805e490 2026-02-12T18:11:04.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.200+0000 7f54d068c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:11:04.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.200+0000 7f54d068c640 1 --2- 10.20.193.48:0/855120861 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f54c808da10 0x7f54c813dd80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:04.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.200+0000 7f54d068c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:04.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.200+0000 7f54d068c640 1 -- 10.20.193.48:0/855120861 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f54c805f140 con 0x7f54c808da10 2026-02-12T18:11:04.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.201+0000 7f54ce401640 1 --2- 10.20.193.48:0/855120861 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f54c808da10 0x7f54c813dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:04.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.201+0000 7f54ce401640 10 monclient: get_auth_request con 0x7f54c808da10 auth_method 0 2026-02-12T18:11:04.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.201+0000 7f54ce401640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:04.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.201+0000 7f54ce401640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:04.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.201+0000 7f54ce401640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:11:04.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.201+0000 7f54ce401640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:11:04.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.201+0000 7f54ce401640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:11:04.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.201+0000 7f54ce401640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:11:04.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.201+0000 7f54aeffd640 1 -- 10.20.193.48:0/855120861 <== mon.3 v2:10.20.193.111:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f54c4004c70 con 0x7f54c805e490 2026-02-12T18:11:04.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.201+0000 7f54aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:04.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.201+0000 7f54aeffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:11:04.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.201+0000 7f54aeffd640 10 monclient: dump: 2026-02-12T18:11:04.213 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:04.213 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:04.213 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:04.213 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:04.213 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:04.213 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:04.213 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:04.213 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:04.214 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:04.214 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:04.214 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:04.214 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:04.214 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:04.214 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:04.214 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:04.214 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:04.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.201+0000 7f54aeffd640 1 -- 10.20.193.48:0/855120861 <== mon.3 v2:10.20.193.111:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f54c4005030 con 0x7f54c805e490 2026-02-12T18:11:04.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.201+0000 7f54ce401640 10 monclient(hunting): handle_auth_done global_id 64272 payload 824 2026-02-12T18:11:04.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.201+0000 7f54ce401640 1 -- 10.20.193.48:0/855120861 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f54c8097de0 con 0x7f54c808da10 2026-02-12T18:11:04.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.201+0000 7f54aeffd640 1 --2- 10.20.193.48:0/855120861 >> v2:10.20.193.111:6812/977811348 conn(0x7f549803f7d0 0x7f549805fc80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:04.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.201+0000 7f54cdc00640 1 --2- 10.20.193.48:0/855120861 >> v2:10.20.193.111:6812/977811348 conn(0x7f549803f7d0 0x7f549805fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:04.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.201+0000 7f54cdc00640 10 monclient: get_auth_request con 0x7f549803f7d0 auth_method 0 2026-02-12T18:11:04.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.203+0000 7f54ce401640 1 -- 10.20.193.48:0/855120861 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f54c808da10 msgr2=0x7f54c813dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:11:04.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.203+0000 7f54ce401640 1 --2- 10.20.193.48:0/855120861 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f54c808da10 0x7f54c813dd80 secure :-1 s=READY pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54b800b470 tx=0x7f54b800b940 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:04.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.204+0000 7f54aeffd640 1 -- 10.20.193.48:0/855120861 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f54b8005530 con 0x7f54c808da10 2026-02-12T18:11:04.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.204+0000 7f54aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:04.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.204+0000 7f54aeffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:11:04.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.204+0000 7f54aeffd640 10 monclient: dump: 2026-02-12T18:11:04.217 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:04.217 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:04.217 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:04.217 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:04.217 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:04.217 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:04.217 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:04.217 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:04.217 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:04.217 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:04.217 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:04.217 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:04.217 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:04.217 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:04.217 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:04.217 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:04.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.204+0000 7f54cdc00640 1 --2- 10.20.193.48:0/855120861 >> v2:10.20.193.111:6812/977811348 conn(0x7f549803f7d0 0x7f549805fc80 secure :-1 s=READY pgs=316 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54c80914b0 tx=0x7f54bc007ba0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:04.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.204+0000 7f54aeffd640 1 -- 10.20.193.48:0/855120861 <== mon.3 v2:10.20.193.111:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f54b8005690 con 0x7f54c808da10 2026-02-12T18:11:04.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.204+0000 7f54aeffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:11:04.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.204+0000 7f54aeffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:11:04.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.204+0000 7f54aeffd640 1 -- 10.20.193.48:0/855120861 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f54c808da10 msgr2=0x7f54c813dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:04.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.204+0000 7f54aeffd640 1 --2- 10.20.193.48:0/855120861 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f54c808da10 0x7f54c813dd80 secure :-1 s=READY pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54b800b470 tx=0x7f54b800b940 comp rx=0 tx=0).stop 2026-02-12T18:11:04.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.204+0000 7f54aeffd640 1 -- 10.20.193.48:0/855120861 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f54c808da10 msgr2=0x7f54c813dd80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:11:04.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.204+0000 7f54aeffd640 1 --2- 10.20.193.48:0/855120861 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f54c808da10 0x7f54c813dd80 secure :-1 s=CLOSED pgs=54 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54b800b470 tx=0x7f54b800b940 comp rx=0 tx=0).stop 2026-02-12T18:11:04.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.207+0000 7f54d068c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:11:04.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.207+0000 7f54d068c640 1 --2- 10.20.193.48:0/855120861 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f54c813e2c0 0x7f54c813e690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:11:04.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.207+0000 7f54d068c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:11:04.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.207+0000 7f54d068c640 1 -- 10.20.193.48:0/855120861 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f54c805fd90 con 0x7f54c813e2c0 2026-02-12T18:11:04.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.207+0000 7f54ce401640 1 --2- 10.20.193.48:0/855120861 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f54c813e2c0 0x7f54c813e690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:11:04.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.207+0000 7f54ce401640 10 monclient: get_auth_request con 0x7f54c813e2c0 auth_method 0 2026-02-12T18:11:04.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.207+0000 7f54ce401640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:11:04.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.207+0000 7f54ce401640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:11:04.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.207+0000 7f54ce401640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:11:04.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.207+0000 7f54ce401640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:11:04.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.207+0000 7f54ce401640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:11:04.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.207+0000 7f54ce401640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:11:04.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.208+0000 7f54ce401640 10 monclient(hunting): handle_auth_done global_id 64281 payload 824 2026-02-12T18:11:04.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.208+0000 7f54ce401640 1 -- 10.20.193.48:0/855120861 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f54c808bc20 con 0x7f54c813e2c0 2026-02-12T18:11:04.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.210+0000 7f54ce401640 1 -- 10.20.193.48:0/855120861 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f54c813e2c0 msgr2=0x7f54c813e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:11:04.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.210+0000 7f54ce401640 1 --2- 10.20.193.48:0/855120861 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f54c813e2c0 0x7f54c813e690 secure :-1 s=READY pgs=55 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54b800b470 tx=0x7f54b8005ae0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:11:04.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.210+0000 7f54aeffd640 1 -- 10.20.193.48:0/855120861 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f54b8020070 con 0x7f54c813e2c0 2026-02-12T18:11:04.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.210+0000 7f54aeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:11:04.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.210+0000 7f54aeffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:11:04.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.210+0000 7f54aeffd640 10 monclient: dump: 2026-02-12T18:11:04.219 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:11:04.219 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:11:04.219 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:04.219 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:11:04.219 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:11:04.219 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:11:04.219 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:11:04.219 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:11:04.219 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:11:04.219 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:11:04.219 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:11:04.219 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:11:04.219 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:11:04.219 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:11:04.220 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:11:04.220 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:11:04.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.210+0000 7f54aeffd640 1 -- 10.20.193.48:0/855120861 <== mon.3 v2:10.20.193.111:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10137 (secure 0 0 0) 0x7f54b801a830 con 0x7f54c813e2c0 2026-02-12T18:11:04.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.210+0000 7f54aeffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:11:04.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.210+0000 7f54aeffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:11:04.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.210+0000 7f54aeffd640 1 -- 10.20.193.48:0/855120861 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f54c813e2c0 msgr2=0x7f54c813e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:04.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.210+0000 7f54aeffd640 1 --2- 10.20.193.48:0/855120861 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f54c813e2c0 0x7f54c813e690 secure :-1 s=READY pgs=55 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54b800b470 tx=0x7f54b8005ae0 comp rx=0 tx=0).stop 2026-02-12T18:11:04.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.210+0000 7f54aeffd640 1 -- 10.20.193.48:0/855120861 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f54c813e2c0 msgr2=0x7f54c813e690 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:11:04.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.210+0000 7f54aeffd640 1 --2- 10.20.193.48:0/855120861 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f54c813e2c0 0x7f54c813e690 secure :-1 s=CLOSED pgs=55 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54b800b470 tx=0x7f54b8005ae0 comp rx=0 tx=0).stop 2026-02-12T18:11:04.220 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:11:04.220 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:11:04.220 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:11:04.220 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:11:04.221 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 54, 2026-02-12T18:11:04.221 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 45013, 2026-02-12T18:11:04.221 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:11:04.221 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:11:04.221 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:11:04.221 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:11:04.221 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:11:04.221 INFO:teuthology.orchestra.run.trial048.stdout: 6 2026-02-12T18:11:04.221 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:11:04.221 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 4, 2026-02-12T18:11:04.221 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:11:04.221 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:11:04.221 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:11:04.221 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:11:04.221 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:11:04.221 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:11:04.221 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:11:04.221 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:11:04.221 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:11:04.222 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:11:04.222 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:11:04.222 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:11:04.222 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:11:04.222 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:11:04.222 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:11:04.222 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:11:04.222 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:11:04.222 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:11:04.222 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:11:04.222 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:11:04.222 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:11:04.222 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:11:04.222 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:11:04.222 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:11:04.222 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:11:04.222 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:11:04.222 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:11:04.222 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:11:04.223 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:11:04.223 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:11:04.223 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:11:04.223 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:11:04.223 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:04.223 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.223 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:11:04.223 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:11:04.223 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:11:04.223 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:11:04.223 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:11:04.223 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:11:04.223 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:11:04.223 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:11:04.223 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:11:04.223 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:11:04.223 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:11:04.223 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:11:04.223 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:11:04.224 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:11:04.224 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:11:04.224 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:11:04.224 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:11:04.224 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:11:04.224 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:11:04.224 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:11:04.224 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:11:04.224 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:11:04.224 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:11:04.224 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:11:04.224 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:11:04.224 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:11:04.224 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:11:04.224 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:11:04.224 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:11:04.224 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:11:04.224 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:11:04.224 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:11:04.224 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.224 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:11:04.225 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.225 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:11:04.225 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:11:04.225 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:04.225 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:04.225 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.225 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:04.225 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:11:04.225 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.225 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.225 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.225 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:04.225 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:11:04.225 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.225 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.225 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:04.225 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.225 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:11:04.225 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:11:04.225 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:04.226 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:04.226 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:11:04.226 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:04.226 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.226 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.226 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:11:04.226 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:11:04.226 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:04.226 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:04.226 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.226 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:04.226 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:11:04.226 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.226 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.226 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.226 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:04.226 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:11:04.226 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.226 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.226 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:04.226 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.226 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:11:04.227 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:11:04.227 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:04.227 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:04.227 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:11:04.227 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:04.227 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.227 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.227 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:11:04.227 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:11:04.227 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:04.227 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:04.227 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.227 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:04.227 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:11:04.227 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.227 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.227 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.227 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:04.227 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:11:04.227 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.227 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.227 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:04.228 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.228 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:11:04.228 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:11:04.228 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:04.228 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:04.228 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:11:04.228 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:04.228 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.228 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.228 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:11:04.228 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:11:04.228 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:04.228 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:04.228 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.228 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:04.228 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:11:04.228 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.228 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.228 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.228 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:04.228 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:11:04.228 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.228 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.229 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:04.229 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.229 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:11:04.229 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:11:04.229 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:04.229 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:04.229 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:11:04.229 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:04.229 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.229 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.229 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:11:04.229 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:11:04.229 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:04.229 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:04.229 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.229 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:04.229 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:11:04.229 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.229 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.229 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.229 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:04.229 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:11:04.229 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.229 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.230 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:04.230 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.230 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:11:04.230 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:11:04.230 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:04.230 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:04.230 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:11:04.230 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:04.230 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.230 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.230 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:11:04.230 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:11:04.230 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:04.230 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:04.230 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.230 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:04.230 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:11:04.230 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.230 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.230 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.230 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:04.230 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:11:04.230 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.231 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.231 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:04.231 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.231 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:11:04.231 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:11:04.231 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:04.231 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:04.231 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:11:04.231 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:04.231 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.231 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.231 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:11:04.231 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:11:04.231 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:04.231 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:04.231 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.231 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:04.231 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:11:04.231 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.231 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.231 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.231 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:04.231 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:11:04.231 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.232 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.232 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:04.232 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.232 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:11:04.232 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:11:04.232 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:04.232 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:04.232 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:11:04.232 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:04.232 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.232 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.232 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:11:04.232 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:11:04.232 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:04.232 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:04.232 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.232 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:04.232 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:11:04.232 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.232 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.232 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.232 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:04.232 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:11:04.232 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.232 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.233 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:04.233 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.233 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:11:04.233 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:11:04.233 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:04.233 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:04.233 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:11:04.233 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:04.233 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.233 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.233 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:11:04.233 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:11:04.233 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:11:04.233 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:11:04.233 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.233 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:11:04.233 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:11:04.233 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.233 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.233 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.233 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:11:04.233 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:11:04.233 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:11:04.233 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.234 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:04.234 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.234 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:11:04.234 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:11:04.234 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:11:04.234 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:11:04.234 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:11:04.234 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:11:04.234 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.234 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:04.234 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.234 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:11:04.234 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:11:04.234 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.234 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:11:04.234 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:11:04.234 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:11:04.234 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.234 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:11:04.234 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:11:04.234 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.234 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:11:04.234 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:11:04.234 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:11:04.234 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.234 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:11:04.235 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:11:04.235 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:11:04.235 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:11:04.235 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:11:04.235 INFO:teuthology.orchestra.run.trial048.stdout: "num": 4 2026-02-12T18:11:04.235 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:11:04.235 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:11:04.235 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:11:04.235 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:11:04.235 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:11:04.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.210+0000 7f54d068c640 1 -- 10.20.193.48:0/855120861 >> v2:10.20.193.111:6812/977811348 conn(0x7f549803f7d0 msgr2=0x7f549805fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:04.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.210+0000 7f54d068c640 1 --2- 10.20.193.48:0/855120861 >> v2:10.20.193.111:6812/977811348 conn(0x7f549803f7d0 0x7f549805fc80 secure :-1 s=READY pgs=316 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54c80914b0 tx=0x7f54bc007ba0 comp rx=0 tx=0).stop 2026-02-12T18:11:04.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.210+0000 7f54d068c640 10 monclient: shutdown 2026-02-12T18:11:04.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.210+0000 7f54d068c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:11:04.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.210+0000 7f54d068c640 1 -- 10.20.193.48:0/855120861 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f54c805e490 msgr2=0x7f54c812de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:11:04.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.210+0000 7f54d068c640 1 --2- 10.20.193.48:0/855120861 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f54c805e490 0x7f54c812de90 secure :-1 s=READY pgs=53 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54c400a830 tx=0x7f54c4005850 comp rx=0 tx=0).stop 2026-02-12T18:11:04.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.210+0000 7f54cec02640 1 -- 10.20.193.48:0/855120861 reap_dead start 2026-02-12T18:11:04.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.210+0000 7f54cec02640 1 -- 10.20.193.48:0/855120861 reap_dead start 2026-02-12T18:11:04.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.210+0000 7f54aeffd640 1 -- 10.20.193.48:0/855120861 <== mon.3 v2:10.20.193.111:3301/0 5 ==== osd_map(215..215 src has 190..215) ==== 3503+0+0 (unknown 0 0 0) 0x7f54c40795a0 con 0x7f54c805e490 2026-02-12T18:11:04.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.210+0000 7f54d068c640 1 -- 10.20.193.48:0/855120861 shutdown_connections 2026-02-12T18:11:04.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.210+0000 7f54d068c640 1 -- 10.20.193.48:0/855120861 >> 10.20.193.48:0/855120861 conn(0x7f54c80548a0 msgr2=0x7f54c8122f50 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:11:04.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.211+0000 7f54d068c640 1 -- 10.20.193.48:0/855120861 shutdown_connections 2026-02-12T18:11:04.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:11:04.211+0000 7f54d068c640 1 -- 10.20.193.48:0/855120861 wait complete. 2026-02-12T18:11:04.237 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2026-02-12T18:11:04.237 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-12T18:12:34.237 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.i 2026-02-12T18:12:34.238 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.i 2026-02-12T18:12:34.238 INFO:tasks.ceph.mon.i:Restarting daemon 2026-02-12T18:12:34.238 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i i 2026-02-12T18:12:34.253 INFO:tasks.ceph.mon.i:Started 2026-02-12T18:12:34.253 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.e 2026-02-12T18:12:34.253 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.e 2026-02-12T18:12:34.253 INFO:tasks.ceph.mon.e:Restarting daemon 2026-02-12T18:12:34.254 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2026-02-12T18:12:34.267 INFO:tasks.ceph.mon.e:Started 2026-02-12T18:12:34.267 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.f 2026-02-12T18:12:34.267 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.f 2026-02-12T18:12:34.267 INFO:tasks.ceph.mon.f:Restarting daemon 2026-02-12T18:12:34.267 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i f 2026-02-12T18:12:34.269 INFO:tasks.ceph.mon.f:Started 2026-02-12T18:12:34.270 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.h 2026-02-12T18:12:34.270 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.h 2026-02-12T18:12:34.270 INFO:tasks.ceph.mon.h:Restarting daemon 2026-02-12T18:12:34.270 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i h 2026-02-12T18:12:34.272 INFO:tasks.ceph.mon.h:Started 2026-02-12T18:12:34.272 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.g 2026-02-12T18:12:34.272 INFO:tasks.mon_thrash:Sending STOP to mon g 2026-02-12T18:12:34.272 INFO:tasks.ceph.mon.g:Sent signal 19 2026-02-12T18:12:34.273 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-12T18:12:34.333 INFO:tasks.ceph.mon.f.trial111.stderr:2026-02-12T18:12:34.331+0000 7f6483220c00 -1 mon.f@-1(???).log v0 log_external_backlog rewinding external_log_to from 198 -> 0 (sync_force? mon rebuild?) 2026-02-12T18:12:49.274 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.g 2026-02-12T18:12:49.274 INFO:tasks.mon_thrash:Sending CONT to mon g 2026-02-12T18:12:49.274 INFO:tasks.ceph.mon.g:Sent signal 18 2026-02-12T18:12:49.275 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2026-02-12T18:12:49.275 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T18:12:49.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.343+0000 7f25df41b640 10 monclient: get_monmap_and_config 2026-02-12T18:12:49.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.343+0000 7f25df41b640 10 monclient: build_initial_monmap 2026-02-12T18:12:49.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.343+0000 7f25df41b640 10 monclient: monmap: 2026-02-12T18:12:49.345 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:49.345 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.345 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:12:49.344778+0000 2026-02-12T18:12:49.346 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:12:49.344778+0000 2026-02-12T18:12:49.346 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:49.346 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.346 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:12:49.346 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:12:49.346 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:49.346 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:49.346 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:49.346 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:49.346 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:49.346 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:49.346 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:49.347 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:12:49.347 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:12:49.347 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25df41b640 1 Processor -- start 2026-02-12T18:12:49.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25df41b640 1 -- start start 2026-02-12T18:12:49.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25df41b640 10 monclient: init 2026-02-12T18:12:49.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25df41b640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:49.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25df41b640 10 monclient: _add_conns ranks=[8,10,3,2,5,6,0,7,4,9,1] 2026-02-12T18:12:49.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25df41b640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f25d805dc20 0x7f25d8144660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25df41b640 10 monclient(hunting): picked mon.noname-e con 0x7f25d805dc20 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:12:49.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25df41b640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f25d805dff0 0x7f25d805e3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25df41b640 10 monclient(hunting): picked mon.noname-f con 0x7f25d805dff0 addr v2:10.20.193.111:3300/0 2026-02-12T18:12:49.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25df41b640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f25d8089df0 0x7f25d808a240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25df41b640 10 monclient(hunting): picked mon.noname-g con 0x7f25d8089df0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:12:49.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25df41b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25df41b640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f25d808b0d0 con 0x7f25d805dff0 2026-02-12T18:12:49.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25df41b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25df41b640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f25d8093a30 con 0x7f25d8089df0 2026-02-12T18:12:49.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25df41b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25df41b640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f25d8092200 con 0x7f25d805dc20 2026-02-12T18:12:49.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25df41b640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:49.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25df41b640 10 monclient(hunting): authenticate will time out at 1008.070548s 2026-02-12T18:12:49.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dd190640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f25d805dc20 0x7f25d8144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dd190640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f25d805dc20 0x7f25d8144660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:57280/0 (socket says 10.20.193.48:57280) 2026-02-12T18:12:49.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dd190640 1 -- 10.20.193.48:0/1681337201 learned_addr learned my addr 10.20.193.48:0/1681337201 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:49.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dd190640 10 monclient(hunting): get_auth_request con 0x7f25d805dc20 auth_method 0 2026-02-12T18:12:49.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dd190640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dd190640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dd190640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dd190640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dd190640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dd190640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dc98f640 1 --2- 10.20.193.48:0/1681337201 >> v2:10.20.193.111:3300/0 conn(0x7f25d805dff0 0x7f25d805e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dd991640 1 --2- 10.20.193.48:0/1681337201 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f25d8089df0 0x7f25d808a240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dc98f640 10 monclient(hunting): get_auth_request con 0x7f25d805dff0 auth_method 0 2026-02-12T18:12:49.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dc98f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dc98f640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dc98f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dd991640 10 monclient(hunting): get_auth_request con 0x7f25d8089df0 auth_method 0 2026-02-12T18:12:49.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dd991640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dd991640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dd991640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dd190640 10 monclient(hunting): handle_auth_done global_id 94112 payload 274 2026-02-12T18:12:49.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dd190640 1 -- 10.20.193.48:0/1681337201 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f25d8089df0 msgr2=0x7f25d808a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:49.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dd190640 1 --2- 10.20.193.48:0/1681337201 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f25d8089df0 0x7f25d808a240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dd190640 1 -- 10.20.193.48:0/1681337201 >> v2:10.20.193.111:3300/0 conn(0x7f25d805dff0 msgr2=0x7f25d805e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:49.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dd190640 1 --2- 10.20.193.48:0/1681337201 >> v2:10.20.193.111:3300/0 conn(0x7f25d805dff0 0x7f25d805e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dd190640 10 monclient: _finish_hunting 0 2026-02-12T18:12:49.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dd190640 1 monclient: found mon.noname-e 2026-02-12T18:12:49.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dd190640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:49.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dd190640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:12:49.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.344+0000 7f25dd190640 1 -- 10.20.193.48:0/1681337201 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25d8060390 con 0x7f25d805dc20 2026-02-12T18:12:49.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.347+0000 7f25dd190640 1 -- 10.20.193.48:0/1681337201 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f25d805dc20 msgr2=0x7f25d8144660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:49.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.347+0000 7f25dd190640 1 --2- 10.20.193.48:0/1681337201 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f25d805dc20 0x7f25d8144660 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=15815837920625161551 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25c80098d0 tx=0x7f25c802ee60 comp rx=0 tx=0).ready entity=mon.8 client_cookie=db7d24cafc03f54f server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:49.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.347+0000 7f25c7fff640 1 -- 10.20.193.48:0/1681337201 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f25c8035340 con 0x7f25d805dc20 2026-02-12T18:12:49.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.347+0000 7f25c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.347+0000 7f25c7fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:12:49.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.347+0000 7f25c7fff640 10 monclient: dump: 2026-02-12T18:12:49.360 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.360 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.360 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.360 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.360 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.360 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.360 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.361 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.361 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.361 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.361 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.361 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.361 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.361 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.361 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.361 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.347+0000 7f25c7fff640 10 monclient: _finish_auth 0 2026-02-12T18:12:49.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.347+0000 7f25c7fff640 10 monclient: _check_auth_tickets 2026-02-12T18:12:49.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.347+0000 7f25c7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:49.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.347+0000 7f25c7fff640 1 -- 10.20.193.48:0/1681337201 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25c80354c0 con 0x7f25d805dc20 2026-02-12T18:12:49.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.347+0000 7f25df41b640 5 monclient: authenticate success, global_id 94112 2026-02-12T18:12:49.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.347+0000 7f25df41b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:12:49.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.347+0000 7f25c7fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:49.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.347+0000 7f25c7fff640 1 -- 10.20.193.48:0/1681337201 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f25c8035af0 con 0x7f25d805dc20 2026-02-12T18:12:49.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.347+0000 7f25df41b640 10 monclient: get_monmap_and_config success 2026-02-12T18:12:49.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.347+0000 7f25df41b640 4 set_mon_vals no callback set 2026-02-12T18:12:49.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.347+0000 7f25c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.347+0000 7f25c7fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:12:49.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.347+0000 7f25c7fff640 10 monclient: dump: 2026-02-12T18:12:49.362 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.362 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.363 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.363 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.363 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.363 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.363 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.363 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.363 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.363 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.363 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.363 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.363 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.363 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.363 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.364 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.348+0000 7f25df41b640 10 monclient: shutdown 2026-02-12T18:12:49.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.348+0000 7f25df41b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:49.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.348+0000 7f25df41b640 1 -- 10.20.193.48:0/1681337201 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f25d805dc20 msgr2=0x7f25d8144660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.348+0000 7f25df41b640 1 --2- 10.20.193.48:0/1681337201 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f25d805dc20 0x7f25d8144660 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=15815837920625161551 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25c80098d0 tx=0x7f25c802ee60 comp rx=0 tx=0).stop 2026-02-12T18:12:49.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.348+0000 7f25df41b640 1 -- 10.20.193.48:0/1681337201 shutdown_connections 2026-02-12T18:12:49.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.348+0000 7f25df41b640 1 --2- 10.20.193.48:0/1681337201 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f25d8089df0 0x7f25d808a240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.348+0000 7f25df41b640 1 --2- 10.20.193.48:0/1681337201 >> v2:10.20.193.111:3300/0 conn(0x7f25d805dff0 0x7f25d805e3e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.348+0000 7f25df41b640 1 --2- 10.20.193.48:0/1681337201 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f25d805dc20 0x7f25d8144660 unknown :-1 s=CLOSED pgs=16 gs=1 cs=0 l=1 c_cookie=15815837920625161551 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.348+0000 7f25df41b640 1 -- 10.20.193.48:0/1681337201 >> 10.20.193.48:0/1681337201 conn(0x7f25d80546d0 msgr2=0x7f25d8054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:49.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.348+0000 7f25df41b640 1 -- 10.20.193.48:0/1681337201 shutdown_connections 2026-02-12T18:12:49.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.348+0000 7f25df41b640 1 -- 10.20.193.48:0/1681337201 wait complete. 2026-02-12T18:12:49.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.348+0000 7f25df41b640 10 monclient: build_initial_monmap 2026-02-12T18:12:49.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.348+0000 7f25df41b640 10 monclient: monmap: 2026-02-12T18:12:49.365 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:49.365 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:12:49.365 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:12:49.365 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:12:49.365 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:49.365 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.365 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:12:49.365 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:12:49.365 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:49.365 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:49.366 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:49.366 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:49.366 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:49.366 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:49.366 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:49.366 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.348+0000 7f25df41b640 1 Processor -- start 2026-02-12T18:12:49.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.348+0000 7f25df41b640 1 -- start start 2026-02-12T18:12:49.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.348+0000 7f25df41b640 10 monclient: init 2026-02-12T18:12:49.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25df41b640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:49.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25df41b640 10 monclient: _add_conns ranks=[5,6,0,4,2,8,7,3,1] 2026-02-12T18:12:49.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25df41b640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f25d805dc20 0x7f25d808d8b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25df41b640 10 monclient(hunting): picked mon.noname-h con 0x7f25d805dc20 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:12:49.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25df41b640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f25d805dff0 0x7f25d81313c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25df41b640 10 monclient(hunting): picked mon.noname-d con 0x7f25d805dff0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:12:49.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25df41b640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f25d8089df0 0x7f25d810db60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25df41b640 10 monclient(hunting): picked mon.noname-a con 0x7f25d8089df0 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:12:49.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25df41b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25df41b640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f25d8141bb0 con 0x7f25d8089df0 2026-02-12T18:12:49.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25df41b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25df41b640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f25d808e220 con 0x7f25d805dc20 2026-02-12T18:12:49.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25df41b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25df41b640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f25d81101d0 con 0x7f25d805dff0 2026-02-12T18:12:49.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25df41b640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:49.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25df41b640 10 monclient(hunting): authenticate will time out at 1008.075156s 2026-02-12T18:12:49.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dc98f640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f25d805dff0 0x7f25d81313c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dc98f640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f25d805dff0 0x7f25d81313c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:59354/0 (socket says 10.20.193.48:59354) 2026-02-12T18:12:49.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dc98f640 1 -- 10.20.193.48:0/3703324866 learned_addr learned my addr 10.20.193.48:0/3703324866 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:49.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dc98f640 10 monclient(hunting): get_auth_request con 0x7f25d805dff0 auth_method 0 2026-02-12T18:12:49.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dc98f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dc98f640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dc98f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dd991640 1 --2- 10.20.193.48:0/3703324866 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f25d8089df0 0x7f25d810db60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dd991640 10 monclient(hunting): get_auth_request con 0x7f25d8089df0 auth_method 0 2026-02-12T18:12:49.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dd991640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dd991640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dd991640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dc98f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dc98f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dc98f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dd991640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dd991640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dd190640 1 --2- 10.20.193.48:0/3703324866 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f25d805dc20 0x7f25d808d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dd991640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dd190640 10 monclient(hunting): get_auth_request con 0x7f25d805dc20 auth_method 0 2026-02-12T18:12:49.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dd190640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dd190640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dd190640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dc98f640 10 monclient(hunting): handle_auth_done global_id 5721 payload 824 2026-02-12T18:12:49.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dc98f640 1 -- 10.20.193.48:0/3703324866 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f25d805dc20 msgr2=0x7f25d808d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dc98f640 1 --2- 10.20.193.48:0/3703324866 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f25d805dc20 0x7f25d808d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dc98f640 1 -- 10.20.193.48:0/3703324866 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f25d8089df0 msgr2=0x7f25d810db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dc98f640 1 --2- 10.20.193.48:0/3703324866 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f25d8089df0 0x7f25d810db60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dc98f640 10 monclient: _finish_hunting 0 2026-02-12T18:12:49.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dc98f640 1 monclient: found mon.noname-d 2026-02-12T18:12:49.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dc98f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:49.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dc98f640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:12:49.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.349+0000 7f25dc98f640 1 -- 10.20.193.48:0/3703324866 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c80094f0 con 0x7f25d805dff0 2026-02-12T18:12:49.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.351+0000 7f25dc98f640 1 -- 10.20.193.48:0/3703324866 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f25d805dff0 msgr2=0x7f25d81313c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:49.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.351+0000 7f25dc98f640 1 --2- 10.20.193.48:0/3703324866 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f25d805dff0 0x7f25d81313c0 secure :-1 s=READY pgs=268 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25cc00e7e0 tx=0x7f25cc00ecb0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:49.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.351+0000 7f25c5ffb640 1 -- 10.20.193.48:0/3703324866 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f25cc0036d0 con 0x7f25d805dff0 2026-02-12T18:12:49.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.351+0000 7f25c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.351+0000 7f25c5ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:12:49.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.351+0000 7f25c5ffb640 10 monclient: dump: 2026-02-12T18:12:49.371 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.371 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.371 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.371 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.371 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.371 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.371 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.371 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.371 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.371 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.372 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.372 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.372 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.372 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.372 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.372 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.351+0000 7f25c5ffb640 10 monclient: _finish_auth 0 2026-02-12T18:12:49.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.351+0000 7f25c5ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:12:49.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.351+0000 7f25c5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:49.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.351+0000 7f25c5ffb640 1 -- 10.20.193.48:0/3703324866 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25cc003830 con 0x7f25d805dff0 2026-02-12T18:12:49.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.351+0000 7f25c5ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:49.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.351+0000 7f25c5ffb640 1 -- 10.20.193.48:0/3703324866 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f25cc003e60 con 0x7f25d805dff0 2026-02-12T18:12:49.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.351+0000 7f25c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.351+0000 7f25c5ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:12:49.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.351+0000 7f25c77fe640 4 set_mon_vals no callback set 2026-02-12T18:12:49.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.351+0000 7f25c5ffb640 10 monclient: dump: 2026-02-12T18:12:49.373 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.373 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.373 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.373 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.373 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.373 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.373 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.373 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.373 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.374 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.374 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.374 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.374 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.374 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.374 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.374 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.351+0000 7f25df41b640 5 monclient: authenticate success, global_id 5721 2026-02-12T18:12:49.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.351+0000 7f25df41b640 10 monclient: _renew_subs 2026-02-12T18:12:49.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.351+0000 7f25df41b640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:12:49.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.351+0000 7f25df41b640 1 -- 10.20.193.48:0/3703324866 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25d81104b0 con 0x7f25d805dff0 2026-02-12T18:12:49.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.351+0000 7f25df41b640 10 monclient: _renew_subs 2026-02-12T18:12:49.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.351+0000 7f25df41b640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:12:49.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.351+0000 7f25df41b640 1 -- 10.20.193.48:0/3703324866 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f25d8131900 con 0x7f25d805dff0 2026-02-12T18:12:49.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.352+0000 7f25df41b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:49.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.352+0000 7f25df41b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:49.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.352+0000 7f25df41b640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:12:49.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.352+0000 7f25df41b640 1 -- 10.20.193.48:0/3703324866 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25d8092510 con 0x7f25d805dff0 2026-02-12T18:12:49.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.352+0000 7f25c5ffb640 1 -- 10.20.193.48:0/3703324866 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f25cc0039a0 con 0x7f25d805dff0 2026-02-12T18:12:49.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.352+0000 7f25c5ffb640 1 --2- 10.20.193.48:0/3703324866 >> v2:10.20.193.111:6812/977811348 conn(0x7f25a803f800 0x7f25a805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.352+0000 7f25c5ffb640 1 -- 10.20.193.48:0/3703324866 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(218..218 src has 190..218) ==== 3897+0+0 (secure 0 0 0) 0x7f25cc052cc0 con 0x7f25d805dff0 2026-02-12T18:12:49.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.352+0000 7f25dd190640 1 --2- 10.20.193.48:0/3703324866 >> v2:10.20.193.111:6812/977811348 conn(0x7f25a803f800 0x7f25a805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.352+0000 7f25dd190640 10 monclient: get_auth_request con 0x7f25a803f800 auth_method 0 2026-02-12T18:12:49.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.354+0000 7f25c5ffb640 1 -- 10.20.193.48:0/3703324866 <== mon.6 v2:10.20.193.48:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f25cc00ca00 con 0x7f25d805dff0 2026-02-12T18:12:49.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.354+0000 7f25c5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:49.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.354+0000 7f25c5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:12:49.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.355+0000 7f25dd190640 1 --2- 10.20.193.48:0/3703324866 >> v2:10.20.193.111:6812/977811348 conn(0x7f25a803f800 0x7f25a805fcb0 secure :-1 s=READY pgs=323 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25c8004740 tx=0x7f25c8039040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:49.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.499+0000 7f25df41b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T18:12:49.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.499+0000 7f25df41b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T18:12:49.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.499+0000 7f25df41b640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:12:49.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.499+0000 7f25df41b640 1 -- 10.20.193.48:0/3703324866 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f25d8110310 con 0x7f25d805dff0 2026-02-12T18:12:49.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.500+0000 7f25c5ffb640 1 -- 10.20.193.48:0/3703324866 <== mon.6 v2:10.20.193.48:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3660 (secure 0 0 0) 0x7f25d8110310 con 0x7f25d805dff0 2026-02-12T18:12:49.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.500+0000 7f25c5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T18:12:49.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.500+0000 7f25c5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:12:49.502 INFO:teuthology.orchestra.run.trial048.stdout:{"election_epoch":68,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","modified":"2026-02-12T18:05:32.850777Z","created":"2026-02-12T18:05:32.850777Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3300","nonce":0},{"type":"v1","addr":"10.20.193.48:6789","nonce":0}]},"addr":"10.20.193.48:6789/0","public_addr":"10.20.193.48:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850827+0000","crush_location":[]},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3300","nonce":0},{"type":"v1","addr":"10.20.193.111:6789","nonce":0}]},"addr":"10.20.193.111:6789/0","public_addr":"10.20.193.111:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850829+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3301","nonce":0},{"type":"v1","addr":"10.20.193.48:6790","nonce":0}]},"addr":"10.20.193.48:6790/0","public_addr":"10.20.193.48:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850830+0000","crush_location":[]},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3301","nonce":0},{"type":"v1","addr":"10.20.193.111:6790","nonce":0}]},"addr":"10.20.193.111:6790/0","public_addr":"10.20.193.111:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850833+0000","crush_location":[]},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3302","nonce":0},{"type":"v1","addr":"10.20.193.48:6791","nonce":0}]},"addr":"10.20.193.48:6791/0","public_addr":"10.20.193.48:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3302","nonce":0},{"type":"v1","addr":"10.20.193.111:6791","nonce":0}]},"addr":"10.20.193.111:6791/0","public_addr":"10.20.193.111:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850834+0000","crush_location":[]},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3303","nonce":0},{"type":"v1","addr":"10.20.193.48:6792","nonce":0}]},"addr":"10.20.193.48:6792/0","public_addr":"10.20.193.48:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3303","nonce":0},{"type":"v1","addr":"10.20.193.111:6792","nonce":0}]},"addr":"10.20.193.111:6792/0","public_addr":"10.20.193.111:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850835+0000","crush_location":[]},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3304","nonce":0},{"type":"v1","addr":"10.20.193.48:6793","nonce":0}]},"addr":"10.20.193.48:6793/0","public_addr":"10.20.193.48:6793/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850832+0000","crush_location":[]}]}} 2026-02-12T18:12:49.503 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.501+0000 7f25df41b640 1 -- 10.20.193.48:0/3703324866 >> v2:10.20.193.111:6812/977811348 conn(0x7f25a803f800 msgr2=0x7f25a805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.503 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.501+0000 7f25df41b640 1 --2- 10.20.193.48:0/3703324866 >> v2:10.20.193.111:6812/977811348 conn(0x7f25a803f800 0x7f25a805fcb0 secure :-1 s=READY pgs=323 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25c8004740 tx=0x7f25c8039040 comp rx=0 tx=0).stop 2026-02-12T18:12:49.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.501+0000 7f25df41b640 10 monclient: shutdown 2026-02-12T18:12:49.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.501+0000 7f25df41b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:49.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.501+0000 7f25df41b640 1 -- 10.20.193.48:0/3703324866 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f25d805dff0 msgr2=0x7f25d81313c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.501+0000 7f25df41b640 1 --2- 10.20.193.48:0/3703324866 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f25d805dff0 0x7f25d81313c0 secure :-1 s=READY pgs=268 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f25cc00e7e0 tx=0x7f25cc00ecb0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.501+0000 7f25df41b640 1 -- 10.20.193.48:0/3703324866 shutdown_connections 2026-02-12T18:12:49.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.501+0000 7f25df41b640 1 --2- 10.20.193.48:0/3703324866 >> v2:10.20.193.111:6812/977811348 conn(0x7f25a803f800 0x7f25a805fcb0 unknown :-1 s=CLOSED pgs=323 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.501+0000 7f25df41b640 1 --2- 10.20.193.48:0/3703324866 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f25d8089df0 0x7f25d810db60 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.501+0000 7f25df41b640 1 --2- 10.20.193.48:0/3703324866 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f25d805dff0 0x7f25d81313c0 unknown :-1 s=CLOSED pgs=268 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.501+0000 7f25df41b640 1 --2- 10.20.193.48:0/3703324866 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f25d805dc20 0x7f25d808d8b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.501+0000 7f25df41b640 1 -- 10.20.193.48:0/3703324866 >> 10.20.193.48:0/3703324866 conn(0x7f25d80546d0 msgr2=0x7f25d8124670 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:49.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.501+0000 7f25df41b640 1 -- 10.20.193.48:0/3703324866 shutdown_connections 2026-02-12T18:12:49.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.501+0000 7f25df41b640 1 -- 10.20.193.48:0/3703324866 wait complete. 2026-02-12T18:12:49.510 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2026-02-12T18:12:49.510 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2026-02-12T18:12:49.511 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T18:12:49.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.576+0000 7f9ba230c640 10 monclient: get_monmap_and_config 2026-02-12T18:12:49.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.576+0000 7f9ba230c640 10 monclient: build_initial_monmap 2026-02-12T18:12:49.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.576+0000 7f9ba230c640 10 monclient: monmap: 2026-02-12T18:12:49.580 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:49.581 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.581 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:12:49.577645+0000 2026-02-12T18:12:49.581 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:12:49.577645+0000 2026-02-12T18:12:49.581 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:49.581 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.581 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:12:49.581 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:12:49.581 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:49.581 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:49.581 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:49.581 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:49.582 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:49.582 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:49.582 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:49.582 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:12:49.582 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:12:49.582 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.576+0000 7f9ba230c640 1 Processor -- start 2026-02-12T18:12:49.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba230c640 1 -- start start 2026-02-12T18:12:49.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba230c640 10 monclient: init 2026-02-12T18:12:49.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba230c640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:49.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba230c640 10 monclient: _add_conns ranks=[6,9,8,2,5,7,1,0,10,4,3] 2026-02-12T18:12:49.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba230c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9b9c090730 0x7f9b9c08fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba230c640 10 monclient(hunting): picked mon.noname-d con 0x7f9b9c090730 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:12:49.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba230c640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f9b9c090b00 0x7f9b9c090f30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba230c640 10 monclient(hunting): picked mon.noname-a con 0x7f9b9c090b00 addr v2:10.20.193.48:3300/0 2026-02-12T18:12:49.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba230c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9b9c1442e0 0x7f9b9c144750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba230c640 10 monclient(hunting): picked mon.noname-e con 0x7f9b9c1442e0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:12:49.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba230c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba230c640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f9b9c0914d0 con 0x7f9b9c090b00 2026-02-12T18:12:49.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba230c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba230c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f9b9c0570c0 con 0x7f9b9c090730 2026-02-12T18:12:49.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba230c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba230c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f9b9c0573a0 con 0x7f9b9c1442e0 2026-02-12T18:12:49.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba230c640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:49.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba230c640 10 monclient(hunting): authenticate will time out at 1008.303340s 2026-02-12T18:12:49.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9bfff640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9b9c090730 0x7f9b9c08fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9b7fe640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f9b9c090b00 0x7f9b9c090f30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba0882640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9b9c1442e0 0x7f9b9c144750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9bfff640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9b9c090730 0x7f9b9c08fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:59356/0 (socket says 10.20.193.48:59356) 2026-02-12T18:12:49.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9bfff640 1 -- 10.20.193.48:0/3221975709 learned_addr learned my addr 10.20.193.48:0/3221975709 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:49.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9bfff640 10 monclient(hunting): get_auth_request con 0x7f9b9c090730 auth_method 0 2026-02-12T18:12:49.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9b7fe640 10 monclient(hunting): get_auth_request con 0x7f9b9c090b00 auth_method 0 2026-02-12T18:12:49.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba0882640 10 monclient(hunting): get_auth_request con 0x7f9b9c1442e0 auth_method 0 2026-02-12T18:12:49.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba0882640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba0882640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba0882640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba0882640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba0882640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba0882640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9bfff640 10 monclient(hunting): handle_auth_done global_id 5730 payload 274 2026-02-12T18:12:49.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9bfff640 1 -- 10.20.193.48:0/3221975709 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9b9c1442e0 msgr2=0x7f9b9c144750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:49.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9bfff640 1 --2- 10.20.193.48:0/3221975709 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9b9c1442e0 0x7f9b9c144750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9bfff640 1 -- 10.20.193.48:0/3221975709 >> v2:10.20.193.48:3300/0 conn(0x7f9b9c090b00 msgr2=0x7f9b9c090f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:49.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9bfff640 1 --2- 10.20.193.48:0/3221975709 >> v2:10.20.193.48:3300/0 conn(0x7f9b9c090b00 0x7f9b9c090f30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9bfff640 10 monclient: _finish_hunting 0 2026-02-12T18:12:49.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9bfff640 1 monclient: found mon.noname-d 2026-02-12T18:12:49.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:49.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9bfff640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:12:49.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9b9bfff640 1 -- 10.20.193.48:0/3221975709 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b9c04dc20 con 0x7f9b9c090730 2026-02-12T18:12:49.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.577+0000 7f9ba0882640 1 --2- 10.20.193.48:0/3221975709 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9b9c1442e0 0x7f9b9c144750 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:12:49.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9b9bfff640 1 -- 10.20.193.48:0/3221975709 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9b9c090730 msgr2=0x7f9b9c08fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:49.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9b9bfff640 1 --2- 10.20.193.48:0/3221975709 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9b9c090730 0x7f9b9c08fca0 secure :-1 s=READY pgs=269 gs=2 cs=0 l=1 c_cookie=9682570445975193298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b88009060 tx=0x7f9b8802edf0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=865f6685290c06d2 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:49.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9b9affd640 1 -- 10.20.193.48:0/3221975709 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9b88035340 con 0x7f9b9c090730 2026-02-12T18:12:49.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9b9affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9b9affd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:12:49.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9b9affd640 10 monclient: dump: 2026-02-12T18:12:49.597 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.597 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.597 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.597 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.597 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.597 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.597 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.597 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.597 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.597 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.597 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.597 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.598 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.598 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.598 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.598 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9b9affd640 10 monclient: _finish_auth 0 2026-02-12T18:12:49.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9b9affd640 10 monclient: _check_auth_tickets 2026-02-12T18:12:49.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9b9affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:49.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9b9affd640 1 -- 10.20.193.48:0/3221975709 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b880354c0 con 0x7f9b9c090730 2026-02-12T18:12:49.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9ba230c640 5 monclient: authenticate success, global_id 5730 2026-02-12T18:12:49.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9b9affd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:49.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9b9affd640 1 -- 10.20.193.48:0/3221975709 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9b88035af0 con 0x7f9b9c090730 2026-02-12T18:12:49.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9b9affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9b9affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:12:49.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9b9affd640 10 monclient: dump: 2026-02-12T18:12:49.599 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.599 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.599 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.599 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.599 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.599 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.599 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.599 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.599 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.599 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.600 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.600 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.600 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.600 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.600 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.600 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9ba230c640 10 monclient: get_monmap_and_config success 2026-02-12T18:12:49.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9ba230c640 4 set_mon_vals no callback set 2026-02-12T18:12:49.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9ba230c640 10 monclient: shutdown 2026-02-12T18:12:49.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9ba230c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:49.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9ba230c640 1 -- 10.20.193.48:0/3221975709 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9b9c090730 msgr2=0x7f9b9c08fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9ba230c640 1 --2- 10.20.193.48:0/3221975709 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9b9c090730 0x7f9b9c08fca0 secure :-1 s=READY pgs=269 gs=2 cs=0 l=1 c_cookie=9682570445975193298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b88009060 tx=0x7f9b8802edf0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9ba230c640 1 -- 10.20.193.48:0/3221975709 shutdown_connections 2026-02-12T18:12:49.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9ba230c640 1 --2- 10.20.193.48:0/3221975709 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9b9c1442e0 0x7f9b9c144750 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9ba230c640 1 --2- 10.20.193.48:0/3221975709 >> v2:10.20.193.48:3300/0 conn(0x7f9b9c090b00 0x7f9b9c090f30 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9ba230c640 1 --2- 10.20.193.48:0/3221975709 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9b9c090730 0x7f9b9c08fca0 unknown :-1 s=CLOSED pgs=269 gs=2 cs=0 l=1 c_cookie=9682570445975193298 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9ba230c640 1 -- 10.20.193.48:0/3221975709 >> 10.20.193.48:0/3221975709 conn(0x7f9b9c054e50 msgr2=0x7f9b9c0952a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:49.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9ba230c640 1 -- 10.20.193.48:0/3221975709 shutdown_connections 2026-02-12T18:12:49.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.580+0000 7f9ba230c640 1 -- 10.20.193.48:0/3221975709 wait complete. 2026-02-12T18:12:49.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9ba230c640 10 monclient: build_initial_monmap 2026-02-12T18:12:49.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9ba230c640 10 monclient: monmap: 2026-02-12T18:12:49.601 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:49.601 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:12:49.601 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:12:49.602 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:12:49.602 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:49.602 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.602 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:12:49.602 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:12:49.602 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:49.602 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:49.602 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:49.602 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:49.602 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:49.602 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:49.602 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:49.602 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9ba230c640 1 Processor -- start 2026-02-12T18:12:49.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9ba230c640 1 -- start start 2026-02-12T18:12:49.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9ba230c640 10 monclient: init 2026-02-12T18:12:49.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9ba230c640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:49.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9ba230c640 10 monclient: _add_conns ranks=[2,3,1,7,4,5,0,6,8] 2026-02-12T18:12:49.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9ba230c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9b9c090730 0x7f9b9c12e2e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9ba230c640 10 monclient(hunting): picked mon.noname-b con 0x7f9b9c090730 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:12:49.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9ba230c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9b9c090b00 0x7f9b9c12e820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9ba230c640 10 monclient(hunting): picked mon.noname-g con 0x7f9b9c090b00 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:12:49.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9ba230c640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f9b9c1442e0 0x7f9b9c12ed60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9ba230c640 10 monclient(hunting): picked mon.noname-f con 0x7f9b9c1442e0 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:12:49.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9ba230c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9ba230c640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9b9c092870 con 0x7f9b9c1442e0 2026-02-12T18:12:49.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9ba230c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9ba230c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f9b9c10e240 con 0x7f9b9c090730 2026-02-12T18:12:49.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9ba230c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9ba230c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f9b9c08c490 con 0x7f9b9c090b00 2026-02-12T18:12:49.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9ba230c640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:49.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9ba230c640 10 monclient(hunting): authenticate will time out at 1008.307808s 2026-02-12T18:12:49.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9b9bfff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9b9c090730 0x7f9b9c12e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9b9bfff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9b9c090730 0x7f9b9c12e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:41836/0 (socket says 10.20.193.48:41836) 2026-02-12T18:12:49.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9b9bfff640 1 -- 10.20.193.48:0/2464156734 learned_addr learned my addr 10.20.193.48:0/2464156734 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:49.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9b9bfff640 10 monclient(hunting): get_auth_request con 0x7f9b9c090730 auth_method 0 2026-02-12T18:12:49.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9b9bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9b9bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9b9bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9b9bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9b9bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9b9bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.581+0000 7f9b9b7fe640 1 --2- 10.20.193.48:0/2464156734 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9b9c090b00 0x7f9b9c12e820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.582+0000 7f9b9b7fe640 10 monclient(hunting): get_auth_request con 0x7f9b9c090b00 auth_method 0 2026-02-12T18:12:49.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.582+0000 7f9b9b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.582+0000 7f9b9b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.582+0000 7f9b9b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.582+0000 7f9ba0882640 1 --2- 10.20.193.48:0/2464156734 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f9b9c1442e0 0x7f9b9c12ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.582+0000 7f9ba0882640 10 monclient(hunting): get_auth_request con 0x7f9b9c1442e0 auth_method 0 2026-02-12T18:12:49.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.582+0000 7f9ba0882640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.582+0000 7f9ba0882640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.582+0000 7f9ba0882640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.582+0000 7f9b9bfff640 10 monclient(hunting): handle_auth_done global_id 35804 payload 824 2026-02-12T18:12:49.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.582+0000 7f9b9bfff640 1 -- 10.20.193.48:0/2464156734 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9b9c090b00 msgr2=0x7f9b9c12e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.582+0000 7f9b9bfff640 1 --2- 10.20.193.48:0/2464156734 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9b9c090b00 0x7f9b9c12e820 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.582+0000 7f9b9bfff640 1 -- 10.20.193.48:0/2464156734 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f9b9c1442e0 msgr2=0x7f9b9c12ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.582+0000 7f9b9bfff640 1 --2- 10.20.193.48:0/2464156734 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f9b9c1442e0 0x7f9b9c12ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.582+0000 7f9b9bfff640 10 monclient: _finish_hunting 0 2026-02-12T18:12:49.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.582+0000 7f9b9bfff640 1 monclient: found mon.noname-b 2026-02-12T18:12:49.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.582+0000 7f9b9bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:49.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.582+0000 7f9b9bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:12:49.607 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.582+0000 7f9b9bfff640 1 -- 10.20.193.48:0/2464156734 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b9000a500 con 0x7f9b9c090730 2026-02-12T18:12:49.607 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.582+0000 7f9b9b7fe640 1 --2- 10.20.193.48:0/2464156734 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9b9c090b00 0x7f9b9c12e820 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:12:49.607 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.584+0000 7f9b9bfff640 1 -- 10.20.193.48:0/2464156734 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9b9c090730 msgr2=0x7f9b9c12e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:49.607 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.584+0000 7f9b9bfff640 1 --2- 10.20.193.48:0/2464156734 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9b9c090730 0x7f9b9c12e2e0 secure :-1 s=READY pgs=307 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b88004740 tx=0x7f9b88004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:49.607 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.584+0000 7f9b98ff9640 1 -- 10.20.193.48:0/2464156734 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9b88035340 con 0x7f9b9c090730 2026-02-12T18:12:49.607 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.584+0000 7f9b98ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.607 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.584+0000 7f9b98ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:12:49.607 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.584+0000 7f9b98ff9640 10 monclient: dump: 2026-02-12T18:12:49.607 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.607 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.607 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.607 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.608 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.608 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.608 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.608 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.608 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.608 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.608 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.608 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.608 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.608 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.608 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.608 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.608 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.584+0000 7f9b98ff9640 10 monclient: _finish_auth 0 2026-02-12T18:12:49.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.584+0000 7f9b98ff9640 10 monclient: _check_auth_tickets 2026-02-12T18:12:49.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.584+0000 7f9b98ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:49.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.584+0000 7f9b98ff9640 1 -- 10.20.193.48:0/2464156734 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b88035e00 con 0x7f9b9c090730 2026-02-12T18:12:49.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.584+0000 7f9ba230c640 5 monclient: authenticate success, global_id 35804 2026-02-12T18:12:49.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.584+0000 7f9b98ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:49.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.584+0000 7f9ba230c640 10 monclient: _renew_subs 2026-02-12T18:12:49.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.584+0000 7f9ba230c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:12:49.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.584+0000 7f9ba230c640 1 -- 10.20.193.48:0/2464156734 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b880094f0 con 0x7f9b9c090730 2026-02-12T18:12:49.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.584+0000 7f9b9a7fc640 4 set_mon_vals no callback set 2026-02-12T18:12:49.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.584+0000 7f9ba230c640 10 monclient: _renew_subs 2026-02-12T18:12:49.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.584+0000 7f9ba230c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:12:49.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.584+0000 7f9ba230c640 1 -- 10.20.193.48:0/2464156734 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b9c10df60 con 0x7f9b9c090730 2026-02-12T18:12:49.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.584+0000 7f9b98ff9640 1 -- 10.20.193.48:0/2464156734 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9b880044f0 con 0x7f9b9c090730 2026-02-12T18:12:49.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.584+0000 7f9b98ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.584+0000 7f9b98ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:12:49.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.584+0000 7f9b98ff9640 10 monclient: dump: 2026-02-12T18:12:49.610 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.610 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.610 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.610 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.610 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.610 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.610 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.610 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.610 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.611 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.611 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.611 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.611 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.611 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.611 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.611 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.585+0000 7f9ba230c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:49.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.585+0000 7f9ba230c640 1 --2- 10.20.193.48:0/2464156734 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9b9c144a70 0x7f9b9c113220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.585+0000 7f9ba230c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.585+0000 7f9ba230c640 1 -- 10.20.193.48:0/2464156734 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f9b9c144e40 con 0x7f9b9c144a70 2026-02-12T18:12:49.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.585+0000 7f9b9b7fe640 1 --2- 10.20.193.48:0/2464156734 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9b9c144a70 0x7f9b9c113220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.585+0000 7f9b9b7fe640 10 monclient: get_auth_request con 0x7f9b9c144a70 auth_method 0 2026-02-12T18:12:49.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.585+0000 7f9b9b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.585+0000 7f9b9b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.585+0000 7f9b9b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.585+0000 7f9b9b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.585+0000 7f9b9b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.585+0000 7f9b9b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.585+0000 7f9b98ff9640 1 -- 10.20.193.48:0/2464156734 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f9b88004030 con 0x7f9b9c090730 2026-02-12T18:12:49.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.585+0000 7f9b9b7fe640 10 monclient(hunting): handle_auth_done global_id 6129 payload 824 2026-02-12T18:12:49.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.585+0000 7f9b9b7fe640 1 -- 10.20.193.48:0/2464156734 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b9c10e480 con 0x7f9b9c144a70 2026-02-12T18:12:49.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.585+0000 7f9b98ff9640 1 --2- 10.20.193.48:0/2464156734 >> v2:10.20.193.111:6812/977811348 conn(0x7f9b6c03f800 0x7f9b6c05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.585+0000 7f9b98ff9640 1 -- 10.20.193.48:0/2464156734 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(218..218 src has 190..218) ==== 3897+0+0 (secure 0 0 0) 0x7f9b88077fb0 con 0x7f9b9c090730 2026-02-12T18:12:49.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.585+0000 7f9ba0882640 1 --2- 10.20.193.48:0/2464156734 >> v2:10.20.193.111:6812/977811348 conn(0x7f9b6c03f800 0x7f9b6c05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.585+0000 7f9ba0882640 10 monclient: get_auth_request con 0x7f9b6c03f800 auth_method 0 2026-02-12T18:12:49.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.587+0000 7f9b9b7fe640 1 -- 10.20.193.48:0/2464156734 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9b9c144a70 msgr2=0x7f9b9c113220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:49.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.587+0000 7f9b9b7fe640 1 --2- 10.20.193.48:0/2464156734 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9b9c144a70 0x7f9b9c113220 secure :-1 s=READY pgs=462 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b9c08ead0 tx=0x7f9b8c011ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:49.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.587+0000 7f9b98ff9640 1 -- 10.20.193.48:0/2464156734 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9b8c011ec0 con 0x7f9b9c144a70 2026-02-12T18:12:49.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.587+0000 7f9b98ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.587+0000 7f9b98ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:12:49.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.587+0000 7f9b98ff9640 10 monclient: dump: 2026-02-12T18:12:49.613 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.613 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.613 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.613 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.613 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.613 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.614 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.614 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.614 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.614 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.614 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.614 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.614 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.614 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.614 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.614 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.587+0000 7f9b98ff9640 1 -- 10.20.193.48:0/2464156734 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f9b8c00fc20 con 0x7f9b9c144a70 2026-02-12T18:12:49.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.587+0000 7f9b98ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:49.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.587+0000 7f9b98ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:12:49.614 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.587+0000 7f9b98ff9640 1 -- 10.20.193.48:0/2464156734 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9b9c144a70 msgr2=0x7f9b9c113220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.587+0000 7f9b98ff9640 1 --2- 10.20.193.48:0/2464156734 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9b9c144a70 0x7f9b9c113220 secure :-1 s=READY pgs=462 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b9c08ead0 tx=0x7f9b8c011ca0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.587+0000 7f9b98ff9640 1 -- 10.20.193.48:0/2464156734 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9b9c144a70 msgr2=0x7f9b9c113220 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:49.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.587+0000 7f9b98ff9640 1 --2- 10.20.193.48:0/2464156734 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9b9c144a70 0x7f9b9c113220 secure :-1 s=CLOSED pgs=462 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b9c08ead0 tx=0x7f9b8c011ca0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.588+0000 7f9ba0882640 1 --2- 10.20.193.48:0/2464156734 >> v2:10.20.193.111:6812/977811348 conn(0x7f9b6c03f800 0x7f9b6c05fcb0 secure :-1 s=READY pgs=324 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b90005820 tx=0x7f9b90009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:49.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.590+0000 7f9ba230c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:12:49.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.591+0000 7f9ba230c640 1 --2- 10.20.193.48:0/2464156734 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9b9c113760 0x7f9b9c113b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.591+0000 7f9ba230c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.591+0000 7f9ba230c640 1 -- 10.20.193.48:0/2464156734 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f9b9c050410 con 0x7f9b9c113760 2026-02-12T18:12:49.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.591+0000 7f9b9b7fe640 1 --2- 10.20.193.48:0/2464156734 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9b9c113760 0x7f9b9c113b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.591+0000 7f9b9b7fe640 10 monclient: get_auth_request con 0x7f9b9c113760 auth_method 0 2026-02-12T18:12:49.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.591+0000 7f9b9b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.591+0000 7f9b9b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.591+0000 7f9b9b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.591+0000 7f9b9b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.591+0000 7f9b9b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.591+0000 7f9b9b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.591+0000 7f9b9b7fe640 10 monclient(hunting): handle_auth_done global_id 6138 payload 824 2026-02-12T18:12:49.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.591+0000 7f9b9b7fe640 1 -- 10.20.193.48:0/2464156734 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9b9c114070 con 0x7f9b9c113760 2026-02-12T18:12:49.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.593+0000 7f9b9b7fe640 1 -- 10.20.193.48:0/2464156734 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9b9c113760 msgr2=0x7f9b9c113b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:49.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.593+0000 7f9b9b7fe640 1 --2- 10.20.193.48:0/2464156734 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9b9c113760 0x7f9b9c113b30 secure :-1 s=READY pgs=463 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b8c019000 tx=0x7f9b8c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:49.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.593+0000 7f9b98ff9640 1 -- 10.20.193.48:0/2464156734 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9b8c024070 con 0x7f9b9c113760 2026-02-12T18:12:49.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.593+0000 7f9b98ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.593+0000 7f9b98ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:12:49.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.593+0000 7f9b98ff9640 10 monclient: dump: 2026-02-12T18:12:49.616 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.616 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.617 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.617 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.617 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.617 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.617 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.617 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.617 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.617 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.617 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.617 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.617 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.617 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.617 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.617 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.617 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.593+0000 7f9b98ff9640 1 -- 10.20.193.48:0/2464156734 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10184 (secure 0 0 0) 0x7f9b8c0062d0 con 0x7f9b9c113760 2026-02-12T18:12:49.617 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.593+0000 7f9b98ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:12:49.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.593+0000 7f9b98ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:12:49.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.593+0000 7f9b98ff9640 1 -- 10.20.193.48:0/2464156734 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9b9c113760 msgr2=0x7f9b9c113b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.593+0000 7f9b98ff9640 1 --2- 10.20.193.48:0/2464156734 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9b9c113760 0x7f9b9c113b30 secure :-1 s=READY pgs=463 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b8c019000 tx=0x7f9b8c004770 comp rx=0 tx=0).stop 2026-02-12T18:12:49.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.593+0000 7f9b98ff9640 1 -- 10.20.193.48:0/2464156734 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9b9c113760 msgr2=0x7f9b9c113b30 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:49.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.593+0000 7f9b98ff9640 1 --2- 10.20.193.48:0/2464156734 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9b9c113760 0x7f9b9c113b30 secure :-1 s=CLOSED pgs=463 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b8c019000 tx=0x7f9b8c004770 comp rx=0 tx=0).stop 2026-02-12T18:12:49.618 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:12:49.618 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:12:49.618 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:12:49.618 INFO:teuthology.orchestra.run.trial048.stdout: "state": "leader", 2026-02-12T18:12:49.619 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 68, 2026-02-12T18:12:49.619 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 424427, 2026-02-12T18:12:49.619 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:12:49.619 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:12:49.619 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:12:49.619 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:12:49.619 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:12:49.619 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:12:49.619 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:12:49.619 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:12:49.619 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:12:49.619 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:12:49.619 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:49.619 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:12:49.619 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:49.620 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:12:49.620 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:12:49.620 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:49.620 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:49.620 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:49.620 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:49.620 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:49.620 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:49.620 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:49.620 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:49.620 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:49.620 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:49.620 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:49.620 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:49.620 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:49.620 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:49.620 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:12:49.621 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:12:49.621 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:49.621 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:49.621 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:49.621 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:49.621 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:49.621 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:49.621 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:49.621 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:49.621 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:49.621 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:49.621 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:49.621 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:49.621 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:49.622 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.622 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.622 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:12:49.622 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:12:49.622 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:12:49.622 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:12:49.622 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:12:49.622 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:12:49.622 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:49.622 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:49.622 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:12:49.622 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:12:49.622 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:12:49.622 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:12:49.622 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:12:49.622 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:12:49.623 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:12:49.623 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:49.623 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:12:49.623 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:49.623 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:49.623 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:49.623 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:49.623 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:49.623 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:49.623 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:49.623 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:49.623 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:49.623 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:49.623 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:49.623 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:49.623 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:49.623 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:49.623 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:12:49.624 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.624 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:12:49.624 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.624 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:12:49.624 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:12:49.624 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.624 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.624 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.624 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.624 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:12:49.624 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.624 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.624 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.624 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.624 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:12:49.624 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.624 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.624 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.624 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.625 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:12:49.625 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:12:49.625 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.625 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.625 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:12:49.625 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.625 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.625 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.625 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:12:49.625 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:12:49.625 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.625 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.625 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.625 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.625 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:12:49.625 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.625 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.625 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.625 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.626 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:12:49.626 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.626 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.626 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.626 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.626 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:12:49.626 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:12:49.626 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.626 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.626 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:12:49.626 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.626 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.626 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.626 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:12:49.626 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:12:49.626 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.626 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.626 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.626 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.627 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:12:49.627 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.627 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.627 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.627 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.627 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:12:49.627 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.627 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.627 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.627 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.627 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:12:49.627 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:12:49.627 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.627 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.627 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:12:49.627 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.627 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.627 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.627 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:12:49.627 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:12:49.627 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.628 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.628 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.628 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.628 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:12:49.628 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.628 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.628 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.628 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.628 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:12:49.628 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.628 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.628 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.628 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.628 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:12:49.628 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:12:49.628 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.628 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.628 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:12:49.628 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.628 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.628 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.629 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:12:49.629 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:12:49.629 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.629 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.629 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.629 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.629 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:12:49.629 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.629 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.629 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.629 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.629 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:12:49.629 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.629 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.629 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.629 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.629 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:12:49.629 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:12:49.629 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.629 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.629 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:49.629 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.630 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.630 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.630 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:12:49.630 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:12:49.630 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.630 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.630 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.630 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.630 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:12:49.630 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.630 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.630 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.630 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.630 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:12:49.630 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.630 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.630 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.630 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.630 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:12:49.630 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:12:49.630 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.630 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.631 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:12:49.631 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.631 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.631 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.631 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:12:49.631 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:12:49.631 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.631 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.631 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.631 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.631 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:12:49.631 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.631 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.631 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.631 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.631 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:12:49.631 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.631 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.631 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.631 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.631 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:12:49.631 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:12:49.631 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.632 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.632 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:49.632 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.632 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.632 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.632 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:12:49.632 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:12:49.632 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.632 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.632 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.632 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.632 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:12:49.632 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.632 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.632 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.632 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.632 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:12:49.632 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.632 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.632 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.632 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.633 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:12:49.633 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:12:49.633 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.633 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.633 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:12:49.633 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.633 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.633 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.633 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:12:49.633 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:12:49.633 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.633 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.633 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.633 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.633 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:12:49.633 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.633 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.633 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.633 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.633 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:12:49.633 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.633 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.633 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.634 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.634 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:12:49.634 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:12:49.634 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.634 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.634 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:12:49.634 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.634 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.634 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.634 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.634 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:12:49.634 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:12:49.634 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.634 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:49.634 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:49.634 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:49.634 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.634 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:49.634 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:12:49.634 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.634 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:49.634 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:49.634 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:12:49.634 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.635 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:49.635 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:12:49.635 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.635 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:49.635 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:49.635 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:12:49.635 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.635 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.635 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.635 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:12:49.635 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:12:49.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.594+0000 7f9ba230c640 1 -- 10.20.193.48:0/2464156734 >> v2:10.20.193.111:6812/977811348 conn(0x7f9b6c03f800 msgr2=0x7f9b6c05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.594+0000 7f9ba230c640 1 --2- 10.20.193.48:0/2464156734 >> v2:10.20.193.111:6812/977811348 conn(0x7f9b6c03f800 0x7f9b6c05fcb0 secure :-1 s=READY pgs=324 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b90005820 tx=0x7f9b90009040 comp rx=0 tx=0).stop 2026-02-12T18:12:49.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.594+0000 7f9ba230c640 10 monclient: shutdown 2026-02-12T18:12:49.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.594+0000 7f9ba230c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:49.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.594+0000 7f9ba230c640 1 -- 10.20.193.48:0/2464156734 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9b9c090730 msgr2=0x7f9b9c12e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.594+0000 7f9ba230c640 1 --2- 10.20.193.48:0/2464156734 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9b9c090730 0x7f9b9c12e2e0 secure :-1 s=READY pgs=307 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9b88004740 tx=0x7f9b88004770 comp rx=0 tx=0).stop 2026-02-12T18:12:49.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.594+0000 7f9ba0882640 1 -- 10.20.193.48:0/2464156734 reap_dead start 2026-02-12T18:12:49.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.594+0000 7f9ba0882640 1 -- 10.20.193.48:0/2464156734 reap_dead start 2026-02-12T18:12:49.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.594+0000 7f9ba230c640 1 -- 10.20.193.48:0/2464156734 shutdown_connections 2026-02-12T18:12:49.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.594+0000 7f9ba230c640 1 -- 10.20.193.48:0/2464156734 >> 10.20.193.48:0/2464156734 conn(0x7f9b9c054e50 msgr2=0x7f9b9c08aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:49.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.594+0000 7f9ba230c640 1 -- 10.20.193.48:0/2464156734 shutdown_connections 2026-02-12T18:12:49.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.594+0000 7f9ba230c640 1 -- 10.20.193.48:0/2464156734 wait complete. 2026-02-12T18:12:49.637 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:12:49.637 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2026-02-12T18:12:49.637 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T18:12:49.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.700+0000 7f13df2cc640 10 monclient: get_monmap_and_config 2026-02-12T18:12:49.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.700+0000 7f13df2cc640 10 monclient: build_initial_monmap 2026-02-12T18:12:49.701 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.700+0000 7f13df2cc640 10 monclient: monmap: 2026-02-12T18:12:49.701 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:49.701 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.702 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:12:49.701404+0000 2026-02-12T18:12:49.702 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:12:49.701404+0000 2026-02-12T18:12:49.702 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:49.702 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.702 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:12:49.702 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:12:49.702 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:49.702 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:49.702 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:49.702 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:49.702 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:49.702 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:49.702 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:49.702 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:12:49.702 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:12:49.702 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.700+0000 7f13df2cc640 1 Processor -- start 2026-02-12T18:12:49.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.700+0000 7f13df2cc640 1 -- start start 2026-02-12T18:12:49.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.700+0000 7f13df2cc640 10 monclient: init 2026-02-12T18:12:49.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13df2cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:49.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13df2cc640 10 monclient: _add_conns ranks=[3,4,1,7,10,0,9,5,6,8,2] 2026-02-12T18:12:49.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13df2cc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f13d805d550 0x7f13d805d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13df2cc640 10 monclient(hunting): picked mon.noname-g con 0x7f13d805d550 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:12:49.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13df2cc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f13d805de60 0x7f13d8141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13df2cc640 10 monclient(hunting): picked mon.noname-c con 0x7f13d805de60 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:12:49.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13df2cc640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f13d813ef60 addr v1:10.20.193.111:6789/0 2026-02-12T18:12:49.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13df2cc640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13d804dc20 con 0x7f13d813ef60 2026-02-12T18:12:49.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13df2cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13df2cc640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f13d808d390 con 0x7f13d805d550 2026-02-12T18:12:49.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13df2cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13df2cc640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f13d808d5a0 con 0x7f13d805de60 2026-02-12T18:12:49.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13df2cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:49.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13df2cc640 10 monclient(hunting): authenticate will time out at 1008.427123s 2026-02-12T18:12:49.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dc840640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f13d805de60 0x7f13d8141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dc840640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f13d805de60 0x7f13d8141fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:48512/0 (socket says 10.20.193.48:48512) 2026-02-12T18:12:49.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dc840640 1 -- 10.20.193.48:0/944458032 learned_addr learned my addr 10.20.193.48:0/944458032 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:49.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dc840640 10 monclient(hunting): get_auth_request con 0x7f13d805de60 auth_method 0 2026-02-12T18:12:49.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dc840640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dc840640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dc840640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dd041640 1 --2- 10.20.193.48:0/944458032 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f13d805d550 0x7f13d805d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dd041640 10 monclient(hunting): get_auth_request con 0x7f13d805d550 auth_method 0 2026-02-12T18:12:49.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dd041640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dd041640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dd041640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dc840640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dc840640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dc840640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dd041640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dd041640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dd041640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dc840640 10 monclient(hunting): handle_auth_done global_id 64345 payload 274 2026-02-12T18:12:49.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dc840640 1 -- 10.20.193.48:0/944458032 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f13d805d550 msgr2=0x7f13d805d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:49.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dc840640 1 --2- 10.20.193.48:0/944458032 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f13d805d550 0x7f13d805d920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dc840640 1 -- 10.20.193.48:0/944458032 >> v1:10.20.193.111:6789/0 conn(0x7f13d813ef60 legacy=0x7f13d81424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:49.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dc840640 10 monclient: _finish_hunting 0 2026-02-12T18:12:49.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dc840640 1 monclient: found mon.noname-c 2026-02-12T18:12:49.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dc840640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:49.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dc840640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:12:49.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.701+0000 7f13dc840640 1 -- 10.20.193.48:0/944458032 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13d80580e0 con 0x7f13d805de60 2026-02-12T18:12:49.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.703+0000 7f13dc840640 1 -- 10.20.193.48:0/944458032 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f13d805de60 msgr2=0x7f13d8141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:49.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.703+0000 7f13dc840640 1 --2- 10.20.193.48:0/944458032 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f13d805de60 0x7f13d8141fa0 secure :-1 s=READY pgs=102 gs=2 cs=0 l=1 c_cookie=15453927587093074648 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13cc0098d0 tx=0x7f13cc02ee20 comp rx=0 tx=0).ready entity=mon.4 client_cookie=d6776143154ad2d8 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:49.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13c7fff640 1 -- 10.20.193.48:0/944458032 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f13cc035340 con 0x7f13d805de60 2026-02-12T18:12:49.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13c7fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:12:49.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13c7fff640 10 monclient: dump: 2026-02-12T18:12:49.711 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.712 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.712 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.712 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.712 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.712 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.712 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.712 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.712 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.712 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.712 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.712 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.712 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.712 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.712 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.712 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13c7fff640 10 monclient: _finish_auth 0 2026-02-12T18:12:49.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13c7fff640 10 monclient: _check_auth_tickets 2026-02-12T18:12:49.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13c7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:49.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13c7fff640 1 -- 10.20.193.48:0/944458032 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13cc0354c0 con 0x7f13d805de60 2026-02-12T18:12:49.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13df2cc640 5 monclient: authenticate success, global_id 64345 2026-02-12T18:12:49.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13df2cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:12:49.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13c7fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:49.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13c7fff640 1 -- 10.20.193.48:0/944458032 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f13cc035af0 con 0x7f13d805de60 2026-02-12T18:12:49.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13df2cc640 10 monclient: get_monmap_and_config success 2026-02-12T18:12:49.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13df2cc640 4 set_mon_vals no callback set 2026-02-12T18:12:49.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13c7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13c7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:12:49.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13c7fff640 10 monclient: dump: 2026-02-12T18:12:49.713 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.713 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.713 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.713 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.713 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.713 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.713 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.713 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.713 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.714 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.714 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.714 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.714 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.714 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.714 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.714 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13df2cc640 10 monclient: shutdown 2026-02-12T18:12:49.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13df2cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:49.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13df2cc640 1 -- 10.20.193.48:0/944458032 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f13d805de60 msgr2=0x7f13d8141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13df2cc640 1 --2- 10.20.193.48:0/944458032 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f13d805de60 0x7f13d8141fa0 secure :-1 s=READY pgs=102 gs=2 cs=0 l=1 c_cookie=15453927587093074648 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13cc0098d0 tx=0x7f13cc02ee20 comp rx=0 tx=0).stop 2026-02-12T18:12:49.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13df2cc640 1 -- 10.20.193.48:0/944458032 shutdown_connections 2026-02-12T18:12:49.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13df2cc640 1 --2- 10.20.193.48:0/944458032 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f13d805de60 0x7f13d8141fa0 unknown :-1 s=CLOSED pgs=102 gs=2 cs=0 l=1 c_cookie=15453927587093074648 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13df2cc640 1 --2- 10.20.193.48:0/944458032 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f13d805d550 0x7f13d805d920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13df2cc640 1 -- 10.20.193.48:0/944458032 >> 10.20.193.48:0/944458032 conn(0x7f13d80546a0 msgr2=0x7f13d8054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:49.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13df2cc640 1 -- 10.20.193.48:0/944458032 shutdown_connections 2026-02-12T18:12:49.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13df2cc640 1 -- 10.20.193.48:0/944458032 wait complete. 2026-02-12T18:12:49.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13df2cc640 10 monclient: build_initial_monmap 2026-02-12T18:12:49.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.704+0000 7f13df2cc640 10 monclient: monmap: 2026-02-12T18:12:49.715 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:49.715 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:12:49.715 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:12:49.715 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:12:49.715 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:49.715 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.715 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:12:49.715 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:12:49.715 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:49.715 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:49.715 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:49.715 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:49.715 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:49.715 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:49.715 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:49.715 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13df2cc640 1 Processor -- start 2026-02-12T18:12:49.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13df2cc640 1 -- start start 2026-02-12T18:12:49.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13df2cc640 10 monclient: init 2026-02-12T18:12:49.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13df2cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:49.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13df2cc640 10 monclient: _add_conns ranks=[8,4,7,3,0,1,2,5,6] 2026-02-12T18:12:49.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13df2cc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f13d805d550 0x7f13d8131e70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13df2cc640 10 monclient(hunting): picked mon.noname-e con 0x7f13d805d550 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:12:49.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13df2cc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f13d805de60 0x7f13d810b7e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13df2cc640 10 monclient(hunting): picked mon.noname-c con 0x7f13d805de60 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:12:49.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13df2cc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f13d813ef60 0x7f13d810bd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13df2cc640 10 monclient(hunting): picked mon.noname-i con 0x7f13d813ef60 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:12:49.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13df2cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13df2cc640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f13d810d140 con 0x7f13d805de60 2026-02-12T18:12:49.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13df2cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13df2cc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f13d81204a0 con 0x7f13d813ef60 2026-02-12T18:12:49.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13df2cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13df2cc640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f13d810ec00 con 0x7f13d805d550 2026-02-12T18:12:49.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13df2cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:49.716 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13df2cc640 10 monclient(hunting): authenticate will time out at 1008.431471s 2026-02-12T18:12:49.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dc840640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f13d805de60 0x7f13d810b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dc840640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f13d805de60 0x7f13d810b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:48514/0 (socket says 10.20.193.48:48514) 2026-02-12T18:12:49.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dc840640 1 -- 10.20.193.48:0/2652071806 learned_addr learned my addr 10.20.193.48:0/2652071806 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:49.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dc840640 10 monclient(hunting): get_auth_request con 0x7f13d805de60 auth_method 0 2026-02-12T18:12:49.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dc840640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dc840640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dc840640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dd041640 1 --2- 10.20.193.48:0/2652071806 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f13d805d550 0x7f13d8131e70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dc840640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dc840640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dc840640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dd041640 10 monclient(hunting): get_auth_request con 0x7f13d805d550 auth_method 0 2026-02-12T18:12:49.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dd041640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dd041640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dd041640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dd842640 1 --2- 10.20.193.48:0/2652071806 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f13d813ef60 0x7f13d810bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dd041640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dd041640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dd041640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dd842640 10 monclient(hunting): get_auth_request con 0x7f13d813ef60 auth_method 0 2026-02-12T18:12:49.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dd842640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dd842640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dd842640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dc840640 10 monclient(hunting): handle_auth_done global_id 64354 payload 824 2026-02-12T18:12:49.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dc840640 1 -- 10.20.193.48:0/2652071806 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f13d805d550 msgr2=0x7f13d8131e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dc840640 1 --2- 10.20.193.48:0/2652071806 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f13d805d550 0x7f13d8131e70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dc840640 1 -- 10.20.193.48:0/2652071806 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f13d813ef60 msgr2=0x7f13d810bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dc840640 1 --2- 10.20.193.48:0/2652071806 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f13d813ef60 0x7f13d810bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dc840640 10 monclient: _finish_hunting 0 2026-02-12T18:12:49.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dc840640 1 monclient: found mon.noname-c 2026-02-12T18:12:49.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dc840640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:49.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dc840640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:12:49.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.705+0000 7f13dc840640 1 -- 10.20.193.48:0/2652071806 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13cc0094f0 con 0x7f13d805de60 2026-02-12T18:12:49.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13dc840640 1 -- 10.20.193.48:0/2652071806 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f13d805de60 msgr2=0x7f13d810b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:49.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13dc840640 1 --2- 10.20.193.48:0/2652071806 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f13d805de60 0x7f13d810b7e0 secure :-1 s=READY pgs=103 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13cc004740 tx=0x7f13cc004770 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:49.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13c5ffb640 1 -- 10.20.193.48:0/2652071806 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f13cc035e00 con 0x7f13d805de60 2026-02-12T18:12:49.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13c5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:12:49.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13c5ffb640 10 monclient: dump: 2026-02-12T18:12:49.719 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.719 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.719 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.719 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.719 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.719 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.719 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.719 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.719 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.719 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.719 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.719 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.719 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.719 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.719 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.719 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13c5ffb640 10 monclient: _finish_auth 0 2026-02-12T18:12:49.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13c5ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:12:49.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13c5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:49.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13df2cc640 5 monclient: authenticate success, global_id 64354 2026-02-12T18:12:49.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13c5ffb640 1 -- 10.20.193.48:0/2652071806 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13cc0044f0 con 0x7f13d805de60 2026-02-12T18:12:49.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13c5ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:49.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13c5ffb640 1 -- 10.20.193.48:0/2652071806 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f13cc003b90 con 0x7f13d805de60 2026-02-12T18:12:49.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13c77fe640 4 set_mon_vals no callback set 2026-02-12T18:12:49.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13c5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:12:49.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13c5ffb640 10 monclient: dump: 2026-02-12T18:12:49.720 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.720 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.720 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.720 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.720 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.720 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.720 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.720 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.721 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.721 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.721 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.721 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.721 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.721 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.721 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.721 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13df2cc640 10 monclient: _renew_subs 2026-02-12T18:12:49.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13df2cc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:12:49.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13df2cc640 1 -- 10.20.193.48:0/2652071806 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13d810eee0 con 0x7f13d805de60 2026-02-12T18:12:49.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13df2cc640 10 monclient: _renew_subs 2026-02-12T18:12:49.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13df2cc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:12:49.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13df2cc640 1 -- 10.20.193.48:0/2652071806 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f13d81207e0 con 0x7f13d805de60 2026-02-12T18:12:49.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13df2cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:49.721 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13df2cc640 1 --2- 10.20.193.48:0/2652071806 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f13d8091010 0x7f13d810c260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13df2cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13df2cc640 1 -- 10.20.193.48:0/2652071806 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f13d80631f0 con 0x7f13d8091010 2026-02-12T18:12:49.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13dd041640 1 --2- 10.20.193.48:0/2652071806 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f13d8091010 0x7f13d810c260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13dd041640 10 monclient: get_auth_request con 0x7f13d8091010 auth_method 0 2026-02-12T18:12:49.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13dd041640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13dd041640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13dd041640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13dd041640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13dd041640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13dd041640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.708+0000 7f13c5ffb640 1 -- 10.20.193.48:0/2652071806 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f13cc003cf0 con 0x7f13d805de60 2026-02-12T18:12:49.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.709+0000 7f13dd041640 10 monclient(hunting): handle_auth_done global_id 35813 payload 824 2026-02-12T18:12:49.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.709+0000 7f13dd041640 1 -- 10.20.193.48:0/2652071806 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f13d808d060 con 0x7f13d8091010 2026-02-12T18:12:49.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.709+0000 7f13c5ffb640 1 --2- 10.20.193.48:0/2652071806 >> v2:10.20.193.111:6812/977811348 conn(0x7f13a803f800 0x7f13a805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.709+0000 7f13c5ffb640 1 -- 10.20.193.48:0/2652071806 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(218..218 src has 190..218) ==== 3897+0+0 (secure 0 0 0) 0x7f13cc077f60 con 0x7f13d805de60 2026-02-12T18:12:49.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.709+0000 7f13dd842640 1 --2- 10.20.193.48:0/2652071806 >> v2:10.20.193.111:6812/977811348 conn(0x7f13a803f800 0x7f13a805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.709+0000 7f13dd842640 10 monclient: get_auth_request con 0x7f13a803f800 auth_method 0 2026-02-12T18:12:49.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.711+0000 7f13dd041640 1 -- 10.20.193.48:0/2652071806 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f13d8091010 msgr2=0x7f13d810c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:49.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.711+0000 7f13dd041640 1 --2- 10.20.193.48:0/2652071806 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f13d8091010 0x7f13d810c260 secure :-1 s=READY pgs=308 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13c80118d0 tx=0x7f13c8011da0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:49.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.711+0000 7f13c5ffb640 1 -- 10.20.193.48:0/2652071806 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f13c800fd50 con 0x7f13d8091010 2026-02-12T18:12:49.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.711+0000 7f13c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.711+0000 7f13c5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:12:49.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.711+0000 7f13c5ffb640 10 monclient: dump: 2026-02-12T18:12:49.725 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.725 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.725 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.725 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.725 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.725 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.725 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.725 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.725 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.725 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.725 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.725 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.726 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.726 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.726 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.726 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.711+0000 7f13c5ffb640 1 -- 10.20.193.48:0/2652071806 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f13c800feb0 con 0x7f13d8091010 2026-02-12T18:12:49.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.711+0000 7f13c5ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:49.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.711+0000 7f13c5ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:12:49.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.711+0000 7f13c5ffb640 1 -- 10.20.193.48:0/2652071806 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f13d8091010 msgr2=0x7f13d810c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.711+0000 7f13c5ffb640 1 --2- 10.20.193.48:0/2652071806 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f13d8091010 0x7f13d810c260 secure :-1 s=READY pgs=308 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13c80118d0 tx=0x7f13c8011da0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.711+0000 7f13c5ffb640 1 -- 10.20.193.48:0/2652071806 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f13d8091010 msgr2=0x7f13d810c260 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:49.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.711+0000 7f13c5ffb640 1 --2- 10.20.193.48:0/2652071806 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f13d8091010 0x7f13d810c260 secure :-1 s=CLOSED pgs=308 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13c80118d0 tx=0x7f13c8011da0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.712+0000 7f13dd842640 1 --2- 10.20.193.48:0/2652071806 >> v2:10.20.193.111:6812/977811348 conn(0x7f13a803f800 0x7f13a805fcb0 secure :-1 s=READY pgs=325 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13d810daa0 tx=0x7f13d400a040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:49.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.715+0000 7f13df2cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:12:49.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.715+0000 7f13df2cc640 1 --2- 10.20.193.48:0/2652071806 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f13d8131560 0x7f13d808a680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.715+0000 7f13df2cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.715+0000 7f13df2cc640 1 -- 10.20.193.48:0/2652071806 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f13d8050410 con 0x7f13d8131560 2026-02-12T18:12:49.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.715+0000 7f13dd041640 1 --2- 10.20.193.48:0/2652071806 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f13d8131560 0x7f13d808a680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.715+0000 7f13dd041640 10 monclient: get_auth_request con 0x7f13d8131560 auth_method 0 2026-02-12T18:12:49.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.715+0000 7f13dd041640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.715+0000 7f13dd041640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.715+0000 7f13dd041640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.715+0000 7f13dd041640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.715+0000 7f13dd041640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.715+0000 7f13dd041640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.715+0000 7f13dd041640 10 monclient(hunting): handle_auth_done global_id 35822 payload 824 2026-02-12T18:12:49.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.715+0000 7f13dd041640 1 -- 10.20.193.48:0/2652071806 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f13d805e310 con 0x7f13d8131560 2026-02-12T18:12:49.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.717+0000 7f13dd041640 1 -- 10.20.193.48:0/2652071806 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f13d8131560 msgr2=0x7f13d808a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:49.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.717+0000 7f13dd041640 1 --2- 10.20.193.48:0/2652071806 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f13d8131560 0x7f13d808a680 secure :-1 s=READY pgs=309 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13c80093d0 tx=0x7f13c8004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:49.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.717+0000 7f13c5ffb640 1 -- 10.20.193.48:0/2652071806 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f13c8003e20 con 0x7f13d8131560 2026-02-12T18:12:49.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.717+0000 7f13c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.717+0000 7f13c5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:12:49.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.717+0000 7f13c5ffb640 10 monclient: dump: 2026-02-12T18:12:49.727 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.727 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.727 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.728 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.728 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.728 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.728 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.728 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.728 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.728 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.728 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.728 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.728 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.728 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.728 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.728 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.718+0000 7f13c5ffb640 1 -- 10.20.193.48:0/2652071806 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10015 (secure 0 0 0) 0x7f13c801e660 con 0x7f13d8131560 2026-02-12T18:12:49.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.718+0000 7f13c5ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:12:49.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.718+0000 7f13c5ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:12:49.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.718+0000 7f13c5ffb640 1 -- 10.20.193.48:0/2652071806 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f13d8131560 msgr2=0x7f13d808a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.718+0000 7f13c5ffb640 1 --2- 10.20.193.48:0/2652071806 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f13d8131560 0x7f13d808a680 secure :-1 s=READY pgs=309 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13c80093d0 tx=0x7f13c8004770 comp rx=0 tx=0).stop 2026-02-12T18:12:49.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.718+0000 7f13c5ffb640 1 -- 10.20.193.48:0/2652071806 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f13d8131560 msgr2=0x7f13d808a680 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:49.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.718+0000 7f13c5ffb640 1 --2- 10.20.193.48:0/2652071806 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f13d8131560 0x7f13d808a680 secure :-1 s=CLOSED pgs=309 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13c80093d0 tx=0x7f13c8004770 comp rx=0 tx=0).stop 2026-02-12T18:12:49.729 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:12:49.729 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:12:49.729 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:12:49.729 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:12:49.729 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 68, 2026-02-12T18:12:49.729 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 424550, 2026-02-12T18:12:49.729 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:12:49.729 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:12:49.729 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:12:49.729 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:12:49.730 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:12:49.730 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:12:49.730 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:12:49.730 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:12:49.730 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:12:49.730 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:12:49.730 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:49.730 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:12:49.730 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:49.730 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:12:49.730 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:12:49.730 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:49.730 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:49.730 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:49.730 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:49.730 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:49.730 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:49.731 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:49.731 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:49.731 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:49.731 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:49.731 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:49.731 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:49.731 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:49.731 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:49.731 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:12:49.731 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:12:49.731 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:49.731 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:49.731 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:49.731 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:49.731 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:49.731 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:49.731 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:49.731 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:49.732 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:49.732 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:49.732 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:49.732 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:49.732 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:49.732 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.732 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.732 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:12:49.732 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:12:49.732 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:12:49.732 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:12:49.732 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:12:49.732 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:12:49.732 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:49.732 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:49.732 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:12:49.732 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:12:49.732 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:12:49.733 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:12:49.733 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:12:49.733 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:12:49.733 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:12:49.733 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:49.733 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:12:49.733 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:49.733 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:49.733 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:49.733 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:49.733 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:49.733 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:49.733 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:49.733 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:49.733 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:49.733 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:49.733 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:49.733 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:49.733 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:49.734 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:49.734 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:12:49.734 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.734 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:12:49.734 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.734 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:12:49.734 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:12:49.734 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.734 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.734 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.734 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.734 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:12:49.734 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.734 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.734 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.734 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.734 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:12:49.734 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.734 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.734 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.735 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.735 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:12:49.735 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:12:49.735 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.735 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.735 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:12:49.735 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.735 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.735 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.735 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:12:49.735 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:12:49.735 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.735 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.735 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.735 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.735 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:12:49.735 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.735 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.735 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.735 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.736 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:12:49.736 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.736 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.736 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.736 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.736 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:12:49.736 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:12:49.736 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.736 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.736 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:12:49.736 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.736 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.736 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.736 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:12:49.736 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:12:49.736 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.736 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.736 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.736 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.736 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:12:49.737 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.737 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.737 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.737 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.737 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:12:49.737 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.737 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.737 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.737 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.737 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:12:49.737 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:12:49.737 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.737 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.737 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:12:49.737 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.737 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.737 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.737 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:12:49.737 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:12:49.737 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.737 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.737 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.738 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.738 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:12:49.738 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.738 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.738 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.738 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.738 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:12:49.738 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.738 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.738 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.738 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.738 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:12:49.738 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:12:49.738 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.738 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.738 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:12:49.738 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.738 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.738 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.738 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:12:49.738 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:12:49.738 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.739 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.739 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.739 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.739 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:12:49.739 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.739 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.739 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.739 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.739 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:12:49.739 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.739 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.739 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.739 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.739 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:12:49.739 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:12:49.739 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.739 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.739 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:49.739 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.739 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.739 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.739 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:12:49.740 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:12:49.740 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.740 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.740 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.740 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.740 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:12:49.740 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.740 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.740 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.740 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.740 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:12:49.740 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.740 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.740 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.740 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.740 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:12:49.740 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:12:49.740 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.740 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.740 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:12:49.740 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.741 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.741 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.741 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:12:49.741 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:12:49.741 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.741 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.741 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.741 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.741 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:12:49.741 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.741 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.741 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.741 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.741 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:12:49.741 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.741 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.741 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.741 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.741 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:12:49.741 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:12:49.741 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.741 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.741 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:49.742 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.742 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.742 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.742 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:12:49.742 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:12:49.742 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.742 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.742 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.742 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.742 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:12:49.742 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.742 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.742 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.742 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.742 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:12:49.742 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.742 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.742 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.742 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.742 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:12:49.742 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:12:49.742 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.743 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.743 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:12:49.743 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.743 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.743 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.743 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:12:49.743 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:12:49.743 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.743 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.743 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.743 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.743 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:12:49.743 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.743 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.743 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.743 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.743 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:12:49.743 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.743 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.743 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.743 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.743 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:12:49.743 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:12:49.743 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.744 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.744 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:12:49.744 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.744 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.744 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.744 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.744 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:12:49.744 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:12:49.744 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.744 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:49.744 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:49.744 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:49.744 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.744 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:49.744 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:12:49.744 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.744 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:49.744 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:49.744 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:12:49.744 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.744 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.744 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.744 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:12:49.745 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:12:49.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.718+0000 7f13df2cc640 1 -- 10.20.193.48:0/2652071806 >> v2:10.20.193.111:6812/977811348 conn(0x7f13a803f800 msgr2=0x7f13a805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.718+0000 7f13df2cc640 1 --2- 10.20.193.48:0/2652071806 >> v2:10.20.193.111:6812/977811348 conn(0x7f13a803f800 0x7f13a805fcb0 secure :-1 s=READY pgs=325 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13d810daa0 tx=0x7f13d400a040 comp rx=0 tx=0).stop 2026-02-12T18:12:49.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.718+0000 7f13df2cc640 10 monclient: shutdown 2026-02-12T18:12:49.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.718+0000 7f13df2cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:49.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.718+0000 7f13df2cc640 1 -- 10.20.193.48:0/2652071806 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f13d805de60 msgr2=0x7f13d810b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.718+0000 7f13df2cc640 1 --2- 10.20.193.48:0/2652071806 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f13d805de60 0x7f13d810b7e0 secure :-1 s=READY pgs=103 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f13cc004740 tx=0x7f13cc004770 comp rx=0 tx=0).stop 2026-02-12T18:12:49.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.718+0000 7f13dd842640 1 -- 10.20.193.48:0/2652071806 reap_dead start 2026-02-12T18:12:49.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.718+0000 7f13df2cc640 1 -- 10.20.193.48:0/2652071806 shutdown_connections 2026-02-12T18:12:49.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.718+0000 7f13df2cc640 1 --2- 10.20.193.48:0/2652071806 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f13d805de60 0x7f13d810b7e0 unknown :-1 s=CLOSED pgs=103 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.718+0000 7f13df2cc640 1 -- 10.20.193.48:0/2652071806 >> 10.20.193.48:0/2652071806 conn(0x7f13d80546a0 msgr2=0x7f13d813c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:49.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.718+0000 7f13df2cc640 1 -- 10.20.193.48:0/2652071806 shutdown_connections 2026-02-12T18:12:49.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.718+0000 7f13df2cc640 1 -- 10.20.193.48:0/2652071806 wait complete. 2026-02-12T18:12:49.746 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:12:49.746 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2026-02-12T18:12:49.746 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T18:12:49.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f20023b9640 10 monclient: get_monmap_and_config 2026-02-12T18:12:49.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f20023b9640 10 monclient: build_initial_monmap 2026-02-12T18:12:49.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f20023b9640 10 monclient: monmap: 2026-02-12T18:12:49.813 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:49.813 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.813 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:12:49.813126+0000 2026-02-12T18:12:49.813 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:12:49.813126+0000 2026-02-12T18:12:49.813 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:49.813 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.813 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:12:49.813 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:12:49.813 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:49.813 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:49.814 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:49.814 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:49.814 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:49.814 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:49.814 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:49.814 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:12:49.814 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:12:49.814 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f20023b9640 1 Processor -- start 2026-02-12T18:12:49.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f20023b9640 1 -- start start 2026-02-12T18:12:49.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f20023b9640 10 monclient: init 2026-02-12T18:12:49.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f20023b9640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:49.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f20023b9640 10 monclient: _add_conns ranks=[6,3,9,1,2,5,10,0,7,4,8] 2026-02-12T18:12:49.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f20023b9640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f1ffc05c950 0x7f1ffc05cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f20023b9640 10 monclient(hunting): picked mon.noname-d con 0x7f1ffc05c950 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:12:49.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f20023b9640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f1ffc05e490 0x7f1ffc05d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f20023b9640 10 monclient(hunting): picked mon.noname-g con 0x7f1ffc05e490 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:12:49.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f20023b9640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f1ffc13db70 0x7f1ffc13dfe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f20023b9640 10 monclient(hunting): picked mon.noname-a con 0x7f1ffc13db70 addr v2:10.20.193.48:3300/0 2026-02-12T18:12:49.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f20023b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f20023b9640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f1ffc05ddd0 con 0x7f1ffc13db70 2026-02-12T18:12:49.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f20023b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f20023b9640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f1ffc05d7a0 con 0x7f1ffc05e490 2026-02-12T18:12:49.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f20023b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f20023b9640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f1ffc092990 con 0x7f1ffc05c950 2026-02-12T18:12:49.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f20023b9640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:49.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f20023b9640 10 monclient(hunting): authenticate will time out at 1008.538843s 2026-02-12T18:12:49.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f1ffbfff640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f1ffc05c950 0x7f1ffc05cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f200092f640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f1ffc13db70 0x7f1ffc13dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f1ffbfff640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f1ffc05c950 0x7f1ffc05cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:59372/0 (socket says 10.20.193.48:59372) 2026-02-12T18:12:49.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f1ffbfff640 1 -- 10.20.193.48:0/1586784571 learned_addr learned my addr 10.20.193.48:0/1586784571 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:49.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f1ffbfff640 10 monclient(hunting): get_auth_request con 0x7f1ffc05c950 auth_method 0 2026-02-12T18:12:49.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f1ffbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f1ffbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f1ffbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f200092f640 10 monclient(hunting): get_auth_request con 0x7f1ffc13db70 auth_method 0 2026-02-12T18:12:49.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f200092f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f200092f640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.812+0000 7f200092f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.813+0000 7f1ffb7fe640 1 --2- 10.20.193.48:0/1586784571 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f1ffc05e490 0x7f1ffc05d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.813+0000 7f1ffb7fe640 10 monclient(hunting): get_auth_request con 0x7f1ffc05e490 auth_method 0 2026-02-12T18:12:49.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.813+0000 7f1ffb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.813+0000 7f1ffb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.813+0000 7f1ffb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.813+0000 7f200092f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.813+0000 7f200092f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.813+0000 7f200092f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.813+0000 7f1ffbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.813+0000 7f1ffbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.813+0000 7f1ffbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.813+0000 7f1ffb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.813+0000 7f1ffb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.813+0000 7f1ffb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.813+0000 7f200092f640 10 monclient(hunting): handle_auth_done global_id 6147 payload 274 2026-02-12T18:12:49.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.813+0000 7f200092f640 1 -- 10.20.193.48:0/1586784571 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f1ffc05c950 msgr2=0x7f1ffc05cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:49.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.813+0000 7f200092f640 1 --2- 10.20.193.48:0/1586784571 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f1ffc05c950 0x7f1ffc05cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.813+0000 7f200092f640 1 -- 10.20.193.48:0/1586784571 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f1ffc05e490 msgr2=0x7f1ffc05d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:49.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.813+0000 7f200092f640 1 --2- 10.20.193.48:0/1586784571 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f1ffc05e490 0x7f1ffc05d260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.813+0000 7f200092f640 10 monclient: _finish_hunting 0 2026-02-12T18:12:49.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.813+0000 7f200092f640 1 monclient: found mon.noname-a 2026-02-12T18:12:49.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.813+0000 7f200092f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:49.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.813+0000 7f200092f640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:12:49.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.813+0000 7f200092f640 1 -- 10.20.193.48:0/1586784571 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ffc04dc20 con 0x7f1ffc13db70 2026-02-12T18:12:49.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.815+0000 7f200092f640 1 -- 10.20.193.48:0/1586784571 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1ffc13db70 msgr2=0x7f1ffc13dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:49.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.815+0000 7f200092f640 1 --2- 10.20.193.48:0/1586784571 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1ffc13db70 0x7f1ffc13dfe0 secure :-1 s=READY pgs=464 gs=2 cs=0 l=1 c_cookie=5307486421704238673 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ff0005820 tx=0x7f1ff002fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49a7fac7bfe3e651 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:49.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.815+0000 7f1ffaffd640 1 -- 10.20.193.48:0/1586784571 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1ff0036340 con 0x7f1ffc13db70 2026-02-12T18:12:49.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.815+0000 7f1ffaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.815+0000 7f1ffaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:12:49.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.815+0000 7f1ffaffd640 10 monclient: dump: 2026-02-12T18:12:49.821 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.821 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.821 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.821 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.821 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.821 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.821 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.821 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.821 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.821 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.821 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.821 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.821 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.821 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.821 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.821 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.815+0000 7f1ffaffd640 10 monclient: _finish_auth 0 2026-02-12T18:12:49.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.815+0000 7f1ffaffd640 10 monclient: _check_auth_tickets 2026-02-12T18:12:49.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.815+0000 7f1ffaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:49.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.815+0000 7f20023b9640 5 monclient: authenticate success, global_id 6147 2026-02-12T18:12:49.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.815+0000 7f20023b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:12:49.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.815+0000 7f1ffaffd640 1 -- 10.20.193.48:0/1586784571 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff00364c0 con 0x7f1ffc13db70 2026-02-12T18:12:49.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.815+0000 7f1ffaffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:49.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.815+0000 7f1ffaffd640 1 -- 10.20.193.48:0/1586784571 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1ff0036af0 con 0x7f1ffc13db70 2026-02-12T18:12:49.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.815+0000 7f20023b9640 10 monclient: get_monmap_and_config success 2026-02-12T18:12:49.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.815+0000 7f20023b9640 4 set_mon_vals no callback set 2026-02-12T18:12:49.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.815+0000 7f1ffaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.815+0000 7f1ffaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:12:49.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.815+0000 7f1ffaffd640 10 monclient: dump: 2026-02-12T18:12:49.822 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.822 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.822 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.822 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.822 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.822 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.822 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.822 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.822 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.822 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.822 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.822 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.822 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.822 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.822 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.823 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.816+0000 7f20023b9640 10 monclient: shutdown 2026-02-12T18:12:49.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.816+0000 7f20023b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:49.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.816+0000 7f20023b9640 1 -- 10.20.193.48:0/1586784571 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1ffc13db70 msgr2=0x7f1ffc13dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.816+0000 7f20023b9640 1 --2- 10.20.193.48:0/1586784571 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1ffc13db70 0x7f1ffc13dfe0 secure :-1 s=READY pgs=464 gs=2 cs=0 l=1 c_cookie=5307486421704238673 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ff0005820 tx=0x7f1ff002fdf0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.816+0000 7f20023b9640 1 -- 10.20.193.48:0/1586784571 shutdown_connections 2026-02-12T18:12:49.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.816+0000 7f20023b9640 1 --2- 10.20.193.48:0/1586784571 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1ffc13db70 0x7f1ffc13dfe0 unknown :-1 s=CLOSED pgs=464 gs=2 cs=0 l=1 c_cookie=5307486421704238673 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.816+0000 7f20023b9640 1 --2- 10.20.193.48:0/1586784571 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f1ffc05e490 0x7f1ffc05d260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.816+0000 7f20023b9640 1 --2- 10.20.193.48:0/1586784571 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f1ffc05c950 0x7f1ffc05cd20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.816+0000 7f20023b9640 1 -- 10.20.193.48:0/1586784571 >> 10.20.193.48:0/1586784571 conn(0x7f1ffc0548a0 msgr2=0x7f1ffc097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:49.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.816+0000 7f20023b9640 1 -- 10.20.193.48:0/1586784571 shutdown_connections 2026-02-12T18:12:49.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.816+0000 7f20023b9640 1 -- 10.20.193.48:0/1586784571 wait complete. 2026-02-12T18:12:49.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.816+0000 7f20023b9640 10 monclient: build_initial_monmap 2026-02-12T18:12:49.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.816+0000 7f20023b9640 10 monclient: monmap: 2026-02-12T18:12:49.823 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:49.823 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:12:49.823 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:12:49.823 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:12:49.823 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:49.823 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.823 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:12:49.823 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:12:49.823 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:49.823 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:49.823 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:49.824 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:49.824 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:49.824 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:49.824 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:49.824 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.816+0000 7f20023b9640 1 Processor -- start 2026-02-12T18:12:49.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.816+0000 7f20023b9640 1 -- start start 2026-02-12T18:12:49.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.816+0000 7f20023b9640 10 monclient: init 2026-02-12T18:12:49.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f20023b9640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:49.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f20023b9640 10 monclient: _add_conns ranks=[2,4,7,6,3,8,1,0,5] 2026-02-12T18:12:49.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f20023b9640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f1ffc05c950 0x7f1ffc1db760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f20023b9640 10 monclient(hunting): picked mon.noname-b con 0x7f1ffc05c950 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:12:49.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f20023b9640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f1ffc05e490 0x7f1ffc1dbca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f20023b9640 10 monclient(hunting): picked mon.noname-c con 0x7f1ffc05e490 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:12:49.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f20023b9640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1ffc13db70 0x7f1ffc08a9d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f20023b9640 10 monclient(hunting): picked mon.noname-i con 0x7f1ffc13db70 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:12:49.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f20023b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f20023b9640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f1ffc13d400 con 0x7f1ffc05c950 2026-02-12T18:12:49.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f20023b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f20023b9640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f1ffc08c330 con 0x7f1ffc05e490 2026-02-12T18:12:49.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f20023b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f20023b9640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f1ffc13e660 con 0x7f1ffc13db70 2026-02-12T18:12:49.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f20023b9640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:49.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f20023b9640 10 monclient(hunting): authenticate will time out at 1008.543223s 2026-02-12T18:12:49.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffbfff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f1ffc05c950 0x7f1ffc1db760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffbfff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f1ffc05c950 0x7f1ffc1db760 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:41850/0 (socket says 10.20.193.48:41850) 2026-02-12T18:12:49.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffbfff640 1 -- 10.20.193.48:0/3630284057 learned_addr learned my addr 10.20.193.48:0/3630284057 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:49.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffbfff640 10 monclient(hunting): get_auth_request con 0x7f1ffc05c950 auth_method 0 2026-02-12T18:12:49.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffb7fe640 1 --2- 10.20.193.48:0/3630284057 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f1ffc05e490 0x7f1ffc1dbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffb7fe640 10 monclient(hunting): get_auth_request con 0x7f1ffc05e490 auth_method 0 2026-02-12T18:12:49.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f200092f640 1 --2- 10.20.193.48:0/3630284057 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1ffc13db70 0x7f1ffc08a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f200092f640 10 monclient(hunting): get_auth_request con 0x7f1ffc13db70 auth_method 0 2026-02-12T18:12:49.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f200092f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f200092f640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f200092f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffbfff640 10 monclient(hunting): handle_auth_done global_id 35831 payload 824 2026-02-12T18:12:49.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffbfff640 1 -- 10.20.193.48:0/3630284057 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1ffc13db70 msgr2=0x7f1ffc08a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffbfff640 1 --2- 10.20.193.48:0/3630284057 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1ffc13db70 0x7f1ffc08a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffbfff640 1 -- 10.20.193.48:0/3630284057 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f1ffc05e490 msgr2=0x7f1ffc1dbca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffbfff640 1 --2- 10.20.193.48:0/3630284057 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f1ffc05e490 0x7f1ffc1dbca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffbfff640 10 monclient: _finish_hunting 0 2026-02-12T18:12:49.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffbfff640 1 monclient: found mon.noname-b 2026-02-12T18:12:49.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:49.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffbfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:12:49.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.817+0000 7f1ffbfff640 1 -- 10.20.193.48:0/3630284057 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff000a500 con 0x7f1ffc05c950 2026-02-12T18:12:49.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.819+0000 7f1ffbfff640 1 -- 10.20.193.48:0/3630284057 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f1ffc05c950 msgr2=0x7f1ffc1db760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:49.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.819+0000 7f1ffbfff640 1 --2- 10.20.193.48:0/3630284057 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f1ffc05c950 0x7f1ffc1db760 secure :-1 s=READY pgs=310 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1fe8006f70 tx=0x7f1fe800ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:49.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.819+0000 7f1ff8ff9640 1 -- 10.20.193.48:0/3630284057 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1fe800cbe0 con 0x7f1ffc05c950 2026-02-12T18:12:49.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.819+0000 7f1ff8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.819+0000 7f1ff8ff9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:12:49.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.819+0000 7f1ff8ff9640 10 monclient: dump: 2026-02-12T18:12:49.829 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.829 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.829 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.829 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.829 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.829 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.829 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.829 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.829 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.829 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.829 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.829 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.829 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.829 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.829 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.829 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.819+0000 7f1ff8ff9640 10 monclient: _finish_auth 0 2026-02-12T18:12:49.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.819+0000 7f1ff8ff9640 10 monclient: _check_auth_tickets 2026-02-12T18:12:49.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.819+0000 7f1ff8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:49.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.819+0000 7f1ff8ff9640 1 -- 10.20.193.48:0/3630284057 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe800cd40 con 0x7f1ffc05c950 2026-02-12T18:12:49.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.819+0000 7f1ff8ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:49.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.819+0000 7f1ff8ff9640 1 -- 10.20.193.48:0/3630284057 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1fe8013df0 con 0x7f1ffc05c950 2026-02-12T18:12:49.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.819+0000 7f1ff8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.819+0000 7f1ff8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:12:49.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.819+0000 7f1ffa7fc640 4 set_mon_vals no callback set 2026-02-12T18:12:49.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.819+0000 7f1ff8ff9640 10 monclient: dump: 2026-02-12T18:12:49.830 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.830 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.830 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.830 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.830 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.830 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.830 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.830 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.830 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.830 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.830 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.830 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.830 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.830 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.830 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.830 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.819+0000 7f20023b9640 5 monclient: authenticate success, global_id 35831 2026-02-12T18:12:49.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.819+0000 7f20023b9640 10 monclient: _renew_subs 2026-02-12T18:12:49.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.819+0000 7f20023b9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:12:49.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.819+0000 7f20023b9640 1 -- 10.20.193.48:0/3630284057 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ffc143ef0 con 0x7f1ffc05c950 2026-02-12T18:12:49.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.819+0000 7f20023b9640 10 monclient: _renew_subs 2026-02-12T18:12:49.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.819+0000 7f20023b9640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:12:49.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.819+0000 7f20023b9640 1 -- 10.20.193.48:0/3630284057 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ffc12e2d0 con 0x7f1ffc05c950 2026-02-12T18:12:49.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.820+0000 7f20023b9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:49.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.820+0000 7f20023b9640 1 --2- 10.20.193.48:0/3630284057 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f1ffc08af10 0x7f1ffc08b2e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.820+0000 7f20023b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.820+0000 7f20023b9640 1 -- 10.20.193.48:0/3630284057 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f1ffc063180 con 0x7f1ffc08af10 2026-02-12T18:12:49.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.820+0000 7f1ffb7fe640 1 --2- 10.20.193.48:0/3630284057 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f1ffc08af10 0x7f1ffc08b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.820+0000 7f1ffb7fe640 10 monclient: get_auth_request con 0x7f1ffc08af10 auth_method 0 2026-02-12T18:12:49.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.820+0000 7f1ffb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.820+0000 7f1ffb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.820+0000 7f1ffb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.820+0000 7f1ffb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.820+0000 7f1ffb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.820+0000 7f1ffb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.820+0000 7f1ff8ff9640 1 -- 10.20.193.48:0/3630284057 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f1fe8011070 con 0x7f1ffc05c950 2026-02-12T18:12:49.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.820+0000 7f1ffb7fe640 10 monclient(hunting): handle_auth_done global_id 64372 payload 824 2026-02-12T18:12:49.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.820+0000 7f1ffb7fe640 1 -- 10.20.193.48:0/3630284057 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1ffc097de0 con 0x7f1ffc08af10 2026-02-12T18:12:49.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.820+0000 7f1ff8ff9640 1 --2- 10.20.193.48:0/3630284057 >> v2:10.20.193.111:6812/977811348 conn(0x7f1fcc03f7f0 0x7f1fcc05fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.820+0000 7f1ff8ff9640 1 -- 10.20.193.48:0/3630284057 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(218..218 src has 190..218) ==== 3897+0+0 (secure 0 0 0) 0x7f1fe8052bf0 con 0x7f1ffc05c950 2026-02-12T18:12:49.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.820+0000 7f200092f640 1 --2- 10.20.193.48:0/3630284057 >> v2:10.20.193.111:6812/977811348 conn(0x7f1fcc03f7f0 0x7f1fcc05fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.821+0000 7f200092f640 10 monclient: get_auth_request con 0x7f1fcc03f7f0 auth_method 0 2026-02-12T18:12:49.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.822+0000 7f1ffb7fe640 1 -- 10.20.193.48:0/3630284057 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f1ffc08af10 msgr2=0x7f1ffc08b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:49.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.822+0000 7f1ffb7fe640 1 --2- 10.20.193.48:0/3630284057 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f1ffc08af10 0x7f1ffc08b2e0 secure :-1 s=READY pgs=104 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ffc08c9a0 tx=0x7f1fec011d90 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:49.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.823+0000 7f1ff8ff9640 1 -- 10.20.193.48:0/3630284057 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1fec00fee0 con 0x7f1ffc08af10 2026-02-12T18:12:49.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.823+0000 7f1ff8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.823+0000 7f1ff8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:12:49.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.823+0000 7f1ff8ff9640 10 monclient: dump: 2026-02-12T18:12:49.832 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.832 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.832 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.832 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.832 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.832 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.832 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.832 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.832 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.832 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.832 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.832 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.832 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.832 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.832 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.832 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.823+0000 7f1ff8ff9640 1 -- 10.20.193.48:0/3630284057 <== mon.4 v2:10.20.193.48:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f1fec014440 con 0x7f1ffc08af10 2026-02-12T18:12:49.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.823+0000 7f1ff8ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:49.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.823+0000 7f1ff8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:12:49.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.823+0000 7f1ff8ff9640 1 -- 10.20.193.48:0/3630284057 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f1ffc08af10 msgr2=0x7f1ffc08b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.823+0000 7f1ff8ff9640 1 --2- 10.20.193.48:0/3630284057 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f1ffc08af10 0x7f1ffc08b2e0 secure :-1 s=READY pgs=104 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ffc08c9a0 tx=0x7f1fec011d90 comp rx=0 tx=0).stop 2026-02-12T18:12:49.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.823+0000 7f1ff8ff9640 1 -- 10.20.193.48:0/3630284057 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f1ffc08af10 msgr2=0x7f1ffc08b2e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:49.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.823+0000 7f1ff8ff9640 1 --2- 10.20.193.48:0/3630284057 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f1ffc08af10 0x7f1ffc08b2e0 secure :-1 s=CLOSED pgs=104 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ffc08c9a0 tx=0x7f1fec011d90 comp rx=0 tx=0).stop 2026-02-12T18:12:49.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.823+0000 7f200092f640 1 --2- 10.20.193.48:0/3630284057 >> v2:10.20.193.111:6812/977811348 conn(0x7f1fcc03f7f0 0x7f1fcc05fca0 secure :-1 s=READY pgs=326 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ff0008fd0 tx=0x7f1ff003a040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:49.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.826+0000 7f20023b9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:12:49.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.826+0000 7f20023b9640 1 --2- 10.20.193.48:0/3630284057 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f1ffc08b820 0x7f1ffc08f160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.826+0000 7f20023b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.826+0000 7f20023b9640 1 -- 10.20.193.48:0/3630284057 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f1ffc050410 con 0x7f1ffc08b820 2026-02-12T18:12:49.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.826+0000 7f1ffb7fe640 1 --2- 10.20.193.48:0/3630284057 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f1ffc08b820 0x7f1ffc08f160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.826+0000 7f1ffb7fe640 10 monclient: get_auth_request con 0x7f1ffc08b820 auth_method 0 2026-02-12T18:12:49.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.826+0000 7f1ffb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.826+0000 7f1ffb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.826+0000 7f1ffb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.826+0000 7f1ffb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.826+0000 7f1ffb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.826+0000 7f1ffb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.826+0000 7f1ffb7fe640 10 monclient(hunting): handle_auth_done global_id 64381 payload 824 2026-02-12T18:12:49.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.826+0000 7f1ffb7fe640 1 -- 10.20.193.48:0/3630284057 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1ffc12df30 con 0x7f1ffc08b820 2026-02-12T18:12:49.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.828+0000 7f1ffb7fe640 1 -- 10.20.193.48:0/3630284057 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f1ffc08b820 msgr2=0x7f1ffc08f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:49.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.828+0000 7f1ffb7fe640 1 --2- 10.20.193.48:0/3630284057 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f1ffc08b820 0x7f1ffc08f160 secure :-1 s=READY pgs=105 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1fec019000 tx=0x7f1fec004770 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:49.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.829+0000 7f1ff8ff9640 1 -- 10.20.193.48:0/3630284057 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1fec014da0 con 0x7f1ffc08b820 2026-02-12T18:12:49.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.829+0000 7f1ff8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.829+0000 7f1ff8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:12:49.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.829+0000 7f1ff8ff9640 10 monclient: dump: 2026-02-12T18:12:49.834 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.834 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.834 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.834 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.834 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.834 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.834 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.834 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.834 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.834 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.834 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.834 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.834 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.834 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.835 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.835 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.829+0000 7f1ff8ff9640 1 -- 10.20.193.48:0/3630284057 <== mon.4 v2:10.20.193.48:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10182 (secure 0 0 0) 0x7f1fec026070 con 0x7f1ffc08b820 2026-02-12T18:12:49.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.829+0000 7f1ff8ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:12:49.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.829+0000 7f1ff8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:12:49.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.829+0000 7f1ff8ff9640 1 -- 10.20.193.48:0/3630284057 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f1ffc08b820 msgr2=0x7f1ffc08f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.829+0000 7f1ff8ff9640 1 --2- 10.20.193.48:0/3630284057 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f1ffc08b820 0x7f1ffc08f160 secure :-1 s=READY pgs=105 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1fec019000 tx=0x7f1fec004770 comp rx=0 tx=0).stop 2026-02-12T18:12:49.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.829+0000 7f1ff8ff9640 1 -- 10.20.193.48:0/3630284057 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f1ffc08b820 msgr2=0x7f1ffc08f160 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:49.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.829+0000 7f1ff8ff9640 1 --2- 10.20.193.48:0/3630284057 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f1ffc08b820 0x7f1ffc08f160 secure :-1 s=CLOSED pgs=105 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1fec019000 tx=0x7f1fec004770 comp rx=0 tx=0).stop 2026-02-12T18:12:49.835 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:12:49.835 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:12:49.835 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:12:49.835 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:12:49.835 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 68, 2026-02-12T18:12:49.835 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 150616, 2026-02-12T18:12:49.835 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:12:49.835 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:12:49.835 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:12:49.836 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:12:49.836 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:12:49.836 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:12:49.836 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:12:49.836 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:12:49.836 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:12:49.836 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:12:49.836 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:49.836 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:12:49.836 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:49.836 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:12:49.836 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:12:49.836 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:49.836 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:49.836 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:49.836 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:49.836 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:49.836 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:49.836 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:49.836 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:49.836 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:49.836 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:49.836 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:49.836 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:49.837 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:49.837 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:49.837 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:12:49.837 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:12:49.837 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:49.837 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:49.837 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:49.837 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:49.837 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:49.837 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:49.837 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:49.837 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:49.837 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:49.837 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:49.837 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:49.837 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:49.837 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:49.837 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.837 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.837 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:12:49.837 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:12:49.837 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:12:49.837 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:12:49.838 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:12:49.838 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:12:49.838 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:49.838 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:49.838 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:12:49.838 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:12:49.838 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:12:49.838 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:12:49.838 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:12:49.838 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:12:49.838 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:12:49.838 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:49.838 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:12:49.838 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:49.838 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:49.838 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:49.838 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:49.838 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:49.838 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:49.838 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:49.838 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:49.838 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:49.838 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:49.838 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:49.838 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:49.839 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:49.839 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:49.839 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:12:49.839 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.839 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:12:49.839 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.839 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:12:49.839 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:12:49.839 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.839 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.839 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.839 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.839 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:12:49.839 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.839 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.839 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.839 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.839 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:12:49.839 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.839 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.839 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.839 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.839 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:12:49.839 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:12:49.840 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.840 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.840 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:12:49.840 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.840 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.840 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.840 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:12:49.840 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:12:49.840 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.840 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.840 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.840 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.840 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:12:49.840 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.840 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.840 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.840 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.840 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:12:49.840 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.840 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.840 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.840 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.840 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:12:49.840 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:12:49.840 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.841 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.841 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:12:49.841 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.841 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.841 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.841 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:12:49.841 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:12:49.841 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.841 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.841 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.841 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.841 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:12:49.841 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.841 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.841 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.841 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.841 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:12:49.841 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.841 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.841 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.841 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.841 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:12:49.841 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:12:49.841 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.841 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.842 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:12:49.842 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.842 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.842 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.842 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:12:49.842 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:12:49.842 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.842 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.842 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.842 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.842 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:12:49.842 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.842 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.842 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.842 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.842 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:12:49.842 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.842 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.842 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.842 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.842 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:12:49.842 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:12:49.842 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.842 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.842 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:12:49.842 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.843 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.843 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.843 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:12:49.843 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:12:49.843 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.843 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.843 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.843 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.843 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:12:49.843 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.843 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.843 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.843 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.843 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:12:49.843 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.843 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.843 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.843 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.843 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:12:49.843 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:12:49.843 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.843 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.843 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:49.843 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.843 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.844 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.844 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:12:49.844 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:12:49.844 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.844 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.844 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.844 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.844 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:12:49.844 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.844 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.844 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.844 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.844 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:12:49.844 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.844 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.844 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.844 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.844 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:12:49.844 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:12:49.844 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.844 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.844 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:12:49.844 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.844 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.844 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.845 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:12:49.845 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:12:49.845 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.845 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.845 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.845 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.845 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:12:49.845 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.845 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.845 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.845 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.845 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:12:49.845 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.845 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.845 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.845 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.845 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:12:49.845 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:12:49.845 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.845 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.845 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:49.845 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.845 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.845 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.845 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:12:49.846 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:12:49.846 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.846 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.846 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.846 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.846 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:12:49.846 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.846 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.846 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.846 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.846 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:12:49.846 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.846 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.846 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.846 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.846 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:12:49.846 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:12:49.846 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.846 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.846 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:12:49.846 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.846 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.846 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.846 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:12:49.846 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.847 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:49.848 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:49.848 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:49.848 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.848 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:49.848 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:12:49.848 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.848 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:49.848 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:49.848 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:49.848 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.848 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:49.848 INFO:teuthology.orchestra.run.trial048.stdout: "mgr": [ 2026-02-12T18:12:49.848 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.848 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:49.848 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:49.848 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:49.848 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.848 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.848 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.848 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:12:49.848 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:12:49.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.829+0000 7f20023b9640 1 -- 10.20.193.48:0/3630284057 >> v2:10.20.193.111:6812/977811348 conn(0x7f1fcc03f7f0 msgr2=0x7f1fcc05fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.829+0000 7f20023b9640 1 --2- 10.20.193.48:0/3630284057 >> v2:10.20.193.111:6812/977811348 conn(0x7f1fcc03f7f0 0x7f1fcc05fca0 secure :-1 s=READY pgs=326 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1ff0008fd0 tx=0x7f1ff003a040 comp rx=0 tx=0).stop 2026-02-12T18:12:49.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.829+0000 7f20023b9640 10 monclient: shutdown 2026-02-12T18:12:49.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.829+0000 7f20023b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:49.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.829+0000 7f20023b9640 1 -- 10.20.193.48:0/3630284057 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f1ffc05c950 msgr2=0x7f1ffc1db760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.829+0000 7f20023b9640 1 --2- 10.20.193.48:0/3630284057 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f1ffc05c950 0x7f1ffc1db760 secure :-1 s=READY pgs=310 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1fe8006f70 tx=0x7f1fe800ee20 comp rx=0 tx=0).stop 2026-02-12T18:12:49.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.829+0000 7f200092f640 1 -- 10.20.193.48:0/3630284057 reap_dead start 2026-02-12T18:12:49.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.829+0000 7f200092f640 1 -- 10.20.193.48:0/3630284057 reap_dead start 2026-02-12T18:12:49.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.829+0000 7f20023b9640 1 -- 10.20.193.48:0/3630284057 shutdown_connections 2026-02-12T18:12:49.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.829+0000 7f20023b9640 1 -- 10.20.193.48:0/3630284057 >> 10.20.193.48:0/3630284057 conn(0x7f1ffc0548a0 msgr2=0x7f1ffc08e810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:49.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.829+0000 7f20023b9640 1 -- 10.20.193.48:0/3630284057 shutdown_connections 2026-02-12T18:12:49.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.829+0000 7f20023b9640 1 -- 10.20.193.48:0/3630284057 wait complete. 2026-02-12T18:12:49.850 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:12:49.850 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2026-02-12T18:12:49.850 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2026-02-12T18:12:49.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.915+0000 7f6942a36640 10 monclient: get_monmap_and_config 2026-02-12T18:12:49.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.915+0000 7f6942a36640 10 monclient: build_initial_monmap 2026-02-12T18:12:49.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.915+0000 7f6942a36640 10 monclient: monmap: 2026-02-12T18:12:49.917 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:49.917 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.917 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:12:49.916534+0000 2026-02-12T18:12:49.917 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:12:49.916534+0000 2026-02-12T18:12:49.917 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:49.917 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.917 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:12:49.917 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:12:49.917 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:49.917 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:49.917 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:49.917 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:49.917 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:49.917 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:49.917 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:49.917 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:12:49.917 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:12:49.917 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.915+0000 7f6942a36640 1 Processor -- start 2026-02-12T18:12:49.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.915+0000 7f6942a36640 1 -- start start 2026-02-12T18:12:49.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.915+0000 7f6942a36640 10 monclient: init 2026-02-12T18:12:49.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6942a36640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:49.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6942a36640 10 monclient: _add_conns ranks=[1,10,8,7,9,2,5,4,0,6,3] 2026-02-12T18:12:49.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6942a36640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f693c05c950 addr v1:10.20.193.111:6789/0 2026-02-12T18:12:49.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6942a36640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f693c05e490 0x7f693c1857b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6942a36640 10 monclient(hunting): picked mon.noname-f con 0x7f693c05e490 addr v2:10.20.193.111:3300/0 2026-02-12T18:12:49.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6942a36640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f693c05d430 0x7f693c1a5d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6942a36640 10 monclient(hunting): picked mon.noname-e con 0x7f693c05d430 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:12:49.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6942a36640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f693c04dc20 con 0x7f693c05c950 2026-02-12T18:12:49.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6942a36640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6942a36640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f693c05ddd0 con 0x7f693c05e490 2026-02-12T18:12:49.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6942a36640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6942a36640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f693c092990 con 0x7f693c05d430 2026-02-12T18:12:49.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6942a36640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:49.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6942a36640 10 monclient(hunting): authenticate will time out at 1008.642242s 2026-02-12T18:12:49.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6940fac640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f693c05d430 0x7f693c1a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6940fac640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f693c05d430 0x7f693c1a5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:57302/0 (socket says 10.20.193.48:57302) 2026-02-12T18:12:49.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6940fac640 1 -- 10.20.193.48:0/1779181291 learned_addr learned my addr 10.20.193.48:0/1779181291 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:49.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6940fac640 10 monclient(hunting): get_auth_request con 0x7f693c05d430 auth_method 0 2026-02-12T18:12:49.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6940fac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6940fac640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6940fac640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f693b7fe640 1 --2- 10.20.193.48:0/1779181291 >> v2:10.20.193.111:3300/0 conn(0x7f693c05e490 0x7f693c1857b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6940fac640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6940fac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6940fac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f693b7fe640 10 monclient(hunting): get_auth_request con 0x7f693c05e490 auth_method 0 2026-02-12T18:12:49.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f693b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f693b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f693b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6940fac640 10 monclient(hunting): handle_auth_done global_id 94139 payload 274 2026-02-12T18:12:49.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6940fac640 1 -- 10.20.193.48:0/1779181291 >> v2:10.20.193.111:3300/0 conn(0x7f693c05e490 msgr2=0x7f693c1857b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:49.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6940fac640 1 --2- 10.20.193.48:0/1779181291 >> v2:10.20.193.111:3300/0 conn(0x7f693c05e490 0x7f693c1857b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6940fac640 1 -- 10.20.193.48:0/1779181291 >> v1:10.20.193.111:6789/0 conn(0x7f693c05c950 legacy=0x7f693c05cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:49.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6940fac640 10 monclient: _finish_hunting 0 2026-02-12T18:12:49.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6940fac640 1 monclient: found mon.noname-e 2026-02-12T18:12:49.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6940fac640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:49.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6940fac640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:12:49.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.916+0000 7f6940fac640 1 -- 10.20.193.48:0/1779181291 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f693c092c70 con 0x7f693c05d430 2026-02-12T18:12:49.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f6940fac640 1 -- 10.20.193.48:0/1779181291 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f693c05d430 msgr2=0x7f693c1a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:49.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f6940fac640 1 --2- 10.20.193.48:0/1779181291 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f693c05d430 0x7f693c1a5d00 secure :-1 s=READY pgs=17 gs=2 cs=0 l=1 c_cookie=6356623793386597525 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f693000a140 tx=0x7f693002fed0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=583743a9479aac95 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:49.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f693affd640 1 -- 10.20.193.48:0/1779181291 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6930030b50 con 0x7f693c05d430 2026-02-12T18:12:49.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f693affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f693affd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:12:49.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f693affd640 10 monclient: dump: 2026-02-12T18:12:49.921 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.921 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.921 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.921 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.921 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.922 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.922 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.922 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.922 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.922 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.922 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.922 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.922 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.922 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.922 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.922 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f693affd640 10 monclient: _finish_auth 0 2026-02-12T18:12:49.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f693affd640 10 monclient: _check_auth_tickets 2026-02-12T18:12:49.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f693affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:49.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f6942a36640 5 monclient: authenticate success, global_id 94139 2026-02-12T18:12:49.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f693affd640 1 -- 10.20.193.48:0/1779181291 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6930030cd0 con 0x7f693c05d430 2026-02-12T18:12:49.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f693affd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:49.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f693affd640 1 -- 10.20.193.48:0/1779181291 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6930030e40 con 0x7f693c05d430 2026-02-12T18:12:49.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f693affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f693affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:12:49.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f693affd640 10 monclient: dump: 2026-02-12T18:12:49.922 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.922 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.922 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.923 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.923 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.923 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.923 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.923 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.923 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.923 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.923 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.923 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.923 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.923 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.923 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.923 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f6942a36640 10 monclient: get_monmap_and_config success 2026-02-12T18:12:49.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f6942a36640 4 set_mon_vals no callback set 2026-02-12T18:12:49.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f6942a36640 10 monclient: shutdown 2026-02-12T18:12:49.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f6942a36640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:49.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f6942a36640 1 -- 10.20.193.48:0/1779181291 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f693c05d430 msgr2=0x7f693c1a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f6942a36640 1 --2- 10.20.193.48:0/1779181291 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f693c05d430 0x7f693c1a5d00 secure :-1 s=READY pgs=17 gs=2 cs=0 l=1 c_cookie=6356623793386597525 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f693000a140 tx=0x7f693002fed0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f6942a36640 1 -- 10.20.193.48:0/1779181291 shutdown_connections 2026-02-12T18:12:49.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f6942a36640 1 --2- 10.20.193.48:0/1779181291 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f693c05d430 0x7f693c1a5d00 unknown :-1 s=CLOSED pgs=17 gs=2 cs=0 l=1 c_cookie=6356623793386597525 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f6942a36640 1 --2- 10.20.193.48:0/1779181291 >> v2:10.20.193.111:3300/0 conn(0x7f693c05e490 0x7f693c1857b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f6942a36640 1 -- 10.20.193.48:0/1779181291 >> 10.20.193.48:0/1779181291 conn(0x7f693c0548a0 msgr2=0x7f693c097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:49.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f6942a36640 1 -- 10.20.193.48:0/1779181291 shutdown_connections 2026-02-12T18:12:49.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.919+0000 7f6942a36640 1 -- 10.20.193.48:0/1779181291 wait complete. 2026-02-12T18:12:49.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6942a36640 10 monclient: build_initial_monmap 2026-02-12T18:12:49.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6942a36640 10 monclient: monmap: 2026-02-12T18:12:49.924 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:49.924 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:12:49.924 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:12:49.924 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:12:49.924 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:49.924 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.924 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:12:49.924 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:12:49.924 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:49.924 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:49.924 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:49.924 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:49.924 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:49.924 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:49.924 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:49.924 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6942a36640 1 Processor -- start 2026-02-12T18:12:49.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6942a36640 1 -- start start 2026-02-12T18:12:49.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6942a36640 10 monclient: init 2026-02-12T18:12:49.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6942a36640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:49.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6942a36640 10 monclient: _add_conns ranks=[8,4,0,3,2,6,5,1,7] 2026-02-12T18:12:49.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6942a36640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f693c05c950 0x7f693c08c600 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6942a36640 10 monclient(hunting): picked mon.noname-e con 0x7f693c05c950 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:12:49.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6942a36640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f693c05d430 0x7f693c1a55b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6942a36640 10 monclient(hunting): picked mon.noname-c con 0x7f693c05d430 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:12:49.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6942a36640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f693c05e490 0x7f693c1a5af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6942a36640 10 monclient(hunting): picked mon.noname-a con 0x7f693c05e490 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:12:49.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6942a36640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6942a36640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f693c08c1e0 con 0x7f693c05e490 2026-02-12T18:12:49.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6942a36640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6942a36640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f693c142750 con 0x7f693c05d430 2026-02-12T18:12:49.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6942a36640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6942a36640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f693c1418e0 con 0x7f693c05c950 2026-02-12T18:12:49.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6942a36640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:49.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6942a36640 10 monclient(hunting): authenticate will time out at 1008.646550s 2026-02-12T18:12:49.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693bfff640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f693c05c950 0x7f693c08c600 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693b7fe640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f693c05d430 0x7f693c1a55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693bfff640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f693c05c950 0x7f693c08c600 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:57318/0 (socket says 10.20.193.48:57318) 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6940fac640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f693c05e490 0x7f693c1a5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693bfff640 1 -- 10.20.193.48:0/1876524579 learned_addr learned my addr 10.20.193.48:0/1876524579 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693bfff640 10 monclient(hunting): get_auth_request con 0x7f693c05c950 auth_method 0 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693b7fe640 10 monclient(hunting): get_auth_request con 0x7f693c05d430 auth_method 0 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6940fac640 10 monclient(hunting): get_auth_request con 0x7f693c05e490 auth_method 0 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6940fac640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6940fac640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6940fac640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6940fac640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6940fac640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f6940fac640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693bfff640 10 monclient(hunting): handle_auth_done global_id 94148 payload 824 2026-02-12T18:12:49.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693bfff640 1 -- 10.20.193.48:0/1876524579 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f693c05d430 msgr2=0x7f693c1a55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693bfff640 1 --2- 10.20.193.48:0/1876524579 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f693c05d430 0x7f693c1a55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693bfff640 1 -- 10.20.193.48:0/1876524579 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f693c05e490 msgr2=0x7f693c1a5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693bfff640 1 --2- 10.20.193.48:0/1876524579 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f693c05e490 0x7f693c1a5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:49.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693bfff640 10 monclient: _finish_hunting 0 2026-02-12T18:12:49.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693bfff640 1 monclient: found mon.noname-e 2026-02-12T18:12:49.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:49.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693bfff640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:12:49.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693bfff640 1 -- 10.20.193.48:0/1876524579 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f693000a5d0 con 0x7f693c05c950 2026-02-12T18:12:49.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.920+0000 7f693b7fe640 1 --2- 10.20.193.48:0/1876524579 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f693c05d430 0x7f693c1a55b0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:12:49.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f693bfff640 1 -- 10.20.193.48:0/1876524579 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f693c05c950 msgr2=0x7f693c08c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:49.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f693bfff640 1 --2- 10.20.193.48:0/1876524579 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f693c05c950 0x7f693c08c600 secure :-1 s=READY pgs=18 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f692800c480 tx=0x7f692800c950 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:49.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f6938ff9640 1 -- 10.20.193.48:0/1876524579 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6928006d50 con 0x7f693c05c950 2026-02-12T18:12:49.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f6938ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f6938ff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:12:49.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f6938ff9640 10 monclient: dump: 2026-02-12T18:12:49.929 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.929 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.929 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.929 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.929 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.929 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.929 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.929 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.929 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.929 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.929 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.930 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.930 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.930 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.930 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.930 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f6938ff9640 10 monclient: _finish_auth 0 2026-02-12T18:12:49.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f6938ff9640 10 monclient: _check_auth_tickets 2026-02-12T18:12:49.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f6938ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:49.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f6938ff9640 1 -- 10.20.193.48:0/1876524579 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6928007030 con 0x7f693c05c950 2026-02-12T18:12:49.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f6942a36640 5 monclient: authenticate success, global_id 94148 2026-02-12T18:12:49.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f6942a36640 10 monclient: _renew_subs 2026-02-12T18:12:49.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f6942a36640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:12:49.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f6942a36640 1 -- 10.20.193.48:0/1876524579 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f693c1a6030 con 0x7f693c05c950 2026-02-12T18:12:49.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f6938ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:49.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f6938ff9640 1 -- 10.20.193.48:0/1876524579 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6928007660 con 0x7f693c05c950 2026-02-12T18:12:49.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f6938ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f6938ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:12:49.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f693a7fc640 4 set_mon_vals no callback set 2026-02-12T18:12:49.930 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f6938ff9640 10 monclient: dump: 2026-02-12T18:12:49.930 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.930 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.930 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.930 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.930 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.930 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.930 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f6942a36640 10 monclient: _renew_subs 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f6942a36640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f6942a36640 1 -- 10.20.193.48:0/1876524579 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f693c08bf00 con 0x7f693c05c950 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f6942a36640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f6942a36640 1 --2- 10.20.193.48:0/1876524579 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f693c12e1a0 0x7f693c12e570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f6942a36640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f6942a36640 1 -- 10.20.193.48:0/1876524579 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f693c05f140 con 0x7f693c12e1a0 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f6938ff9640 1 -- 10.20.193.48:0/1876524579 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f69280071a0 con 0x7f693c05c950 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f693b7fe640 1 --2- 10.20.193.48:0/1876524579 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f693c12e1a0 0x7f693c12e570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f693b7fe640 10 monclient: get_auth_request con 0x7f693c12e1a0 auth_method 0 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f693b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f693b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f693b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f693b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.923+0000 7f693b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.924+0000 7f693b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.924+0000 7f6938ff9640 1 --2- 10.20.193.48:0/1876524579 >> v2:10.20.193.111:6812/977811348 conn(0x7f690c03f800 0x7f690c05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.924+0000 7f693b7fe640 10 monclient(hunting): handle_auth_done global_id 5748 payload 824 2026-02-12T18:12:49.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.924+0000 7f693b7fe640 1 -- 10.20.193.48:0/1876524579 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f693c1a6220 con 0x7f693c12e1a0 2026-02-12T18:12:49.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.924+0000 7f6938ff9640 1 -- 10.20.193.48:0/1876524579 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(218..218 src has 190..218) ==== 3897+0+0 (secure 0 0 0) 0x7f6928052030 con 0x7f693c05c950 2026-02-12T18:12:49.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.924+0000 7f6940fac640 1 --2- 10.20.193.48:0/1876524579 >> v2:10.20.193.111:6812/977811348 conn(0x7f690c03f800 0x7f690c05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.924+0000 7f6940fac640 10 monclient: get_auth_request con 0x7f690c03f800 auth_method 0 2026-02-12T18:12:49.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.926+0000 7f693b7fe640 1 -- 10.20.193.48:0/1876524579 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f693c12e1a0 msgr2=0x7f693c12e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:49.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.926+0000 7f693b7fe640 1 --2- 10.20.193.48:0/1876524579 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f693c12e1a0 0x7f693c12e570 secure :-1 s=READY pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f692c011aa0 tx=0x7f692c009f70 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:49.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.926+0000 7f6938ff9640 1 -- 10.20.193.48:0/1876524579 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f692c00c070 con 0x7f693c12e1a0 2026-02-12T18:12:49.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.926+0000 7f6938ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.926+0000 7f6938ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:12:49.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.926+0000 7f6938ff9640 10 monclient: dump: 2026-02-12T18:12:49.933 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.933 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.933 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.933 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.933 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.933 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.933 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.933 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.933 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.933 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.933 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.933 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.933 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.933 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.933 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.934 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.926+0000 7f6938ff9640 1 -- 10.20.193.48:0/1876524579 <== mon.6 v2:10.20.193.48:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f692c004030 con 0x7f693c12e1a0 2026-02-12T18:12:49.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.926+0000 7f6938ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:49.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.926+0000 7f6938ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:12:49.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.926+0000 7f6938ff9640 1 -- 10.20.193.48:0/1876524579 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f693c12e1a0 msgr2=0x7f693c12e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.926+0000 7f6938ff9640 1 --2- 10.20.193.48:0/1876524579 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f693c12e1a0 0x7f693c12e570 secure :-1 s=READY pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f692c011aa0 tx=0x7f692c009f70 comp rx=0 tx=0).stop 2026-02-12T18:12:49.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.926+0000 7f6938ff9640 1 -- 10.20.193.48:0/1876524579 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f693c12e1a0 msgr2=0x7f693c12e570 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:49.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.926+0000 7f6938ff9640 1 --2- 10.20.193.48:0/1876524579 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f693c12e1a0 0x7f693c12e570 secure :-1 s=CLOSED pgs=270 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f692c011aa0 tx=0x7f692c009f70 comp rx=0 tx=0).stop 2026-02-12T18:12:49.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.926+0000 7f6940fac640 1 --2- 10.20.193.48:0/1876524579 >> v2:10.20.193.111:6812/977811348 conn(0x7f690c03f800 0x7f690c05fcb0 secure :-1 s=READY pgs=327 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f693002ff10 tx=0x7f6930007f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:49.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.929+0000 7f6942a36640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:12:49.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.929+0000 7f6942a36640 1 --2- 10.20.193.48:0/1876524579 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f693c12eab0 0x7f693c090000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:49.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.929+0000 7f6942a36640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:49.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.929+0000 7f6942a36640 1 -- 10.20.193.48:0/1876524579 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f693c05fd90 con 0x7f693c12eab0 2026-02-12T18:12:49.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.929+0000 7f693b7fe640 1 --2- 10.20.193.48:0/1876524579 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f693c12eab0 0x7f693c090000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:49.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.929+0000 7f693b7fe640 10 monclient: get_auth_request con 0x7f693c12eab0 auth_method 0 2026-02-12T18:12:49.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.929+0000 7f693b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:49.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.929+0000 7f693b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:49.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.929+0000 7f693b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:49.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.929+0000 7f693b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:49.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.929+0000 7f693b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:49.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.929+0000 7f693b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:49.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.930+0000 7f693b7fe640 10 monclient(hunting): handle_auth_done global_id 5757 payload 824 2026-02-12T18:12:49.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.930+0000 7f693b7fe640 1 -- 10.20.193.48:0/1876524579 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f693c08bb10 con 0x7f693c12eab0 2026-02-12T18:12:49.935 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.932+0000 7f693b7fe640 1 -- 10.20.193.48:0/1876524579 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f693c12eab0 msgr2=0x7f693c090000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:49.935 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.932+0000 7f693b7fe640 1 --2- 10.20.193.48:0/1876524579 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f693c12eab0 0x7f693c090000 secure :-1 s=READY pgs=271 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f692c011aa0 tx=0x7f692c004770 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:49.935 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.932+0000 7f6938ff9640 1 -- 10.20.193.48:0/1876524579 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f692c015920 con 0x7f693c12eab0 2026-02-12T18:12:49.935 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.932+0000 7f6938ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:49.935 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.932+0000 7f6938ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:12:49.935 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.932+0000 7f6938ff9640 10 monclient: dump: 2026-02-12T18:12:49.935 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:49.935 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:49.935 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.935 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:49.935 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:49.935 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:49.935 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:49.935 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:49.936 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:49.936 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:49.936 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:49.936 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:49.936 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:49.936 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:49.936 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:49.936 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:49.936 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.932+0000 7f6938ff9640 1 -- 10.20.193.48:0/1876524579 <== mon.6 v2:10.20.193.48:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10182 (secure 0 0 0) 0x7f692c015460 con 0x7f693c12eab0 2026-02-12T18:12:49.936 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.932+0000 7f6938ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:12:49.936 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.932+0000 7f6938ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:12:49.936 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.932+0000 7f6938ff9640 1 -- 10.20.193.48:0/1876524579 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f693c12eab0 msgr2=0x7f693c090000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.936 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.932+0000 7f6938ff9640 1 --2- 10.20.193.48:0/1876524579 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f693c12eab0 0x7f693c090000 secure :-1 s=READY pgs=271 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f692c011aa0 tx=0x7f692c004770 comp rx=0 tx=0).stop 2026-02-12T18:12:49.936 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.932+0000 7f6938ff9640 1 -- 10.20.193.48:0/1876524579 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f693c12eab0 msgr2=0x7f693c090000 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:49.936 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.932+0000 7f6938ff9640 1 --2- 10.20.193.48:0/1876524579 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f693c12eab0 0x7f693c090000 secure :-1 s=CLOSED pgs=271 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f692c011aa0 tx=0x7f692c004770 comp rx=0 tx=0).stop 2026-02-12T18:12:49.936 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:12:49.936 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:12:49.936 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:12:49.936 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:12:49.936 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 68, 2026-02-12T18:12:49.937 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 424758, 2026-02-12T18:12:49.937 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:12:49.937 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:12:49.937 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:12:49.937 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:12:49.937 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:12:49.937 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:12:49.937 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:12:49.937 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:12:49.937 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:12:49.937 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:12:49.937 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:49.937 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:12:49.937 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:49.937 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:12:49.937 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:12:49.937 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:49.937 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:49.937 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:49.937 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:49.937 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:49.937 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:49.937 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:49.937 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:49.937 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:49.938 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:49.938 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:49.938 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:49.938 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:49.938 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:49.938 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:12:49.938 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:12:49.938 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:49.938 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:49.938 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:49.938 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:49.938 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:49.938 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:49.938 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:49.938 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:49.938 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:49.938 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:49.938 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:49.938 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:49.938 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:49.938 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.938 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.938 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:12:49.938 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:12:49.938 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:49.939 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:49.940 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:49.940 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:12:49.940 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.940 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:12:49.940 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.940 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:12:49.940 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:12:49.940 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.940 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.940 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.940 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.940 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:12:49.940 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.940 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.940 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.940 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.940 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:12:49.940 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.940 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.940 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.940 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.940 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:12:49.940 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:12:49.940 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.940 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.940 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:12:49.941 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.941 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.941 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.941 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:12:49.941 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:12:49.941 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.941 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.941 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.941 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.941 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:12:49.941 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.941 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.941 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.941 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.941 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:12:49.941 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.941 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.941 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.941 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.941 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:12:49.941 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:12:49.941 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.941 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.941 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:12:49.941 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.941 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:12:49.942 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:12:49.943 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.943 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.943 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.943 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.943 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:12:49.943 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.943 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.943 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.943 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.943 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:12:49.943 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.943 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.943 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.943 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.943 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:12:49.943 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:12:49.943 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.943 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.943 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:12:49.943 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.943 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.943 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.943 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:12:49.943 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:12:49.943 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.943 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.944 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.945 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.946 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.946 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:12:49.946 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.946 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.946 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.946 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.946 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:12:49.946 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:12:49.946 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.946 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.946 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:49.946 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.946 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.946 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.946 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:12:49.946 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:12:49.946 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.946 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.946 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.946 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.946 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:12:49.946 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.946 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.946 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.946 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.946 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.947 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.948 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.948 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:12:49.948 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:12:49.948 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:49.948 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:49.948 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:12:49.948 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:49.948 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.948 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.948 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.948 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:12:49.948 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:12:49.948 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.948 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:49.948 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:49.948 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:49.948 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.948 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:49.948 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:12:49.948 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.948 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:49.948 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:49.948 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:49.948 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.948 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:49.948 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:12:49.949 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:49.949 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:49.949 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:49.949 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:12:49.949 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:49.949 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:49.949 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:49.949 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:12:49.949 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:12:49.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.932+0000 7f6942a36640 1 -- 10.20.193.48:0/1876524579 >> v2:10.20.193.111:6812/977811348 conn(0x7f690c03f800 msgr2=0x7f690c05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.932+0000 7f6942a36640 1 --2- 10.20.193.48:0/1876524579 >> v2:10.20.193.111:6812/977811348 conn(0x7f690c03f800 0x7f690c05fcb0 secure :-1 s=READY pgs=327 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f693002ff10 tx=0x7f6930007f90 comp rx=0 tx=0).stop 2026-02-12T18:12:49.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.932+0000 7f6942a36640 10 monclient: shutdown 2026-02-12T18:12:49.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.932+0000 7f6942a36640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:49.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.932+0000 7f6942a36640 1 -- 10.20.193.48:0/1876524579 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f693c05c950 msgr2=0x7f693c08c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:49.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.932+0000 7f6942a36640 1 --2- 10.20.193.48:0/1876524579 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f693c05c950 0x7f693c08c600 secure :-1 s=READY pgs=18 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f692800c480 tx=0x7f692800c950 comp rx=0 tx=0).stop 2026-02-12T18:12:49.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.932+0000 7f6940fac640 1 -- 10.20.193.48:0/1876524579 reap_dead start 2026-02-12T18:12:49.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.932+0000 7f6940fac640 1 -- 10.20.193.48:0/1876524579 reap_dead start 2026-02-12T18:12:49.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.932+0000 7f6942a36640 1 -- 10.20.193.48:0/1876524579 shutdown_connections 2026-02-12T18:12:49.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.932+0000 7f6942a36640 1 -- 10.20.193.48:0/1876524579 >> 10.20.193.48:0/1876524579 conn(0x7f693c0548a0 msgr2=0x7f693c093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:49.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.933+0000 7f6942a36640 1 -- 10.20.193.48:0/1876524579 shutdown_connections 2026-02-12T18:12:49.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:49.933+0000 7f6942a36640 1 -- 10.20.193.48:0/1876524579 wait complete. 2026-02-12T18:12:49.950 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:12:49.950 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2026-02-12T18:12:49.951 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2026-02-12T18:12:50.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.015+0000 7f4db350c640 10 monclient: get_monmap_and_config 2026-02-12T18:12:50.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.015+0000 7f4db350c640 10 monclient: build_initial_monmap 2026-02-12T18:12:50.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.015+0000 7f4db350c640 10 monclient: monmap: 2026-02-12T18:12:50.016 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:50.016 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.016 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:12:50.016279+0000 2026-02-12T18:12:50.016 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:12:50.016279+0000 2026-02-12T18:12:50.016 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:50.016 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.017 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:12:50.017 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:12:50.017 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:50.017 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:50.017 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:50.017 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:50.017 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:50.017 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:50.017 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:50.017 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:12:50.017 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:12:50.017 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.015+0000 7f4db350c640 1 Processor -- start 2026-02-12T18:12:50.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.015+0000 7f4db350c640 1 -- start start 2026-02-12T18:12:50.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.015+0000 7f4db350c640 10 monclient: init 2026-02-12T18:12:50.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.015+0000 7f4db350c640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:50.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.015+0000 7f4db350c640 10 monclient: _add_conns ranks=[5,6,1,2,10,0,8,9,7,3,4] 2026-02-12T18:12:50.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.015+0000 7f4db350c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f4dac05c950 0x7f4dac05cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.015+0000 7f4db350c640 10 monclient(hunting): picked mon.noname-h con 0x7f4dac05c950 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:12:50.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.015+0000 7f4db350c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4dac05e490 0x7f4dac05d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.015+0000 7f4db350c640 10 monclient(hunting): picked mon.noname-d con 0x7f4dac05e490 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:12:50.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.015+0000 7f4db350c640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f4dac13db70 addr v1:10.20.193.111:6789/0 2026-02-12T18:12:50.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.015+0000 7f4db350c640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dac04dc20 con 0x7f4dac13db70 2026-02-12T18:12:50.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.015+0000 7f4db350c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.015+0000 7f4db350c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f4dac05ddd0 con 0x7f4dac05c950 2026-02-12T18:12:50.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.015+0000 7f4db350c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.015+0000 7f4db350c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f4dac05d7a0 con 0x7f4dac05e490 2026-02-12T18:12:50.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.015+0000 7f4db350c640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:50.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.015+0000 7f4db350c640 10 monclient(hunting): authenticate will time out at 1008.741961s 2026-02-12T18:12:50.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.016+0000 7f4db0a80640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4dac05e490 0x7f4dac05d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.016+0000 7f4db0a80640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4dac05e490 0x7f4dac05d260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:59396/0 (socket says 10.20.193.48:59396) 2026-02-12T18:12:50.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.016+0000 7f4db0a80640 1 -- 10.20.193.48:0/2231135215 learned_addr learned my addr 10.20.193.48:0/2231135215 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:50.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.016+0000 7f4db0a80640 10 monclient(hunting): get_auth_request con 0x7f4dac05e490 auth_method 0 2026-02-12T18:12:50.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.016+0000 7f4db0a80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.016+0000 7f4db0a80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.016+0000 7f4db0a80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.016+0000 7f4db0a80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.016+0000 7f4db0a80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.016+0000 7f4db0a80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.016+0000 7f4db1281640 1 --2- 10.20.193.48:0/2231135215 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f4dac05c950 0x7f4dac05cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.016+0000 7f4db0a80640 10 monclient(hunting): handle_auth_done global_id 5766 payload 274 2026-02-12T18:12:50.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.016+0000 7f4db0a80640 1 -- 10.20.193.48:0/2231135215 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f4dac05c950 msgr2=0x7f4dac05cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:50.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.016+0000 7f4db0a80640 1 --2- 10.20.193.48:0/2231135215 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f4dac05c950 0x7f4dac05cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.016+0000 7f4db0a80640 1 -- 10.20.193.48:0/2231135215 >> v1:10.20.193.111:6789/0 conn(0x7f4dac13db70 legacy=0x7f4dac13dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:50.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.016+0000 7f4db0a80640 10 monclient: _finish_hunting 0 2026-02-12T18:12:50.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.016+0000 7f4db0a80640 1 monclient: found mon.noname-d 2026-02-12T18:12:50.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.016+0000 7f4db0a80640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:50.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.016+0000 7f4db0a80640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:12:50.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.016+0000 7f4db0a80640 1 -- 10.20.193.48:0/2231135215 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dac092990 con 0x7f4dac05e490 2026-02-12T18:12:50.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.016+0000 7f4db1281640 10 monclient: get_auth_request con 0x7f4dac05c950 auth_method 0 2026-02-12T18:12:50.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.016+0000 7f4db1281640 1 --2- 10.20.193.48:0/2231135215 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f4dac05c950 0x7f4dac05cd20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-12T18:12:50.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.018+0000 7f4db0a80640 1 -- 10.20.193.48:0/2231135215 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4dac05e490 msgr2=0x7f4dac05d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:50.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.018+0000 7f4db0a80640 1 --2- 10.20.193.48:0/2231135215 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4dac05e490 0x7f4dac05d260 secure :-1 s=READY pgs=272 gs=2 cs=0 l=1 c_cookie=12560179095307587106 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da00098d0 tx=0x7f4da002ee20 comp rx=0 tx=0).ready entity=mon.6 client_cookie=ae4eb8572b188e22 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.018+0000 7f4d9bfff640 1 -- 10.20.193.48:0/2231135215 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4da002fb80 con 0x7f4dac05e490 2026-02-12T18:12:50.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.018+0000 7f4d9bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.018+0000 7f4d9bfff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:12:50.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.018+0000 7f4d9bfff640 10 monclient: dump: 2026-02-12T18:12:50.023 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.023 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.023 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.023 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.023 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.023 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.023 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.023 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.023 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.023 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.023 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.023 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.023 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.023 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.023 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.023 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.018+0000 7f4d9bfff640 10 monclient: _finish_auth 0 2026-02-12T18:12:50.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.018+0000 7f4d9bfff640 10 monclient: _check_auth_tickets 2026-02-12T18:12:50.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.018+0000 7f4d9bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:50.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.018+0000 7f4d9bfff640 1 -- 10.20.193.48:0/2231135215 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da002fd00 con 0x7f4dac05e490 2026-02-12T18:12:50.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.018+0000 7f4d9bfff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.018+0000 7f4db350c640 5 monclient: authenticate success, global_id 5766 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.018+0000 7f4d9bfff640 1 -- 10.20.193.48:0/2231135215 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4da002fe70 con 0x7f4dac05e490 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.018+0000 7f4db350c640 10 monclient: get_monmap_and_config success 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.018+0000 7f4db350c640 4 set_mon_vals no callback set 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.018+0000 7f4d9bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.018+0000 7f4d9bfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.018+0000 7f4d9bfff640 10 monclient: dump: 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.019+0000 7f4db350c640 10 monclient: shutdown 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.019+0000 7f4db350c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.019+0000 7f4db350c640 1 -- 10.20.193.48:0/2231135215 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4dac05e490 msgr2=0x7f4dac05d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.019+0000 7f4db350c640 1 --2- 10.20.193.48:0/2231135215 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4dac05e490 0x7f4dac05d260 secure :-1 s=READY pgs=272 gs=2 cs=0 l=1 c_cookie=12560179095307587106 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da00098d0 tx=0x7f4da002ee20 comp rx=0 tx=0).stop 2026-02-12T18:12:50.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.019+0000 7f4db350c640 1 -- 10.20.193.48:0/2231135215 shutdown_connections 2026-02-12T18:12:50.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.019+0000 7f4db350c640 1 --2- 10.20.193.48:0/2231135215 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4dac05e490 0x7f4dac05d260 unknown :-1 s=CLOSED pgs=272 gs=2 cs=0 l=1 c_cookie=12560179095307587106 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.019+0000 7f4db350c640 1 --2- 10.20.193.48:0/2231135215 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f4dac05c950 0x7f4dac05cd20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.019+0000 7f4db350c640 1 -- 10.20.193.48:0/2231135215 >> 10.20.193.48:0/2231135215 conn(0x7f4dac0548a0 msgr2=0x7f4dac097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:50.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.019+0000 7f4db350c640 1 -- 10.20.193.48:0/2231135215 shutdown_connections 2026-02-12T18:12:50.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.019+0000 7f4db350c640 1 -- 10.20.193.48:0/2231135215 wait complete. 2026-02-12T18:12:50.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.019+0000 7f4db350c640 10 monclient: build_initial_monmap 2026-02-12T18:12:50.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.019+0000 7f4db350c640 10 monclient: monmap: 2026-02-12T18:12:50.025 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:50.025 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:12:50.025 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:12:50.025 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:12:50.025 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:50.025 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.025 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:12:50.025 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:12:50.025 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:50.025 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:50.025 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:50.025 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:50.025 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:50.025 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:50.025 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:50.025 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.019+0000 7f4db350c640 1 Processor -- start 2026-02-12T18:12:50.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db350c640 1 -- start start 2026-02-12T18:12:50.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db350c640 10 monclient: init 2026-02-12T18:12:50.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db350c640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:50.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db350c640 10 monclient: _add_conns ranks=[2,6,8,3,5,4,0,1,7] 2026-02-12T18:12:50.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db350c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4dac05c950 0x7f4dac08f130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db350c640 10 monclient(hunting): picked mon.noname-b con 0x7f4dac05c950 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:12:50.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db350c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4dac05e490 0x7f4dac08f670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db350c640 10 monclient(hunting): picked mon.noname-d con 0x7f4dac05e490 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:12:50.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db350c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4dac13db70 0x7f4dac08fbb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db350c640 10 monclient(hunting): picked mon.noname-e con 0x7f4dac13db70 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:12:50.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db350c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db350c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f4dac13e8c0 con 0x7f4dac05c950 2026-02-12T18:12:50.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db350c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db350c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f4dac08cd80 con 0x7f4dac05e490 2026-02-12T18:12:50.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db350c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db350c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f4dac08a2b0 con 0x7f4dac13db70 2026-02-12T18:12:50.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db350c640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:50.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db350c640 10 monclient(hunting): authenticate will time out at 1008.746284s 2026-02-12T18:12:50.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db0a80640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4dac05e490 0x7f4dac08f670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db0a80640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4dac05e490 0x7f4dac08f670 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:59404/0 (socket says 10.20.193.48:59404) 2026-02-12T18:12:50.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db0a80640 1 -- 10.20.193.48:0/1410209353 learned_addr learned my addr 10.20.193.48:0/1410209353 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:50.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db0a80640 10 monclient(hunting): get_auth_request con 0x7f4dac05e490 auth_method 0 2026-02-12T18:12:50.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db0a80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db0a80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db0a80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db1281640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4dac05c950 0x7f4dac08f130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db1281640 10 monclient(hunting): get_auth_request con 0x7f4dac05c950 auth_method 0 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db1a82640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4dac13db70 0x7f4dac08fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db1281640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db1281640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db1281640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db0a80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db0a80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db0a80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db1a82640 10 monclient(hunting): get_auth_request con 0x7f4dac13db70 auth_method 0 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db1a82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db1a82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db1a82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db1281640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db1281640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db1281640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db1a82640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db1a82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db1a82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db0a80640 10 monclient(hunting): handle_auth_done global_id 5775 payload 824 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db0a80640 1 -- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4dac13db70 msgr2=0x7f4dac08fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db0a80640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4dac13db70 0x7f4dac08fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db0a80640 1 -- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4dac05c950 msgr2=0x7f4dac08f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db0a80640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4dac05c950 0x7f4dac08f130 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db0a80640 10 monclient: _finish_hunting 0 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db0a80640 1 monclient: found mon.noname-d 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db0a80640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db0a80640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:12:50.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.020+0000 7f4db0a80640 1 -- 10.20.193.48:0/1410209353 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4da00094f0 con 0x7f4dac05e490 2026-02-12T18:12:50.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.022+0000 7f4db0a80640 1 -- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4dac05e490 msgr2=0x7f4dac08f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:50.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.022+0000 7f4db0a80640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4dac05e490 0x7f4dac08f670 secure :-1 s=READY pgs=273 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da00099d0 tx=0x7f4da0004770 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.022+0000 7f4db0a80640 1 -- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4dac05e490 msgr2=0x7f4dac08f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-12T18:12:50.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.022+0000 7f4db0a80640 1 -- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4dac05e490 msgr2=0x7f4dac08f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:12:50.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.022+0000 7f4db0a80640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4dac05e490 0x7f4dac08f670 secure :-1 s=READY pgs=273 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da00099d0 tx=0x7f4da0004770 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:12:50.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.022+0000 7f4db0a80640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4dac05e490 0x7f4dac08f670 secure :-1 s=READY pgs=273 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da00099d0 tx=0x7f4da0004770 comp rx=0 tx=0).stop 2026-02-12T18:12:50.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.022+0000 7f4d99ffb640 10 monclient: ms_handle_reset current mon [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:12:50.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.022+0000 7f4d99ffb640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:50.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.022+0000 7f4d99ffb640 1 -- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4dac05e490 msgr2=0x7f4dac08f670 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:50.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.022+0000 7f4d99ffb640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4dac05e490 0x7f4dac08f670 unknown :-1 s=CLOSED pgs=273 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.022+0000 7f4d99ffb640 10 monclient: _add_conns ranks=[5,7,1,4,0,3] 2026-02-12T18:12:50.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.022+0000 7f4d99ffb640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f4d7c003690 0x7f4d7c023ad0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.022+0000 7f4d99ffb640 10 monclient(hunting): picked mon.noname-h con 0x7f4d7c003690 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:12:50.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.022+0000 7f4d99ffb640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f4d7c024620 0x7f4d7c044aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.022+0000 7f4d99ffb640 10 monclient(hunting): picked mon.noname-i con 0x7f4d7c024620 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:12:50.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.022+0000 7f4d99ffb640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f4d7c045640 0x7f4d7c065af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.022+0000 7f4d99ffb640 10 monclient(hunting): picked mon.noname-f con 0x7f4d7c045640 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:12:50.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.022+0000 7f4d99ffb640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.022+0000 7f4d99ffb640 1 -- 10.20.193.48:0/1410209353 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7c0666e0 con 0x7f4d7c045640 2026-02-12T18:12:50.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.022+0000 7f4d99ffb640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.022+0000 7f4d99ffb640 1 -- 10.20.193.48:0/1410209353 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f4d7c066820 con 0x7f4d7c003690 2026-02-12T18:12:50.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.022+0000 7f4d99ffb640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.022+0000 7f4d99ffb640 1 -- 10.20.193.48:0/1410209353 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f4d7c0669e0 con 0x7f4d7c024620 2026-02-12T18:12:50.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.022+0000 7f4d99ffb640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:50.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1281640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f4d7c003690 0x7f4d7c023ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1281640 10 monclient(hunting): get_auth_request con 0x7f4d7c003690 auth_method 0 2026-02-12T18:12:50.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1281640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1281640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1281640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:12:50.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db0a80640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f4d7c024620 0x7f4d7c044aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db0a80640 10 monclient(hunting): get_auth_request con 0x7f4d7c024620 auth_method 0 2026-02-12T18:12:50.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db0a80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db0a80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db0a80640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:12:50.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1a82640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f4d7c045640 0x7f4d7c065af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1a82640 10 monclient(hunting): get_auth_request con 0x7f4d7c045640 auth_method 0 2026-02-12T18:12:50.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1a82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1a82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1a82640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:12:50.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1281640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1281640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1281640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:12:50.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1a82640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1a82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1a82640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:12:50.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db0a80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db0a80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db0a80640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:12:50.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1281640 10 monclient(hunting): handle_auth_done global_id 5775 payload 293 2026-02-12T18:12:50.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1281640 1 -- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f4d7c024620 msgr2=0x7f4d7c044aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1281640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f4d7c024620 0x7f4d7c044aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1281640 1 -- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f4d7c045640 msgr2=0x7f4d7c065af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1281640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f4d7c045640 0x7f4d7c065af0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1281640 10 monclient: _finish_hunting 0 2026-02-12T18:12:50.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1281640 1 monclient: found mon.noname-h 2026-02-12T18:12:50.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1281640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:50.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1281640 10 monclient: _send_mon_message to mon.noname-h at v2:10.20.193.111:3302/0 2026-02-12T18:12:50.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1281640 1 -- 10.20.193.48:0/1410209353 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d7c066c60 con 0x7f4d7c003690 2026-02-12T18:12:50.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.023+0000 7f4db1a82640 1 -- 10.20.193.48:0/1410209353 reap_dead start 2026-02-12T18:12:50.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.025+0000 7f4db1281640 1 -- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f4d7c003690 msgr2=0x7f4d7c023ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:50.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.025+0000 7f4db1281640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f4d7c003690 0x7f4d7c023ad0 secure :-1 s=READY pgs=23 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d9c004740 tx=0x7f4da0033000 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.025+0000 7f4d99ffb640 1 -- 10.20.193.48:0/1410209353 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4d9c0044f0 con 0x7f4d7c003690 2026-02-12T18:12:50.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.025+0000 7f4d99ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.025+0000 7f4d99ffb640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2026-02-12T18:12:50.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.025+0000 7f4d99ffb640 10 monclient: dump: 2026-02-12T18:12:50.034 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.034 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.034 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.034 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.035 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.035 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.035 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.035 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.035 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.035 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.035 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.035 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.035 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.035 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.035 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.035 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.025+0000 7f4d99ffb640 10 monclient: _finish_auth 0 2026-02-12T18:12:50.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.025+0000 7f4d99ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:12:50.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.025+0000 7f4db1281640 1 -- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f4d7c003690 msgr2=0x7f4d7c023ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-12T18:12:50.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.025+0000 7f4d99ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:50.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.025+0000 7f4db1281640 1 -- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f4d7c003690 msgr2=0x7f4d7c023ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:12:50.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.025+0000 7f4db1281640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f4d7c003690 0x7f4d7c023ad0 secure :-1 s=READY pgs=23 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d9c004740 tx=0x7f4da0033000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:12:50.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.025+0000 7f4db1281640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f4d7c003690 0x7f4d7c023ad0 secure :-1 s=READY pgs=23 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d9c004740 tx=0x7f4da0033000 comp rx=0 tx=0).stop 2026-02-12T18:12:50.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.025+0000 7f4db350c640 5 monclient: authenticate success, global_id 5775 2026-02-12T18:12:50.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.025+0000 7f4db350c640 10 monclient: _renew_subs 2026-02-12T18:12:50.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.025+0000 7f4db350c640 10 monclient: _send_mon_message to mon.h at v2:10.20.193.111:3302/0 2026-02-12T18:12:50.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.025+0000 7f4db350c640 1 -- 10.20.193.48:0/1410209353 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dac08b130 con 0x7f4d7c003690 2026-02-12T18:12:50.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.025+0000 7f4d99ffb640 10 monclient: ms_handle_reset current mon [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:12:50.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.025+0000 7f4d99ffb640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:50.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.025+0000 7f4d99ffb640 1 -- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f4d7c003690 msgr2=0x7f4d7c023ad0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:50.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.025+0000 7f4d99ffb640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f4d7c003690 0x7f4d7c023ad0 unknown :-1 s=CLOSED pgs=23 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.025+0000 7f4d99ffb640 10 monclient: _add_conns ranks=[3,8,1,7,2,6,4,0,5] 2026-02-12T18:12:50.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.025+0000 7f4d99ffb640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f4d7c046860 0x7f4d7c044a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4d99ffb640 10 monclient(hunting): picked mon.g con 0x7f4d7c046860 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:12:50.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4d99ffb640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4d7c046db0 0x7f4d7c047220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4d99ffb640 10 monclient(hunting): picked mon.e con 0x7f4d7c046db0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:12:50.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4d99ffb640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f4d7c047c40 0x7f4d7c0480b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4d99ffb640 10 monclient(hunting): picked mon.f con 0x7f4d7c047c40 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:12:50.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4d99ffb640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4d99ffb640 1 -- 10.20.193.48:0/1410209353 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7c048b80 con 0x7f4d7c047c40 2026-02-12T18:12:50.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4d99ffb640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4d99ffb640 1 -- 10.20.193.48:0/1410209353 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f4d7c048cf0 con 0x7f4d7c046860 2026-02-12T18:12:50.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4d99ffb640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4d99ffb640 1 -- 10.20.193.48:0/1410209353 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f4d7c048e60 con 0x7f4d7c046db0 2026-02-12T18:12:50.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4d99ffb640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:50.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db350c640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:50.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4d99ffb640 1 -- 10.20.193.48:0/1410209353 <== mon.5 v2:10.20.193.111:3302/0 2 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4d9c00c040 con 0x7f4d7c003690 2026-02-12T18:12:50.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4d99ffb640 10 monclient(hunting): discarding stray monitor message config(0 keys) 2026-02-12T18:12:50.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db0a80640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4d7c046db0 0x7f4d7c047220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db0a80640 10 monclient(hunting): get_auth_request con 0x7f4d7c046db0 auth_method 0 2026-02-12T18:12:50.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db0a80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db0a80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db0a80640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:12:50.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db1281640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f4d7c046860 0x7f4d7c044a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db0a80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db0a80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db0a80640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db1281640 10 monclient(hunting): get_auth_request con 0x7f4d7c046860 auth_method 0 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db1a82640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f4d7c047c40 0x7f4d7c0480b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db1281640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db1281640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db1281640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db1a82640 10 monclient(hunting): get_auth_request con 0x7f4d7c047c40 auth_method 0 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db1a82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db1a82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db1a82640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db0a80640 10 monclient(hunting): handle_auth_done global_id 5775 payload 293 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db0a80640 1 -- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f4d7c046860 msgr2=0x7f4d7c044a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db0a80640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f4d7c046860 0x7f4d7c044a00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db0a80640 1 -- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f4d7c047c40 msgr2=0x7f4d7c0480b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db0a80640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f4d7c047c40 0x7f4d7c0480b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db0a80640 10 monclient: _finish_hunting 0 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db0a80640 1 monclient: found mon.e 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db0a80640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db0a80640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db0a80640 1 -- 10.20.193.48:0/1410209353 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+}) -- 0x7f4d7c0462d0 con 0x7f4d7c046db0 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db0a80640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db0a80640 1 -- 10.20.193.48:0/1410209353 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dac08b130 con 0x7f4d7c046db0 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db0a80640 10 monclient: _finish_auth 0 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db0a80640 10 monclient: _check_auth_tickets 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db0a80640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db1281640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f4d7c046860 0x7f4d7c044a00 unknown :-1 s=CLOSED pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:12:50.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db350c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:50.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db350c640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4dac11fd90 0x7f4dac120160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db350c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db350c640 1 -- 10.20.193.48:0/1410209353 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f4dac05f140 con 0x7f4dac11fd90 2026-02-12T18:12:50.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db1281640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4dac11fd90 0x7f4dac120160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=10 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db1281640 10 monclient: get_auth_request con 0x7f4dac11fd90 auth_method 0 2026-02-12T18:12:50.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db1281640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db1281640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db1281640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db1281640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db1281640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db1281640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.026+0000 7f4db1281640 10 monclient(hunting): handle_auth_done global_id 94166 payload 824 2026-02-12T18:12:50.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.027+0000 7f4db1281640 1 -- 10.20.193.48:0/1410209353 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4dac097de0 con 0x7f4dac11fd90 2026-02-12T18:12:50.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.028+0000 7f4db0a80640 1 -- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4d7c046db0 msgr2=0x7f4d7c047220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:50.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.028+0000 7f4db0a80640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4d7c046db0 0x7f4d7c047220 secure :-1 s=READY pgs=19 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dac08acd0 tx=0x7f4d9c008040 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.028+0000 7f4d99ffb640 1 -- 10.20.193.48:0/1410209353 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4da0006d50 con 0x7f4d7c046db0 2026-02-12T18:12:50.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.028+0000 7f4d99ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.028+0000 7f4d99ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:12:50.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.028+0000 7f4d99ffb640 10 monclient: dump: 2026-02-12T18:12:50.038 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.038 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.038 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.038 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.038 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.038 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.028+0000 7f4d99ffb640 1 -- 10.20.193.48:0/1410209353 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da004e050 con 0x7f4d7c046db0 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.028+0000 7f4d99ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.028+0000 7f4d9b7fe640 4 set_mon_vals no callback set 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.029+0000 7f4db1281640 1 -- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4dac11fd90 msgr2=0x7f4dac120160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.029+0000 7f4db1281640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4dac11fd90 0x7f4dac120160 secure :-1 s=READY pgs=20 gs=10 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d9c006fd0 tx=0x7f4d9c0047e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.029+0000 7f4d99ffb640 1 -- 10.20.193.48:0/1410209353 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f4da0004120 con 0x7f4d7c046db0 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.029+0000 7f4d99ffb640 1 --2- 10.20.193.48:0/1410209353 >> v2:10.20.193.111:6812/977811348 conn(0x7f4d7c0c4bd0 0x7f4d7c0e5080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.029+0000 7f4d99ffb640 1 -- 10.20.193.48:0/1410209353 <== mon.8 v2:10.20.193.48:3304/0 4 ==== osd_map(218..218 src has 190..218) ==== 3897+0+0 (secure 0 0 0) 0x7f4da0079930 con 0x7f4d7c046db0 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.029+0000 7f4d99ffb640 1 -- 10.20.193.48:0/1410209353 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4d9c003e70 con 0x7f4dac11fd90 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.029+0000 7f4d99ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.029+0000 7f4d99ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.029+0000 7f4d99ffb640 10 monclient: dump: 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.039 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.040 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.040 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.040 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.040 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.040 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.040 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.040 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.040 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.040 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.040 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.040 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.029+0000 7f4d99ffb640 1 -- 10.20.193.48:0/1410209353 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f4d9c021050 con 0x7f4dac11fd90 2026-02-12T18:12:50.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.029+0000 7f4d99ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:50.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.029+0000 7f4d99ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:12:50.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.029+0000 7f4d99ffb640 1 -- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4dac11fd90 msgr2=0x7f4dac120160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.029+0000 7f4d99ffb640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4dac11fd90 0x7f4dac120160 secure :-1 s=READY pgs=20 gs=10 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d9c006fd0 tx=0x7f4d9c0047e0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.029+0000 7f4d99ffb640 1 -- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4dac11fd90 msgr2=0x7f4dac120160 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:50.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.029+0000 7f4d99ffb640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4dac11fd90 0x7f4dac120160 secure :-1 s=CLOSED pgs=20 gs=10 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d9c006fd0 tx=0x7f4d9c0047e0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.029+0000 7f4db1a82640 1 --2- 10.20.193.48:0/1410209353 >> v2:10.20.193.111:6812/977811348 conn(0x7f4d7c0c4bd0 0x7f4d7c0e5080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=11 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.029+0000 7f4db1a82640 10 monclient: get_auth_request con 0x7f4d7c0c4bd0 auth_method 0 2026-02-12T18:12:50.041 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.032+0000 7f4db1a82640 1 --2- 10.20.193.48:0/1410209353 >> v2:10.20.193.111:6812/977811348 conn(0x7f4d7c0c4bd0 0x7f4d7c0e5080 secure :-1 s=READY pgs=328 gs=11 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da8004780 tx=0x7f4da800a040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.041 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.032+0000 7f4db350c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:12:50.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.033+0000 7f4db350c640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4dac08ad50 0x7f4dac1206a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.033+0000 7f4db350c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.033+0000 7f4db350c640 1 -- 10.20.193.48:0/1410209353 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f4dac050410 con 0x7f4dac08ad50 2026-02-12T18:12:50.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.033+0000 7f4db1281640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4dac08ad50 0x7f4dac1206a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=12 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.033+0000 7f4db1281640 10 monclient: get_auth_request con 0x7f4dac08ad50 auth_method 0 2026-02-12T18:12:50.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.033+0000 7f4db1281640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.033+0000 7f4db1281640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.033+0000 7f4db1281640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.033+0000 7f4db1281640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.033+0000 7f4db1281640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.033+0000 7f4db1281640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.033+0000 7f4db1281640 10 monclient(hunting): handle_auth_done global_id 94175 payload 824 2026-02-12T18:12:50.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.033+0000 7f4db1281640 1 -- 10.20.193.48:0/1410209353 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4dac0902b0 con 0x7f4dac08ad50 2026-02-12T18:12:50.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.035+0000 7f4db1281640 1 -- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4dac08ad50 msgr2=0x7f4dac1206a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:50.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.035+0000 7f4db1281640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4dac08ad50 0x7f4dac1206a0 secure :-1 s=READY pgs=21 gs=12 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d9c003fd0 tx=0x7f4d9c004770 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.035+0000 7f4d99ffb640 1 -- 10.20.193.48:0/1410209353 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4d9c027930 con 0x7f4dac08ad50 2026-02-12T18:12:50.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.035+0000 7f4d99ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.035+0000 7f4d99ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:12:50.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.035+0000 7f4d99ffb640 10 monclient: dump: 2026-02-12T18:12:50.042 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.042 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.042 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.042 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.042 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.042 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.043 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.043 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.043 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.043 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.043 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.043 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.043 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.043 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.043 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.043 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.035+0000 7f4d99ffb640 1 -- 10.20.193.48:0/1410209353 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7f4d9c027470 con 0x7f4dac08ad50 2026-02-12T18:12:50.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.035+0000 7f4d99ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:12:50.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.035+0000 7f4d99ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:12:50.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.035+0000 7f4d99ffb640 1 -- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4dac08ad50 msgr2=0x7f4dac1206a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.035+0000 7f4d99ffb640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4dac08ad50 0x7f4dac1206a0 secure :-1 s=READY pgs=21 gs=12 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d9c003fd0 tx=0x7f4d9c004770 comp rx=0 tx=0).stop 2026-02-12T18:12:50.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.035+0000 7f4d99ffb640 1 -- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4dac08ad50 msgr2=0x7f4dac1206a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:50.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.035+0000 7f4d99ffb640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4dac08ad50 0x7f4dac1206a0 secure :-1 s=CLOSED pgs=21 gs=12 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4d9c003fd0 tx=0x7f4d9c004770 comp rx=0 tx=0).stop 2026-02-12T18:12:50.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.035+0000 7f4db1a82640 1 -- 10.20.193.48:0/1410209353 reap_dead start 2026-02-12T18:12:50.043 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:12:50.043 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:12:50.044 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:12:50.044 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:12:50.044 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 68, 2026-02-12T18:12:50.044 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 15709, 2026-02-12T18:12:50.044 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:12:50.044 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:12:50.044 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:12:50.044 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:12:50.044 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:12:50.044 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:12:50.044 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:12:50.044 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:12:50.044 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:12:50.044 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:12:50.044 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:50.044 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:12:50.044 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:50.044 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:12:50.044 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:12:50.044 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:50.044 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:50.044 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:50.044 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:50.044 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:50.044 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:50.045 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:50.045 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:50.045 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:50.045 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:50.045 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:50.045 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:50.045 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:50.045 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:50.045 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:12:50.045 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:12:50.045 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:50.045 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:50.045 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:50.045 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:50.045 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:50.045 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:50.045 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:50.045 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:50.045 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:50.045 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:50.045 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:50.045 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:50.045 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:50.045 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.045 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.046 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:12:50.046 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:12:50.046 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:12:50.046 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:12:50.046 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:12:50.046 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:12:50.046 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:50.046 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:50.046 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:12:50.046 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:12:50.046 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:12:50.046 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:12:50.046 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:12:50.046 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:12:50.046 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:12:50.046 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:50.046 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:12:50.046 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:50.046 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:50.046 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:50.046 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:50.046 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:50.046 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:50.046 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:50.046 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:50.046 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:50.047 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:50.047 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:50.047 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:50.047 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:50.047 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:50.047 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:12:50.047 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.047 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:12:50.047 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.047 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:12:50.047 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:12:50.047 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.047 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.047 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.047 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.047 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:12:50.047 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.047 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.047 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.047 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.047 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:12:50.047 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.047 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.047 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.047 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.047 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:12:50.048 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:12:50.048 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.048 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.048 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:12:50.048 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.048 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.048 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.048 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:12:50.048 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:12:50.048 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.048 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.048 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.048 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.048 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:12:50.048 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.048 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.048 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.048 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.048 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:12:50.048 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.048 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.048 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.048 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.048 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:12:50.048 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:12:50.048 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.049 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:12:50.050 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.051 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.052 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.053 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:12:50.054 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.055 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.055 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.055 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.055 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:12:50.055 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:12:50.055 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.055 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:50.055 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:50.055 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:50.055 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.055 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:50.055 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:12:50.055 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.055 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:50.055 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:50.055 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:12:50.055 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.055 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.055 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.055 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:12:50.055 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:12:50.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.036+0000 7f4db350c640 1 -- 10.20.193.48:0/1410209353 >> v2:10.20.193.111:6812/977811348 conn(0x7f4d7c0c4bd0 msgr2=0x7f4d7c0e5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.036+0000 7f4db350c640 1 --2- 10.20.193.48:0/1410209353 >> v2:10.20.193.111:6812/977811348 conn(0x7f4d7c0c4bd0 0x7f4d7c0e5080 secure :-1 s=READY pgs=328 gs=11 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4da8004780 tx=0x7f4da800a040 comp rx=0 tx=0).stop 2026-02-12T18:12:50.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.036+0000 7f4db350c640 10 monclient: shutdown 2026-02-12T18:12:50.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.036+0000 7f4db350c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:50.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.036+0000 7f4db350c640 1 -- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4d7c046db0 msgr2=0x7f4d7c047220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.036+0000 7f4db350c640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4d7c046db0 0x7f4d7c047220 secure :-1 s=READY pgs=19 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4dac08acd0 tx=0x7f4d9c008040 comp rx=0 tx=0).stop 2026-02-12T18:12:50.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.036+0000 7f4db350c640 1 -- 10.20.193.48:0/1410209353 shutdown_connections 2026-02-12T18:12:50.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.036+0000 7f4db350c640 1 --2- 10.20.193.48:0/1410209353 >> v2:10.20.193.111:6812/977811348 conn(0x7f4d7c0c4bd0 0x7f4d7c0e5080 unknown :-1 s=CLOSED pgs=328 gs=11 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.036+0000 7f4db350c640 1 --2- 10.20.193.48:0/1410209353 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4d7c046db0 0x7f4d7c047220 unknown :-1 s=CLOSED pgs=19 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.036+0000 7f4db350c640 1 -- 10.20.193.48:0/1410209353 >> 10.20.193.48:0/1410209353 conn(0x7f4dac0548a0 msgr2=0x7f4dac093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:50.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.036+0000 7f4db350c640 1 -- 10.20.193.48:0/1410209353 shutdown_connections 2026-02-12T18:12:50.056 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.036+0000 7f4db350c640 1 -- 10.20.193.48:0/1410209353 wait complete. 2026-02-12T18:12:50.057 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:12:50.057 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2026-02-12T18:12:50.057 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2026-02-12T18:12:50.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.120+0000 7f23ee85b640 10 monclient: get_monmap_and_config 2026-02-12T18:12:50.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.120+0000 7f23ee85b640 10 monclient: build_initial_monmap 2026-02-12T18:12:50.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.120+0000 7f23ee85b640 10 monclient: monmap: 2026-02-12T18:12:50.121 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:50.121 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.121 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:12:50.121455+0000 2026-02-12T18:12:50.121 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:12:50.121455+0000 2026-02-12T18:12:50.122 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:50.122 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.122 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:12:50.122 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:12:50.122 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:50.122 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:50.122 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:50.122 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:50.122 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:50.122 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:50.122 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:50.122 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:12:50.122 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:12:50.122 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.120+0000 7f23ee85b640 1 Processor -- start 2026-02-12T18:12:50.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.120+0000 7f23ee85b640 1 -- start start 2026-02-12T18:12:50.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.120+0000 7f23ee85b640 10 monclient: init 2026-02-12T18:12:50.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23ee85b640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:50.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23ee85b640 10 monclient: _add_conns ranks=[8,10,6,4,9,1,5,3,0,2,7] 2026-02-12T18:12:50.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23ee85b640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f23e80914d0 0x7f23e805c950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23ee85b640 10 monclient(hunting): picked mon.noname-e con 0x7f23e80914d0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:12:50.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23ee85b640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f23e808e210 0x7f23e805ce90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23ee85b640 10 monclient(hunting): picked mon.noname-f con 0x7f23e808e210 addr v2:10.20.193.111:3300/0 2026-02-12T18:12:50.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23ee85b640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f23e805e4b0 0x7f23e805d3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23ee85b640 10 monclient(hunting): picked mon.noname-d con 0x7f23e805e4b0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:12:50.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23ee85b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23ee85b640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f23e8093d70 con 0x7f23e808e210 2026-02-12T18:12:50.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23ee85b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23ee85b640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f23e8092f90 con 0x7f23e805e4b0 2026-02-12T18:12:50.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23ee85b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23ee85b640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f23e80918a0 con 0x7f23e80914d0 2026-02-12T18:12:50.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23ee85b640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:50.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23ee85b640 10 monclient(hunting): authenticate will time out at 1008.847162s 2026-02-12T18:12:50.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23e7fff640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f23e80914d0 0x7f23e805c950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23e7fff640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f23e80914d0 0x7f23e805c950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:57356/0 (socket says 10.20.193.48:57356) 2026-02-12T18:12:50.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23e7fff640 1 -- 10.20.193.48:0/3210617475 learned_addr learned my addr 10.20.193.48:0/3210617475 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:50.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23e7fff640 10 monclient(hunting): get_auth_request con 0x7f23e80914d0 auth_method 0 2026-02-12T18:12:50.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23e7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23ecdd1640 1 --2- 10.20.193.48:0/3210617475 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f23e805e4b0 0x7f23e805d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23e7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23e7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23e7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23ecdd1640 10 monclient(hunting): get_auth_request con 0x7f23e805e4b0 auth_method 0 2026-02-12T18:12:50.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23ecdd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23ecdd1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23ecdd1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23e77fe640 1 --2- 10.20.193.48:0/3210617475 >> v2:10.20.193.111:3300/0 conn(0x7f23e808e210 0x7f23e805ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23e77fe640 10 monclient(hunting): get_auth_request con 0x7f23e808e210 auth_method 0 2026-02-12T18:12:50.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23e77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23ecdd1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23ecdd1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23ecdd1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23e7fff640 10 monclient(hunting): handle_auth_done global_id 94184 payload 274 2026-02-12T18:12:50.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23e7fff640 1 -- 10.20.193.48:0/3210617475 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f23e805e4b0 msgr2=0x7f23e805d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:50.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23e7fff640 1 --2- 10.20.193.48:0/3210617475 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f23e805e4b0 0x7f23e805d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23e7fff640 1 -- 10.20.193.48:0/3210617475 >> v2:10.20.193.111:3300/0 conn(0x7f23e808e210 msgr2=0x7f23e805ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:50.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23e7fff640 1 --2- 10.20.193.48:0/3210617475 >> v2:10.20.193.111:3300/0 conn(0x7f23e808e210 0x7f23e805ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23e7fff640 10 monclient: _finish_hunting 0 2026-02-12T18:12:50.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23e7fff640 1 monclient: found mon.noname-e 2026-02-12T18:12:50.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23e7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:50.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23e7fff640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:12:50.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.121+0000 7f23e7fff640 1 -- 10.20.193.48:0/3210617475 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e804dc20 con 0x7f23e80914d0 2026-02-12T18:12:50.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.123+0000 7f23e7fff640 1 -- 10.20.193.48:0/3210617475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f23e80914d0 msgr2=0x7f23e805c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.123+0000 7f23e7fff640 1 --2- 10.20.193.48:0/3210617475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f23e80914d0 0x7f23e805c950 secure :-1 s=READY pgs=22 gs=1 cs=0 l=1 c_cookie=3171050490059852737 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23d4009060 tx=0x7f23d402edf0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=2c01d59ea8d88bc1 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.123+0000 7f23e7fff640 1 -- 10.20.193.48:0/3210617475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f23e80914d0 msgr2=0x7f23e805c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 10 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.123+0000 7f23e7fff640 1 -- 10.20.193.48:0/3210617475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f23e80914d0 msgr2=0x7f23e805c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e7fff640 1 --2- 10.20.193.48:0/3210617475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f23e80914d0 0x7f23e805c950 secure :-1 s=READY pgs=22 gs=1 cs=0 l=1 c_cookie=3171050490059852737 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23d4009060 tx=0x7f23d402edf0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e7fff640 1 --2- 10.20.193.48:0/3210617475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f23e80914d0 0x7f23e805c950 secure :-1 s=READY pgs=22 gs=1 cs=0 l=1 c_cookie=3171050490059852737 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23d4009060 tx=0x7f23d402edf0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e6ffd640 10 monclient: ms_handle_reset current mon [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e6ffd640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e6ffd640 1 -- 10.20.193.48:0/3210617475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f23e80914d0 msgr2=0x7f23e805c950 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e6ffd640 1 --2- 10.20.193.48:0/3210617475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f23e80914d0 0x7f23e805c950 unknown :-1 s=CLOSED pgs=22 gs=1 cs=0 l=1 c_cookie=3171050490059852737 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e6ffd640 10 monclient: _add_conns ranks=[9,1,0,3,5,4,2,7] 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e6ffd640 1 --2- 10.20.193.48:0/3210617475 >> v2:10.20.193.48:3300/0 conn(0x7f23cc0036f0 0x7f23cc023b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e6ffd640 10 monclient(hunting): picked mon.noname-a con 0x7f23cc0036f0 addr v2:10.20.193.48:3300/0 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e6ffd640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f23cc024380 addr v1:10.20.193.111:6789/0 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e6ffd640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f23cc046340 addr v1:10.20.193.48:6789/0 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e6ffd640 1 -- 10.20.193.48:0/3210617475 --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23cc0682e0 con 0x7f23cc046340 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e6ffd640 1 -- 10.20.193.48:0/3210617475 --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23cc0694c0 con 0x7f23cc024380 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e6ffd640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e6ffd640 1 -- 10.20.193.48:0/3210617475 --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f23cc06a6d0 con 0x7f23cc0036f0 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e6ffd640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e6ffd640 10 monclient(hunting): ms_handle_reset stray mon [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e7fff640 1 --2- 10.20.193.48:0/3210617475 >> v2:10.20.193.48:3300/0 conn(0x7f23cc0036f0 0x7f23cc023b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e7fff640 10 monclient(hunting): get_auth_request con 0x7f23cc0036f0 auth_method 0 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e7fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e77fe640 1 -- 10.20.193.48:0/3210617475 >> v1:10.20.193.111:6789/0 conn(0x7f23cc024380 legacy=0x7f23cc044830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:12:50.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e77fe640 1 -- 10.20.193.48:0/3210617475 >> v1:10.20.193.111:6789/0 conn(0x7f23cc024380 legacy=0x7f23cc044830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:12:50.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e77fe640 1 --1- 10.20.193.48:0/3210617475 >> v1:10.20.193.111:6789/0 conn(0x7f23cc024380 0x7f23cc044830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=4 cs=0 l=0).handle_server_banner_and_identify read banner and identify addresses failed 2026-02-12T18:12:50.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e7fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:12:50.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e7fff640 10 monclient(hunting): handle_auth_done global_id 94184 payload 293 2026-02-12T18:12:50.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e7fff640 1 -- 10.20.193.48:0/3210617475 >> v1:10.20.193.111:6789/0 conn(0x7f23cc024380 legacy=0x7f23cc044830 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:12:50.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e7fff640 1 -- 10.20.193.48:0/3210617475 >> v1:10.20.193.48:6789/0 conn(0x7f23cc046340 legacy=0x7f23cc0667f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:50.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e7fff640 10 monclient: _finish_hunting 0 2026-02-12T18:12:50.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e7fff640 1 monclient: found mon.noname-a 2026-02-12T18:12:50.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:50.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23ecdd1640 1 -- 10.20.193.48:0/3210617475 reap_dead start 2026-02-12T18:12:50.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e7fff640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:12:50.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.124+0000 7f23e7fff640 1 -- 10.20.193.48:0/3210617475 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23cc06a920 con 0x7f23cc0036f0 2026-02-12T18:12:50.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.126+0000 7f23e7fff640 1 -- 10.20.193.48:0/3210617475 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f23cc0036f0 msgr2=0x7f23cc023b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:50.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.126+0000 7f23e7fff640 1 --2- 10.20.193.48:0/3210617475 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f23cc0036f0 0x7f23cc023b30 secure :-1 s=READY pgs=466 gs=6 cs=0 l=1 c_cookie=3366574464183731964 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23e8093ce0 tx=0x7f23d40092c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb879a3679286fc server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.126+0000 7f23e6ffd640 1 -- 10.20.193.48:0/3210617475 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f23d402fc40 con 0x7f23cc0036f0 2026-02-12T18:12:50.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.126+0000 7f23e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.126+0000 7f23e6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:12:50.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.126+0000 7f23e6ffd640 10 monclient: dump: 2026-02-12T18:12:50.130 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.130 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.130 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.130 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.130 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.130 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.130 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.130 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.130 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.130 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.130 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.130 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.130 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.130 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.126+0000 7f23e6ffd640 10 monclient: _finish_auth 0 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.126+0000 7f23e6ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.126+0000 7f23e6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.126+0000 7f23e6ffd640 1 -- 10.20.193.48:0/3210617475 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d4037900 con 0x7f23cc0036f0 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.126+0000 7f23e6ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.126+0000 7f23ee85b640 5 monclient: authenticate success, global_id 94184 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.126+0000 7f23e6ffd640 1 -- 10.20.193.48:0/3210617475 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f23d4042420 con 0x7f23cc0036f0 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.126+0000 7f23ee85b640 10 monclient: get_monmap_and_config success 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.126+0000 7f23ee85b640 4 set_mon_vals no callback set 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.126+0000 7f23e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.126+0000 7f23e6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.126+0000 7f23e6ffd640 10 monclient: dump: 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.131 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.127+0000 7f23ee85b640 10 monclient: shutdown 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.127+0000 7f23ee85b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.127+0000 7f23ee85b640 1 -- 10.20.193.48:0/3210617475 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f23cc0036f0 msgr2=0x7f23cc023b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.127+0000 7f23ee85b640 1 --2- 10.20.193.48:0/3210617475 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f23cc0036f0 0x7f23cc023b30 secure :-1 s=READY pgs=466 gs=6 cs=0 l=1 c_cookie=3366574464183731964 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23e8093ce0 tx=0x7f23d40092c0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.127+0000 7f23ee85b640 1 -- 10.20.193.48:0/3210617475 shutdown_connections 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.127+0000 7f23ee85b640 1 --2- 10.20.193.48:0/3210617475 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f23cc0036f0 0x7f23cc023b30 unknown :-1 s=CLOSED pgs=466 gs=6 cs=0 l=1 c_cookie=3366574464183731964 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.127+0000 7f23ee85b640 1 -- 10.20.193.48:0/3210617475 >> 10.20.193.48:0/3210617475 conn(0x7f23e80548a0 msgr2=0x7f23e8097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.127+0000 7f23ee85b640 1 -- 10.20.193.48:0/3210617475 shutdown_connections 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.127+0000 7f23ee85b640 1 -- 10.20.193.48:0/3210617475 wait complete. 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.127+0000 7f23ee85b640 10 monclient: build_initial_monmap 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.127+0000 7f23ee85b640 10 monclient: monmap: 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:50.132 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.127+0000 7f23ee85b640 1 Processor -- start 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23ee85b640 1 -- start start 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23ee85b640 10 monclient: init 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23ee85b640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23ee85b640 10 monclient: _add_conns ranks=[1,6,5,2,3,4,8,7,0] 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23ee85b640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f23cc0036f0 0x7f23e81db250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23ee85b640 10 monclient(hunting): picked mon.noname-f con 0x7f23cc0036f0 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23ee85b640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f23e81afe40 0x7f23e81b0230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23ee85b640 10 monclient(hunting): picked mon.noname-d con 0x7f23e81afe40 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23ee85b640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f23e81d7d30 0x7f23e81d81a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23ee85b640 10 monclient(hunting): picked mon.noname-h con 0x7f23e81d7d30 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23ee85b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23ee85b640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f23e81994a0 con 0x7f23cc0036f0 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23ee85b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23ee85b640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f23e8094700 con 0x7f23e81d7d30 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23ee85b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23ee85b640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f23e808d1b0 con 0x7f23e81afe40 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23ee85b640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23ee85b640 10 monclient(hunting): authenticate will time out at 1008.854284s 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23e77fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f23e81afe40 0x7f23e81b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23e77fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f23e81afe40 0x7f23e81b0230 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:59416/0 (socket says 10.20.193.48:59416) 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23e77fe640 1 -- 10.20.193.48:0/2953999211 learned_addr learned my addr 10.20.193.48:0/2953999211 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23e77fe640 10 monclient(hunting): get_auth_request con 0x7f23e81afe40 auth_method 0 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23e77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23e77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23e77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23e77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23e77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23e77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23e7fff640 1 --2- 10.20.193.48:0/2953999211 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f23cc0036f0 0x7f23e81db250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23e7fff640 10 monclient(hunting): get_auth_request con 0x7f23cc0036f0 auth_method 0 2026-02-12T18:12:50.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23e7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23ecdd1640 1 --2- 10.20.193.48:0/2953999211 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f23e81d7d30 0x7f23e81d81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23e77fe640 10 monclient(hunting): handle_auth_done global_id 5793 payload 824 2026-02-12T18:12:50.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23e77fe640 1 -- 10.20.193.48:0/2953999211 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f23e81d7d30 msgr2=0x7f23e81d81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23e77fe640 1 --2- 10.20.193.48:0/2953999211 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f23e81d7d30 0x7f23e81d81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23e77fe640 1 -- 10.20.193.48:0/2953999211 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f23cc0036f0 msgr2=0x7f23e81db250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23e77fe640 1 --2- 10.20.193.48:0/2953999211 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f23cc0036f0 0x7f23e81db250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23e77fe640 10 monclient: _finish_hunting 0 2026-02-12T18:12:50.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23e77fe640 1 monclient: found mon.noname-d 2026-02-12T18:12:50.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23e77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:50.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23e77fe640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:12:50.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23e77fe640 1 -- 10.20.193.48:0/2953999211 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e81dbcb0 con 0x7f23e81afe40 2026-02-12T18:12:50.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23ecdd1640 10 monclient: get_auth_request con 0x7f23e81d7d30 auth_method 0 2026-02-12T18:12:50.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.128+0000 7f23ecdd1640 1 --2- 10.20.193.48:0/2953999211 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f23e81d7d30 0x7f23e81d81a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-12T18:12:50.136 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.130+0000 7f23e77fe640 1 -- 10.20.193.48:0/2953999211 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f23e81afe40 msgr2=0x7f23e81b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:50.136 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.130+0000 7f23e77fe640 1 --2- 10.20.193.48:0/2953999211 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f23e81afe40 0x7f23e81b0230 secure :-1 s=READY pgs=274 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23d800e7e0 tx=0x7f23d800ecb0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.136 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.130+0000 7f23e4ff9640 1 -- 10.20.193.48:0/2953999211 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f23d800cb90 con 0x7f23e81afe40 2026-02-12T18:12:50.136 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.130+0000 7f23e4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.136 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.130+0000 7f23e4ff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:12:50.136 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.130+0000 7f23e4ff9640 10 monclient: dump: 2026-02-12T18:12:50.136 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.136 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.136 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.136 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.136 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.136 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.136 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.136 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.136 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.136 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.136 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.136 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.136 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.130+0000 7f23e4ff9640 10 monclient: _finish_auth 0 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.130+0000 7f23e4ff9640 10 monclient: _check_auth_tickets 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.130+0000 7f23e4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.130+0000 7f23e4ff9640 1 -- 10.20.193.48:0/2953999211 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f23d800ccf0 con 0x7f23e81afe40 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.130+0000 7f23ee85b640 5 monclient: authenticate success, global_id 5793 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.130+0000 7f23ee85b640 10 monclient: _renew_subs 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.130+0000 7f23ee85b640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.130+0000 7f23ee85b640 1 -- 10.20.193.48:0/2953999211 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e819b800 con 0x7f23e81afe40 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.130+0000 7f23e4ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.130+0000 7f23e4ff9640 1 -- 10.20.193.48:0/2953999211 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f23d800ce60 con 0x7f23e81afe40 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.130+0000 7f23e4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.130+0000 7f23e67fc640 4 set_mon_vals no callback set 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.130+0000 7f23e4ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.130+0000 7f23e4ff9640 10 monclient: dump: 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.137 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.130+0000 7f23ee85b640 10 monclient: _renew_subs 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.130+0000 7f23ee85b640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.130+0000 7f23ee85b640 1 -- 10.20.193.48:0/2953999211 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e819a000 con 0x7f23e81afe40 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.131+0000 7f23ee85b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.131+0000 7f23ee85b640 1 --2- 10.20.193.48:0/2953999211 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f23e81d86e0 0x7f23e808b780 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.131+0000 7f23ee85b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.131+0000 7f23ee85b640 1 -- 10.20.193.48:0/2953999211 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f23e805f140 con 0x7f23e81d86e0 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.131+0000 7f23e7fff640 1 --2- 10.20.193.48:0/2953999211 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f23e81d86e0 0x7f23e808b780 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.131+0000 7f23e4ff9640 1 -- 10.20.193.48:0/2953999211 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f23d800c6d0 con 0x7f23e81afe40 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.131+0000 7f23e7fff640 10 monclient: get_auth_request con 0x7f23e81d86e0 auth_method 0 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.131+0000 7f23e7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.131+0000 7f23e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.131+0000 7f23e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.131+0000 7f23e7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.131+0000 7f23e7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.131+0000 7f23e7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.131+0000 7f23e4ff9640 1 --2- 10.20.193.48:0/2953999211 >> v2:10.20.193.111:6812/977811348 conn(0x7f23b803f7f0 0x7f23b805fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.132+0000 7f23e4ff9640 1 -- 10.20.193.48:0/2953999211 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(218..218 src has 190..218) ==== 3897+0+0 (secure 0 0 0) 0x7f23d8052b00 con 0x7f23e81afe40 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.132+0000 7f23ecdd1640 1 --2- 10.20.193.48:0/2953999211 >> v2:10.20.193.111:6812/977811348 conn(0x7f23b803f7f0 0x7f23b805fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.132+0000 7f23e7fff640 10 monclient(hunting): handle_auth_done global_id 94150 payload 824 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.132+0000 7f23e7fff640 1 -- 10.20.193.48:0/2953999211 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f23e80929d0 con 0x7f23e81d86e0 2026-02-12T18:12:50.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.132+0000 7f23ecdd1640 10 monclient: get_auth_request con 0x7f23b803f7f0 auth_method 0 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.134+0000 7f23e7fff640 1 -- 10.20.193.48:0/2953999211 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f23e81d86e0 msgr2=0x7f23e808b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.134+0000 7f23e7fff640 1 --2- 10.20.193.48:0/2953999211 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f23e81d86e0 0x7f23e808b780 secure :-1 s=READY pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23e8093ce0 tx=0x7f23d4004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.134+0000 7f23ecdd1640 1 --2- 10.20.193.48:0/2953999211 >> v2:10.20.193.111:6812/977811348 conn(0x7f23b803f7f0 0x7f23b805fca0 secure :-1 s=READY pgs=329 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23d4008000 tx=0x7f23dc009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.134+0000 7f23e4ff9640 1 -- 10.20.193.48:0/2953999211 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f23d402fc40 con 0x7f23e81d86e0 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.134+0000 7f23e4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.134+0000 7f23e4ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.134+0000 7f23e4ff9640 10 monclient: dump: 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.134+0000 7f23e4ff9640 1 -- 10.20.193.48:0/2953999211 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f23d4052040 con 0x7f23e81d86e0 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.134+0000 7f23e4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.134+0000 7f23e4ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.134+0000 7f23e4ff9640 1 -- 10.20.193.48:0/2953999211 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f23e81d86e0 msgr2=0x7f23e808b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.134+0000 7f23e4ff9640 1 --2- 10.20.193.48:0/2953999211 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f23e81d86e0 0x7f23e808b780 secure :-1 s=READY pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23e8093ce0 tx=0x7f23d4004770 comp rx=0 tx=0).stop 2026-02-12T18:12:50.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.134+0000 7f23e4ff9640 1 -- 10.20.193.48:0/2953999211 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f23e81d86e0 msgr2=0x7f23e808b780 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:50.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.134+0000 7f23e4ff9640 1 --2- 10.20.193.48:0/2953999211 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f23e81d86e0 0x7f23e808b780 secure :-1 s=CLOSED pgs=20 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23e8093ce0 tx=0x7f23d4004770 comp rx=0 tx=0).stop 2026-02-12T18:12:50.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.138+0000 7f23ee85b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:12:50.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.138+0000 7f23ee85b640 1 --2- 10.20.193.48:0/2953999211 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f23e808bcc0 0x7f23e808c0c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.138+0000 7f23ee85b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.138+0000 7f23ee85b640 1 -- 10.20.193.48:0/2953999211 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f23e805fd90 con 0x7f23e808bcc0 2026-02-12T18:12:50.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.138+0000 7f23e7fff640 1 --2- 10.20.193.48:0/2953999211 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f23e808bcc0 0x7f23e808c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.138+0000 7f23e7fff640 10 monclient: get_auth_request con 0x7f23e808bcc0 auth_method 0 2026-02-12T18:12:50.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.138+0000 7f23e7fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.138+0000 7f23e7fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.138+0000 7f23e7fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.138+0000 7f23e7fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.138+0000 7f23e7fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.138+0000 7f23e7fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.138+0000 7f23e7fff640 10 monclient(hunting): handle_auth_done global_id 94159 payload 824 2026-02-12T18:12:50.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.138+0000 7f23e7fff640 1 -- 10.20.193.48:0/2953999211 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f23e805de10 con 0x7f23e808bcc0 2026-02-12T18:12:50.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.140+0000 7f23e7fff640 1 -- 10.20.193.48:0/2953999211 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f23e808bcc0 msgr2=0x7f23e808c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:50.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.140+0000 7f23e7fff640 1 --2- 10.20.193.48:0/2953999211 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f23e808bcc0 0x7f23e808c0c0 secure :-1 s=READY pgs=21 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23d4009820 tx=0x7f23d4033000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.140+0000 7f23e4ff9640 1 -- 10.20.193.48:0/2953999211 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f23d405e720 con 0x7f23e808bcc0 2026-02-12T18:12:50.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.140+0000 7f23e4ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.140+0000 7f23e4ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:12:50.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.140+0000 7f23e4ff9640 10 monclient: dump: 2026-02-12T18:12:50.142 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.142 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.142 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.142 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.142 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.142 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.143 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.143 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.143 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.143 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.143 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.143 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.143 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.143 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.143 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.143 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.141+0000 7f23e4ff9640 1 -- 10.20.193.48:0/2953999211 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7f23d405e880 con 0x7f23e808bcc0 2026-02-12T18:12:50.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.141+0000 7f23e4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:12:50.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.141+0000 7f23e4ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:12:50.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.141+0000 7f23e4ff9640 1 -- 10.20.193.48:0/2953999211 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f23e808bcc0 msgr2=0x7f23e808c0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.141+0000 7f23e4ff9640 1 --2- 10.20.193.48:0/2953999211 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f23e808bcc0 0x7f23e808c0c0 secure :-1 s=READY pgs=21 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23d4009820 tx=0x7f23d4033000 comp rx=0 tx=0).stop 2026-02-12T18:12:50.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.141+0000 7f23e4ff9640 1 -- 10.20.193.48:0/2953999211 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f23e808bcc0 msgr2=0x7f23e808c0c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:50.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.141+0000 7f23e4ff9640 1 --2- 10.20.193.48:0/2953999211 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f23e808bcc0 0x7f23e808c0c0 secure :-1 s=CLOSED pgs=21 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23d4009820 tx=0x7f23d4033000 comp rx=0 tx=0).stop 2026-02-12T18:12:50.143 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:12:50.143 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:12:50.143 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:12:50.144 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:12:50.144 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 68, 2026-02-12T18:12:50.144 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 15814, 2026-02-12T18:12:50.144 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:12:50.144 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:12:50.144 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:12:50.144 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:12:50.144 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:12:50.144 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:12:50.144 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:12:50.144 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:12:50.144 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:12:50.144 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:12:50.144 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:50.144 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:12:50.144 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:50.144 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:12:50.144 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:12:50.144 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:50.144 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:50.144 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:50.144 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:50.144 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:50.144 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:50.144 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:50.144 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:50.145 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:50.145 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:50.145 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:50.145 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:50.145 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:50.145 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:50.145 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:12:50.145 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:12:50.145 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:50.145 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:50.145 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:50.145 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:50.145 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:50.145 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:50.145 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:50.145 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:50.145 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:50.145 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:50.145 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:50.145 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:50.145 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:50.145 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.145 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.145 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:12:50.145 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:12:50.146 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:12:50.146 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:12:50.146 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:12:50.146 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:12:50.146 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:50.146 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:50.146 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:12:50.146 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:12:50.146 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:12:50.146 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:12:50.146 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:12:50.146 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:12:50.146 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:12:50.146 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:50.146 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:12:50.146 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:50.146 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:50.146 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:50.146 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:50.146 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:50.146 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:50.146 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:50.146 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:50.146 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:50.146 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:50.146 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:50.147 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:50.147 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:50.147 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:50.147 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:12:50.147 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.147 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:12:50.147 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.147 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:12:50.147 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:12:50.147 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.147 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.147 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.147 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.147 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:12:50.147 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.147 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.147 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.147 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.147 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:12:50.147 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.147 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.147 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.147 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.147 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:12:50.147 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:12:50.147 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:12:50.148 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.149 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:12:50.150 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:12:50.150 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.150 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.150 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.150 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.150 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:12:50.150 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.150 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.150 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.150 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.150 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:12:50.150 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.150 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.150 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.150 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.150 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:12:50.150 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:12:50.150 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.150 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.150 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:12:50.150 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.150 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.150 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.150 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:12:50.150 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:12:50.150 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.151 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.152 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.153 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.153 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:12:50.153 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.153 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.153 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.153 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.153 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:12:50.153 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:12:50.153 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.153 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.153 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:50.153 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.153 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.153 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.153 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:12:50.153 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:12:50.153 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.153 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.153 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.153 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.153 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:12:50.153 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.153 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.153 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.153 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.153 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:12:50.154 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.154 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.154 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.154 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.154 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:12:50.154 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:12:50.154 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.154 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.154 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:12:50.154 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.154 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.154 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.154 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:12:50.154 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:12:50.154 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.154 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.154 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.154 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.154 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:12:50.154 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.154 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.154 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.154 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.154 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:12:50.154 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.154 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.155 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.156 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:12:50.156 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:12:50.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.141+0000 7f23ee85b640 1 -- 10.20.193.48:0/2953999211 >> v2:10.20.193.111:6812/977811348 conn(0x7f23b803f7f0 msgr2=0x7f23b805fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.141+0000 7f23ee85b640 1 --2- 10.20.193.48:0/2953999211 >> v2:10.20.193.111:6812/977811348 conn(0x7f23b803f7f0 0x7f23b805fca0 secure :-1 s=READY pgs=329 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23d4008000 tx=0x7f23dc009040 comp rx=0 tx=0).stop 2026-02-12T18:12:50.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.141+0000 7f23ee85b640 10 monclient: shutdown 2026-02-12T18:12:50.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.141+0000 7f23ee85b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:50.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.141+0000 7f23ee85b640 1 -- 10.20.193.48:0/2953999211 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f23e81afe40 msgr2=0x7f23e81b0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.141+0000 7f23ee85b640 1 --2- 10.20.193.48:0/2953999211 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f23e81afe40 0x7f23e81b0230 secure :-1 s=READY pgs=274 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f23d800e7e0 tx=0x7f23d800ecb0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.141+0000 7f23ecdd1640 1 -- 10.20.193.48:0/2953999211 reap_dead start 2026-02-12T18:12:50.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.141+0000 7f23ee85b640 1 -- 10.20.193.48:0/2953999211 shutdown_connections 2026-02-12T18:12:50.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.141+0000 7f23ee85b640 1 --2- 10.20.193.48:0/2953999211 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f23e81afe40 0x7f23e81b0230 unknown :-1 s=CLOSED pgs=274 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.141+0000 7f23ee85b640 1 -- 10.20.193.48:0/2953999211 >> 10.20.193.48:0/2953999211 conn(0x7f23e80548a0 msgr2=0x7f23e81b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:50.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.141+0000 7f23ee85b640 1 -- 10.20.193.48:0/2953999211 shutdown_connections 2026-02-12T18:12:50.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.141+0000 7f23ee85b640 1 -- 10.20.193.48:0/2953999211 wait complete. 2026-02-12T18:12:50.157 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:12:50.157 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2026-02-12T18:12:50.157 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2026-02-12T18:12:50.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.220+0000 7fe65d207640 10 monclient: get_monmap_and_config 2026-02-12T18:12:50.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.220+0000 7fe65d207640 10 monclient: build_initial_monmap 2026-02-12T18:12:50.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.220+0000 7fe65d207640 10 monclient: monmap: 2026-02-12T18:12:50.222 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:50.222 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.222 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:12:50.221501+0000 2026-02-12T18:12:50.222 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:12:50.221501+0000 2026-02-12T18:12:50.222 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:50.222 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.222 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:12:50.222 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:12:50.222 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:50.222 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:50.222 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:50.222 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:50.222 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:50.222 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:50.222 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:50.222 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:12:50.222 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:12:50.222 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.220+0000 7fe65d207640 1 Processor -- start 2026-02-12T18:12:50.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.220+0000 7fe65d207640 1 -- start start 2026-02-12T18:12:50.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.220+0000 7fe65d207640 10 monclient: init 2026-02-12T18:12:50.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe65d207640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:50.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe65d207640 10 monclient: _add_conns ranks=[5,3,9,8,1,2,7,10,0,4,6] 2026-02-12T18:12:50.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe65d207640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe6580951a0 0x7fe658093850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe65d207640 10 monclient(hunting): picked mon.noname-h con 0x7fe6580951a0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:12:50.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe65d207640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe658096ad0 0x7fe658095570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe65d207640 10 monclient(hunting): picked mon.noname-g con 0x7fe658096ad0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:12:50.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe65d207640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fe658095ab0 0x7fe6581a4ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe65d207640 10 monclient(hunting): picked mon.noname-a con 0x7fe658095ab0 addr v2:10.20.193.48:3300/0 2026-02-12T18:12:50.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe65d207640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe65d207640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7fe658096900 con 0x7fe658095ab0 2026-02-12T18:12:50.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe65d207640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe65d207640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe658092260 con 0x7fe658096ad0 2026-02-12T18:12:50.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe65d207640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe65d207640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fe658093070 con 0x7fe6580951a0 2026-02-12T18:12:50.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe65d207640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:50.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe65d207640 10 monclient(hunting): authenticate will time out at 1008.947338s 2026-02-12T18:12:50.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe657577640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fe658095ab0 0x7fe6581a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe657577640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fe658095ab0 0x7fe6581a4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:42280/0 (socket says 10.20.193.48:42280) 2026-02-12T18:12:50.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe657577640 1 -- 10.20.193.48:0/3001239347 learned_addr learned my addr 10.20.193.48:0/3001239347 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:50.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe657577640 10 monclient(hunting): get_auth_request con 0x7fe658095ab0 auth_method 0 2026-02-12T18:12:50.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe657577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe657577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe657577640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe657577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe657577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe657577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe656d76640 1 --2- 10.20.193.48:0/3001239347 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe6580951a0 0x7fe658093850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe656d76640 10 monclient(hunting): get_auth_request con 0x7fe6580951a0 auth_method 0 2026-02-12T18:12:50.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe656d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe656575640 1 --2- 10.20.193.48:0/3001239347 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe658096ad0 0x7fe658095570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe656d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe656d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe657577640 10 monclient(hunting): handle_auth_done global_id 6165 payload 274 2026-02-12T18:12:50.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe657577640 1 -- 10.20.193.48:0/3001239347 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe6580951a0 msgr2=0x7fe658093850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:50.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe657577640 1 --2- 10.20.193.48:0/3001239347 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe6580951a0 0x7fe658093850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe657577640 1 -- 10.20.193.48:0/3001239347 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe658096ad0 msgr2=0x7fe658095570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:50.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe657577640 1 --2- 10.20.193.48:0/3001239347 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe658096ad0 0x7fe658095570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe657577640 10 monclient: _finish_hunting 0 2026-02-12T18:12:50.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe657577640 1 monclient: found mon.noname-a 2026-02-12T18:12:50.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe657577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:50.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe657577640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:12:50.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.221+0000 7fe657577640 1 -- 10.20.193.48:0/3001239347 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe65804dc20 con 0x7fe658095ab0 2026-02-12T18:12:50.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe657577640 1 -- 10.20.193.48:0/3001239347 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fe658095ab0 msgr2=0x7fe6581a4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:50.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe657577640 1 --2- 10.20.193.48:0/3001239347 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fe658095ab0 0x7fe6581a4ba0 secure :-1 s=READY pgs=467 gs=1 cs=0 l=1 c_cookie=5725090841595509975 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe64800a140 tx=0x7fe64802fed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f739bc9a0247cd7 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe655d74640 1 -- 10.20.193.48:0/3001239347 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe648030b50 con 0x7fe658095ab0 2026-02-12T18:12:50.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe655d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe655d74640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:12:50.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe655d74640 10 monclient: dump: 2026-02-12T18:12:50.228 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.228 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.228 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.228 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.228 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.228 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.228 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.228 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.228 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.228 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.228 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.228 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.228 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.228 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.228 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.228 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe655d74640 10 monclient: _finish_auth 0 2026-02-12T18:12:50.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe655d74640 10 monclient: _check_auth_tickets 2026-02-12T18:12:50.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe655d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:50.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe655d74640 1 -- 10.20.193.48:0/3001239347 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe648030cd0 con 0x7fe658095ab0 2026-02-12T18:12:50.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe65d207640 5 monclient: authenticate success, global_id 6165 2026-02-12T18:12:50.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe65d207640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:12:50.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe655d74640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:50.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe655d74640 1 -- 10.20.193.48:0/3001239347 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe648030e40 con 0x7fe658095ab0 2026-02-12T18:12:50.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe655d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe655d74640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:12:50.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe655d74640 10 monclient: dump: 2026-02-12T18:12:50.229 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.229 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.229 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.229 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.229 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.229 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.229 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.229 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.229 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.229 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.229 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.229 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.229 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.229 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.229 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.229 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe65d207640 10 monclient: get_monmap_and_config success 2026-02-12T18:12:50.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe65d207640 4 set_mon_vals no callback set 2026-02-12T18:12:50.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe65d207640 10 monclient: shutdown 2026-02-12T18:12:50.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe65d207640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:50.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe65d207640 1 -- 10.20.193.48:0/3001239347 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fe658095ab0 msgr2=0x7fe6581a4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe65d207640 1 --2- 10.20.193.48:0/3001239347 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fe658095ab0 0x7fe6581a4ba0 secure :-1 s=READY pgs=467 gs=1 cs=0 l=1 c_cookie=5725090841595509975 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe64800a140 tx=0x7fe64802fed0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe65d207640 1 -- 10.20.193.48:0/3001239347 shutdown_connections 2026-02-12T18:12:50.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe65d207640 1 --2- 10.20.193.48:0/3001239347 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fe658095ab0 0x7fe6581a4ba0 unknown :-1 s=CLOSED pgs=467 gs=1 cs=0 l=1 c_cookie=5725090841595509975 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe65d207640 1 --2- 10.20.193.48:0/3001239347 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe658096ad0 0x7fe658095570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe65d207640 1 --2- 10.20.193.48:0/3001239347 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe6580951a0 0x7fe658093850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe65d207640 1 -- 10.20.193.48:0/3001239347 >> 10.20.193.48:0/3001239347 conn(0x7fe6580548c0 msgr2=0x7fe6580973a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:50.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe65d207640 1 -- 10.20.193.48:0/3001239347 shutdown_connections 2026-02-12T18:12:50.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.224+0000 7fe65d207640 1 -- 10.20.193.48:0/3001239347 wait complete. 2026-02-12T18:12:50.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe65d207640 10 monclient: build_initial_monmap 2026-02-12T18:12:50.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe65d207640 10 monclient: monmap: 2026-02-12T18:12:50.230 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:50.230 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:12:50.230 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:12:50.230 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:12:50.230 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:50.230 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.230 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:12:50.230 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:12:50.230 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:50.230 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:50.230 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:50.230 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:50.230 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:50.231 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:50.231 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:50.231 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe65d207640 1 Processor -- start 2026-02-12T18:12:50.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe65d207640 1 -- start start 2026-02-12T18:12:50.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe65d207640 10 monclient: init 2026-02-12T18:12:50.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe65d207640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:50.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe65d207640 10 monclient: _add_conns ranks=[7,8,1,6,0,3,2,4,5] 2026-02-12T18:12:50.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe65d207640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe6580951a0 0x7fe6581db0e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe65d207640 10 monclient(hunting): picked mon.noname-i con 0x7fe6580951a0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:12:50.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe65d207640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe658095ab0 0x7fe6581afcc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe65d207640 10 monclient(hunting): picked mon.noname-e con 0x7fe658095ab0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:12:50.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe65d207640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe658096ad0 0x7fe658197a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe65d207640 10 monclient(hunting): picked mon.noname-f con 0x7fe658096ad0 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:12:50.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe65d207640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe65d207640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe658199320 con 0x7fe658096ad0 2026-02-12T18:12:50.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe65d207640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe65d207640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fe65808d4d0 con 0x7fe6580951a0 2026-02-12T18:12:50.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe65d207640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe65d207640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fe65819b680 con 0x7fe658095ab0 2026-02-12T18:12:50.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe65d207640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:50.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe65d207640 10 monclient(hunting): authenticate will time out at 1008.951740s 2026-02-12T18:12:50.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe656575640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe658095ab0 0x7fe6581afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe656575640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe658095ab0 0x7fe6581afcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:57372/0 (socket says 10.20.193.48:57372) 2026-02-12T18:12:50.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe656575640 1 -- 10.20.193.48:0/4261728686 learned_addr learned my addr 10.20.193.48:0/4261728686 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:50.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe656575640 10 monclient(hunting): get_auth_request con 0x7fe658095ab0 auth_method 0 2026-02-12T18:12:50.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe656575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe656575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe656575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe656575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe656575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe656575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe656d76640 1 --2- 10.20.193.48:0/4261728686 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe6580951a0 0x7fe6581db0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe656d76640 10 monclient(hunting): get_auth_request con 0x7fe6580951a0 auth_method 0 2026-02-12T18:12:50.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe656d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe656d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe656d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe657577640 1 --2- 10.20.193.48:0/4261728686 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe658096ad0 0x7fe658197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe657577640 10 monclient(hunting): get_auth_request con 0x7fe658096ad0 auth_method 0 2026-02-12T18:12:50.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe657577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe657577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.225+0000 7fe657577640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.226+0000 7fe656575640 10 monclient(hunting): handle_auth_done global_id 94193 payload 824 2026-02-12T18:12:50.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.226+0000 7fe656575640 1 -- 10.20.193.48:0/4261728686 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe6580951a0 msgr2=0x7fe6581db0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.226+0000 7fe656575640 1 --2- 10.20.193.48:0/4261728686 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe6580951a0 0x7fe6581db0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.226+0000 7fe656575640 1 -- 10.20.193.48:0/4261728686 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe658096ad0 msgr2=0x7fe658197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.226+0000 7fe656575640 1 --2- 10.20.193.48:0/4261728686 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe658096ad0 0x7fe658197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.226+0000 7fe656575640 10 monclient: _finish_hunting 0 2026-02-12T18:12:50.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.226+0000 7fe656575640 1 monclient: found mon.noname-e 2026-02-12T18:12:50.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.226+0000 7fe656575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:50.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.226+0000 7fe656575640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:12:50.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.226+0000 7fe656575640 1 -- 10.20.193.48:0/4261728686 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe64800a5d0 con 0x7fe658095ab0 2026-02-12T18:12:50.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.226+0000 7fe657577640 1 --2- 10.20.193.48:0/4261728686 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe658096ad0 0x7fe658197a00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:12:50.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.228+0000 7fe656575640 1 -- 10.20.193.48:0/4261728686 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe658095ab0 msgr2=0x7fe6581afcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:50.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.228+0000 7fe656575640 1 --2- 10.20.193.48:0/4261728686 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe658095ab0 0x7fe6581afcc0 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe64000c7c0 tx=0x7fe64000cc90 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.228+0000 7fe6377fe640 1 -- 10.20.193.48:0/4261728686 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe64000ce90 con 0x7fe658095ab0 2026-02-12T18:12:50.235 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.228+0000 7fe6377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.235 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.228+0000 7fe6377fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:12:50.235 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.228+0000 7fe6377fe640 10 monclient: dump: 2026-02-12T18:12:50.235 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.235 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.235 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.235 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.235 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.235 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.235 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.235 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.235 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.235 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.235 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.235 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.235 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.235 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.235 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.235 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.235 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.228+0000 7fe6377fe640 10 monclient: _finish_auth 0 2026-02-12T18:12:50.235 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.228+0000 7fe6377fe640 10 monclient: _check_auth_tickets 2026-02-12T18:12:50.235 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.228+0000 7fe6377fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:50.235 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.228+0000 7fe6377fe640 1 -- 10.20.193.48:0/4261728686 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe640004030 con 0x7fe658095ab0 2026-02-12T18:12:50.235 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.228+0000 7fe6377fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:50.235 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.228+0000 7fe6377fe640 1 -- 10.20.193.48:0/4261728686 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe6400036d0 con 0x7fe658095ab0 2026-02-12T18:12:50.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.228+0000 7fe6377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.228+0000 7fe655573640 4 set_mon_vals no callback set 2026-02-12T18:12:50.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.228+0000 7fe6377fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:12:50.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.228+0000 7fe6377fe640 10 monclient: dump: 2026-02-12T18:12:50.236 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.236 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.236 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.236 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.236 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.236 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.236 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.236 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.236 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.236 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.236 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.236 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.236 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.236 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.236 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.236 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.228+0000 7fe65d207640 5 monclient: authenticate success, global_id 94193 2026-02-12T18:12:50.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.228+0000 7fe65d207640 10 monclient: _renew_subs 2026-02-12T18:12:50.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.228+0000 7fe65d207640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:12:50.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.228+0000 7fe65d207640 1 -- 10.20.193.48:0/4261728686 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe65808cf80 con 0x7fe658095ab0 2026-02-12T18:12:50.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.228+0000 7fe65d207640 10 monclient: _renew_subs 2026-02-12T18:12:50.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.228+0000 7fe65d207640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:12:50.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.228+0000 7fe65d207640 1 -- 10.20.193.48:0/4261728686 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fe65819b3a0 con 0x7fe658095ab0 2026-02-12T18:12:50.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.229+0000 7fe65d207640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:50.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.229+0000 7fe65d207640 1 --2- 10.20.193.48:0/4261728686 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe6581b0200 0x7fe65808a440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.229+0000 7fe65d207640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.229+0000 7fe65d207640 1 -- 10.20.193.48:0/4261728686 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe65805f140 con 0x7fe6581b0200 2026-02-12T18:12:50.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.229+0000 7fe6377fe640 1 -- 10.20.193.48:0/4261728686 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fe6400041a0 con 0x7fe658095ab0 2026-02-12T18:12:50.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.229+0000 7fe656d76640 1 --2- 10.20.193.48:0/4261728686 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe6581b0200 0x7fe65808a440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.229+0000 7fe656d76640 10 monclient: get_auth_request con 0x7fe6581b0200 auth_method 0 2026-02-12T18:12:50.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.229+0000 7fe656d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.229+0000 7fe656d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.229+0000 7fe656d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.229+0000 7fe656d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.229+0000 7fe656d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.229+0000 7fe656d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.229+0000 7fe6377fe640 1 --2- 10.20.193.48:0/4261728686 >> v2:10.20.193.111:6812/977811348 conn(0x7fe62403f720 0x7fe62405fbd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.229+0000 7fe6377fe640 1 -- 10.20.193.48:0/4261728686 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(218..218 src has 190..218) ==== 3897+0+0 (secure 0 0 0) 0x7fe640052ca0 con 0x7fe658095ab0 2026-02-12T18:12:50.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.229+0000 7fe656d76640 10 monclient(hunting): handle_auth_done global_id 64326 payload 824 2026-02-12T18:12:50.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.229+0000 7fe656d76640 1 -- 10.20.193.48:0/4261728686 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe658095f20 con 0x7fe6581b0200 2026-02-12T18:12:50.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.229+0000 7fe657577640 1 --2- 10.20.193.48:0/4261728686 >> v2:10.20.193.111:6812/977811348 conn(0x7fe62403f720 0x7fe62405fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.229+0000 7fe657577640 10 monclient: get_auth_request con 0x7fe62403f720 auth_method 0 2026-02-12T18:12:50.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.231+0000 7fe656d76640 1 -- 10.20.193.48:0/4261728686 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe6581b0200 msgr2=0x7fe65808a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:50.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.231+0000 7fe656d76640 1 --2- 10.20.193.48:0/4261728686 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe6581b0200 0x7fe65808a440 secure :-1 s=READY pgs=101 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe64c010790 tx=0x7fe64c010c60 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.232+0000 7fe6377fe640 1 -- 10.20.193.48:0/4261728686 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe64c0044f0 con 0x7fe6581b0200 2026-02-12T18:12:50.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.232+0000 7fe6377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.232+0000 7fe6377fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:12:50.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.232+0000 7fe657577640 1 --2- 10.20.193.48:0/4261728686 >> v2:10.20.193.111:6812/977811348 conn(0x7fe62403f720 0x7fe62405fbd0 secure :-1 s=READY pgs=330 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe648007e00 tx=0x7fe648007f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.232+0000 7fe6377fe640 10 monclient: dump: 2026-02-12T18:12:50.238 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.238 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.238 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.238 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.238 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.238 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.238 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.238 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.238 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.238 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.238 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.238 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.238 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.238 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.238 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.238 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.232+0000 7fe6377fe640 1 -- 10.20.193.48:0/4261728686 <== mon.3 v2:10.20.193.111:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fe64c00c050 con 0x7fe6581b0200 2026-02-12T18:12:50.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.232+0000 7fe6377fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:50.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.232+0000 7fe6377fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:12:50.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.232+0000 7fe6377fe640 1 -- 10.20.193.48:0/4261728686 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe6581b0200 msgr2=0x7fe65808a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.232+0000 7fe6377fe640 1 --2- 10.20.193.48:0/4261728686 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe6581b0200 0x7fe65808a440 secure :-1 s=READY pgs=101 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe64c010790 tx=0x7fe64c010c60 comp rx=0 tx=0).stop 2026-02-12T18:12:50.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.232+0000 7fe6377fe640 1 -- 10.20.193.48:0/4261728686 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe6581b0200 msgr2=0x7fe65808a440 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:50.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.232+0000 7fe6377fe640 1 --2- 10.20.193.48:0/4261728686 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe6581b0200 0x7fe65808a440 secure :-1 s=CLOSED pgs=101 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe64c010790 tx=0x7fe64c010c60 comp rx=0 tx=0).stop 2026-02-12T18:12:50.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.236+0000 7fe65d207640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:12:50.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.236+0000 7fe65d207640 1 --2- 10.20.193.48:0/4261728686 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe65808a980 0x7fe65808ad80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.236+0000 7fe65d207640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.236+0000 7fe65d207640 1 -- 10.20.193.48:0/4261728686 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fe65805fd90 con 0x7fe65808a980 2026-02-12T18:12:50.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.236+0000 7fe656d76640 1 --2- 10.20.193.48:0/4261728686 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe65808a980 0x7fe65808ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.236+0000 7fe656d76640 10 monclient: get_auth_request con 0x7fe65808a980 auth_method 0 2026-02-12T18:12:50.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.236+0000 7fe656d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.236+0000 7fe656d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.236+0000 7fe656d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.236+0000 7fe656d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.236+0000 7fe656d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.236+0000 7fe656d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.236+0000 7fe656d76640 10 monclient(hunting): handle_auth_done global_id 64335 payload 824 2026-02-12T18:12:50.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.236+0000 7fe656d76640 1 -- 10.20.193.48:0/4261728686 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe65805dc10 con 0x7fe65808a980 2026-02-12T18:12:50.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.239+0000 7fe656d76640 1 -- 10.20.193.48:0/4261728686 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe65808a980 msgr2=0x7fe65808ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:50.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.239+0000 7fe656d76640 1 --2- 10.20.193.48:0/4261728686 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe65808a980 0x7fe65808ad80 secure :-1 s=READY pgs=102 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe64c004000 tx=0x7fe64c004770 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.239+0000 7fe6377fe640 1 -- 10.20.193.48:0/4261728686 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe64c004330 con 0x7fe65808a980 2026-02-12T18:12:50.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.239+0000 7fe6377fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.239+0000 7fe6377fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:12:50.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.239+0000 7fe6377fe640 10 monclient: dump: 2026-02-12T18:12:50.241 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.241 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.241 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.241 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.241 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.241 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.241 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.241 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.241 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.241 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.241 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.241 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.241 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.241 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.241 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.241 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.239+0000 7fe6377fe640 1 -- 10.20.193.48:0/4261728686 <== mon.3 v2:10.20.193.111:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10182 (secure 0 0 0) 0x7fe64c020860 con 0x7fe65808a980 2026-02-12T18:12:50.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.239+0000 7fe6377fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:12:50.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.239+0000 7fe6377fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:12:50.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.239+0000 7fe6377fe640 1 -- 10.20.193.48:0/4261728686 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe65808a980 msgr2=0x7fe65808ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.239+0000 7fe6377fe640 1 --2- 10.20.193.48:0/4261728686 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe65808a980 0x7fe65808ad80 secure :-1 s=READY pgs=102 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe64c004000 tx=0x7fe64c004770 comp rx=0 tx=0).stop 2026-02-12T18:12:50.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.239+0000 7fe6377fe640 1 -- 10.20.193.48:0/4261728686 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe65808a980 msgr2=0x7fe65808ad80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:50.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.239+0000 7fe6377fe640 1 --2- 10.20.193.48:0/4261728686 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fe65808a980 0x7fe65808ad80 secure :-1 s=CLOSED pgs=102 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe64c004000 tx=0x7fe64c004770 comp rx=0 tx=0).stop 2026-02-12T18:12:50.242 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:12:50.242 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:12:50.242 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:12:50.242 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:12:50.242 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 68, 2026-02-12T18:12:50.242 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 151042, 2026-02-12T18:12:50.242 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:12:50.242 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:12:50.242 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:12:50.242 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:12:50.242 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:12:50.242 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:12:50.242 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:12:50.242 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:12:50.242 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:12:50.242 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:12:50.242 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:50.242 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:12:50.243 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:50.243 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:12:50.243 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:12:50.243 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:50.243 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:50.243 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:50.243 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:50.243 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:50.243 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:50.243 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:50.243 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:50.243 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:50.243 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:50.243 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:50.243 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:50.243 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:50.243 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:50.243 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:12:50.243 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:12:50.243 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:50.243 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:50.243 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:50.243 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:50.243 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:50.243 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:50.244 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:50.244 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:50.244 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:50.244 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:50.244 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:50.244 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:50.244 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:50.244 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.244 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.244 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:12:50.244 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:12:50.244 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:12:50.244 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:12:50.244 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:12:50.244 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:12:50.244 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:50.244 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:50.244 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:12:50.244 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:12:50.244 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:12:50.244 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:12:50.244 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:12:50.244 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:12:50.244 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:12:50.244 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:12:50.245 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.246 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.246 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.246 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.246 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:12:50.246 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.246 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.246 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.246 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.246 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:12:50.246 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:12:50.246 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.246 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.246 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:12:50.246 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.246 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.246 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.246 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:12:50.246 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:12:50.246 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.246 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.246 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.246 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.246 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:12:50.246 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.246 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.246 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:12:50.247 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.248 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.248 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.248 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.248 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:12:50.248 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:12:50.248 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.248 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.248 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:12:50.248 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.248 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.248 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.248 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:12:50.248 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:12:50.248 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.248 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.248 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.248 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.248 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:12:50.248 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.248 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.248 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.248 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.248 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:12:50.248 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.248 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.248 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:12:50.249 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:12:50.250 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.250 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.250 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:50.250 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.250 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.250 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.250 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:12:50.250 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:12:50.250 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.250 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.250 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.250 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.250 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:12:50.250 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.250 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.250 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.250 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.250 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:12:50.250 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.250 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.250 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.250 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.250 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:12:50.250 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:12:50.250 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.250 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.251 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:12:50.251 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.251 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.251 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.251 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:12:50.251 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:12:50.251 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.251 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.251 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.251 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.251 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:12:50.251 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.251 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.251 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.251 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.251 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:12:50.251 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.251 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.251 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.251 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.251 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:12:50.251 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:12:50.251 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.251 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.251 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:50.251 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.252 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.252 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.252 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:12:50.252 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:12:50.252 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.252 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.252 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.252 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.252 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:12:50.252 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.252 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.252 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.252 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.252 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:12:50.252 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.252 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.252 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.252 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.252 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:12:50.252 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:12:50.252 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.252 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.252 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:12:50.252 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.252 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.252 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:12:50.253 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.254 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:50.254 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:50.254 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:50.254 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.254 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:50.254 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:12:50.254 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.254 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:50.254 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:50.254 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:12:50.254 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.254 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:50.254 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:12:50.254 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.254 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:50.254 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:50.254 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:12:50.254 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.254 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.254 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.254 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:12:50.254 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:12:50.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.239+0000 7fe65d207640 1 -- 10.20.193.48:0/4261728686 >> v2:10.20.193.111:6812/977811348 conn(0x7fe62403f720 msgr2=0x7fe62405fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.239+0000 7fe65d207640 1 --2- 10.20.193.48:0/4261728686 >> v2:10.20.193.111:6812/977811348 conn(0x7fe62403f720 0x7fe62405fbd0 secure :-1 s=READY pgs=330 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe648007e00 tx=0x7fe648007f90 comp rx=0 tx=0).stop 2026-02-12T18:12:50.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.239+0000 7fe65d207640 10 monclient: shutdown 2026-02-12T18:12:50.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.239+0000 7fe65d207640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:50.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.239+0000 7fe65d207640 1 -- 10.20.193.48:0/4261728686 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe658095ab0 msgr2=0x7fe6581afcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.239+0000 7fe65d207640 1 --2- 10.20.193.48:0/4261728686 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe658095ab0 0x7fe6581afcc0 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe64000c7c0 tx=0x7fe64000cc90 comp rx=0 tx=0).stop 2026-02-12T18:12:50.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.239+0000 7fe657577640 1 -- 10.20.193.48:0/4261728686 reap_dead start 2026-02-12T18:12:50.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.239+0000 7fe65d207640 1 -- 10.20.193.48:0/4261728686 shutdown_connections 2026-02-12T18:12:50.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.239+0000 7fe65d207640 1 --2- 10.20.193.48:0/4261728686 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe658095ab0 0x7fe6581afcc0 unknown :-1 s=CLOSED pgs=23 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.240+0000 7fe65d207640 1 -- 10.20.193.48:0/4261728686 >> 10.20.193.48:0/4261728686 conn(0x7fe6580548c0 msgr2=0x7fe65808d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:50.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.240+0000 7fe65d207640 1 -- 10.20.193.48:0/4261728686 shutdown_connections 2026-02-12T18:12:50.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.240+0000 7fe65d207640 1 -- 10.20.193.48:0/4261728686 wait complete. 2026-02-12T18:12:50.256 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:12:50.256 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2026-02-12T18:12:50.256 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2026-02-12T18:12:50.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.320+0000 7f65d885b640 10 monclient: get_monmap_and_config 2026-02-12T18:12:50.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.320+0000 7f65d885b640 10 monclient: build_initial_monmap 2026-02-12T18:12:50.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.320+0000 7f65d885b640 10 monclient: monmap: 2026-02-12T18:12:50.322 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:50.322 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.322 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:12:50.321922+0000 2026-02-12T18:12:50.322 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:12:50.321922+0000 2026-02-12T18:12:50.322 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:50.322 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.322 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:12:50.322 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:12:50.322 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:50.322 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:50.322 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:50.322 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:50.322 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:50.322 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:50.322 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:50.322 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:12:50.322 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:12:50.322 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.321+0000 7f65d885b640 1 Processor -- start 2026-02-12T18:12:50.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.321+0000 7f65d885b640 1 -- start start 2026-02-12T18:12:50.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.321+0000 7f65d885b640 10 monclient: init 2026-02-12T18:12:50.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.321+0000 7f65d885b640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:50.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.321+0000 7f65d885b640 10 monclient: _add_conns ranks=[1,0,5,4,9,6,7,8,10,3,2] 2026-02-12T18:12:50.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.321+0000 7f65d885b640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f65d005c950 addr v1:10.20.193.111:6789/0 2026-02-12T18:12:50.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.321+0000 7f65d885b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f65d005e490 addr v1:10.20.193.48:6789/0 2026-02-12T18:12:50.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.321+0000 7f65d885b640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d005d430 0x7f65d01a6ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.321+0000 7f65d885b640 10 monclient(hunting): picked mon.noname-h con 0x7f65d005d430 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:12:50.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.321+0000 7f65d885b640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65d004dc20 con 0x7f65d005e490 2026-02-12T18:12:50.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.321+0000 7f65d885b640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65d005ddd0 con 0x7f65d005c950 2026-02-12T18:12:50.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.321+0000 7f65d885b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.321+0000 7f65d885b640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f65d0092990 con 0x7f65d005d430 2026-02-12T18:12:50.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.321+0000 7f65d885b640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:50.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.321+0000 7f65d885b640 10 monclient(hunting): authenticate will time out at 1009.047659s 2026-02-12T18:12:50.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.321+0000 7f65d5dcf640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f65d005e490 0x7f65d01857b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:51738/0 (socket says 10.20.193.48:51738) 2026-02-12T18:12:50.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.321+0000 7f65d5dcf640 1 -- 10.20.193.48:0/29307161 learned_addr learned my addr 10.20.193.48:0/29307161 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:12:50.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.321+0000 7f65d6dd1640 1 --2- 10.20.193.48:0/29307161 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d005d430 0x7f65d01a6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.321+0000 7f65d6dd1640 10 monclient(hunting): get_auth_request con 0x7f65d005d430 auth_method 0 2026-02-12T18:12:50.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.321+0000 7f65d6dd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.321+0000 7f65d6dd1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.321+0000 7f65d6dd1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.321+0000 7f65d6dd1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.321+0000 7f65d6dd1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.321+0000 7f65d6dd1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.322+0000 7f65d6dd1640 10 monclient(hunting): handle_auth_done global_id 94127 payload 274 2026-02-12T18:12:50.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.322+0000 7f65d6dd1640 1 -- 10.20.193.48:0/29307161 >> v1:10.20.193.111:6789/0 conn(0x7f65d005c950 legacy=0x7f65d005cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:50.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.322+0000 7f65d6dd1640 1 -- 10.20.193.48:0/29307161 >> v1:10.20.193.48:6789/0 conn(0x7f65d005e490 legacy=0x7f65d01857b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:50.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.322+0000 7f65d6dd1640 10 monclient: _finish_hunting 0 2026-02-12T18:12:50.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.322+0000 7f65d6dd1640 1 monclient: found mon.noname-h 2026-02-12T18:12:50.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.322+0000 7f65d6dd1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:50.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.322+0000 7f65d6dd1640 10 monclient: _send_mon_message to mon.noname-h at v2:10.20.193.111:3302/0 2026-02-12T18:12:50.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.322+0000 7f65d6dd1640 1 -- 10.20.193.48:0/29307161 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d0092c70 con 0x7f65d005d430 2026-02-12T18:12:50.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.324+0000 7f65d6dd1640 1 -- 10.20.193.48:0/29307161 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d005d430 msgr2=0x7f65d01a6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:50.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.324+0000 7f65d6dd1640 1 --2- 10.20.193.48:0/29307161 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d005d430 0x7f65d01a6ee0 secure :-1 s=READY pgs=24 gs=3 cs=0 l=1 c_cookie=10552841068238421581 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65c400a8e0 tx=0x7f65c402fe20 comp rx=0 tx=0).ready entity=mon.5 client_cookie=9273390a4b813e4d server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.324+0000 7f65d55ce640 1 -- 10.20.193.48:0/29307161 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f65c4030b80 con 0x7f65d005d430 2026-02-12T18:12:50.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.324+0000 7f65d55ce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.324+0000 7f65d55ce640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2026-02-12T18:12:50.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.324+0000 7f65d55ce640 10 monclient: dump: 2026-02-12T18:12:50.327 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.327 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.327 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.327 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.327 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.327 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.327 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.327 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.327 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.328 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.328 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.328 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.328 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.328 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.328 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.328 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.324+0000 7f65d55ce640 10 monclient: _finish_auth 0 2026-02-12T18:12:50.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.324+0000 7f65d55ce640 10 monclient: _check_auth_tickets 2026-02-12T18:12:50.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.324+0000 7f65d55ce640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:50.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.324+0000 7f65d55ce640 1 -- 10.20.193.48:0/29307161 <== mon.5 v2:10.20.193.111:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c4030d00 con 0x7f65d005d430 2026-02-12T18:12:50.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.324+0000 7f65d885b640 5 monclient: authenticate success, global_id 94127 2026-02-12T18:12:50.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.325+0000 7f65d885b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:12:50.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.325+0000 7f65d55ce640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:50.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.325+0000 7f65d55ce640 1 -- 10.20.193.48:0/29307161 <== mon.5 v2:10.20.193.111:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f65c4036cc0 con 0x7f65d005d430 2026-02-12T18:12:50.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.325+0000 7f65d885b640 10 monclient: get_monmap_and_config success 2026-02-12T18:12:50.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.325+0000 7f65d885b640 4 set_mon_vals no callback set 2026-02-12T18:12:50.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.325+0000 7f65d55ce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.325+0000 7f65d55ce640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:12:50.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.325+0000 7f65d55ce640 10 monclient: dump: 2026-02-12T18:12:50.328 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.329 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.329 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.329 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.329 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.329 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.329 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.329 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.329 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.329 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.329 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.329 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.329 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.329 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.329 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.329 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.325+0000 7f65d885b640 10 monclient: shutdown 2026-02-12T18:12:50.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.325+0000 7f65d885b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:50.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.325+0000 7f65d885b640 1 -- 10.20.193.48:0/29307161 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d005d430 msgr2=0x7f65d01a6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.325+0000 7f65d885b640 1 --2- 10.20.193.48:0/29307161 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d005d430 0x7f65d01a6ee0 secure :-1 s=READY pgs=24 gs=3 cs=0 l=1 c_cookie=10552841068238421581 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65c400a8e0 tx=0x7f65c402fe20 comp rx=0 tx=0).stop 2026-02-12T18:12:50.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.325+0000 7f65d885b640 1 -- 10.20.193.48:0/29307161 shutdown_connections 2026-02-12T18:12:50.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.325+0000 7f65d885b640 1 --2- 10.20.193.48:0/29307161 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d005d430 0x7f65d01a6ee0 unknown :-1 s=CLOSED pgs=24 gs=3 cs=0 l=1 c_cookie=10552841068238421581 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.325+0000 7f65d885b640 1 -- 10.20.193.48:0/29307161 >> 10.20.193.48:0/29307161 conn(0x7f65d00548a0 msgr2=0x7f65d0097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:50.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.325+0000 7f65d885b640 1 -- 10.20.193.48:0/29307161 shutdown_connections 2026-02-12T18:12:50.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.325+0000 7f65d885b640 1 -- 10.20.193.48:0/29307161 wait complete. 2026-02-12T18:12:50.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.325+0000 7f65d885b640 10 monclient: build_initial_monmap 2026-02-12T18:12:50.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.325+0000 7f65d885b640 10 monclient: monmap: 2026-02-12T18:12:50.330 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:50.330 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:12:50.330 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:12:50.330 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:12:50.330 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:50.330 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.330 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:12:50.330 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:12:50.330 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:50.330 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:50.330 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:50.330 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:50.330 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:50.330 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:50.330 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:50.330 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.325+0000 7f65d885b640 1 Processor -- start 2026-02-12T18:12:50.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d885b640 1 -- start start 2026-02-12T18:12:50.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d885b640 10 monclient: init 2026-02-12T18:12:50.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d885b640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:50.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d885b640 10 monclient: _add_conns ranks=[7,2,5,6,1,0,3,8,4] 2026-02-12T18:12:50.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d885b640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f65d005c950 0x7f65d008d390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d885b640 10 monclient(hunting): picked mon.noname-i con 0x7f65d005c950 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:12:50.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d885b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f65d005d430 0x7f65d013de10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d885b640 10 monclient(hunting): picked mon.noname-b con 0x7f65d005d430 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:12:50.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d885b640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d005e490 0x7f65d013e350 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d885b640 10 monclient(hunting): picked mon.noname-h con 0x7f65d005e490 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:12:50.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d885b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d885b640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f65d008b6c0 con 0x7f65d005d430 2026-02-12T18:12:50.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d885b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d885b640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f65d012e470 con 0x7f65d005e490 2026-02-12T18:12:50.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d885b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d885b640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f65d008a590 con 0x7f65d005c950 2026-02-12T18:12:50.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d885b640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:50.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d885b640 10 monclient(hunting): authenticate will time out at 1009.052248s 2026-02-12T18:12:50.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d5dcf640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f65d005d430 0x7f65d013de10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d5dcf640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f65d005d430 0x7f65d013de10 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:41880/0 (socket says 10.20.193.48:41880) 2026-02-12T18:12:50.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d5dcf640 1 -- 10.20.193.48:0/12370031 learned_addr learned my addr 10.20.193.48:0/12370031 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:50.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d5dcf640 10 monclient(hunting): get_auth_request con 0x7f65d005d430 auth_method 0 2026-02-12T18:12:50.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d5dcf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d5dcf640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d5dcf640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d6dd1640 1 --2- 10.20.193.48:0/12370031 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d005e490 0x7f65d013e350 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d65d0640 1 --2- 10.20.193.48:0/12370031 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f65d005c950 0x7f65d008d390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d6dd1640 10 monclient(hunting): get_auth_request con 0x7f65d005e490 auth_method 0 2026-02-12T18:12:50.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d6dd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d6dd1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d6dd1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d65d0640 10 monclient(hunting): get_auth_request con 0x7f65d005c950 auth_method 0 2026-02-12T18:12:50.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d65d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d65d0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d65d0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d5dcf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d5dcf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d5dcf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d6dd1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d6dd1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d6dd1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d65d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d65d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d65d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d5dcf640 10 monclient(hunting): handle_auth_done global_id 35849 payload 824 2026-02-12T18:12:50.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d5dcf640 1 -- 10.20.193.48:0/12370031 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f65d005c950 msgr2=0x7f65d008d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d5dcf640 1 --2- 10.20.193.48:0/12370031 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f65d005c950 0x7f65d008d390 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d5dcf640 1 -- 10.20.193.48:0/12370031 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d005e490 msgr2=0x7f65d013e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d5dcf640 1 --2- 10.20.193.48:0/12370031 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d005e490 0x7f65d013e350 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d5dcf640 10 monclient: _finish_hunting 0 2026-02-12T18:12:50.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d5dcf640 1 monclient: found mon.noname-b 2026-02-12T18:12:50.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d5dcf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:50.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d5dcf640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:12:50.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d5dcf640 1 -- 10.20.193.48:0/12370031 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65c400a500 con 0x7f65d005d430 2026-02-12T18:12:50.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.326+0000 7f65d6dd1640 1 --2- 10.20.193.48:0/12370031 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d005e490 0x7f65d013e350 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:12:50.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.328+0000 7f65d5dcf640 1 -- 10.20.193.48:0/12370031 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f65d005d430 msgr2=0x7f65d013de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:50.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.328+0000 7f65d5dcf640 1 --2- 10.20.193.48:0/12370031 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f65d005d430 0x7f65d013de10 secure :-1 s=READY pgs=311 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65bc007fd0 tx=0x7f65bc00c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65baffd640 1 -- 10.20.193.48:0/12370031 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f65bc005db0 con 0x7f65d005d430 2026-02-12T18:12:50.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65baffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:12:50.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65baffd640 10 monclient: dump: 2026-02-12T18:12:50.337 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.337 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.337 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.337 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.337 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.337 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.337 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.338 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.338 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.338 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.338 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.338 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.338 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.338 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.338 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.338 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65baffd640 10 monclient: _finish_auth 0 2026-02-12T18:12:50.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65baffd640 10 monclient: _check_auth_tickets 2026-02-12T18:12:50.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65baffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:50.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65baffd640 1 -- 10.20.193.48:0/12370031 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65bc007530 con 0x7f65d005d430 2026-02-12T18:12:50.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65baffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:50.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65baffd640 1 -- 10.20.193.48:0/12370031 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f65bc0076a0 con 0x7f65d005d430 2026-02-12T18:12:50.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65d885b640 5 monclient: authenticate success, global_id 35849 2026-02-12T18:12:50.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65d4dcd640 4 set_mon_vals no callback set 2026-02-12T18:12:50.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65d885b640 10 monclient: _renew_subs 2026-02-12T18:12:50.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65d885b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:12:50.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65d885b640 1 -- 10.20.193.48:0/12370031 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d0142830 con 0x7f65d005d430 2026-02-12T18:12:50.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65baffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:12:50.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65baffd640 10 monclient: dump: 2026-02-12T18:12:50.339 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.339 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.339 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.339 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.339 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.339 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.339 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.339 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.339 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.339 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.339 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.339 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.339 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.339 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.339 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.339 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65d885b640 10 monclient: _renew_subs 2026-02-12T18:12:50.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65d885b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:12:50.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65d885b640 1 -- 10.20.193.48:0/12370031 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d0141930 con 0x7f65d005d430 2026-02-12T18:12:50.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65d885b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:50.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65d885b640 1 --2- 10.20.193.48:0/12370031 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d013e890 0x7f65d012a440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65d885b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65d885b640 1 -- 10.20.193.48:0/12370031 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f65d005f140 con 0x7f65d013e890 2026-02-12T18:12:50.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65baffd640 1 -- 10.20.193.48:0/12370031 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f65bc007070 con 0x7f65d005d430 2026-02-12T18:12:50.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65d65d0640 1 --2- 10.20.193.48:0/12370031 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d013e890 0x7f65d012a440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65d65d0640 10 monclient: get_auth_request con 0x7f65d013e890 auth_method 0 2026-02-12T18:12:50.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65d65d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65d65d0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65d65d0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65d65d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65d65d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.329+0000 7f65d65d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.330+0000 7f65baffd640 1 --2- 10.20.193.48:0/12370031 >> v2:10.20.193.111:6812/977811348 conn(0x7f65a003f800 0x7f65a005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.330+0000 7f65d65d0640 10 monclient(hunting): handle_auth_done global_id 94145 payload 824 2026-02-12T18:12:50.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.330+0000 7f65d65d0640 1 -- 10.20.193.48:0/12370031 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f65d008b440 con 0x7f65d013e890 2026-02-12T18:12:50.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.330+0000 7f65baffd640 1 -- 10.20.193.48:0/12370031 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(218..218 src has 190..218) ==== 3897+0+0 (secure 0 0 0) 0x7f65bc052090 con 0x7f65d005d430 2026-02-12T18:12:50.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.330+0000 7f65d6dd1640 1 --2- 10.20.193.48:0/12370031 >> v2:10.20.193.111:6812/977811348 conn(0x7f65a003f800 0x7f65a005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.330+0000 7f65d6dd1640 10 monclient: get_auth_request con 0x7f65a003f800 auth_method 0 2026-02-12T18:12:50.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.332+0000 7f65d65d0640 1 -- 10.20.193.48:0/12370031 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d013e890 msgr2=0x7f65d012a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:50.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.332+0000 7f65d65d0640 1 --2- 10.20.193.48:0/12370031 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d013e890 0x7f65d012a440 secure :-1 s=READY pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65c8003770 tx=0x7f65c800fc10 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.332+0000 7f65baffd640 1 -- 10.20.193.48:0/12370031 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f65c800dbc0 con 0x7f65d013e890 2026-02-12T18:12:50.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.332+0000 7f65baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.332+0000 7f65baffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:12:50.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.332+0000 7f65baffd640 10 monclient: dump: 2026-02-12T18:12:50.341 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.341 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.341 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.341 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.341 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.341 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.341 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.341 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.341 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.341 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.341 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.341 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.341 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.341 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.341 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.341 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.332+0000 7f65d6dd1640 1 --2- 10.20.193.48:0/12370031 >> v2:10.20.193.111:6812/977811348 conn(0x7f65a003f800 0x7f65a005fcb0 secure :-1 s=READY pgs=331 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65c4030fd0 tx=0x7f65c4034000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.332+0000 7f65baffd640 1 -- 10.20.193.48:0/12370031 <== mon.5 v2:10.20.193.111:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f65c800dd20 con 0x7f65d013e890 2026-02-12T18:12:50.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.332+0000 7f65baffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:50.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.332+0000 7f65baffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:12:50.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.332+0000 7f65baffd640 1 -- 10.20.193.48:0/12370031 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d013e890 msgr2=0x7f65d012a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.332+0000 7f65baffd640 1 --2- 10.20.193.48:0/12370031 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d013e890 0x7f65d012a440 secure :-1 s=READY pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65c8003770 tx=0x7f65c800fc10 comp rx=0 tx=0).stop 2026-02-12T18:12:50.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.332+0000 7f65baffd640 1 -- 10.20.193.48:0/12370031 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d013e890 msgr2=0x7f65d012a440 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:50.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.332+0000 7f65baffd640 1 --2- 10.20.193.48:0/12370031 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d013e890 0x7f65d012a440 secure :-1 s=CLOSED pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65c8003770 tx=0x7f65c800fc10 comp rx=0 tx=0).stop 2026-02-12T18:12:50.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.336+0000 7f65d885b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:12:50.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.336+0000 7f65d885b640 1 --2- 10.20.193.48:0/12370031 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d012db60 0x7f65d012a980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.336+0000 7f65d885b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.336+0000 7f65d885b640 1 -- 10.20.193.48:0/12370031 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f65d005fd90 con 0x7f65d012db60 2026-02-12T18:12:50.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.336+0000 7f65d65d0640 1 --2- 10.20.193.48:0/12370031 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d012db60 0x7f65d012a980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.336+0000 7f65d65d0640 10 monclient: get_auth_request con 0x7f65d012db60 auth_method 0 2026-02-12T18:12:50.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.336+0000 7f65d65d0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.336+0000 7f65d65d0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.336+0000 7f65d65d0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.336+0000 7f65d65d0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.336+0000 7f65d65d0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.336+0000 7f65d65d0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.336+0000 7f65d65d0640 10 monclient(hunting): handle_auth_done global_id 94154 payload 824 2026-02-12T18:12:50.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.336+0000 7f65d65d0640 1 -- 10.20.193.48:0/12370031 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f65d005cd20 con 0x7f65d012db60 2026-02-12T18:12:50.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.339+0000 7f65d65d0640 1 -- 10.20.193.48:0/12370031 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d012db60 msgr2=0x7f65d012a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:50.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.339+0000 7f65d65d0640 1 --2- 10.20.193.48:0/12370031 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d012db60 0x7f65d012a980 secure :-1 s=READY pgs=26 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65c8016000 tx=0x7f65c8003810 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.339+0000 7f65baffd640 1 -- 10.20.193.48:0/12370031 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f65c8014d50 con 0x7f65d012db60 2026-02-12T18:12:50.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.339+0000 7f65baffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.339+0000 7f65baffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:12:50.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.339+0000 7f65baffd640 10 monclient: dump: 2026-02-12T18:12:50.344 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.344 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.344 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.344 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.344 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.344 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.344 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.344 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.344 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.344 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.345 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.345 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.345 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.345 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.345 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.345 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.339+0000 7f65baffd640 1 -- 10.20.193.48:0/12370031 <== mon.5 v2:10.20.193.111:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7f65c8014890 con 0x7f65d012db60 2026-02-12T18:12:50.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.339+0000 7f65baffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:12:50.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.339+0000 7f65baffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:12:50.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.339+0000 7f65baffd640 1 -- 10.20.193.48:0/12370031 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d012db60 msgr2=0x7f65d012a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.339+0000 7f65baffd640 1 --2- 10.20.193.48:0/12370031 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d012db60 0x7f65d012a980 secure :-1 s=READY pgs=26 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65c8016000 tx=0x7f65c8003810 comp rx=0 tx=0).stop 2026-02-12T18:12:50.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.339+0000 7f65baffd640 1 -- 10.20.193.48:0/12370031 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d012db60 msgr2=0x7f65d012a980 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:50.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.339+0000 7f65baffd640 1 --2- 10.20.193.48:0/12370031 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f65d012db60 0x7f65d012a980 unknown :-1 s=CLOSED pgs=26 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.345 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:12:50.345 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:12:50.345 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:12:50.346 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:12:50.346 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 68, 2026-02-12T18:12:50.346 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 16012, 2026-02-12T18:12:50.346 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:12:50.346 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:12:50.346 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:12:50.346 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:12:50.346 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:12:50.346 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:12:50.346 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:12:50.346 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:12:50.346 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:12:50.346 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:12:50.346 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:50.346 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 1, 2026-02-12T18:12:50.346 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:50.346 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:12:50.346 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:12:50.346 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:50.346 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:50.347 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:50.347 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:50.347 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:50.347 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:50.347 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:50.347 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:50.347 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:50.347 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:50.347 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:50.347 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:50.347 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:50.347 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:50.347 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:12:50.347 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:12:50.347 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:50.347 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:50.347 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:50.347 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:50.347 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:50.347 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:50.347 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:50.348 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:50.348 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:50.348 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:50.348 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:50.348 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:50.348 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:50.348 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.348 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.348 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:12:50.348 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:12:50.348 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:12:50.348 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:12:50.348 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:12:50.348 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:12:50.348 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:50.348 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:50.348 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:12:50.348 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:12:50.348 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:12:50.348 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:12:50.349 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:12:50.349 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:12:50.349 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:12:50.349 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:50.349 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:12:50.349 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:50.349 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:50.349 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:50.349 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:50.349 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:50.349 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:50.349 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:50.349 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:50.349 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:50.349 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:50.349 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:50.349 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:50.349 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:50.349 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:50.349 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:12:50.349 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.350 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:12:50.350 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.350 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:12:50.350 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:12:50.350 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.350 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.350 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.350 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.350 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:12:50.350 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.350 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.350 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.350 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.350 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:12:50.350 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.350 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.350 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.350 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.350 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:12:50.350 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:12:50.350 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.350 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.350 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:12:50.351 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.351 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.351 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.351 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:12:50.351 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:12:50.351 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.351 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.351 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.351 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.351 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:12:50.351 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.351 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.351 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.351 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.351 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:12:50.351 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.351 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.351 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.351 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.351 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:12:50.351 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:12:50.351 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.352 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.352 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:12:50.352 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.352 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.352 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.352 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:12:50.352 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:12:50.352 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.352 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.352 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.352 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.352 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:12:50.352 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.352 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.352 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.352 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.352 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:12:50.352 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.352 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.352 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.352 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.352 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:12:50.352 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:12:50.353 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.353 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.353 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:12:50.353 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.353 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.353 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.353 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:12:50.353 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:12:50.353 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.353 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.353 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.353 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.353 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:12:50.353 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.353 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.353 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.353 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.353 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:12:50.353 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.353 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.353 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.353 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.353 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:12:50.354 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:12:50.354 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.354 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.354 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:12:50.354 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.354 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.354 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.354 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:12:50.354 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:12:50.354 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.354 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.354 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.354 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.354 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:12:50.354 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.354 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.354 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.354 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.354 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:12:50.354 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.354 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.354 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.354 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.354 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:12:50.355 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:12:50.355 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.355 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.355 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:50.355 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.355 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.355 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.355 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:12:50.355 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:12:50.355 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.355 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.355 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.355 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.355 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:12:50.355 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.355 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.355 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.355 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.355 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:12:50.355 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.355 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.355 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.355 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.355 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.356 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.357 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:50.357 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.357 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.357 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.357 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:12:50.357 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:12:50.357 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.357 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.357 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.357 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.357 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:12:50.357 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.357 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.357 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.357 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.357 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:12:50.357 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.357 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.357 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.357 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.357 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:12:50.357 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:12:50.357 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.357 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.357 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:12:50.358 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.358 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.358 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.358 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:12:50.358 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:12:50.358 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.358 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.358 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.358 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.358 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:12:50.358 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.358 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.358 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.358 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.358 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:12:50.358 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.358 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.358 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.358 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.358 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:12:50.358 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:12:50.358 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.358 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.358 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:12:50.358 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.358 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.359 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.359 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.359 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:12:50.359 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:12:50.359 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.359 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:50.359 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:50.359 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:50.359 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.359 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:50.359 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:12:50.359 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.359 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:50.359 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:50.359 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:50.359 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.359 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.359 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.359 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:12:50.359 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:12:50.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.339+0000 7f65d885b640 1 -- 10.20.193.48:0/12370031 >> v2:10.20.193.111:6812/977811348 conn(0x7f65a003f800 msgr2=0x7f65a005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.339+0000 7f65d885b640 1 --2- 10.20.193.48:0/12370031 >> v2:10.20.193.111:6812/977811348 conn(0x7f65a003f800 0x7f65a005fcb0 secure :-1 s=READY pgs=331 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65c4030fd0 tx=0x7f65c4034000 comp rx=0 tx=0).stop 2026-02-12T18:12:50.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.339+0000 7f65d885b640 10 monclient: shutdown 2026-02-12T18:12:50.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.339+0000 7f65d885b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:50.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.339+0000 7f65d885b640 1 -- 10.20.193.48:0/12370031 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f65d005d430 msgr2=0x7f65d013de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.339+0000 7f65d885b640 1 --2- 10.20.193.48:0/12370031 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f65d005d430 0x7f65d013de10 secure :-1 s=READY pgs=311 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f65bc007fd0 tx=0x7f65bc00c970 comp rx=0 tx=0).stop 2026-02-12T18:12:50.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.339+0000 7f65d6dd1640 1 -- 10.20.193.48:0/12370031 reap_dead start 2026-02-12T18:12:50.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.340+0000 7f65d6dd1640 1 -- 10.20.193.48:0/12370031 reap_dead start 2026-02-12T18:12:50.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.340+0000 7f65d885b640 1 -- 10.20.193.48:0/12370031 shutdown_connections 2026-02-12T18:12:50.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.340+0000 7f65d885b640 1 -- 10.20.193.48:0/12370031 >> 10.20.193.48:0/12370031 conn(0x7f65d00548a0 msgr2=0x7f65d013f020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:50.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.340+0000 7f65d885b640 1 -- 10.20.193.48:0/12370031 shutdown_connections 2026-02-12T18:12:50.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.340+0000 7f65d885b640 1 -- 10.20.193.48:0/12370031 wait complete. 2026-02-12T18:12:50.361 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:12:50.361 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2026-02-12T18:12:50.361 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2026-02-12T18:12:50.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.426+0000 7f6d4f6af640 10 monclient: get_monmap_and_config 2026-02-12T18:12:50.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.426+0000 7f6d4f6af640 10 monclient: build_initial_monmap 2026-02-12T18:12:50.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.426+0000 7f6d4f6af640 10 monclient: monmap: 2026-02-12T18:12:50.427 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:50.427 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.427 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:12:50.427331+0000 2026-02-12T18:12:50.427 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:12:50.427331+0000 2026-02-12T18:12:50.427 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:50.428 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.428 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:12:50.428 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:12:50.428 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:50.428 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:50.428 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:50.428 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:50.428 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:50.428 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:50.428 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:50.428 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:12:50.428 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:12:50.428 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.426+0000 7f6d4f6af640 1 Processor -- start 2026-02-12T18:12:50.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.426+0000 7f6d4f6af640 1 -- start start 2026-02-12T18:12:50.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.426+0000 7f6d4f6af640 10 monclient: init 2026-02-12T18:12:50.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4f6af640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:50.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4f6af640 10 monclient: _add_conns ranks=[10,3,9,0,6,5,4,2,1,7,8] 2026-02-12T18:12:50.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4f6af640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f6d4805c950 0x7f6d4805cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4f6af640 10 monclient(hunting): picked mon.noname-f con 0x7f6d4805c950 addr v2:10.20.193.111:3300/0 2026-02-12T18:12:50.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4f6af640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6d4805e490 0x7f6d4805d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4f6af640 10 monclient(hunting): picked mon.noname-g con 0x7f6d4805e490 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:12:50.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4f6af640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f6d4813db70 0x7f6d4813e010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4f6af640 10 monclient(hunting): picked mon.noname-a con 0x7f6d4813db70 addr v2:10.20.193.48:3300/0 2026-02-12T18:12:50.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4f6af640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4f6af640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f6d4805ddd0 con 0x7f6d4813db70 2026-02-12T18:12:50.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4f6af640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4f6af640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f6d4805d7a0 con 0x7f6d4805c950 2026-02-12T18:12:50.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4f6af640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4f6af640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6d48092990 con 0x7f6d4805e490 2026-02-12T18:12:50.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4f6af640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:50.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4f6af640 10 monclient(hunting): authenticate will time out at 1009.153157s 2026-02-12T18:12:50.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4dc25640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f6d4813db70 0x7f6d4813e010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4dc25640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f6d4813db70 0x7f6d4813e010 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:42288/0 (socket says 10.20.193.48:42288) 2026-02-12T18:12:50.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4dc25640 1 -- 10.20.193.48:0/277879322 learned_addr learned my addr 10.20.193.48:0/277879322 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:50.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4dc25640 10 monclient(hunting): get_auth_request con 0x7f6d4813db70 auth_method 0 2026-02-12T18:12:50.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4dc25640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4dc25640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4dc25640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4cc23640 1 --2- 10.20.193.48:0/277879322 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6d4805e490 0x7f6d4805d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4cc23640 10 monclient(hunting): get_auth_request con 0x7f6d4805e490 auth_method 0 2026-02-12T18:12:50.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4cc23640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4cc23640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4cc23640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4dc25640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4dc25640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4d424640 1 --2- 10.20.193.48:0/277879322 >> v2:10.20.193.111:3300/0 conn(0x7f6d4805c950 0x7f6d4805cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4dc25640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4d424640 10 monclient(hunting): get_auth_request con 0x7f6d4805c950 auth_method 0 2026-02-12T18:12:50.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4d424640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4d424640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4d424640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4cc23640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4cc23640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4cc23640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4dc25640 10 monclient(hunting): handle_auth_done global_id 6174 payload 274 2026-02-12T18:12:50.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4dc25640 1 -- 10.20.193.48:0/277879322 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6d4805e490 msgr2=0x7f6d4805d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:50.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4dc25640 1 --2- 10.20.193.48:0/277879322 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6d4805e490 0x7f6d4805d260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4dc25640 1 -- 10.20.193.48:0/277879322 >> v2:10.20.193.111:3300/0 conn(0x7f6d4805c950 msgr2=0x7f6d4805cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:50.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4dc25640 1 --2- 10.20.193.48:0/277879322 >> v2:10.20.193.111:3300/0 conn(0x7f6d4805c950 0x7f6d4805cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4dc25640 10 monclient: _finish_hunting 0 2026-02-12T18:12:50.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4dc25640 1 monclient: found mon.noname-a 2026-02-12T18:12:50.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4dc25640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:50.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4dc25640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:12:50.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.427+0000 7f6d4dc25640 1 -- 10.20.193.48:0/277879322 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d4804dc20 con 0x7f6d4813db70 2026-02-12T18:12:50.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.429+0000 7f6d4dc25640 1 -- 10.20.193.48:0/277879322 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6d4813db70 msgr2=0x7f6d4813e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:50.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.429+0000 7f6d4dc25640 1 --2- 10.20.193.48:0/277879322 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6d4813db70 0x7f6d4813e010 secure :-1 s=READY pgs=469 gs=1 cs=0 l=1 c_cookie=3332485688388362373 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d4808e130 tx=0x7f6d4402fe90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3f5e13cb762085 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d37fff640 1 -- 10.20.193.48:0/277879322 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6d44036340 con 0x7f6d4813db70 2026-02-12T18:12:50.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d37fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d37fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:12:50.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d37fff640 10 monclient: dump: 2026-02-12T18:12:50.434 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.434 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.434 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.434 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.434 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.435 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.435 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.435 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.435 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.435 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.435 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.435 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.435 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.435 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.435 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.435 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d37fff640 10 monclient: _finish_auth 0 2026-02-12T18:12:50.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d37fff640 10 monclient: _check_auth_tickets 2026-02-12T18:12:50.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d37fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:50.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d37fff640 1 -- 10.20.193.48:0/277879322 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d440364c0 con 0x7f6d4813db70 2026-02-12T18:12:50.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d4f6af640 5 monclient: authenticate success, global_id 6174 2026-02-12T18:12:50.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d4f6af640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:12:50.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d37fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:50.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d37fff640 1 -- 10.20.193.48:0/277879322 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6d44036af0 con 0x7f6d4813db70 2026-02-12T18:12:50.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d4f6af640 10 monclient: get_monmap_and_config success 2026-02-12T18:12:50.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d4f6af640 4 set_mon_vals no callback set 2026-02-12T18:12:50.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d37fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d37fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:12:50.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d37fff640 10 monclient: dump: 2026-02-12T18:12:50.435 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.436 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.436 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.436 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.436 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.436 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.436 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.436 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.436 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.436 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.436 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.436 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.436 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.436 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.436 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.436 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d4f6af640 10 monclient: shutdown 2026-02-12T18:12:50.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d4f6af640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:50.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d4f6af640 1 -- 10.20.193.48:0/277879322 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6d4813db70 msgr2=0x7f6d4813e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d4f6af640 1 --2- 10.20.193.48:0/277879322 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6d4813db70 0x7f6d4813e010 secure :-1 s=READY pgs=469 gs=1 cs=0 l=1 c_cookie=3332485688388362373 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d4808e130 tx=0x7f6d4402fe90 comp rx=0 tx=0).stop 2026-02-12T18:12:50.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d4f6af640 1 -- 10.20.193.48:0/277879322 shutdown_connections 2026-02-12T18:12:50.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d4f6af640 1 --2- 10.20.193.48:0/277879322 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6d4813db70 0x7f6d4813e010 unknown :-1 s=CLOSED pgs=469 gs=1 cs=0 l=1 c_cookie=3332485688388362373 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d4f6af640 1 --2- 10.20.193.48:0/277879322 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6d4805e490 0x7f6d4805d260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d4f6af640 1 --2- 10.20.193.48:0/277879322 >> v2:10.20.193.111:3300/0 conn(0x7f6d4805c950 0x7f6d4805cd20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d4f6af640 1 -- 10.20.193.48:0/277879322 >> 10.20.193.48:0/277879322 conn(0x7f6d480548a0 msgr2=0x7f6d48097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:50.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d4f6af640 1 -- 10.20.193.48:0/277879322 shutdown_connections 2026-02-12T18:12:50.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d4f6af640 1 -- 10.20.193.48:0/277879322 wait complete. 2026-02-12T18:12:50.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.430+0000 7f6d4f6af640 10 monclient: build_initial_monmap 2026-02-12T18:12:50.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4f6af640 10 monclient: monmap: 2026-02-12T18:12:50.437 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:50.437 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:12:50.437 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:12:50.437 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:12:50.437 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:50.437 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.437 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:12:50.437 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:12:50.437 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:50.437 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:50.437 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:50.437 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:50.437 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:50.437 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:50.437 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:50.437 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4f6af640 1 Processor -- start 2026-02-12T18:12:50.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4f6af640 1 -- start start 2026-02-12T18:12:50.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4f6af640 10 monclient: init 2026-02-12T18:12:50.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4f6af640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:50.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4f6af640 10 monclient: _add_conns ranks=[6,3,4,2,8,0,7,1,5] 2026-02-12T18:12:50.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4f6af640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6d4805c950 0x7f6d4808d150 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4f6af640 10 monclient(hunting): picked mon.noname-d con 0x7f6d4805c950 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:12:50.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4f6af640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6d4805e490 0x7f6d4808d690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4f6af640 10 monclient(hunting): picked mon.noname-g con 0x7f6d4805e490 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:12:50.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4f6af640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6d4813db70 0x7f6d4813cb70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4f6af640 10 monclient(hunting): picked mon.noname-c con 0x7f6d4813db70 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:12:50.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4f6af640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4f6af640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6d4812d710 con 0x7f6d4805e490 2026-02-12T18:12:50.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4f6af640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4f6af640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f6d4808a4e0 con 0x7f6d4813db70 2026-02-12T18:12:50.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4f6af640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4f6af640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f6d4808aa30 con 0x7f6d4805c950 2026-02-12T18:12:50.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4f6af640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:50.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4f6af640 10 monclient(hunting): authenticate will time out at 1009.157516s 2026-02-12T18:12:50.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4d424640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6d4805c950 0x7f6d4808d150 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4dc25640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6d4813db70 0x7f6d4813cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4d424640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6d4805c950 0x7f6d4808d150 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:59422/0 (socket says 10.20.193.48:59422) 2026-02-12T18:12:50.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4d424640 1 -- 10.20.193.48:0/2405045839 learned_addr learned my addr 10.20.193.48:0/2405045839 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:50.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4d424640 10 monclient(hunting): get_auth_request con 0x7f6d4805c950 auth_method 0 2026-02-12T18:12:50.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4d424640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4d424640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4d424640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4dc25640 10 monclient(hunting): get_auth_request con 0x7f6d4813db70 auth_method 0 2026-02-12T18:12:50.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4dc25640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4dc25640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4dc25640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4cc23640 1 --2- 10.20.193.48:0/2405045839 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6d4805e490 0x7f6d4808d690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4d424640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4d424640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4d424640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4cc23640 10 monclient(hunting): get_auth_request con 0x7f6d4805e490 auth_method 0 2026-02-12T18:12:50.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4cc23640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4cc23640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4cc23640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4dc25640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4dc25640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4dc25640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4cc23640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4cc23640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4cc23640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4d424640 10 monclient(hunting): handle_auth_done global_id 5802 payload 824 2026-02-12T18:12:50.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4d424640 1 -- 10.20.193.48:0/2405045839 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6d4813db70 msgr2=0x7f6d4813cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4d424640 1 --2- 10.20.193.48:0/2405045839 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6d4813db70 0x7f6d4813cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4d424640 1 -- 10.20.193.48:0/2405045839 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6d4805e490 msgr2=0x7f6d4808d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4d424640 1 --2- 10.20.193.48:0/2405045839 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6d4805e490 0x7f6d4808d690 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4d424640 10 monclient: _finish_hunting 0 2026-02-12T18:12:50.440 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4d424640 1 monclient: found mon.noname-d 2026-02-12T18:12:50.440 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4d424640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:50.440 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4d424640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:12:50.440 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.431+0000 7f6d4d424640 1 -- 10.20.193.48:0/2405045839 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d4400a5d0 con 0x7f6d4805c950 2026-02-12T18:12:50.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d4d424640 1 -- 10.20.193.48:0/2405045839 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6d4805c950 msgr2=0x7f6d4808d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:50.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d4d424640 1 --2- 10.20.193.48:0/2405045839 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6d4805c950 0x7f6d4808d150 secure :-1 s=READY pgs=275 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d3800e730 tx=0x7f6d3800ec00 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d35ffb640 1 -- 10.20.193.48:0/2405045839 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6d3800ee60 con 0x7f6d4805c950 2026-02-12T18:12:50.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d35ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d35ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:12:50.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d35ffb640 10 monclient: dump: 2026-02-12T18:12:50.442 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.442 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.442 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.442 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.442 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.442 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.442 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.442 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.442 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.442 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.442 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.442 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.442 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.442 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.442 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.442 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d35ffb640 10 monclient: _finish_auth 0 2026-02-12T18:12:50.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d35ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:12:50.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d35ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:50.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d4f6af640 5 monclient: authenticate success, global_id 5802 2026-02-12T18:12:50.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d4f6af640 10 monclient: _renew_subs 2026-02-12T18:12:50.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d4f6af640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:12:50.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d4f6af640 1 -- 10.20.193.48:0/2405045839 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d48143aa0 con 0x7f6d4805c950 2026-02-12T18:12:50.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d4f6af640 10 monclient: _renew_subs 2026-02-12T18:12:50.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d4f6af640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:12:50.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d4f6af640 1 -- 10.20.193.48:0/2405045839 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d48090590 con 0x7f6d4805c950 2026-02-12T18:12:50.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d35ffb640 1 -- 10.20.193.48:0/2405045839 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d3800c8e0 con 0x7f6d4805c950 2026-02-12T18:12:50.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d35ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:50.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d35ffb640 1 -- 10.20.193.48:0/2405045839 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6d3801c450 con 0x7f6d4805c950 2026-02-12T18:12:50.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d35ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d377fe640 4 set_mon_vals no callback set 2026-02-12T18:12:50.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d35ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:12:50.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d35ffb640 10 monclient: dump: 2026-02-12T18:12:50.443 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.443 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.443 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.443 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.443 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.443 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.443 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.443 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.443 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.443 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.443 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.443 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.444 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.444 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.444 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.444 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d4f6af640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:50.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d4f6af640 1 --2- 10.20.193.48:0/2405045839 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d4812c970 0x7f6d4813d0b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d4f6af640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d4f6af640 1 -- 10.20.193.48:0/2405045839 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f6d4805f140 con 0x7f6d4812c970 2026-02-12T18:12:50.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d4d424640 1 --2- 10.20.193.48:0/2405045839 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6d4805c950 0x7f6d4808d150 secure :-1 s=READY pgs=275 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d3800e730 tx=0x7f6d3800ec00 comp rx=0 tx=0).queue_received will delay after 1.77092e+09 on 0x7f6d38024070 mgrmap(e 5) 2026-02-12T18:12:50.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d4cc23640 1 --2- 10.20.193.48:0/2405045839 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d4812c970 0x7f6d4813d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d4cc23640 10 monclient: get_auth_request con 0x7f6d4812c970 auth_method 0 2026-02-12T18:12:50.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d4cc23640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d4cc23640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d4cc23640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.434+0000 7f6d35ffb640 1 -- 10.20.193.48:0/2405045839 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f6d38024070 con 0x7f6d4805c950 2026-02-12T18:12:50.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.435+0000 7f6d4cc23640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.435+0000 7f6d4cc23640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.435+0000 7f6d4cc23640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.435+0000 7f6d35ffb640 1 --2- 10.20.193.48:0/2405045839 >> v2:10.20.193.111:6812/977811348 conn(0x7f6d1803f800 0x7f6d1805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.435+0000 7f6d4dc25640 1 --2- 10.20.193.48:0/2405045839 >> v2:10.20.193.111:6812/977811348 conn(0x7f6d1803f800 0x7f6d1805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.435+0000 7f6d4dc25640 10 monclient: get_auth_request con 0x7f6d1803f800 auth_method 0 2026-02-12T18:12:50.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.435+0000 7f6d4cc23640 10 monclient(hunting): handle_auth_done global_id 94147 payload 824 2026-02-12T18:12:50.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.435+0000 7f6d4cc23640 1 -- 10.20.193.48:0/2405045839 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6d4808ad90 con 0x7f6d4812c970 2026-02-12T18:12:50.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.437+0000 7f6d4cc23640 1 -- 10.20.193.48:0/2405045839 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d4812c970 msgr2=0x7f6d4813d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:50.445 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.437+0000 7f6d4cc23640 1 --2- 10.20.193.48:0/2405045839 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d4812c970 0x7f6d4813d0b0 secure :-1 s=READY pgs=27 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d4808ebe0 tx=0x7f6d3c011d90 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.445 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.437+0000 7f6d4dc25640 1 --2- 10.20.193.48:0/2405045839 >> v2:10.20.193.111:6812/977811348 conn(0x7f6d1803f800 0x7f6d1805fcb0 secure :-1 s=READY pgs=332 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d4402fed0 tx=0x7f6d44007f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.445 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.437+0000 7f6d35ffb640 1 -- 10.20.193.48:0/2405045839 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6d3c00fee0 con 0x7f6d4812c970 2026-02-12T18:12:50.445 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.438+0000 7f6d35ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.445 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.438+0000 7f6d35ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:12:50.445 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.438+0000 7f6d35ffb640 10 monclient: dump: 2026-02-12T18:12:50.445 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.445 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.445 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.445 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.445 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.445 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.445 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.445 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.445 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.445 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.445 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.445 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.445 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.445 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.445 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.445 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.445 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.438+0000 7f6d35ffb640 1 -- 10.20.193.48:0/2405045839 <== mon.7 v2:10.20.193.111:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f6d3c014440 con 0x7f6d4812c970 2026-02-12T18:12:50.445 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.438+0000 7f6d35ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:50.445 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.438+0000 7f6d35ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:12:50.446 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.438+0000 7f6d35ffb640 1 -- 10.20.193.48:0/2405045839 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d4812c970 msgr2=0x7f6d4813d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.446 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.438+0000 7f6d35ffb640 1 --2- 10.20.193.48:0/2405045839 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d4812c970 0x7f6d4813d0b0 secure :-1 s=READY pgs=27 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d4808ebe0 tx=0x7f6d3c011d90 comp rx=0 tx=0).stop 2026-02-12T18:12:50.446 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.438+0000 7f6d35ffb640 1 -- 10.20.193.48:0/2405045839 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d4812c970 msgr2=0x7f6d4813d0b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:50.446 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.438+0000 7f6d35ffb640 1 --2- 10.20.193.48:0/2405045839 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d4812c970 0x7f6d4813d0b0 secure :-1 s=CLOSED pgs=27 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d4808ebe0 tx=0x7f6d3c011d90 comp rx=0 tx=0).stop 2026-02-12T18:12:50.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.441+0000 7f6d4f6af640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:12:50.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.441+0000 7f6d4f6af640 1 --2- 10.20.193.48:0/2405045839 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d4813d5f0 0x7f6d4808ecd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.441+0000 7f6d4f6af640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.441+0000 7f6d4f6af640 1 -- 10.20.193.48:0/2405045839 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f6d4805fd90 con 0x7f6d4813d5f0 2026-02-12T18:12:50.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.441+0000 7f6d4cc23640 1 --2- 10.20.193.48:0/2405045839 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d4813d5f0 0x7f6d4808ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.441+0000 7f6d4cc23640 10 monclient: get_auth_request con 0x7f6d4813d5f0 auth_method 0 2026-02-12T18:12:50.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.441+0000 7f6d4cc23640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.441+0000 7f6d4cc23640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.441+0000 7f6d4cc23640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.441+0000 7f6d4cc23640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.441+0000 7f6d4cc23640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.441+0000 7f6d4cc23640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.442+0000 7f6d4cc23640 10 monclient(hunting): handle_auth_done global_id 94156 payload 824 2026-02-12T18:12:50.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.442+0000 7f6d4cc23640 1 -- 10.20.193.48:0/2405045839 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6d4813d9c0 con 0x7f6d4813d5f0 2026-02-12T18:12:50.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.444+0000 7f6d4cc23640 1 -- 10.20.193.48:0/2405045839 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d4813d5f0 msgr2=0x7f6d4808ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:50.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.444+0000 7f6d4cc23640 1 --2- 10.20.193.48:0/2405045839 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d4813d5f0 0x7f6d4808ecd0 secure :-1 s=READY pgs=28 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d3c00f680 tx=0x7f6d3c004770 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.444+0000 7f6d35ffb640 1 -- 10.20.193.48:0/2405045839 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6d3c014b20 con 0x7f6d4813d5f0 2026-02-12T18:12:50.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.444+0000 7f6d35ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.444+0000 7f6d35ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:12:50.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.444+0000 7f6d35ffb640 10 monclient: dump: 2026-02-12T18:12:50.448 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.448 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.448 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.448 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.448 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.448 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.448 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.448 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.448 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.448 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.448 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.448 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.448 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.448 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.448 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.448 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.444+0000 7f6d35ffb640 1 -- 10.20.193.48:0/2405045839 <== mon.7 v2:10.20.193.111:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7f6d3c026070 con 0x7f6d4813d5f0 2026-02-12T18:12:50.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.444+0000 7f6d35ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:12:50.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.444+0000 7f6d35ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:12:50.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.444+0000 7f6d35ffb640 1 -- 10.20.193.48:0/2405045839 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d4813d5f0 msgr2=0x7f6d4808ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.444+0000 7f6d35ffb640 1 --2- 10.20.193.48:0/2405045839 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d4813d5f0 0x7f6d4808ecd0 secure :-1 s=READY pgs=28 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d3c00f680 tx=0x7f6d3c004770 comp rx=0 tx=0).stop 2026-02-12T18:12:50.449 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.444+0000 7f6d35ffb640 1 -- 10.20.193.48:0/2405045839 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d4813d5f0 msgr2=0x7f6d4808ecd0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:50.449 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.444+0000 7f6d35ffb640 1 --2- 10.20.193.48:0/2405045839 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d4813d5f0 0x7f6d4808ecd0 secure :-1 s=CLOSED pgs=28 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d3c00f680 tx=0x7f6d3c004770 comp rx=0 tx=0).stop 2026-02-12T18:12:50.449 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:12:50.449 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:12:50.449 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:12:50.449 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:12:50.449 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 68, 2026-02-12T18:12:50.449 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 16128, 2026-02-12T18:12:50.449 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:12:50.449 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:12:50.449 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:12:50.449 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:12:50.449 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:12:50.449 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:12:50.449 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:12:50.449 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:12:50.449 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:12:50.449 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:12:50.450 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:50.450 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 1, 2026-02-12T18:12:50.450 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:50.450 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:12:50.450 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:12:50.450 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:50.450 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:50.450 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:50.450 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:50.450 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:50.450 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:50.450 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:50.450 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:50.450 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:50.450 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:50.450 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:50.450 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:50.450 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:50.450 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:50.450 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:12:50.450 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:12:50.450 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:50.450 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:50.451 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:50.451 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:50.451 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:50.451 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:50.451 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:50.451 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:50.451 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:50.451 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:50.451 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:50.451 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:50.451 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:50.451 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.451 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.451 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:12:50.451 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:12:50.451 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:12:50.451 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:12:50.451 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:12:50.451 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:12:50.451 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:50.451 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:50.451 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:12:50.451 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:12:50.451 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:12:50.452 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:12:50.452 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:12:50.452 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:12:50.452 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:12:50.452 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:50.452 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:12:50.452 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:50.452 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:50.452 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:50.452 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:50.452 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:50.452 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:50.452 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:50.452 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:50.452 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:50.452 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:50.452 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:50.452 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:50.452 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:50.452 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:50.452 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:12:50.452 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.452 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:12:50.452 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.452 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:12:50.453 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:12:50.453 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.453 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.453 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.453 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.453 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:12:50.453 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.453 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.453 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.453 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.453 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:12:50.453 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.453 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.453 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.453 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.453 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:12:50.453 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:12:50.453 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.453 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.453 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:12:50.453 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.453 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.453 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.453 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:12:50.453 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:12:50.454 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.454 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.454 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.454 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.454 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:12:50.454 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.454 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.454 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.454 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.454 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:12:50.454 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.454 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.454 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.454 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.454 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:12:50.454 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:12:50.454 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.454 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.454 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:12:50.454 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.454 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.454 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.454 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:12:50.454 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:12:50.454 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.454 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.455 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.455 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.455 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:12:50.455 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.455 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.455 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.455 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.455 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:12:50.455 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.455 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.455 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.455 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.455 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:12:50.455 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:12:50.455 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.455 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.455 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:12:50.455 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.455 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.455 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.455 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:12:50.455 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:12:50.455 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.455 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.455 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.456 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.456 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:12:50.456 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.456 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.456 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.456 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.456 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:12:50.456 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.456 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.456 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.456 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.456 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:12:50.456 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:12:50.456 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.456 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.456 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:12:50.456 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.456 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.456 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.456 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:12:50.456 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:12:50.456 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.456 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.456 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.456 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.456 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:12:50.457 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.457 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.457 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.457 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.457 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:12:50.457 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.457 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.457 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.457 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.457 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:12:50.457 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:12:50.457 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.457 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.457 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:50.457 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.457 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.457 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.457 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:12:50.457 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:12:50.457 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.457 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.457 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.457 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.457 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:12:50.457 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.457 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.458 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.458 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.458 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:12:50.458 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.458 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.458 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.458 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.458 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:12:50.458 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:12:50.458 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.458 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.458 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:12:50.458 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.458 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.458 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.458 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:12:50.458 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:12:50.458 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.458 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.458 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.458 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.458 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:12:50.458 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.458 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.458 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.459 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.459 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:12:50.459 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.459 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.459 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.459 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.459 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:12:50.459 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:12:50.459 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.459 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.459 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:50.459 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.459 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.459 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.459 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:12:50.459 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:12:50.459 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.459 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.459 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.459 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.459 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:12:50.459 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.459 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.459 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.459 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.459 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.460 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:50.461 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:12:50.462 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:12:50.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.444+0000 7f6d4f6af640 1 -- 10.20.193.48:0/2405045839 >> v2:10.20.193.111:6812/977811348 conn(0x7f6d1803f800 msgr2=0x7f6d1805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.444+0000 7f6d4f6af640 1 --2- 10.20.193.48:0/2405045839 >> v2:10.20.193.111:6812/977811348 conn(0x7f6d1803f800 0x7f6d1805fcb0 secure :-1 s=READY pgs=332 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d4402fed0 tx=0x7f6d44007f90 comp rx=0 tx=0).stop 2026-02-12T18:12:50.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.444+0000 7f6d4f6af640 10 monclient: shutdown 2026-02-12T18:12:50.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.444+0000 7f6d4f6af640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:50.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.444+0000 7f6d4f6af640 1 -- 10.20.193.48:0/2405045839 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6d4805c950 msgr2=0x7f6d4808d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.444+0000 7f6d4f6af640 1 --2- 10.20.193.48:0/2405045839 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6d4805c950 0x7f6d4808d150 secure :-1 s=READY pgs=275 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d3800e730 tx=0x7f6d3800ec00 comp rx=0 tx=0).stop 2026-02-12T18:12:50.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.444+0000 7f6d4dc25640 1 -- 10.20.193.48:0/2405045839 reap_dead start 2026-02-12T18:12:50.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.444+0000 7f6d35ffb640 1 -- 10.20.193.48:0/2405045839 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(219..219 src has 190..219) ==== 3897+0+0 (unknown 0 0 0) 0x7f6d38052ca0 con 0x7f6d4805c950 2026-02-12T18:12:50.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.444+0000 7f6d4dc25640 1 -- 10.20.193.48:0/2405045839 reap_dead start 2026-02-12T18:12:50.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.444+0000 7f6d4f6af640 1 -- 10.20.193.48:0/2405045839 shutdown_connections 2026-02-12T18:12:50.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.444+0000 7f6d4f6af640 1 -- 10.20.193.48:0/2405045839 >> 10.20.193.48:0/2405045839 conn(0x7f6d480548a0 msgr2=0x7f6d48093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:50.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.444+0000 7f6d4f6af640 1 -- 10.20.193.48:0/2405045839 shutdown_connections 2026-02-12T18:12:50.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.444+0000 7f6d4f6af640 1 -- 10.20.193.48:0/2405045839 wait complete. 2026-02-12T18:12:50.463 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:12:50.463 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-12T18:12:50.463 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-12T18:12:50.505 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30361]: starting. 2026-02-12T18:12:50.505 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30361]: creating pool ceph_test_rados_delete_pools_parallel.trial111-30360 2026-02-12T18:12:50.506 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30361]: created object 0... 2026-02-12T18:12:50.506 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30361]: created object 25... 2026-02-12T18:12:50.506 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30361]: created object 49... 2026-02-12T18:12:50.506 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30361]: finishing. 2026-02-12T18:12:50.506 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30361]: shutting down. 2026-02-12T18:12:50.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.529+0000 7fa7afacc640 10 monclient: get_monmap_and_config 2026-02-12T18:12:50.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.529+0000 7fa7afacc640 10 monclient: build_initial_monmap 2026-02-12T18:12:50.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.529+0000 7fa7afacc640 10 monclient: monmap: 2026-02-12T18:12:50.531 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:50.531 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.531 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:12:50.530546+0000 2026-02-12T18:12:50.531 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:12:50.530546+0000 2026-02-12T18:12:50.531 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:50.531 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.531 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:12:50.531 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:12:50.531 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:50.531 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:50.531 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:50.531 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:50.531 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:50.531 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:50.531 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:50.531 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:12:50.531 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:12:50.531 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.529+0000 7fa7afacc640 1 Processor -- start 2026-02-12T18:12:50.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.529+0000 7fa7afacc640 1 -- start start 2026-02-12T18:12:50.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.529+0000 7fa7afacc640 10 monclient: init 2026-02-12T18:12:50.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7afacc640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:50.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7afacc640 10 monclient: _add_conns ranks=[4,8,3,9,10,6,1,7,0,2,5] 2026-02-12T18:12:50.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7afacc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa7a8144600 0x7fa7a81449d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7afacc640 10 monclient(hunting): picked mon.noname-c con 0x7fa7a8144600 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:12:50.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7afacc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa7a8144210 0x7fa7a8089df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7afacc640 10 monclient(hunting): picked mon.noname-e con 0x7fa7a8144210 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:12:50.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7afacc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa7a8144f10 0x7fa7a808a330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7afacc640 10 monclient(hunting): picked mon.noname-g con 0x7fa7a8144f10 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:12:50.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7afacc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7afacc640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa7a8092be0 con 0x7fa7a8144f10 2026-02-12T18:12:50.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7afacc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7afacc640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fa7a808b230 con 0x7fa7a8144600 2026-02-12T18:12:50.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7afacc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7afacc640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fa7a8092370 con 0x7fa7a8144210 2026-02-12T18:12:50.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7afacc640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:50.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7afacc640 10 monclient(hunting): authenticate will time out at 1009.256244s 2026-02-12T18:12:50.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad040640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa7a8144210 0x7fa7a8089df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad841640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa7a8144600 0x7fa7a81449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad040640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa7a8144210 0x7fa7a8089df0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:57384/0 (socket says 10.20.193.48:57384) 2026-02-12T18:12:50.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad040640 1 -- 10.20.193.48:0/3546028048 learned_addr learned my addr 10.20.193.48:0/3546028048 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:50.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad040640 10 monclient(hunting): get_auth_request con 0x7fa7a8144210 auth_method 0 2026-02-12T18:12:50.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad040640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad040640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad040640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad841640 10 monclient(hunting): get_auth_request con 0x7fa7a8144600 auth_method 0 2026-02-12T18:12:50.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad841640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad841640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad841640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ae042640 1 --2- 10.20.193.48:0/3546028048 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa7a8144f10 0x7fa7a808a330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad040640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad040640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad040640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ae042640 10 monclient(hunting): get_auth_request con 0x7fa7a8144f10 auth_method 0 2026-02-12T18:12:50.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ae042640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ae042640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ae042640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad841640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad841640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad841640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad040640 10 monclient(hunting): handle_auth_done global_id 94202 payload 274 2026-02-12T18:12:50.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad040640 1 -- 10.20.193.48:0/3546028048 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa7a8144600 msgr2=0x7fa7a81449d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:50.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad040640 1 --2- 10.20.193.48:0/3546028048 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa7a8144600 0x7fa7a81449d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad040640 1 -- 10.20.193.48:0/3546028048 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa7a8144f10 msgr2=0x7fa7a808a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:50.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad040640 1 --2- 10.20.193.48:0/3546028048 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa7a8144f10 0x7fa7a808a330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad040640 10 monclient: _finish_hunting 0 2026-02-12T18:12:50.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad040640 1 monclient: found mon.noname-e 2026-02-12T18:12:50.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad040640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:50.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad040640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:12:50.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ad040640 1 -- 10.20.193.48:0/3546028048 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a8060390 con 0x7fa7a8144210 2026-02-12T18:12:50.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.530+0000 7fa7ae042640 1 --2- 10.20.193.48:0/3546028048 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa7a8144f10 0x7fa7a808a330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:12:50.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7ad040640 1 -- 10.20.193.48:0/3546028048 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa7a8144210 msgr2=0x7fa7a8089df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:50.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7ad040640 1 --2- 10.20.193.48:0/3546028048 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa7a8144210 0x7fa7a8089df0 secure :-1 s=READY pgs=24 gs=1 cs=0 l=1 c_cookie=13193022443285177474 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa79c0098d0 tx=0x7fa79c02eeb0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=b717080335c4e482 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7ac83f640 1 -- 10.20.193.48:0/3546028048 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa79c035340 con 0x7fa7a8144210 2026-02-12T18:12:50.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7ac83f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7ac83f640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:12:50.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7ac83f640 10 monclient: dump: 2026-02-12T18:12:50.539 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.539 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.539 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.539 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.539 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.539 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.539 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.539 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.539 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.539 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.539 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.539 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.540 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.540 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.540 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.540 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.540 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7ac83f640 10 monclient: _finish_auth 0 2026-02-12T18:12:50.540 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7ac83f640 10 monclient: _check_auth_tickets 2026-02-12T18:12:50.540 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7ac83f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:50.540 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7ac83f640 1 -- 10.20.193.48:0/3546028048 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa79c0354c0 con 0x7fa7a8144210 2026-02-12T18:12:50.540 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7ac83f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:50.540 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7ac83f640 1 -- 10.20.193.48:0/3546028048 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa79c035af0 con 0x7fa7a8144210 2026-02-12T18:12:50.540 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7ac83f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.540 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7ac83f640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:12:50.540 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7ac83f640 10 monclient: dump: 2026-02-12T18:12:50.540 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.540 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.540 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.540 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.540 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.540 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.540 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.540 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.540 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.540 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.540 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.540 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.541 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.541 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.541 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.541 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7afacc640 5 monclient: authenticate success, global_id 94202 2026-02-12T18:12:50.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7afacc640 10 monclient: get_monmap_and_config success 2026-02-12T18:12:50.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7afacc640 4 set_mon_vals no callback set 2026-02-12T18:12:50.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7afacc640 10 monclient: shutdown 2026-02-12T18:12:50.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7afacc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:50.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7afacc640 1 -- 10.20.193.48:0/3546028048 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa7a8144210 msgr2=0x7fa7a8089df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7afacc640 1 --2- 10.20.193.48:0/3546028048 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa7a8144210 0x7fa7a8089df0 secure :-1 s=READY pgs=24 gs=1 cs=0 l=1 c_cookie=13193022443285177474 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa79c0098d0 tx=0x7fa79c02eeb0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7afacc640 1 -- 10.20.193.48:0/3546028048 shutdown_connections 2026-02-12T18:12:50.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7afacc640 1 --2- 10.20.193.48:0/3546028048 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa7a8144f10 0x7fa7a808a330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7afacc640 1 --2- 10.20.193.48:0/3546028048 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa7a8144210 0x7fa7a8089df0 unknown :-1 s=CLOSED pgs=24 gs=1 cs=0 l=1 c_cookie=13193022443285177474 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7afacc640 1 --2- 10.20.193.48:0/3546028048 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa7a8144600 0x7fa7a81449d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7afacc640 1 -- 10.20.193.48:0/3546028048 >> 10.20.193.48:0/3546028048 conn(0x7fa7a80546d0 msgr2=0x7fa7a8054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:50.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7afacc640 1 -- 10.20.193.48:0/3546028048 shutdown_connections 2026-02-12T18:12:50.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.533+0000 7fa7afacc640 1 -- 10.20.193.48:0/3546028048 wait complete. 2026-02-12T18:12:50.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7afacc640 10 monclient: build_initial_monmap 2026-02-12T18:12:50.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7afacc640 10 monclient: monmap: 2026-02-12T18:12:50.541 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:50.541 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:12:50.541 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:12:50.542 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:12:50.542 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:50.542 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.542 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:12:50.542 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:12:50.542 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:50.542 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:50.542 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:50.542 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:50.542 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:50.542 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:50.542 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:50.542 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7afacc640 1 Processor -- start 2026-02-12T18:12:50.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7afacc640 1 -- start start 2026-02-12T18:12:50.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7afacc640 10 monclient: init 2026-02-12T18:12:50.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7afacc640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:50.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7afacc640 10 monclient: _add_conns ranks=[2,8,6,1,3,4,7,0,5] 2026-02-12T18:12:50.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7afacc640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa7a8144210 0x7fa7a8090e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7afacc640 10 monclient(hunting): picked mon.noname-b con 0x7fa7a8144210 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:12:50.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7afacc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa7a8144600 0x7fa7a810e6f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7afacc640 10 monclient(hunting): picked mon.noname-e con 0x7fa7a8144600 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:12:50.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7afacc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa7a8144f10 0x7fa7a8131450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7afacc640 10 monclient(hunting): picked mon.noname-d con 0x7fa7a8144f10 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:12:50.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7afacc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7afacc640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fa7a81106b0 con 0x7fa7a8144210 2026-02-12T18:12:50.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7afacc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7afacc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fa7a810e050 con 0x7fa7a8144f10 2026-02-12T18:12:50.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7afacc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:50.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7afacc640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fa7a80918e0 con 0x7fa7a8144600 2026-02-12T18:12:50.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7afacc640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:50.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7afacc640 10 monclient(hunting): authenticate will time out at 1009.260558s 2026-02-12T18:12:50.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad040640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa7a8144600 0x7fa7a810e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad040640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa7a8144600 0x7fa7a810e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:57388/0 (socket says 10.20.193.48:57388) 2026-02-12T18:12:50.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad040640 1 -- 10.20.193.48:0/3504649507 learned_addr learned my addr 10.20.193.48:0/3504649507 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:50.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad040640 10 monclient(hunting): get_auth_request con 0x7fa7a8144600 auth_method 0 2026-02-12T18:12:50.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad040640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad040640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad040640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad841640 1 --2- 10.20.193.48:0/3504649507 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa7a8144210 0x7fa7a8090e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad040640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad040640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ae042640 1 --2- 10.20.193.48:0/3504649507 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa7a8144f10 0x7fa7a8131450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad040640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad841640 10 monclient(hunting): get_auth_request con 0x7fa7a8144210 auth_method 0 2026-02-12T18:12:50.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad841640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad841640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad841640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ae042640 10 monclient(hunting): get_auth_request con 0x7fa7a8144f10 auth_method 0 2026-02-12T18:12:50.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ae042640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:50.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ae042640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:50.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ae042640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:50.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad841640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad841640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad841640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ae042640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:50.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ae042640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:50.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ae042640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:50.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad040640 10 monclient(hunting): handle_auth_done global_id 94211 payload 824 2026-02-12T18:12:50.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad040640 1 -- 10.20.193.48:0/3504649507 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa7a8144f10 msgr2=0x7fa7a8131450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad040640 1 --2- 10.20.193.48:0/3504649507 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa7a8144f10 0x7fa7a8131450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad040640 1 -- 10.20.193.48:0/3504649507 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa7a8144210 msgr2=0x7fa7a8090e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:50.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad040640 1 --2- 10.20.193.48:0/3504649507 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa7a8144210 0x7fa7a8090e50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:50.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad040640 10 monclient: _finish_hunting 0 2026-02-12T18:12:50.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad040640 1 monclient: found mon.noname-e 2026-02-12T18:12:50.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad040640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:50.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad040640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:12:50.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.534+0000 7fa7ad040640 1 -- 10.20.193.48:0/3504649507 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa79c0094f0 con 0x7fa7a8144600 2026-02-12T18:12:50.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7ad040640 1 -- 10.20.193.48:0/3504649507 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa7a8144600 msgr2=0x7fa7a810e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:50.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7ad040640 1 --2- 10.20.193.48:0/3504649507 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa7a8144600 0x7fa7a810e6f0 secure :-1 s=READY pgs=25 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa79c004740 tx=0x7fa79c0047e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:50.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7967fc640 1 -- 10.20.193.48:0/3504649507 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa79c0044f0 con 0x7fa7a8144600 2026-02-12T18:12:50.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7967fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7967fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:12:50.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7967fc640 10 monclient: dump: 2026-02-12T18:12:50.545 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.545 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.545 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.545 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.545 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.545 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.545 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.545 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.545 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.545 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.545 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.545 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.545 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.545 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.545 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.545 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7967fc640 10 monclient: _finish_auth 0 2026-02-12T18:12:50.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7967fc640 10 monclient: _check_auth_tickets 2026-02-12T18:12:50.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7967fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:50.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7967fc640 1 -- 10.20.193.48:0/3504649507 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa79c035dc0 con 0x7fa7a8144600 2026-02-12T18:12:50.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7afacc640 5 monclient: authenticate success, global_id 94211 2026-02-12T18:12:50.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7afacc640 10 monclient: _renew_subs 2026-02-12T18:12:50.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7afacc640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:12:50.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7afacc640 1 -- 10.20.193.48:0/3504649507 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7a80976e0 con 0x7fa7a8144600 2026-02-12T18:12:50.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7967fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:50.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7967fc640 1 -- 10.20.193.48:0/3504649507 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa79c003b90 con 0x7fa7a8144600 2026-02-12T18:12:50.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7967fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:50.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa797fff640 4 set_mon_vals no callback set 2026-02-12T18:12:50.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7967fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:12:50.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7967fc640 10 monclient: dump: 2026-02-12T18:12:50.546 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:50.546 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:50.546 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.546 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:50.546 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:50.546 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:50.546 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:50.546 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:50.546 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:50.546 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:50.546 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:50.546 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:50.546 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:50.546 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:50.546 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:50.546 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:50.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7afacc640 10 monclient: _renew_subs 2026-02-12T18:12:50.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7afacc640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:12:50.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7afacc640 1 -- 10.20.193.48:0/3504649507 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7a81103d0 con 0x7fa7a8144600 2026-02-12T18:12:50.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7afacc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:50.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7afacc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:50.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7afacc640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:12:50.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7afacc640 1 -- 10.20.193.48:0/3504649507 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7a80913e0 con 0x7fa7a8144600 2026-02-12T18:12:50.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7ad040640 1 --2- 10.20.193.48:0/3504649507 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa7a8144600 0x7fa7a810e6f0 secure :-1 s=READY pgs=25 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa79c004740 tx=0x7fa79c0047e0 comp rx=0 tx=0).queue_received will delay after 1.77092e+09 on 0x7fa79c04a070 mgrmap(e 5) 2026-02-12T18:12:50.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.537+0000 7fa7967fc640 1 -- 10.20.193.48:0/3504649507 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fa79c04a070 con 0x7fa7a8144600 2026-02-12T18:12:50.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.538+0000 7fa7967fc640 1 --2- 10.20.193.48:0/3504649507 >> v2:10.20.193.111:6812/977811348 conn(0x7fa77803f800 0x7fa77805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:50.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.538+0000 7fa7ad841640 1 --2- 10.20.193.48:0/3504649507 >> v2:10.20.193.111:6812/977811348 conn(0x7fa77803f800 0x7fa77805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:50.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.538+0000 7fa7ad841640 10 monclient: get_auth_request con 0x7fa77803f800 auth_method 0 2026-02-12T18:12:50.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.540+0000 7fa7967fc640 1 -- 10.20.193.48:0/3504649507 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(219..219 src has 190..219) ==== 3897+0+0 (secure 0 0 0) 0x7fa79c078450 con 0x7fa7a8144600 2026-02-12T18:12:50.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:50.540+0000 7fa7ad841640 1 --2- 10.20.193.48:0/3504649507 >> v2:10.20.193.111:6812/977811348 conn(0x7fa77803f800 0x7fa77805fcb0 secure :-1 s=READY pgs=333 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa798004740 tx=0x7fa798009210 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:51.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:51.366+0000 7fa7967fc640 1 -- 10.20.193.48:0/3504649507 <== mon.8 v2:10.20.193.48:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fa79c043450 con 0x7fa7a8144600 2026-02-12T18:12:51.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:51.366+0000 7fa7967fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:51.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:51.366+0000 7fa7967fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:12:51.438 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[30362]: starting. 2026-02-12T18:12:51.438 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[30362]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-30360 2026-02-12T18:12:51.439 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[30362]: shutting down. 2026-02-12T18:12:51.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:51.513+0000 7fa7afacc640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-12T18:12:51.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:51.513+0000 7fa7afacc640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-12T18:12:51.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:51.513+0000 7fa7afacc640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:12:51.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:51.513+0000 7fa7afacc640 1 -- 10.20.193.48:0/3504649507 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fa7a81433e0 con 0x7fa7a8144600 2026-02-12T18:12:51.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:51.515+0000 7fa7967fc640 1 -- 10.20.193.48:0/3504649507 <== mon.8 v2:10.20.193.48:3304/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fa79c03c070 con 0x7fa7a8144600 2026-02-12T18:12:51.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:51.515+0000 7fa7967fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-12T18:12:51.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:51.515+0000 7fa7967fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:12:51.521 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.515+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.522 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.515+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=11,kv=11,logm=61} crc {auth=897640142,config=1618278320,health=3121840240,kv=2857826951,logm=2680521207}) 2026-02-12T18:12:51.522 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.515+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=16,config=2,health=12,kv=10,logm=60} crc {auth=4183268498,config=1618278320,health=654214909,kv=1775932005,logm=100787872}) 2026-02-12T18:12:51.522 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.515+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.522 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.515+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=11,kv=11,logm=61} crc {auth=897640142,config=1618278320,health=3121840240,kv=2857826951,logm=2680521207}) 2026-02-12T18:12:51.522 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.515+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=16,health=13,kv=12,logm=59} crc {auth=4183268498,health=1869875948,kv=2857826951,logm=2835989343}) 2026-02-12T18:12:51.522 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.515+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.522 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.515+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=11,kv=11,logm=61} crc {auth=897640142,config=1618278320,health=3121840240,kv=2857826951,logm=2680521207}) 2026-02-12T18:12:51.522 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.515+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=14,config=2,health=11,kv=11,logm=62} crc {auth=1862955250,config=1618278320,health=3637466452,kv=381788265,logm=2982855266}) 2026-02-12T18:12:51.522 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.515+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.522 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.515+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=11,kv=11,logm=61} crc {auth=897640142,config=1618278320,health=3121840240,kv=2857826951,logm=2680521207}) 2026-02-12T18:12:51.523 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.515+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=14,config=2,health=12,kv=12,logm=60} crc {auth=1326915342,config=1618278320,health=3423964923,kv=4234028933,logm=3398125405}) 2026-02-12T18:12:51.523 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.515+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.523 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.515+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=11,kv=11,logm=61} crc {auth=897640142,config=1618278320,health=3121840240,kv=2857826951,logm=2680521207}) 2026-02-12T18:12:51.523 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.515+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=16,config=2,health=11,kv=10,logm=61} crc {auth=4183268498,config=1618278320,health=3160574007,kv=679045386,logm=1987492912}) 2026-02-12T18:12:51.523 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.515+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.523 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.515+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=11,kv=11,logm=61} crc {auth=897640142,config=1618278320,health=3121840240,kv=2857826951,logm=2680521207}) 2026-02-12T18:12:51.523 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.515+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=16,config=2,health=12,kv=12,logm=58} crc {auth=4183268498,config=1618278320,health=3331030292,kv=2857826951,logm=3543937318}) 2026-02-12T18:12:51.523 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.515+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.523 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.515+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=11,kv=11,logm=61} crc {auth=897640142,config=1618278320,health=3121840240,kv=2857826951,logm=2680521207}) 2026-02-12T18:12:51.523 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.515+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=16,config=2,health=13,kv=11,logm=58} crc {auth=4183268498,config=1618278320,health=1869875948,kv=1775932005,logm=1992738301}) 2026-02-12T18:12:51.523 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.515+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.523 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.515+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=15,config=2,health=11,kv=11,logm=61} crc {auth=897640142,config=1618278320,health=3121840240,kv=2857826951,logm=2680521207}) 2026-02-12T18:12:51.524 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.515+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=15,config=2,health=13,kv=11,logm=59} crc {auth=897640142,config=1618278320,health=1869875948,kv=1024714632,logm=2263787173}) 2026-02-12T18:12:51.524 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.516+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.524 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.516+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2132881391}) 2026-02-12T18:12:51.524 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.516+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=135138857}) 2026-02-12T18:12:51.524 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.516+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.524 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.516+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2132881391}) 2026-02-12T18:12:51.524 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.516+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1918279268}) 2026-02-12T18:12:51.524 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.516+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.524 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.516+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2132881391}) 2026-02-12T18:12:51.524 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.516+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4144895951}) 2026-02-12T18:12:51.524 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.516+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.524 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.516+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2132881391}) 2026-02-12T18:12:51.524 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.516+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=19522735}) 2026-02-12T18:12:51.525 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.516+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.525 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.516+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2132881391}) 2026-02-12T18:12:51.525 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.516+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=605746532}) 2026-02-12T18:12:51.525 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.516+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.525 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.516+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2132881391}) 2026-02-12T18:12:51.525 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.516+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3685547405}) 2026-02-12T18:12:51.525 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.516+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.525 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.516+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2132881391}) 2026-02-12T18:12:51.525 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.516+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1975863437}) 2026-02-12T18:12:51.525 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.516+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.526 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.516+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2132881391}) 2026-02-12T18:12:51.526 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.516+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3348869920}) 2026-02-12T18:12:51.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:51.517+0000 7fa7afacc640 1 -- 10.20.193.48:0/3504649507 >> v2:10.20.193.111:6812/977811348 conn(0x7fa77803f800 msgr2=0x7fa77805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:51.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:51.517+0000 7fa7afacc640 1 --2- 10.20.193.48:0/3504649507 >> v2:10.20.193.111:6812/977811348 conn(0x7fa77803f800 0x7fa77805fcb0 secure :-1 s=READY pgs=333 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa798004740 tx=0x7fa798009210 comp rx=0 tx=0).stop 2026-02-12T18:12:51.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:51.517+0000 7fa7afacc640 10 monclient: shutdown 2026-02-12T18:12:51.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:51.517+0000 7fa7afacc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:51.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:51.517+0000 7fa7afacc640 1 -- 10.20.193.48:0/3504649507 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa7a8144600 msgr2=0x7fa7a810e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:51.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:51.517+0000 7fa7afacc640 1 --2- 10.20.193.48:0/3504649507 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa7a8144600 0x7fa7a810e6f0 secure :-1 s=READY pgs=25 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa79c004740 tx=0x7fa79c0047e0 comp rx=0 tx=0).stop 2026-02-12T18:12:51.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:51.517+0000 7fa7afacc640 1 -- 10.20.193.48:0/3504649507 shutdown_connections 2026-02-12T18:12:51.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:51.517+0000 7fa7afacc640 1 --2- 10.20.193.48:0/3504649507 >> v2:10.20.193.111:6812/977811348 conn(0x7fa77803f800 0x7fa77805fcb0 unknown :-1 s=CLOSED pgs=333 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:51.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:51.517+0000 7fa7afacc640 1 --2- 10.20.193.48:0/3504649507 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa7a8144f10 0x7fa7a8131450 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:51.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:51.517+0000 7fa7afacc640 1 --2- 10.20.193.48:0/3504649507 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa7a8144600 0x7fa7a810e6f0 unknown :-1 s=CLOSED pgs=25 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:51.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:51.517+0000 7fa7afacc640 1 --2- 10.20.193.48:0/3504649507 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa7a8144210 0x7fa7a8090e50 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:51.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:51.517+0000 7fa7afacc640 1 -- 10.20.193.48:0/3504649507 >> 10.20.193.48:0/3504649507 conn(0x7fa7a80546d0 msgr2=0x7fa7a8124e40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:51.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:51.517+0000 7fa7afacc640 1 -- 10.20.193.48:0/3504649507 shutdown_connections 2026-02-12T18:12:51.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:51.517+0000 7fa7afacc640 1 -- 10.20.193.48:0/3504649507 wait complete. 2026-02-12T18:12:51.543 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.517+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.544 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.517+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4117189747}) 2026-02-12T18:12:51.544 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.517+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3734440309}) 2026-02-12T18:12:51.544 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.517+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.544 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.517+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4117189747}) 2026-02-12T18:12:51.544 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.517+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=836316280}) 2026-02-12T18:12:51.544 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.517+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.544 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.517+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4117189747}) 2026-02-12T18:12:51.544 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.517+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4263418992}) 2026-02-12T18:12:51.544 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.517+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.545 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.517+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4117189747}) 2026-02-12T18:12:51.545 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.517+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4149694536}) 2026-02-12T18:12:51.545 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.517+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.545 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.517+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4117189747}) 2026-02-12T18:12:51.545 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.517+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1629770142}) 2026-02-12T18:12:51.545 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.517+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.545 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.517+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4117189747}) 2026-02-12T18:12:51.545 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.518+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=893793276}) 2026-02-12T18:12:51.545 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.518+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.545 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.518+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4117189747}) 2026-02-12T18:12:51.545 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.518+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4142217202}) 2026-02-12T18:12:51.545 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.518+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.546 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.518+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4117189747}) 2026-02-12T18:12:51.546 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.518+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2278636638}) 2026-02-12T18:12:51.546 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.518+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.546 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.518+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2463769440}) 2026-02-12T18:12:51.546 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.518+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1979266654}) 2026-02-12T18:12:51.546 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.518+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.546 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.518+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2463769440}) 2026-02-12T18:12:51.546 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.518+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=341554689}) 2026-02-12T18:12:51.546 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.518+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.546 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.518+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2463769440}) 2026-02-12T18:12:51.546 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.518+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3984908836}) 2026-02-12T18:12:51.546 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.518+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.546 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.519+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2463769440}) 2026-02-12T18:12:51.546 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.519+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3283292802}) 2026-02-12T18:12:51.547 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.519+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.547 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.519+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2463769440}) 2026-02-12T18:12:51.547 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.519+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1622861835}) 2026-02-12T18:12:51.547 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.519+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.547 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.519+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2463769440}) 2026-02-12T18:12:51.547 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.519+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1187745481}) 2026-02-12T18:12:51.547 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.519+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.547 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.519+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2463769440}) 2026-02-12T18:12:51.547 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.519+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3081422898}) 2026-02-12T18:12:51.547 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.519+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.547 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.519+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2463769440}) 2026-02-12T18:12:51.547 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.519+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1710144963}) 2026-02-12T18:12:51.547 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.519+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.547 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.519+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=628403348}) 2026-02-12T18:12:51.548 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.519+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3340429851}) 2026-02-12T18:12:51.548 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.519+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.548 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.519+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=628403348}) 2026-02-12T18:12:51.548 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.519+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3341307811}) 2026-02-12T18:12:51.548 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.519+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.548 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.519+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=628403348}) 2026-02-12T18:12:51.548 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.519+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1197966405}) 2026-02-12T18:12:51.548 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.519+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.548 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.519+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=628403348}) 2026-02-12T18:12:51.548 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.519+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3218508261}) 2026-02-12T18:12:51.548 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.520+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.548 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.520+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=628403348}) 2026-02-12T18:12:51.548 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.520+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2239771311}) 2026-02-12T18:12:51.548 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.520+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.548 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.520+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=628403348}) 2026-02-12T18:12:51.549 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.520+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2078767443}) 2026-02-12T18:12:51.549 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.520+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.549 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.520+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=628403348}) 2026-02-12T18:12:51.549 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.520+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1352972754}) 2026-02-12T18:12:51.549 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.520+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.549 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.520+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=628403348}) 2026-02-12T18:12:51.549 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.520+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1089897111}) 2026-02-12T18:12:51.549 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.520+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.549 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.520+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2429630346}) 2026-02-12T18:12:51.549 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.520+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=494373768}) 2026-02-12T18:12:51.549 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.521+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.549 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.521+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2429630346}) 2026-02-12T18:12:51.549 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.521+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3227054103}) 2026-02-12T18:12:51.550 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.521+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.550 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.521+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2429630346}) 2026-02-12T18:12:51.550 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.521+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=975865282}) 2026-02-12T18:12:51.550 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.521+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.550 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.521+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2429630346}) 2026-02-12T18:12:51.550 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.521+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4190057578}) 2026-02-12T18:12:51.550 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.521+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.550 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.521+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2429630346}) 2026-02-12T18:12:51.550 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.521+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=895983599}) 2026-02-12T18:12:51.550 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.521+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.550 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.521+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2429630346}) 2026-02-12T18:12:51.550 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.521+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1492320876}) 2026-02-12T18:12:51.550 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.521+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.550 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.521+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2429630346}) 2026-02-12T18:12:51.550 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.521+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=113242260}) 2026-02-12T18:12:51.551 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.521+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.551 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.521+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2429630346}) 2026-02-12T18:12:51.551 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.521+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=780175138}) 2026-02-12T18:12:51.551 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.522+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.551 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.522+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3238011775}) 2026-02-12T18:12:51.551 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.522+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1187029038}) 2026-02-12T18:12:51.551 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.522+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.551 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.522+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3238011775}) 2026-02-12T18:12:51.551 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.522+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1690764115}) 2026-02-12T18:12:51.551 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.522+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.551 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.522+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3238011775}) 2026-02-12T18:12:51.551 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.522+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3675050741}) 2026-02-12T18:12:51.551 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.522+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.551 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.522+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3238011775}) 2026-02-12T18:12:51.551 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.522+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=460409426}) 2026-02-12T18:12:51.551 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.522+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.552 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.522+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3238011775}) 2026-02-12T18:12:51.552 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.522+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1954936783}) 2026-02-12T18:12:51.552 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.522+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.552 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.522+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3238011775}) 2026-02-12T18:12:51.552 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.522+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2617752545}) 2026-02-12T18:12:51.552 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.522+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.552 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.522+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3238011775}) 2026-02-12T18:12:51.552 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.522+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3801606597}) 2026-02-12T18:12:51.552 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.522+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.552 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.522+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3238011775}) 2026-02-12T18:12:51.552 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.522+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3367540443}) 2026-02-12T18:12:51.552 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.523+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.552 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.523+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=705404830}) 2026-02-12T18:12:51.552 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.523+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3002766118}) 2026-02-12T18:12:51.552 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.523+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.552 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.523+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=705404830}) 2026-02-12T18:12:51.552 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.523+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4222784591}) 2026-02-12T18:12:51.552 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.523+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.553 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.523+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=705404830}) 2026-02-12T18:12:51.553 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.523+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4203271281}) 2026-02-12T18:12:51.553 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.523+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.553 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.523+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=705404830}) 2026-02-12T18:12:51.553 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.523+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2757328579}) 2026-02-12T18:12:51.553 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.523+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.553 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.523+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=705404830}) 2026-02-12T18:12:51.553 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.523+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2231023309}) 2026-02-12T18:12:51.553 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.523+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.553 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.523+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=705404830}) 2026-02-12T18:12:51.553 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.523+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3520110738}) 2026-02-12T18:12:51.553 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.523+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.553 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.523+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=705404830}) 2026-02-12T18:12:51.553 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.523+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3053314619}) 2026-02-12T18:12:51.553 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.523+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.553 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.523+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=705404830}) 2026-02-12T18:12:51.553 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.523+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=592360757}) 2026-02-12T18:12:51.554 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.524+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.554 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.524+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1400653687}) 2026-02-12T18:12:51.554 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.524+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1697688456}) 2026-02-12T18:12:51.554 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.524+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.554 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.524+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1400653687}) 2026-02-12T18:12:51.554 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.524+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1110713920}) 2026-02-12T18:12:51.554 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.524+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.554 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.524+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1400653687}) 2026-02-12T18:12:51.554 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.524+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=991426599}) 2026-02-12T18:12:51.554 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.524+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.554 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.524+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1400653687}) 2026-02-12T18:12:51.554 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.524+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=37136614}) 2026-02-12T18:12:51.554 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.524+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.554 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.524+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1400653687}) 2026-02-12T18:12:51.554 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.524+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4170607927}) 2026-02-12T18:12:51.554 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.524+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.554 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.524+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1400653687}) 2026-02-12T18:12:51.554 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.524+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2355729069}) 2026-02-12T18:12:51.555 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.524+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.555 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.524+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1400653687}) 2026-02-12T18:12:51.555 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.524+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2413900045}) 2026-02-12T18:12:51.555 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.524+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.555 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.524+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1400653687}) 2026-02-12T18:12:51.555 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.524+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=779183906}) 2026-02-12T18:12:51.556 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-12T18:12:51.574 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.531+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.574 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.531+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2538781493}) 2026-02-12T18:12:51.574 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.531+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4250793380}) 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.531+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.531+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2538781493}) 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.531+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2314252120}) 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.531+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.531+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2538781493}) 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.531+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3081223720}) 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.531+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.531+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2538781493}) 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.531+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2547179305}) 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.531+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.531+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2538781493}) 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.531+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=582674863}) 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.531+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.531+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2538781493}) 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.531+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2921822466}) 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2538781493}) 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2424674475}) 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2538781493}) 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1824276704}) 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=975973543}) 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4197475055}) 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=975973543}) 2026-02-12T18:12:51.575 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3453510391}) 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=975973543}) 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=644455384}) 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=975973543}) 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2030505572}) 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=975973543}) 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1481805108}) 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=975973543}) 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1605834953}) 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=975973543}) 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3631390047}) 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=975973543}) 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.532+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3166448104}) 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.533+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.533+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1622184760}) 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.533+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3082082762}) 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.533+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.533+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1622184760}) 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.533+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1454302575}) 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.533+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.533+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1622184760}) 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.533+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2299057589}) 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.533+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.533+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1622184760}) 2026-02-12T18:12:51.576 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.533+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1235257556}) 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.533+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.533+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1622184760}) 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.533+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1188032133}) 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.533+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.533+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1622184760}) 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.533+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1522515017}) 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.533+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.533+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1622184760}) 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.533+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1367331730}) 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.533+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.533+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1622184760}) 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.533+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1691937448}) 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.534+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.534+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=20918273}) 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.534+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2180212502}) 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.534+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.534+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=20918273}) 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.534+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=432064772}) 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.534+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.534+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=20918273}) 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.534+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2024323080}) 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.534+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.534+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=20918273}) 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.534+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2064981186}) 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.534+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.534+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=20918273}) 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.534+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1950194966}) 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.534+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.577 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.534+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=20918273}) 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.534+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3991385562}) 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.534+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.534+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=20918273}) 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.534+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3189193531}) 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.534+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.534+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=20918273}) 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.534+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1948643125}) 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.535+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.535+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2106985478}) 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.535+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3738415413}) 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.535+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.535+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2106985478}) 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.535+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=871946863}) 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.535+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.535+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2106985478}) 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.535+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=827717316}) 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.535+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.535+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2106985478}) 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.535+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4085884614}) 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.535+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.535+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2106985478}) 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.535+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3475875630}) 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.535+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.535+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2106985478}) 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.535+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=944553623}) 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.535+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.535+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2106985478}) 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.535+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2001057515}) 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.535+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.535+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2106985478}) 2026-02-12T18:12:51.578 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.535+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4123728325}) 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.536+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.536+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1612048921}) 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.536+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2534966072}) 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.536+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.536+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1612048921}) 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.536+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=524158955}) 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.536+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.536+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1612048921}) 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.536+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2931589271}) 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.536+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.536+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1612048921}) 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.536+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=68819191}) 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.536+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.536+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1612048921}) 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.536+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=661848472}) 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.536+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.536+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1612048921}) 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.536+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1547959256}) 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.536+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.536+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1612048921}) 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.536+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1234833996}) 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.536+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.536+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1612048921}) 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.536+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1888008648}) 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.537+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.537+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4070230077}) 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.537+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4015345215}) 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.537+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.537+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4070230077}) 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.537+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1753570502}) 2026-02-12T18:12:51.579 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.537+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.537+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4070230077}) 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.537+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3525171162}) 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.537+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.537+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4070230077}) 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.537+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3102557290}) 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.537+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.537+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4070230077}) 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.537+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1727211098}) 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.537+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.537+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4070230077}) 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.537+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3321070168}) 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.537+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.537+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4070230077}) 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.537+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=997284992}) 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.537+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.537+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4070230077}) 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.537+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=434234401}) 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.538+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.538+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1094323794}) 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.538+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4015806080}) 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.538+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.538+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1094323794}) 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.538+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3613760241}) 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.538+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.538+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1094323794}) 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.538+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2916336253}) 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.538+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.538+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1094323794}) 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.538+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=257876036}) 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.538+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.538+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1094323794}) 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.538+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1234182818}) 2026-02-12T18:12:51.580 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.538+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.538+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1094323794}) 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.538+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=401539045}) 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.538+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.538+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1094323794}) 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.538+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3774590099}) 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.538+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.538+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1094323794}) 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.538+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=542994868}) 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3571949494}) 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3892261286}) 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3571949494}) 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2386919475}) 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3571949494}) 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2898269665}) 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3571949494}) 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1710374985}) 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3571949494}) 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1013327102}) 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3571949494}) 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4245719961}) 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3571949494}) 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=876835260}) 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3571949494}) 2026-02-12T18:12:51.581 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=207826042}) 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3747906083}) 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3194890792}) 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3747906083}) 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2700839406}) 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.539+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3747906083}) 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1330219668}) 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3747906083}) 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=776611005}) 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3747906083}) 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3548818751}) 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3747906083}) 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3256031972}) 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3747906083}) 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3532113709}) 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3747906083}) 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3102199935}) 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1592106794}) 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1298456679}) 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1592106794}) 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2649441295}) 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1592106794}) 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3160042461}) 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.582 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1592106794}) 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=433643608}) 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1592106794}) 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=365423365}) 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.540+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1592106794}) 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3507216736}) 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1592106794}) 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3038736823}) 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1592106794}) 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2186644652}) 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3247385103}) 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=980981792}) 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3247385103}) 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1745999682}) 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3247385103}) 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4102117269}) 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3247385103}) 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3303019434}) 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3247385103}) 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=977916520}) 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3247385103}) 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1087603951}) 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3247385103}) 2026-02-12T18:12:51.583 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2571045418}) 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.541+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.542+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3247385103}) 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.542+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=503034577}) 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.542+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.542+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1087015320}) 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.542+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3807269105}) 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.542+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.542+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1087015320}) 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.542+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=37324053}) 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.542+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.542+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1087015320}) 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.542+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=243568547}) 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.542+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.542+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1087015320}) 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.542+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1285850613}) 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.542+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.542+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1087015320}) 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.542+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3894736324}) 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.542+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.542+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1087015320}) 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.542+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=935264412}) 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.542+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.542+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1087015320}) 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1090920906}) 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1087015320}) 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1673877505}) 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4176745284}) 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1975726765}) 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4176745284}) 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1937965001}) 2026-02-12T18:12:51.584 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4176745284}) 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2371078525}) 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4176745284}) 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3311586920}) 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4176745284}) 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=394206117}) 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4176745284}) 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=50199753}) 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4176745284}) 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3897973021}) 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4176745284}) 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.543+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=380122151}) 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.544+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.544+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=642338469}) 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.544+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2303500134}) 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.544+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.544+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=642338469}) 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.544+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2739288243}) 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.544+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.544+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=642338469}) 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.544+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1106564879}) 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.544+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.544+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=642338469}) 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.544+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=128713960}) 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.544+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.544+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=642338469}) 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.544+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2303500134}) 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.544+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.544+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=642338469}) 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.544+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1292392573}) 2026-02-12T18:12:51.585 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.544+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.544+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=642338469}) 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.544+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4161783327}) 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.544+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.544+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=642338469}) 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.544+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2901944834}) 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.545+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.545+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3572027101}) 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.545+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1613790429}) 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.545+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.545+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3572027101}) 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.545+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=520653334}) 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.545+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.545+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3572027101}) 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.545+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3044890369}) 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.545+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.545+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3572027101}) 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.545+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3791734913}) 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.545+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.545+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3572027101}) 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.545+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1613790429}) 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.545+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.545+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3572027101}) 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.545+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2578799514}) 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.545+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.545+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3572027101}) 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.545+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4280716807}) 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.545+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.545+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3572027101}) 2026-02-12T18:12:51.586 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.545+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3578773663}) 2026-02-12T18:12:51.821 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.816+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.821 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.816+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1769052847}) 2026-02-12T18:12:51.821 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.816+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2958701449}) 2026-02-12T18:12:51.821 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.816+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.822 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.816+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1769052847}) 2026-02-12T18:12:51.822 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.816+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4073856783}) 2026-02-12T18:12:51.822 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.816+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.822 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.816+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1769052847}) 2026-02-12T18:12:51.822 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.816+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3588957517}) 2026-02-12T18:12:51.822 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.816+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.822 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.816+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1769052847}) 2026-02-12T18:12:51.822 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.816+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2120095416}) 2026-02-12T18:12:51.822 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.816+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.822 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.816+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1769052847}) 2026-02-12T18:12:51.822 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.816+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2958701449}) 2026-02-12T18:12:51.823 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.816+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.823 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.816+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1769052847}) 2026-02-12T18:12:51.823 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.816+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3621619135}) 2026-02-12T18:12:51.823 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.816+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.823 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.816+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1769052847}) 2026-02-12T18:12:51.823 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.816+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1602348072}) 2026-02-12T18:12:51.823 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.816+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.823 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.816+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1769052847}) 2026-02-12T18:12:51.823 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.816+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=471218143}) 2026-02-12T18:12:51.823 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.817+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.823 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.817+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=24,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=29} crc {logm=3746294034,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=381084586,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3140514009,osd_metadata=1232835945,osd_pg_creating=1298178034,osd_snap=841190635,osdmap=2925270374}) 2026-02-12T18:12:51.823 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.817+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=26,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=8,monmap=3,nvmeofgw=2,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=32} crc {logm=3819370241,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=3905161260,mon_config_key=1654720334,monmap=2848783498,nvmeofgw=935146538,osd_metadata=1742003354,osd_pg_creating=1298178034,osd_snap=841190635,osdmap=4109817006}) 2026-02-12T18:12:51.824 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.817+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.824 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.817+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=24,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=29} crc {logm=3746294034,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=381084586,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3140514009,osd_metadata=1232835945,osd_pg_creating=1298178034,osd_snap=841190635,osdmap=2925270374}) 2026-02-12T18:12:51.824 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.817+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=27,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=2,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=29} crc {logm=2774018625,mdsmap=3465989318,mgr=285587493,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=381084586,mon_config_key=2610204668,monmap=3865314839,nvmeofgw=3140514009,osd_metadata=1232835945,osd_pg_creating=1298178034,osd_snap=841190635,osdmap=1272874860}) 2026-02-12T18:12:51.824 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.817+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.824 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.817+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=24,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=29} crc {logm=3746294034,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=381084586,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3140514009,osd_metadata=1232835945,osd_pg_creating=1298178034,osd_snap=841190635,osdmap=2925270374}) 2026-02-12T18:12:51.824 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.817+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=27,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=2,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=30} crc {logm=665239087,mdsmap=968626843,mgr=2585383004,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=498800076,mon_config_key=2610204668,monmap=3865314839,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=1298178034,osd_snap=3058936622,osdmap=3422286055}) 2026-02-12T18:12:51.824 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.817+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.824 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.817+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=24,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=29} crc {logm=3746294034,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=381084586,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3140514009,osd_metadata=1232835945,osd_pg_creating=1298178034,osd_snap=841190635,osdmap=2925270374}) 2026-02-12T18:12:51.824 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.817+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=26,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,nvmeofgw=2,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=28} crc {logm=4133074585,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=381084586,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3140514009,osd_metadata=1679651515,osd_pg_creating=1298178034,osd_snap=841190635,osdmap=3963752664}) 2026-02-12T18:12:51.824 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.817+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.824 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.817+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=24,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=29} crc {logm=3746294034,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=381084586,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3140514009,osd_metadata=1232835945,osd_pg_creating=1298178034,osd_snap=841190635,osdmap=2925270374}) 2026-02-12T18:12:51.824 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.817+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=26,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=8,monmap=3,nvmeofgw=2,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=32} crc {logm=3819370241,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=3905161260,mon_config_key=1654720334,monmap=2848783498,nvmeofgw=935146538,osd_metadata=1742003354,osd_pg_creating=1298178034,osd_snap=841190635,osdmap=4109817006}) 2026-02-12T18:12:51.825 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.817+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.825 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.817+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=24,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=29} crc {logm=3746294034,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=381084586,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3140514009,osd_metadata=1232835945,osd_pg_creating=1298178034,osd_snap=841190635,osdmap=2925270374}) 2026-02-12T18:12:51.825 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.817+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=26,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=27} crc {logm=4021153331,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=381084586,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=2227164093,osd_pg_creating=1298178034,osd_snap=841190635,osdmap=1692422069}) 2026-02-12T18:12:51.825 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.817+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.825 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.817+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=24,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=29} crc {logm=3746294034,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=381084586,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3140514009,osd_metadata=1232835945,osd_pg_creating=1298178034,osd_snap=841190635,osdmap=2925270374}) 2026-02-12T18:12:51.825 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.817+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=26,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=28} crc {logm=1346766884,mdsmap=3465989318,mgr=3779528008,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=696218346,mon_config_key=1580463513,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=2227164093,osd_pg_creating=1298178034,osd_snap=841190635,osdmap=1830939069}) 2026-02-12T18:12:51.825 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.817+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.825 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.817+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=24,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=29} crc {logm=3746294034,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=381084586,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3140514009,osd_metadata=1232835945,osd_pg_creating=1298178034,osd_snap=841190635,osdmap=2925270374}) 2026-02-12T18:12:51.825 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.817+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=27,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=9,monmap=2,nvmeofgw=3,osd_metadata=6,osd_snap=2,osdmap=29} crc {logm=2774018625,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=498800076,mon_config_key=48446373,monmap=3865314839,nvmeofgw=3360707892,osd_metadata=1232835945,osd_snap=841190635,osdmap=2554644812}) 2026-02-12T18:12:51.878 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.874+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.878 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.874+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=34} crc {osdmap=2353221051}) 2026-02-12T18:12:51.878 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.874+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=32} crc {osdmap=3397790405}) 2026-02-12T18:12:51.878 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.875+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.878 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.875+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=34} crc {osdmap=2353221051}) 2026-02-12T18:12:51.878 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.875+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=34} crc {osdmap=2954804244}) 2026-02-12T18:12:51.878 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.875+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.879 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.875+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=34} crc {osdmap=2353221051}) 2026-02-12T18:12:51.879 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.875+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=34} crc {osdmap=1874414580}) 2026-02-12T18:12:51.879 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.875+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.879 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.875+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=34} crc {osdmap=2353221051}) 2026-02-12T18:12:51.879 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.875+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=34} crc {osdmap=4216514400}) 2026-02-12T18:12:51.879 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.875+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.879 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.875+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=34} crc {osdmap=2353221051}) 2026-02-12T18:12:51.879 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.875+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=32} crc {osdmap=3397790405}) 2026-02-12T18:12:51.879 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.875+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.879 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.875+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=34} crc {osdmap=2353221051}) 2026-02-12T18:12:51.879 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.875+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=33} crc {osdmap=400543237}) 2026-02-12T18:12:51.879 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.875+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.880 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.875+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=34} crc {osdmap=2353221051}) 2026-02-12T18:12:51.880 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.875+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=34} crc {osdmap=3101173116}) 2026-02-12T18:12:51.880 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.875+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:12:51.880 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.875+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=34} crc {osdmap=2353221051}) 2026-02-12T18:12:51.880 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:12:51.875+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=34} crc {osdmap=1229974032}) 2026-02-12T18:12:52.557 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2026-02-12T18:12:52.557 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T18:12:52.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.621+0000 7f5f254c3640 10 monclient: get_monmap_and_config 2026-02-12T18:12:52.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.621+0000 7f5f254c3640 10 monclient: build_initial_monmap 2026-02-12T18:12:52.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.621+0000 7f5f254c3640 10 monclient: monmap: 2026-02-12T18:12:52.626 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:52.626 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:52.627 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:12:52.623029+0000 2026-02-12T18:12:52.627 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:12:52.623029+0000 2026-02-12T18:12:52.627 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:52.627 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:52.627 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:12:52.627 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:12:52.627 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:52.627 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:52.627 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:52.627 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:52.627 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:52.627 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:52.628 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:52.628 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:12:52.628 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:12:52.628 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:52.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f254c3640 1 Processor -- start 2026-02-12T18:12:52.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f254c3640 1 -- start start 2026-02-12T18:12:52.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f254c3640 10 monclient: init 2026-02-12T18:12:52.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f254c3640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:52.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f254c3640 10 monclient: _add_conns ranks=[6,7,10,4,1,3,5,8,9,0,2] 2026-02-12T18:12:52.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f254c3640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5f2005dc20 0x7f5f20144660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:52.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f254c3640 10 monclient(hunting): picked mon.noname-d con 0x7f5f2005dc20 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:12:52.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f254c3640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5f2005dff0 0x7f5f2005e3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:52.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f254c3640 10 monclient(hunting): picked mon.noname-i con 0x7f5f2005dff0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:12:52.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f254c3640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f5f20089df0 0x7f5f2008a240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:52.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f254c3640 10 monclient(hunting): picked mon.noname-f con 0x7f5f20089df0 addr v2:10.20.193.111:3300/0 2026-02-12T18:12:52.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f254c3640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:52.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f254c3640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f5f2008b0d0 con 0x7f5f20089df0 2026-02-12T18:12:52.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f254c3640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:52.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f254c3640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f5f20093a30 con 0x7f5f2005dc20 2026-02-12T18:12:52.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f254c3640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:52.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f254c3640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f5f20092200 con 0x7f5f2005dff0 2026-02-12T18:12:52.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f254c3640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:52.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f254c3640 10 monclient(hunting): authenticate will time out at 1011.348759s 2026-02-12T18:12:52.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f1effd640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5f2005dc20 0x7f5f20144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:52.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f1effd640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5f2005dc20 0x7f5f20144660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:59442/0 (socket says 10.20.193.48:59442) 2026-02-12T18:12:52.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f1effd640 1 -- 10.20.193.48:0/1040646279 learned_addr learned my addr 10.20.193.48:0/1040646279 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:52.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f1effd640 10 monclient(hunting): get_auth_request con 0x7f5f2005dc20 auth_method 0 2026-02-12T18:12:52.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f1effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:52.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f1effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:52.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f1effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:52.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f1effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:52.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f1effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:52.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f1effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:52.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f1e7fc640 1 --2- 10.20.193.48:0/1040646279 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5f2005dff0 0x7f5f2005e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:52.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f1f7fe640 1 --2- 10.20.193.48:0/1040646279 >> v2:10.20.193.111:3300/0 conn(0x7f5f20089df0 0x7f5f2008a240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:52.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f1e7fc640 10 monclient(hunting): get_auth_request con 0x7f5f2005dff0 auth_method 0 2026-02-12T18:12:52.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f1e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:52.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f1e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:52.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.622+0000 7f5f1e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:52.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.623+0000 7f5f1f7fe640 10 monclient(hunting): get_auth_request con 0x7f5f20089df0 auth_method 0 2026-02-12T18:12:52.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.623+0000 7f5f1f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:52.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.623+0000 7f5f1f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:52.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.623+0000 7f5f1f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:52.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.623+0000 7f5f1effd640 10 monclient(hunting): handle_auth_done global_id 5838 payload 274 2026-02-12T18:12:52.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.623+0000 7f5f1effd640 1 -- 10.20.193.48:0/1040646279 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5f2005dff0 msgr2=0x7f5f2005e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:52.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.623+0000 7f5f1effd640 1 --2- 10.20.193.48:0/1040646279 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5f2005dff0 0x7f5f2005e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:52.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.623+0000 7f5f1effd640 1 -- 10.20.193.48:0/1040646279 >> v2:10.20.193.111:3300/0 conn(0x7f5f20089df0 msgr2=0x7f5f2008a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:52.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.623+0000 7f5f1effd640 1 --2- 10.20.193.48:0/1040646279 >> v2:10.20.193.111:3300/0 conn(0x7f5f20089df0 0x7f5f2008a240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:52.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.623+0000 7f5f1effd640 10 monclient: _finish_hunting 0 2026-02-12T18:12:52.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.623+0000 7f5f1effd640 1 monclient: found mon.noname-d 2026-02-12T18:12:52.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.623+0000 7f5f1effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:52.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.623+0000 7f5f1effd640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:12:52.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.623+0000 7f5f1effd640 1 -- 10.20.193.48:0/1040646279 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f20060390 con 0x7f5f2005dc20 2026-02-12T18:12:52.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.625+0000 7f5f1effd640 1 -- 10.20.193.48:0/1040646279 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5f2005dc20 msgr2=0x7f5f20144660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:52.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.625+0000 7f5f1effd640 1 --2- 10.20.193.48:0/1040646279 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5f2005dc20 0x7f5f20144660 secure :-1 s=READY pgs=276 gs=1 cs=0 l=1 c_cookie=7481994355934462943 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f14009060 tx=0x7f5f1402ee80 comp rx=0 tx=0).ready entity=mon.6 client_cookie=67d56239b4f383df server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:52.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.625+0000 7f5f1dffb640 1 -- 10.20.193.48:0/1040646279 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5f14035340 con 0x7f5f2005dc20 2026-02-12T18:12:52.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.625+0000 7f5f1dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:52.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.625+0000 7f5f1dffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:12:52.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.625+0000 7f5f1dffb640 10 monclient: dump: 2026-02-12T18:12:52.639 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:52.639 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:52.639 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:52.640 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:52.640 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:52.640 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:52.640 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:52.640 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:52.640 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:52.640 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:52.640 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:52.640 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:52.640 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:52.640 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:52.640 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:52.641 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:52.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.625+0000 7f5f1dffb640 10 monclient: _finish_auth 0 2026-02-12T18:12:52.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.625+0000 7f5f1dffb640 10 monclient: _check_auth_tickets 2026-02-12T18:12:52.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.625+0000 7f5f1dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:52.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.625+0000 7f5f1dffb640 1 -- 10.20.193.48:0/1040646279 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f140354c0 con 0x7f5f2005dc20 2026-02-12T18:12:52.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.625+0000 7f5f254c3640 5 monclient: authenticate success, global_id 5838 2026-02-12T18:12:52.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.625+0000 7f5f254c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:12:52.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.625+0000 7f5f1dffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:52.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.625+0000 7f5f1dffb640 1 -- 10.20.193.48:0/1040646279 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5f14035af0 con 0x7f5f2005dc20 2026-02-12T18:12:52.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.625+0000 7f5f254c3640 10 monclient: get_monmap_and_config success 2026-02-12T18:12:52.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.625+0000 7f5f254c3640 4 set_mon_vals no callback set 2026-02-12T18:12:52.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.625+0000 7f5f1dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:52.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.625+0000 7f5f1dffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:12:52.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.625+0000 7f5f1dffb640 10 monclient: dump: 2026-02-12T18:12:52.642 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:52.642 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:52.642 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:52.642 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:52.642 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:52.642 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:52.642 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:52.642 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:52.642 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:52.642 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:52.643 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:52.643 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:52.643 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:52.643 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:52.643 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:52.643 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:52.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.626+0000 7f5f254c3640 10 monclient: shutdown 2026-02-12T18:12:52.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.626+0000 7f5f254c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:52.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.626+0000 7f5f254c3640 1 -- 10.20.193.48:0/1040646279 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5f2005dc20 msgr2=0x7f5f20144660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:52.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.626+0000 7f5f254c3640 1 --2- 10.20.193.48:0/1040646279 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5f2005dc20 0x7f5f20144660 secure :-1 s=READY pgs=276 gs=1 cs=0 l=1 c_cookie=7481994355934462943 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f14009060 tx=0x7f5f1402ee80 comp rx=0 tx=0).stop 2026-02-12T18:12:52.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.626+0000 7f5f254c3640 1 -- 10.20.193.48:0/1040646279 shutdown_connections 2026-02-12T18:12:52.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.626+0000 7f5f254c3640 1 --2- 10.20.193.48:0/1040646279 >> v2:10.20.193.111:3300/0 conn(0x7f5f20089df0 0x7f5f2008a240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:52.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.626+0000 7f5f254c3640 1 --2- 10.20.193.48:0/1040646279 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5f2005dff0 0x7f5f2005e3c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:52.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.626+0000 7f5f254c3640 1 --2- 10.20.193.48:0/1040646279 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5f2005dc20 0x7f5f20144660 unknown :-1 s=CLOSED pgs=276 gs=1 cs=0 l=1 c_cookie=7481994355934462943 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:52.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.626+0000 7f5f254c3640 1 -- 10.20.193.48:0/1040646279 >> 10.20.193.48:0/1040646279 conn(0x7f5f200546d0 msgr2=0x7f5f20054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:52.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.626+0000 7f5f254c3640 1 -- 10.20.193.48:0/1040646279 shutdown_connections 2026-02-12T18:12:52.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.626+0000 7f5f254c3640 1 -- 10.20.193.48:0/1040646279 wait complete. 2026-02-12T18:12:52.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.626+0000 7f5f254c3640 10 monclient: build_initial_monmap 2026-02-12T18:12:52.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.626+0000 7f5f254c3640 10 monclient: monmap: 2026-02-12T18:12:52.644 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:52.644 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:12:52.644 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:12:52.644 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:12:52.644 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:52.645 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:52.645 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:12:52.645 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:12:52.645 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:52.645 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:52.645 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:52.645 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:52.645 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:52.645 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:52.645 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:52.645 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:52.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.626+0000 7f5f254c3640 1 Processor -- start 2026-02-12T18:12:52.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f254c3640 1 -- start start 2026-02-12T18:12:52.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f254c3640 10 monclient: init 2026-02-12T18:12:52.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f254c3640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:52.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f254c3640 10 monclient: _add_conns ranks=[6,7,3,2,1,4,5,8,0] 2026-02-12T18:12:52.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f254c3640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5f2005dc20 0x7f5f2010db60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:52.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f254c3640 10 monclient(hunting): picked mon.noname-d con 0x7f5f2005dc20 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:12:52.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f254c3640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5f2005dff0 0x7f5f2010e0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:52.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f254c3640 10 monclient(hunting): picked mon.noname-i con 0x7f5f2005dff0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:12:52.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f254c3640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f5f20089df0 0x7f5f2010e5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:52.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f254c3640 10 monclient(hunting): picked mon.noname-g con 0x7f5f20089df0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:12:52.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f254c3640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:52.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f254c3640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f5f2010ff50 con 0x7f5f20089df0 2026-02-12T18:12:52.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f254c3640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:52.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f254c3640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f5f2008df10 con 0x7f5f2005dc20 2026-02-12T18:12:52.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f254c3640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:52.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f254c3640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f5f20142940 con 0x7f5f2005dff0 2026-02-12T18:12:52.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f254c3640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:52.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f254c3640 10 monclient(hunting): authenticate will time out at 1011.353282s 2026-02-12T18:12:52.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1effd640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5f2005dc20 0x7f5f2010db60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:52.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1effd640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5f2005dc20 0x7f5f2010db60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:59444/0 (socket says 10.20.193.48:59444) 2026-02-12T18:12:52.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1effd640 1 -- 10.20.193.48:0/2960959514 learned_addr learned my addr 10.20.193.48:0/2960959514 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:52.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1effd640 10 monclient(hunting): get_auth_request con 0x7f5f2005dc20 auth_method 0 2026-02-12T18:12:52.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:52.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:52.648 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:52.648 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:52.648 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:52.648 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:52.648 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1e7fc640 1 --2- 10.20.193.48:0/2960959514 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5f2005dff0 0x7f5f2010e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:52.648 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1e7fc640 10 monclient(hunting): get_auth_request con 0x7f5f2005dff0 auth_method 0 2026-02-12T18:12:52.648 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1f7fe640 1 --2- 10.20.193.48:0/2960959514 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f5f20089df0 0x7f5f2010e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:52.648 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:52.648 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:52.648 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:52.648 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1f7fe640 10 monclient(hunting): get_auth_request con 0x7f5f20089df0 auth_method 0 2026-02-12T18:12:52.648 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:52.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:52.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:52.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1effd640 10 monclient(hunting): handle_auth_done global_id 5847 payload 824 2026-02-12T18:12:52.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1effd640 1 -- 10.20.193.48:0/2960959514 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5f2005dff0 msgr2=0x7f5f2010e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:52.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1effd640 1 --2- 10.20.193.48:0/2960959514 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5f2005dff0 0x7f5f2010e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:52.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1effd640 1 -- 10.20.193.48:0/2960959514 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f5f20089df0 msgr2=0x7f5f2010e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:52.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1effd640 1 --2- 10.20.193.48:0/2960959514 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f5f20089df0 0x7f5f2010e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:52.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1effd640 10 monclient: _finish_hunting 0 2026-02-12T18:12:52.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1effd640 1 monclient: found mon.noname-d 2026-02-12T18:12:52.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:52.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1effd640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:12:52.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.627+0000 7f5f1effd640 1 -- 10.20.193.48:0/2960959514 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f140094f0 con 0x7f5f2005dc20 2026-02-12T18:12:52.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.629+0000 7f5f1effd640 1 -- 10.20.193.48:0/2960959514 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5f2005dc20 msgr2=0x7f5f2010db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:52.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.629+0000 7f5f1effd640 1 --2- 10.20.193.48:0/2960959514 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5f2005dc20 0x7f5f2010db60 secure :-1 s=READY pgs=277 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f140099a0 tx=0x7f5f14004770 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:52.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.629+0000 7f5eff7fe640 1 -- 10.20.193.48:0/2960959514 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5f14035a50 con 0x7f5f2005dc20 2026-02-12T18:12:52.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.629+0000 7f5eff7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:52.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.629+0000 7f5eff7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:12:52.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.629+0000 7f5eff7fe640 10 monclient: dump: 2026-02-12T18:12:52.650 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:52.650 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:52.650 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:52.650 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:52.651 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:52.651 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:52.651 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:52.651 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:52.651 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:52.651 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:52.651 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:52.651 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:52.651 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:52.651 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:52.651 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:52.651 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:52.651 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.629+0000 7f5eff7fe640 10 monclient: _finish_auth 0 2026-02-12T18:12:52.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.629+0000 7f5eff7fe640 10 monclient: _check_auth_tickets 2026-02-12T18:12:52.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.629+0000 7f5eff7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:52.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.629+0000 7f5eff7fe640 1 -- 10.20.193.48:0/2960959514 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f14037900 con 0x7f5f2005dc20 2026-02-12T18:12:52.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.629+0000 7f5f254c3640 5 monclient: authenticate success, global_id 5847 2026-02-12T18:12:52.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.629+0000 7f5eff7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:52.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.629+0000 7f5eff7fe640 1 -- 10.20.193.48:0/2960959514 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5f14040410 con 0x7f5f2005dc20 2026-02-12T18:12:52.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.629+0000 7f5eff7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:52.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.629+0000 7f5eff7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:12:52.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.629+0000 7f5f1d7fa640 4 set_mon_vals no callback set 2026-02-12T18:12:52.652 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.629+0000 7f5eff7fe640 10 monclient: dump: 2026-02-12T18:12:52.652 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:52.652 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:52.653 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:52.653 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:52.653 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:52.653 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:52.653 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:52.653 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:52.653 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:52.653 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:52.653 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:52.653 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:52.653 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:52.653 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:52.653 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:52.654 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:52.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.629+0000 7f5f254c3640 10 monclient: _renew_subs 2026-02-12T18:12:52.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.629+0000 7f5f254c3640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:12:52.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.629+0000 7f5f254c3640 1 -- 10.20.193.48:0/2960959514 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f201423a0 con 0x7f5f2005dc20 2026-02-12T18:12:52.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.630+0000 7f5f254c3640 10 monclient: _renew_subs 2026-02-12T18:12:52.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.630+0000 7f5f254c3640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:12:52.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.630+0000 7f5f254c3640 1 -- 10.20.193.48:0/2960959514 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f20110510 con 0x7f5f2005dc20 2026-02-12T18:12:52.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.630+0000 7f5f254c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:52.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.630+0000 7f5f254c3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:52.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.630+0000 7f5f254c3640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:12:52.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.630+0000 7f5f254c3640 1 -- 10.20.193.48:0/2960959514 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f20110850 con 0x7f5f2005dc20 2026-02-12T18:12:52.654 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.630+0000 7f5eff7fe640 1 -- 10.20.193.48:0/2960959514 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f5f14046020 con 0x7f5f2005dc20 2026-02-12T18:12:52.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.631+0000 7f5eff7fe640 1 --2- 10.20.193.48:0/2960959514 >> v2:10.20.193.111:6812/977811348 conn(0x7f5eec03f800 0x7f5eec05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:52.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.631+0000 7f5eff7fe640 1 -- 10.20.193.48:0/2960959514 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(220..220 src has 190..220) ==== 3503+0+0 (secure 0 0 0) 0x7f5f14077fb0 con 0x7f5f2005dc20 2026-02-12T18:12:52.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.631+0000 7f5f1e7fc640 1 --2- 10.20.193.48:0/2960959514 >> v2:10.20.193.111:6812/977811348 conn(0x7f5eec03f800 0x7f5eec05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:52.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.631+0000 7f5f1e7fc640 10 monclient: get_auth_request con 0x7f5eec03f800 auth_method 0 2026-02-12T18:12:52.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.633+0000 7f5eff7fe640 1 -- 10.20.193.48:0/2960959514 <== mon.6 v2:10.20.193.48:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f5f1403fba0 con 0x7f5f2005dc20 2026-02-12T18:12:52.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.633+0000 7f5eff7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:52.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.633+0000 7f5eff7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:12:52.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.633+0000 7f5f1e7fc640 1 --2- 10.20.193.48:0/2960959514 >> v2:10.20.193.111:6812/977811348 conn(0x7f5eec03f800 0x7f5eec05fcb0 secure :-1 s=READY pgs=337 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f2008d5c0 tx=0x7f5f08008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:52.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.775+0000 7f5f254c3640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T18:12:52.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.775+0000 7f5f254c3640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T18:12:52.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.775+0000 7f5f254c3640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:12:52.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.775+0000 7f5f254c3640 1 -- 10.20.193.48:0/2960959514 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5f20110120 con 0x7f5f2005dc20 2026-02-12T18:12:52.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.775+0000 7f5eff7fe640 1 -- 10.20.193.48:0/2960959514 <== mon.6 v2:10.20.193.48:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3660 (secure 0 0 0) 0x7f5f1404d080 con 0x7f5f2005dc20 2026-02-12T18:12:52.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.775+0000 7f5eff7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T18:12:52.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.775+0000 7f5eff7fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:12:52.778 INFO:teuthology.orchestra.run.trial048.stdout:{"election_epoch":68,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","modified":"2026-02-12T18:05:32.850777Z","created":"2026-02-12T18:05:32.850777Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3300","nonce":0},{"type":"v1","addr":"10.20.193.48:6789","nonce":0}]},"addr":"10.20.193.48:6789/0","public_addr":"10.20.193.48:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850827+0000","crush_location":[]},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3300","nonce":0},{"type":"v1","addr":"10.20.193.111:6789","nonce":0}]},"addr":"10.20.193.111:6789/0","public_addr":"10.20.193.111:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850829+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3301","nonce":0},{"type":"v1","addr":"10.20.193.48:6790","nonce":0}]},"addr":"10.20.193.48:6790/0","public_addr":"10.20.193.48:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850830+0000","crush_location":[]},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3301","nonce":0},{"type":"v1","addr":"10.20.193.111:6790","nonce":0}]},"addr":"10.20.193.111:6790/0","public_addr":"10.20.193.111:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850833+0000","crush_location":[]},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3302","nonce":0},{"type":"v1","addr":"10.20.193.48:6791","nonce":0}]},"addr":"10.20.193.48:6791/0","public_addr":"10.20.193.48:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3302","nonce":0},{"type":"v1","addr":"10.20.193.111:6791","nonce":0}]},"addr":"10.20.193.111:6791/0","public_addr":"10.20.193.111:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850834+0000","crush_location":[]},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3303","nonce":0},{"type":"v1","addr":"10.20.193.48:6792","nonce":0}]},"addr":"10.20.193.48:6792/0","public_addr":"10.20.193.48:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3303","nonce":0},{"type":"v1","addr":"10.20.193.111:6792","nonce":0}]},"addr":"10.20.193.111:6792/0","public_addr":"10.20.193.111:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850835+0000","crush_location":[]},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3304","nonce":0},{"type":"v1","addr":"10.20.193.48:6793","nonce":0}]},"addr":"10.20.193.48:6793/0","public_addr":"10.20.193.48:6793/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850832+0000","crush_location":[]}]}} 2026-02-12T18:12:52.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.777+0000 7f5f254c3640 1 -- 10.20.193.48:0/2960959514 >> v2:10.20.193.111:6812/977811348 conn(0x7f5eec03f800 msgr2=0x7f5eec05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:52.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.777+0000 7f5f254c3640 1 --2- 10.20.193.48:0/2960959514 >> v2:10.20.193.111:6812/977811348 conn(0x7f5eec03f800 0x7f5eec05fcb0 secure :-1 s=READY pgs=337 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f2008d5c0 tx=0x7f5f08008040 comp rx=0 tx=0).stop 2026-02-12T18:12:52.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.777+0000 7f5f254c3640 10 monclient: shutdown 2026-02-12T18:12:52.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.777+0000 7f5f254c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:52.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.777+0000 7f5f254c3640 1 -- 10.20.193.48:0/2960959514 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5f2005dc20 msgr2=0x7f5f2010db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:52.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.777+0000 7f5f254c3640 1 --2- 10.20.193.48:0/2960959514 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5f2005dc20 0x7f5f2010db60 secure :-1 s=READY pgs=277 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f140099a0 tx=0x7f5f14004770 comp rx=0 tx=0).stop 2026-02-12T18:12:52.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.777+0000 7f5f254c3640 1 -- 10.20.193.48:0/2960959514 shutdown_connections 2026-02-12T18:12:52.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.777+0000 7f5f254c3640 1 --2- 10.20.193.48:0/2960959514 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f5f20089df0 0x7f5f2010e5e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:52.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.777+0000 7f5f254c3640 1 --2- 10.20.193.48:0/2960959514 >> v2:10.20.193.111:6812/977811348 conn(0x7f5eec03f800 0x7f5eec05fcb0 unknown :-1 s=CLOSED pgs=337 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:52.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.777+0000 7f5f254c3640 1 --2- 10.20.193.48:0/2960959514 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5f2005dff0 0x7f5f2010e0a0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:52.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.777+0000 7f5f254c3640 1 --2- 10.20.193.48:0/2960959514 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5f2005dc20 0x7f5f2010db60 unknown :-1 s=CLOSED pgs=277 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:52.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.777+0000 7f5f254c3640 1 -- 10.20.193.48:0/2960959514 >> 10.20.193.48:0/2960959514 conn(0x7f5f200546d0 msgr2=0x7f5f20124810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:52.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.777+0000 7f5f254c3640 1 -- 10.20.193.48:0/2960959514 shutdown_connections 2026-02-12T18:12:52.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.777+0000 7f5f254c3640 1 -- 10.20.193.48:0/2960959514 wait complete. 2026-02-12T18:12:52.787 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2026-02-12T18:12:52.787 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-12T18:12:52.787 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2026-02-12T18:12:52.787 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T18:12:52.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.852+0000 7f5f3341b640 10 monclient: get_monmap_and_config 2026-02-12T18:12:52.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.852+0000 7f5f3341b640 10 monclient: build_initial_monmap 2026-02-12T18:12:52.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.852+0000 7f5f3341b640 10 monclient: monmap: 2026-02-12T18:12:52.854 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:52.854 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:52.854 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:12:52.853774+0000 2026-02-12T18:12:52.855 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:12:52.853774+0000 2026-02-12T18:12:52.855 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:52.855 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:52.855 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:12:52.855 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:12:52.855 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:52.855 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:52.855 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:52.855 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:52.855 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:52.855 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:52.855 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:52.856 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:12:52.856 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:12:52.856 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:52.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f3341b640 1 Processor -- start 2026-02-12T18:12:52.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f3341b640 1 -- start start 2026-02-12T18:12:52.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f3341b640 10 monclient: init 2026-02-12T18:12:52.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f3341b640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:52.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f3341b640 10 monclient: _add_conns ranks=[7,0,8,6,1,5,2,10,9,4,3] 2026-02-12T18:12:52.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f3341b640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5f2c05c950 0x7f5f2c05cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:52.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f3341b640 10 monclient(hunting): picked mon.noname-i con 0x7f5f2c05c950 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:12:52.865 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f3341b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5f2c05e490 addr v1:10.20.193.48:6789/0 2026-02-12T18:12:52.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f3341b640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5f2c05d260 0x7f5f2c13e280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:52.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f3341b640 10 monclient(hunting): picked mon.noname-e con 0x7f5f2c05d260 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:12:52.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f3341b640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f2c04dc20 con 0x7f5f2c05e490 2026-02-12T18:12:52.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f3341b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:52.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f3341b640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f5f2c05ddd0 con 0x7f5f2c05c950 2026-02-12T18:12:52.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f3341b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:52.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f3341b640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f5f2c092990 con 0x7f5f2c05d260 2026-02-12T18:12:52.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f3341b640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:52.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f3341b640 10 monclient(hunting): authenticate will time out at 1011.579518s 2026-02-12T18:12:52.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f3098f640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f5f2c05e490 0x7f5f2c13db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:51746/0 (socket says 10.20.193.48:51746) 2026-02-12T18:12:52.866 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f3098f640 1 -- 10.20.193.48:0/3234857459 learned_addr learned my addr 10.20.193.48:0/3234857459 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:12:52.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f31991640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5f2c05d260 0x7f5f2c13e280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:52.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f31991640 10 monclient(hunting): get_auth_request con 0x7f5f2c05d260 auth_method 0 2026-02-12T18:12:52.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f31991640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:52.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f31991640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:52.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f31991640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:52.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f31991640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:52.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f31991640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:52.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f31190640 1 --2- 10.20.193.48:0/3234857459 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5f2c05c950 0x7f5f2c05cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:52.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f31991640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:52.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f31190640 10 monclient(hunting): get_auth_request con 0x7f5f2c05c950 auth_method 0 2026-02-12T18:12:52.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f31190640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:52.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f31190640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:52.867 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f31190640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:52.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f31991640 10 monclient(hunting): handle_auth_done global_id 94238 payload 274 2026-02-12T18:12:52.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f31991640 1 -- 10.20.193.48:0/3234857459 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5f2c05c950 msgr2=0x7f5f2c05cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:52.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f31991640 1 --2- 10.20.193.48:0/3234857459 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5f2c05c950 0x7f5f2c05cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:52.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f31991640 1 -- 10.20.193.48:0/3234857459 >> v1:10.20.193.48:6789/0 conn(0x7f5f2c05e490 legacy=0x7f5f2c13db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:52.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f31991640 10 monclient: _finish_hunting 0 2026-02-12T18:12:52.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f31991640 1 monclient: found mon.noname-e 2026-02-12T18:12:52.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f31991640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:52.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f31991640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:12:52.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.853+0000 7f5f31991640 1 -- 10.20.193.48:0/3234857459 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f2c092c70 con 0x7f5f2c05d260 2026-02-12T18:12:52.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.856+0000 7f5f31991640 1 -- 10.20.193.48:0/3234857459 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5f2c05d260 msgr2=0x7f5f2c13e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:52.868 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.856+0000 7f5f31991640 1 --2- 10.20.193.48:0/3234857459 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5f2c05d260 0x7f5f2c13e280 secure :-1 s=READY pgs=26 gs=2 cs=0 l=1 c_cookie=15786226910909613874 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f2800a910 tx=0x7f5f2802fdb0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=db13f1bc887ac732 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:52.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.856+0000 7f5f1bfff640 1 -- 10.20.193.48:0/3234857459 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5f28036340 con 0x7f5f2c05d260 2026-02-12T18:12:52.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.856+0000 7f5f1bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:52.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.856+0000 7f5f1bfff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:12:52.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.856+0000 7f5f1bfff640 10 monclient: dump: 2026-02-12T18:12:52.871 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:52.871 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:52.871 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:52.871 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:52.871 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:52.871 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:52.871 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:52.871 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:52.871 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:52.871 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:52.871 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:52.871 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:52.872 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:52.872 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:52.872 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:52.872 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:52.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.856+0000 7f5f1bfff640 10 monclient: _finish_auth 0 2026-02-12T18:12:52.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.856+0000 7f5f1bfff640 10 monclient: _check_auth_tickets 2026-02-12T18:12:52.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.856+0000 7f5f1bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:52.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.856+0000 7f5f1bfff640 1 -- 10.20.193.48:0/3234857459 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f280364c0 con 0x7f5f2c05d260 2026-02-12T18:12:52.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.856+0000 7f5f3341b640 5 monclient: authenticate success, global_id 94238 2026-02-12T18:12:52.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.856+0000 7f5f3341b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:12:52.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.856+0000 7f5f1bfff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:52.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.856+0000 7f5f1bfff640 1 -- 10.20.193.48:0/3234857459 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5f28036af0 con 0x7f5f2c05d260 2026-02-12T18:12:52.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.856+0000 7f5f3341b640 10 monclient: get_monmap_and_config success 2026-02-12T18:12:52.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.856+0000 7f5f3341b640 4 set_mon_vals no callback set 2026-02-12T18:12:52.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.856+0000 7f5f1bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:52.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.856+0000 7f5f1bfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:12:52.873 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.856+0000 7f5f1bfff640 10 monclient: dump: 2026-02-12T18:12:52.873 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:52.873 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:52.873 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:52.873 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:52.873 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:52.873 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:52.874 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:52.874 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:52.874 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:52.874 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:52.874 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:52.874 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:52.874 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:52.874 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:52.874 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:52.874 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:52.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.857+0000 7f5f3341b640 10 monclient: shutdown 2026-02-12T18:12:52.874 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.857+0000 7f5f3341b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:52.875 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.857+0000 7f5f3341b640 1 -- 10.20.193.48:0/3234857459 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5f2c05d260 msgr2=0x7f5f2c13e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:52.875 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.857+0000 7f5f3341b640 1 --2- 10.20.193.48:0/3234857459 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5f2c05d260 0x7f5f2c13e280 secure :-1 s=READY pgs=26 gs=2 cs=0 l=1 c_cookie=15786226910909613874 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f2800a910 tx=0x7f5f2802fdb0 comp rx=0 tx=0).stop 2026-02-12T18:12:52.875 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.857+0000 7f5f3341b640 1 -- 10.20.193.48:0/3234857459 shutdown_connections 2026-02-12T18:12:52.875 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.857+0000 7f5f3341b640 1 --2- 10.20.193.48:0/3234857459 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5f2c05d260 0x7f5f2c13e280 unknown :-1 s=CLOSED pgs=26 gs=2 cs=0 l=1 c_cookie=15786226910909613874 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:52.875 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.857+0000 7f5f3341b640 1 --2- 10.20.193.48:0/3234857459 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5f2c05c950 0x7f5f2c05cd20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:52.875 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.857+0000 7f5f3341b640 1 -- 10.20.193.48:0/3234857459 >> 10.20.193.48:0/3234857459 conn(0x7f5f2c0548a0 msgr2=0x7f5f2c097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:52.875 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.857+0000 7f5f3341b640 1 -- 10.20.193.48:0/3234857459 shutdown_connections 2026-02-12T18:12:52.875 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.857+0000 7f5f3341b640 1 -- 10.20.193.48:0/3234857459 wait complete. 2026-02-12T18:12:52.875 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.857+0000 7f5f3341b640 10 monclient: build_initial_monmap 2026-02-12T18:12:52.875 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.857+0000 7f5f3341b640 10 monclient: monmap: 2026-02-12T18:12:52.875 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:52.875 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:12:52.876 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:12:52.876 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:12:52.876 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:52.876 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:52.876 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:12:52.876 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:12:52.876 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:52.876 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:52.876 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:52.876 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:52.876 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:52.876 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:52.876 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:52.877 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:52.877 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.857+0000 7f5f3341b640 1 Processor -- start 2026-02-12T18:12:52.877 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.857+0000 7f5f3341b640 1 -- start start 2026-02-12T18:12:52.877 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.857+0000 7f5f3341b640 10 monclient: init 2026-02-12T18:12:52.877 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.857+0000 7f5f3341b640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:52.877 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.857+0000 7f5f3341b640 10 monclient: _add_conns ranks=[8,4,2,0,3,5,7,6,1] 2026-02-12T18:12:52.877 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.857+0000 7f5f3341b640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5f2c05c950 0x7f5f2c12da90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:52.877 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.857+0000 7f5f3341b640 10 monclient(hunting): picked mon.noname-e con 0x7f5f2c05c950 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:12:52.877 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.857+0000 7f5f3341b640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5f2c05d260 0x7f5f2c08d440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:52.877 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f3341b640 10 monclient(hunting): picked mon.noname-c con 0x7f5f2c05d260 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:12:52.877 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f3341b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5f2c05e490 0x7f5f2c13dec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:52.877 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f3341b640 10 monclient(hunting): picked mon.noname-b con 0x7f5f2c05e490 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:12:52.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f3341b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:52.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f3341b640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f5f2c142bb0 con 0x7f5f2c05e490 2026-02-12T18:12:52.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f3341b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:52.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f3341b640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f5f2c08bc30 con 0x7f5f2c05d260 2026-02-12T18:12:52.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f3341b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:52.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f3341b640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f5f2c142570 con 0x7f5f2c05c950 2026-02-12T18:12:52.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f3341b640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:52.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f3341b640 10 monclient(hunting): authenticate will time out at 1011.584020s 2026-02-12T18:12:52.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31190640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5f2c05c950 0x7f5f2c12da90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:52.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31190640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5f2c05c950 0x7f5f2c12da90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:57414/0 (socket says 10.20.193.48:57414) 2026-02-12T18:12:52.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31190640 1 -- 10.20.193.48:0/3163278498 learned_addr learned my addr 10.20.193.48:0/3163278498 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:52.878 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31190640 10 monclient(hunting): get_auth_request con 0x7f5f2c05c950 auth_method 0 2026-02-12T18:12:52.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31190640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:52.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31190640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:52.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31190640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:52.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f3098f640 1 --2- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5f2c05d260 0x7f5f2c08d440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:52.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f3098f640 10 monclient(hunting): get_auth_request con 0x7f5f2c05d260 auth_method 0 2026-02-12T18:12:52.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31991640 1 --2- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5f2c05e490 0x7f5f2c13dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:52.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f3098f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:52.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f3098f640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:52.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f3098f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:52.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31991640 10 monclient(hunting): get_auth_request con 0x7f5f2c05e490 auth_method 0 2026-02-12T18:12:52.879 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31991640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:52.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31991640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:52.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31991640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:52.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31190640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:52.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31190640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:52.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31190640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:52.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31991640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:52.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31991640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:52.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31991640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:52.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f3098f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:52.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f3098f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:52.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f3098f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:52.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31190640 10 monclient(hunting): handle_auth_done global_id 94247 payload 824 2026-02-12T18:12:52.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31190640 1 -- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5f2c05d260 msgr2=0x7f5f2c08d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:52.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31190640 1 --2- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5f2c05d260 0x7f5f2c08d440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:52.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31190640 1 -- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5f2c05e490 msgr2=0x7f5f2c13dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:52.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31190640 1 --2- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5f2c05e490 0x7f5f2c13dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:52.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31190640 10 monclient: _finish_hunting 0 2026-02-12T18:12:52.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31190640 1 monclient: found mon.noname-e 2026-02-12T18:12:52.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31190640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:52.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31190640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:12:52.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31190640 1 -- 10.20.193.48:0/3163278498 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f2800a500 con 0x7f5f2c05c950 2026-02-12T18:12:52.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f31991640 1 --2- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5f2c05e490 0x7f5f2c13dec0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:12:52.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.858+0000 7f5f3098f640 1 --2- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5f2c05d260 0x7f5f2c08d440 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:12:52.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.860+0000 7f5f31190640 1 -- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5f2c05c950 msgr2=0x7f5f2c12da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:52.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.860+0000 7f5f31190640 1 --2- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5f2c05c950 0x7f5f2c12da90 secure :-1 s=READY pgs=27 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f1c006f30 tx=0x7f5f1c00ebd0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:52.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.860+0000 7f5f19ffb640 1 -- 10.20.193.48:0/3163278498 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5f1c00ee30 con 0x7f5f2c05c950 2026-02-12T18:12:52.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.860+0000 7f5f19ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:52.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.860+0000 7f5f19ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:12:52.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.860+0000 7f5f19ffb640 10 monclient: dump: 2026-02-12T18:12:52.882 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:52.882 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:52.882 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:52.882 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:52.882 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:52.882 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:52.882 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:52.882 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:52.882 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:52.883 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:52.883 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:52.883 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:52.883 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:52.883 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:52.883 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:52.883 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:52.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.860+0000 7f5f19ffb640 10 monclient: _finish_auth 0 2026-02-12T18:12:52.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.860+0000 7f5f19ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:12:52.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.860+0000 7f5f19ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:52.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.860+0000 7f5f19ffb640 1 -- 10.20.193.48:0/3163278498 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f1c00cda0 con 0x7f5f2c05c950 2026-02-12T18:12:52.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.860+0000 7f5f19ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:52.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.860+0000 7f5f19ffb640 1 -- 10.20.193.48:0/3163278498 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5f1c0138d0 con 0x7f5f2c05c950 2026-02-12T18:12:52.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.860+0000 7f5f19ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:52.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.860+0000 7f5f19ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:12:52.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.860+0000 7f5f1b7fe640 4 set_mon_vals no callback set 2026-02-12T18:12:52.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.860+0000 7f5f19ffb640 10 monclient: dump: 2026-02-12T18:12:52.884 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:52.884 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:52.884 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:52.884 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:52.884 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:52.884 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:52.884 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:52.884 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:52.885 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:52.885 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:52.885 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:52.885 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:52.885 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:52.885 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:52.885 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:52.885 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:52.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.860+0000 7f5f3341b640 5 monclient: authenticate success, global_id 94247 2026-02-12T18:12:52.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.860+0000 7f5f3341b640 10 monclient: _renew_subs 2026-02-12T18:12:52.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.860+0000 7f5f3341b640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:12:52.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.860+0000 7f5f3341b640 1 -- 10.20.193.48:0/3163278498 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f2c091600 con 0x7f5f2c05c950 2026-02-12T18:12:52.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.860+0000 7f5f3341b640 10 monclient: _renew_subs 2026-02-12T18:12:52.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.860+0000 7f5f3341b640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:12:52.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.860+0000 7f5f3341b640 1 -- 10.20.193.48:0/3163278498 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f2c08b670 con 0x7f5f2c05c950 2026-02-12T18:12:52.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.861+0000 7f5f3341b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:52.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.861+0000 7f5f3341b640 1 --2- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5f2c08d980 0x7f5f2c12a510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:52.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.861+0000 7f5f3341b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:52.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.861+0000 7f5f3341b640 1 -- 10.20.193.48:0/3163278498 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c05f140 con 0x7f5f2c08d980 2026-02-12T18:12:52.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.861+0000 7f5f3098f640 1 --2- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5f2c08d980 0x7f5f2c12a510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:52.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.861+0000 7f5f31190640 1 --2- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5f2c05c950 0x7f5f2c12da90 secure :-1 s=READY pgs=27 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f1c006f30 tx=0x7f5f1c00ebd0 comp rx=0 tx=0).queue_received will delay after 1.77092e+09 on 0x7f5f1c013410 mgrmap(e 5) 2026-02-12T18:12:52.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.861+0000 7f5f3098f640 1 -- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5f2c08d980 msgr2=0x7f5f2c12a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-12T18:12:52.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.861+0000 7f5f3098f640 1 -- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5f2c08d980 msgr2=0x7f5f2c12a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:12:52.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.861+0000 7f5f3098f640 1 --2- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5f2c08d980 0x7f5f2c12a510 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:12:52.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.861+0000 7f5f19ffb640 1 -- 10.20.193.48:0/3163278498 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f5f1c013410 con 0x7f5f2c05c950 2026-02-12T18:12:52.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.861+0000 7f5f3098f640 1 --2- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5f2c08d980 0x7f5f2c12a510 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:12:52.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.861+0000 7f5f19ffb640 1 --2- 10.20.193.48:0/3163278498 >> v2:10.20.193.111:6812/977811348 conn(0x7f5efc03f800 0x7f5efc05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:52.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.861+0000 7f5f31991640 1 --2- 10.20.193.48:0/3163278498 >> v2:10.20.193.111:6812/977811348 conn(0x7f5efc03f800 0x7f5efc05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:52.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.861+0000 7f5f31991640 10 monclient: get_auth_request con 0x7f5efc03f800 auth_method 0 2026-02-12T18:12:52.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:52.864+0000 7f5f31991640 1 --2- 10.20.193.48:0/3163278498 >> v2:10.20.193.111:6812/977811348 conn(0x7f5efc03f800 0x7f5efc05fcb0 secure :-1 s=READY pgs=338 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f28031fd0 tx=0x7f5f28034000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.062+0000 7f5f3098f640 1 --2- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5f2c08d980 0x7f5f2c12a510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.062+0000 7f5f3098f640 10 monclient: get_auth_request con 0x7f5f2c08d980 auth_method 0 2026-02-12T18:12:53.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.062+0000 7f5f3098f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.062+0000 7f5f3098f640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.062+0000 7f5f3098f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.062+0000 7f5f3098f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.062+0000 7f5f3098f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.062+0000 7f5f3098f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.063+0000 7f5f3098f640 10 monclient(hunting): handle_auth_done global_id 6201 payload 824 2026-02-12T18:12:53.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.063+0000 7f5f3098f640 1 -- 10.20.193.48:0/3163278498 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5f2c097de0 con 0x7f5f2c08d980 2026-02-12T18:12:53.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.065+0000 7f5f3098f640 1 -- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5f2c08d980 msgr2=0x7f5f2c12a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.065+0000 7f5f3098f640 1 --2- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5f2c08d980 0x7f5f2c12a510 secure :-1 s=READY pgs=473 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f20004930 tx=0x7f5f20005900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.065+0000 7f5f19ffb640 1 -- 10.20.193.48:0/3163278498 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5f20010e30 con 0x7f5f2c08d980 2026-02-12T18:12:53.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.065+0000 7f5f19ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.065+0000 7f5f19ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:12:53.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.065+0000 7f5f19ffb640 10 monclient: dump: 2026-02-12T18:12:53.068 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.068 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.068 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.068 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.068 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.068 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.068 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.068 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.068 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.068 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.069 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.069 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.069 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.069 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.069 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.069 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.065+0000 7f5f19ffb640 1 -- 10.20.193.48:0/3163278498 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f5f20010970 con 0x7f5f2c08d980 2026-02-12T18:12:53.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.065+0000 7f5f19ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:53.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.065+0000 7f5f19ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:12:53.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.065+0000 7f5f19ffb640 1 -- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5f2c08d980 msgr2=0x7f5f2c12a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.065+0000 7f5f19ffb640 1 --2- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5f2c08d980 0x7f5f2c12a510 secure :-1 s=READY pgs=473 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f20004930 tx=0x7f5f20005900 comp rx=0 tx=0).stop 2026-02-12T18:12:53.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.065+0000 7f5f19ffb640 1 -- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5f2c08d980 msgr2=0x7f5f2c12a510 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:53.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.065+0000 7f5f19ffb640 1 --2- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5f2c08d980 0x7f5f2c12a510 secure :-1 s=CLOSED pgs=473 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f20004930 tx=0x7f5f20005900 comp rx=0 tx=0).stop 2026-02-12T18:12:53.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.068+0000 7f5f3341b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:12:53.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.068+0000 7f5f3341b640 1 --2- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5f2c12aa50 0x7f5f2c12ae20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.068+0000 7f5f3341b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.068+0000 7f5f3341b640 1 -- 10.20.193.48:0/3163278498 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f5f2c05fd90 con 0x7f5f2c12aa50 2026-02-12T18:12:53.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.068+0000 7f5f3098f640 1 --2- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5f2c12aa50 0x7f5f2c12ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.069+0000 7f5f3098f640 10 monclient: get_auth_request con 0x7f5f2c12aa50 auth_method 0 2026-02-12T18:12:53.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.069+0000 7f5f3098f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.069+0000 7f5f3098f640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.069+0000 7f5f3098f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.069+0000 7f5f3098f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.069+0000 7f5f3098f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.069+0000 7f5f3098f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.069+0000 7f5f3098f640 10 monclient(hunting): handle_auth_done global_id 6210 payload 824 2026-02-12T18:12:53.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.069+0000 7f5f3098f640 1 -- 10.20.193.48:0/3163278498 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5f2c08be70 con 0x7f5f2c12aa50 2026-02-12T18:12:53.073 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.071+0000 7f5f3098f640 1 -- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5f2c12aa50 msgr2=0x7f5f2c12ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.073 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.071+0000 7f5f3098f640 1 --2- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5f2c12aa50 0x7f5f2c12ae20 secure :-1 s=READY pgs=474 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f20005fd0 tx=0x7f5f200048a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.073 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.071+0000 7f5f19ffb640 1 -- 10.20.193.48:0/3163278498 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5f20024070 con 0x7f5f2c12aa50 2026-02-12T18:12:53.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.071+0000 7f5f19ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.071+0000 7f5f19ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:12:53.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.071+0000 7f5f19ffb640 10 monclient: dump: 2026-02-12T18:12:53.074 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.074 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.074 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.074 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.074 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.074 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.074 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.074 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.075 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.075 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.075 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.075 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.075 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.075 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.075 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.075 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.071+0000 7f5f19ffb640 1 -- 10.20.193.48:0/3163278498 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10184 (secure 0 0 0) 0x7f5f2001f270 con 0x7f5f2c12aa50 2026-02-12T18:12:53.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.071+0000 7f5f19ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:12:53.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.071+0000 7f5f19ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:12:53.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.071+0000 7f5f19ffb640 1 -- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5f2c12aa50 msgr2=0x7f5f2c12ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.071+0000 7f5f19ffb640 1 --2- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5f2c12aa50 0x7f5f2c12ae20 secure :-1 s=READY pgs=474 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f20005fd0 tx=0x7f5f200048a0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.071+0000 7f5f19ffb640 1 -- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5f2c12aa50 msgr2=0x7f5f2c12ae20 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:53.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.071+0000 7f5f19ffb640 1 --2- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f5f2c12aa50 0x7f5f2c12ae20 secure :-1 s=CLOSED pgs=474 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f20005fd0 tx=0x7f5f200048a0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.076 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:12:53.076 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:12:53.076 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:12:53.077 INFO:teuthology.orchestra.run.trial048.stdout: "state": "leader", 2026-02-12T18:12:53.077 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 68, 2026-02-12T18:12:53.077 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 427905, 2026-02-12T18:12:53.077 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:12:53.077 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:12:53.077 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:12:53.077 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:12:53.077 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:12:53.077 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:12:53.077 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:12:53.077 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:12:53.077 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:12:53.078 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:12:53.078 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.078 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 3, 2026-02-12T18:12:53.078 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:53.078 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:12:53.078 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:12:53.078 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.078 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.078 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.078 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.078 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.079 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.079 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.079 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.079 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.079 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.079 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.079 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.079 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.079 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.079 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:12:53.079 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:12:53.079 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.080 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.080 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.080 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.080 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.080 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.080 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.080 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.080 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.080 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.080 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.080 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.080 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.081 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.081 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.081 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:12:53.081 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:12:53.081 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:12:53.081 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:12:53.081 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:12:53.081 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:12:53.081 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:53.081 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:53.081 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:12:53.081 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:12:53.082 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:12:53.082 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:12:53.082 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:12:53.082 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:12:53.082 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:12:53.082 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:53.082 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:12:53.082 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.082 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.082 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.082 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.082 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.083 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.083 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.083 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.083 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.083 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.083 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.083 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.083 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.083 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.083 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:12:53.083 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.084 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:12:53.084 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.084 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:12:53.084 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:12:53.084 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.084 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.084 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.084 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.084 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:12:53.084 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.084 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.084 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.084 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.085 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:12:53.085 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.085 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.085 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.085 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.085 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:12:53.085 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:12:53.085 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.085 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.085 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:12:53.085 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.085 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.086 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.086 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:12:53.086 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:12:53.086 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.086 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.086 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.086 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.086 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:12:53.086 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.086 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.086 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.086 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.087 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:12:53.087 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.087 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.087 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.087 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.087 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:12:53.087 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:12:53.087 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.087 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.087 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:12:53.087 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.087 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.088 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.088 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:12:53.088 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:12:53.088 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.088 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.088 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.088 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.088 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:12:53.088 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.088 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.088 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.088 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.088 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:12:53.089 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.089 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.089 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.089 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.089 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:12:53.089 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:12:53.089 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.089 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.089 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:12:53.089 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.089 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.089 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.090 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:12:53.090 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:12:53.090 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.090 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.090 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.090 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.090 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:12:53.090 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.090 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.090 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.090 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.090 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:12:53.090 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.091 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.091 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.091 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.091 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:12:53.091 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:12:53.091 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.091 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.091 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:12:53.091 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.091 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.091 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.091 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:12:53.092 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:12:53.092 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.092 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.092 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.092 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.092 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:12:53.092 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.092 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.092 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.092 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.092 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:12:53.092 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.092 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.093 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.093 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.093 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:12:53.093 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:12:53.093 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.093 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.093 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:53.093 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.093 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.093 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.093 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:12:53.093 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:12:53.094 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.094 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.094 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.094 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.094 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:12:53.094 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.094 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.094 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.094 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.094 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:12:53.094 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.094 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.095 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.095 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.095 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:12:53.095 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:12:53.095 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.095 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.095 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:12:53.095 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.095 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.095 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.095 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:12:53.095 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:12:53.095 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.096 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.096 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.096 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.096 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:12:53.096 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.096 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.096 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.096 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.096 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:12:53.096 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.096 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.096 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.097 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.097 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:12:53.097 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:12:53.097 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.097 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.097 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:53.097 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.097 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.097 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.097 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:12:53.097 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:12:53.097 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.098 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.098 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.098 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.098 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:12:53.098 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.098 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.098 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.098 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.098 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:12:53.098 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.098 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.099 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.099 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.099 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:12:53.099 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:12:53.099 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.099 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.099 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:12:53.099 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.099 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.100 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.100 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:12:53.100 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:12:53.100 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.100 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.100 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.100 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.100 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:12:53.100 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.100 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.100 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.100 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.100 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:12:53.101 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.101 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.101 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.101 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.101 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:12:53.101 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:12:53.101 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.101 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.101 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:12:53.101 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.101 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.101 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.102 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.102 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:12:53.102 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:12:53.102 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.102 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:53.102 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:53.102 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:53.102 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.102 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.102 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:12:53.102 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.102 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:53.103 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:53.103 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:12:53.103 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.103 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.103 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:12:53.103 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.103 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:53.103 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:53.103 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:12:53.103 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.103 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.103 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.104 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:12:53.104 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:12:53.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.071+0000 7f5f3341b640 1 -- 10.20.193.48:0/3163278498 >> v2:10.20.193.111:6812/977811348 conn(0x7f5efc03f800 msgr2=0x7f5efc05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.072+0000 7f5f3341b640 1 --2- 10.20.193.48:0/3163278498 >> v2:10.20.193.111:6812/977811348 conn(0x7f5efc03f800 0x7f5efc05fcb0 secure :-1 s=READY pgs=338 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f28031fd0 tx=0x7f5f28034000 comp rx=0 tx=0).stop 2026-02-12T18:12:53.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.072+0000 7f5f3341b640 10 monclient: shutdown 2026-02-12T18:12:53.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.072+0000 7f5f3341b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:53.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.072+0000 7f5f3341b640 1 -- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5f2c05c950 msgr2=0x7f5f2c12da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.072+0000 7f5f3341b640 1 --2- 10.20.193.48:0/3163278498 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5f2c05c950 0x7f5f2c12da90 secure :-1 s=READY pgs=27 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5f1c006f30 tx=0x7f5f1c00ebd0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.072+0000 7f5f31991640 1 -- 10.20.193.48:0/3163278498 reap_dead start 2026-02-12T18:12:53.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.072+0000 7f5f19ffb640 1 -- 10.20.193.48:0/3163278498 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(221..221 src has 190..221) ==== 3897+0+0 (unknown 0 0 0) 0x7f5f1c052cd0 con 0x7f5f2c05c950 2026-02-12T18:12:53.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.072+0000 7f5f31991640 1 -- 10.20.193.48:0/3163278498 reap_dead start 2026-02-12T18:12:53.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.072+0000 7f5f3341b640 1 -- 10.20.193.48:0/3163278498 shutdown_connections 2026-02-12T18:12:53.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.072+0000 7f5f3341b640 1 -- 10.20.193.48:0/3163278498 >> 10.20.193.48:0/3163278498 conn(0x7f5f2c0548a0 msgr2=0x7f5f2c123070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:53.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.072+0000 7f5f3341b640 1 -- 10.20.193.48:0/3163278498 shutdown_connections 2026-02-12T18:12:53.107 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.072+0000 7f5f3341b640 1 -- 10.20.193.48:0/3163278498 wait complete. 2026-02-12T18:12:53.107 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:12:53.107 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2026-02-12T18:12:53.108 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T18:12:53.175 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.173+0000 7f5a59b0c640 10 monclient: get_monmap_and_config 2026-02-12T18:12:53.175 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.173+0000 7f5a59b0c640 10 monclient: build_initial_monmap 2026-02-12T18:12:53.175 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.173+0000 7f5a59b0c640 10 monclient: monmap: 2026-02-12T18:12:53.176 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:53.176 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.176 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:12:53.174699+0000 2026-02-12T18:12:53.176 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:12:53.174699+0000 2026-02-12T18:12:53.176 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:53.176 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.176 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:12:53.176 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:12:53.176 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:53.176 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:53.176 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:53.176 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:53.177 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:53.177 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:53.177 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:53.177 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:12:53.177 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:12:53.177 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a59b0c640 1 Processor -- start 2026-02-12T18:12:53.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a59b0c640 1 -- start start 2026-02-12T18:12:53.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a59b0c640 10 monclient: init 2026-02-12T18:12:53.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a59b0c640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:53.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a59b0c640 10 monclient: _add_conns ranks=[8,9,0,7,1,2,3,4,6,5,10] 2026-02-12T18:12:53.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a59b0c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5a5405d550 0x7f5a5405d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a59b0c640 10 monclient(hunting): picked mon.noname-e con 0x7f5a5405d550 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:12:53.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a59b0c640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f5a5405de60 0x7f5a54141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a59b0c640 10 monclient(hunting): picked mon.noname-a con 0x7f5a5405de60 addr v2:10.20.193.48:3300/0 2026-02-12T18:12:53.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a59b0c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5a5413ef60 addr v1:10.20.193.48:6789/0 2026-02-12T18:12:53.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a59b0c640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a5404dc20 con 0x7f5a5413ef60 2026-02-12T18:12:53.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a59b0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a59b0c640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f5a5408d390 con 0x7f5a5405de60 2026-02-12T18:12:53.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a59b0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a59b0c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f5a5408d5a0 con 0x7f5a5405d550 2026-02-12T18:12:53.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a59b0c640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:53.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a59b0c640 10 monclient(hunting): authenticate will time out at 1011.900403s 2026-02-12T18:12:53.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a537fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5a5405d550 0x7f5a5405d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a52ffd640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f5a5405de60 0x7f5a54141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a537fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5a5405d550 0x7f5a5405d920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:57426/0 (socket says 10.20.193.48:57426) 2026-02-12T18:12:53.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a537fe640 1 -- 10.20.193.48:0/104530488 learned_addr learned my addr 10.20.193.48:0/104530488 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:53.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a53fff640 1 --1- 10.20.193.48:0/104530488 >> v1:10.20.193.48:6789/0 conn(0x7f5a5413ef60 0x7f5a541424e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:51754/0 (socket says 10.20.193.48:51754) 2026-02-12T18:12:53.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a537fe640 10 monclient(hunting): get_auth_request con 0x7f5a5405d550 auth_method 0 2026-02-12T18:12:53.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a537fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a537fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a52ffd640 10 monclient(hunting): get_auth_request con 0x7f5a5405de60 auth_method 0 2026-02-12T18:12:53.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a52ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a52ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a52ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a537fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a537fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a537fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a52ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a52ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a52ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a537fe640 10 monclient(hunting): handle_auth_done global_id 94256 payload 274 2026-02-12T18:12:53.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a537fe640 1 -- 10.20.193.48:0/104530488 >> v2:10.20.193.48:3300/0 conn(0x7f5a5405de60 msgr2=0x7f5a54141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:53.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a537fe640 1 --2- 10.20.193.48:0/104530488 >> v2:10.20.193.48:3300/0 conn(0x7f5a5405de60 0x7f5a54141fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a537fe640 1 -- 10.20.193.48:0/104530488 >> v1:10.20.193.48:6789/0 conn(0x7f5a5413ef60 legacy=0x7f5a541424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:53.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a537fe640 10 monclient: _finish_hunting 0 2026-02-12T18:12:53.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a537fe640 1 monclient: found mon.noname-e 2026-02-12T18:12:53.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:53.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a537fe640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:12:53.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a537fe640 1 -- 10.20.193.48:0/104530488 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a540580e0 con 0x7f5a5405d550 2026-02-12T18:12:53.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.174+0000 7f5a52ffd640 1 --2- 10.20.193.48:0/104530488 >> v2:10.20.193.48:3300/0 conn(0x7f5a5405de60 0x7f5a54141fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:12:53.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a537fe640 1 -- 10.20.193.48:0/104530488 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5a5405d550 msgr2=0x7f5a5405d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a537fe640 1 --2- 10.20.193.48:0/104530488 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5a5405d550 0x7f5a5405d920 secure :-1 s=READY pgs=28 gs=2 cs=0 l=1 c_cookie=9466937657715775414 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a40009060 tx=0x7f5a4002edf0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=836151a446ead7b6 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a527fc640 1 -- 10.20.193.48:0/104530488 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5a40035340 con 0x7f5a5405d550 2026-02-12T18:12:53.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a527fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:12:53.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a527fc640 10 monclient: dump: 2026-02-12T18:12:53.191 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.191 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.191 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.192 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.192 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.192 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.192 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.192 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.192 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.192 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.192 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.192 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.192 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.192 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.192 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.193 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a527fc640 10 monclient: _finish_auth 0 2026-02-12T18:12:53.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a527fc640 10 monclient: _check_auth_tickets 2026-02-12T18:12:53.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a527fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:53.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a527fc640 1 -- 10.20.193.48:0/104530488 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a400354c0 con 0x7f5a5405d550 2026-02-12T18:12:53.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a59b0c640 5 monclient: authenticate success, global_id 94256 2026-02-12T18:12:53.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a527fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:53.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a527fc640 1 -- 10.20.193.48:0/104530488 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5a40035af0 con 0x7f5a5405d550 2026-02-12T18:12:53.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a59b0c640 10 monclient: get_monmap_and_config success 2026-02-12T18:12:53.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a527fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a59b0c640 4 set_mon_vals no callback set 2026-02-12T18:12:53.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a527fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:12:53.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a527fc640 10 monclient: dump: 2026-02-12T18:12:53.194 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.194 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.194 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.194 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.194 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.194 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.194 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.194 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.194 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.194 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.194 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.195 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.195 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.195 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.195 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.195 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a59b0c640 10 monclient: shutdown 2026-02-12T18:12:53.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a59b0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:53.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a59b0c640 1 -- 10.20.193.48:0/104530488 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5a5405d550 msgr2=0x7f5a5405d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a59b0c640 1 --2- 10.20.193.48:0/104530488 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5a5405d550 0x7f5a5405d920 secure :-1 s=READY pgs=28 gs=2 cs=0 l=1 c_cookie=9466937657715775414 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a40009060 tx=0x7f5a4002edf0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a59b0c640 1 -- 10.20.193.48:0/104530488 shutdown_connections 2026-02-12T18:12:53.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a59b0c640 1 --2- 10.20.193.48:0/104530488 >> v2:10.20.193.48:3300/0 conn(0x7f5a5405de60 0x7f5a54141fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a59b0c640 1 --2- 10.20.193.48:0/104530488 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5a5405d550 0x7f5a5405d920 unknown :-1 s=CLOSED pgs=28 gs=2 cs=0 l=1 c_cookie=9466937657715775414 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a59b0c640 1 -- 10.20.193.48:0/104530488 >> 10.20.193.48:0/104530488 conn(0x7f5a540546a0 msgr2=0x7f5a54054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:53.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.177+0000 7f5a59b0c640 1 -- 10.20.193.48:0/104530488 shutdown_connections 2026-02-12T18:12:53.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.178+0000 7f5a59b0c640 1 -- 10.20.193.48:0/104530488 wait complete. 2026-02-12T18:12:53.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.178+0000 7f5a59b0c640 10 monclient: build_initial_monmap 2026-02-12T18:12:53.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.178+0000 7f5a59b0c640 10 monclient: monmap: 2026-02-12T18:12:53.196 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:53.196 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:12:53.196 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:12:53.196 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:12:53.196 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:53.196 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.196 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:12:53.196 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:12:53.197 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:53.197 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:53.197 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:53.197 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:53.197 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:53.197 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:53.197 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:53.197 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.178+0000 7f5a59b0c640 1 Processor -- start 2026-02-12T18:12:53.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.178+0000 7f5a59b0c640 1 -- start start 2026-02-12T18:12:53.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.178+0000 7f5a59b0c640 10 monclient: init 2026-02-12T18:12:53.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a59b0c640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:53.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a59b0c640 10 monclient: _add_conns ranks=[6,1,7,8,0,5,4,2,3] 2026-02-12T18:12:53.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a59b0c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5a5405d550 0x7f5a5412fbb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a59b0c640 10 monclient(hunting): picked mon.noname-d con 0x7f5a5405d550 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:12:53.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a59b0c640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f5a5405de60 0x7f5a54109760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a59b0c640 10 monclient(hunting): picked mon.noname-f con 0x7f5a5405de60 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:12:53.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a59b0c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5a5413ef60 0x7f5a54109ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a59b0c640 10 monclient(hunting): picked mon.noname-i con 0x7f5a5413ef60 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:12:53.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a59b0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a59b0c640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5a5410c9a0 con 0x7f5a5405de60 2026-02-12T18:12:53.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a59b0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a59b0c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f5a5410cbc0 con 0x7f5a5405d550 2026-02-12T18:12:53.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a59b0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a59b0c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f5a5410cea0 con 0x7f5a5413ef60 2026-02-12T18:12:53.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a59b0c640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:53.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a59b0c640 10 monclient(hunting): authenticate will time out at 1011.905161s 2026-02-12T18:12:53.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a537fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5a5405d550 0x7f5a5412fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a537fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5a5405d550 0x7f5a5412fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:59446/0 (socket says 10.20.193.48:59446) 2026-02-12T18:12:53.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a537fe640 1 -- 10.20.193.48:0/2666261729 learned_addr learned my addr 10.20.193.48:0/2666261729 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:53.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a537fe640 10 monclient(hunting): get_auth_request con 0x7f5a5405d550 auth_method 0 2026-02-12T18:12:53.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a537fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a537fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a537fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a537fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a537fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a537fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a52ffd640 1 --2- 10.20.193.48:0/2666261729 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f5a5405de60 0x7f5a54109760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a53fff640 1 --2- 10.20.193.48:0/2666261729 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5a5413ef60 0x7f5a54109ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a53fff640 10 monclient(hunting): get_auth_request con 0x7f5a5413ef60 auth_method 0 2026-02-12T18:12:53.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a53fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a53fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a53fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a52ffd640 10 monclient(hunting): get_auth_request con 0x7f5a5405de60 auth_method 0 2026-02-12T18:12:53.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a52ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a52ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a52ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a537fe640 10 monclient(hunting): handle_auth_done global_id 5856 payload 824 2026-02-12T18:12:53.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a537fe640 1 -- 10.20.193.48:0/2666261729 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5a5413ef60 msgr2=0x7f5a54109ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a537fe640 1 --2- 10.20.193.48:0/2666261729 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f5a5413ef60 0x7f5a54109ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a537fe640 1 -- 10.20.193.48:0/2666261729 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f5a5405de60 msgr2=0x7f5a54109760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a537fe640 1 --2- 10.20.193.48:0/2666261729 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f5a5405de60 0x7f5a54109760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a537fe640 10 monclient: _finish_hunting 0 2026-02-12T18:12:53.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a537fe640 1 monclient: found mon.noname-d 2026-02-12T18:12:53.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:53.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a537fe640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:12:53.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.179+0000 7f5a537fe640 1 -- 10.20.193.48:0/2666261729 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a44009420 con 0x7f5a5405d550 2026-02-12T18:12:53.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.181+0000 7f5a537fe640 1 -- 10.20.193.48:0/2666261729 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5a5405d550 msgr2=0x7f5a5412fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.181+0000 7f5a537fe640 1 --2- 10.20.193.48:0/2666261729 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5a5405d550 0x7f5a5412fbb0 secure :-1 s=READY pgs=278 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a400099a0 tx=0x7f5a40004770 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.181+0000 7f5a2ffff640 1 -- 10.20.193.48:0/2666261729 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5a40035e00 con 0x7f5a5405d550 2026-02-12T18:12:53.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.181+0000 7f5a2ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.181+0000 7f5a2ffff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:12:53.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.181+0000 7f5a2ffff640 10 monclient: dump: 2026-02-12T18:12:53.202 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.202 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.202 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.202 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.202 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.202 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.202 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.203 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.203 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.203 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.203 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.203 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.203 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.203 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.203 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.203 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.181+0000 7f5a2ffff640 10 monclient: _finish_auth 0 2026-02-12T18:12:53.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.181+0000 7f5a2ffff640 10 monclient: _check_auth_tickets 2026-02-12T18:12:53.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.181+0000 7f5a2ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:53.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.181+0000 7f5a59b0c640 5 monclient: authenticate success, global_id 5856 2026-02-12T18:12:53.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.181+0000 7f5a59b0c640 10 monclient: _renew_subs 2026-02-12T18:12:53.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.181+0000 7f5a59b0c640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:12:53.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.181+0000 7f5a59b0c640 1 -- 10.20.193.48:0/2666261729 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a400094f0 con 0x7f5a5405d550 2026-02-12T18:12:53.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.181+0000 7f5a2ffff640 1 -- 10.20.193.48:0/2666261729 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a40037440 con 0x7f5a5405d550 2026-02-12T18:12:53.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.181+0000 7f5a2ffff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:53.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.181+0000 7f5a2ffff640 1 -- 10.20.193.48:0/2666261729 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5a40037a70 con 0x7f5a5405d550 2026-02-12T18:12:53.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.181+0000 7f5a2ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.181+0000 7f5a2ffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:12:53.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.181+0000 7f5a51ffb640 4 set_mon_vals no callback set 2026-02-12T18:12:53.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.181+0000 7f5a2ffff640 10 monclient: dump: 2026-02-12T18:12:53.204 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.204 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.204 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.204 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.204 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.204 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.205 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.205 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.205 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.205 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.205 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.205 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.205 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.205 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.205 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.205 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.181+0000 7f5a59b0c640 10 monclient: _renew_subs 2026-02-12T18:12:53.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.181+0000 7f5a59b0c640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:12:53.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.181+0000 7f5a59b0c640 1 -- 10.20.193.48:0/2666261729 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a54124280 con 0x7f5a5405d550 2026-02-12T18:12:53.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.182+0000 7f5a59b0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:53.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.182+0000 7f5a59b0c640 1 --2- 10.20.193.48:0/2666261729 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5a54091010 0x7f5a5410a1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.182+0000 7f5a59b0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.182+0000 7f5a59b0c640 1 -- 10.20.193.48:0/2666261729 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f5a540631f0 con 0x7f5a54091010 2026-02-12T18:12:53.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.182+0000 7f5a52ffd640 1 --2- 10.20.193.48:0/2666261729 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5a54091010 0x7f5a5410a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.182+0000 7f5a52ffd640 10 monclient: get_auth_request con 0x7f5a54091010 auth_method 0 2026-02-12T18:12:53.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.182+0000 7f5a52ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.182+0000 7f5a52ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.182+0000 7f5a52ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.182+0000 7f5a52ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.182+0000 7f5a52ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.182+0000 7f5a52ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.182+0000 7f5a52ffd640 10 monclient(hunting): handle_auth_done global_id 35876 payload 824 2026-02-12T18:12:53.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.182+0000 7f5a52ffd640 1 -- 10.20.193.48:0/2666261729 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5a5410cd30 con 0x7f5a54091010 2026-02-12T18:12:53.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.182+0000 7f5a2ffff640 1 -- 10.20.193.48:0/2666261729 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f5a40046020 con 0x7f5a5405d550 2026-02-12T18:12:53.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.182+0000 7f5a2ffff640 1 --2- 10.20.193.48:0/2666261729 >> v2:10.20.193.111:6812/977811348 conn(0x7f5a2403f800 0x7f5a2405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.182+0000 7f5a2ffff640 1 -- 10.20.193.48:0/2666261729 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(221..221 src has 190..221) ==== 3897+0+0 (secure 0 0 0) 0x7f5a40077e00 con 0x7f5a5405d550 2026-02-12T18:12:53.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.182+0000 7f5a53fff640 1 --2- 10.20.193.48:0/2666261729 >> v2:10.20.193.111:6812/977811348 conn(0x7f5a2403f800 0x7f5a2405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.182+0000 7f5a53fff640 10 monclient: get_auth_request con 0x7f5a2403f800 auth_method 0 2026-02-12T18:12:53.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.184+0000 7f5a52ffd640 1 -- 10.20.193.48:0/2666261729 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5a54091010 msgr2=0x7f5a5410a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.184+0000 7f5a52ffd640 1 --2- 10.20.193.48:0/2666261729 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5a54091010 0x7f5a5410a1e0 secure :-1 s=READY pgs=312 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a5410b490 tx=0x7f5a44011ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.184+0000 7f5a2ffff640 1 -- 10.20.193.48:0/2666261729 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5a4400fbd0 con 0x7f5a54091010 2026-02-12T18:12:53.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.184+0000 7f5a2ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.184+0000 7f5a2ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:12:53.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.184+0000 7f5a2ffff640 10 monclient: dump: 2026-02-12T18:12:53.207 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.207 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.207 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.207 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.208 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.208 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.208 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.208 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.208 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.208 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.208 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.208 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.208 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.208 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.208 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.208 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.184+0000 7f5a2ffff640 1 -- 10.20.193.48:0/2666261729 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f5a4400fd30 con 0x7f5a54091010 2026-02-12T18:12:53.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.184+0000 7f5a2ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:53.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.184+0000 7f5a2ffff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:12:53.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.184+0000 7f5a2ffff640 1 -- 10.20.193.48:0/2666261729 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5a54091010 msgr2=0x7f5a5410a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.184+0000 7f5a2ffff640 1 --2- 10.20.193.48:0/2666261729 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5a54091010 0x7f5a5410a1e0 secure :-1 s=READY pgs=312 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a5410b490 tx=0x7f5a44011ca0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.184+0000 7f5a2ffff640 1 -- 10.20.193.48:0/2666261729 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5a54091010 msgr2=0x7f5a5410a1e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:53.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.184+0000 7f5a2ffff640 1 --2- 10.20.193.48:0/2666261729 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5a54091010 0x7f5a5410a1e0 secure :-1 s=CLOSED pgs=312 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a5410b490 tx=0x7f5a44011ca0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.185+0000 7f5a53fff640 1 --2- 10.20.193.48:0/2666261729 >> v2:10.20.193.111:6812/977811348 conn(0x7f5a2403f800 0x7f5a2405fcb0 secure :-1 s=READY pgs=339 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a48005a20 tx=0x7f5a4800a040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.210 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.187+0000 7f5a59b0c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:12:53.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.188+0000 7f5a59b0c640 1 --2- 10.20.193.48:0/2666261729 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5a54120680 0x7f5a5410a720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.188+0000 7f5a59b0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.188+0000 7f5a59b0c640 1 -- 10.20.193.48:0/2666261729 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f5a54050410 con 0x7f5a54120680 2026-02-12T18:12:53.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.188+0000 7f5a52ffd640 1 --2- 10.20.193.48:0/2666261729 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5a54120680 0x7f5a5410a720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.188+0000 7f5a52ffd640 10 monclient: get_auth_request con 0x7f5a54120680 auth_method 0 2026-02-12T18:12:53.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.188+0000 7f5a52ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.188+0000 7f5a52ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.188+0000 7f5a52ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.188+0000 7f5a52ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.188+0000 7f5a52ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.188+0000 7f5a52ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.188+0000 7f5a52ffd640 10 monclient(hunting): handle_auth_done global_id 35885 payload 824 2026-02-12T18:12:53.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.188+0000 7f5a52ffd640 1 -- 10.20.193.48:0/2666261729 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5a54057e00 con 0x7f5a54120680 2026-02-12T18:12:53.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.190+0000 7f5a52ffd640 1 -- 10.20.193.48:0/2666261729 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5a54120680 msgr2=0x7f5a5410a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.190+0000 7f5a52ffd640 1 --2- 10.20.193.48:0/2666261729 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5a54120680 0x7f5a5410a720 secure :-1 s=READY pgs=313 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a5410b490 tx=0x7f5a440047e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.190+0000 7f5a2ffff640 1 -- 10.20.193.48:0/2666261729 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5a44005e70 con 0x7f5a54120680 2026-02-12T18:12:53.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.190+0000 7f5a2ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.190+0000 7f5a2ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:12:53.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.190+0000 7f5a2ffff640 10 monclient: dump: 2026-02-12T18:12:53.212 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.212 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.212 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.212 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.212 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.212 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.212 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.212 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.212 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.213 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.213 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.213 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.213 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.213 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.213 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.213 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.190+0000 7f5a2ffff640 1 -- 10.20.193.48:0/2666261729 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10015 (secure 0 0 0) 0x7f5a440227e0 con 0x7f5a54120680 2026-02-12T18:12:53.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.190+0000 7f5a2ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:12:53.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.190+0000 7f5a2ffff640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:12:53.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.190+0000 7f5a2ffff640 1 -- 10.20.193.48:0/2666261729 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5a54120680 msgr2=0x7f5a5410a720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.190+0000 7f5a2ffff640 1 --2- 10.20.193.48:0/2666261729 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5a54120680 0x7f5a5410a720 secure :-1 s=READY pgs=313 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a5410b490 tx=0x7f5a440047e0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.190+0000 7f5a2ffff640 1 -- 10.20.193.48:0/2666261729 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5a54120680 msgr2=0x7f5a5410a720 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:53.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.190+0000 7f5a2ffff640 1 --2- 10.20.193.48:0/2666261729 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5a54120680 0x7f5a5410a720 secure :-1 s=CLOSED pgs=313 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a5410b490 tx=0x7f5a440047e0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.214 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:12:53.214 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:12:53.214 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:12:53.214 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:12:53.214 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 68, 2026-02-12T18:12:53.214 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 428023, 2026-02-12T18:12:53.214 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:12:53.214 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:12:53.214 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:12:53.214 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:12:53.214 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:12:53.214 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:12:53.215 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:12:53.215 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:12:53.215 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:12:53.215 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:12:53.215 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.215 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 3, 2026-02-12T18:12:53.215 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:53.215 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:12:53.215 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:12:53.215 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.215 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.215 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.215 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.215 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.215 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.215 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.215 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.216 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.216 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.216 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.216 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.216 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.216 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.216 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:12:53.216 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:12:53.216 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.216 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.216 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.216 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.216 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.216 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.216 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.216 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.216 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.217 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.217 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.217 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.217 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.217 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.217 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.217 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:12:53.217 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:12:53.217 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:12:53.217 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:12:53.217 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:12:53.217 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:12:53.217 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:53.217 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:53.217 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:12:53.217 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:12:53.217 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:12:53.218 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:12:53.218 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:12:53.218 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:12:53.218 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:12:53.218 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:53.218 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:12:53.218 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.218 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.218 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.218 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.218 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.218 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.218 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.218 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.218 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.218 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.218 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.218 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.218 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.219 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.219 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:12:53.219 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.219 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:12:53.219 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.219 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:12:53.219 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:12:53.219 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.219 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.219 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.219 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.219 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:12:53.219 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.219 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.219 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.219 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.219 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:12:53.219 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.219 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.219 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.220 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.220 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:12:53.220 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:12:53.220 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.220 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.220 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:12:53.220 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.220 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.220 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.220 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:12:53.220 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:12:53.220 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.220 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.220 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.220 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.220 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:12:53.220 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.220 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.220 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.220 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.221 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:12:53.221 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.221 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.221 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.221 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.221 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:12:53.221 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:12:53.221 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.221 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.221 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:12:53.221 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.221 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.221 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.221 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:12:53.221 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:12:53.221 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.221 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.221 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.221 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.221 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:12:53.222 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.222 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.222 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.222 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.222 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:12:53.222 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.222 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.222 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.222 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.222 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:12:53.222 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:12:53.222 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.222 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.222 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:12:53.222 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.222 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.222 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.222 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:12:53.222 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:12:53.222 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.222 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.222 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.222 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.223 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:12:53.223 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.223 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.223 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.223 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.223 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:12:53.223 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.223 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.223 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.223 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.223 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:12:53.223 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:12:53.223 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.223 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.223 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:12:53.223 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.223 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.223 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.223 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:12:53.223 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:12:53.223 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.223 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.224 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.224 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.224 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:12:53.224 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.224 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.224 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.224 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.224 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:12:53.224 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.224 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.224 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.224 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.224 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:12:53.224 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:12:53.224 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.224 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.224 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:53.224 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.224 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.224 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.224 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:12:53.224 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:12:53.225 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.225 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.225 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.225 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.225 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:12:53.225 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.225 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.225 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.225 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.225 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:12:53.225 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.225 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.225 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.225 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.225 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:12:53.225 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:12:53.225 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.225 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.225 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:12:53.225 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.225 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.225 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.225 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:12:53.226 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:12:53.226 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.226 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.226 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.226 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.226 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:12:53.226 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.226 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.226 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.226 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.226 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:12:53.226 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.226 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.226 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.226 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.226 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:12:53.226 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:12:53.226 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.226 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.226 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:53.226 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.226 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.227 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.227 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:12:53.227 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:12:53.227 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.227 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.227 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.227 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.227 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:12:53.227 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.227 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.227 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.227 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.227 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:12:53.227 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.227 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.227 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.227 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.227 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:12:53.227 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:12:53.227 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.227 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.227 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:12:53.227 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.228 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.228 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.228 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:12:53.228 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:12:53.228 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.228 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.228 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.228 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.228 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:12:53.228 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.228 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.228 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.228 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.228 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:12:53.228 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.228 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.228 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.228 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.228 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:12:53.228 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:12:53.228 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.228 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.228 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:12:53.228 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.229 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.229 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.229 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.229 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:12:53.229 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:12:53.229 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.229 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:53.229 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:53.229 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:53.229 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.229 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.229 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:12:53.229 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.229 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:53.229 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:53.229 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:12:53.229 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.229 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.229 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.229 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:12:53.229 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:12:53.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.190+0000 7f5a59b0c640 1 -- 10.20.193.48:0/2666261729 >> v2:10.20.193.111:6812/977811348 conn(0x7f5a2403f800 msgr2=0x7f5a2405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.190+0000 7f5a59b0c640 1 --2- 10.20.193.48:0/2666261729 >> v2:10.20.193.111:6812/977811348 conn(0x7f5a2403f800 0x7f5a2405fcb0 secure :-1 s=READY pgs=339 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a48005a20 tx=0x7f5a4800a040 comp rx=0 tx=0).stop 2026-02-12T18:12:53.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.190+0000 7f5a59b0c640 10 monclient: shutdown 2026-02-12T18:12:53.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.190+0000 7f5a59b0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:53.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.190+0000 7f5a59b0c640 1 -- 10.20.193.48:0/2666261729 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5a5405d550 msgr2=0x7f5a5412fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.190+0000 7f5a59b0c640 1 --2- 10.20.193.48:0/2666261729 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5a5405d550 0x7f5a5412fbb0 secure :-1 s=READY pgs=278 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5a400099a0 tx=0x7f5a40004770 comp rx=0 tx=0).stop 2026-02-12T18:12:53.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.190+0000 7f5a53fff640 1 -- 10.20.193.48:0/2666261729 reap_dead start 2026-02-12T18:12:53.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.190+0000 7f5a53fff640 1 -- 10.20.193.48:0/2666261729 reap_dead start 2026-02-12T18:12:53.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.190+0000 7f5a59b0c640 1 -- 10.20.193.48:0/2666261729 shutdown_connections 2026-02-12T18:12:53.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.190+0000 7f5a59b0c640 1 -- 10.20.193.48:0/2666261729 >> 10.20.193.48:0/2666261729 conn(0x7f5a540546a0 msgr2=0x7f5a5413d190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:53.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.191+0000 7f5a59b0c640 1 -- 10.20.193.48:0/2666261729 shutdown_connections 2026-02-12T18:12:53.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.191+0000 7f5a59b0c640 1 -- 10.20.193.48:0/2666261729 wait complete. 2026-02-12T18:12:53.231 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:12:53.231 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2026-02-12T18:12:53.231 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T18:12:53.296 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.295+0000 7f514e10c640 10 monclient: get_monmap_and_config 2026-02-12T18:12:53.296 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.295+0000 7f514e10c640 10 monclient: build_initial_monmap 2026-02-12T18:12:53.296 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.295+0000 7f514e10c640 10 monclient: monmap: 2026-02-12T18:12:53.296 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:53.297 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.297 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:12:53.296456+0000 2026-02-12T18:12:53.297 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:12:53.296456+0000 2026-02-12T18:12:53.297 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:53.297 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.297 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:12:53.297 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:12:53.297 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:53.297 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:53.297 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:53.297 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:53.297 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:53.297 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:53.297 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:53.297 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:12:53.297 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:12:53.297 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.303 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.295+0000 7f514e10c640 1 Processor -- start 2026-02-12T18:12:53.303 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.295+0000 7f514e10c640 1 -- start start 2026-02-12T18:12:53.303 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.295+0000 7f514e10c640 10 monclient: init 2026-02-12T18:12:53.303 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f514e10c640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:53.303 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f514e10c640 10 monclient: _add_conns ranks=[8,7,3,1,9,6,10,4,2,5,0] 2026-02-12T18:12:53.303 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f514e10c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f514805d550 0x7f514805d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.303 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f514e10c640 10 monclient(hunting): picked mon.noname-e con 0x7f514805d550 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:12:53.303 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f514e10c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f514805de60 0x7f5148141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.303 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f514e10c640 10 monclient(hunting): picked mon.noname-i con 0x7f514805de60 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:12:53.303 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f514e10c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f514813ef60 0x7f51481424e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.303 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f514e10c640 10 monclient(hunting): picked mon.noname-g con 0x7f514813ef60 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:12:53.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f514e10c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f514e10c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f514808d390 con 0x7f514813ef60 2026-02-12T18:12:53.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f514e10c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f514e10c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f514808d5a0 con 0x7f514805de60 2026-02-12T18:12:53.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f514e10c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f514e10c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f51480580e0 con 0x7f514805d550 2026-02-12T18:12:53.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f514e10c640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:53.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f514e10c640 10 monclient(hunting): authenticate will time out at 1012.022156s 2026-02-12T18:12:53.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f51477fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f514805d550 0x7f514805d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f51477fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f514805d550 0x7f514805d920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:57432/0 (socket says 10.20.193.48:57432) 2026-02-12T18:12:53.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f51477fe640 1 -- 10.20.193.48:0/366633754 learned_addr learned my addr 10.20.193.48:0/366633754 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:53.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f51477fe640 10 monclient(hunting): get_auth_request con 0x7f514805d550 auth_method 0 2026-02-12T18:12:53.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f51477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f51477fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f51477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f51477fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f51477fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f51477fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f5147fff640 1 --2- 10.20.193.48:0/366633754 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f514813ef60 0x7f51481424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f5146ffd640 1 --2- 10.20.193.48:0/366633754 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f514805de60 0x7f5148141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f5147fff640 10 monclient(hunting): get_auth_request con 0x7f514813ef60 auth_method 0 2026-02-12T18:12:53.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f5147fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f5147fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f5147fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f5146ffd640 10 monclient(hunting): get_auth_request con 0x7f514805de60 auth_method 0 2026-02-12T18:12:53.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f5146ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f5146ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f5146ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f51477fe640 10 monclient(hunting): handle_auth_done global_id 94265 payload 274 2026-02-12T18:12:53.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f51477fe640 1 -- 10.20.193.48:0/366633754 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f514805de60 msgr2=0x7f5148141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:53.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f51477fe640 1 --2- 10.20.193.48:0/366633754 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f514805de60 0x7f5148141fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f51477fe640 1 -- 10.20.193.48:0/366633754 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f514813ef60 msgr2=0x7f51481424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:53.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f51477fe640 1 --2- 10.20.193.48:0/366633754 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f514813ef60 0x7f51481424e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f51477fe640 10 monclient: _finish_hunting 0 2026-02-12T18:12:53.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f51477fe640 1 monclient: found mon.noname-e 2026-02-12T18:12:53.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f51477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:53.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f51477fe640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:12:53.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.296+0000 7f51477fe640 1 -- 10.20.193.48:0/366633754 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f514804dc20 con 0x7f514805d550 2026-02-12T18:12:53.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f51477fe640 1 -- 10.20.193.48:0/366633754 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f514805d550 msgr2=0x7f514805d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f51477fe640 1 --2- 10.20.193.48:0/366633754 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f514805d550 0x7f514805d920 secure :-1 s=READY pgs=29 gs=1 cs=0 l=1 c_cookie=15232026799066096906 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f51340098d0 tx=0x7f513402ee20 comp rx=0 tx=0).ready entity=mon.8 client_cookie=d36307abc790a50a server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f51467fc640 1 -- 10.20.193.48:0/366633754 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5134035340 con 0x7f514805d550 2026-02-12T18:12:53.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f51467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f51467fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:12:53.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f51467fc640 10 monclient: dump: 2026-02-12T18:12:53.306 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.306 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.306 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.307 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.307 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.307 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.307 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.307 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.307 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.307 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.307 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.307 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.307 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.307 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.307 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.307 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f51467fc640 10 monclient: _finish_auth 0 2026-02-12T18:12:53.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f51467fc640 10 monclient: _check_auth_tickets 2026-02-12T18:12:53.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f51467fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:53.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f51467fc640 1 -- 10.20.193.48:0/366633754 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51340354c0 con 0x7f514805d550 2026-02-12T18:12:53.308 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f514e10c640 5 monclient: authenticate success, global_id 94265 2026-02-12T18:12:53.308 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f514e10c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:12:53.308 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f51467fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:53.308 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f51467fc640 1 -- 10.20.193.48:0/366633754 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5134035af0 con 0x7f514805d550 2026-02-12T18:12:53.308 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f51467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.308 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f51467fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:12:53.308 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f51467fc640 10 monclient: dump: 2026-02-12T18:12:53.308 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.308 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.308 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.308 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.308 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.308 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.308 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.308 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.308 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.308 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.309 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.309 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.309 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.309 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.309 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.309 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f514e10c640 10 monclient: get_monmap_and_config success 2026-02-12T18:12:53.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f514e10c640 4 set_mon_vals no callback set 2026-02-12T18:12:53.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f514e10c640 10 monclient: shutdown 2026-02-12T18:12:53.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f514e10c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:53.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f514e10c640 1 -- 10.20.193.48:0/366633754 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f514805d550 msgr2=0x7f514805d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f514e10c640 1 --2- 10.20.193.48:0/366633754 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f514805d550 0x7f514805d920 secure :-1 s=READY pgs=29 gs=1 cs=0 l=1 c_cookie=15232026799066096906 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f51340098d0 tx=0x7f513402ee20 comp rx=0 tx=0).stop 2026-02-12T18:12:53.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f514e10c640 1 -- 10.20.193.48:0/366633754 shutdown_connections 2026-02-12T18:12:53.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f514e10c640 1 --2- 10.20.193.48:0/366633754 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f514813ef60 0x7f51481424e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f514e10c640 1 --2- 10.20.193.48:0/366633754 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f514805de60 0x7f5148141fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f514e10c640 1 --2- 10.20.193.48:0/366633754 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f514805d550 0x7f514805d920 unknown :-1 s=CLOSED pgs=29 gs=1 cs=0 l=1 c_cookie=15232026799066096906 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.310 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f514e10c640 1 -- 10.20.193.48:0/366633754 >> 10.20.193.48:0/366633754 conn(0x7f51480546a0 msgr2=0x7f5148054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:53.310 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f514e10c640 1 -- 10.20.193.48:0/366633754 shutdown_connections 2026-02-12T18:12:53.310 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.299+0000 7f514e10c640 1 -- 10.20.193.48:0/366633754 wait complete. 2026-02-12T18:12:53.310 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f514e10c640 10 monclient: build_initial_monmap 2026-02-12T18:12:53.310 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f514e10c640 10 monclient: monmap: 2026-02-12T18:12:53.310 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:53.310 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:12:53.310 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:12:53.310 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:12:53.310 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:53.310 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.310 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:12:53.310 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:12:53.310 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:53.310 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:53.310 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:53.310 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:53.310 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:53.311 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:53.311 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:53.311 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f514e10c640 1 Processor -- start 2026-02-12T18:12:53.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f514e10c640 1 -- start start 2026-02-12T18:12:53.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f514e10c640 10 monclient: init 2026-02-12T18:12:53.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f514e10c640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:53.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f514e10c640 10 monclient: _add_conns ranks=[6,2,3,7,4,5,8,0,1] 2026-02-12T18:12:53.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f514e10c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f514805d550 0x7f514812f760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f514e10c640 10 monclient(hunting): picked mon.noname-d con 0x7f514805d550 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:12:53.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f514e10c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f514805de60 0x7f5148109760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f514e10c640 10 monclient(hunting): picked mon.noname-b con 0x7f514805de60 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:12:53.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f514e10c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f514813ef60 0x7f5148109ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f514e10c640 10 monclient(hunting): picked mon.noname-g con 0x7f514813ef60 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:12:53.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f514e10c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.311 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f514e10c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f514810cab0 con 0x7f514805de60 2026-02-12T18:12:53.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f514e10c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f514e10c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f514813db40 con 0x7f514813ef60 2026-02-12T18:12:53.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f514e10c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f514e10c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f5148120890 con 0x7f514805d550 2026-02-12T18:12:53.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f514e10c640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:53.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f514e10c640 10 monclient(hunting): authenticate will time out at 1012.026644s 2026-02-12T18:12:53.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f51477fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f514805d550 0x7f514812f760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f5146ffd640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f514805de60 0x7f5148109760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f51477fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f514805d550 0x7f514812f760 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:59452/0 (socket says 10.20.193.48:59452) 2026-02-12T18:12:53.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f51477fe640 1 -- 10.20.193.48:0/2663459639 learned_addr learned my addr 10.20.193.48:0/2663459639 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:53.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f51477fe640 10 monclient(hunting): get_auth_request con 0x7f514805d550 auth_method 0 2026-02-12T18:12:53.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f51477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f51477fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f51477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f5146ffd640 10 monclient(hunting): get_auth_request con 0x7f514805de60 auth_method 0 2026-02-12T18:12:53.312 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f5146ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f5146ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f5146ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f51477fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f51477fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f51477fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f5147fff640 1 --2- 10.20.193.48:0/2663459639 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f514813ef60 0x7f5148109ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f5146ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f5146ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f5146ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f5147fff640 10 monclient(hunting): get_auth_request con 0x7f514813ef60 auth_method 0 2026-02-12T18:12:53.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f5147fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f5147fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f5147fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f5147fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f5147fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f5147fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f51477fe640 10 monclient(hunting): handle_auth_done global_id 5865 payload 824 2026-02-12T18:12:53.313 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f51477fe640 1 -- 10.20.193.48:0/2663459639 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f514813ef60 msgr2=0x7f5148109ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.314 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f51477fe640 1 --2- 10.20.193.48:0/2663459639 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f514813ef60 0x7f5148109ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.314 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f51477fe640 1 -- 10.20.193.48:0/2663459639 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f514805de60 msgr2=0x7f5148109760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.314 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f51477fe640 1 --2- 10.20.193.48:0/2663459639 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f514805de60 0x7f5148109760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.314 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f51477fe640 10 monclient: _finish_hunting 0 2026-02-12T18:12:53.314 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f51477fe640 1 monclient: found mon.noname-d 2026-02-12T18:12:53.314 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f51477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:53.314 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f51477fe640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:12:53.314 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.300+0000 7f51477fe640 1 -- 10.20.193.48:0/2663459639 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51340094f0 con 0x7f514805d550 2026-02-12T18:12:53.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f51477fe640 1 -- 10.20.193.48:0/2663459639 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f514805d550 msgr2=0x7f514812f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f51477fe640 1 --2- 10.20.193.48:0/2663459639 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f514805d550 0x7f514812f760 secure :-1 s=READY pgs=279 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5134004740 tx=0x7f5134004770 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f5123fff640 1 -- 10.20.193.48:0/2663459639 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5134035e00 con 0x7f514805d550 2026-02-12T18:12:53.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f5123fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f5123fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:12:53.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f5123fff640 10 monclient: dump: 2026-02-12T18:12:53.318 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.318 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.318 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.319 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.319 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.319 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.319 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.319 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.319 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.319 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.319 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.319 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.319 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.319 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.319 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.319 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f5123fff640 10 monclient: _finish_auth 0 2026-02-12T18:12:53.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f5123fff640 10 monclient: _check_auth_tickets 2026-02-12T18:12:53.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f5123fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:53.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f5123fff640 1 -- 10.20.193.48:0/2663459639 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5134037900 con 0x7f514805d550 2026-02-12T18:12:53.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f5123fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:53.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f5123fff640 1 -- 10.20.193.48:0/2663459639 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5134040410 con 0x7f514805d550 2026-02-12T18:12:53.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f5123fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f5123fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:12:53.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f5145ffb640 4 set_mon_vals no callback set 2026-02-12T18:12:53.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f5123fff640 10 monclient: dump: 2026-02-12T18:12:53.320 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.320 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.320 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.320 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.320 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.320 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.320 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.320 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.320 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.320 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.320 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.321 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.321 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.321 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.321 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.321 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f514e10c640 5 monclient: authenticate success, global_id 5865 2026-02-12T18:12:53.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f514e10c640 10 monclient: _renew_subs 2026-02-12T18:12:53.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f514e10c640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:12:53.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f514e10c640 1 -- 10.20.193.48:0/2663459639 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5148124260 con 0x7f514805d550 2026-02-12T18:12:53.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f514e10c640 10 monclient: _renew_subs 2026-02-12T18:12:53.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f514e10c640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:12:53.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f514e10c640 1 -- 10.20.193.48:0/2663459639 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f514810b870 con 0x7f514805d550 2026-02-12T18:12:53.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f514e10c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:53.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f514e10c640 1 --2- 10.20.193.48:0/2663459639 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5148091010 0x7f514810a1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f514e10c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f514e10c640 1 -- 10.20.193.48:0/2663459639 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f514810ba30 con 0x7f5148091010 2026-02-12T18:12:53.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f5146ffd640 1 --2- 10.20.193.48:0/2663459639 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5148091010 0x7f514810a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f5146ffd640 10 monclient: get_auth_request con 0x7f5148091010 auth_method 0 2026-02-12T18:12:53.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f5146ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f5146ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.303+0000 7f5146ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.304+0000 7f5146ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.304+0000 7f5146ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.304+0000 7f5146ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.304+0000 7f5146ffd640 10 monclient(hunting): handle_auth_done global_id 64444 payload 824 2026-02-12T18:12:53.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.304+0000 7f5146ffd640 1 -- 10.20.193.48:0/2663459639 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f514805e310 con 0x7f5148091010 2026-02-12T18:12:53.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.304+0000 7f5123fff640 1 -- 10.20.193.48:0/2663459639 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f5134046020 con 0x7f514805d550 2026-02-12T18:12:53.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.304+0000 7f5123fff640 1 --2- 10.20.193.48:0/2663459639 >> v2:10.20.193.111:6812/977811348 conn(0x7f511803f800 0x7f511805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.304+0000 7f5123fff640 1 -- 10.20.193.48:0/2663459639 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(221..221 src has 190..221) ==== 3897+0+0 (secure 0 0 0) 0x7f5134077e80 con 0x7f514805d550 2026-02-12T18:12:53.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.304+0000 7f5147fff640 1 --2- 10.20.193.48:0/2663459639 >> v2:10.20.193.111:6812/977811348 conn(0x7f511803f800 0x7f511805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.304+0000 7f5147fff640 10 monclient: get_auth_request con 0x7f511803f800 auth_method 0 2026-02-12T18:12:53.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.306+0000 7f5146ffd640 1 -- 10.20.193.48:0/2663459639 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5148091010 msgr2=0x7f514810a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.306+0000 7f5146ffd640 1 --2- 10.20.193.48:0/2663459639 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5148091010 0x7f514810a1e0 secure :-1 s=READY pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f514805c6b0 tx=0x7f5138011ca0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.323 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.306+0000 7f5123fff640 1 -- 10.20.193.48:0/2663459639 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5138011ec0 con 0x7f5148091010 2026-02-12T18:12:53.323 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.306+0000 7f5123fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.323 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.306+0000 7f5123fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:12:53.323 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.306+0000 7f5123fff640 10 monclient: dump: 2026-02-12T18:12:53.323 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.323 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.323 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.323 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.323 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.323 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.323 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.323 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.323 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.323 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.323 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.323 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.323 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.324 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.324 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.324 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.306+0000 7f5123fff640 1 -- 10.20.193.48:0/2663459639 <== mon.4 v2:10.20.193.48:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f5138004450 con 0x7f5148091010 2026-02-12T18:12:53.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.306+0000 7f5123fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:53.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.306+0000 7f5123fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:12:53.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.306+0000 7f5123fff640 1 -- 10.20.193.48:0/2663459639 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5148091010 msgr2=0x7f514810a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.306+0000 7f5123fff640 1 --2- 10.20.193.48:0/2663459639 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5148091010 0x7f514810a1e0 secure :-1 s=READY pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f514805c6b0 tx=0x7f5138011ca0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.306+0000 7f5123fff640 1 -- 10.20.193.48:0/2663459639 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5148091010 msgr2=0x7f514810a1e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:53.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.306+0000 7f5123fff640 1 --2- 10.20.193.48:0/2663459639 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5148091010 0x7f514810a1e0 secure :-1 s=CLOSED pgs=106 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f514805c6b0 tx=0x7f5138011ca0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.307+0000 7f5147fff640 1 --2- 10.20.193.48:0/2663459639 >> v2:10.20.193.111:6812/977811348 conn(0x7f511803f800 0x7f511805fcb0 secure :-1 s=READY pgs=340 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5148090780 tx=0x7f513c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.309+0000 7f514e10c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:12:53.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.309+0000 7f514e10c640 1 --2- 10.20.193.48:0/2663459639 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f514810a720 0x7f51480588e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.309+0000 7f514e10c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.309+0000 7f514e10c640 1 -- 10.20.193.48:0/2663459639 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f514805f140 con 0x7f514810a720 2026-02-12T18:12:53.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.309+0000 7f5146ffd640 1 --2- 10.20.193.48:0/2663459639 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f514810a720 0x7f51480588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.309+0000 7f5146ffd640 10 monclient: get_auth_request con 0x7f514810a720 auth_method 0 2026-02-12T18:12:53.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.309+0000 7f5146ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.309+0000 7f5146ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.309+0000 7f5146ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.309+0000 7f5146ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.309+0000 7f5146ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.309+0000 7f5146ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.310+0000 7f5146ffd640 10 monclient(hunting): handle_auth_done global_id 64453 payload 824 2026-02-12T18:12:53.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.310+0000 7f5146ffd640 1 -- 10.20.193.48:0/2663459639 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5148057e00 con 0x7f514810a720 2026-02-12T18:12:53.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.312+0000 7f5146ffd640 1 -- 10.20.193.48:0/2663459639 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f514810a720 msgr2=0x7f51480588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.312+0000 7f5146ffd640 1 --2- 10.20.193.48:0/2663459639 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f514810a720 0x7f51480588e0 secure :-1 s=READY pgs=107 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f514805c6b0 tx=0x7f5138004770 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.312+0000 7f5123fff640 1 -- 10.20.193.48:0/2663459639 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5138025070 con 0x7f514810a720 2026-02-12T18:12:53.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.312+0000 7f5123fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.312+0000 7f5123fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:12:53.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.312+0000 7f5123fff640 10 monclient: dump: 2026-02-12T18:12:53.325 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.325 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.326 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.326 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.326 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.326 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.326 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.326 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.326 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.326 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.326 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.326 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.326 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.326 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.326 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.326 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.312+0000 7f5123fff640 1 -- 10.20.193.48:0/2663459639 <== mon.4 v2:10.20.193.48:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10182 (secure 0 0 0) 0x7f513800fd60 con 0x7f514810a720 2026-02-12T18:12:53.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.312+0000 7f5123fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:12:53.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.312+0000 7f5123fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:12:53.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.312+0000 7f5123fff640 1 -- 10.20.193.48:0/2663459639 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f514810a720 msgr2=0x7f51480588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.312+0000 7f5123fff640 1 --2- 10.20.193.48:0/2663459639 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f514810a720 0x7f51480588e0 secure :-1 s=READY pgs=107 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f514805c6b0 tx=0x7f5138004770 comp rx=0 tx=0).stop 2026-02-12T18:12:53.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.312+0000 7f5123fff640 1 -- 10.20.193.48:0/2663459639 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f514810a720 msgr2=0x7f51480588e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:53.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.312+0000 7f5123fff640 1 --2- 10.20.193.48:0/2663459639 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f514810a720 0x7f51480588e0 secure :-1 s=CLOSED pgs=107 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f514805c6b0 tx=0x7f5138004770 comp rx=0 tx=0).stop 2026-02-12T18:12:53.327 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:12:53.327 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:12:53.327 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:12:53.327 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:12:53.327 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 68, 2026-02-12T18:12:53.327 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 154099, 2026-02-12T18:12:53.327 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:12:53.327 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:12:53.327 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:12:53.327 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:12:53.328 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:12:53.328 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:12:53.328 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:12:53.328 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:12:53.328 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:12:53.328 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:12:53.328 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.328 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 4, 2026-02-12T18:12:53.328 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:53.328 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:12:53.328 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:12:53.328 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.328 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.328 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.328 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.328 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.328 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.328 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.329 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.329 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.329 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.329 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.329 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.329 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.329 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.329 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:12:53.329 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:12:53.329 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.329 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.329 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.329 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.329 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.329 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.329 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.329 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.329 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.329 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.330 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.330 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.330 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.330 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.330 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.330 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:12:53.330 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:12:53.330 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:12:53.330 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:12:53.330 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:12:53.330 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:12:53.330 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:53.330 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:53.330 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:12:53.330 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:12:53.330 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:12:53.330 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:12:53.330 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:12:53.331 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:12:53.331 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:12:53.331 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:53.331 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:12:53.331 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.331 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.331 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.331 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.331 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.331 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.331 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.331 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.331 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.331 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.331 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.331 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.331 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.331 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.331 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:12:53.331 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.332 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:12:53.332 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.332 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:12:53.332 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:12:53.332 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.332 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.332 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.332 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.332 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:12:53.332 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.332 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.332 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.332 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.332 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:12:53.332 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.332 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.332 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.333 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.333 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:12:53.333 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:12:53.333 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.333 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.333 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:12:53.333 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.333 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.333 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.333 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:12:53.333 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:12:53.333 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.333 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.333 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.333 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.333 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:12:53.333 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.333 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.333 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.333 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.334 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:12:53.334 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.334 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.334 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.334 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.334 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:12:53.334 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:12:53.334 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.334 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.334 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:12:53.334 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.334 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.334 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.334 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:12:53.334 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:12:53.334 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.334 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.334 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.334 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.334 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:12:53.334 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.335 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.335 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.335 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.335 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:12:53.335 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.335 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.335 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.335 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.335 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:12:53.335 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:12:53.335 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.335 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.335 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:12:53.335 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.335 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.335 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.335 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:12:53.335 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:12:53.335 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.335 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.335 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.335 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.336 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:12:53.336 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.336 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.336 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.336 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.336 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:12:53.336 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.336 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.336 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.336 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.336 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:12:53.336 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:12:53.336 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.336 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.336 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:12:53.336 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.336 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.336 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.336 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:12:53.336 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:12:53.336 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.336 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.336 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.337 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.337 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:12:53.337 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.337 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.337 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.337 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.337 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:12:53.337 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.337 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.337 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.337 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.337 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:12:53.337 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:12:53.337 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.337 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.337 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:53.337 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.337 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.337 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.337 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:12:53.337 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:12:53.337 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.337 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.337 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.338 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.338 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:12:53.338 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.338 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.338 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.338 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.338 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:12:53.338 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.338 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.338 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.338 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.338 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:12:53.338 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:12:53.338 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.338 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.338 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:12:53.338 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.338 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.338 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.338 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:12:53.338 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:12:53.338 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.338 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.338 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.339 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.339 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:12:53.339 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.339 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.339 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.339 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.339 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:12:53.339 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.339 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.339 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.339 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.339 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:12:53.339 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:12:53.339 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.339 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.339 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:53.339 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.339 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.339 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.339 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:12:53.339 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:12:53.339 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.339 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.340 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.340 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.340 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:12:53.340 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.340 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.340 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.340 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.340 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:12:53.340 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.340 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.340 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.340 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.340 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:12:53.340 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:12:53.340 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.340 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.340 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:12:53.340 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.340 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.340 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.340 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:12:53.340 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:12:53.340 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.341 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.341 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.341 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.341 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:12:53.341 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.341 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.341 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.341 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.341 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:12:53.341 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.341 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.341 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.341 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.341 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:12:53.341 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:12:53.341 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.341 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.341 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:12:53.341 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.341 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.341 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.341 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.341 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:12:53.341 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:12:53.342 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.342 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:53.342 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:53.342 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:53.342 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.342 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.342 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:12:53.342 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.342 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:53.342 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:53.342 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:53.342 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.342 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.342 INFO:teuthology.orchestra.run.trial048.stdout: "mgr": [ 2026-02-12T18:12:53.342 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.342 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:53.342 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:53.342 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:53.342 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.342 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.342 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.342 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:12:53.342 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:12:53.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.312+0000 7f514e10c640 1 -- 10.20.193.48:0/2663459639 >> v2:10.20.193.111:6812/977811348 conn(0x7f511803f800 msgr2=0x7f511805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.312+0000 7f514e10c640 1 --2- 10.20.193.48:0/2663459639 >> v2:10.20.193.111:6812/977811348 conn(0x7f511803f800 0x7f511805fcb0 secure :-1 s=READY pgs=340 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5148090780 tx=0x7f513c009040 comp rx=0 tx=0).stop 2026-02-12T18:12:53.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.312+0000 7f514e10c640 10 monclient: shutdown 2026-02-12T18:12:53.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.312+0000 7f514e10c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:53.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.312+0000 7f514e10c640 1 -- 10.20.193.48:0/2663459639 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f514805d550 msgr2=0x7f514812f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.312+0000 7f514e10c640 1 --2- 10.20.193.48:0/2663459639 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f514805d550 0x7f514812f760 secure :-1 s=READY pgs=279 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5134004740 tx=0x7f5134004770 comp rx=0 tx=0).stop 2026-02-12T18:12:53.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.312+0000 7f5147fff640 1 -- 10.20.193.48:0/2663459639 reap_dead start 2026-02-12T18:12:53.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.312+0000 7f5147fff640 1 -- 10.20.193.48:0/2663459639 reap_dead start 2026-02-12T18:12:53.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.312+0000 7f514e10c640 1 -- 10.20.193.48:0/2663459639 shutdown_connections 2026-02-12T18:12:53.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.312+0000 7f514e10c640 1 -- 10.20.193.48:0/2663459639 >> 10.20.193.48:0/2663459639 conn(0x7f51480546a0 msgr2=0x7f514813c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:53.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.312+0000 7f514e10c640 1 -- 10.20.193.48:0/2663459639 shutdown_connections 2026-02-12T18:12:53.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.312+0000 7f514e10c640 1 -- 10.20.193.48:0/2663459639 wait complete. 2026-02-12T18:12:53.344 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:12:53.344 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2026-02-12T18:12:53.344 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2026-02-12T18:12:53.410 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.409+0000 7fafab2cc640 10 monclient: get_monmap_and_config 2026-02-12T18:12:53.410 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.409+0000 7fafab2cc640 10 monclient: build_initial_monmap 2026-02-12T18:12:53.410 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.409+0000 7fafab2cc640 10 monclient: monmap: 2026-02-12T18:12:53.410 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:53.410 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.410 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:12:53.410218+0000 2026-02-12T18:12:53.410 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:12:53.410218+0000 2026-02-12T18:12:53.410 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:53.410 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.410 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:12:53.410 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:12:53.411 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:53.411 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:53.411 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:53.411 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:53.411 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:53.411 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:53.411 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:53.411 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:12:53.411 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:12:53.411 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.409+0000 7fafab2cc640 1 Processor -- start 2026-02-12T18:12:53.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.409+0000 7fafab2cc640 1 -- start start 2026-02-12T18:12:53.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.409+0000 7fafab2cc640 10 monclient: init 2026-02-12T18:12:53.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.409+0000 7fafab2cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:53.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.409+0000 7fafab2cc640 10 monclient: _add_conns ranks=[6,3,8,0,4,10,7,1,2,5,9] 2026-02-12T18:12:53.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.409+0000 7fafab2cc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fafa405c950 0x7fafa405cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.409+0000 7fafab2cc640 10 monclient(hunting): picked mon.noname-d con 0x7fafa405c950 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:12:53.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.409+0000 7fafab2cc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fafa405e490 0x7fafa405d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.409+0000 7fafab2cc640 10 monclient(hunting): picked mon.noname-g con 0x7fafa405e490 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:12:53.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.409+0000 7fafab2cc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fafa413db70 0x7fafa413dfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.409+0000 7fafab2cc640 10 monclient(hunting): picked mon.noname-e con 0x7fafa413db70 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:12:53.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.409+0000 7fafab2cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.409+0000 7fafab2cc640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fafa405ddd0 con 0x7fafa405e490 2026-02-12T18:12:53.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.409+0000 7fafab2cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.409+0000 7fafab2cc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fafa405d7a0 con 0x7fafa405c950 2026-02-12T18:12:53.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.409+0000 7fafab2cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.409+0000 7fafab2cc640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fafa4092990 con 0x7fafa413db70 2026-02-12T18:12:53.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.409+0000 7fafab2cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:53.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.409+0000 7fafab2cc640 10 monclient(hunting): authenticate will time out at 1012.135955s 2026-02-12T18:12:53.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9842640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fafa413db70 0x7fafa413dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9041640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fafa405c950 0x7fafa405cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9842640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fafa413db70 0x7fafa413dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:57442/0 (socket says 10.20.193.48:57442) 2026-02-12T18:12:53.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9842640 1 -- 10.20.193.48:0/3090361680 learned_addr learned my addr 10.20.193.48:0/3090361680 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:53.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9842640 10 monclient(hunting): get_auth_request con 0x7fafa413db70 auth_method 0 2026-02-12T18:12:53.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9842640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9842640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9842640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9041640 10 monclient(hunting): get_auth_request con 0x7fafa405c950 auth_method 0 2026-02-12T18:12:53.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9041640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9041640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9041640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa8840640 1 --2- 10.20.193.48:0/3090361680 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fafa405e490 0x7fafa405d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9842640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9842640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9842640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa8840640 10 monclient(hunting): get_auth_request con 0x7fafa405e490 auth_method 0 2026-02-12T18:12:53.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa8840640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa8840640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa8840640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9041640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9041640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9041640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa8840640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa8840640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa8840640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9842640 10 monclient(hunting): handle_auth_done global_id 94274 payload 274 2026-02-12T18:12:53.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9842640 1 -- 10.20.193.48:0/3090361680 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fafa405c950 msgr2=0x7fafa405cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:53.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9842640 1 --2- 10.20.193.48:0/3090361680 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fafa405c950 0x7fafa405cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9842640 1 -- 10.20.193.48:0/3090361680 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fafa405e490 msgr2=0x7fafa405d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:53.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9842640 1 --2- 10.20.193.48:0/3090361680 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fafa405e490 0x7fafa405d260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9842640 10 monclient: _finish_hunting 0 2026-02-12T18:12:53.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9842640 1 monclient: found mon.noname-e 2026-02-12T18:12:53.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9842640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:53.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9842640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:12:53.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.410+0000 7fafa9842640 1 -- 10.20.193.48:0/3090361680 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa404dc20 con 0x7fafa413db70 2026-02-12T18:12:53.422 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.412+0000 7fafa9842640 1 -- 10.20.193.48:0/3090361680 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fafa413db70 msgr2=0x7fafa413dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.422 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.412+0000 7fafa9842640 1 --2- 10.20.193.48:0/3090361680 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fafa413db70 0x7fafa413dfc0 secure :-1 s=READY pgs=30 gs=2 cs=0 l=1 c_cookie=535787112243316011 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fafa000a9b0 tx=0x7fafa002fef0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=76f7f8a347ec52b server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.422 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.412+0000 7faf93fff640 1 -- 10.20.193.48:0/3090361680 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fafa0030b70 con 0x7fafa413db70 2026-02-12T18:12:53.422 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.412+0000 7faf93fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.422 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.412+0000 7faf93fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:12:53.422 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.412+0000 7faf93fff640 10 monclient: dump: 2026-02-12T18:12:53.422 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.422 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.422 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.422 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.422 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.422 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.423 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.423 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.423 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.423 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.423 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.423 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.423 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.423 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.423 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.423 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.412+0000 7faf93fff640 10 monclient: _finish_auth 0 2026-02-12T18:12:53.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.412+0000 7faf93fff640 10 monclient: _check_auth_tickets 2026-02-12T18:12:53.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.412+0000 7faf93fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:53.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.412+0000 7faf93fff640 1 -- 10.20.193.48:0/3090361680 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa0030cf0 con 0x7fafa413db70 2026-02-12T18:12:53.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.412+0000 7fafab2cc640 5 monclient: authenticate success, global_id 94274 2026-02-12T18:12:53.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.412+0000 7fafab2cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:12:53.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.412+0000 7faf93fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:53.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.412+0000 7faf93fff640 1 -- 10.20.193.48:0/3090361680 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fafa0030e60 con 0x7fafa413db70 2026-02-12T18:12:53.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.412+0000 7faf93fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.412+0000 7faf93fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:12:53.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.412+0000 7faf93fff640 10 monclient: dump: 2026-02-12T18:12:53.424 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.424 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.424 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.424 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.424 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.424 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.424 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.424 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.424 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.424 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.424 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.424 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.424 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.424 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.424 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.424 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.413+0000 7fafab2cc640 10 monclient: get_monmap_and_config success 2026-02-12T18:12:53.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.413+0000 7fafab2cc640 4 set_mon_vals no callback set 2026-02-12T18:12:53.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.413+0000 7fafab2cc640 10 monclient: shutdown 2026-02-12T18:12:53.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.413+0000 7fafab2cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:53.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.413+0000 7fafab2cc640 1 -- 10.20.193.48:0/3090361680 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fafa413db70 msgr2=0x7fafa413dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.413+0000 7fafab2cc640 1 --2- 10.20.193.48:0/3090361680 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fafa413db70 0x7fafa413dfc0 secure :-1 s=READY pgs=30 gs=2 cs=0 l=1 c_cookie=535787112243316011 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fafa000a9b0 tx=0x7fafa002fef0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.413+0000 7fafab2cc640 1 -- 10.20.193.48:0/3090361680 shutdown_connections 2026-02-12T18:12:53.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.413+0000 7fafab2cc640 1 --2- 10.20.193.48:0/3090361680 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fafa413db70 0x7fafa413dfc0 unknown :-1 s=CLOSED pgs=30 gs=2 cs=0 l=1 c_cookie=535787112243316011 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.413+0000 7fafab2cc640 1 --2- 10.20.193.48:0/3090361680 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fafa405e490 0x7fafa405d260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.413+0000 7fafab2cc640 1 --2- 10.20.193.48:0/3090361680 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fafa405c950 0x7fafa405cd20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.413+0000 7fafab2cc640 1 -- 10.20.193.48:0/3090361680 >> 10.20.193.48:0/3090361680 conn(0x7fafa40548a0 msgr2=0x7fafa4097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:53.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.413+0000 7fafab2cc640 1 -- 10.20.193.48:0/3090361680 shutdown_connections 2026-02-12T18:12:53.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.413+0000 7fafab2cc640 1 -- 10.20.193.48:0/3090361680 wait complete. 2026-02-12T18:12:53.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.413+0000 7fafab2cc640 10 monclient: build_initial_monmap 2026-02-12T18:12:53.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.413+0000 7fafab2cc640 10 monclient: monmap: 2026-02-12T18:12:53.425 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:53.425 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:12:53.425 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:12:53.426 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:12:53.426 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:53.426 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.426 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:12:53.426 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:12:53.426 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:53.426 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:53.426 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:53.426 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:53.426 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:53.426 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:53.426 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:53.426 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.413+0000 7fafab2cc640 1 Processor -- start 2026-02-12T18:12:53.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.413+0000 7fafab2cc640 1 -- start start 2026-02-12T18:12:53.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafab2cc640 10 monclient: init 2026-02-12T18:12:53.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafab2cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:53.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafab2cc640 10 monclient: _add_conns ranks=[0,7,5,8,2,1,3,4,6] 2026-02-12T18:12:53.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafab2cc640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fafa405c950 0x7fafa412ca60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafab2cc640 10 monclient(hunting): picked mon.noname-a con 0x7fafa405c950 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:12:53.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafab2cc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fafa405e490 0x7fafa408d480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafab2cc640 10 monclient(hunting): picked mon.noname-i con 0x7fafa405e490 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:12:53.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafab2cc640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fafa413db70 0x7fafa413ce90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafab2cc640 10 monclient(hunting): picked mon.noname-h con 0x7fafa413db70 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:12:53.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafab2cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafab2cc640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fafa4141700 con 0x7fafa405c950 2026-02-12T18:12:53.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafab2cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafab2cc640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fafa408af40 con 0x7fafa413db70 2026-02-12T18:12:53.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafab2cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafab2cc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fafa413e360 con 0x7fafa405e490 2026-02-12T18:12:53.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafab2cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:53.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafab2cc640 10 monclient(hunting): authenticate will time out at 1012.140254s 2026-02-12T18:12:53.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa9041640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fafa405c950 0x7fafa412ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa9041640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fafa405c950 0x7fafa412ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:42344/0 (socket says 10.20.193.48:42344) 2026-02-12T18:12:53.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa9041640 1 -- 10.20.193.48:0/3444404072 learned_addr learned my addr 10.20.193.48:0/3444404072 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:53.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa9041640 10 monclient(hunting): get_auth_request con 0x7fafa405c950 auth_method 0 2026-02-12T18:12:53.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa9041640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa9041640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa9041640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa9041640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa9041640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa9041640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa9842640 1 --2- 10.20.193.48:0/3444404072 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fafa413db70 0x7fafa413ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa8840640 1 --2- 10.20.193.48:0/3444404072 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fafa405e490 0x7fafa408d480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa8840640 10 monclient(hunting): get_auth_request con 0x7fafa405e490 auth_method 0 2026-02-12T18:12:53.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa8840640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa8840640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa8840640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa9842640 10 monclient(hunting): get_auth_request con 0x7fafa413db70 auth_method 0 2026-02-12T18:12:53.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa9842640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa9842640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa9842640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa8840640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa8840640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa8840640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa9041640 10 monclient(hunting): handle_auth_done global_id 6228 payload 824 2026-02-12T18:12:53.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa9041640 1 -- 10.20.193.48:0/3444404072 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fafa405e490 msgr2=0x7fafa408d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa9041640 1 --2- 10.20.193.48:0/3444404072 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fafa405e490 0x7fafa408d480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa9041640 1 -- 10.20.193.48:0/3444404072 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fafa413db70 msgr2=0x7fafa413ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa9041640 1 --2- 10.20.193.48:0/3444404072 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fafa413db70 0x7fafa413ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa9041640 10 monclient: _finish_hunting 0 2026-02-12T18:12:53.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa9041640 1 monclient: found mon.noname-a 2026-02-12T18:12:53.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa9041640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:53.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa9041640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:12:53.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa9041640 1 -- 10.20.193.48:0/3444404072 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa000a5d0 con 0x7fafa405c950 2026-02-12T18:12:53.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.414+0000 7fafa9842640 1 --2- 10.20.193.48:0/3444404072 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fafa413db70 0x7fafa413ce90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:12:53.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.416+0000 7fafa9041640 1 -- 10.20.193.48:0/3444404072 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fafa405c950 msgr2=0x7fafa412ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.416+0000 7fafa9041640 1 --2- 10.20.193.48:0/3444404072 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fafa405c950 0x7fafa412ca60 secure :-1 s=READY pgs=476 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf940093f0 tx=0x7faf9400ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.416+0000 7faf91ffb640 1 -- 10.20.193.48:0/3444404072 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7faf94013470 con 0x7fafa405c950 2026-02-12T18:12:53.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.416+0000 7faf91ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.416+0000 7faf91ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:12:53.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.416+0000 7faf91ffb640 10 monclient: dump: 2026-02-12T18:12:53.429 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.429 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.430 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.430 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.430 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.430 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.430 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.430 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.430 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.430 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.430 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.430 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.430 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.430 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.430 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.430 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.416+0000 7faf91ffb640 10 monclient: _finish_auth 0 2026-02-12T18:12:53.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.416+0000 7faf91ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:12:53.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.416+0000 7faf91ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:53.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.416+0000 7faf91ffb640 1 -- 10.20.193.48:0/3444404072 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf940135f0 con 0x7fafa405c950 2026-02-12T18:12:53.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.416+0000 7faf91ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:53.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.416+0000 7faf91ffb640 1 -- 10.20.193.48:0/3444404072 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7faf94013760 con 0x7fafa405c950 2026-02-12T18:12:53.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.416+0000 7fafab2cc640 5 monclient: authenticate success, global_id 6228 2026-02-12T18:12:53.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.416+0000 7fafab2cc640 10 monclient: _renew_subs 2026-02-12T18:12:53.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.416+0000 7fafab2cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:12:53.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.416+0000 7fafab2cc640 1 -- 10.20.193.48:0/3444404072 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafa4143b50 con 0x7fafa405c950 2026-02-12T18:12:53.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.416+0000 7faf937fe640 4 set_mon_vals no callback set 2026-02-12T18:12:53.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.416+0000 7faf91ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.416+0000 7faf91ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:12:53.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.416+0000 7faf91ffb640 10 monclient: dump: 2026-02-12T18:12:53.431 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.431 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.431 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.431 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.431 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.431 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.431 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.431 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.431 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.431 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.432 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.432 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.432 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.432 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.432 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.432 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.416+0000 7fafab2cc640 10 monclient: _renew_subs 2026-02-12T18:12:53.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.416+0000 7fafab2cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:12:53.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.416+0000 7fafab2cc640 1 -- 10.20.193.48:0/3444404072 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafa408ac60 con 0x7fafa405c950 2026-02-12T18:12:53.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.417+0000 7fafab2cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:53.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.417+0000 7fafab2cc640 1 --2- 10.20.193.48:0/3444404072 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fafa408d9c0 0x7fafa413d3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.417+0000 7fafab2cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.417+0000 7fafab2cc640 1 -- 10.20.193.48:0/3444404072 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fafa408a8e0 con 0x7fafa408d9c0 2026-02-12T18:12:53.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.417+0000 7fafa8840640 1 --2- 10.20.193.48:0/3444404072 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fafa408d9c0 0x7fafa413d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.417+0000 7fafa8840640 10 monclient: get_auth_request con 0x7fafa408d9c0 auth_method 0 2026-02-12T18:12:53.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.417+0000 7fafa8840640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.417+0000 7fafa8840640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.417+0000 7fafa8840640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.417+0000 7fafa8840640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.417+0000 7fafa8840640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.417+0000 7fafa8840640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.417+0000 7faf91ffb640 1 -- 10.20.193.48:0/3444404072 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7faf94011070 con 0x7fafa405c950 2026-02-12T18:12:53.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.417+0000 7fafa8840640 10 monclient(hunting): handle_auth_done global_id 5883 payload 824 2026-02-12T18:12:53.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.417+0000 7fafa8840640 1 -- 10.20.193.48:0/3444404072 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fafa4140710 con 0x7fafa408d9c0 2026-02-12T18:12:53.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.417+0000 7faf91ffb640 1 --2- 10.20.193.48:0/3444404072 >> v2:10.20.193.111:6812/977811348 conn(0x7faf7403f720 0x7faf7405fbd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.417+0000 7faf91ffb640 1 -- 10.20.193.48:0/3444404072 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(221..221 src has 190..221) ==== 3897+0+0 (secure 0 0 0) 0x7faf94052bb0 con 0x7fafa405c950 2026-02-12T18:12:53.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.418+0000 7fafa9842640 1 --2- 10.20.193.48:0/3444404072 >> v2:10.20.193.111:6812/977811348 conn(0x7faf7403f720 0x7faf7405fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.418+0000 7fafa9842640 10 monclient: get_auth_request con 0x7faf7403f720 auth_method 0 2026-02-12T18:12:53.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.419+0000 7fafa8840640 1 -- 10.20.193.48:0/3444404072 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fafa408d9c0 msgr2=0x7fafa413d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.419+0000 7fafa8840640 1 --2- 10.20.193.48:0/3444404072 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fafa408d9c0 0x7fafa413d3d0 secure :-1 s=READY pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf98004740 tx=0x7faf98011d90 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.420+0000 7faf91ffb640 1 -- 10.20.193.48:0/3444404072 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7faf98014900 con 0x7fafa408d9c0 2026-02-12T18:12:53.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.420+0000 7faf91ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.420+0000 7faf91ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:12:53.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.420+0000 7faf91ffb640 10 monclient: dump: 2026-02-12T18:12:53.434 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.434 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.434 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.434 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.434 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.434 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.434 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.434 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.434 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.434 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.434 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.434 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.434 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.434 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.434 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.434 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.420+0000 7faf91ffb640 1 -- 10.20.193.48:0/3444404072 <== mon.6 v2:10.20.193.48:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7faf98014440 con 0x7fafa408d9c0 2026-02-12T18:12:53.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.420+0000 7faf91ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:53.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.420+0000 7faf91ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:12:53.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.420+0000 7faf91ffb640 1 -- 10.20.193.48:0/3444404072 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fafa408d9c0 msgr2=0x7fafa413d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.420+0000 7faf91ffb640 1 --2- 10.20.193.48:0/3444404072 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fafa408d9c0 0x7fafa413d3d0 secure :-1 s=READY pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf98004740 tx=0x7faf98011d90 comp rx=0 tx=0).stop 2026-02-12T18:12:53.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.420+0000 7faf91ffb640 1 -- 10.20.193.48:0/3444404072 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fafa408d9c0 msgr2=0x7fafa413d3d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:53.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.420+0000 7faf91ffb640 1 --2- 10.20.193.48:0/3444404072 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fafa408d9c0 0x7fafa413d3d0 secure :-1 s=CLOSED pgs=280 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf98004740 tx=0x7faf98011d90 comp rx=0 tx=0).stop 2026-02-12T18:12:53.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.420+0000 7fafa9842640 1 --2- 10.20.193.48:0/3444404072 >> v2:10.20.193.111:6812/977811348 conn(0x7faf7403f720 0x7faf7405fbd0 secure :-1 s=READY pgs=341 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fafa000a900 tx=0x7fafa0007f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.423+0000 7fafab2cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:12:53.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.423+0000 7fafab2cc640 1 --2- 10.20.193.48:0/3444404072 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fafa4129500 0x7fafa4129900 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.423+0000 7fafab2cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.423+0000 7fafab2cc640 1 -- 10.20.193.48:0/3444404072 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fafa4050410 con 0x7fafa4129500 2026-02-12T18:12:53.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.423+0000 7fafa8840640 1 --2- 10.20.193.48:0/3444404072 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fafa4129500 0x7fafa4129900 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.423+0000 7fafa8840640 10 monclient: get_auth_request con 0x7fafa4129500 auth_method 0 2026-02-12T18:12:53.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.423+0000 7fafa8840640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.423+0000 7fafa8840640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.423+0000 7fafa8840640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.423+0000 7fafa8840640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.423+0000 7fafa8840640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.423+0000 7fafa8840640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.423+0000 7fafa8840640 10 monclient(hunting): handle_auth_done global_id 5892 payload 824 2026-02-12T18:12:53.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.423+0000 7fafa8840640 1 -- 10.20.193.48:0/3444404072 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fafa4097de0 con 0x7fafa4129500 2026-02-12T18:12:53.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.426+0000 7fafa8840640 1 -- 10.20.193.48:0/3444404072 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fafa4129500 msgr2=0x7fafa4129900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.426+0000 7fafa8840640 1 --2- 10.20.193.48:0/3444404072 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fafa4129500 0x7fafa4129900 secure :-1 s=READY pgs=281 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf98019000 tx=0x7faf98004770 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.426+0000 7faf91ffb640 1 -- 10.20.193.48:0/3444404072 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7faf98022880 con 0x7fafa4129500 2026-02-12T18:12:53.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.426+0000 7faf91ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.426+0000 7faf91ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:12:53.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.426+0000 7faf91ffb640 10 monclient: dump: 2026-02-12T18:12:53.437 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.437 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.438 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.438 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.438 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.438 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.438 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.438 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.438 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.438 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.438 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.438 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.438 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.438 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.438 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.438 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.426+0000 7faf91ffb640 1 -- 10.20.193.48:0/3444404072 <== mon.6 v2:10.20.193.48:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10182 (secure 0 0 0) 0x7faf98026070 con 0x7fafa4129500 2026-02-12T18:12:53.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.426+0000 7faf91ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:12:53.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.426+0000 7faf91ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:12:53.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.426+0000 7faf91ffb640 1 -- 10.20.193.48:0/3444404072 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fafa4129500 msgr2=0x7fafa4129900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.426+0000 7faf91ffb640 1 --2- 10.20.193.48:0/3444404072 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fafa4129500 0x7fafa4129900 secure :-1 s=READY pgs=281 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf98019000 tx=0x7faf98004770 comp rx=0 tx=0).stop 2026-02-12T18:12:53.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.426+0000 7faf91ffb640 1 -- 10.20.193.48:0/3444404072 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fafa4129500 msgr2=0x7fafa4129900 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:53.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.426+0000 7faf91ffb640 1 --2- 10.20.193.48:0/3444404072 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fafa4129500 0x7fafa4129900 secure :-1 s=CLOSED pgs=281 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf98019000 tx=0x7faf98004770 comp rx=0 tx=0).stop 2026-02-12T18:12:53.439 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:12:53.439 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:12:53.439 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:12:53.439 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:12:53.439 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 68, 2026-02-12T18:12:53.439 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 428252, 2026-02-12T18:12:53.439 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:12:53.439 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:12:53.439 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:12:53.439 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:12:53.440 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:12:53.440 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:12:53.440 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:12:53.440 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:12:53.440 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:12:53.440 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:12:53.440 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.440 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 4, 2026-02-12T18:12:53.440 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:53.440 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:12:53.440 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:12:53.440 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.440 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.440 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.440 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.440 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.440 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.440 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.441 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.441 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.441 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.441 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.441 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.441 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.441 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.441 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:12:53.441 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:12:53.441 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.441 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.441 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.441 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.441 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.441 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.441 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.441 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.441 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.441 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.441 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.442 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.442 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.442 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.442 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.442 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:12:53.442 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:12:53.442 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:12:53.442 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:12:53.442 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:12:53.442 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:12:53.442 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:53.442 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:53.442 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:12:53.442 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:12:53.442 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:12:53.442 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:12:53.442 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:12:53.442 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:12:53.442 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:12:53.442 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:53.443 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:12:53.443 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.443 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.443 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.443 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.443 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.443 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.443 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.443 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.443 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.443 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.443 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.443 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.443 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.443 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.443 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:12:53.443 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.443 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:12:53.443 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.443 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:12:53.444 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:12:53.444 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.444 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.444 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.444 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.444 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:12:53.444 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.444 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.444 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.444 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.444 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:12:53.444 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.444 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.444 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.444 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.444 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:12:53.444 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:12:53.444 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.444 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.444 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:12:53.444 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.445 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.445 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.445 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:12:53.445 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:12:53.445 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.445 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.445 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.445 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.445 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:12:53.445 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.445 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.445 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.445 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.445 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:12:53.445 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.445 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.445 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.445 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.445 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:12:53.445 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:12:53.445 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.446 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.446 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:12:53.446 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.446 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.446 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.446 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:12:53.446 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:12:53.446 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.446 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.446 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.446 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.446 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:12:53.446 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.446 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.446 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.446 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.446 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:12:53.446 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.446 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.446 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.446 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.446 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:12:53.446 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:12:53.446 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.446 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.447 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:12:53.447 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.447 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.447 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.447 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:12:53.447 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:12:53.447 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.447 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.447 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.447 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.447 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:12:53.447 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.447 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.447 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.447 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.447 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:12:53.447 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.447 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.447 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.447 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.447 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:12:53.447 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:12:53.447 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.448 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.448 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:12:53.448 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.448 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.448 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.448 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:12:53.448 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:12:53.448 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.448 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.448 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.448 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.448 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:12:53.448 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.448 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.448 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.448 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.448 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:12:53.448 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.448 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.448 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.448 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.448 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:12:53.448 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:12:53.448 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.449 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.449 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:53.449 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.449 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.449 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.449 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:12:53.449 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:12:53.449 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.449 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.449 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.449 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.449 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:12:53.449 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.449 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.449 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.449 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.449 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:12:53.449 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.449 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.449 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.449 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.449 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:12:53.449 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:12:53.449 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.450 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.450 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:12:53.450 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.450 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.450 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.450 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:12:53.450 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:12:53.450 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.450 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.450 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.450 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.450 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:12:53.450 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.450 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.450 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.450 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.450 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:12:53.450 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.450 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.450 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.450 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.450 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:12:53.450 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:12:53.450 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.450 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.451 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:53.451 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.451 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.451 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.451 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:12:53.451 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:12:53.451 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.451 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.451 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.451 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.451 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:12:53.451 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.451 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.451 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.451 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.451 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:12:53.451 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.451 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.451 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.451 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.451 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:12:53.451 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:12:53.451 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.451 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.452 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:12:53.452 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.452 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.452 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.452 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:12:53.452 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:12:53.452 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.452 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.452 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.452 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.452 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:12:53.452 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.452 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.452 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.452 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.452 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:12:53.452 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.452 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.452 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.452 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.452 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:12:53.452 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:12:53.452 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.452 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.452 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:12:53.452 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.453 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.453 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.453 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.453 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:12:53.453 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:12:53.453 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.453 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:53.453 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:53.453 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:53.453 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.453 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.453 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:12:53.453 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.453 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:53.453 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:53.453 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:53.453 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.453 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.453 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:12:53.453 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.453 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:53.453 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:53.453 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:12:53.453 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.454 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.454 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.454 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:12:53.454 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:12:53.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.426+0000 7fafab2cc640 1 -- 10.20.193.48:0/3444404072 >> v2:10.20.193.111:6812/977811348 conn(0x7faf7403f720 msgr2=0x7faf7405fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.426+0000 7fafab2cc640 1 --2- 10.20.193.48:0/3444404072 >> v2:10.20.193.111:6812/977811348 conn(0x7faf7403f720 0x7faf7405fbd0 secure :-1 s=READY pgs=341 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fafa000a900 tx=0x7fafa0007f90 comp rx=0 tx=0).stop 2026-02-12T18:12:53.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.426+0000 7fafab2cc640 10 monclient: shutdown 2026-02-12T18:12:53.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.426+0000 7fafab2cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:53.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.426+0000 7fafab2cc640 1 -- 10.20.193.48:0/3444404072 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fafa405c950 msgr2=0x7fafa412ca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.426+0000 7fafab2cc640 1 --2- 10.20.193.48:0/3444404072 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fafa405c950 0x7fafa412ca60 secure :-1 s=READY pgs=476 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7faf940093f0 tx=0x7faf9400ed50 comp rx=0 tx=0).stop 2026-02-12T18:12:53.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.426+0000 7fafa9842640 1 -- 10.20.193.48:0/3444404072 reap_dead start 2026-02-12T18:12:53.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.426+0000 7fafa9842640 1 -- 10.20.193.48:0/3444404072 reap_dead start 2026-02-12T18:12:53.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.426+0000 7fafab2cc640 1 -- 10.20.193.48:0/3444404072 shutdown_connections 2026-02-12T18:12:53.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.426+0000 7fafab2cc640 1 -- 10.20.193.48:0/3444404072 >> 10.20.193.48:0/3444404072 conn(0x7fafa40548a0 msgr2=0x7fafa4093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:53.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.426+0000 7fafab2cc640 1 -- 10.20.193.48:0/3444404072 shutdown_connections 2026-02-12T18:12:53.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.426+0000 7fafab2cc640 1 -- 10.20.193.48:0/3444404072 wait complete. 2026-02-12T18:12:53.455 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:12:53.455 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2026-02-12T18:12:53.455 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2026-02-12T18:12:53.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.520+0000 7f5e990cc640 10 monclient: get_monmap_and_config 2026-02-12T18:12:53.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.520+0000 7f5e990cc640 10 monclient: build_initial_monmap 2026-02-12T18:12:53.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.520+0000 7f5e990cc640 10 monclient: monmap: 2026-02-12T18:12:53.522 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:53.522 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.522 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:12:53.521634+0000 2026-02-12T18:12:53.522 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:12:53.521634+0000 2026-02-12T18:12:53.522 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:53.522 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.522 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:12:53.522 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:12:53.522 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:53.522 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:53.522 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:53.522 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:53.522 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:53.522 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:53.522 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:53.522 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:12:53.522 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:12:53.522 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.520+0000 7f5e990cc640 1 Processor -- start 2026-02-12T18:12:53.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e990cc640 1 -- start start 2026-02-12T18:12:53.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e990cc640 10 monclient: init 2026-02-12T18:12:53.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e990cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:53.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e990cc640 10 monclient: _add_conns ranks=[5,4,2,8,7,9,10,0,1,3,6] 2026-02-12T18:12:53.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e990cc640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f5e9405d550 0x7f5e9405d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e990cc640 10 monclient(hunting): picked mon.noname-h con 0x7f5e9405d550 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:12:53.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e990cc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5e9405de60 0x7f5e94141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e990cc640 10 monclient(hunting): picked mon.noname-c con 0x7f5e9405de60 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:12:53.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e990cc640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5e9413ef60 0x7f5e941424e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e990cc640 10 monclient(hunting): picked mon.noname-b con 0x7f5e9413ef60 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:12:53.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e990cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e990cc640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f5e9408d390 con 0x7f5e9413ef60 2026-02-12T18:12:53.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e990cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e990cc640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f5e9408d5a0 con 0x7f5e9405de60 2026-02-12T18:12:53.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e990cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e990cc640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f5e940580e0 con 0x7f5e9405d550 2026-02-12T18:12:53.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e990cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:53.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e990cc640 10 monclient(hunting): authenticate will time out at 1012.247359s 2026-02-12T18:12:53.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92575640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5e9405de60 0x7f5e94141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92575640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5e9405de60 0x7f5e94141fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:48602/0 (socket says 10.20.193.48:48602) 2026-02-12T18:12:53.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92575640 1 -- 10.20.193.48:0/911823168 learned_addr learned my addr 10.20.193.48:0/911823168 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:53.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e93577640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5e9413ef60 0x7f5e941424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92575640 10 monclient(hunting): get_auth_request con 0x7f5e9405de60 auth_method 0 2026-02-12T18:12:53.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e93577640 10 monclient(hunting): get_auth_request con 0x7f5e9413ef60 auth_method 0 2026-02-12T18:12:53.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e93577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e93577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e93577640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92d76640 1 --2- 10.20.193.48:0/911823168 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f5e9405d550 0x7f5e9405d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92d76640 10 monclient(hunting): get_auth_request con 0x7f5e9405d550 auth_method 0 2026-02-12T18:12:53.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e93577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e93577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e93577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92575640 10 monclient(hunting): handle_auth_done global_id 64462 payload 274 2026-02-12T18:12:53.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92575640 1 -- 10.20.193.48:0/911823168 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f5e9405d550 msgr2=0x7f5e9405d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:53.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92575640 1 --2- 10.20.193.48:0/911823168 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f5e9405d550 0x7f5e9405d920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92575640 1 -- 10.20.193.48:0/911823168 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5e9413ef60 msgr2=0x7f5e941424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:53.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92575640 1 --2- 10.20.193.48:0/911823168 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5e9413ef60 0x7f5e941424e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92575640 10 monclient: _finish_hunting 0 2026-02-12T18:12:53.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92575640 1 monclient: found mon.noname-c 2026-02-12T18:12:53.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:53.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:12:53.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.521+0000 7f5e92575640 1 -- 10.20.193.48:0/911823168 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e9404dc20 con 0x7f5e9405de60 2026-02-12T18:12:53.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.524+0000 7f5e92575640 1 -- 10.20.193.48:0/911823168 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5e9405de60 msgr2=0x7f5e94141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.524+0000 7f5e92575640 1 --2- 10.20.193.48:0/911823168 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5e9405de60 0x7f5e94141fa0 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=5496455732667554819 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e7c0098d0 tx=0x7f5e7c02ee20 comp rx=0 tx=0).ready entity=mon.4 client_cookie=4c47555e0d4f1c03 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e91d74640 1 -- 10.20.193.48:0/911823168 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5e7c035340 con 0x7f5e9405de60 2026-02-12T18:12:53.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e91d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e91d74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:12:53.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e91d74640 10 monclient: dump: 2026-02-12T18:12:53.528 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.528 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.528 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.528 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.528 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.528 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.528 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.528 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.528 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.528 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.529 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.529 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.529 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.529 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.529 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.529 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e91d74640 10 monclient: _finish_auth 0 2026-02-12T18:12:53.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e91d74640 10 monclient: _check_auth_tickets 2026-02-12T18:12:53.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e91d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:53.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e91d74640 1 -- 10.20.193.48:0/911823168 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e7c0354c0 con 0x7f5e9405de60 2026-02-12T18:12:53.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e91d74640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:53.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e990cc640 5 monclient: authenticate success, global_id 64462 2026-02-12T18:12:53.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e990cc640 10 monclient: get_monmap_and_config success 2026-02-12T18:12:53.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e990cc640 4 set_mon_vals no callback set 2026-02-12T18:12:53.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e91d74640 1 -- 10.20.193.48:0/911823168 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5e7c035630 con 0x7f5e9405de60 2026-02-12T18:12:53.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e91d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e91d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:12:53.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e91d74640 10 monclient: dump: 2026-02-12T18:12:53.529 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.529 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.529 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.530 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.530 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.530 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.530 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.530 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.530 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.530 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.530 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.530 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.530 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.530 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.530 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.530 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e990cc640 10 monclient: shutdown 2026-02-12T18:12:53.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e990cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:53.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e990cc640 1 -- 10.20.193.48:0/911823168 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5e9405de60 msgr2=0x7f5e94141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e990cc640 1 --2- 10.20.193.48:0/911823168 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5e9405de60 0x7f5e94141fa0 secure :-1 s=READY pgs=108 gs=1 cs=0 l=1 c_cookie=5496455732667554819 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e7c0098d0 tx=0x7f5e7c02ee20 comp rx=0 tx=0).stop 2026-02-12T18:12:53.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e990cc640 1 -- 10.20.193.48:0/911823168 shutdown_connections 2026-02-12T18:12:53.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e990cc640 1 --2- 10.20.193.48:0/911823168 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5e9413ef60 0x7f5e941424e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e990cc640 1 --2- 10.20.193.48:0/911823168 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5e9405de60 0x7f5e94141fa0 unknown :-1 s=CLOSED pgs=108 gs=1 cs=0 l=1 c_cookie=5496455732667554819 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e990cc640 1 --2- 10.20.193.48:0/911823168 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f5e9405d550 0x7f5e9405d920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e990cc640 1 -- 10.20.193.48:0/911823168 >> 10.20.193.48:0/911823168 conn(0x7f5e940546a0 msgr2=0x7f5e94054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:53.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e990cc640 1 -- 10.20.193.48:0/911823168 shutdown_connections 2026-02-12T18:12:53.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.526+0000 7f5e990cc640 1 -- 10.20.193.48:0/911823168 wait complete. 2026-02-12T18:12:53.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e990cc640 10 monclient: build_initial_monmap 2026-02-12T18:12:53.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e990cc640 10 monclient: monmap: 2026-02-12T18:12:53.534 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:53.534 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:12:53.534 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:12:53.535 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:12:53.535 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:53.535 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.535 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:12:53.535 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:12:53.535 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:53.535 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:53.535 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:53.535 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:53.535 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:53.535 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:53.535 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:53.535 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e990cc640 1 Processor -- start 2026-02-12T18:12:53.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e990cc640 1 -- start start 2026-02-12T18:12:53.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e990cc640 10 monclient: init 2026-02-12T18:12:53.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e990cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:53.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e990cc640 10 monclient: _add_conns ranks=[4,3,1,2,0,6,7,5,8] 2026-02-12T18:12:53.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e990cc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5e9405d550 0x7f5e9412d000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e990cc640 10 monclient(hunting): picked mon.noname-c con 0x7f5e9405d550 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:12:53.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e990cc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f5e9405de60 0x7f5e9412d540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e990cc640 10 monclient(hunting): picked mon.noname-g con 0x7f5e9405de60 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:12:53.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e990cc640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f5e9413ef60 0x7f5e9410aa90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e990cc640 10 monclient(hunting): picked mon.noname-f con 0x7f5e9413ef60 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:12:53.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e990cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e990cc640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5e9410c920 con 0x7f5e9413ef60 2026-02-12T18:12:53.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e990cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e990cc640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f5e9413da20 con 0x7f5e9405de60 2026-02-12T18:12:53.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e990cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e990cc640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f5e9410c0d0 con 0x7f5e9405d550 2026-02-12T18:12:53.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e990cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:53.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e990cc640 10 monclient(hunting): authenticate will time out at 1012.253915s 2026-02-12T18:12:53.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e92d76640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5e9405d550 0x7f5e9412d000 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e92d76640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5e9405d550 0x7f5e9412d000 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:48610/0 (socket says 10.20.193.48:48610) 2026-02-12T18:12:53.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e92d76640 1 -- 10.20.193.48:0/1758073401 learned_addr learned my addr 10.20.193.48:0/1758073401 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:53.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e92d76640 10 monclient(hunting): get_auth_request con 0x7f5e9405d550 auth_method 0 2026-02-12T18:12:53.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e92d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e92d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.527+0000 7f5e92d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e92d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e92d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e92d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e92575640 1 --2- 10.20.193.48:0/1758073401 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f5e9405de60 0x7f5e9412d540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e92575640 10 monclient(hunting): get_auth_request con 0x7f5e9405de60 auth_method 0 2026-02-12T18:12:53.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e92575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e92575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e92575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e93577640 1 --2- 10.20.193.48:0/1758073401 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f5e9413ef60 0x7f5e9410aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e93577640 10 monclient(hunting): get_auth_request con 0x7f5e9413ef60 auth_method 0 2026-02-12T18:12:53.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e93577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e93577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e93577640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e92575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e92575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e92575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e93577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e93577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e93577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e92d76640 10 monclient(hunting): handle_auth_done global_id 64471 payload 824 2026-02-12T18:12:53.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e92d76640 1 -- 10.20.193.48:0/1758073401 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f5e9405de60 msgr2=0x7f5e9412d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e92d76640 1 --2- 10.20.193.48:0/1758073401 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f5e9405de60 0x7f5e9412d540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e92d76640 1 -- 10.20.193.48:0/1758073401 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f5e9413ef60 msgr2=0x7f5e9410aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e92d76640 1 --2- 10.20.193.48:0/1758073401 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f5e9413ef60 0x7f5e9410aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e92d76640 10 monclient: _finish_hunting 0 2026-02-12T18:12:53.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e92d76640 1 monclient: found mon.noname-c 2026-02-12T18:12:53.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e92d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:53.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e92d76640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:12:53.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.528+0000 7f5e92d76640 1 -- 10.20.193.48:0/1758073401 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e7c0094f0 con 0x7f5e9405d550 2026-02-12T18:12:53.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.530+0000 7f5e92d76640 1 -- 10.20.193.48:0/1758073401 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5e9405d550 msgr2=0x7f5e9412d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.530+0000 7f5e92d76640 1 --2- 10.20.193.48:0/1758073401 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5e9405d550 0x7f5e9412d000 secure :-1 s=READY pgs=109 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e880093f0 tx=0x7f5e8800ed50 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.530+0000 7f5e737fe640 1 -- 10.20.193.48:0/1758073401 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5e8800cb50 con 0x7f5e9405d550 2026-02-12T18:12:53.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.530+0000 7f5e737fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.530+0000 7f5e737fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:12:53.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.530+0000 7f5e737fe640 10 monclient: dump: 2026-02-12T18:12:53.538 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.538 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.538 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.538 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.538 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.538 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.538 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.538 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.538 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.539 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.539 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.539 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.539 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.539 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.539 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.539 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.530+0000 7f5e737fe640 10 monclient: _finish_auth 0 2026-02-12T18:12:53.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.530+0000 7f5e737fe640 10 monclient: _check_auth_tickets 2026-02-12T18:12:53.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.530+0000 7f5e737fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:53.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.530+0000 7f5e737fe640 1 -- 10.20.193.48:0/1758073401 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5e8800ccd0 con 0x7f5e9405d550 2026-02-12T18:12:53.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.530+0000 7f5e737fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:53.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.530+0000 7f5e737fe640 1 -- 10.20.193.48:0/1758073401 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5e8800ce40 con 0x7f5e9405d550 2026-02-12T18:12:53.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.530+0000 7f5e990cc640 5 monclient: authenticate success, global_id 64471 2026-02-12T18:12:53.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.530+0000 7f5e990cc640 10 monclient: _renew_subs 2026-02-12T18:12:53.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.530+0000 7f5e990cc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:12:53.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.530+0000 7f5e990cc640 1 -- 10.20.193.48:0/1758073401 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e940904b0 con 0x7f5e9405d550 2026-02-12T18:12:53.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.530+0000 7f5e91573640 4 set_mon_vals no callback set 2026-02-12T18:12:53.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.530+0000 7f5e737fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.530+0000 7f5e737fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:12:53.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.530+0000 7f5e737fe640 10 monclient: dump: 2026-02-12T18:12:53.539 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.540 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.540 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.540 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.540 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.540 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.540 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.540 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.540 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.540 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.540 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.540 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.540 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.540 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.540 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.540 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.540 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.530+0000 7f5e990cc640 10 monclient: _renew_subs 2026-02-12T18:12:53.540 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.530+0000 7f5e990cc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:12:53.540 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.530+0000 7f5e990cc640 1 -- 10.20.193.48:0/1758073401 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e94121370 con 0x7f5e9405d550 2026-02-12T18:12:53.540 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.531+0000 7f5e737fe640 1 -- 10.20.193.48:0/1758073401 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f5e88011070 con 0x7f5e9405d550 2026-02-12T18:12:53.540 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.531+0000 7f5e990cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:53.540 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.531+0000 7f5e990cc640 1 --2- 10.20.193.48:0/1758073401 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5e94091010 0x7f5e940584c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.540 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.531+0000 7f5e990cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.531+0000 7f5e990cc640 1 -- 10.20.193.48:0/1758073401 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f5e940631f0 con 0x7f5e94091010 2026-02-12T18:12:53.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.531+0000 7f5e92575640 1 --2- 10.20.193.48:0/1758073401 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5e94091010 0x7f5e940584c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.531+0000 7f5e92575640 10 monclient: get_auth_request con 0x7f5e94091010 auth_method 0 2026-02-12T18:12:53.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.531+0000 7f5e92575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.531+0000 7f5e92575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.531+0000 7f5e92575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.531+0000 7f5e92575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.531+0000 7f5e737fe640 1 --2- 10.20.193.48:0/1758073401 >> v2:10.20.193.111:6812/977811348 conn(0x7f5e6003f7f0 0x7f5e6005fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.531+0000 7f5e92575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.531+0000 7f5e92575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.531+0000 7f5e737fe640 1 -- 10.20.193.48:0/1758073401 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(221..221 src has 190..221) ==== 3897+0+0 (secure 0 0 0) 0x7f5e88052b50 con 0x7f5e9405d550 2026-02-12T18:12:53.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.531+0000 7f5e92575640 10 monclient(hunting): handle_auth_done global_id 94283 payload 824 2026-02-12T18:12:53.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.531+0000 7f5e92575640 1 -- 10.20.193.48:0/1758073401 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5e94090330 con 0x7f5e94091010 2026-02-12T18:12:53.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.531+0000 7f5e93577640 1 --2- 10.20.193.48:0/1758073401 >> v2:10.20.193.111:6812/977811348 conn(0x7f5e6003f7f0 0x7f5e6005fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.531+0000 7f5e93577640 10 monclient: get_auth_request con 0x7f5e6003f7f0 auth_method 0 2026-02-12T18:12:53.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.534+0000 7f5e92575640 1 -- 10.20.193.48:0/1758073401 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5e94091010 msgr2=0x7f5e940584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.534+0000 7f5e92575640 1 --2- 10.20.193.48:0/1758073401 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5e94091010 0x7f5e940584c0 secure :-1 s=READY pgs=31 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e7c009820 tx=0x7f5e7c004770 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.534+0000 7f5e737fe640 1 -- 10.20.193.48:0/1758073401 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5e7c035c70 con 0x7f5e94091010 2026-02-12T18:12:53.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.534+0000 7f5e737fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.534+0000 7f5e737fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:12:53.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.534+0000 7f5e737fe640 10 monclient: dump: 2026-02-12T18:12:53.543 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.543 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.543 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.543 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.543 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.543 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.544 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.544 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.544 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.544 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.544 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.544 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.544 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.544 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.544 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.544 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.534+0000 7f5e93577640 1 --2- 10.20.193.48:0/1758073401 >> v2:10.20.193.111:6812/977811348 conn(0x7f5e6003f7f0 0x7f5e6005fca0 secure :-1 s=READY pgs=342 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e9408c770 tx=0x7f5e8400a2d0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.534+0000 7f5e737fe640 1 -- 10.20.193.48:0/1758073401 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f5e7c035dd0 con 0x7f5e94091010 2026-02-12T18:12:53.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.534+0000 7f5e737fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:53.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.534+0000 7f5e737fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:12:53.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.534+0000 7f5e737fe640 1 -- 10.20.193.48:0/1758073401 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5e94091010 msgr2=0x7f5e940584c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.534+0000 7f5e737fe640 1 --2- 10.20.193.48:0/1758073401 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5e94091010 0x7f5e940584c0 secure :-1 s=READY pgs=31 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e7c009820 tx=0x7f5e7c004770 comp rx=0 tx=0).stop 2026-02-12T18:12:53.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.534+0000 7f5e737fe640 1 -- 10.20.193.48:0/1758073401 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5e94091010 msgr2=0x7f5e940584c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:53.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.534+0000 7f5e737fe640 1 --2- 10.20.193.48:0/1758073401 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5e94091010 0x7f5e940584c0 secure :-1 s=CLOSED pgs=31 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e7c009820 tx=0x7f5e7c004770 comp rx=0 tx=0).stop 2026-02-12T18:12:53.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.537+0000 7f5e990cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:12:53.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.537+0000 7f5e990cc640 1 --2- 10.20.193.48:0/1758073401 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5e9412da80 0x7f5e94058a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.537+0000 7f5e990cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.537+0000 7f5e990cc640 1 -- 10.20.193.48:0/1758073401 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f5e94050410 con 0x7f5e9412da80 2026-02-12T18:12:53.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.537+0000 7f5e92575640 1 --2- 10.20.193.48:0/1758073401 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5e9412da80 0x7f5e94058a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.537+0000 7f5e92575640 10 monclient: get_auth_request con 0x7f5e9412da80 auth_method 0 2026-02-12T18:12:53.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.537+0000 7f5e92575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.537+0000 7f5e92575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.537+0000 7f5e92575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.537+0000 7f5e92575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.537+0000 7f5e92575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.537+0000 7f5e92575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.537+0000 7f5e92575640 10 monclient(hunting): handle_auth_done global_id 94292 payload 824 2026-02-12T18:12:53.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.537+0000 7f5e92575640 1 -- 10.20.193.48:0/1758073401 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5e9405e310 con 0x7f5e9412da80 2026-02-12T18:12:53.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.540+0000 7f5e92575640 1 -- 10.20.193.48:0/1758073401 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5e9412da80 msgr2=0x7f5e94058a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.540+0000 7f5e92575640 1 --2- 10.20.193.48:0/1758073401 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5e9412da80 0x7f5e94058a00 secure :-1 s=READY pgs=32 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e7c0098d0 tx=0x7f5e7c0092c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.540+0000 7f5e737fe640 1 -- 10.20.193.48:0/1758073401 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5e7c050070 con 0x7f5e9412da80 2026-02-12T18:12:53.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.540+0000 7f5e737fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.540+0000 7f5e737fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:12:53.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.540+0000 7f5e737fe640 10 monclient: dump: 2026-02-12T18:12:53.545 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.545 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.545 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.545 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.546 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.546 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.546 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.546 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.546 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.546 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.546 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.546 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.546 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.546 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.546 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.546 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.540+0000 7f5e737fe640 1 -- 10.20.193.48:0/1758073401 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7f5e7c040610 con 0x7f5e9412da80 2026-02-12T18:12:53.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.540+0000 7f5e737fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:12:53.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.540+0000 7f5e737fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:12:53.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.540+0000 7f5e737fe640 1 -- 10.20.193.48:0/1758073401 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5e9412da80 msgr2=0x7f5e94058a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.540+0000 7f5e737fe640 1 --2- 10.20.193.48:0/1758073401 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5e9412da80 0x7f5e94058a00 secure :-1 s=READY pgs=32 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e7c0098d0 tx=0x7f5e7c0092c0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.540+0000 7f5e737fe640 1 -- 10.20.193.48:0/1758073401 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5e9412da80 msgr2=0x7f5e94058a00 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:53.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.540+0000 7f5e737fe640 1 --2- 10.20.193.48:0/1758073401 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5e9412da80 0x7f5e94058a00 secure :-1 s=CLOSED pgs=32 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e7c0098d0 tx=0x7f5e7c0092c0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.547 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:12:53.547 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:12:53.547 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:12:53.547 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:12:53.547 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 68, 2026-02-12T18:12:53.547 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 19214, 2026-02-12T18:12:53.547 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:12:53.547 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:12:53.547 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:12:53.547 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:12:53.547 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:12:53.547 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:12:53.547 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:12:53.547 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:12:53.547 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:12:53.547 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:12:53.547 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.547 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 4, 2026-02-12T18:12:53.548 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:53.548 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:12:53.548 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:12:53.548 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.548 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.548 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.548 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.548 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.548 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.548 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.548 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.548 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.548 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.548 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.548 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.548 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.548 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.548 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:12:53.548 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:12:53.548 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.549 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.549 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.549 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.549 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.549 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.549 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.549 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.549 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.549 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.549 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.549 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.549 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.549 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.549 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.549 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:12:53.549 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:12:53.549 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:12:53.549 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:12:53.549 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:12:53.549 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:12:53.549 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:53.549 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:53.550 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:12:53.550 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:12:53.550 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:12:53.550 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:12:53.550 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:12:53.550 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:12:53.550 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:12:53.550 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:53.550 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:12:53.550 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.550 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.550 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.550 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.550 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.550 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.550 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.550 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.550 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.550 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.550 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.550 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.550 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.551 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.551 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:12:53.551 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.551 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:12:53.551 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.551 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:12:53.551 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:12:53.551 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.551 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.551 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.551 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.551 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:12:53.551 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.551 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.551 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.551 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.551 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:12:53.551 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.551 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.551 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.551 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.552 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:12:53.552 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:12:53.552 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.552 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.552 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:12:53.552 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.552 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.552 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.552 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:12:53.552 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:12:53.552 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.552 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.552 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.552 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.552 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:12:53.552 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.552 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.552 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.552 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.552 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:12:53.552 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.552 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.552 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.553 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.553 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:12:53.553 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:12:53.553 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.553 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.553 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:12:53.553 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.553 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.553 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.553 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:12:53.553 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:12:53.553 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.553 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.553 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.553 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.553 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:12:53.553 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.553 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.553 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.553 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.553 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:12:53.554 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.554 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.554 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.554 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.554 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:12:53.554 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:12:53.554 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.554 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.554 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:12:53.554 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.554 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.554 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.554 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:12:53.554 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:12:53.554 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.554 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.554 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.554 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.554 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:12:53.554 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.554 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.554 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.555 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.555 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:12:53.555 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.555 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.555 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.555 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.555 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:12:53.555 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:12:53.555 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.555 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.555 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:12:53.555 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.555 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.555 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.555 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:12:53.555 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:12:53.555 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.555 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.555 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.555 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.555 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:12:53.555 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.555 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.555 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.555 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.556 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:12:53.556 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.556 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.556 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.556 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.556 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:12:53.556 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:12:53.556 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.556 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.556 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:53.556 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.556 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.556 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.556 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:12:53.556 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:12:53.556 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.556 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.556 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.556 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.556 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:12:53.556 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.556 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.556 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.556 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.556 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:12:53.557 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.557 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.557 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.557 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.557 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:12:53.557 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:12:53.557 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.557 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.557 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:12:53.557 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.557 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.557 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.557 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:12:53.557 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:12:53.557 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.557 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.557 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.557 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.557 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:12:53.557 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.557 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.557 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.557 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.557 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:12:53.557 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.558 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.558 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.558 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.558 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:12:53.558 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:12:53.558 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.558 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.558 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:53.558 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.558 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.558 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.558 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:12:53.558 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:12:53.558 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.558 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.558 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.558 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.558 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:12:53.558 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.558 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.558 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.558 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.558 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:12:53.558 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.558 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.559 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:12:53.560 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:12:53.560 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.560 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.560 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:12:53.560 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.560 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.560 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.560 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.560 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:12:53.560 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:12:53.560 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.560 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:53.560 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:53.560 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:53.560 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.560 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.560 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:12:53.560 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.560 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:53.560 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:53.560 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:53.560 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.560 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.560 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.560 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:12:53.560 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:12:53.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.540+0000 7f5e990cc640 1 -- 10.20.193.48:0/1758073401 >> v2:10.20.193.111:6812/977811348 conn(0x7f5e6003f7f0 msgr2=0x7f5e6005fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.540+0000 7f5e990cc640 1 --2- 10.20.193.48:0/1758073401 >> v2:10.20.193.111:6812/977811348 conn(0x7f5e6003f7f0 0x7f5e6005fca0 secure :-1 s=READY pgs=342 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e9408c770 tx=0x7f5e8400a2d0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.540+0000 7f5e990cc640 10 monclient: shutdown 2026-02-12T18:12:53.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.540+0000 7f5e990cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:53.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.540+0000 7f5e990cc640 1 -- 10.20.193.48:0/1758073401 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5e9405d550 msgr2=0x7f5e9412d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.540+0000 7f5e990cc640 1 --2- 10.20.193.48:0/1758073401 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5e9405d550 0x7f5e9412d000 secure :-1 s=READY pgs=109 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5e880093f0 tx=0x7f5e8800ed50 comp rx=0 tx=0).stop 2026-02-12T18:12:53.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.540+0000 7f5e93577640 1 -- 10.20.193.48:0/1758073401 reap_dead start 2026-02-12T18:12:53.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.540+0000 7f5e93577640 1 -- 10.20.193.48:0/1758073401 reap_dead start 2026-02-12T18:12:53.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.540+0000 7f5e990cc640 1 -- 10.20.193.48:0/1758073401 shutdown_connections 2026-02-12T18:12:53.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.540+0000 7f5e990cc640 1 -- 10.20.193.48:0/1758073401 >> 10.20.193.48:0/1758073401 conn(0x7f5e940546a0 msgr2=0x7f5e9413d190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:53.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.540+0000 7f5e990cc640 1 -- 10.20.193.48:0/1758073401 shutdown_connections 2026-02-12T18:12:53.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.540+0000 7f5e990cc640 1 -- 10.20.193.48:0/1758073401 wait complete. 2026-02-12T18:12:53.562 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:12:53.562 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2026-02-12T18:12:53.562 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2026-02-12T18:12:53.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.627+0000 7fd593ccc640 10 monclient: get_monmap_and_config 2026-02-12T18:12:53.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.627+0000 7fd593ccc640 10 monclient: build_initial_monmap 2026-02-12T18:12:53.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.627+0000 7fd593ccc640 10 monclient: monmap: 2026-02-12T18:12:53.629 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:53.629 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.629 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:12:53.628733+0000 2026-02-12T18:12:53.629 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:12:53.628733+0000 2026-02-12T18:12:53.629 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:53.629 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.629 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:12:53.629 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:12:53.629 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:53.630 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:53.630 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:53.630 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:53.630 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:53.630 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:53.630 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:53.630 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:12:53.630 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:12:53.630 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd593ccc640 1 Processor -- start 2026-02-12T18:12:53.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd593ccc640 1 -- start start 2026-02-12T18:12:53.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd593ccc640 10 monclient: init 2026-02-12T18:12:53.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd593ccc640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:53.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd593ccc640 10 monclient: _add_conns ranks=[8,6,2,5,0,10,7,4,9,3,1] 2026-02-12T18:12:53.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd593ccc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd58c05d550 0x7fd58c05d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd593ccc640 10 monclient(hunting): picked mon.noname-e con 0x7fd58c05d550 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:12:53.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd593ccc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd58c05de60 0x7fd58c141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd593ccc640 10 monclient(hunting): picked mon.noname-d con 0x7fd58c05de60 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:12:53.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd593ccc640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd58c13ef60 0x7fd58c1424e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd593ccc640 10 monclient(hunting): picked mon.noname-b con 0x7fd58c13ef60 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:12:53.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd593ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd593ccc640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fd58c08d390 con 0x7fd58c13ef60 2026-02-12T18:12:53.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd593ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd593ccc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fd58c08d5a0 con 0x7fd58c05de60 2026-02-12T18:12:53.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd593ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd593ccc640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fd58c0580e0 con 0x7fd58c05d550 2026-02-12T18:12:53.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd593ccc640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:53.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd593ccc640 10 monclient(hunting): authenticate will time out at 1012.354457s 2026-02-12T18:12:53.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591a41640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd58c05d550 0x7fd58c05d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591240640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd58c05de60 0x7fd58c141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd592242640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd58c13ef60 0x7fd58c1424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591a41640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd58c05d550 0x7fd58c05d920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:57462/0 (socket says 10.20.193.48:57462) 2026-02-12T18:12:53.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591a41640 1 -- 10.20.193.48:0/4004286910 learned_addr learned my addr 10.20.193.48:0/4004286910 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:53.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591a41640 10 monclient(hunting): get_auth_request con 0x7fd58c05d550 auth_method 0 2026-02-12T18:12:53.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591a41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591a41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591a41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd592242640 10 monclient(hunting): get_auth_request con 0x7fd58c13ef60 auth_method 0 2026-02-12T18:12:53.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd592242640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd592242640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd592242640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591240640 10 monclient(hunting): get_auth_request con 0x7fd58c05de60 auth_method 0 2026-02-12T18:12:53.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591240640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591240640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591240640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591a41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591a41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591a41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd592242640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd592242640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd592242640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591240640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591240640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591240640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591a41640 10 monclient(hunting): handle_auth_done global_id 94301 payload 274 2026-02-12T18:12:53.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591a41640 1 -- 10.20.193.48:0/4004286910 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd58c05de60 msgr2=0x7fd58c141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:53.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591a41640 1 --2- 10.20.193.48:0/4004286910 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd58c05de60 0x7fd58c141fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591a41640 1 -- 10.20.193.48:0/4004286910 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd58c13ef60 msgr2=0x7fd58c1424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:53.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591a41640 1 --2- 10.20.193.48:0/4004286910 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd58c13ef60 0x7fd58c1424e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591a41640 10 monclient: _finish_hunting 0 2026-02-12T18:12:53.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591a41640 1 monclient: found mon.noname-e 2026-02-12T18:12:53.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591a41640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:53.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591a41640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:12:53.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd591a41640 1 -- 10.20.193.48:0/4004286910 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd58c04dc20 con 0x7fd58c05d550 2026-02-12T18:12:53.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.628+0000 7fd592242640 1 --2- 10.20.193.48:0/4004286910 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd58c13ef60 0x7fd58c1424e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:12:53.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd591a41640 1 -- 10.20.193.48:0/4004286910 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd58c05d550 msgr2=0x7fd58c05d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd591a41640 1 --2- 10.20.193.48:0/4004286910 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd58c05d550 0x7fd58c05d920 secure :-1 s=READY pgs=33 gs=1 cs=0 l=1 c_cookie=11595426278598228291 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd57c0098d0 tx=0x7fd57c02ee20 comp rx=0 tx=0).ready entity=mon.8 client_cookie=a0eb3ac3e313b943 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd590a3f640 1 -- 10.20.193.48:0/4004286910 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd57c035340 con 0x7fd58c05d550 2026-02-12T18:12:53.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd590a3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd590a3f640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:12:53.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd590a3f640 10 monclient: dump: 2026-02-12T18:12:53.636 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.636 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.636 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.636 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.636 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd590a3f640 10 monclient: _finish_auth 0 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd590a3f640 10 monclient: _check_auth_tickets 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd590a3f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd593ccc640 5 monclient: authenticate success, global_id 94301 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd593ccc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd590a3f640 1 -- 10.20.193.48:0/4004286910 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd57c0354c0 con 0x7fd58c05d550 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd590a3f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd590a3f640 1 -- 10.20.193.48:0/4004286910 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd57c035af0 con 0x7fd58c05d550 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd590a3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd590a3f640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd590a3f640 10 monclient: dump: 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.637 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.638 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.638 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.638 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.638 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.638 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.638 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.638 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.638 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.638 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.638 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.638 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd593ccc640 10 monclient: get_monmap_and_config success 2026-02-12T18:12:53.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd593ccc640 4 set_mon_vals no callback set 2026-02-12T18:12:53.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd593ccc640 10 monclient: shutdown 2026-02-12T18:12:53.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd593ccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:53.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd593ccc640 1 -- 10.20.193.48:0/4004286910 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd58c05d550 msgr2=0x7fd58c05d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd593ccc640 1 --2- 10.20.193.48:0/4004286910 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd58c05d550 0x7fd58c05d920 secure :-1 s=READY pgs=33 gs=1 cs=0 l=1 c_cookie=11595426278598228291 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd57c0098d0 tx=0x7fd57c02ee20 comp rx=0 tx=0).stop 2026-02-12T18:12:53.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd593ccc640 1 -- 10.20.193.48:0/4004286910 shutdown_connections 2026-02-12T18:12:53.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd593ccc640 1 --2- 10.20.193.48:0/4004286910 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fd58c13ef60 0x7fd58c1424e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd593ccc640 1 --2- 10.20.193.48:0/4004286910 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd58c05de60 0x7fd58c141fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd593ccc640 1 --2- 10.20.193.48:0/4004286910 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fd58c05d550 0x7fd58c05d920 unknown :-1 s=CLOSED pgs=33 gs=1 cs=0 l=1 c_cookie=11595426278598228291 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd593ccc640 1 -- 10.20.193.48:0/4004286910 >> 10.20.193.48:0/4004286910 conn(0x7fd58c0546a0 msgr2=0x7fd58c054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:53.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd593ccc640 1 -- 10.20.193.48:0/4004286910 shutdown_connections 2026-02-12T18:12:53.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.631+0000 7fd593ccc640 1 -- 10.20.193.48:0/4004286910 wait complete. 2026-02-12T18:12:53.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.632+0000 7fd593ccc640 10 monclient: build_initial_monmap 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.632+0000 7fd593ccc640 10 monclient: monmap: 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.632+0000 7fd593ccc640 1 Processor -- start 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.632+0000 7fd593ccc640 1 -- start start 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.632+0000 7fd593ccc640 10 monclient: init 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd593ccc640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd593ccc640 10 monclient: _add_conns ranks=[3,7,6,2,5,0,8,4,1] 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd593ccc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd58c05d550 0x7fd58c12f760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd593ccc640 10 monclient(hunting): picked mon.noname-g con 0x7fd58c05d550 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd593ccc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd58c05de60 0x7fd58c109760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd593ccc640 10 monclient(hunting): picked mon.noname-i con 0x7fd58c05de60 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:12:53.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd593ccc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd58c13ef60 0x7fd58c109ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd593ccc640 10 monclient(hunting): picked mon.noname-d con 0x7fd58c13ef60 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:12:53.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd593ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd593ccc640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fd58c10cab0 con 0x7fd58c05d550 2026-02-12T18:12:53.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd593ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd593ccc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fd58c13db40 con 0x7fd58c13ef60 2026-02-12T18:12:53.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd593ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd593ccc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fd58c120890 con 0x7fd58c05de60 2026-02-12T18:12:53.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd593ccc640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:53.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd593ccc640 10 monclient(hunting): authenticate will time out at 1012.359115s 2026-02-12T18:12:53.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd592242640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd58c13ef60 0x7fd58c109ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd592242640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd58c13ef60 0x7fd58c109ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:59484/0 (socket says 10.20.193.48:59484) 2026-02-12T18:12:53.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd592242640 1 -- 10.20.193.48:0/1312913198 learned_addr learned my addr 10.20.193.48:0/1312913198 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:53.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd592242640 10 monclient(hunting): get_auth_request con 0x7fd58c13ef60 auth_method 0 2026-02-12T18:12:53.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd592242640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd592242640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd592242640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd591a41640 1 --2- 10.20.193.48:0/1312913198 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd58c05d550 0x7fd58c12f760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd592242640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd592242640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd591240640 1 --2- 10.20.193.48:0/1312913198 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd58c05de60 0x7fd58c109760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd592242640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd591a41640 10 monclient(hunting): get_auth_request con 0x7fd58c05d550 auth_method 0 2026-02-12T18:12:53.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd591a41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd591a41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd591a41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd591240640 10 monclient(hunting): get_auth_request con 0x7fd58c05de60 auth_method 0 2026-02-12T18:12:53.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd591240640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd591240640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd591240640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd591240640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd591240640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd591240640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd591a41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd591a41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd591a41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd592242640 10 monclient(hunting): handle_auth_done global_id 5910 payload 824 2026-02-12T18:12:53.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd592242640 1 -- 10.20.193.48:0/1312913198 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd58c05de60 msgr2=0x7fd58c109760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd592242640 1 --2- 10.20.193.48:0/1312913198 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fd58c05de60 0x7fd58c109760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd592242640 1 -- 10.20.193.48:0/1312913198 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd58c05d550 msgr2=0x7fd58c12f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd592242640 1 --2- 10.20.193.48:0/1312913198 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fd58c05d550 0x7fd58c12f760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd592242640 10 monclient: _finish_hunting 0 2026-02-12T18:12:53.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd592242640 1 monclient: found mon.noname-d 2026-02-12T18:12:53.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd592242640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:53.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd592242640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:12:53.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.633+0000 7fd592242640 1 -- 10.20.193.48:0/1312913198 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd58800a500 con 0x7fd58c13ef60 2026-02-12T18:12:53.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.635+0000 7fd592242640 1 -- 10.20.193.48:0/1312913198 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd58c13ef60 msgr2=0x7fd58c109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.635+0000 7fd592242640 1 --2- 10.20.193.48:0/1312913198 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd58c13ef60 0x7fd58c109ca0 secure :-1 s=READY pgs=282 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd58800fb30 tx=0x7fd58800af00 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.635+0000 7fd57a7fc640 1 -- 10.20.193.48:0/1312913198 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd58800dce0 con 0x7fd58c13ef60 2026-02-12T18:12:53.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.635+0000 7fd57a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.635+0000 7fd57a7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:12:53.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.635+0000 7fd57a7fc640 10 monclient: dump: 2026-02-12T18:12:53.643 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.643 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.644 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.644 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.644 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.644 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.644 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.644 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.644 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.644 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.644 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.644 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.644 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.644 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.644 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.644 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.635+0000 7fd57a7fc640 10 monclient: _finish_auth 0 2026-02-12T18:12:53.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.635+0000 7fd57a7fc640 10 monclient: _check_auth_tickets 2026-02-12T18:12:53.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.635+0000 7fd57a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:53.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.635+0000 7fd57a7fc640 1 -- 10.20.193.48:0/1312913198 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5880054f0 con 0x7fd58c13ef60 2026-02-12T18:12:53.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.635+0000 7fd593ccc640 5 monclient: authenticate success, global_id 5910 2026-02-12T18:12:53.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.635+0000 7fd593ccc640 10 monclient: _renew_subs 2026-02-12T18:12:53.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.635+0000 7fd593ccc640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:12:53.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.635+0000 7fd593ccc640 1 -- 10.20.193.48:0/1312913198 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd57c0094f0 con 0x7fd58c13ef60 2026-02-12T18:12:53.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.635+0000 7fd57a7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:53.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.635+0000 7fd57a7fc640 1 -- 10.20.193.48:0/1312913198 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd58800dea0 con 0x7fd58c13ef60 2026-02-12T18:12:53.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.635+0000 7fd57a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.635+0000 7fd57bfff640 4 set_mon_vals no callback set 2026-02-12T18:12:53.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.635+0000 7fd57a7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:12:53.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.635+0000 7fd57a7fc640 10 monclient: dump: 2026-02-12T18:12:53.645 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.645 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.645 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.645 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.645 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.645 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.645 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.645 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.645 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.645 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.645 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.645 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.645 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.645 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.645 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.645 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.635+0000 7fd593ccc640 10 monclient: _renew_subs 2026-02-12T18:12:53.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.635+0000 7fd593ccc640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:12:53.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.635+0000 7fd593ccc640 1 -- 10.20.193.48:0/1312913198 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fd58c10c7d0 con 0x7fd58c13ef60 2026-02-12T18:12:53.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.636+0000 7fd593ccc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:53.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.636+0000 7fd593ccc640 1 --2- 10.20.193.48:0/1312913198 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd58c091010 0x7fd58c10a1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.636+0000 7fd593ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.636+0000 7fd593ccc640 1 -- 10.20.193.48:0/1312913198 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd58c05f140 con 0x7fd58c091010 2026-02-12T18:12:53.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.636+0000 7fd591a41640 1 --2- 10.20.193.48:0/1312913198 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd58c091010 0x7fd58c10a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.636+0000 7fd591a41640 10 monclient: get_auth_request con 0x7fd58c091010 auth_method 0 2026-02-12T18:12:53.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.636+0000 7fd591a41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.636+0000 7fd591a41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.636+0000 7fd591a41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.636+0000 7fd57a7fc640 1 -- 10.20.193.48:0/1312913198 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fd588024020 con 0x7fd58c13ef60 2026-02-12T18:12:53.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.636+0000 7fd591a41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.636+0000 7fd591a41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.636+0000 7fd591a41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.636+0000 7fd57a7fc640 1 --2- 10.20.193.48:0/1312913198 >> v2:10.20.193.111:6812/977811348 conn(0x7fd55c03f800 0x7fd55c05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.636+0000 7fd57a7fc640 1 -- 10.20.193.48:0/1312913198 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(221..221 src has 190..221) ==== 3897+0+0 (secure 0 0 0) 0x7fd5880541b0 con 0x7fd58c13ef60 2026-02-12T18:12:53.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.636+0000 7fd591a41640 10 monclient(hunting): handle_auth_done global_id 94231 payload 824 2026-02-12T18:12:53.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.636+0000 7fd591a41640 1 -- 10.20.193.48:0/1312913198 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd58c05e310 con 0x7fd58c091010 2026-02-12T18:12:53.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.637+0000 7fd591240640 1 --2- 10.20.193.48:0/1312913198 >> v2:10.20.193.111:6812/977811348 conn(0x7fd55c03f800 0x7fd55c05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.637+0000 7fd591240640 10 monclient: get_auth_request con 0x7fd55c03f800 auth_method 0 2026-02-12T18:12:53.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.639+0000 7fd591a41640 1 -- 10.20.193.48:0/1312913198 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd58c091010 msgr2=0x7fd58c10a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.639+0000 7fd591a41640 1 --2- 10.20.193.48:0/1312913198 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd58c091010 0x7fd58c10a1e0 secure :-1 s=READY pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd57c004740 tx=0x7fd57c0047e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.639+0000 7fd591240640 1 --2- 10.20.193.48:0/1312913198 >> v2:10.20.193.111:6812/977811348 conn(0x7fd55c03f800 0x7fd55c05fcb0 secure :-1 s=READY pgs=343 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd58c05c5b0 tx=0x7fd580009210 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.639+0000 7fd57a7fc640 1 -- 10.20.193.48:0/1312913198 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd57c035bf0 con 0x7fd58c091010 2026-02-12T18:12:53.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.639+0000 7fd57a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.639+0000 7fd57a7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:12:53.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.639+0000 7fd57a7fc640 10 monclient: dump: 2026-02-12T18:12:53.647 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.647 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.647 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.647 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.647 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.647 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.647 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.647 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.647 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.647 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.647 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.647 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.647 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.647 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.647 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.647 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.639+0000 7fd57a7fc640 1 -- 10.20.193.48:0/1312913198 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fd57c035d50 con 0x7fd58c091010 2026-02-12T18:12:53.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.639+0000 7fd57a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:53.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.639+0000 7fd57a7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:12:53.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.639+0000 7fd57a7fc640 1 -- 10.20.193.48:0/1312913198 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd58c091010 msgr2=0x7fd58c10a1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.639+0000 7fd57a7fc640 1 --2- 10.20.193.48:0/1312913198 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd58c091010 0x7fd58c10a1e0 secure :-1 s=READY pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd57c004740 tx=0x7fd57c0047e0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.639+0000 7fd57a7fc640 1 -- 10.20.193.48:0/1312913198 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd58c091010 msgr2=0x7fd58c10a1e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:53.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.639+0000 7fd57a7fc640 1 --2- 10.20.193.48:0/1312913198 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd58c091010 0x7fd58c10a1e0 secure :-1 s=CLOSED pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd57c004740 tx=0x7fd57c0047e0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.648 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.643+0000 7fd593ccc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:12:53.648 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.643+0000 7fd593ccc640 1 --2- 10.20.193.48:0/1312913198 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd58c10a720 0x7fd58c0588e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.648 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.643+0000 7fd593ccc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.648 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.643+0000 7fd593ccc640 1 -- 10.20.193.48:0/1312913198 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fd58c05fd90 con 0x7fd58c10a720 2026-02-12T18:12:53.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.643+0000 7fd591a41640 1 --2- 10.20.193.48:0/1312913198 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd58c10a720 0x7fd58c0588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.643+0000 7fd591a41640 10 monclient: get_auth_request con 0x7fd58c10a720 auth_method 0 2026-02-12T18:12:53.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.643+0000 7fd591a41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.643+0000 7fd591a41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.643+0000 7fd591a41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.643+0000 7fd591a41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.643+0000 7fd591a41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.643+0000 7fd591a41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.643+0000 7fd591a41640 10 monclient(hunting): handle_auth_done global_id 94240 payload 824 2026-02-12T18:12:53.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.643+0000 7fd591a41640 1 -- 10.20.193.48:0/1312913198 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd58c057e00 con 0x7fd58c10a720 2026-02-12T18:12:53.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.645+0000 7fd591a41640 1 -- 10.20.193.48:0/1312913198 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd58c10a720 msgr2=0x7fd58c0588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.645+0000 7fd591a41640 1 --2- 10.20.193.48:0/1312913198 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd58c10a720 0x7fd58c0588e0 secure :-1 s=READY pgs=26 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd57c0098d0 tx=0x7fd57c004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.646+0000 7fd57a7fc640 1 -- 10.20.193.48:0/1312913198 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd57c052070 con 0x7fd58c10a720 2026-02-12T18:12:53.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.646+0000 7fd57a7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.646+0000 7fd57a7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:12:53.649 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.646+0000 7fd57a7fc640 10 monclient: dump: 2026-02-12T18:12:53.649 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.649 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.649 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.649 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.649 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.649 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.649 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.649 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.650 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.650 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.650 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.650 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.650 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.650 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.650 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.650 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.646+0000 7fd57a7fc640 1 -- 10.20.193.48:0/1312913198 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7fd57c042e10 con 0x7fd58c10a720 2026-02-12T18:12:53.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.646+0000 7fd57a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:12:53.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.646+0000 7fd57a7fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:12:53.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.646+0000 7fd57a7fc640 1 -- 10.20.193.48:0/1312913198 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd58c10a720 msgr2=0x7fd58c0588e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.646+0000 7fd57a7fc640 1 --2- 10.20.193.48:0/1312913198 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd58c10a720 0x7fd58c0588e0 secure :-1 s=READY pgs=26 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd57c0098d0 tx=0x7fd57c004770 comp rx=0 tx=0).stop 2026-02-12T18:12:53.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.646+0000 7fd57a7fc640 1 -- 10.20.193.48:0/1312913198 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd58c10a720 msgr2=0x7fd58c0588e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:53.650 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.646+0000 7fd57a7fc640 1 --2- 10.20.193.48:0/1312913198 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fd58c10a720 0x7fd58c0588e0 secure :-1 s=CLOSED pgs=26 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd57c0098d0 tx=0x7fd57c004770 comp rx=0 tx=0).stop 2026-02-12T18:12:53.650 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:12:53.650 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:12:53.650 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:12:53.650 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:12:53.650 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 68, 2026-02-12T18:12:53.651 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 19319, 2026-02-12T18:12:53.651 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:12:53.651 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:12:53.651 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:12:53.651 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:12:53.651 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:12:53.651 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:12:53.651 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:12:53.651 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:12:53.651 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:12:53.651 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:12:53.651 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.651 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 4, 2026-02-12T18:12:53.651 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:53.651 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:12:53.651 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:12:53.651 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.651 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.651 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.651 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.651 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.651 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.651 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.651 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.652 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.652 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.652 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.652 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.652 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.652 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.652 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:12:53.652 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:12:53.652 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.652 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.652 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.652 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.652 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.652 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.652 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.652 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.652 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.652 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.652 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.652 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.652 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.652 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.652 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.652 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:12:53.652 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:12:53.653 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:12:53.653 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:12:53.653 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:12:53.653 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:12:53.653 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:53.653 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:53.653 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:12:53.653 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:12:53.653 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:12:53.653 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:12:53.653 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:12:53.653 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:12:53.653 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:12:53.653 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:53.653 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:12:53.653 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.653 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.653 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.653 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.653 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.653 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.653 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.653 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.653 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.653 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.653 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.654 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.654 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.654 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.654 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:12:53.654 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.654 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:12:53.654 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.654 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:12:53.654 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:12:53.654 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.654 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.654 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.654 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.654 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:12:53.654 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.654 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.654 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.654 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.654 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:12:53.654 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.654 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.654 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.654 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.654 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:12:53.654 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:12:53.655 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.655 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.655 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:12:53.655 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.655 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.655 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.655 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:12:53.655 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:12:53.655 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.655 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.655 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.655 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.655 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:12:53.655 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.655 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.655 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.655 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.655 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:12:53.655 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.655 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.655 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.655 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.655 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:12:53.655 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:12:53.655 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.656 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.656 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:12:53.656 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.656 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.656 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.656 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:12:53.656 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:12:53.656 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.656 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.656 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.656 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.656 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:12:53.656 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.656 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.656 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.656 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.656 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:12:53.656 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.656 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.656 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.656 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.656 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:12:53.656 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:12:53.656 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.656 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.657 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:12:53.657 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.657 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.657 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.657 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:12:53.657 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:12:53.657 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.657 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.657 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.657 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.657 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:12:53.657 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.657 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.657 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.657 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.657 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:12:53.657 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.657 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.657 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.657 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.657 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:12:53.657 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:12:53.657 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.657 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.657 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:12:53.658 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.658 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.658 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.658 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:12:53.658 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:12:53.658 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.658 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.658 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.658 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.658 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:12:53.658 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.658 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.658 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.658 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.658 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:12:53.658 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.658 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.658 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.658 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.658 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:12:53.658 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:12:53.658 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.658 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.658 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:53.658 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.658 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.659 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.659 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:12:53.659 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:12:53.659 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.659 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.659 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.659 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.659 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:12:53.659 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.659 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.659 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.659 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.659 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:12:53.659 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.659 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.659 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.659 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.659 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:12:53.659 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:12:53.659 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.659 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.659 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:12:53.659 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.659 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.659 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.659 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:12:53.660 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:12:53.660 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.660 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.660 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.660 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.660 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:12:53.660 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.660 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.660 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.660 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.660 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:12:53.660 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.660 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.660 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.660 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.660 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:12:53.660 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:12:53.660 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.660 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.660 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:53.660 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.660 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.660 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.660 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:12:53.660 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:12:53.661 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.661 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.661 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.661 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.661 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:12:53.661 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.661 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.661 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.661 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.661 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:12:53.661 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.661 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.661 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.661 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.661 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:12:53.661 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:12:53.661 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.661 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.661 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:12:53.661 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.661 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.661 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.661 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:12:53.661 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:12:53.661 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.662 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.662 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.662 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.662 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:12:53.662 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.662 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.662 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.662 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.662 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:12:53.662 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.662 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.662 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.662 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.662 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:12:53.662 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:12:53.662 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.662 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.662 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:12:53.662 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.662 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.662 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.662 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.662 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:12:53.662 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:12:53.662 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.662 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:53.663 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:53.663 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:53.663 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.663 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.663 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:12:53.663 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.663 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:53.663 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:53.663 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:12:53.663 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.663 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.663 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.663 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:12:53.663 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:12:53.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.646+0000 7fd593ccc640 1 -- 10.20.193.48:0/1312913198 >> v2:10.20.193.111:6812/977811348 conn(0x7fd55c03f800 msgr2=0x7fd55c05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.646+0000 7fd593ccc640 1 --2- 10.20.193.48:0/1312913198 >> v2:10.20.193.111:6812/977811348 conn(0x7fd55c03f800 0x7fd55c05fcb0 secure :-1 s=READY pgs=343 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd58c05c5b0 tx=0x7fd580009210 comp rx=0 tx=0).stop 2026-02-12T18:12:53.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.646+0000 7fd593ccc640 10 monclient: shutdown 2026-02-12T18:12:53.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.646+0000 7fd593ccc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:53.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.646+0000 7fd593ccc640 1 -- 10.20.193.48:0/1312913198 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd58c13ef60 msgr2=0x7fd58c109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.646+0000 7fd593ccc640 1 --2- 10.20.193.48:0/1312913198 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd58c13ef60 0x7fd58c109ca0 secure :-1 s=READY pgs=282 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd58800fb30 tx=0x7fd58800af00 comp rx=0 tx=0).stop 2026-02-12T18:12:53.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.646+0000 7fd592242640 1 -- 10.20.193.48:0/1312913198 reap_dead start 2026-02-12T18:12:53.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.646+0000 7fd592242640 1 -- 10.20.193.48:0/1312913198 reap_dead start 2026-02-12T18:12:53.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.646+0000 7fd593ccc640 1 -- 10.20.193.48:0/1312913198 shutdown_connections 2026-02-12T18:12:53.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.646+0000 7fd593ccc640 1 -- 10.20.193.48:0/1312913198 >> 10.20.193.48:0/1312913198 conn(0x7fd58c0546a0 msgr2=0x7fd58c13c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:53.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.646+0000 7fd593ccc640 1 -- 10.20.193.48:0/1312913198 shutdown_connections 2026-02-12T18:12:53.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.646+0000 7fd593ccc640 1 -- 10.20.193.48:0/1312913198 wait complete. 2026-02-12T18:12:53.665 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:12:53.665 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2026-02-12T18:12:53.665 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2026-02-12T18:12:53.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.728+0000 7f2ad06cc640 10 monclient: get_monmap_and_config 2026-02-12T18:12:53.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.728+0000 7f2ad06cc640 10 monclient: build_initial_monmap 2026-02-12T18:12:53.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.728+0000 7f2ad06cc640 10 monclient: monmap: 2026-02-12T18:12:53.730 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:53.730 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.730 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:12:53.729390+0000 2026-02-12T18:12:53.730 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:12:53.729390+0000 2026-02-12T18:12:53.730 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:53.730 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.730 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:12:53.730 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:12:53.730 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:53.730 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:53.730 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:53.730 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:53.730 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:53.730 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:53.730 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:53.730 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:12:53.730 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:12:53.731 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.728+0000 7f2ad06cc640 1 Processor -- start 2026-02-12T18:12:53.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.728+0000 7f2ad06cc640 1 -- start start 2026-02-12T18:12:53.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.728+0000 7f2ad06cc640 10 monclient: init 2026-02-12T18:12:53.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2ad06cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:53.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2ad06cc640 10 monclient: _add_conns ranks=[10,3,4,5,1,2,7,0,6,8,9] 2026-02-12T18:12:53.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2ad06cc640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f2ac8057db0 0x7f2ac8141140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2ad06cc640 10 monclient(hunting): picked mon.noname-f con 0x7f2ac8057db0 addr v2:10.20.193.111:3300/0 2026-02-12T18:12:53.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2ad06cc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2ac8090c40 0x7f2ac81441e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2ad06cc640 10 monclient(hunting): picked mon.noname-g con 0x7f2ac8090c40 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:12:53.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2ad06cc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f2ac8091010 0x7f2ac8144720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2ad06cc640 10 monclient(hunting): picked mon.noname-c con 0x7f2ac8091010 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:12:53.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2ad06cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2ad06cc640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f2ac8058180 con 0x7f2ac8057db0 2026-02-12T18:12:53.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2ad06cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2ad06cc640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2ac8091a60 con 0x7f2ac8090c40 2026-02-12T18:12:53.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2ad06cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2ad06cc640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f2ac8056ff0 con 0x7f2ac8091010 2026-02-12T18:12:53.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2ad06cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:53.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2ad06cc640 10 monclient(hunting): authenticate will time out at 1012.455148s 2026-02-12T18:12:53.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2acec42640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f2ac8091010 0x7f2ac8144720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2acec42640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f2ac8091010 0x7f2ac8144720 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:48620/0 (socket says 10.20.193.48:48620) 2026-02-12T18:12:53.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2acec42640 1 -- 10.20.193.48:0/2947414910 learned_addr learned my addr 10.20.193.48:0/2947414910 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:53.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2acec42640 10 monclient(hunting): get_auth_request con 0x7f2ac8091010 auth_method 0 2026-02-12T18:12:53.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2acec42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2acec42640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2acec42640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2acec42640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2acec42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2acec42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2ace441640 1 --2- 10.20.193.48:0/2947414910 >> v2:10.20.193.111:3300/0 conn(0x7f2ac8057db0 0x7f2ac8141140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2acdc40640 1 --2- 10.20.193.48:0/2947414910 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2ac8090c40 0x7f2ac81441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2acec42640 10 monclient(hunting): handle_auth_done global_id 64480 payload 274 2026-02-12T18:12:53.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2acec42640 1 -- 10.20.193.48:0/2947414910 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2ac8090c40 msgr2=0x7f2ac81441e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:53.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2acec42640 1 --2- 10.20.193.48:0/2947414910 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2ac8090c40 0x7f2ac81441e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2acec42640 1 -- 10.20.193.48:0/2947414910 >> v2:10.20.193.111:3300/0 conn(0x7f2ac8057db0 msgr2=0x7f2ac8141140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:53.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2acec42640 1 --2- 10.20.193.48:0/2947414910 >> v2:10.20.193.111:3300/0 conn(0x7f2ac8057db0 0x7f2ac8141140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2acec42640 10 monclient: _finish_hunting 0 2026-02-12T18:12:53.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2acec42640 1 monclient: found mon.noname-c 2026-02-12T18:12:53.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2acec42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:53.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2acec42640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:12:53.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.729+0000 7f2acec42640 1 -- 10.20.193.48:0/2947414910 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac804dc20 con 0x7f2ac8091010 2026-02-12T18:12:53.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.731+0000 7f2acec42640 1 -- 10.20.193.48:0/2947414910 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f2ac8091010 msgr2=0x7f2ac8144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.731+0000 7f2acec42640 1 --2- 10.20.193.48:0/2947414910 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f2ac8091010 0x7f2ac8144720 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=14278838751189449962 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ac400a140 tx=0x7f2ac402fed0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=c628a03111babcea server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2acd43f640 1 -- 10.20.193.48:0/2947414910 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2ac4030c30 con 0x7f2ac8091010 2026-02-12T18:12:53.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2acd43f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2acd43f640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:12:53.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2acd43f640 10 monclient: dump: 2026-02-12T18:12:53.736 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.736 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.736 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.736 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.736 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.736 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.736 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.736 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.736 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.736 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.736 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.736 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.736 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.736 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.736 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.736 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2acd43f640 10 monclient: _finish_auth 0 2026-02-12T18:12:53.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2acd43f640 10 monclient: _check_auth_tickets 2026-02-12T18:12:53.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2acd43f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:53.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2acd43f640 1 -- 10.20.193.48:0/2947414910 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ac4030db0 con 0x7f2ac8091010 2026-02-12T18:12:53.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2acd43f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:53.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2ad06cc640 5 monclient: authenticate success, global_id 64480 2026-02-12T18:12:53.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2acd43f640 1 -- 10.20.193.48:0/2947414910 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2ac4036cc0 con 0x7f2ac8091010 2026-02-12T18:12:53.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2ad06cc640 10 monclient: get_monmap_and_config success 2026-02-12T18:12:53.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2ad06cc640 4 set_mon_vals no callback set 2026-02-12T18:12:53.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2acd43f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2acd43f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:12:53.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2acd43f640 10 monclient: dump: 2026-02-12T18:12:53.737 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.737 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.737 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.737 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.737 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.737 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.737 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.737 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.737 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.737 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.737 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.737 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.737 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.737 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.737 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.737 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2ad06cc640 10 monclient: shutdown 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2ad06cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2ad06cc640 1 -- 10.20.193.48:0/2947414910 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f2ac8091010 msgr2=0x7f2ac8144720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2ad06cc640 1 --2- 10.20.193.48:0/2947414910 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f2ac8091010 0x7f2ac8144720 secure :-1 s=READY pgs=110 gs=1 cs=0 l=1 c_cookie=14278838751189449962 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ac400a140 tx=0x7f2ac402fed0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2ad06cc640 1 -- 10.20.193.48:0/2947414910 shutdown_connections 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2ad06cc640 1 --2- 10.20.193.48:0/2947414910 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f2ac8091010 0x7f2ac8144720 unknown :-1 s=CLOSED pgs=110 gs=1 cs=0 l=1 c_cookie=14278838751189449962 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2ad06cc640 1 --2- 10.20.193.48:0/2947414910 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2ac8090c40 0x7f2ac81441e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2ad06cc640 1 --2- 10.20.193.48:0/2947414910 >> v2:10.20.193.111:3300/0 conn(0x7f2ac8057db0 0x7f2ac8141140 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2ad06cc640 1 -- 10.20.193.48:0/2947414910 >> 10.20.193.48:0/2947414910 conn(0x7f2ac8054de0 msgr2=0x7f2ac8095230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2ad06cc640 1 -- 10.20.193.48:0/2947414910 shutdown_connections 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2ad06cc640 1 -- 10.20.193.48:0/2947414910 wait complete. 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2ad06cc640 10 monclient: build_initial_monmap 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.732+0000 7f2ad06cc640 10 monclient: monmap: 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:53.738 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:53.739 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ad06cc640 1 Processor -- start 2026-02-12T18:12:53.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ad06cc640 1 -- start start 2026-02-12T18:12:53.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ad06cc640 10 monclient: init 2026-02-12T18:12:53.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ad06cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:53.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ad06cc640 10 monclient: _add_conns ranks=[7,3,6,1,4,0,5,8,2] 2026-02-12T18:12:53.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ad06cc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2ac8057db0 0x7f2ac812e270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ad06cc640 10 monclient(hunting): picked mon.noname-i con 0x7f2ac8057db0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:12:53.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ad06cc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2ac8090c40 0x7f2ac813e6a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ad06cc640 10 monclient(hunting): picked mon.noname-g con 0x7f2ac8090c40 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:12:53.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ad06cc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f2ac8091010 0x7f2ac812acf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ad06cc640 10 monclient(hunting): picked mon.noname-d con 0x7f2ac8091010 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:12:53.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ad06cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ad06cc640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2ac810f040 con 0x7f2ac8090c40 2026-02-12T18:12:53.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ad06cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ad06cc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f2ac810d160 con 0x7f2ac8091010 2026-02-12T18:12:53.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ad06cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ad06cc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f2ac808b830 con 0x7f2ac8057db0 2026-02-12T18:12:53.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ad06cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:53.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ad06cc640 10 monclient(hunting): authenticate will time out at 1012.459440s 2026-02-12T18:12:53.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acec42640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f2ac8091010 0x7f2ac812acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acec42640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f2ac8091010 0x7f2ac812acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:59486/0 (socket says 10.20.193.48:59486) 2026-02-12T18:12:53.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acec42640 1 -- 10.20.193.48:0/250458475 learned_addr learned my addr 10.20.193.48:0/250458475 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:53.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acec42640 10 monclient(hunting): get_auth_request con 0x7f2ac8091010 auth_method 0 2026-02-12T18:12:53.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acec42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acec42640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acec42640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acec42640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acec42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acec42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ace441640 1 --2- 10.20.193.48:0/250458475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2ac8057db0 0x7f2ac812e270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acdc40640 1 --2- 10.20.193.48:0/250458475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2ac8090c40 0x7f2ac813e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ace441640 10 monclient(hunting): get_auth_request con 0x7f2ac8057db0 auth_method 0 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ace441640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ace441640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ace441640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acdc40640 10 monclient(hunting): get_auth_request con 0x7f2ac8090c40 auth_method 0 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acdc40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acdc40640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acdc40640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ace441640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ace441640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2ace441640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acdc40640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acdc40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acdc40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acec42640 10 monclient(hunting): handle_auth_done global_id 5919 payload 824 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acec42640 1 -- 10.20.193.48:0/250458475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2ac8057db0 msgr2=0x7f2ac812e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acec42640 1 --2- 10.20.193.48:0/250458475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2ac8057db0 0x7f2ac812e270 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acec42640 1 -- 10.20.193.48:0/250458475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2ac8090c40 msgr2=0x7f2ac813e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acec42640 1 --2- 10.20.193.48:0/250458475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2ac8090c40 0x7f2ac813e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acec42640 10 monclient: _finish_hunting 0 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acec42640 1 monclient: found mon.noname-d 2026-02-12T18:12:53.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acec42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:53.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acec42640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:12:53.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.733+0000 7f2acec42640 1 -- 10.20.193.48:0/250458475 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ac400a5d0 con 0x7f2ac8091010 2026-02-12T18:12:53.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.735+0000 7f2acec42640 1 -- 10.20.193.48:0/250458475 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f2ac8091010 msgr2=0x7f2ac812acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.735+0000 7f2acec42640 1 --2- 10.20.193.48:0/250458475 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f2ac8091010 0x7f2ac812acf0 secure :-1 s=READY pgs=283 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ac400aa80 tx=0x7f2ac4005850 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2aaeffd640 1 -- 10.20.193.48:0/250458475 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2ac4030c30 con 0x7f2ac8091010 2026-02-12T18:12:53.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2aaeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2aaeffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:12:53.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2aaeffd640 10 monclient: dump: 2026-02-12T18:12:53.742 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.743 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.743 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.743 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.743 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.743 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.743 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.743 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.743 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.743 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.743 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.743 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.743 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.743 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.743 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.743 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2aaeffd640 10 monclient: _finish_auth 0 2026-02-12T18:12:53.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2aaeffd640 10 monclient: _check_auth_tickets 2026-02-12T18:12:53.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2aaeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:53.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2aaeffd640 1 -- 10.20.193.48:0/250458475 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ac40056c0 con 0x7f2ac8091010 2026-02-12T18:12:53.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2aaeffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:53.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2aaeffd640 1 -- 10.20.193.48:0/250458475 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2ac4038dc0 con 0x7f2ac8091010 2026-02-12T18:12:53.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2aaeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2aaeffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:12:53.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2accc3e640 4 set_mon_vals no callback set 2026-02-12T18:12:53.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2aaeffd640 10 monclient: dump: 2026-02-12T18:12:53.743 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2ad06cc640 5 monclient: authenticate success, global_id 5919 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2ad06cc640 10 monclient: _renew_subs 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2ad06cc640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2ad06cc640 1 -- 10.20.193.48:0/250458475 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ac8056430 con 0x7f2ac8091010 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2ad06cc640 10 monclient: _renew_subs 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2ad06cc640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2ad06cc640 1 -- 10.20.193.48:0/250458475 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ac810e8e0 con 0x7f2ac8091010 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2ad06cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2ad06cc640 1 --2- 10.20.193.48:0/250458475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2ac810e0e0 0x7f2ac812b230 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2ad06cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2ad06cc640 1 -- 10.20.193.48:0/250458475 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2ac8094410 con 0x7f2ac810e0e0 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2aaeffd640 1 -- 10.20.193.48:0/250458475 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f2ac4038440 con 0x7f2ac8091010 2026-02-12T18:12:53.744 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.736+0000 7f2ace441640 1 --2- 10.20.193.48:0/250458475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2ac810e0e0 0x7f2ac812b230 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.737+0000 7f2aaeffd640 1 --2- 10.20.193.48:0/250458475 >> v2:10.20.193.111:6812/977811348 conn(0x7f2a9803f800 0x7f2a9805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.737+0000 7f2aaeffd640 1 -- 10.20.193.48:0/250458475 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(221..221 src has 190..221) ==== 3897+0+0 (secure 0 0 0) 0x7f2ac40790d0 con 0x7f2ac8091010 2026-02-12T18:12:53.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.737+0000 7f2ace441640 10 monclient: get_auth_request con 0x7f2ac810e0e0 auth_method 0 2026-02-12T18:12:53.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.737+0000 7f2ace441640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.737+0000 7f2ace441640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.737+0000 7f2ace441640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.737+0000 7f2ace441640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.737+0000 7f2ace441640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.737+0000 7f2ace441640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.737+0000 7f2acdc40640 1 --2- 10.20.193.48:0/250458475 >> v2:10.20.193.111:6812/977811348 conn(0x7f2a9803f800 0x7f2a9805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.737+0000 7f2acdc40640 10 monclient: get_auth_request con 0x7f2a9803f800 auth_method 0 2026-02-12T18:12:53.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.737+0000 7f2ace441640 10 monclient(hunting): handle_auth_done global_id 64479 payload 824 2026-02-12T18:12:53.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.737+0000 7f2ace441640 1 -- 10.20.193.48:0/250458475 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2ac80562b0 con 0x7f2ac810e0e0 2026-02-12T18:12:53.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.740+0000 7f2acdc40640 1 --2- 10.20.193.48:0/250458475 >> v2:10.20.193.111:6812/977811348 conn(0x7f2a9803f800 0x7f2a9805fcb0 secure :-1 s=READY pgs=344 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ac8144fb0 tx=0x7f2abc008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.740+0000 7f2ace441640 1 -- 10.20.193.48:0/250458475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2ac810e0e0 msgr2=0x7f2ac812b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.740+0000 7f2ace441640 1 --2- 10.20.193.48:0/250458475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2ac810e0e0 0x7f2ac812b230 secure :-1 s=READY pgs=105 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ab800f830 tx=0x7f2ab800fd00 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.740+0000 7f2aaeffd640 1 -- 10.20.193.48:0/250458475 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2ab800dc30 con 0x7f2ac810e0e0 2026-02-12T18:12:53.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.740+0000 7f2aaeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.740+0000 7f2aaeffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:12:53.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.740+0000 7f2aaeffd640 10 monclient: dump: 2026-02-12T18:12:53.745 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.745 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.745 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.745 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.745 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.745 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.746 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.746 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.746 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.746 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.746 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.746 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.746 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.746 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.746 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.746 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.740+0000 7f2aaeffd640 1 -- 10.20.193.48:0/250458475 <== mon.3 v2:10.20.193.111:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f2ab800c040 con 0x7f2ac810e0e0 2026-02-12T18:12:53.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.740+0000 7f2aaeffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:53.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.740+0000 7f2aaeffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:12:53.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.740+0000 7f2aaeffd640 1 -- 10.20.193.48:0/250458475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2ac810e0e0 msgr2=0x7f2ac812b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.740+0000 7f2aaeffd640 1 --2- 10.20.193.48:0/250458475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2ac810e0e0 0x7f2ac812b230 secure :-1 s=READY pgs=105 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ab800f830 tx=0x7f2ab800fd00 comp rx=0 tx=0).stop 2026-02-12T18:12:53.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.740+0000 7f2aaeffd640 1 -- 10.20.193.48:0/250458475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2ac810e0e0 msgr2=0x7f2ac812b230 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:53.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.740+0000 7f2aaeffd640 1 --2- 10.20.193.48:0/250458475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2ac810e0e0 0x7f2ac812b230 secure :-1 s=CLOSED pgs=105 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ab800f830 tx=0x7f2ab800fd00 comp rx=0 tx=0).stop 2026-02-12T18:12:53.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.743+0000 7f2ad06cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:12:53.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.743+0000 7f2ad06cc640 1 --2- 10.20.193.48:0/250458475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2ac812b770 0x7f2ac808daa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.743+0000 7f2ad06cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.743+0000 7f2ad06cc640 1 -- 10.20.193.48:0/250458475 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2ac8050410 con 0x7f2ac812b770 2026-02-12T18:12:53.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.743+0000 7f2ace441640 1 --2- 10.20.193.48:0/250458475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2ac812b770 0x7f2ac808daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.744+0000 7f2ace441640 10 monclient: get_auth_request con 0x7f2ac812b770 auth_method 0 2026-02-12T18:12:53.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.744+0000 7f2ace441640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.744+0000 7f2ace441640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.744+0000 7f2ace441640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.744+0000 7f2ace441640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.744+0000 7f2ace441640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.744+0000 7f2ace441640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.744+0000 7f2ace441640 10 monclient(hunting): handle_auth_done global_id 64488 payload 824 2026-02-12T18:12:53.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.744+0000 7f2ace441640 1 -- 10.20.193.48:0/250458475 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2ac810f3b0 con 0x7f2ac812b770 2026-02-12T18:12:53.748 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.746+0000 7f2ace441640 1 -- 10.20.193.48:0/250458475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2ac812b770 msgr2=0x7f2ac808daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.748 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.746+0000 7f2ace441640 1 --2- 10.20.193.48:0/250458475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2ac812b770 0x7f2ac808daa0 secure :-1 s=READY pgs=106 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ab800f830 tx=0x7f2ab8004770 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.748 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.746+0000 7f2aaeffd640 1 -- 10.20.193.48:0/250458475 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2ab8022070 con 0x7f2ac812b770 2026-02-12T18:12:53.748 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.746+0000 7f2aaeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.748 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.746+0000 7f2aaeffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:12:53.748 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.746+0000 7f2aaeffd640 10 monclient: dump: 2026-02-12T18:12:53.748 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.748 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.748 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.748 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.748 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.748 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.748 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.748 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.748 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.748 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.748 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.748 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.748 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.749 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.749 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.749 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.746+0000 7f2aaeffd640 1 -- 10.20.193.48:0/250458475 <== mon.3 v2:10.20.193.111:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10182 (secure 0 0 0) 0x7f2ab80067c0 con 0x7f2ac812b770 2026-02-12T18:12:53.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.746+0000 7f2aaeffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:12:53.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.746+0000 7f2aaeffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:12:53.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.746+0000 7f2aaeffd640 1 -- 10.20.193.48:0/250458475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2ac812b770 msgr2=0x7f2ac808daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.746+0000 7f2aaeffd640 1 --2- 10.20.193.48:0/250458475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2ac812b770 0x7f2ac808daa0 secure :-1 s=READY pgs=106 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ab800f830 tx=0x7f2ab8004770 comp rx=0 tx=0).stop 2026-02-12T18:12:53.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.746+0000 7f2aaeffd640 1 -- 10.20.193.48:0/250458475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2ac812b770 msgr2=0x7f2ac808daa0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:53.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.746+0000 7f2aaeffd640 1 --2- 10.20.193.48:0/250458475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2ac812b770 0x7f2ac808daa0 secure :-1 s=CLOSED pgs=106 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ab800f830 tx=0x7f2ab8004770 comp rx=0 tx=0).stop 2026-02-12T18:12:53.749 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:12:53.749 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:12:53.749 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:12:53.749 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:12:53.749 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 68, 2026-02-12T18:12:53.749 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 154549, 2026-02-12T18:12:53.749 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:12:53.749 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:12:53.749 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:12:53.749 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:12:53.749 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 4, 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:12:53.750 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:12:53.751 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.752 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.753 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.754 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:12:53.755 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.756 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:12:53.757 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.758 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.759 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:53.760 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:12:53.761 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.761 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.761 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:12:53.761 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.761 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:53.761 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:53.761 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:12:53.761 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.761 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.761 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.761 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:12:53.761 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:12:53.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.747+0000 7f2ad06cc640 1 -- 10.20.193.48:0/250458475 >> v2:10.20.193.111:6812/977811348 conn(0x7f2a9803f800 msgr2=0x7f2a9805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.747+0000 7f2ad06cc640 1 --2- 10.20.193.48:0/250458475 >> v2:10.20.193.111:6812/977811348 conn(0x7f2a9803f800 0x7f2a9805fcb0 secure :-1 s=READY pgs=344 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ac8144fb0 tx=0x7f2abc008040 comp rx=0 tx=0).stop 2026-02-12T18:12:53.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.747+0000 7f2ad06cc640 10 monclient: shutdown 2026-02-12T18:12:53.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.747+0000 7f2ad06cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:53.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.747+0000 7f2ad06cc640 1 -- 10.20.193.48:0/250458475 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f2ac8091010 msgr2=0x7f2ac812acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.747+0000 7f2ad06cc640 1 --2- 10.20.193.48:0/250458475 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f2ac8091010 0x7f2ac812acf0 secure :-1 s=READY pgs=283 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2ac400aa80 tx=0x7f2ac4005850 comp rx=0 tx=0).stop 2026-02-12T18:12:53.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.747+0000 7f2acec42640 1 -- 10.20.193.48:0/250458475 reap_dead start 2026-02-12T18:12:53.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.747+0000 7f2acec42640 1 -- 10.20.193.48:0/250458475 reap_dead start 2026-02-12T18:12:53.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.747+0000 7f2ad06cc640 1 -- 10.20.193.48:0/250458475 shutdown_connections 2026-02-12T18:12:53.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.747+0000 7f2ad06cc640 1 -- 10.20.193.48:0/250458475 >> 10.20.193.48:0/250458475 conn(0x7f2ac8054de0 msgr2=0x7f2ac8091c30 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:53.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.747+0000 7f2ad06cc640 1 -- 10.20.193.48:0/250458475 shutdown_connections 2026-02-12T18:12:53.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.747+0000 7f2ad06cc640 1 -- 10.20.193.48:0/250458475 wait complete. 2026-02-12T18:12:53.762 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:12:53.763 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2026-02-12T18:12:53.763 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2026-02-12T18:12:53.814 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:12:53.814 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30593]: starting. 2026-02-12T18:12:53.814 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30593]: creating pool ceph_test_rados_delete_pools_parallel.trial111-30360 2026-02-12T18:12:53.814 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30593]: created object 0... 2026-02-12T18:12:53.814 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30593]: created object 25... 2026-02-12T18:12:53.814 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30593]: created object 49... 2026-02-12T18:12:53.814 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30593]: finishing. 2026-02-12T18:12:53.814 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30593]: shutting down. 2026-02-12T18:12:53.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.828+0000 7fe64f007640 10 monclient: get_monmap_and_config 2026-02-12T18:12:53.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.828+0000 7fe64f007640 10 monclient: build_initial_monmap 2026-02-12T18:12:53.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.828+0000 7fe64f007640 10 monclient: monmap: 2026-02-12T18:12:53.830 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:53.830 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.830 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:12:53.829701+0000 2026-02-12T18:12:53.830 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:12:53.829701+0000 2026-02-12T18:12:53.830 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:53.830 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.830 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:12:53.830 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:12:53.830 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:53.830 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:53.830 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:53.830 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:53.830 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:53.830 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:53.830 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:53.830 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:12:53.830 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:12:53.831 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64f007640 1 Processor -- start 2026-02-12T18:12:53.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64f007640 1 -- start start 2026-02-12T18:12:53.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64f007640 10 monclient: init 2026-02-12T18:12:53.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64f007640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:53.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64f007640 10 monclient: _add_conns ranks=[2,4,1,0,10,3,5,9,6,7,8] 2026-02-12T18:12:53.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64f007640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe64805c950 0x7fe64805cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64f007640 10 monclient(hunting): picked mon.noname-b con 0x7fe64805c950 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:12:53.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64f007640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe64805e490 0x7fe64805d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64f007640 10 monclient(hunting): picked mon.noname-c con 0x7fe64805e490 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:12:53.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64f007640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fe64813db70 addr v1:10.20.193.111:6789/0 2026-02-12T18:12:53.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64f007640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe64804dc20 con 0x7fe64813db70 2026-02-12T18:12:53.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64f007640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64f007640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fe64805ddd0 con 0x7fe64805c950 2026-02-12T18:12:53.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64f007640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64f007640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fe64805d7a0 con 0x7fe64805e490 2026-02-12T18:12:53.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64f007640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:53.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64f007640 10 monclient(hunting): authenticate will time out at 1012.555401s 2026-02-12T18:12:53.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64cd7c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe64805c950 0x7fe64805cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe63ffff640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe64805e490 0x7fe64805d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64cd7c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe64805c950 0x7fe64805cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:41962/0 (socket says 10.20.193.48:41962) 2026-02-12T18:12:53.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe63ffff640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe64805e490 0x7fe64805d260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:48622/0 (socket says 10.20.193.48:48622) 2026-02-12T18:12:53.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64cd7c640 1 -- 10.20.193.48:0/744402195 learned_addr learned my addr 10.20.193.48:0/744402195 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:53.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64cd7c640 10 monclient(hunting): get_auth_request con 0x7fe64805c950 auth_method 0 2026-02-12T18:12:53.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64cd7c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64cd7c640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64cd7c640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe63ffff640 10 monclient(hunting): get_auth_request con 0x7fe64805e490 auth_method 0 2026-02-12T18:12:53.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe63ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe63ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe63ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64cd7c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64cd7c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64cd7c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe63ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe63ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe63ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64cd7c640 10 monclient(hunting): handle_auth_done global_id 35921 payload 274 2026-02-12T18:12:53.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64cd7c640 1 -- 10.20.193.48:0/744402195 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe64805e490 msgr2=0x7fe64805d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:53.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64cd7c640 1 --2- 10.20.193.48:0/744402195 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe64805e490 0x7fe64805d260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64cd7c640 1 -- 10.20.193.48:0/744402195 >> v1:10.20.193.111:6789/0 conn(0x7fe64813db70 legacy=0x7fe64813dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:53.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64cd7c640 10 monclient: _finish_hunting 0 2026-02-12T18:12:53.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64cd7c640 1 monclient: found mon.noname-b 2026-02-12T18:12:53.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64cd7c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:53.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64cd7c640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:12:53.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.829+0000 7fe64cd7c640 1 -- 10.20.193.48:0/744402195 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe648092990 con 0x7fe64805c950 2026-02-12T18:12:53.840 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe64cd7c640 1 -- 10.20.193.48:0/744402195 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe64805c950 msgr2=0x7fe64805cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.840 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe64cd7c640 1 --2- 10.20.193.48:0/744402195 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe64805c950 0x7fe64805cd20 secure :-1 s=READY pgs=314 gs=2 cs=0 l=1 c_cookie=8029471159259342287 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6380098d0 tx=0x7fe63802ee20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f6e697a35e5a5cf server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.840 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe63f7fe640 1 -- 10.20.193.48:0/744402195 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe638035340 con 0x7fe64805c950 2026-02-12T18:12:53.840 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe63f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.840 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe63f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:12:53.840 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe63f7fe640 10 monclient: dump: 2026-02-12T18:12:53.840 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.840 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.840 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.840 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.840 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.840 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.840 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.840 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.840 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.840 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.841 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.841 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.841 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.841 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.841 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.841 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe63f7fe640 10 monclient: _finish_auth 0 2026-02-12T18:12:53.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe63f7fe640 10 monclient: _check_auth_tickets 2026-02-12T18:12:53.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe63f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:53.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe63f7fe640 1 -- 10.20.193.48:0/744402195 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6380354c0 con 0x7fe64805c950 2026-02-12T18:12:53.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe64f007640 5 monclient: authenticate success, global_id 35921 2026-02-12T18:12:53.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe64f007640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:12:53.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe63f7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:53.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe63f7fe640 1 -- 10.20.193.48:0/744402195 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe638035af0 con 0x7fe64805c950 2026-02-12T18:12:53.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe63f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe63f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:12:53.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe63f7fe640 10 monclient: dump: 2026-02-12T18:12:53.841 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.841 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.841 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.842 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.842 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.842 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.842 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.842 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.842 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.842 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.842 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.842 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.842 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.842 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.842 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.842 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe64f007640 10 monclient: get_monmap_and_config success 2026-02-12T18:12:53.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe64f007640 4 set_mon_vals no callback set 2026-02-12T18:12:53.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe64f007640 10 monclient: shutdown 2026-02-12T18:12:53.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe64f007640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:53.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe64f007640 1 -- 10.20.193.48:0/744402195 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe64805c950 msgr2=0x7fe64805cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe64f007640 1 --2- 10.20.193.48:0/744402195 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe64805c950 0x7fe64805cd20 secure :-1 s=READY pgs=314 gs=2 cs=0 l=1 c_cookie=8029471159259342287 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6380098d0 tx=0x7fe63802ee20 comp rx=0 tx=0).stop 2026-02-12T18:12:53.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe64f007640 1 -- 10.20.193.48:0/744402195 shutdown_connections 2026-02-12T18:12:53.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe64f007640 1 --2- 10.20.193.48:0/744402195 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe64805e490 0x7fe64805d260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe64f007640 1 --2- 10.20.193.48:0/744402195 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fe64805c950 0x7fe64805cd20 unknown :-1 s=CLOSED pgs=314 gs=2 cs=0 l=1 c_cookie=8029471159259342287 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe64f007640 1 -- 10.20.193.48:0/744402195 >> 10.20.193.48:0/744402195 conn(0x7fe6480548a0 msgr2=0x7fe648097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:53.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe64f007640 1 -- 10.20.193.48:0/744402195 shutdown_connections 2026-02-12T18:12:53.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.832+0000 7fe64f007640 1 -- 10.20.193.48:0/744402195 wait complete. 2026-02-12T18:12:53.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe64f007640 10 monclient: build_initial_monmap 2026-02-12T18:12:53.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe64f007640 10 monclient: monmap: 2026-02-12T18:12:53.843 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:53.843 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:12:53.843 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:12:53.843 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:12:53.843 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:53.843 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.843 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:12:53.843 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:12:53.843 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:53.843 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:53.843 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:53.843 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:53.843 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:53.843 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:53.844 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:53.844 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe64f007640 1 Processor -- start 2026-02-12T18:12:53.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe64f007640 1 -- start start 2026-02-12T18:12:53.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe64f007640 10 monclient: init 2026-02-12T18:12:53.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe64f007640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:53.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe64f007640 10 monclient: _add_conns ranks=[7,8,1,2,0,6,4,5,3] 2026-02-12T18:12:53.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe64f007640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe64805c950 0x7fe64812cac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe64f007640 10 monclient(hunting): picked mon.noname-i con 0x7fe64805c950 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:12:53.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe64f007640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe64805e490 0x7fe64808d2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe64f007640 10 monclient(hunting): picked mon.noname-e con 0x7fe64805e490 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:12:53.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe64f007640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe64813db70 0x7fe64808d800 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe64f007640 10 monclient(hunting): picked mon.noname-f con 0x7fe64813db70 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:12:53.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe64f007640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe64f007640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fe64813e3c0 con 0x7fe64813db70 2026-02-12T18:12:53.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe64f007640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe64f007640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fe648143a60 con 0x7fe64805c950 2026-02-12T18:12:53.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe64f007640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe64f007640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fe64808a4e0 con 0x7fe64805e490 2026-02-12T18:12:53.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe64f007640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:53.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe64f007640 10 monclient(hunting): authenticate will time out at 1012.559843s 2026-02-12T18:12:53.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe63ffff640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe64805e490 0x7fe64808d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe63ffff640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe64805e490 0x7fe64808d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:57472/0 (socket says 10.20.193.48:57472) 2026-02-12T18:12:53.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe63ffff640 1 -- 10.20.193.48:0/2327886039 learned_addr learned my addr 10.20.193.48:0/2327886039 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:53.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe63ffff640 10 monclient(hunting): get_auth_request con 0x7fe64805e490 auth_method 0 2026-02-12T18:12:53.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe63ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe63ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe63ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe63ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.833+0000 7fe63ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe64cd7c640 1 --2- 10.20.193.48:0/2327886039 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe64805c950 0x7fe64812cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe63ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe64d57d640 1 --2- 10.20.193.48:0/2327886039 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe64813db70 0x7fe64808d800 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe64cd7c640 10 monclient(hunting): get_auth_request con 0x7fe64805c950 auth_method 0 2026-02-12T18:12:53.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe64cd7c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe64cd7c640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe64cd7c640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe64d57d640 10 monclient(hunting): get_auth_request con 0x7fe64813db70 auth_method 0 2026-02-12T18:12:53.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe64d57d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe64d57d640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe64d57d640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe64d57d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe64d57d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe64d57d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe64cd7c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe64cd7c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe64cd7c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe63ffff640 10 monclient(hunting): handle_auth_done global_id 94310 payload 824 2026-02-12T18:12:53.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe63ffff640 1 -- 10.20.193.48:0/2327886039 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe64805c950 msgr2=0x7fe64812cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe63ffff640 1 --2- 10.20.193.48:0/2327886039 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe64805c950 0x7fe64812cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe63ffff640 1 -- 10.20.193.48:0/2327886039 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe64813db70 msgr2=0x7fe64808d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe63ffff640 1 --2- 10.20.193.48:0/2327886039 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fe64813db70 0x7fe64808d800 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe63ffff640 10 monclient: _finish_hunting 0 2026-02-12T18:12:53.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe63ffff640 1 monclient: found mon.noname-e 2026-02-12T18:12:53.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe63ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:53.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe63ffff640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:12:53.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.834+0000 7fe63ffff640 1 -- 10.20.193.48:0/2327886039 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6380094f0 con 0x7fe64805e490 2026-02-12T18:12:53.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.836+0000 7fe63ffff640 1 -- 10.20.193.48:0/2327886039 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe64805e490 msgr2=0x7fe64808d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.836+0000 7fe63ffff640 1 --2- 10.20.193.48:0/2327886039 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe64805e490 0x7fe64808d2c0 secure :-1 s=READY pgs=34 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6300093f0 tx=0x7fe63000ed30 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.847 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.836+0000 7fe63d7fa640 1 -- 10.20.193.48:0/2327886039 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe63000cb50 con 0x7fe64805e490 2026-02-12T18:12:53.847 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.836+0000 7fe63d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.847 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.836+0000 7fe63d7fa640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:12:53.847 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.836+0000 7fe63d7fa640 10 monclient: dump: 2026-02-12T18:12:53.847 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.847 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.847 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.847 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.847 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.847 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.847 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.847 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.847 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.847 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.847 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.847 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.847 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.847 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.847 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.847 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.847 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.836+0000 7fe63d7fa640 10 monclient: _finish_auth 0 2026-02-12T18:12:53.848 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.836+0000 7fe63d7fa640 10 monclient: _check_auth_tickets 2026-02-12T18:12:53.848 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.836+0000 7fe63d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:53.848 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.836+0000 7fe63d7fa640 1 -- 10.20.193.48:0/2327886039 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe63000ccd0 con 0x7fe64805e490 2026-02-12T18:12:53.848 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.836+0000 7fe64f007640 5 monclient: authenticate success, global_id 94310 2026-02-12T18:12:53.848 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.836+0000 7fe64f007640 10 monclient: _renew_subs 2026-02-12T18:12:53.848 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.836+0000 7fe64f007640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:12:53.848 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.836+0000 7fe64f007640 1 -- 10.20.193.48:0/2327886039 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe64808a7c0 con 0x7fe64805e490 2026-02-12T18:12:53.848 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.836+0000 7fe63d7fa640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:53.848 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.836+0000 7fe63d7fa640 1 -- 10.20.193.48:0/2327886039 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe63000ce40 con 0x7fe64805e490 2026-02-12T18:12:53.848 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.836+0000 7fe63d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.848 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.836+0000 7fe63d7fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:12:53.848 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.836+0000 7fe63effd640 4 set_mon_vals no callback set 2026-02-12T18:12:53.848 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.836+0000 7fe63d7fa640 10 monclient: dump: 2026-02-12T18:12:53.848 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.848 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.848 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.848 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.848 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.848 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.848 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.849 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.849 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.849 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.849 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.849 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.849 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.849 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.849 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.849 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.836+0000 7fe64f007640 10 monclient: _renew_subs 2026-02-12T18:12:53.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.836+0000 7fe64f007640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:12:53.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.836+0000 7fe64f007640 1 -- 10.20.193.48:0/2327886039 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fe64808a120 con 0x7fe64805e490 2026-02-12T18:12:53.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.837+0000 7fe64f007640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:53.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.837+0000 7fe64f007640 1 --2- 10.20.193.48:0/2327886039 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe64808a980 0x7fe64813cc90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.837+0000 7fe64f007640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.837+0000 7fe64f007640 1 -- 10.20.193.48:0/2327886039 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fe64805f140 con 0x7fe64808a980 2026-02-12T18:12:53.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.837+0000 7fe64cd7c640 1 --2- 10.20.193.48:0/2327886039 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe64808a980 0x7fe64813cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.837+0000 7fe63d7fa640 1 -- 10.20.193.48:0/2327886039 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fe630011070 con 0x7fe64805e490 2026-02-12T18:12:53.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.837+0000 7fe64cd7c640 10 monclient: get_auth_request con 0x7fe64808a980 auth_method 0 2026-02-12T18:12:53.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.837+0000 7fe64cd7c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.837+0000 7fe64cd7c640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.837+0000 7fe64cd7c640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.837+0000 7fe64cd7c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.837+0000 7fe64cd7c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.837+0000 7fe64cd7c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.837+0000 7fe63d7fa640 1 --2- 10.20.193.48:0/2327886039 >> v2:10.20.193.111:6812/977811348 conn(0x7fe61803f800 0x7fe61805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.837+0000 7fe63d7fa640 1 -- 10.20.193.48:0/2327886039 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(222..222 src has 190..222) ==== 3897+0+0 (secure 0 0 0) 0x7fe630052ad0 con 0x7fe64805e490 2026-02-12T18:12:53.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.837+0000 7fe64cd7c640 10 monclient(hunting): handle_auth_done global_id 94199 payload 824 2026-02-12T18:12:53.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.837+0000 7fe64cd7c640 1 -- 10.20.193.48:0/2327886039 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe648097de0 con 0x7fe64808a980 2026-02-12T18:12:53.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.837+0000 7fe64d57d640 1 --2- 10.20.193.48:0/2327886039 >> v2:10.20.193.111:6812/977811348 conn(0x7fe61803f800 0x7fe61805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.837+0000 7fe64d57d640 10 monclient: get_auth_request con 0x7fe61803f800 auth_method 0 2026-02-12T18:12:53.851 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:12:53.851 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30595]: starting. 2026-02-12T18:12:53.851 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30595]: listing objects. 2026-02-12T18:12:53.851 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30595]: listed object 0... 2026-02-12T18:12:53.851 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30595]: listed object 25... 2026-02-12T18:12:53.851 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30595]: saw 50 objects 2026-02-12T18:12:53.851 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30595]: shutting down. 2026-02-12T18:12:53.853 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.839+0000 7fe64cd7c640 1 -- 10.20.193.48:0/2327886039 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe64808a980 msgr2=0x7fe64813cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.853 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.839+0000 7fe64cd7c640 1 --2- 10.20.193.48:0/2327886039 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe64808a980 0x7fe64813cc90 secure :-1 s=READY pgs=29 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe638004740 tx=0x7fe6380047e0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.853 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.840+0000 7fe63d7fa640 1 -- 10.20.193.48:0/2327886039 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe638035ea0 con 0x7fe64808a980 2026-02-12T18:12:53.853 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.840+0000 7fe63d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.853 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.840+0000 7fe63d7fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:12:53.853 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.840+0000 7fe63d7fa640 10 monclient: dump: 2026-02-12T18:12:53.853 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.853 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.853 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.853 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.853 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.853 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.853 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.853 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.853 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.853 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.853 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.853 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.854 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.854 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.854 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.854 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.840+0000 7fe64d57d640 1 --2- 10.20.193.48:0/2327886039 >> v2:10.20.193.111:6812/977811348 conn(0x7fe61803f800 0x7fe61805fcb0 secure :-1 s=READY pgs=345 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe644008fd0 tx=0x7fe644008f20 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.840+0000 7fe63d7fa640 1 -- 10.20.193.48:0/2327886039 <== mon.5 v2:10.20.193.111:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fe638042480 con 0x7fe64808a980 2026-02-12T18:12:53.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.840+0000 7fe63d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:53.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.840+0000 7fe63d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:12:53.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.840+0000 7fe63d7fa640 1 -- 10.20.193.48:0/2327886039 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe64808a980 msgr2=0x7fe64813cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.840+0000 7fe63d7fa640 1 --2- 10.20.193.48:0/2327886039 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe64808a980 0x7fe64813cc90 secure :-1 s=READY pgs=29 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe638004740 tx=0x7fe6380047e0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.840+0000 7fe63d7fa640 1 -- 10.20.193.48:0/2327886039 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe64808a980 msgr2=0x7fe64813cc90 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:53.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.840+0000 7fe63d7fa640 1 --2- 10.20.193.48:0/2327886039 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe64808a980 0x7fe64813cc90 secure :-1 s=CLOSED pgs=29 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe638004740 tx=0x7fe6380047e0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.843+0000 7fe64f007640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:12:53.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.843+0000 7fe64f007640 1 --2- 10.20.193.48:0/2327886039 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe64813d1d0 0x7fe64813d5d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.843+0000 7fe64f007640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.843+0000 7fe64f007640 1 -- 10.20.193.48:0/2327886039 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fe64805fd90 con 0x7fe64813d1d0 2026-02-12T18:12:53.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.843+0000 7fe64cd7c640 1 --2- 10.20.193.48:0/2327886039 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe64813d1d0 0x7fe64813d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.843+0000 7fe64cd7c640 10 monclient: get_auth_request con 0x7fe64813d1d0 auth_method 0 2026-02-12T18:12:53.855 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.843+0000 7fe64cd7c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.855 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.843+0000 7fe64cd7c640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.855 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.843+0000 7fe64cd7c640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.855 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.844+0000 7fe64cd7c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.855 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.844+0000 7fe64cd7c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.855 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.844+0000 7fe64cd7c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.855 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.844+0000 7fe64cd7c640 10 monclient(hunting): handle_auth_done global_id 94208 payload 824 2026-02-12T18:12:53.855 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.844+0000 7fe64cd7c640 1 -- 10.20.193.48:0/2327886039 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe64805cd20 con 0x7fe64813d1d0 2026-02-12T18:12:53.855 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.846+0000 7fe64cd7c640 1 -- 10.20.193.48:0/2327886039 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe64813d1d0 msgr2=0x7fe64813d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.855 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.846+0000 7fe64cd7c640 1 --2- 10.20.193.48:0/2327886039 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe64813d1d0 0x7fe64813d5d0 secure :-1 s=READY pgs=30 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe638009820 tx=0x7fe638004770 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.855 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.846+0000 7fe63d7fa640 1 -- 10.20.193.48:0/2327886039 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe638052070 con 0x7fe64813d1d0 2026-02-12T18:12:53.855 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.846+0000 7fe63d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.855 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.846+0000 7fe63d7fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:12:53.855 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.846+0000 7fe63d7fa640 10 monclient: dump: 2026-02-12T18:12:53.855 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.855 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.855 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.855 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.855 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.855 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.856 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.856 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.856 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.856 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.856 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.856 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.856 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.856 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.856 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.856 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.856 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.846+0000 7fe63d7fa640 1 -- 10.20.193.48:0/2327886039 <== mon.5 v2:10.20.193.111:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7fe63804d8e0 con 0x7fe64813d1d0 2026-02-12T18:12:53.856 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.846+0000 7fe63d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:12:53.856 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.846+0000 7fe63d7fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:12:53.856 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.846+0000 7fe63d7fa640 1 -- 10.20.193.48:0/2327886039 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe64813d1d0 msgr2=0x7fe64813d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.856 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.846+0000 7fe63d7fa640 1 --2- 10.20.193.48:0/2327886039 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe64813d1d0 0x7fe64813d5d0 secure :-1 s=READY pgs=30 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe638009820 tx=0x7fe638004770 comp rx=0 tx=0).stop 2026-02-12T18:12:53.856 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.846+0000 7fe63d7fa640 1 -- 10.20.193.48:0/2327886039 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe64813d1d0 msgr2=0x7fe64813d5d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:53.856 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.846+0000 7fe63d7fa640 1 --2- 10.20.193.48:0/2327886039 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe64813d1d0 0x7fe64813d5d0 secure :-1 s=CLOSED pgs=30 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe638009820 tx=0x7fe638004770 comp rx=0 tx=0).stop 2026-02-12T18:12:53.857 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:12:53.857 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:12:53.857 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:12:53.857 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:12:53.857 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 68, 2026-02-12T18:12:53.857 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 19519, 2026-02-12T18:12:53.857 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:12:53.857 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:12:53.857 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:12:53.857 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:12:53.857 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:12:53.857 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:12:53.857 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:12:53.857 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:12:53.857 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:12:53.857 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:12:53.857 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.857 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 4, 2026-02-12T18:12:53.857 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:53.858 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:12:53.858 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:12:53.858 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.858 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.858 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.858 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.858 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.858 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.858 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.858 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.858 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.858 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.858 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.858 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.858 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.858 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.858 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:12:53.858 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:12:53.858 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.858 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.859 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.859 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.859 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.859 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.859 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.859 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.859 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.859 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.859 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.859 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.859 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.859 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.859 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.859 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:12:53.859 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:12:53.859 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:12:53.859 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:12:53.859 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:12:53.859 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:12:53.859 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:53.859 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:53.860 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:12:53.860 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:12:53.860 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:12:53.860 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:12:53.860 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:12:53.860 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:12:53.860 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:12:53.860 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:53.860 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:12:53.860 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.860 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.860 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.860 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.860 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.860 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.860 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.860 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.860 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.860 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.860 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.860 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.860 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.860 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.861 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:12:53.861 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.861 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:12:53.861 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.861 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:12:53.861 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:12:53.861 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.861 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.861 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.861 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.861 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:12:53.861 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.861 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.861 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.861 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.861 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:12:53.861 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.861 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.861 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.861 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.861 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:12:53.861 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:12:53.861 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.862 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.862 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:12:53.862 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.862 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.862 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.862 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:12:53.862 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:12:53.862 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.862 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.862 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.862 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.862 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:12:53.862 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.862 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.862 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.862 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.862 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:12:53.862 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.862 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.862 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.862 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.862 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:12:53.862 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:12:53.863 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.863 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.863 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:12:53.863 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.863 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.863 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.863 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:12:53.863 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:12:53.863 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.863 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.863 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.863 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.863 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:12:53.863 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.863 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.863 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.863 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.863 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:12:53.863 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.863 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.863 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.863 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.863 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:12:53.863 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:12:53.864 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.864 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.864 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:12:53.864 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.864 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.864 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.864 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:12:53.864 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:12:53.864 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.864 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.864 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.864 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.864 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:12:53.864 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.864 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.864 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.864 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.864 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:12:53.864 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.864 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.864 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.864 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.864 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:12:53.864 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.865 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:53.866 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.866 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.866 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.866 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:12:53.866 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:12:53.866 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.866 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.866 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.866 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.866 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:12:53.866 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.866 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.866 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.866 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.866 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:12:53.866 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.866 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.866 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.866 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.866 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:12:53.866 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:12:53.866 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.866 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.866 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:12:53.866 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.866 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:12:53.867 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:12:53.868 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.868 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.868 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.868 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.868 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:12:53.868 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.868 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.868 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.868 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.868 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:12:53.868 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.868 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.868 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.868 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.868 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:12:53.868 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:12:53.868 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.868 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.868 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:12:53.868 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.868 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.868 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.868 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:12:53.868 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:12:53.868 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:53.869 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:53.870 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.870 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.870 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:12:53.870 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.870 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:53.870 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:53.870 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:53.870 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.870 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.870 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.870 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:12:53.870 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:12:53.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.847+0000 7fe64f007640 1 -- 10.20.193.48:0/2327886039 >> v2:10.20.193.111:6812/977811348 conn(0x7fe61803f800 msgr2=0x7fe61805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.847+0000 7fe64f007640 1 --2- 10.20.193.48:0/2327886039 >> v2:10.20.193.111:6812/977811348 conn(0x7fe61803f800 0x7fe61805fcb0 secure :-1 s=READY pgs=345 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe644008fd0 tx=0x7fe644008f20 comp rx=0 tx=0).stop 2026-02-12T18:12:53.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.847+0000 7fe64f007640 10 monclient: shutdown 2026-02-12T18:12:53.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.847+0000 7fe64f007640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:53.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.847+0000 7fe64f007640 1 -- 10.20.193.48:0/2327886039 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe64805e490 msgr2=0x7fe64808d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.847+0000 7fe64f007640 1 --2- 10.20.193.48:0/2327886039 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe64805e490 0x7fe64808d2c0 secure :-1 s=READY pgs=34 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe6300093f0 tx=0x7fe63000ed30 comp rx=0 tx=0).stop 2026-02-12T18:12:53.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.847+0000 7fe64d57d640 1 -- 10.20.193.48:0/2327886039 reap_dead start 2026-02-12T18:12:53.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.847+0000 7fe64d57d640 1 -- 10.20.193.48:0/2327886039 reap_dead start 2026-02-12T18:12:53.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.847+0000 7fe64f007640 1 -- 10.20.193.48:0/2327886039 shutdown_connections 2026-02-12T18:12:53.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.847+0000 7fe64f007640 1 -- 10.20.193.48:0/2327886039 >> 10.20.193.48:0/2327886039 conn(0x7fe6480548a0 msgr2=0x7fe648093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:53.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.847+0000 7fe64f007640 1 -- 10.20.193.48:0/2327886039 shutdown_connections 2026-02-12T18:12:53.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.847+0000 7fe64f007640 1 -- 10.20.193.48:0/2327886039 wait complete. 2026-02-12T18:12:53.871 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:12:53.871 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2026-02-12T18:12:53.872 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2026-02-12T18:12:53.938 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.936+0000 7f6d8770c640 10 monclient: get_monmap_and_config 2026-02-12T18:12:53.938 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.936+0000 7f6d8770c640 10 monclient: build_initial_monmap 2026-02-12T18:12:53.938 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.936+0000 7f6d8770c640 10 monclient: monmap: 2026-02-12T18:12:53.938 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:53.939 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.939 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:12:53.937917+0000 2026-02-12T18:12:53.939 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:12:53.937917+0000 2026-02-12T18:12:53.939 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:53.939 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.939 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:12:53.939 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:12:53.939 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:53.939 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:53.939 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:53.939 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:53.939 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:53.939 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:53.939 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:53.939 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:12:53.939 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:12:53.939 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.940 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d8770c640 1 Processor -- start 2026-02-12T18:12:53.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d8770c640 1 -- start start 2026-02-12T18:12:53.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d8770c640 10 monclient: init 2026-02-12T18:12:53.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d8770c640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:53.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d8770c640 10 monclient: _add_conns ranks=[4,1,0,8,9,10,6,5,3,2,7] 2026-02-12T18:12:53.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d8770c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6d8013dd70 0x7f6d8013e140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d8770c640 10 monclient(hunting): picked mon.noname-c con 0x7f6d8013dd70 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:12:53.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d8770c640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f6d8005dee0 addr v1:10.20.193.111:6789/0 2026-02-12T18:12:53.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d8770c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6d80144940 addr v1:10.20.193.48:6789/0 2026-02-12T18:12:53.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d8770c640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d8004dc20 con 0x7f6d80144940 2026-02-12T18:12:53.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d8770c640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d8005c760 con 0x7f6d8005dee0 2026-02-12T18:12:53.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d8770c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d8770c640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f6d8008f9e0 con 0x7f6d8013dd70 2026-02-12T18:12:53.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d8770c640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:53.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d8770c640 10 monclient(hunting): authenticate will time out at 1012.663663s 2026-02-12T18:12:53.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d85481640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6d8013dd70 0x7f6d8013e140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d85481640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6d8013dd70 0x7f6d8013e140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:48634/0 (socket says 10.20.193.48:48634) 2026-02-12T18:12:53.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d85481640 1 -- 10.20.193.48:0/3259112195 learned_addr learned my addr 10.20.193.48:0/3259112195 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:53.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d85481640 10 monclient(hunting): get_auth_request con 0x7f6d8013dd70 auth_method 0 2026-02-12T18:12:53.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d85481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d85481640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d85481640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d85481640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.942 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d85481640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.942 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d85481640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.942 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d85481640 10 monclient(hunting): handle_auth_done global_id 64498 payload 274 2026-02-12T18:12:53.942 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d85481640 1 -- 10.20.193.48:0/3259112195 >> v1:10.20.193.111:6789/0 conn(0x7f6d8005dee0 legacy=0x7f6d80144230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:53.942 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d85481640 1 -- 10.20.193.48:0/3259112195 >> v1:10.20.193.48:6789/0 conn(0x7f6d80144940 legacy=0x7f6d801a65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:53.942 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d85481640 10 monclient: _finish_hunting 0 2026-02-12T18:12:53.942 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d85481640 1 monclient: found mon.noname-c 2026-02-12T18:12:53.942 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d85481640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:53.942 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d85481640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:12:53.942 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.937+0000 7f6d85481640 1 -- 10.20.193.48:0/3259112195 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d8008f5a0 con 0x7f6d8013dd70 2026-02-12T18:12:53.944 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.940+0000 7f6d85481640 1 -- 10.20.193.48:0/3259112195 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6d8013dd70 msgr2=0x7f6d8013e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.945 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.940+0000 7f6d85481640 1 --2- 10.20.193.48:0/3259112195 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6d8013dd70 0x7f6d8013e140 secure :-1 s=READY pgs=111 gs=3 cs=0 l=1 c_cookie=3880143182401357137 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d700098d0 tx=0x7f6d7002ee20 comp rx=0 tx=0).ready entity=mon.4 client_cookie=35d909aaa0afc551 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.945 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.940+0000 7f6d6ffff640 1 -- 10.20.193.48:0/3259112195 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6d7002fb80 con 0x7f6d8013dd70 2026-02-12T18:12:53.945 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.940+0000 7f6d6ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.945 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.940+0000 7f6d6ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:12:53.945 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.940+0000 7f6d6ffff640 10 monclient: dump: 2026-02-12T18:12:53.945 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.945 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.945 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.945 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.945 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.945 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.945 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.945 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.945 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.945 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.945 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.945 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.945 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.945 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.945 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.945 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.945 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.940+0000 7f6d6ffff640 10 monclient: _finish_auth 0 2026-02-12T18:12:53.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.940+0000 7f6d6ffff640 10 monclient: _check_auth_tickets 2026-02-12T18:12:53.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.940+0000 7f6d6ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:53.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.940+0000 7f6d8770c640 5 monclient: authenticate success, global_id 64498 2026-02-12T18:12:53.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.940+0000 7f6d8770c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:12:53.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.940+0000 7f6d6ffff640 1 -- 10.20.193.48:0/3259112195 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d7002fce0 con 0x7f6d8013dd70 2026-02-12T18:12:53.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.940+0000 7f6d6ffff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:53.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.940+0000 7f6d6ffff640 1 -- 10.20.193.48:0/3259112195 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6d7002fe50 con 0x7f6d8013dd70 2026-02-12T18:12:53.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.940+0000 7f6d8770c640 10 monclient: get_monmap_and_config success 2026-02-12T18:12:53.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.940+0000 7f6d8770c640 4 set_mon_vals no callback set 2026-02-12T18:12:53.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.940+0000 7f6d6ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.940+0000 7f6d6ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:12:53.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.940+0000 7f6d6ffff640 10 monclient: dump: 2026-02-12T18:12:53.946 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.946 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.946 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.946 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.946 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.946 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.946 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.946 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.946 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.946 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.946 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.946 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.946 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.947 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.947 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.947 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.947 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.941+0000 7f6d8770c640 10 monclient: shutdown 2026-02-12T18:12:53.947 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.941+0000 7f6d8770c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:53.947 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.941+0000 7f6d8770c640 1 -- 10.20.193.48:0/3259112195 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6d8013dd70 msgr2=0x7f6d8013e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.947 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.941+0000 7f6d8770c640 1 --2- 10.20.193.48:0/3259112195 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6d8013dd70 0x7f6d8013e140 secure :-1 s=READY pgs=111 gs=3 cs=0 l=1 c_cookie=3880143182401357137 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d700098d0 tx=0x7f6d7002ee20 comp rx=0 tx=0).stop 2026-02-12T18:12:53.947 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.941+0000 7f6d8770c640 1 -- 10.20.193.48:0/3259112195 shutdown_connections 2026-02-12T18:12:53.947 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.941+0000 7f6d8770c640 1 --2- 10.20.193.48:0/3259112195 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6d8013dd70 0x7f6d8013e140 unknown :-1 s=CLOSED pgs=111 gs=3 cs=0 l=1 c_cookie=3880143182401357137 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.947 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.941+0000 7f6d8770c640 1 -- 10.20.193.48:0/3259112195 >> 10.20.193.48:0/3259112195 conn(0x7f6d800546a0 msgr2=0x7f6d80054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:53.947 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.941+0000 7f6d8770c640 1 -- 10.20.193.48:0/3259112195 shutdown_connections 2026-02-12T18:12:53.947 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.941+0000 7f6d8770c640 1 -- 10.20.193.48:0/3259112195 wait complete. 2026-02-12T18:12:53.947 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.941+0000 7f6d8770c640 10 monclient: build_initial_monmap 2026-02-12T18:12:53.947 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.941+0000 7f6d8770c640 10 monclient: monmap: 2026-02-12T18:12:53.947 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:53.947 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:12:53.947 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:12:53.947 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:12:53.947 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:53.947 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.947 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:12:53.947 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:12:53.947 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:53.947 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:53.948 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:53.948 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:53.948 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:53.948 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:53.948 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:53.948 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.948 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.941+0000 7f6d8770c640 1 Processor -- start 2026-02-12T18:12:53.948 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.941+0000 7f6d8770c640 1 -- start start 2026-02-12T18:12:53.948 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.941+0000 7f6d8770c640 10 monclient: init 2026-02-12T18:12:53.948 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d8770c640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:53.948 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d8770c640 10 monclient: _add_conns ranks=[0,5,6,2,1,3,7,4,8] 2026-02-12T18:12:53.948 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d8770c640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6d8005dee0 0x7f6d8012c820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.948 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d8770c640 10 monclient(hunting): picked mon.noname-a con 0x7f6d8005dee0 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:12:53.948 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d8770c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6d8013dd70 0x7f6d80109970 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.948 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d8770c640 10 monclient(hunting): picked mon.noname-h con 0x7f6d8013dd70 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:12:53.948 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d8770c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6d80144940 0x7f6d80109eb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.948 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d8770c640 10 monclient(hunting): picked mon.noname-d con 0x7f6d80144940 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:12:53.948 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d8770c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.948 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d8770c640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f6d8010d440 con 0x7f6d8005dee0 2026-02-12T18:12:53.948 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d8770c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.948 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d8770c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f6d8010d720 con 0x7f6d8013dd70 2026-02-12T18:12:53.948 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d8770c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.948 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d8770c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f6d8008e3c0 con 0x7f6d80144940 2026-02-12T18:12:53.948 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d8770c640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:53.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d8770c640 10 monclient(hunting): authenticate will time out at 1012.668095s 2026-02-12T18:12:53.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85481640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6d8005dee0 0x7f6d8012c820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85c82640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6d80144940 0x7f6d80109eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85481640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6d8005dee0 0x7f6d8012c820 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:42362/0 (socket says 10.20.193.48:42362) 2026-02-12T18:12:53.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85481640 1 -- 10.20.193.48:0/274651094 learned_addr learned my addr 10.20.193.48:0/274651094 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:53.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85481640 10 monclient(hunting): get_auth_request con 0x7f6d8005dee0 auth_method 0 2026-02-12T18:12:53.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85481640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85481640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85c82640 10 monclient(hunting): get_auth_request con 0x7f6d80144940 auth_method 0 2026-02-12T18:12:53.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85c82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85c82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85c82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85481640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85481640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85481640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85c82640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85c82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85c82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d84c80640 1 --2- 10.20.193.48:0/274651094 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6d8013dd70 0x7f6d80109970 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d84c80640 10 monclient(hunting): get_auth_request con 0x7f6d8013dd70 auth_method 0 2026-02-12T18:12:53.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d84c80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d84c80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d84c80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85481640 10 monclient(hunting): handle_auth_done global_id 6237 payload 824 2026-02-12T18:12:53.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85481640 1 -- 10.20.193.48:0/274651094 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6d80144940 msgr2=0x7f6d80109eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85481640 1 --2- 10.20.193.48:0/274651094 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6d80144940 0x7f6d80109eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85481640 1 -- 10.20.193.48:0/274651094 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6d8013dd70 msgr2=0x7f6d80109970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85481640 1 --2- 10.20.193.48:0/274651094 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6d8013dd70 0x7f6d80109970 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85481640 10 monclient: _finish_hunting 0 2026-02-12T18:12:53.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85481640 1 monclient: found mon.noname-a 2026-02-12T18:12:53.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85481640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:53.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85481640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:12:53.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85481640 1 -- 10.20.193.48:0/274651094 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d700094f0 con 0x7f6d8005dee0 2026-02-12T18:12:53.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.942+0000 7f6d85c82640 1 --2- 10.20.193.48:0/274651094 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6d80144940 0x7f6d80109eb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:12:53.952 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.944+0000 7f6d85481640 1 -- 10.20.193.48:0/274651094 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6d8005dee0 msgr2=0x7f6d8012c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.952 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.944+0000 7f6d85481640 1 --2- 10.20.193.48:0/274651094 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6d8005dee0 0x7f6d8012c820 secure :-1 s=READY pgs=482 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d70004740 tx=0x7f6d700047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.952 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.944+0000 7f6d6dffb640 1 -- 10.20.193.48:0/274651094 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6d7002fe50 con 0x7f6d8005dee0 2026-02-12T18:12:53.952 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.944+0000 7f6d6dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.952 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.944+0000 7f6d6dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:12:53.952 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.944+0000 7f6d6dffb640 10 monclient: dump: 2026-02-12T18:12:53.952 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.952 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.952 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.952 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.952 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.952 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.952 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.952 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.952 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.952 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.952 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.952 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.953 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.953 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.953 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.953 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.953 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.944+0000 7f6d6dffb640 10 monclient: _finish_auth 0 2026-02-12T18:12:53.953 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.944+0000 7f6d6dffb640 10 monclient: _check_auth_tickets 2026-02-12T18:12:53.953 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.944+0000 7f6d6dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:53.953 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.944+0000 7f6d8770c640 5 monclient: authenticate success, global_id 6237 2026-02-12T18:12:53.953 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.944+0000 7f6d8770c640 10 monclient: _renew_subs 2026-02-12T18:12:53.953 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.944+0000 7f6d8770c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:12:53.953 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.944+0000 7f6d8770c640 1 -- 10.20.193.48:0/274651094 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d8010b3c0 con 0x7f6d8005dee0 2026-02-12T18:12:53.953 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.944+0000 7f6d6dffb640 1 -- 10.20.193.48:0/274651094 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d70004030 con 0x7f6d8005dee0 2026-02-12T18:12:53.953 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.944+0000 7f6d6dffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:53.953 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.944+0000 7f6d6dffb640 1 -- 10.20.193.48:0/274651094 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6d700036d0 con 0x7f6d8005dee0 2026-02-12T18:12:53.953 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.944+0000 7f6d6dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.953 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.944+0000 7f6d6dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:12:53.953 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.944+0000 7f6d6f7fe640 4 set_mon_vals no callback set 2026-02-12T18:12:53.953 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.944+0000 7f6d6dffb640 10 monclient: dump: 2026-02-12T18:12:53.953 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.953 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.953 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.953 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.953 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.953 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.953 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.954 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.954 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.954 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.954 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.954 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.954 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.954 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.954 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.954 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.954 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.944+0000 7f6d8770c640 10 monclient: _renew_subs 2026-02-12T18:12:53.954 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.944+0000 7f6d8770c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:12:53.954 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.944+0000 7f6d8770c640 1 -- 10.20.193.48:0/274651094 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d8012c280 con 0x7f6d8005dee0 2026-02-12T18:12:53.954 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.945+0000 7f6d8770c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:53.954 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.945+0000 7f6d8770c640 1 --2- 10.20.193.48:0/274651094 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d80091010 0x7f6d8010a3f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.954 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.945+0000 7f6d8770c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.954 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.945+0000 7f6d8770c640 1 -- 10.20.193.48:0/274651094 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f6d800631f0 con 0x7f6d80091010 2026-02-12T18:12:53.954 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.945+0000 7f6d84c80640 1 --2- 10.20.193.48:0/274651094 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d80091010 0x7f6d8010a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.954 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.945+0000 7f6d6dffb640 1 -- 10.20.193.48:0/274651094 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f6d7004a070 con 0x7f6d8005dee0 2026-02-12T18:12:53.954 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.945+0000 7f6d84c80640 10 monclient: get_auth_request con 0x7f6d80091010 auth_method 0 2026-02-12T18:12:53.954 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.945+0000 7f6d84c80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.954 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.945+0000 7f6d84c80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.954 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.945+0000 7f6d84c80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.954 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.945+0000 7f6d84c80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.955 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.945+0000 7f6d84c80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.955 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.945+0000 7f6d84c80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.955 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.945+0000 7f6d6dffb640 1 --2- 10.20.193.48:0/274651094 >> v2:10.20.193.111:6812/977811348 conn(0x7f6d5003f800 0x7f6d5005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.955 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.945+0000 7f6d6dffb640 1 -- 10.20.193.48:0/274651094 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(222..222 src has 190..222) ==== 3897+0+0 (secure 0 0 0) 0x7f6d700785c0 con 0x7f6d8005dee0 2026-02-12T18:12:53.955 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.945+0000 7f6d84c80640 10 monclient(hunting): handle_auth_done global_id 94255 payload 824 2026-02-12T18:12:53.955 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.945+0000 7f6d85c82640 1 --2- 10.20.193.48:0/274651094 >> v2:10.20.193.111:6812/977811348 conn(0x7f6d5003f800 0x7f6d5005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.955 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.945+0000 7f6d84c80640 1 -- 10.20.193.48:0/274651094 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6d8005c170 con 0x7f6d80091010 2026-02-12T18:12:53.955 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.945+0000 7f6d85c82640 10 monclient: get_auth_request con 0x7f6d5003f800 auth_method 0 2026-02-12T18:12:53.955 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.948+0000 7f6d84c80640 1 -- 10.20.193.48:0/274651094 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d80091010 msgr2=0x7f6d8010a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.955 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.948+0000 7f6d84c80640 1 --2- 10.20.193.48:0/274651094 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d80091010 0x7f6d8010a3f0 secure :-1 s=READY pgs=31 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d8013cb90 tx=0x7f6d7400d970 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.955 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.948+0000 7f6d85c82640 1 --2- 10.20.193.48:0/274651094 >> v2:10.20.193.111:6812/977811348 conn(0x7f6d5003f800 0x7f6d5005fcb0 secure :-1 s=READY pgs=346 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d7c008fd0 tx=0x7f6d7c008f20 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.955 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.948+0000 7f6d6dffb640 1 -- 10.20.193.48:0/274651094 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6d74002b60 con 0x7f6d80091010 2026-02-12T18:12:53.955 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.948+0000 7f6d6dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.955 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.948+0000 7f6d6dffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:12:53.955 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.948+0000 7f6d6dffb640 10 monclient: dump: 2026-02-12T18:12:53.955 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.955 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.955 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.955 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.955 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.955 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.955 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.955 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.955 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.956 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.956 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.956 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.956 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.956 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.956 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.956 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.956 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.948+0000 7f6d6dffb640 1 -- 10.20.193.48:0/274651094 <== mon.7 v2:10.20.193.111:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f6d74002cc0 con 0x7f6d80091010 2026-02-12T18:12:53.956 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.948+0000 7f6d6dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:53.956 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.948+0000 7f6d6dffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:12:53.956 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.948+0000 7f6d6dffb640 1 -- 10.20.193.48:0/274651094 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d80091010 msgr2=0x7f6d8010a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.956 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.948+0000 7f6d6dffb640 1 --2- 10.20.193.48:0/274651094 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d80091010 0x7f6d8010a3f0 secure :-1 s=READY pgs=31 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d8013cb90 tx=0x7f6d7400d970 comp rx=0 tx=0).stop 2026-02-12T18:12:53.956 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.948+0000 7f6d6dffb640 1 -- 10.20.193.48:0/274651094 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d80091010 msgr2=0x7f6d8010a3f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:53.956 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.948+0000 7f6d6dffb640 1 --2- 10.20.193.48:0/274651094 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d80091010 0x7f6d8010a3f0 secure :-1 s=CLOSED pgs=31 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d8013cb90 tx=0x7f6d7400d970 comp rx=0 tx=0).stop 2026-02-12T18:12:53.957 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.951+0000 7f6d8770c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:12:53.957 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.951+0000 7f6d8770c640 1 --2- 10.20.193.48:0/274651094 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d8012cd60 0x7f6d8008bab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:53.957 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.951+0000 7f6d8770c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:53.957 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.951+0000 7f6d8770c640 1 -- 10.20.193.48:0/274651094 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f6d80050410 con 0x7f6d8012cd60 2026-02-12T18:12:53.957 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.951+0000 7f6d84c80640 1 --2- 10.20.193.48:0/274651094 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d8012cd60 0x7f6d8008bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:53.957 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.951+0000 7f6d84c80640 10 monclient: get_auth_request con 0x7f6d8012cd60 auth_method 0 2026-02-12T18:12:53.958 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.951+0000 7f6d84c80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:53.958 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.951+0000 7f6d84c80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:53.958 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.951+0000 7f6d84c80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:53.958 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.951+0000 7f6d84c80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:53.958 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.951+0000 7f6d84c80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:53.958 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.951+0000 7f6d84c80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:53.958 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.952+0000 7f6d84c80640 10 monclient(hunting): handle_auth_done global_id 94264 payload 824 2026-02-12T18:12:53.958 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.952+0000 7f6d84c80640 1 -- 10.20.193.48:0/274651094 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6d8013e680 con 0x7f6d8012cd60 2026-02-12T18:12:53.958 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.954+0000 7f6d84c80640 1 -- 10.20.193.48:0/274651094 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d8012cd60 msgr2=0x7f6d8008bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:53.958 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.954+0000 7f6d84c80640 1 --2- 10.20.193.48:0/274651094 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d8012cd60 0x7f6d8008bab0 secure :-1 s=READY pgs=32 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d74014000 tx=0x7f6d74004770 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:53.958 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.954+0000 7f6d6dffb640 1 -- 10.20.193.48:0/274651094 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6d7401baf0 con 0x7f6d8012cd60 2026-02-12T18:12:53.958 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.954+0000 7f6d6dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:53.958 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.954+0000 7f6d6dffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:12:53.958 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.954+0000 7f6d6dffb640 10 monclient: dump: 2026-02-12T18:12:53.958 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:53.958 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:53.958 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.958 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:53.958 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:53.958 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:53.958 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:53.958 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:53.958 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:53.958 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:53.959 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:53.959 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:53.959 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:53.959 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:53.959 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:53.959 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:53.959 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.954+0000 7f6d6dffb640 1 -- 10.20.193.48:0/274651094 <== mon.7 v2:10.20.193.111:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7f6d7401bc50 con 0x7f6d8012cd60 2026-02-12T18:12:53.959 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.954+0000 7f6d6dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:12:53.959 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.954+0000 7f6d6dffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:12:53.959 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.954+0000 7f6d6dffb640 1 -- 10.20.193.48:0/274651094 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d8012cd60 msgr2=0x7f6d8008bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.959 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.954+0000 7f6d6dffb640 1 --2- 10.20.193.48:0/274651094 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d8012cd60 0x7f6d8008bab0 secure :-1 s=READY pgs=32 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d74014000 tx=0x7f6d74004770 comp rx=0 tx=0).stop 2026-02-12T18:12:53.959 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.954+0000 7f6d6dffb640 1 -- 10.20.193.48:0/274651094 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d8012cd60 msgr2=0x7f6d8008bab0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:12:53.959 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.954+0000 7f6d6dffb640 1 --2- 10.20.193.48:0/274651094 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6d8012cd60 0x7f6d8008bab0 secure :-1 s=CLOSED pgs=32 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d74014000 tx=0x7f6d74004770 comp rx=0 tx=0).stop 2026-02-12T18:12:53.959 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:12:53.959 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:12:53.959 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:12:53.959 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:12:53.959 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 68, 2026-02-12T18:12:53.959 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 19638, 2026-02-12T18:12:53.960 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:12:53.960 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:12:53.960 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:12:53.960 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:12:53.960 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:12:53.960 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:12:53.960 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:12:53.960 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:12:53.960 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:12:53.960 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:12:53.960 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.960 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 4, 2026-02-12T18:12:53.960 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:53.960 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:12:53.960 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:12:53.960 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.960 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.960 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.960 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.960 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.960 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.960 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.960 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.961 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.961 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.961 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.961 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.961 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.961 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.961 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:12:53.961 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:12:53.961 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.961 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.961 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.961 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.961 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.961 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.961 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.961 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.961 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.961 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.961 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.961 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.961 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.961 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.961 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.961 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:12:53.962 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:12:53.962 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:12:53.962 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:12:53.962 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:12:53.962 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:12:53.962 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:53.962 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:12:53.962 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:12:53.962 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:12:53.962 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:12:53.962 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:12:53.962 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:12:53.962 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:12:53.962 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:12:53.962 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:12:53.962 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:12:53.962 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:12:53.962 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:12:53.962 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:12:53.962 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:12:53.962 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:12:53.962 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:12:53.962 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:12:53.962 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:12:53.963 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:12:53.963 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:12:53.963 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:12:53.963 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:12:53.963 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:12:53.963 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.963 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:12:53.963 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.963 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:12:53.963 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.963 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:12:53.963 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:12:53.963 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.963 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.963 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.963 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.963 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:12:53.963 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.963 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.963 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.963 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.963 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:12:53.963 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.963 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.964 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.964 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.964 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:12:53.964 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:12:53.964 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.964 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.964 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:12:53.964 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.964 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.964 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.964 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:12:53.964 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:12:53.964 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.964 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.964 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.964 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.964 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:12:53.964 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.964 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.964 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.964 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.964 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:12:53.964 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.964 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.965 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.965 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.965 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:12:53.965 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:12:53.965 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.965 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.965 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:12:53.965 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.965 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.965 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.965 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:12:53.965 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:12:53.965 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.965 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.965 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.965 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.965 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:12:53.965 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.965 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.965 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.965 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.965 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:12:53.965 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.965 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.965 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.966 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.966 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:12:53.966 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:12:53.966 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.966 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.966 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:12:53.966 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.966 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.966 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.966 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:12:53.966 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:12:53.966 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.966 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.966 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.966 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.966 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:12:53.966 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.966 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.966 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.966 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.966 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:12:53.966 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.966 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.966 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.967 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.967 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:12:53.967 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:12:53.967 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.967 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.967 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:12:53.967 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.967 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.967 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.967 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:12:53.967 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:12:53.967 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.967 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.967 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.967 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.967 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:12:53.967 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.967 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.967 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.967 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.967 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:12:53.967 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.967 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.967 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.967 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.968 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:12:53.968 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:12:53.968 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.968 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.968 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:53.968 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.968 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.968 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.968 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:12:53.968 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:12:53.968 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.968 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.968 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.968 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.968 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:12:53.968 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.968 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.968 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.968 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.968 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:12:53.968 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.968 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.968 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.968 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.969 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:12:53.969 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:12:53.969 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.969 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.969 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:12:53.969 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.969 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.969 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.969 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:12:53.969 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:12:53.969 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.969 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.969 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.969 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.969 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:12:53.969 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.969 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.969 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.969 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.969 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:12:53.969 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.969 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.969 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.969 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.969 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:12:53.969 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:12:53.970 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.970 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.970 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:12:53.970 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.970 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.970 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.970 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:12:53.970 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:12:53.970 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.970 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.970 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.970 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.970 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:12:53.970 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.970 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.970 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.970 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.970 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:12:53.970 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.970 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.970 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.970 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.970 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:12:53.970 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:12:53.970 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.971 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.971 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:12:53.971 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.971 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.971 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.971 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:12:53.971 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:12:53.971 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:12:53.971 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:12:53.971 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.971 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:12:53.971 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:12:53.971 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.971 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.971 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.971 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:12:53.971 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:12:53.971 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:12:53.971 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.971 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.971 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.971 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:12:53.971 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:12:53.971 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:12:53.971 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:12:53.971 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:12:53.972 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:12:53.972 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.972 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.972 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.972 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:12:53.972 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:12:53.972 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.972 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:53.972 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:53.972 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:53.972 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.972 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:12:53.972 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:12:53.972 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:12:53.972 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:12:53.972 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:12:53.972 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:12:53.972 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:12:53.972 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:12:53.972 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:12:53.972 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:12:53.972 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:12:53.973 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.955+0000 7f6d8770c640 1 -- 10.20.193.48:0/274651094 >> v2:10.20.193.111:6812/977811348 conn(0x7f6d5003f800 msgr2=0x7f6d5005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.973 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.955+0000 7f6d8770c640 1 --2- 10.20.193.48:0/274651094 >> v2:10.20.193.111:6812/977811348 conn(0x7f6d5003f800 0x7f6d5005fcb0 secure :-1 s=READY pgs=346 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d7c008fd0 tx=0x7f6d7c008f20 comp rx=0 tx=0).stop 2026-02-12T18:12:53.973 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.955+0000 7f6d8770c640 10 monclient: shutdown 2026-02-12T18:12:53.973 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.955+0000 7f6d8770c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:53.973 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.955+0000 7f6d8770c640 1 -- 10.20.193.48:0/274651094 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6d8005dee0 msgr2=0x7f6d8012c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:53.973 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.955+0000 7f6d8770c640 1 --2- 10.20.193.48:0/274651094 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6d8005dee0 0x7f6d8012c820 secure :-1 s=READY pgs=482 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6d70004740 tx=0x7f6d700047e0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.973 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.955+0000 7f6d85c82640 1 -- 10.20.193.48:0/274651094 reap_dead start 2026-02-12T18:12:53.974 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.955+0000 7f6d8770c640 1 -- 10.20.193.48:0/274651094 shutdown_connections 2026-02-12T18:12:53.974 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.955+0000 7f6d8770c640 1 --2- 10.20.193.48:0/274651094 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6d8005dee0 0x7f6d8012c820 unknown :-1 s=CLOSED pgs=482 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:53.974 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.955+0000 7f6d8770c640 1 -- 10.20.193.48:0/274651094 >> 10.20.193.48:0/274651094 conn(0x7f6d800546a0 msgr2=0x7f6d80144180 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:53.974 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.955+0000 7f6d8770c640 1 -- 10.20.193.48:0/274651094 shutdown_connections 2026-02-12T18:12:53.974 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:53.955+0000 7f6d8770c640 1 -- 10.20.193.48:0/274651094 wait complete. 2026-02-12T18:12:53.974 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:12:53.974 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['h', 'd', 'g'] 2026-02-12T18:12:53.975 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2026-02-12T18:12:53.975 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.h 2026-02-12T18:12:53.975 INFO:tasks.mon_thrash.mon_thrasher:killing mon.h 2026-02-12T18:12:53.975 DEBUG:tasks.ceph.mon.h:waiting for process to exit 2026-02-12T18:12:53.975 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:12:53.984 INFO:tasks.ceph.mon.h:Stopped 2026-02-12T18:12:53.984 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.d 2026-02-12T18:12:53.984 INFO:tasks.mon_thrash.mon_thrasher:killing mon.d 2026-02-12T18:12:53.985 DEBUG:tasks.ceph.mon.d:waiting for process to exit 2026-02-12T18:12:53.985 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:12:53.995 INFO:tasks.ceph.mon.d:Stopped 2026-02-12T18:12:53.995 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.g 2026-02-12T18:12:53.995 INFO:tasks.mon_thrash.mon_thrasher:killing mon.g 2026-02-12T18:12:53.995 DEBUG:tasks.ceph.mon.g:waiting for process to exit 2026-02-12T18:12:53.995 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:12:54.035 INFO:tasks.ceph.mon.g:Stopped 2026-02-12T18:12:54.035 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 6 2026-02-12T18:12:54.035 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T18:12:54.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.100+0000 7fc8bcd0c640 10 monclient: get_monmap_and_config 2026-02-12T18:12:54.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.100+0000 7fc8bcd0c640 10 monclient: build_initial_monmap 2026-02-12T18:12:54.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.100+0000 7fc8bcd0c640 10 monclient: monmap: 2026-02-12T18:12:54.102 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:54.102 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:54.102 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:12:54.101686+0000 2026-02-12T18:12:54.102 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:12:54.101686+0000 2026-02-12T18:12:54.102 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:54.102 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:54.102 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:12:54.103 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:12:54.103 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:54.103 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:54.103 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:54.103 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:54.103 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:54.103 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:54.103 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:54.103 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:12:54.103 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:12:54.103 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:54.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8bcd0c640 1 Processor -- start 2026-02-12T18:12:54.108 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8bcd0c640 1 -- start start 2026-02-12T18:12:54.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8bcd0c640 10 monclient: init 2026-02-12T18:12:54.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8bcd0c640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:54.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8bcd0c640 10 monclient: _add_conns ranks=[7,2,3,1,5,10,9,8,6,0,4] 2026-02-12T18:12:54.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8bcd0c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fc8b805dc20 0x7fc8b8144660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:54.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8bcd0c640 10 monclient(hunting): picked mon.noname-i con 0x7fc8b805dc20 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:12:54.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8bcd0c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc8b805dff0 0x7fc8b805e3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:54.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8bcd0c640 10 monclient(hunting): picked mon.noname-b con 0x7fc8b805dff0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:12:54.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8bcd0c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc8b8089df0 0x7fc8b808a240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:54.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8bcd0c640 10 monclient(hunting): picked mon.noname-g con 0x7fc8b8089df0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:12:54.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8bcd0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:54.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8bcd0c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b8093a30 con 0x7fc8b805dff0 2026-02-12T18:12:54.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8bcd0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:54.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8bcd0c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b8092200 con 0x7fc8b8089df0 2026-02-12T18:12:54.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8bcd0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:54.109 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8bcd0c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fc8b808b250 con 0x7fc8b805dc20 2026-02-12T18:12:54.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8bcd0c640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:54.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8bcd0c640 10 monclient(hunting): authenticate will time out at 1012.827373s 2026-02-12T18:12:54.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b5d74640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc8b805dff0 0x7fc8b805e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:54.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b6d76640 1 -- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc8b8089df0 msgr2=0x7fc8b808a240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3301/0 2026-02-12T18:12:54.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b6d76640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc8b8089df0 0x7fc8b808a240 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:12:54.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b5d74640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc8b805dff0 0x7fc8b805e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:47524/0 (socket says 10.20.193.48:47524) 2026-02-12T18:12:54.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b5d74640 1 -- 10.20.193.48:0/2088158909 learned_addr learned my addr 10.20.193.48:0/2088158909 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:54.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b5d74640 10 monclient(hunting): get_auth_request con 0x7fc8b805dff0 auth_method 0 2026-02-12T18:12:54.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b5d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:54.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b5d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:54.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:54.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b5d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:54.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b5d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:54.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b6575640 1 --2- 10.20.193.48:0/2088158909 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fc8b805dc20 0x7fc8b8144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:54.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b5d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:54.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b6575640 10 monclient(hunting): get_auth_request con 0x7fc8b805dc20 auth_method 0 2026-02-12T18:12:54.110 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:54.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b6575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:54.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:54.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b5d74640 10 monclient(hunting): handle_auth_done global_id 35930 payload 274 2026-02-12T18:12:54.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b5d74640 1 -- 10.20.193.48:0/2088158909 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fc8b805dc20 msgr2=0x7fc8b8144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:54.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b5d74640 1 --2- 10.20.193.48:0/2088158909 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fc8b805dc20 0x7fc8b8144660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:54.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b5d74640 1 -- 10.20.193.48:0/2088158909 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc8b8089df0 msgr2=0x7fc8b808a240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:12:54.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b5d74640 1 --2- 10.20.193.48:0/2088158909 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc8b8089df0 0x7fc8b808a240 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:54.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b5d74640 10 monclient: _finish_hunting 0 2026-02-12T18:12:54.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b5d74640 1 monclient: found mon.noname-b 2026-02-12T18:12:54.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b5d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:54.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b5d74640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:12:54.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.101+0000 7fc8b5d74640 1 -- 10.20.193.48:0/2088158909 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8b8060390 con 0x7fc8b805dff0 2026-02-12T18:12:54.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8b5d74640 1 -- 10.20.193.48:0/2088158909 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc8b805dff0 msgr2=0x7fc8b805e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:54.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8b5d74640 1 --2- 10.20.193.48:0/2088158909 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc8b805dff0 0x7fc8b805e3c0 secure :-1 s=READY pgs=316 gs=1 cs=0 l=1 c_cookie=11160889279346624218 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8a0009900 tx=0x7fc8a002eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ae371aaa8ebc6da server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:54.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8b5573640 1 -- 10.20.193.48:0/2088158909 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc8a0035340 con 0x7fc8b805dff0 2026-02-12T18:12:54.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8b5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:54.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8b5573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:12:54.112 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8b5573640 10 monclient: dump: 2026-02-12T18:12:54.112 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:54.112 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:54.112 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:54.112 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:54.112 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:54.112 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:54.112 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:54.112 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:54.112 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:54.112 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:54.112 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:54.112 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:54.112 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:54.112 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:54.112 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:54.113 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:54.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8b5573640 10 monclient: _finish_auth 0 2026-02-12T18:12:54.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8b5573640 10 monclient: _check_auth_tickets 2026-02-12T18:12:54.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8b5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:54.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8b5573640 1 -- 10.20.193.48:0/2088158909 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8a00354c0 con 0x7fc8b805dff0 2026-02-12T18:12:54.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8b5573640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:54.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8b5573640 1 -- 10.20.193.48:0/2088158909 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc8a0035af0 con 0x7fc8b805dff0 2026-02-12T18:12:54.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8b5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:54.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8b5573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:12:54.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8b5573640 10 monclient: dump: 2026-02-12T18:12:54.113 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:54.113 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:54.113 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:54.113 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:54.113 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:54.113 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:54.113 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:54.114 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:54.114 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:54.114 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:54.114 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:54.114 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:54.114 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:54.114 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:54.114 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:54.114 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:54.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8bcd0c640 5 monclient: authenticate success, global_id 35930 2026-02-12T18:12:54.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8bcd0c640 10 monclient: get_monmap_and_config success 2026-02-12T18:12:54.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8bcd0c640 4 set_mon_vals no callback set 2026-02-12T18:12:54.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8bcd0c640 10 monclient: shutdown 2026-02-12T18:12:54.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8bcd0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:54.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8bcd0c640 1 -- 10.20.193.48:0/2088158909 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc8b805dff0 msgr2=0x7fc8b805e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:54.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8bcd0c640 1 --2- 10.20.193.48:0/2088158909 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc8b805dff0 0x7fc8b805e3c0 secure :-1 s=READY pgs=316 gs=1 cs=0 l=1 c_cookie=11160889279346624218 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8a0009900 tx=0x7fc8a002eeb0 comp rx=0 tx=0).stop 2026-02-12T18:12:54.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8bcd0c640 1 -- 10.20.193.48:0/2088158909 shutdown_connections 2026-02-12T18:12:54.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8bcd0c640 1 --2- 10.20.193.48:0/2088158909 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc8b8089df0 0x7fc8b808a240 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:54.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8bcd0c640 1 --2- 10.20.193.48:0/2088158909 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fc8b805dff0 0x7fc8b805e3c0 unknown :-1 s=CLOSED pgs=316 gs=1 cs=0 l=1 c_cookie=11160889279346624218 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:54.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8bcd0c640 1 --2- 10.20.193.48:0/2088158909 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fc8b805dc20 0x7fc8b8144660 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:54.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8bcd0c640 1 -- 10.20.193.48:0/2088158909 >> 10.20.193.48:0/2088158909 conn(0x7fc8b80546d0 msgr2=0x7fc8b8054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:54.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8bcd0c640 1 -- 10.20.193.48:0/2088158909 shutdown_connections 2026-02-12T18:12:54.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.104+0000 7fc8bcd0c640 1 -- 10.20.193.48:0/2088158909 wait complete. 2026-02-12T18:12:54.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8bcd0c640 10 monclient: build_initial_monmap 2026-02-12T18:12:54.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8bcd0c640 10 monclient: monmap: 2026-02-12T18:12:54.115 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:54.115 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:12:54.115 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:12:54.115 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:12:54.115 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:54.115 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:54.115 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:12:54.115 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:12:54.115 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:54.115 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:54.116 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:54.116 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:54.116 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:54.116 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:54.116 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:54.116 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:54.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8bcd0c640 1 Processor -- start 2026-02-12T18:12:54.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8bcd0c640 1 -- start start 2026-02-12T18:12:54.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8bcd0c640 10 monclient: init 2026-02-12T18:12:54.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8bcd0c640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:54.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8bcd0c640 10 monclient: _add_conns ranks=[0,3,5,7,8,4,6,2,1] 2026-02-12T18:12:54.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8bcd0c640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fc8b805dc20 0x7fc8b810db60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:54.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8bcd0c640 10 monclient(hunting): picked mon.noname-a con 0x7fc8b805dc20 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:12:54.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8bcd0c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc8b805dff0 0x7fc8b810e0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:54.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8bcd0c640 10 monclient(hunting): picked mon.noname-g con 0x7fc8b805dff0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:12:54.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8bcd0c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fc8b8089df0 0x7fc8b810e5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:54.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8bcd0c640 10 monclient(hunting): picked mon.noname-h con 0x7fc8b8089df0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:12:54.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8bcd0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:54.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8bcd0c640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fc8b8110740 con 0x7fc8b805dc20 2026-02-12T18:12:54.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8bcd0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:54.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8bcd0c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fc8b81424e0 con 0x7fc8b805dff0 2026-02-12T18:12:54.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8bcd0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:54.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8bcd0c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fc8b8142a30 con 0x7fc8b8089df0 2026-02-12T18:12:54.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8bcd0c640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:54.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8bcd0c640 10 monclient(hunting): authenticate will time out at 1012.831801s 2026-02-12T18:12:54.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8b6d76640 1 -- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fc8b8089df0 msgr2=0x7fc8b810e5e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:12:54.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8b5d74640 1 -- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc8b805dff0 msgr2=0x7fc8b810e0a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3301/0 2026-02-12T18:12:54.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8b6575640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fc8b805dc20 0x7fc8b810db60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:54.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8b6d76640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fc8b8089df0 0x7fc8b810e5e0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:12:54.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8b5d74640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc8b805dff0 0x7fc8b810e0a0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:12:54.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8b6575640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fc8b805dc20 0x7fc8b810db60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:40414/0 (socket says 10.20.193.48:40414) 2026-02-12T18:12:54.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8b6575640 1 -- 10.20.193.48:0/784045533 learned_addr learned my addr 10.20.193.48:0/784045533 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:54.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8b6575640 10 monclient(hunting): get_auth_request con 0x7fc8b805dc20 auth_method 0 2026-02-12T18:12:54.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8b6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8b6575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8b6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8b6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8b6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.105+0000 7fc8b6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.106+0000 7fc8b6575640 10 monclient(hunting): handle_auth_done global_id 6246 payload 824 2026-02-12T18:12:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.106+0000 7fc8b6575640 1 -- 10.20.193.48:0/784045533 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fc8b8089df0 msgr2=0x7fc8b810e5e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:12:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.106+0000 7fc8b6575640 1 --2- 10.20.193.48:0/784045533 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fc8b8089df0 0x7fc8b810e5e0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.106+0000 7fc8b6575640 1 -- 10.20.193.48:0/784045533 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc8b805dff0 msgr2=0x7fc8b810e0a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:12:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.106+0000 7fc8b6575640 1 --2- 10.20.193.48:0/784045533 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc8b805dff0 0x7fc8b810e0a0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.106+0000 7fc8b6575640 10 monclient: _finish_hunting 0 2026-02-12T18:12:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.106+0000 7fc8b6575640 1 monclient: found mon.noname-a 2026-02-12T18:12:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.106+0000 7fc8b6575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.106+0000 7fc8b6575640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:12:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.106+0000 7fc8b6575640 1 -- 10.20.193.48:0/784045533 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a00094f0 con 0x7fc8b805dc20 2026-02-12T18:12:54.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.108+0000 7fc8b6575640 1 -- 10.20.193.48:0/784045533 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fc8b805dc20 msgr2=0x7fc8b810db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:54.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.108+0000 7fc8b6575640 1 --2- 10.20.193.48:0/784045533 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fc8b805dc20 0x7fc8b810db60 secure :-1 s=READY pgs=487 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8ac006f30 tx=0x7fc8ac00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:54.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.108+0000 7fc89effd640 1 -- 10.20.193.48:0/784045533 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc8ac00cda0 con 0x7fc8b805dc20 2026-02-12T18:12:54.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.108+0000 7fc89effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:54.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.108+0000 7fc89effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:12:54.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.108+0000 7fc89effd640 10 monclient: dump: 2026-02-12T18:12:54.121 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:54.121 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:54.121 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:54.121 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:54.121 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:54.121 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:54.121 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:54.121 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:54.121 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:54.121 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:54.121 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:54.121 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:54.121 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:54.121 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:54.121 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:54.121 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:54.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.108+0000 7fc89effd640 10 monclient: _finish_auth 0 2026-02-12T18:12:54.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.108+0000 7fc89effd640 10 monclient: _check_auth_tickets 2026-02-12T18:12:54.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.108+0000 7fc89effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:54.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.108+0000 7fc89effd640 1 -- 10.20.193.48:0/784045533 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8ac013410 con 0x7fc8b805dc20 2026-02-12T18:12:54.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.108+0000 7fc89effd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:54.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.108+0000 7fc89effd640 1 -- 10.20.193.48:0/784045533 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc8ac013a40 con 0x7fc8b805dc20 2026-02-12T18:12:54.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.108+0000 7fc89effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:54.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.108+0000 7fc89effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:12:54.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.108+0000 7fc8b4d72640 4 set_mon_vals no callback set 2026-02-12T18:12:54.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.108+0000 7fc89effd640 10 monclient: dump: 2026-02-12T18:12:54.122 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:54.122 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:54.122 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:54.122 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:54.122 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:54.122 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:54.122 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:54.123 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:54.123 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:54.123 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:54.123 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:54.123 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:54.123 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:54.123 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:54.123 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:54.123 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:54.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.108+0000 7fc8bcd0c640 5 monclient: authenticate success, global_id 6246 2026-02-12T18:12:54.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.108+0000 7fc8bcd0c640 10 monclient: _renew_subs 2026-02-12T18:12:54.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.108+0000 7fc8bcd0c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:12:54.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.108+0000 7fc8bcd0c640 1 -- 10.20.193.48:0/784045533 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8b808dd10 con 0x7fc8b805dc20 2026-02-12T18:12:54.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.108+0000 7fc8bcd0c640 10 monclient: _renew_subs 2026-02-12T18:12:54.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.108+0000 7fc8bcd0c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:12:54.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.108+0000 7fc8bcd0c640 1 -- 10.20.193.48:0/784045533 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8b810ecc0 con 0x7fc8b805dc20 2026-02-12T18:12:54.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.109+0000 7fc8bcd0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:54.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.109+0000 7fc8bcd0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:54.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.109+0000 7fc8bcd0c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:12:54.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.109+0000 7fc8bcd0c640 1 -- 10.20.193.48:0/784045533 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8b8092510 con 0x7fc8b805dc20 2026-02-12T18:12:54.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.109+0000 7fc89effd640 1 -- 10.20.193.48:0/784045533 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fc8ac013ba0 con 0x7fc8b805dc20 2026-02-12T18:12:54.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.109+0000 7fc89effd640 1 --2- 10.20.193.48:0/784045533 >> v2:10.20.193.111:6812/977811348 conn(0x7fc88403f780 0x7fc88405fc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:54.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.109+0000 7fc89effd640 1 -- 10.20.193.48:0/784045533 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(222..222 src has 190..222) ==== 3897+0+0 (secure 0 0 0) 0x7fc8ac052d70 con 0x7fc8b805dc20 2026-02-12T18:12:54.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.109+0000 7fc8b5d74640 1 --2- 10.20.193.48:0/784045533 >> v2:10.20.193.111:6812/977811348 conn(0x7fc88403f780 0x7fc88405fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:54.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.109+0000 7fc8b5d74640 10 monclient: get_auth_request con 0x7fc88403f780 auth_method 0 2026-02-12T18:12:54.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.111+0000 7fc89effd640 1 -- 10.20.193.48:0/784045533 <== mon.0 v2:10.20.193.48:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fc8ac012370 con 0x7fc8b805dc20 2026-02-12T18:12:54.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.111+0000 7fc89effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:54.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.111+0000 7fc89effd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:12:54.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.112+0000 7fc8b5d74640 1 --2- 10.20.193.48:0/784045533 >> v2:10.20.193.111:6812/977811348 conn(0x7fc88403f780 0x7fc88405fc30 secure :-1 s=READY pgs=347 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8a00023d0 tx=0x7fc8a0033000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:54.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.258+0000 7fc8bcd0c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T18:12:54.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.258+0000 7fc8bcd0c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T18:12:54.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.258+0000 7fc8bcd0c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:12:54.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.258+0000 7fc8bcd0c640 1 -- 10.20.193.48:0/784045533 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc8b8144660 con 0x7fc8b805dc20 2026-02-12T18:12:54.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.259+0000 7fc89effd640 1 -- 10.20.193.48:0/784045533 <== mon.0 v2:10.20.193.48:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3660 (secure 0 0 0) 0x7fc8ac01b3b0 con 0x7fc8b805dc20 2026-02-12T18:12:54.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.259+0000 7fc89effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T18:12:54.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.259+0000 7fc89effd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:12:54.261 INFO:teuthology.orchestra.run.trial048.stdout:{"election_epoch":68,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":4,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","modified":"2026-02-12T18:05:32.850777Z","created":"2026-02-12T18:05:32.850777Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3300","nonce":0},{"type":"v1","addr":"10.20.193.48:6789","nonce":0}]},"addr":"10.20.193.48:6789/0","public_addr":"10.20.193.48:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850827+0000","crush_location":[]},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3300","nonce":0},{"type":"v1","addr":"10.20.193.111:6789","nonce":0}]},"addr":"10.20.193.111:6789/0","public_addr":"10.20.193.111:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850829+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3301","nonce":0},{"type":"v1","addr":"10.20.193.48:6790","nonce":0}]},"addr":"10.20.193.48:6790/0","public_addr":"10.20.193.48:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850830+0000","crush_location":[]},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3301","nonce":0},{"type":"v1","addr":"10.20.193.111:6790","nonce":0}]},"addr":"10.20.193.111:6790/0","public_addr":"10.20.193.111:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850833+0000","crush_location":[]},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3302","nonce":0},{"type":"v1","addr":"10.20.193.48:6791","nonce":0}]},"addr":"10.20.193.48:6791/0","public_addr":"10.20.193.48:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3302","nonce":0},{"type":"v1","addr":"10.20.193.111:6791","nonce":0}]},"addr":"10.20.193.111:6791/0","public_addr":"10.20.193.111:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850834+0000","crush_location":[]},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3303","nonce":0},{"type":"v1","addr":"10.20.193.48:6792","nonce":0}]},"addr":"10.20.193.48:6792/0","public_addr":"10.20.193.48:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3303","nonce":0},{"type":"v1","addr":"10.20.193.111:6792","nonce":0}]},"addr":"10.20.193.111:6792/0","public_addr":"10.20.193.111:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850835+0000","crush_location":[]},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3304","nonce":0},{"type":"v1","addr":"10.20.193.48:6793","nonce":0}]},"addr":"10.20.193.48:6793/0","public_addr":"10.20.193.48:6793/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850832+0000","crush_location":[]}]}} 2026-02-12T18:12:54.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.260+0000 7fc8bcd0c640 1 -- 10.20.193.48:0/784045533 >> v2:10.20.193.111:6812/977811348 conn(0x7fc88403f780 msgr2=0x7fc88405fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:54.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.260+0000 7fc8bcd0c640 1 --2- 10.20.193.48:0/784045533 >> v2:10.20.193.111:6812/977811348 conn(0x7fc88403f780 0x7fc88405fc30 secure :-1 s=READY pgs=347 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8a00023d0 tx=0x7fc8a0033000 comp rx=0 tx=0).stop 2026-02-12T18:12:54.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.260+0000 7fc8bcd0c640 10 monclient: shutdown 2026-02-12T18:12:54.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.260+0000 7fc8bcd0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:54.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.260+0000 7fc8bcd0c640 1 -- 10.20.193.48:0/784045533 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fc8b805dc20 msgr2=0x7fc8b810db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:54.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.260+0000 7fc8bcd0c640 1 --2- 10.20.193.48:0/784045533 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fc8b805dc20 0x7fc8b810db60 secure :-1 s=READY pgs=487 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc8ac006f30 tx=0x7fc8ac00ebd0 comp rx=0 tx=0).stop 2026-02-12T18:12:54.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.260+0000 7fc8bcd0c640 1 -- 10.20.193.48:0/784045533 shutdown_connections 2026-02-12T18:12:54.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.260+0000 7fc8bcd0c640 1 --2- 10.20.193.48:0/784045533 >> v2:10.20.193.111:6812/977811348 conn(0x7fc88403f780 0x7fc88405fc30 unknown :-1 s=CLOSED pgs=347 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:54.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.260+0000 7fc8bcd0c640 1 --2- 10.20.193.48:0/784045533 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fc8b8089df0 0x7fc8b810e5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:54.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.260+0000 7fc8bcd0c640 1 --2- 10.20.193.48:0/784045533 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc8b805dff0 0x7fc8b810e0a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:54.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.260+0000 7fc8bcd0c640 1 --2- 10.20.193.48:0/784045533 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fc8b805dc20 0x7fc8b810db60 unknown :-1 s=CLOSED pgs=487 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:54.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.260+0000 7fc8bcd0c640 1 -- 10.20.193.48:0/784045533 >> 10.20.193.48:0/784045533 conn(0x7fc8b80546d0 msgr2=0x7fc8b805d490 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:54.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.260+0000 7fc8bcd0c640 1 -- 10.20.193.48:0/784045533 shutdown_connections 2026-02-12T18:12:54.264 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:54.260+0000 7fc8bcd0c640 1 -- 10.20.193.48:0/784045533 wait complete. 2026-02-12T18:12:57.272 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T18:12:57.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.339+0000 7f5b8d647640 10 monclient: get_monmap_and_config 2026-02-12T18:12:57.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.339+0000 7f5b8d647640 10 monclient: build_initial_monmap 2026-02-12T18:12:57.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.339+0000 7f5b8d647640 10 monclient: monmap: 2026-02-12T18:12:57.341 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:57.341 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:57.341 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:12:57.340575+0000 2026-02-12T18:12:57.341 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:12:57.340575+0000 2026-02-12T18:12:57.342 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:57.342 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:57.342 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:12:57.342 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:12:57.342 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:57.342 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:57.342 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:57.342 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:57.342 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:57.342 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:57.342 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:57.342 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:12:57.343 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:12:57.343 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:57.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.340+0000 7f5b8d647640 1 Processor -- start 2026-02-12T18:12:57.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.340+0000 7f5b8d647640 1 -- start start 2026-02-12T18:12:57.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.340+0000 7f5b8d647640 10 monclient: init 2026-02-12T18:12:57.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.340+0000 7f5b8d647640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:57.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.340+0000 7f5b8d647640 10 monclient: _add_conns ranks=[3,1,0,9,8,4,10,5,6,2,7] 2026-02-12T18:12:57.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.340+0000 7f5b8d647640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f5b8805cb90 0x7f5b88144130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:57.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.340+0000 7f5b8d647640 10 monclient(hunting): picked mon.noname-g con 0x7f5b8805cb90 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:12:57.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.340+0000 7f5b8d647640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f5b88144670 addr v1:10.20.193.111:6789/0 2026-02-12T18:12:57.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.340+0000 7f5b8d647640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f5b88144a80 addr v1:10.20.193.48:6789/0 2026-02-12T18:12:57.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.340+0000 7f5b8d647640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b88060390 con 0x7f5b88144a80 2026-02-12T18:12:57.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.340+0000 7f5b8d647640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b88092370 con 0x7f5b88144670 2026-02-12T18:12:57.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.340+0000 7f5b8d647640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:57.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.340+0000 7f5b8d647640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f5b8805e8d0 con 0x7f5b8805cb90 2026-02-12T18:12:57.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.340+0000 7f5b8d647640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:57.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.340+0000 7f5b8d647640 10 monclient(hunting): authenticate will time out at 1016.066518s 2026-02-12T18:12:57.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.340+0000 7f5b86ffd640 1 -- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f5b8805cb90 msgr2=0x7f5b88144130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3301/0 2026-02-12T18:12:57.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.340+0000 7f5b86ffd640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f5b8805cb90 0x7f5b88144130 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:12:57.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.340+0000 7f5b877fe640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f5b88144a80 0x7f5b88095fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:38680/0 (socket says 10.20.193.48:38680) 2026-02-12T18:12:57.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.340+0000 7f5b877fe640 1 -- 10.20.193.48:0/3158733340 learned_addr learned my addr 10.20.193.48:0/3158733340 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:12:57.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.342+0000 7f5b877fe640 1 -- 10.20.193.48:0/3158733340 >> v1:10.20.193.48:6789/0 conn(0x7f5b88144a80 legacy=0x7f5b88095fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:57.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.342+0000 7f5b867fc640 1 -- 10.20.193.48:0/3158733340 >> v1:10.20.193.111:6789/0 conn(0x7f5b88144670 legacy=0x7f5b88095890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:57.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.342+0000 7f5b85ffb640 1 -- 10.20.193.48:0/3158733340 <== mon.0 v1:10.20.193.48:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2325424954 0 0) 0x7f5b88060390 con 0x7f5b88144a80 2026-02-12T18:12:57.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.342+0000 7f5b85ffb640 10 monclient(hunting): _negotiate 2026-02-12T18:12:57.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.342+0000 7f5b85ffb640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:57.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.342+0000 7f5b85ffb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:57.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.342+0000 7f5b85ffb640 10 monclient(hunting): my global_id is 6255 2026-02-12T18:12:57.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.342+0000 7f5b85ffb640 1 -- 10.20.193.48:0/3158733340 --> v1:10.20.193.48:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b740035e0 con 0x7f5b88144a80 2026-02-12T18:12:57.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 1 -- 10.20.193.48:0/3158733340 <== mon.0 v1:10.20.193.48:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2773293682 0 0) 0x7f5b740035e0 con 0x7f5b88144a80 2026-02-12T18:12:57.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 1 -- 10.20.193.48:0/3158733340 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f5b8805cb90 msgr2=0x7f5b88144130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:12:57.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 1 --2- 10.20.193.48:0/3158733340 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f5b8805cb90 0x7f5b88144130 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:57.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 1 -- 10.20.193.48:0/3158733340 >> v1:10.20.193.111:6789/0 conn(0x7f5b88144670 legacy=0x7f5b88095890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:57.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 10 monclient: _finish_hunting 0 2026-02-12T18:12:57.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 1 monclient: found mon.noname-a-legacy 2026-02-12T18:12:57.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:57.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 10 monclient: _send_mon_message to mon.noname-a-legacy at v1:10.20.193.48:6789/0 2026-02-12T18:12:57.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 1 -- 10.20.193.48:0/3158733340 --> v1:10.20.193.48:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b8805cf60 con 0x7f5b88144a80 2026-02-12T18:12:57.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 10 monclient: _finish_auth 0 2026-02-12T18:12:57.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:12:57.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:57.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 1 -- 10.20.193.48:0/3158733340 <== mon.0 v1:10.20.193.48:6789/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (unknown 3750814960 0 0) 0x7f5b780044c0 con 0x7f5b88144a80 2026-02-12T18:12:57.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b8d647640 5 monclient: authenticate success, global_id 6255 2026-02-12T18:12:57.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b8d647640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:12:57.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:57.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 10 monclient: got monmap 1 from mon.noname-a-legacy (according to old e1) 2026-02-12T18:12:57.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 10 monclient: dump: 2026-02-12T18:12:57.358 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:57.358 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:57.359 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:57.359 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:57.359 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:57.359 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:57.359 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:57.359 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:57.359 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:57.359 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:57.359 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:57.359 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:57.359 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:57.359 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:57.359 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:57.360 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:57.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 1 monclient: mon.a has (v2) addrs [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] but i'm connected to v1:10.20.193.48:6789/0, reconnecting 2026-02-12T18:12:57.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:57.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 1 -- 10.20.193.48:0/3158733340 >> v1:10.20.193.48:6789/0 conn(0x7f5b88144a80 legacy=0x7f5b88095fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:57.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 10 monclient: _add_conns ranks=[4,8,6,1,0,7,5,3,2] 2026-02-12T18:12:57.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 1 --2- 10.20.193.48:0/3158733340 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5b74004280 0x7f5b74004850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:57.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 10 monclient(hunting): picked mon.c con 0x7f5b74004280 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:12:57.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 1 --2- 10.20.193.48:0/3158733340 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5b74004f90 0x7f5b74045a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:57.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 10 monclient(hunting): picked mon.e con 0x7f5b74004f90 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:12:57.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 1 --2- 10.20.193.48:0/3158733340 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5b74045f40 0x7f5b74066320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:57.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 10 monclient(hunting): picked mon.d con 0x7f5b74045f40 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:12:57.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:57.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 1 -- 10.20.193.48:0/3158733340 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f5b8805e8d0 con 0x7f5b74004280 2026-02-12T18:12:57.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:57.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 1 -- 10.20.193.48:0/3158733340 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f5b74066b40 con 0x7f5b74045f40 2026-02-12T18:12:57.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:57.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 1 -- 10.20.193.48:0/3158733340 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f5b74066cb0 con 0x7f5b74004f90 2026-02-12T18:12:57.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:57.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b85ffb640 10 monclient(hunting): _finish_auth 0 2026-02-12T18:12:57.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b8d647640 20 monclient(hunting): get_monmap_and_config waiting for monmap|config 2026-02-12T18:12:57.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b877fe640 1 -- 10.20.193.48:0/3158733340 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5b74045f40 msgr2=0x7f5b74066320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.48:3303/0 2026-02-12T18:12:57.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b877fe640 1 --2- 10.20.193.48:0/3158733340 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5b74045f40 0x7f5b74066320 unknown :-1 s=START_CONNECT pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:12:57.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b867fc640 1 --2- 10.20.193.48:0/3158733340 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5b74004f90 0x7f5b74045a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:57.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b86ffd640 1 --2- 10.20.193.48:0/3158733340 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5b74004280 0x7f5b74004850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:57.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b867fc640 10 monclient(hunting): get_auth_request con 0x7f5b74004f90 auth_method 0 2026-02-12T18:12:57.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b867fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:57.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b867fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:57.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b867fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:12:57.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b86ffd640 10 monclient(hunting): get_auth_request con 0x7f5b74004280 auth_method 0 2026-02-12T18:12:57.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b86ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:57.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b86ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:57.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b86ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:12:57.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b867fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:57.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b867fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:57.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b867fc640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:12:57.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b86ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:57.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b86ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:57.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b86ffd640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:12:57.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b867fc640 10 monclient(hunting): handle_auth_done global_id 6255 payload 293 2026-02-12T18:12:57.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b867fc640 1 -- 10.20.193.48:0/3158733340 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5b74045f40 msgr2=0x7f5b74066320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:12:57.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b867fc640 1 --2- 10.20.193.48:0/3158733340 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5b74045f40 0x7f5b74066320 unknown :-1 s=START_CONNECT pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:57.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b867fc640 1 -- 10.20.193.48:0/3158733340 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5b74004280 msgr2=0x7f5b74004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:12:57.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b867fc640 1 --2- 10.20.193.48:0/3158733340 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5b74004280 0x7f5b74004850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:57.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b867fc640 10 monclient: _finish_hunting 0 2026-02-12T18:12:57.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b867fc640 1 monclient: found mon.e 2026-02-12T18:12:57.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b877fe640 1 -- 10.20.193.48:0/3158733340 reap_dead start 2026-02-12T18:12:57.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b867fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:57.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b867fc640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:12:57.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b867fc640 1 -- 10.20.193.48:0/3158733340 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b740035e0 con 0x7f5b74004f90 2026-02-12T18:12:57.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b867fc640 10 monclient: _finish_auth 0 2026-02-12T18:12:57.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b867fc640 10 monclient: _check_auth_tickets 2026-02-12T18:12:57.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.343+0000 7f5b867fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:57.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.346+0000 7f5b867fc640 1 -- 10.20.193.48:0/3158733340 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5b74004f90 msgr2=0x7f5b74045a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:57.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.346+0000 7f5b867fc640 1 --2- 10.20.193.48:0/3158733340 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5b74004f90 0x7f5b74045a00 secure :-1 s=READY pgs=49 gs=5 cs=0 l=1 c_cookie=14757641015483720534 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b70003130 tx=0x7f5b7002ef40 comp rx=0 tx=0).ready entity=mon.8 client_cookie=cccdac5072a46356 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:57.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.346+0000 7f5b85ffb640 1 -- 10.20.193.48:0/3158733340 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5b70005e00 con 0x7f5b74004f90 2026-02-12T18:12:57.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.346+0000 7f5b85ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:57.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.346+0000 7f5b85ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:12:57.364 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.346+0000 7f5b85ffb640 10 monclient: dump: 2026-02-12T18:12:57.364 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:57.364 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:57.365 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:57.365 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:57.365 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:57.365 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:57.365 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:57.365 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:57.365 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:57.365 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:57.365 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:57.365 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:57.365 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:57.366 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:57.366 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:57.366 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:57.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.346+0000 7f5b8d647640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:12:57.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.346+0000 7f5b85ffb640 1 -- 10.20.193.48:0/3158733340 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b7002f7a0 con 0x7f5b74004f90 2026-02-12T18:12:57.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.346+0000 7f5b85ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:57.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.346+0000 7f5b85ffb640 1 -- 10.20.193.48:0/3158733340 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5b7002fdd0 con 0x7f5b74004f90 2026-02-12T18:12:57.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.346+0000 7f5b85ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:57.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.346+0000 7f5b85ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:12:57.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.346+0000 7f5b85ffb640 10 monclient: dump: 2026-02-12T18:12:57.366 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:57.367 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:57.367 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:57.367 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:57.367 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:57.367 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:57.367 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:57.367 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:57.367 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:57.367 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:57.367 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:57.367 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:57.367 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:57.368 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:57.368 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:57.368 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:57.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.346+0000 7f5b8d647640 10 monclient: get_monmap_and_config success 2026-02-12T18:12:57.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.346+0000 7f5b8d647640 4 set_mon_vals no callback set 2026-02-12T18:12:57.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.346+0000 7f5b8d647640 10 monclient: shutdown 2026-02-12T18:12:57.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.346+0000 7f5b8d647640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:57.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.346+0000 7f5b8d647640 1 -- 10.20.193.48:0/3158733340 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5b74004f90 msgr2=0x7f5b74045a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:57.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.346+0000 7f5b8d647640 1 --2- 10.20.193.48:0/3158733340 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5b74004f90 0x7f5b74045a00 secure :-1 s=READY pgs=49 gs=5 cs=0 l=1 c_cookie=14757641015483720534 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b70003130 tx=0x7f5b7002ef40 comp rx=0 tx=0).stop 2026-02-12T18:12:57.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.346+0000 7f5b8d647640 1 -- 10.20.193.48:0/3158733340 shutdown_connections 2026-02-12T18:12:57.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.346+0000 7f5b8d647640 1 --2- 10.20.193.48:0/3158733340 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f5b74004f90 0x7f5b74045a00 unknown :-1 s=CLOSED pgs=49 gs=5 cs=0 l=1 c_cookie=14757641015483720534 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:57.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.346+0000 7f5b8d647640 1 -- 10.20.193.48:0/3158733340 >> 10.20.193.48:0/3158733340 conn(0x7f5b880943b0 msgr2=0x7f5b880947b0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:57.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.346+0000 7f5b8d647640 1 -- 10.20.193.48:0/3158733340 shutdown_connections 2026-02-12T18:12:57.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.346+0000 7f5b8d647640 1 -- 10.20.193.48:0/3158733340 wait complete. 2026-02-12T18:12:57.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.346+0000 7f5b8d647640 10 monclient: build_initial_monmap 2026-02-12T18:12:57.369 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.346+0000 7f5b8d647640 10 monclient: monmap: 2026-02-12T18:12:57.369 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:12:57.369 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:12:57.369 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:12:57.369 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:12:57.369 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:12:57.369 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:57.369 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:12:57.369 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:12:57.369 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:12:57.370 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:12:57.370 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:12:57.370 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:12:57.370 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:12:57.370 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:12:57.370 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:12:57.370 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:57.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b8d647640 1 Processor -- start 2026-02-12T18:12:57.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b8d647640 1 -- start start 2026-02-12T18:12:57.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b8d647640 10 monclient: init 2026-02-12T18:12:57.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b8d647640 10 monclient: _reopen_session rank -1 2026-02-12T18:12:57.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b8d647640 10 monclient: _add_conns ranks=[4,1,6,0,8,5,3,2,7] 2026-02-12T18:12:57.370 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b8d647640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5b74004f90 0x7f5b88131690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:57.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b8d647640 10 monclient(hunting): picked mon.noname-c con 0x7f5b74004f90 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:12:57.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b8d647640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f5b88131bd0 0x7f5b88131fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:57.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b8d647640 10 monclient(hunting): picked mon.noname-f con 0x7f5b88131bd0 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:12:57.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b8d647640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5b8810de50 0x7f5b8810e2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:57.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b8d647640 10 monclient(hunting): picked mon.noname-d con 0x7f5b8810de50 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:12:57.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b8d647640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:57.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b8d647640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f5b88141fa0 con 0x7f5b88131bd0 2026-02-12T18:12:57.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b8d647640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:57.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b8d647640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f5b88142150 con 0x7f5b74004f90 2026-02-12T18:12:57.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b8d647640 10 monclient(hunting): start opening mon connection 2026-02-12T18:12:57.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b8d647640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f5b88111130 con 0x7f5b8810de50 2026-02-12T18:12:57.371 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b8d647640 10 monclient(hunting): _renew_subs 2026-02-12T18:12:57.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b8d647640 10 monclient(hunting): authenticate will time out at 1016.073456s 2026-02-12T18:12:57.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b877fe640 1 -- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5b8810de50 msgr2=0x7f5b8810e2c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.48:3303/0 2026-02-12T18:12:57.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b877fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5b8810de50 0x7f5b8810e2c0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:12:57.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b86ffd640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5b74004f90 0x7f5b88131690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:57.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b86ffd640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5b74004f90 0x7f5b88131690 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:58794/0 (socket says 10.20.193.48:58794) 2026-02-12T18:12:57.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b86ffd640 1 -- 10.20.193.48:0/1213889842 learned_addr learned my addr 10.20.193.48:0/1213889842 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:12:57.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b86ffd640 10 monclient(hunting): get_auth_request con 0x7f5b74004f90 auth_method 0 2026-02-12T18:12:57.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b86ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:57.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b86ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:57.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b86ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:57.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b86ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:12:57.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b86ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:12:57.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b86ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:12:57.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b867fc640 1 --2- 10.20.193.48:0/1213889842 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f5b88131bd0 0x7f5b88131fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:57.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b867fc640 10 monclient(hunting): get_auth_request con 0x7f5b88131bd0 auth_method 0 2026-02-12T18:12:57.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b867fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:12:57.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b867fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:12:57.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b867fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:12:57.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b86ffd640 10 monclient(hunting): handle_auth_done global_id 64507 payload 824 2026-02-12T18:12:57.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b86ffd640 1 -- 10.20.193.48:0/1213889842 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5b8810de50 msgr2=0x7f5b8810e2c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:12:57.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b86ffd640 1 --2- 10.20.193.48:0/1213889842 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5b8810de50 0x7f5b8810e2c0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:57.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b86ffd640 1 -- 10.20.193.48:0/1213889842 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f5b88131bd0 msgr2=0x7f5b88131fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:57.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b86ffd640 1 --2- 10.20.193.48:0/1213889842 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f5b88131bd0 0x7f5b88131fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:57.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b86ffd640 10 monclient: _finish_hunting 0 2026-02-12T18:12:57.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b86ffd640 1 monclient: found mon.noname-c 2026-02-12T18:12:57.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b86ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:12:57.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b86ffd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:12:57.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b86ffd640 1 -- 10.20.193.48:0/1213889842 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b881426a0 con 0x7f5b74004f90 2026-02-12T18:12:57.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.347+0000 7f5b867fc640 1 --2- 10.20.193.48:0/1213889842 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f5b88131bd0 0x7f5b88131fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:12:57.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b86ffd640 1 -- 10.20.193.48:0/1213889842 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5b74004f90 msgr2=0x7f5b88131690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:12:57.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b86ffd640 1 --2- 10.20.193.48:0/1213889842 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5b74004f90 0x7f5b88131690 secure :-1 s=READY pgs=124 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b7c0096e0 tx=0x7f5b7c0097e0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:57.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b677fe640 1 -- 10.20.193.48:0/1213889842 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5b7c012cd0 con 0x7f5b74004f90 2026-02-12T18:12:57.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b677fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:57.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b677fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:12:57.374 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b677fe640 10 monclient: dump: 2026-02-12T18:12:57.374 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:57.374 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:57.374 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:57.374 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:57.375 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:57.375 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:57.375 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:57.375 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:57.375 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:57.375 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:57.375 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:57.375 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:57.375 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:57.375 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:57.375 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:57.375 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:57.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b677fe640 10 monclient: _finish_auth 0 2026-02-12T18:12:57.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b677fe640 10 monclient: _check_auth_tickets 2026-02-12T18:12:57.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b677fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:12:57.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b677fe640 1 -- 10.20.193.48:0/1213889842 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b7c012e30 con 0x7f5b74004f90 2026-02-12T18:12:57.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b8d647640 5 monclient: authenticate success, global_id 64507 2026-02-12T18:12:57.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b8d647640 10 monclient: _renew_subs 2026-02-12T18:12:57.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b8d647640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:12:57.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b8d647640 1 -- 10.20.193.48:0/1213889842 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b881119d0 con 0x7f5b74004f90 2026-02-12T18:12:57.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b677fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:12:57.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b677fe640 1 -- 10.20.193.48:0/1213889842 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5b7c011810 con 0x7f5b74004f90 2026-02-12T18:12:57.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b677fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:12:57.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b677fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:12:57.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b857fa640 4 set_mon_vals no callback set 2026-02-12T18:12:57.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b677fe640 10 monclient: dump: 2026-02-12T18:12:57.376 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:12:57.376 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:12:57.377 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:57.377 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:12:57.377 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:12:57.377 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:12:57.377 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:12:57.377 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:12:57.377 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:12:57.377 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:12:57.377 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:12:57.377 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:12:57.377 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:12:57.377 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:12:57.377 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:12:57.377 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:12:57.377 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b8d647640 10 monclient: _renew_subs 2026-02-12T18:12:57.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b8d647640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:12:57.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b8d647640 1 -- 10.20.193.48:0/1213889842 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b881101d0 con 0x7f5b74004f90 2026-02-12T18:12:57.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b8d647640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:57.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b8d647640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:57.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b8d647640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:12:57.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b8d647640 1 -- 10.20.193.48:0/1213889842 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b88056260 con 0x7f5b74004f90 2026-02-12T18:12:57.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.350+0000 7f5b677fe640 1 -- 10.20.193.48:0/1213889842 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f5b7c011070 con 0x7f5b74004f90 2026-02-12T18:12:57.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.351+0000 7f5b677fe640 1 --2- 10.20.193.48:0/1213889842 >> v2:10.20.193.111:6812/977811348 conn(0x7f5b5403f7c0 0x7f5b5405fc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:12:57.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.351+0000 7f5b677fe640 1 -- 10.20.193.48:0/1213889842 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(222..222 src has 190..222) ==== 3897+0+0 (secure 0 0 0) 0x7f5b7c052c50 con 0x7f5b74004f90 2026-02-12T18:12:57.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.351+0000 7f5b867fc640 1 --2- 10.20.193.48:0/1213889842 >> v2:10.20.193.111:6812/977811348 conn(0x7f5b5403f7c0 0x7f5b5405fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:12:57.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.351+0000 7f5b867fc640 10 monclient: get_auth_request con 0x7f5b5403f7c0 auth_method 0 2026-02-12T18:12:57.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.353+0000 7f5b677fe640 1 -- 10.20.193.48:0/1213889842 <== mon.4 v2:10.20.193.48:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f5b88056260 con 0x7f5b74004f90 2026-02-12T18:12:57.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.353+0000 7f5b677fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:12:57.378 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.353+0000 7f5b677fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:12:57.379 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.354+0000 7f5b867fc640 1 --2- 10.20.193.48:0/1213889842 >> v2:10.20.193.111:6812/977811348 conn(0x7f5b5403f7c0 0x7f5b5405fc70 secure :-1 s=READY pgs=348 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b70002670 tx=0x7f5b70007000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:12:57.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.497+0000 7f5b8d647640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T18:12:57.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.497+0000 7f5b8d647640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T18:12:57.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.497+0000 7f5b8d647640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:12:57.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.497+0000 7f5b8d647640 1 -- 10.20.193.48:0/1213889842 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5b88056260 con 0x7f5b74004f90 2026-02-12T18:12:57.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.498+0000 7f5b677fe640 1 -- 10.20.193.48:0/1213889842 <== mon.4 v2:10.20.193.48:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3660 (secure 0 0 0) 0x7f5b88056260 con 0x7f5b74004f90 2026-02-12T18:12:57.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.498+0000 7f5b677fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T18:12:57.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.498+0000 7f5b677fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:12:57.500 INFO:teuthology.orchestra.run.trial048.stdout:{"election_epoch":68,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","modified":"2026-02-12T18:05:32.850777Z","created":"2026-02-12T18:05:32.850777Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3300","nonce":0},{"type":"v1","addr":"10.20.193.48:6789","nonce":0}]},"addr":"10.20.193.48:6789/0","public_addr":"10.20.193.48:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850827+0000","crush_location":[]},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3300","nonce":0},{"type":"v1","addr":"10.20.193.111:6789","nonce":0}]},"addr":"10.20.193.111:6789/0","public_addr":"10.20.193.111:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850829+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3301","nonce":0},{"type":"v1","addr":"10.20.193.48:6790","nonce":0}]},"addr":"10.20.193.48:6790/0","public_addr":"10.20.193.48:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850830+0000","crush_location":[]},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3301","nonce":0},{"type":"v1","addr":"10.20.193.111:6790","nonce":0}]},"addr":"10.20.193.111:6790/0","public_addr":"10.20.193.111:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850833+0000","crush_location":[]},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3302","nonce":0},{"type":"v1","addr":"10.20.193.48:6791","nonce":0}]},"addr":"10.20.193.48:6791/0","public_addr":"10.20.193.48:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3302","nonce":0},{"type":"v1","addr":"10.20.193.111:6791","nonce":0}]},"addr":"10.20.193.111:6791/0","public_addr":"10.20.193.111:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850834+0000","crush_location":[]},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3303","nonce":0},{"type":"v1","addr":"10.20.193.48:6792","nonce":0}]},"addr":"10.20.193.48:6792/0","public_addr":"10.20.193.48:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3303","nonce":0},{"type":"v1","addr":"10.20.193.111:6792","nonce":0}]},"addr":"10.20.193.111:6792/0","public_addr":"10.20.193.111:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850835+0000","crush_location":[]},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3304","nonce":0},{"type":"v1","addr":"10.20.193.48:6793","nonce":0}]},"addr":"10.20.193.48:6793/0","public_addr":"10.20.193.48:6793/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850832+0000","crush_location":[]}]}} 2026-02-12T18:12:57.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.499+0000 7f5b8d647640 1 -- 10.20.193.48:0/1213889842 >> v2:10.20.193.111:6812/977811348 conn(0x7f5b5403f7c0 msgr2=0x7f5b5405fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:57.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.499+0000 7f5b8d647640 1 --2- 10.20.193.48:0/1213889842 >> v2:10.20.193.111:6812/977811348 conn(0x7f5b5403f7c0 0x7f5b5405fc70 secure :-1 s=READY pgs=348 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b70002670 tx=0x7f5b70007000 comp rx=0 tx=0).stop 2026-02-12T18:12:57.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.499+0000 7f5b8d647640 10 monclient: shutdown 2026-02-12T18:12:57.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.499+0000 7f5b8d647640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:12:57.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.499+0000 7f5b8d647640 1 -- 10.20.193.48:0/1213889842 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5b74004f90 msgr2=0x7f5b88131690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:12:57.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.499+0000 7f5b8d647640 1 --2- 10.20.193.48:0/1213889842 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5b74004f90 0x7f5b88131690 secure :-1 s=READY pgs=124 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5b7c0096e0 tx=0x7f5b7c0097e0 comp rx=0 tx=0).stop 2026-02-12T18:12:57.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.499+0000 7f5b8d647640 1 -- 10.20.193.48:0/1213889842 shutdown_connections 2026-02-12T18:12:57.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.499+0000 7f5b8d647640 1 --2- 10.20.193.48:0/1213889842 >> v2:10.20.193.111:6812/977811348 conn(0x7f5b5403f7c0 0x7f5b5405fc70 unknown :-1 s=CLOSED pgs=348 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:57.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.499+0000 7f5b8d647640 1 --2- 10.20.193.48:0/1213889842 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5b8810de50 0x7f5b8810e2c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:57.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.499+0000 7f5b8d647640 1 --2- 10.20.193.48:0/1213889842 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f5b88131bd0 0x7f5b88131fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:57.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.499+0000 7f5b8d647640 1 --2- 10.20.193.48:0/1213889842 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f5b74004f90 0x7f5b88131690 unknown :-1 s=CLOSED pgs=124 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:12:57.503 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.499+0000 7f5b8d647640 1 -- 10.20.193.48:0/1213889842 >> 10.20.193.48:0/1213889842 conn(0x7f5b880943b0 msgr2=0x7f5b88124d40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:12:57.503 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.499+0000 7f5b8d647640 1 -- 10.20.193.48:0/1213889842 shutdown_connections 2026-02-12T18:12:57.503 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:12:57.499+0000 7f5b8d647640 1 -- 10.20.193.48:0/1213889842 wait complete. 2026-02-12T18:13:00.510 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T18:13:00.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.575+0000 7f66d121b640 10 monclient: get_monmap_and_config 2026-02-12T18:13:00.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.575+0000 7f66d121b640 10 monclient: build_initial_monmap 2026-02-12T18:13:00.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.575+0000 7f66d121b640 10 monclient: monmap: 2026-02-12T18:13:00.580 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:13:00.580 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:00.580 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:13:00.576699+0000 2026-02-12T18:13:00.580 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:13:00.576699+0000 2026-02-12T18:13:00.580 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:13:00.580 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:00.580 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:13:00.580 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:13:00.580 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:13:00.581 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:13:00.581 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:13:00.581 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:13:00.581 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:13:00.581 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:13:00.581 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:13:00.581 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:13:00.581 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:13:00.581 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:00.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66d121b640 1 Processor -- start 2026-02-12T18:13:00.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66d121b640 1 -- start start 2026-02-12T18:13:00.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66d121b640 10 monclient: init 2026-02-12T18:13:00.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66d121b640 10 monclient: _reopen_session rank -1 2026-02-12T18:13:00.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66d121b640 10 monclient: _add_conns ranks=[10,2,9,4,0,5,6,3,7,8,1] 2026-02-12T18:13:00.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66d121b640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f66cc054330 0x7f66cc0901d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:00.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66d121b640 10 monclient(hunting): picked mon.noname-f con 0x7f66cc054330 addr v2:10.20.193.111:3300/0 2026-02-12T18:13:00.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66d121b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f66cc141120 0x7f66cc08a0d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:00.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66d121b640 10 monclient(hunting): picked mon.noname-b con 0x7f66cc141120 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:13:00.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66d121b640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f66cc08a610 0x7f66cc08aab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:00.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66d121b640 10 monclient(hunting): picked mon.noname-a con 0x7f66cc08a610 addr v2:10.20.193.48:3300/0 2026-02-12T18:13:00.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66d121b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:00.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66d121b640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f66cc054bd0 con 0x7f66cc08a610 2026-02-12T18:13:00.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66d121b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:00.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66d121b640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f66cc054f90 con 0x7f66cc054330 2026-02-12T18:13:00.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66d121b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:00.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66d121b640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f66cc054700 con 0x7f66cc141120 2026-02-12T18:13:00.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66d121b640 10 monclient(hunting): _renew_subs 2026-02-12T18:13:00.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66d121b640 10 monclient(hunting): authenticate will time out at 1019.302401s 2026-02-12T18:13:00.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66ca575640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f66cc141120 0x7f66cc08a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:00.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66cb577640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f66cc08a610 0x7f66cc08aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:00.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66ca575640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f66cc141120 0x7f66cc08a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:47528/0 (socket says 10.20.193.48:47528) 2026-02-12T18:13:00.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66ca575640 1 -- 10.20.193.48:0/2488881466 learned_addr learned my addr 10.20.193.48:0/2488881466 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:13:00.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66ca575640 10 monclient(hunting): get_auth_request con 0x7f66cc141120 auth_method 0 2026-02-12T18:13:00.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66ca575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:00.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66ca575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:00.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66ca575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:00.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66cb577640 10 monclient(hunting): get_auth_request con 0x7f66cc08a610 auth_method 0 2026-02-12T18:13:00.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66cb577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:00.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66cb577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:00.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66cb577640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:00.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66cad76640 1 --2- 10.20.193.48:0/2488881466 >> v2:10.20.193.111:3300/0 conn(0x7f66cc054330 0x7f66cc0901d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:00.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66ca575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:00.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66ca575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:00.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66ca575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:00.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66cad76640 10 monclient(hunting): get_auth_request con 0x7f66cc054330 auth_method 0 2026-02-12T18:13:00.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66cad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:00.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66cad76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:00.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66cad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:00.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66cb577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:00.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66cb577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:00.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66cb577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:00.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66ca575640 10 monclient(hunting): handle_auth_done global_id 35939 payload 274 2026-02-12T18:13:00.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66ca575640 1 -- 10.20.193.48:0/2488881466 >> v2:10.20.193.111:3300/0 conn(0x7f66cc054330 msgr2=0x7f66cc0901d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:13:00.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66ca575640 1 --2- 10.20.193.48:0/2488881466 >> v2:10.20.193.111:3300/0 conn(0x7f66cc054330 0x7f66cc0901d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:00.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66ca575640 1 -- 10.20.193.48:0/2488881466 >> v2:10.20.193.48:3300/0 conn(0x7f66cc08a610 msgr2=0x7f66cc08aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:13:00.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66ca575640 1 --2- 10.20.193.48:0/2488881466 >> v2:10.20.193.48:3300/0 conn(0x7f66cc08a610 0x7f66cc08aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:00.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66ca575640 10 monclient: _finish_hunting 0 2026-02-12T18:13:00.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66ca575640 1 monclient: found mon.noname-b 2026-02-12T18:13:00.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66ca575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:13:00.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66ca575640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:13:00.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66ca575640 1 -- 10.20.193.48:0/2488881466 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66cc060390 con 0x7f66cc141120 2026-02-12T18:13:00.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.576+0000 7f66cad76640 1 --2- 10.20.193.48:0/2488881466 >> v2:10.20.193.111:3300/0 conn(0x7f66cc054330 0x7f66cc0901d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:13:00.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66ca575640 1 -- 10.20.193.48:0/2488881466 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f66cc141120 msgr2=0x7f66cc08a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:00.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66ca575640 1 --2- 10.20.193.48:0/2488881466 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f66cc141120 0x7f66cc08a0d0 secure :-1 s=READY pgs=334 gs=1 cs=0 l=1 c_cookie=814200085517117538 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66b4009060 tx=0x7f66b402eda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4c9ea9f9572862 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:00.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66c9d74640 1 -- 10.20.193.48:0/2488881466 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f66b4035340 con 0x7f66cc141120 2026-02-12T18:13:00.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66c9d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:00.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66c9d74640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:13:00.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66c9d74640 10 monclient: dump: 2026-02-12T18:13:00.590 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:00.590 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:00.590 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:00.590 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:00.590 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:00.590 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:00.590 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:00.590 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:00.590 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:00.590 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:00.591 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:00.591 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:00.591 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:00.591 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:00.591 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:00.591 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:00.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66c9d74640 10 monclient: _finish_auth 0 2026-02-12T18:13:00.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66c9d74640 10 monclient: _check_auth_tickets 2026-02-12T18:13:00.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66c9d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:13:00.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66c9d74640 1 -- 10.20.193.48:0/2488881466 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66b40354c0 con 0x7f66cc141120 2026-02-12T18:13:00.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66d121b640 5 monclient: authenticate success, global_id 35939 2026-02-12T18:13:00.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66d121b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:13:00.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66c9d74640 10 monclient: handle_config config(0 keys) 2026-02-12T18:13:00.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66c9d74640 1 -- 10.20.193.48:0/2488881466 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f66b4035af0 con 0x7f66cc141120 2026-02-12T18:13:00.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66d121b640 10 monclient: get_monmap_and_config success 2026-02-12T18:13:00.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66d121b640 4 set_mon_vals no callback set 2026-02-12T18:13:00.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66c9d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:00.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66c9d74640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:13:00.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66c9d74640 10 monclient: dump: 2026-02-12T18:13:00.592 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:00.592 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:00.592 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:00.592 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:00.592 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:00.592 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:00.593 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:00.593 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:00.593 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:00.593 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:00.593 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:00.593 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:00.593 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:00.593 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:00.593 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:00.593 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:00.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66d121b640 10 monclient: shutdown 2026-02-12T18:13:00.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66d121b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:13:00.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66d121b640 1 -- 10.20.193.48:0/2488881466 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f66cc141120 msgr2=0x7f66cc08a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:00.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66d121b640 1 --2- 10.20.193.48:0/2488881466 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f66cc141120 0x7f66cc08a0d0 secure :-1 s=READY pgs=334 gs=1 cs=0 l=1 c_cookie=814200085517117538 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66b4009060 tx=0x7f66b402eda0 comp rx=0 tx=0).stop 2026-02-12T18:13:00.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66d121b640 1 -- 10.20.193.48:0/2488881466 shutdown_connections 2026-02-12T18:13:00.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66d121b640 1 --2- 10.20.193.48:0/2488881466 >> v2:10.20.193.48:3300/0 conn(0x7f66cc08a610 0x7f66cc08aab0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:00.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66d121b640 1 --2- 10.20.193.48:0/2488881466 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f66cc141120 0x7f66cc08a0d0 unknown :-1 s=CLOSED pgs=334 gs=1 cs=0 l=1 c_cookie=814200085517117538 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:00.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66d121b640 1 --2- 10.20.193.48:0/2488881466 >> v2:10.20.193.111:3300/0 conn(0x7f66cc054330 0x7f66cc0901d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:00.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66d121b640 1 -- 10.20.193.48:0/2488881466 >> 10.20.193.48:0/2488881466 conn(0x7f66cc0943c0 msgr2=0x7f66cc0947c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:13:00.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66d121b640 1 -- 10.20.193.48:0/2488881466 shutdown_connections 2026-02-12T18:13:00.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.579+0000 7f66d121b640 1 -- 10.20.193.48:0/2488881466 wait complete. 2026-02-12T18:13:00.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66d121b640 10 monclient: build_initial_monmap 2026-02-12T18:13:00.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66d121b640 10 monclient: monmap: 2026-02-12T18:13:00.594 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:13:00.594 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:13:00.595 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:13:00.595 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:13:00.595 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:13:00.595 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:00.595 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:13:00.595 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:13:00.595 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:13:00.595 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:13:00.595 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:13:00.595 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:13:00.595 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:13:00.595 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:13:00.595 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:13:00.596 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:00.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66d121b640 1 Processor -- start 2026-02-12T18:13:00.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66d121b640 1 -- start start 2026-02-12T18:13:00.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66d121b640 10 monclient: init 2026-02-12T18:13:00.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66d121b640 10 monclient: _reopen_session rank -1 2026-02-12T18:13:00.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66d121b640 10 monclient: _add_conns ranks=[5,3,6,2,0,8,1,4,7] 2026-02-12T18:13:00.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66d121b640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f66cc054330 0x7f66cc129580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:00.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66d121b640 10 monclient(hunting): picked mon.noname-h con 0x7f66cc054330 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:13:00.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66d121b640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f66cc08a610 0x7f66cc129ac0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:00.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66d121b640 10 monclient(hunting): picked mon.noname-g con 0x7f66cc08a610 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:13:00.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66d121b640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f66cc141120 0x7f66cc12a000 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:00.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66d121b640 10 monclient(hunting): picked mon.noname-d con 0x7f66cc141120 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:13:00.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66d121b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:00.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66d121b640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f66cc12af40 con 0x7f66cc08a610 2026-02-12T18:13:00.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66d121b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:00.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66d121b640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f66cc12d2a0 con 0x7f66cc054330 2026-02-12T18:13:00.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66d121b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:00.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66d121b640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f66cc08d930 con 0x7f66cc141120 2026-02-12T18:13:00.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66d121b640 10 monclient(hunting): _renew_subs 2026-02-12T18:13:00.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66d121b640 10 monclient(hunting): authenticate will time out at 1019.306615s 2026-02-12T18:13:00.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66cb577640 1 -- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f66cc141120 msgr2=0x7f66cc12a000 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.48:3303/0 2026-02-12T18:13:00.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66cb577640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f66cc141120 0x7f66cc12a000 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:13:00.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66cad76640 1 -- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f66cc054330 msgr2=0x7f66cc129580 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:13:00.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66cad76640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f66cc054330 0x7f66cc129580 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:13:00.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66ca575640 1 -- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f66cc08a610 msgr2=0x7f66cc129ac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3301/0 2026-02-12T18:13:00.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.580+0000 7f66ca575640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f66cc08a610 0x7f66cc129ac0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:13:00.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.781+0000 7f66cb577640 1 -- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f66cc141120 msgr2=0x7f66cc12a000 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.48:3303/0 2026-02-12T18:13:00.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.781+0000 7f66cb577640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f66cc141120 0x7f66cc12a000 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:13:00.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.781+0000 7f66cad76640 1 -- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f66cc054330 msgr2=0x7f66cc129580 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:13:00.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.781+0000 7f66cad76640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f66cc054330 0x7f66cc129580 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:13:00.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.782+0000 7f66ca575640 1 -- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f66cc08a610 msgr2=0x7f66cc129ac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3301/0 2026-02-12T18:13:00.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:00.782+0000 7f66ca575640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f66cc08a610 0x7f66cc129ac0 unknown :-1 s=START_CONNECT pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:13:01.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:01.183+0000 7f66cb577640 1 -- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f66cc141120 msgr2=0x7f66cc12a000 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.48:3303/0 2026-02-12T18:13:01.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:01.183+0000 7f66cb577640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f66cc141120 0x7f66cc12a000 unknown :-1 s=START_CONNECT pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:13:01.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:01.183+0000 7f66cad76640 1 -- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f66cc054330 msgr2=0x7f66cc129580 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:13:01.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:01.183+0000 7f66cad76640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f66cc054330 0x7f66cc129580 unknown :-1 s=START_CONNECT pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:13:01.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:01.183+0000 7f66ca575640 1 -- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f66cc08a610 msgr2=0x7f66cc129ac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3301/0 2026-02-12T18:13:01.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:01.183+0000 7f66ca575640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f66cc08a610 0x7f66cc129ac0 unknown :-1 s=START_CONNECT pgs=0 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:13:01.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:01.984+0000 7f66cb577640 1 -- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f66cc141120 msgr2=0x7f66cc12a000 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.48:3303/0 2026-02-12T18:13:01.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:01.984+0000 7f66cb577640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f66cc141120 0x7f66cc12a000 unknown :-1 s=START_CONNECT pgs=0 gs=10 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:13:01.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:01.984+0000 7f66cad76640 1 -- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f66cc054330 msgr2=0x7f66cc129580 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:13:01.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:01.984+0000 7f66cad76640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f66cc054330 0x7f66cc129580 unknown :-1 s=START_CONNECT pgs=0 gs=11 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:13:01.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:01.984+0000 7f66ca575640 1 -- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f66cc08a610 msgr2=0x7f66cc129ac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3301/0 2026-02-12T18:13:01.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:01.984+0000 7f66ca575640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f66cc08a610 0x7f66cc129ac0 unknown :-1 s=START_CONNECT pgs=0 gs=12 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:13:03.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66aa7fc640 10 monclient(hunting): tick 2026-02-12T18:13:03.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66aa7fc640 10 monclient(hunting): _check_auth_tickets 2026-02-12T18:13:03.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66aa7fc640 1 monclient(hunting): continuing hunt 2026-02-12T18:13:03.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66aa7fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T18:13:03.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66aa7fc640 1 -- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f66cc141120 msgr2=0x7f66cc12a000 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:13:03.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66aa7fc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f66cc141120 0x7f66cc12a000 unknown :-1 s=START_CONNECT pgs=0 gs=10 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:03.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66aa7fc640 1 -- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f66cc054330 msgr2=0x7f66cc129580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:13:03.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66aa7fc640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f66cc054330 0x7f66cc129580 unknown :-1 s=START_CONNECT pgs=0 gs=11 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:03.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66aa7fc640 1 -- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f66cc08a610 msgr2=0x7f66cc129ac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:13:03.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66aa7fc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f66cc08a610 0x7f66cc129ac0 unknown :-1 s=START_CONNECT pgs=0 gs=12 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:03.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66aa7fc640 10 monclient: _add_conns ranks=[4,7,0,1,8,2] 2026-02-12T18:13:03.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66aa7fc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6690003890 0x7f6690023cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:03.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66aa7fc640 10 monclient(hunting): picked mon.noname-c con 0x7f6690003890 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:13:03.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66aa7fc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f66900242b0 0x7f6690044730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:03.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66aa7fc640 10 monclient(hunting): picked mon.noname-i con 0x7f66900242b0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:13:03.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66aa7fc640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6690044dd0 0x7f6690065280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:03.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66aa7fc640 10 monclient(hunting): picked mon.noname-a con 0x7f6690044dd0 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:13:03.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66aa7fc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:03.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66aa7fc640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f66cc12af40 con 0x7f6690044dd0 2026-02-12T18:13:03.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66aa7fc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:03.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66aa7fc640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f66cc12d2a0 con 0x7f6690003890 2026-02-12T18:13:03.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66aa7fc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:03.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66aa7fc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f66cc08d930 con 0x7f66900242b0 2026-02-12T18:13:03.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66aa7fc640 10 monclient(hunting): _renew_subs 2026-02-12T18:13:03.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cad76640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6690003890 0x7f6690023cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=13 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:03.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cb577640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6690044dd0 0x7f6690065280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=14 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:03.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cad76640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6690003890 0x7f6690023cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=13 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:58798/0 (socket says 10.20.193.48:58798) 2026-02-12T18:13:03.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cad76640 1 -- 10.20.193.48:0/1573975346 learned_addr learned my addr 10.20.193.48:0/1573975346 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:13:03.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cad76640 10 monclient(hunting): get_auth_request con 0x7f6690003890 auth_method 0 2026-02-12T18:13:03.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:03.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cad76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:03.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:03.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cb577640 10 monclient(hunting): get_auth_request con 0x7f6690044dd0 auth_method 0 2026-02-12T18:13:03.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cb577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:03.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cb577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:03.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cb577640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:03.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:03.587 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:03.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:03.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cb577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:03.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cb577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:03.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cb577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:03.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66ca575640 1 --2- 10.20.193.48:0/1573975346 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f66900242b0 0x7f6690044730 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=15 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:03.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66ca575640 10 monclient(hunting): get_auth_request con 0x7f66900242b0 auth_method 0 2026-02-12T18:13:03.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66ca575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:03.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66ca575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:03.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66ca575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:03.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66ca575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:03.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66ca575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:03.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66ca575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:03.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cb577640 10 monclient(hunting): handle_auth_done global_id 6273 payload 824 2026-02-12T18:13:03.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cb577640 1 -- 10.20.193.48:0/1573975346 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f66900242b0 msgr2=0x7f6690044730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:03.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cb577640 1 --2- 10.20.193.48:0/1573975346 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f66900242b0 0x7f6690044730 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=15 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:03.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cb577640 1 -- 10.20.193.48:0/1573975346 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6690003890 msgr2=0x7f6690023cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:03.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cb577640 1 --2- 10.20.193.48:0/1573975346 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6690003890 0x7f6690023cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=13 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:03.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cb577640 10 monclient: _finish_hunting 0 2026-02-12T18:13:03.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cb577640 1 monclient: found mon.noname-a 2026-02-12T18:13:03.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cb577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:13:03.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cb577640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:13:03.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cb577640 1 -- 10.20.193.48:0/1573975346 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66b40094f0 con 0x7f6690044dd0 2026-02-12T18:13:03.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.581+0000 7f66cb577640 1 -- 10.20.193.48:0/1573975346 reap_dead start 2026-02-12T18:13:03.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.583+0000 7f66cb577640 1 -- 10.20.193.48:0/1573975346 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6690044dd0 msgr2=0x7f6690065280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:03.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.583+0000 7f66cb577640 1 --2- 10.20.193.48:0/1573975346 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6690044dd0 0x7f6690065280 secure :-1 s=READY pgs=504 gs=14 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66bc00fbb0 tx=0x7f66bc00d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:03.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.583+0000 7f66ab7fe640 1 -- 10.20.193.48:0/1573975346 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f66bc00de50 con 0x7f6690044dd0 2026-02-12T18:13:03.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.583+0000 7f66ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:03.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.583+0000 7f66ab7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:13:03.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.583+0000 7f66ab7fe640 10 monclient: dump: 2026-02-12T18:13:03.593 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:03.593 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:03.593 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:03.593 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:03.593 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:03.593 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:03.593 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:03.593 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:03.593 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:03.594 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:03.594 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:03.594 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:03.594 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:03.594 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:03.594 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:03.594 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:03.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.583+0000 7f66ab7fe640 10 monclient: _finish_auth 0 2026-02-12T18:13:03.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.583+0000 7f66ab7fe640 10 monclient: _check_auth_tickets 2026-02-12T18:13:03.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.583+0000 7f66ab7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:13:03.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.583+0000 7f66ab7fe640 1 -- 10.20.193.48:0/1573975346 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66bc014930 con 0x7f6690044dd0 2026-02-12T18:13:03.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.583+0000 7f66ab7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:13:03.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.583+0000 7f66ab7fe640 1 -- 10.20.193.48:0/1573975346 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f66bc0133d0 con 0x7f6690044dd0 2026-02-12T18:13:03.595 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.583+0000 7f66d121b640 5 monclient: authenticate success, global_id 6273 2026-02-12T18:13:03.595 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.583+0000 7f66d121b640 10 monclient: _renew_subs 2026-02-12T18:13:03.595 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.583+0000 7f66c9573640 4 set_mon_vals no callback set 2026-02-12T18:13:03.595 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.583+0000 7f66d121b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:13:03.595 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.583+0000 7f66d121b640 1 -- 10.20.193.48:0/1573975346 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66cc13f2a0 con 0x7f6690044dd0 2026-02-12T18:13:03.595 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.583+0000 7f66ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:03.595 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.583+0000 7f66ab7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:13:03.595 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.583+0000 7f66ab7fe640 10 monclient: dump: 2026-02-12T18:13:03.595 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:03.595 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:03.595 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:03.596 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:03.596 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:03.596 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:03.596 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:03.596 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:03.596 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:03.596 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:03.596 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:03.596 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:03.596 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:03.596 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:03.596 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:03.596 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:03.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.583+0000 7f66d121b640 10 monclient: _renew_subs 2026-02-12T18:13:03.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.583+0000 7f66d121b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:13:03.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.583+0000 7f66d121b640 1 -- 10.20.193.48:0/1573975346 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66cc12cfc0 con 0x7f6690044dd0 2026-02-12T18:13:03.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.584+0000 7f66d121b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:13:03.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.584+0000 7f66d121b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:13:03.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.584+0000 7f66d121b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:13:03.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.584+0000 7f66ab7fe640 1 -- 10.20.193.48:0/1573975346 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f66bc023020 con 0x7f6690044dd0 2026-02-12T18:13:03.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.584+0000 7f66d121b640 1 -- 10.20.193.48:0/1573975346 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66cc12ca00 con 0x7f6690044dd0 2026-02-12T18:13:03.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.584+0000 7f66ab7fe640 1 --2- 10.20.193.48:0/1573975346 >> v2:10.20.193.111:6812/977811348 conn(0x7f669803f780 0x7f669805fc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:03.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.584+0000 7f66ab7fe640 1 -- 10.20.193.48:0/1573975346 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(222..222 src has 190..222) ==== 3897+0+0 (secure 0 0 0) 0x7f66bc053a00 con 0x7f6690044dd0 2026-02-12T18:13:03.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.584+0000 7f66cad76640 1 --2- 10.20.193.48:0/1573975346 >> v2:10.20.193.111:6812/977811348 conn(0x7f669803f780 0x7f669805fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=16 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:03.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.584+0000 7f66cad76640 10 monclient: get_auth_request con 0x7f669803f780 auth_method 0 2026-02-12T18:13:03.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.586+0000 7f66ab7fe640 1 -- 10.20.193.48:0/1573975346 <== mon.0 v2:10.20.193.48:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f66bc013720 con 0x7f6690044dd0 2026-02-12T18:13:03.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.586+0000 7f66ab7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:13:03.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.586+0000 7f66ab7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:13:03.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.587+0000 7f66cad76640 1 --2- 10.20.193.48:0/1573975346 >> v2:10.20.193.111:6812/977811348 conn(0x7f669803f780 0x7f669805fc30 secure :-1 s=READY pgs=349 gs=16 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66c0006df0 tx=0x7f66c0008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:03.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.734+0000 7f66d121b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T18:13:03.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.734+0000 7f66d121b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T18:13:03.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.734+0000 7f66d121b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:13:03.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.734+0000 7f66d121b640 1 -- 10.20.193.48:0/1573975346 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f66cc05e350 con 0x7f6690044dd0 2026-02-12T18:13:03.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.734+0000 7f66ab7fe640 1 -- 10.20.193.48:0/1573975346 <== mon.0 v2:10.20.193.48:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3661 (secure 0 0 0) 0x7f66bc01b360 con 0x7f6690044dd0 2026-02-12T18:13:03.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.734+0000 7f66ab7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T18:13:03.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.734+0000 7f66ab7fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:13:03.737 INFO:teuthology.orchestra.run.trial048.stdout:{"election_epoch":68,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":14,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","modified":"2026-02-12T18:05:32.850777Z","created":"2026-02-12T18:05:32.850777Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3300","nonce":0},{"type":"v1","addr":"10.20.193.48:6789","nonce":0}]},"addr":"10.20.193.48:6789/0","public_addr":"10.20.193.48:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850827+0000","crush_location":[]},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3300","nonce":0},{"type":"v1","addr":"10.20.193.111:6789","nonce":0}]},"addr":"10.20.193.111:6789/0","public_addr":"10.20.193.111:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850829+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3301","nonce":0},{"type":"v1","addr":"10.20.193.48:6790","nonce":0}]},"addr":"10.20.193.48:6790/0","public_addr":"10.20.193.48:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850830+0000","crush_location":[]},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3301","nonce":0},{"type":"v1","addr":"10.20.193.111:6790","nonce":0}]},"addr":"10.20.193.111:6790/0","public_addr":"10.20.193.111:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850833+0000","crush_location":[]},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3302","nonce":0},{"type":"v1","addr":"10.20.193.48:6791","nonce":0}]},"addr":"10.20.193.48:6791/0","public_addr":"10.20.193.48:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3302","nonce":0},{"type":"v1","addr":"10.20.193.111:6791","nonce":0}]},"addr":"10.20.193.111:6791/0","public_addr":"10.20.193.111:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850834+0000","crush_location":[]},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3303","nonce":0},{"type":"v1","addr":"10.20.193.48:6792","nonce":0}]},"addr":"10.20.193.48:6792/0","public_addr":"10.20.193.48:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3303","nonce":0},{"type":"v1","addr":"10.20.193.111:6792","nonce":0}]},"addr":"10.20.193.111:6792/0","public_addr":"10.20.193.111:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850835+0000","crush_location":[]},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3304","nonce":0},{"type":"v1","addr":"10.20.193.48:6793","nonce":0}]},"addr":"10.20.193.48:6793/0","public_addr":"10.20.193.48:6793/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850832+0000","crush_location":[]}]}} 2026-02-12T18:13:03.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.736+0000 7f66d121b640 1 -- 10.20.193.48:0/1573975346 >> v2:10.20.193.111:6812/977811348 conn(0x7f669803f780 msgr2=0x7f669805fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:03.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.736+0000 7f66d121b640 1 --2- 10.20.193.48:0/1573975346 >> v2:10.20.193.111:6812/977811348 conn(0x7f669803f780 0x7f669805fc30 secure :-1 s=READY pgs=349 gs=16 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66c0006df0 tx=0x7f66c0008040 comp rx=0 tx=0).stop 2026-02-12T18:13:03.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.736+0000 7f66d121b640 10 monclient: shutdown 2026-02-12T18:13:03.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.736+0000 7f66d121b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:13:03.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.736+0000 7f66d121b640 1 -- 10.20.193.48:0/1573975346 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6690044dd0 msgr2=0x7f6690065280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:03.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.736+0000 7f66d121b640 1 --2- 10.20.193.48:0/1573975346 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6690044dd0 0x7f6690065280 secure :-1 s=READY pgs=504 gs=14 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f66bc00fbb0 tx=0x7f66bc00d520 comp rx=0 tx=0).stop 2026-02-12T18:13:03.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.736+0000 7f66d121b640 1 -- 10.20.193.48:0/1573975346 shutdown_connections 2026-02-12T18:13:03.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.736+0000 7f66d121b640 1 --2- 10.20.193.48:0/1573975346 >> v2:10.20.193.111:6812/977811348 conn(0x7f669803f780 0x7f669805fc30 unknown :-1 s=CLOSED pgs=349 gs=16 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:03.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.736+0000 7f66d121b640 1 --2- 10.20.193.48:0/1573975346 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f6690044dd0 0x7f6690065280 unknown :-1 s=CLOSED pgs=504 gs=14 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:03.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.736+0000 7f66d121b640 1 -- 10.20.193.48:0/1573975346 >> 10.20.193.48:0/1573975346 conn(0x7f66cc0943c0 msgr2=0x7f66cc126d40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:13:03.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.736+0000 7f66d121b640 1 -- 10.20.193.48:0/1573975346 shutdown_connections 2026-02-12T18:13:03.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:03.736+0000 7f66d121b640 1 -- 10.20.193.48:0/1573975346 wait complete. 2026-02-12T18:13:06.747 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T18:13:06.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.813+0000 7f84cb70c640 10 monclient: get_monmap_and_config 2026-02-12T18:13:06.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.813+0000 7f84cb70c640 10 monclient: build_initial_monmap 2026-02-12T18:13:06.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.813+0000 7f84cb70c640 10 monclient: monmap: 2026-02-12T18:13:06.815 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:13:06.815 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:06.815 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:13:06.814516+0000 2026-02-12T18:13:06.815 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:13:06.814516+0000 2026-02-12T18:13:06.815 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:13:06.815 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:06.816 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:13:06.816 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:13:06.816 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:13:06.816 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:13:06.816 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:13:06.816 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:13:06.816 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:13:06.816 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:13:06.816 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:13:06.816 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:13:06.816 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:13:06.816 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:06.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.813+0000 7f84cb70c640 1 Processor -- start 2026-02-12T18:13:06.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.813+0000 7f84cb70c640 1 -- start start 2026-02-12T18:13:06.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.813+0000 7f84cb70c640 10 monclient: init 2026-02-12T18:13:06.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84cb70c640 10 monclient: _reopen_session rank -1 2026-02-12T18:13:06.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84cb70c640 10 monclient: _add_conns ranks=[2,8,7,0,6,5,3,10,9,4,1] 2026-02-12T18:13:06.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84cb70c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f84c405dc20 0x7f84c4144660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:06.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84cb70c640 10 monclient(hunting): picked mon.noname-b con 0x7f84c405dc20 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:13:06.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84cb70c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c405dff0 0x7f84c405e3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:06.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84cb70c640 10 monclient(hunting): picked mon.noname-e con 0x7f84c405dff0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:13:06.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84cb70c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f84c4089df0 0x7f84c408a240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:06.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84cb70c640 10 monclient(hunting): picked mon.noname-i con 0x7f84c4089df0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:13:06.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84cb70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:06.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84cb70c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f84c4093a30 con 0x7f84c405dc20 2026-02-12T18:13:06.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84cb70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:06.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84cb70c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f84c4092200 con 0x7f84c4089df0 2026-02-12T18:13:06.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84cb70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:06.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84cb70c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f84c408b250 con 0x7f84c405dff0 2026-02-12T18:13:06.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84cb70c640 10 monclient(hunting): _renew_subs 2026-02-12T18:13:06.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84cb70c640 10 monclient(hunting): authenticate will time out at 1025.540264s 2026-02-12T18:13:06.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c8c80640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c405dff0 0x7f84c405e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:06.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c9481640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f84c405dc20 0x7f84c4144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:06.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c8c80640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c405dff0 0x7f84c405e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:50080/0 (socket says 10.20.193.48:50080) 2026-02-12T18:13:06.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c8c80640 1 -- 10.20.193.48:0/2063557516 learned_addr learned my addr 10.20.193.48:0/2063557516 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:13:06.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c8c80640 10 monclient(hunting): get_auth_request con 0x7f84c405dff0 auth_method 0 2026-02-12T18:13:06.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c8c80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:06.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c8c80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:06.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c8c80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:06.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c9481640 10 monclient(hunting): get_auth_request con 0x7f84c405dc20 auth_method 0 2026-02-12T18:13:06.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c9481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:06.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c9481640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:06.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c9481640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:06.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c8c80640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c405dff0 msgr2=0x7f84c405e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:13:06.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c8c80640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c405dff0 msgr2=0x7f84c405e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:13:06.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c8c80640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c405dff0 0x7f84c405e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:13:06.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c9481640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f84c405dc20 msgr2=0x7f84c4144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:13:06.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c8c80640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c405dff0 0x7f84c405e3c0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:13:06.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c9481640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f84c405dc20 msgr2=0x7f84c4144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:13:06.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c9481640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f84c405dc20 0x7f84c4144660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:13:06.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c9c82640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f84c4089df0 0x7f84c408a240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:06.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c9c82640 10 monclient(hunting): get_auth_request con 0x7f84c4089df0 auth_method 0 2026-02-12T18:13:06.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c9c82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:06.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c9c82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:06.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c9c82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:06.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c9481640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f84c405dc20 0x7f84c4144660 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:13:06.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c9c82640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f84c4089df0 msgr2=0x7f84c408a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-12T18:13:06.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c9c82640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f84c4089df0 msgr2=0x7f84c408a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:13:06.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c9c82640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f84c4089df0 0x7f84c408a240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:13:06.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:06.814+0000 7f84c9c82640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f84c4089df0 0x7f84c408a240 unknown :-1 s=START_CONNECT pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:13:07.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.015+0000 7f84c9481640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f84c405dc20 0x7f84c4144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:07.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.015+0000 7f84c9481640 10 monclient(hunting): get_auth_request con 0x7f84c405dc20 auth_method 0 2026-02-12T18:13:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.015+0000 7f84c9481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.015+0000 7f84c9481640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.015+0000 7f84c9481640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:13:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.015+0000 7f84c8c80640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c405dff0 0x7f84c405e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=8 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.015+0000 7f84c8c80640 10 monclient(hunting): get_auth_request con 0x7f84c405dff0 auth_method 0 2026-02-12T18:13:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.015+0000 7f84c8c80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.015+0000 7f84c8c80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.015+0000 7f84c8c80640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:13:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.015+0000 7f84c9481640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f84c405dc20 msgr2=0x7f84c4144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:13:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.015+0000 7f84c9481640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f84c405dc20 msgr2=0x7f84c4144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:13:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.015+0000 7f84c9481640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f84c405dc20 0x7f84c4144660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=7 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:13:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.015+0000 7f84c9481640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f84c405dc20 0x7f84c4144660 unknown :-1 s=START_CONNECT pgs=0 gs=10 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:13:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.015+0000 7f84c8c80640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c405dff0 msgr2=0x7f84c405e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:13:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.015+0000 7f84c8c80640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c405dff0 msgr2=0x7f84c405e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:13:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.015+0000 7f84c8c80640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c405dff0 0x7f84c405e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=8 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:13:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.015+0000 7f84c8c80640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c405dff0 0x7f84c405e3c0 unknown :-1 s=START_CONNECT pgs=0 gs=11 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:13:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.016+0000 7f84c9c82640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f84c4089df0 0x7f84c408a240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=9 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.016+0000 7f84c9c82640 10 monclient(hunting): get_auth_request con 0x7f84c4089df0 auth_method 0 2026-02-12T18:13:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.016+0000 7f84c9c82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.016+0000 7f84c9c82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.016+0000 7f84c9c82640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:13:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.016+0000 7f84c9c82640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f84c4089df0 msgr2=0x7f84c408a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-12T18:13:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.016+0000 7f84c9c82640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f84c4089df0 msgr2=0x7f84c408a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:13:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.016+0000 7f84c9c82640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f84c4089df0 0x7f84c408a240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=9 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:13:07.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.016+0000 7f84c9c82640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f84c4089df0 0x7f84c408a240 unknown :-1 s=START_CONNECT pgs=0 gs=12 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:13:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c9481640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f84c405dc20 0x7f84c4144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=13 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c9481640 10 monclient(hunting): get_auth_request con 0x7f84c405dc20 auth_method 0 2026-02-12T18:13:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c9481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c9481640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c9481640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:13:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c8c80640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c405dff0 0x7f84c405e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=14 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c8c80640 10 monclient(hunting): get_auth_request con 0x7f84c405dff0 auth_method 0 2026-02-12T18:13:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c8c80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c8c80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c8c80640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:13:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c9481640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f84c405dc20 msgr2=0x7f84c4144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:13:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c9481640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f84c405dc20 msgr2=0x7f84c4144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:13:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c9481640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f84c405dc20 0x7f84c4144660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=13 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:13:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c8c80640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c405dff0 msgr2=0x7f84c405e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:13:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c8c80640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c405dff0 msgr2=0x7f84c405e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:13:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c8c80640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c405dff0 0x7f84c405e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=14 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:13:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c9481640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f84c405dc20 0x7f84c4144660 unknown :-1 s=START_CONNECT pgs=0 gs=15 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:13:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c8c80640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c405dff0 0x7f84c405e3c0 unknown :-1 s=START_CONNECT pgs=0 gs=16 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:13:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c9c82640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f84c4089df0 0x7f84c408a240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=17 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c9c82640 10 monclient(hunting): get_auth_request con 0x7f84c4089df0 auth_method 0 2026-02-12T18:13:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c9c82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c9c82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c9c82640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:13:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c9c82640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f84c4089df0 msgr2=0x7f84c408a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:13:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c9c82640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f84c4089df0 msgr2=0x7f84c408a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:13:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c9c82640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f84c4089df0 0x7f84c408a240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=17 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:13:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:07.417+0000 7f84c9c82640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f84c4089df0 0x7f84c408a240 unknown :-1 s=START_CONNECT pgs=0 gs=18 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:13:08.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c9481640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f84c405dc20 0x7f84c4144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=19 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:08.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c9481640 10 monclient(hunting): get_auth_request con 0x7f84c405dc20 auth_method 0 2026-02-12T18:13:08.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c9481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:08.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c9481640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:08.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c9481640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:13:08.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c8c80640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c405dff0 0x7f84c405e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=20 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:08.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c8c80640 10 monclient(hunting): get_auth_request con 0x7f84c405dff0 auth_method 0 2026-02-12T18:13:08.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c8c80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:08.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c8c80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:08.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c8c80640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:13:08.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c9481640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f84c405dc20 msgr2=0x7f84c4144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:13:08.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c9481640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f84c405dc20 msgr2=0x7f84c4144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:13:08.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c9481640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f84c405dc20 0x7f84c4144660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=19 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:13:08.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c9481640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f84c405dc20 0x7f84c4144660 unknown :-1 s=START_CONNECT pgs=0 gs=21 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:13:08.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c8c80640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c405dff0 msgr2=0x7f84c405e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:13:08.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c8c80640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c405dff0 msgr2=0x7f84c405e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:13:08.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c8c80640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c405dff0 0x7f84c405e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=20 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:13:08.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c8c80640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c405dff0 0x7f84c405e3c0 unknown :-1 s=START_CONNECT pgs=0 gs=22 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:13:08.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c9c82640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f84c4089df0 0x7f84c408a240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=23 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:08.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c9c82640 10 monclient(hunting): get_auth_request con 0x7f84c4089df0 auth_method 0 2026-02-12T18:13:08.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c9c82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:08.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c9c82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:08.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c9c82640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:13:08.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c9c82640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f84c4089df0 msgr2=0x7f84c408a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:13:08.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c9c82640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f84c4089df0 msgr2=0x7f84c408a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:13:08.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c9c82640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f84c4089df0 0x7f84c408a240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=23 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:13:08.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:08.218+0000 7f84c9c82640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f84c4089df0 0x7f84c408a240 unknown :-1 s=START_CONNECT pgs=0 gs=24 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:13:09.767 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:09.767 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[30594]: starting. 2026-02-12T18:13:09.767 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[30594]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-30360 2026-02-12T18:13:09.767 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[30594]: shutting down. 2026-02-12T18:13:09.769 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:09.769 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:09.769 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:13:09.771 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:13:09.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84b2ffd640 10 monclient(hunting): tick 2026-02-12T18:13:09.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84b2ffd640 10 monclient(hunting): _check_auth_tickets 2026-02-12T18:13:09.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84b2ffd640 1 monclient(hunting): continuing hunt 2026-02-12T18:13:09.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84b2ffd640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T18:13:09.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84b2ffd640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c405dff0 msgr2=0x7f84c405e3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:13:09.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84b2ffd640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c405dff0 0x7f84c405e3c0 unknown :-1 s=START_CONNECT pgs=0 gs=22 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:09.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84b2ffd640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f84c4089df0 msgr2=0x7f84c408a240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:13:09.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84b2ffd640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f84c4089df0 0x7f84c408a240 unknown :-1 s=START_CONNECT pgs=0 gs=24 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:09.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84b2ffd640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f84c405dc20 msgr2=0x7f84c4144660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:13:09.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84b2ffd640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f84c405dc20 0x7f84c4144660 unknown :-1 s=START_CONNECT pgs=0 gs=21 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:09.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84b2ffd640 10 monclient: _add_conns ranks=[4,5,3,6,1,10,9,0] 2026-02-12T18:13:09.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84b2ffd640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f84a80038f0 0x7f84a8023d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:09.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84b2ffd640 10 monclient(hunting): picked mon.noname-c con 0x7f84a80038f0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:13:09.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84b2ffd640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f84a8024250 0x7f84a80446d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:09.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84b2ffd640 10 monclient(hunting): picked mon.noname-h con 0x7f84a8024250 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:13:09.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84b2ffd640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f84a8044d70 0x7f84a80651f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:09.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84b2ffd640 10 monclient(hunting): picked mon.noname-g con 0x7f84a8044d70 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:13:09.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84b2ffd640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:09.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84b2ffd640 1 -- 10.20.193.48:0/2063557516 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f84c4093a30 con 0x7f84a8044d70 2026-02-12T18:13:09.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84b2ffd640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:09.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84b2ffd640 1 -- 10.20.193.48:0/2063557516 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f84c4092200 con 0x7f84a80038f0 2026-02-12T18:13:09.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84b2ffd640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:09.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84b2ffd640 1 -- 10.20.193.48:0/2063557516 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f84c408b250 con 0x7f84a8024250 2026-02-12T18:13:09.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84b2ffd640 10 monclient(hunting): _renew_subs 2026-02-12T18:13:09.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84c8c80640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f84a8024250 msgr2=0x7f84a80446d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:13:09.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84c8c80640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f84a8024250 0x7f84a80446d0 unknown :-1 s=START_CONNECT pgs=0 gs=26 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:13:09.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84c9c82640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f84a8044d70 msgr2=0x7f84a80651f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3301/0 2026-02-12T18:13:09.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84c9481640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f84a80038f0 0x7f84a8023d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=25 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:09.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84c9c82640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f84a8044d70 0x7f84a80651f0 unknown :-1 s=START_CONNECT pgs=0 gs=27 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:13:09.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84c9481640 10 monclient(hunting): get_auth_request con 0x7f84a80038f0 auth_method 0 2026-02-12T18:13:09.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84c9481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:09.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84c9481640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:09.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84c9481640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:09.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84c9481640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:09.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84c9481640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:09.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84c9481640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:09.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84c9481640 10 monclient(hunting): handle_auth_done global_id 64525 payload 274 2026-02-12T18:13:09.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84c9481640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f84a8024250 msgr2=0x7f84a80446d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:13:09.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84c9481640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f84a8024250 0x7f84a80446d0 unknown :-1 s=START_CONNECT pgs=0 gs=26 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:09.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84c9481640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f84a8044d70 msgr2=0x7f84a80651f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:13:09.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84c9481640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f84a8044d70 0x7f84a80651f0 unknown :-1 s=START_CONNECT pgs=0 gs=27 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:09.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84c9481640 10 monclient: _finish_hunting 0 2026-02-12T18:13:09.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84c9481640 1 monclient: found mon.noname-c 2026-02-12T18:13:09.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84c9c82640 1 -- 10.20.193.48:0/2063557516 reap_dead start 2026-02-12T18:13:09.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84c9481640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:13:09.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84c9481640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:13:09.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.815+0000 7f84c9481640 1 -- 10.20.193.48:0/2063557516 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84c4060390 con 0x7f84a80038f0 2026-02-12T18:13:09.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.818+0000 7f84c9481640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f84a80038f0 msgr2=0x7f84a8023d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:09.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.818+0000 7f84c9481640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f84a80038f0 0x7f84a8023d10 secure :-1 s=READY pgs=131 gs=25 cs=0 l=1 c_cookie=9883415932664427198 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84b4010a80 tx=0x7f84b402fe30 comp rx=0 tx=0).ready entity=mon.4 client_cookie=8928f26d19e632be server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:09.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.818+0000 7f84b3fff640 1 -- 10.20.193.48:0/2063557516 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f84b40393b0 con 0x7f84a80038f0 2026-02-12T18:13:09.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.818+0000 7f84b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:09.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.818+0000 7f84b3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:13:09.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.818+0000 7f84b3fff640 10 monclient: dump: 2026-02-12T18:13:09.830 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:09.830 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:09.830 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:09.830 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:09.830 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:09.831 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:09.831 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:09.831 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:09.831 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:09.831 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:09.831 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:09.831 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:09.831 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:09.831 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:09.831 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:09.831 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:09.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.818+0000 7f84b3fff640 10 monclient: _finish_auth 0 2026-02-12T18:13:09.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.818+0000 7f84b3fff640 10 monclient: _check_auth_tickets 2026-02-12T18:13:09.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.818+0000 7f84b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:13:09.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.818+0000 7f84b3fff640 1 -- 10.20.193.48:0/2063557516 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84b4034070 con 0x7f84a80038f0 2026-02-12T18:13:09.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.818+0000 7f84cb70c640 5 monclient: authenticate success, global_id 64525 2026-02-12T18:13:09.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.818+0000 7f84cb70c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:13:09.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.818+0000 7f84b3fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:13:09.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.818+0000 7f84b3fff640 1 -- 10.20.193.48:0/2063557516 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f84b40399f0 con 0x7f84a80038f0 2026-02-12T18:13:09.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.818+0000 7f84cb70c640 10 monclient: get_monmap_and_config success 2026-02-12T18:13:09.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.818+0000 7f84cb70c640 4 set_mon_vals no callback set 2026-02-12T18:13:09.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.818+0000 7f84b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:09.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.818+0000 7f84b3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:13:09.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.818+0000 7f84b3fff640 10 monclient: dump: 2026-02-12T18:13:09.833 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:09.833 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:09.833 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:09.833 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:09.833 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:09.833 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:09.833 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:09.833 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:09.833 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:09.833 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:09.833 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:09.833 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:09.833 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:09.834 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:09.834 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:09.834 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:09.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.819+0000 7f84cb70c640 10 monclient: shutdown 2026-02-12T18:13:09.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.819+0000 7f84cb70c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:13:09.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.819+0000 7f84cb70c640 1 -- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f84a80038f0 msgr2=0x7f84a8023d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:09.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.819+0000 7f84cb70c640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f84a80038f0 0x7f84a8023d10 secure :-1 s=READY pgs=131 gs=25 cs=0 l=1 c_cookie=9883415932664427198 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84b4010a80 tx=0x7f84b402fe30 comp rx=0 tx=0).stop 2026-02-12T18:13:09.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.819+0000 7f84cb70c640 1 -- 10.20.193.48:0/2063557516 shutdown_connections 2026-02-12T18:13:09.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.819+0000 7f84cb70c640 1 --2- 10.20.193.48:0/2063557516 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f84a80038f0 0x7f84a8023d10 unknown :-1 s=CLOSED pgs=131 gs=25 cs=0 l=1 c_cookie=9883415932664427198 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:09.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.819+0000 7f84cb70c640 1 -- 10.20.193.48:0/2063557516 >> 10.20.193.48:0/2063557516 conn(0x7f84c40546d0 msgr2=0x7f84c4054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:13:09.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.819+0000 7f84cb70c640 1 -- 10.20.193.48:0/2063557516 shutdown_connections 2026-02-12T18:13:09.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.819+0000 7f84cb70c640 1 -- 10.20.193.48:0/2063557516 wait complete. 2026-02-12T18:13:09.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.819+0000 7f84cb70c640 10 monclient: build_initial_monmap 2026-02-12T18:13:09.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.819+0000 7f84cb70c640 10 monclient: monmap: 2026-02-12T18:13:09.835 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:13:09.835 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:13:09.835 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:13:09.835 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:13:09.835 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:13:09.835 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:09.835 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:13:09.835 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:13:09.835 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:13:09.835 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:13:09.835 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:13:09.836 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:13:09.836 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:13:09.836 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:13:09.836 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:13:09.836 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:09.836 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84cb70c640 1 Processor -- start 2026-02-12T18:13:09.836 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84cb70c640 1 -- start start 2026-02-12T18:13:09.836 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84cb70c640 10 monclient: init 2026-02-12T18:13:09.836 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84cb70c640 10 monclient: _reopen_session rank -1 2026-02-12T18:13:09.836 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84cb70c640 10 monclient: _add_conns ranks=[3,1,8,5,7,4,6,0,2] 2026-02-12T18:13:09.836 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84cb70c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f84a80038f0 0x7f84c4112040 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:09.836 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84cb70c640 10 monclient(hunting): picked mon.noname-g con 0x7f84a80038f0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:13:09.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84cb70c640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f84c410dec0 0x7f84c4112580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:09.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84cb70c640 10 monclient(hunting): picked mon.noname-f con 0x7f84c410dec0 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:13:09.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84cb70c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c408c4d0 0x7f84c408c8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:09.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84cb70c640 10 monclient(hunting): picked mon.noname-e con 0x7f84c408c4d0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:13:09.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84cb70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:09.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84cb70c640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f84c4122c90 con 0x7f84c410dec0 2026-02-12T18:13:09.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84cb70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:09.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84cb70c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f84c410f6c0 con 0x7f84a80038f0 2026-02-12T18:13:09.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84cb70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:09.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84cb70c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f84c408dd90 con 0x7f84c408c4d0 2026-02-12T18:13:09.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84cb70c640 10 monclient(hunting): _renew_subs 2026-02-12T18:13:09.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84cb70c640 10 monclient(hunting): authenticate will time out at 1028.545547s 2026-02-12T18:13:09.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c9481640 1 -- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f84a80038f0 msgr2=0x7f84c4112040 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3301/0 2026-02-12T18:13:09.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c9481640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f84a80038f0 0x7f84c4112040 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:13:09.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c9c82640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c408c4d0 0x7f84c408c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:09.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c9c82640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c408c4d0 0x7f84c408c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:50112/0 (socket says 10.20.193.48:50112) 2026-02-12T18:13:09.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c9c82640 1 -- 10.20.193.48:0/2553592599 learned_addr learned my addr 10.20.193.48:0/2553592599 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:13:09.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c9c82640 10 monclient(hunting): get_auth_request con 0x7f84c408c4d0 auth_method 0 2026-02-12T18:13:09.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c9c82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:09.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c9c82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:09.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c9c82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:09.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c9c82640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:09.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c9c82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:09.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c8c80640 1 --2- 10.20.193.48:0/2553592599 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f84c410dec0 0x7f84c4112580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:09.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c9c82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:09.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c8c80640 10 monclient(hunting): get_auth_request con 0x7f84c410dec0 auth_method 0 2026-02-12T18:13:09.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c8c80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:09.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c8c80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:09.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c8c80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:09.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c8c80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:09.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c8c80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:09.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c8c80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:09.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c9c82640 10 monclient(hunting): handle_auth_done global_id 94319 payload 824 2026-02-12T18:13:09.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c9c82640 1 -- 10.20.193.48:0/2553592599 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f84a80038f0 msgr2=0x7f84c4112040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:13:09.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c9c82640 1 --2- 10.20.193.48:0/2553592599 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f84a80038f0 0x7f84c4112040 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:09.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c9c82640 1 -- 10.20.193.48:0/2553592599 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f84c410dec0 msgr2=0x7f84c4112580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:09.840 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c9c82640 1 --2- 10.20.193.48:0/2553592599 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f84c410dec0 0x7f84c4112580 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:09.840 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c9c82640 10 monclient: _finish_hunting 0 2026-02-12T18:13:09.840 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c9c82640 1 monclient: found mon.noname-e 2026-02-12T18:13:09.840 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c9c82640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:13:09.840 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c9c82640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:13:09.840 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.820+0000 7f84c9c82640 1 -- 10.20.193.48:0/2553592599 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b40106a0 con 0x7f84c408c4d0 2026-02-12T18:13:09.840 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84c9c82640 1 -- 10.20.193.48:0/2553592599 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c408c4d0 msgr2=0x7f84c408c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:09.840 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84c9c82640 1 --2- 10.20.193.48:0/2553592599 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c408c4d0 0x7f84c408c8e0 secure :-1 s=READY pgs=59 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84c4094e50 tx=0x7f84c00155f0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:09.840 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84b1ffb640 1 -- 10.20.193.48:0/2553592599 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f84c0015d30 con 0x7f84c408c4d0 2026-02-12T18:13:09.840 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:09.840 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84b1ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:13:09.840 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84b1ffb640 10 monclient: dump: 2026-02-12T18:13:09.841 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:09.841 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:09.841 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:09.841 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:09.841 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:09.841 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:09.841 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:09.841 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:09.841 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:09.841 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:09.841 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:09.841 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:09.841 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:09.842 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:09.842 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:09.842 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:09.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84b1ffb640 10 monclient: _finish_auth 0 2026-02-12T18:13:09.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84b1ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:13:09.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84b1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:13:09.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84b1ffb640 1 -- 10.20.193.48:0/2553592599 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84c000d040 con 0x7f84c408c4d0 2026-02-12T18:13:09.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84b1ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:13:09.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84b1ffb640 1 -- 10.20.193.48:0/2553592599 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f84c00054f0 con 0x7f84c408c4d0 2026-02-12T18:13:09.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:09.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84b1ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:13:09.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84b37fe640 4 set_mon_vals no callback set 2026-02-12T18:13:09.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84b1ffb640 10 monclient: dump: 2026-02-12T18:13:09.843 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:09.843 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:09.843 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:09.843 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:09.843 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:09.843 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:09.843 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:09.843 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:09.843 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:09.843 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:09.843 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:09.844 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:09.844 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:09.844 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:09.844 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:09.844 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:09.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84cb70c640 5 monclient: authenticate success, global_id 94319 2026-02-12T18:13:09.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84cb70c640 10 monclient: _renew_subs 2026-02-12T18:13:09.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84cb70c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:13:09.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84cb70c640 1 -- 10.20.193.48:0/2553592599 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84c410f3e0 con 0x7f84c408c4d0 2026-02-12T18:13:09.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84cb70c640 10 monclient: _renew_subs 2026-02-12T18:13:09.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84cb70c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:13:09.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84cb70c640 1 -- 10.20.193.48:0/2553592599 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f84c4112ac0 con 0x7f84c408c4d0 2026-02-12T18:13:09.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84b1ffb640 1 -- 10.20.193.48:0/2553592599 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f84c0005030 con 0x7f84c408c4d0 2026-02-12T18:13:09.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84cb70c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:13:09.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84cb70c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:13:09.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84cb70c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:13:09.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.823+0000 7f84cb70c640 1 -- 10.20.193.48:0/2553592599 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84c4092510 con 0x7f84c408c4d0 2026-02-12T18:13:09.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.824+0000 7f84b1ffb640 1 --2- 10.20.193.48:0/2553592599 >> v2:10.20.193.111:6812/977811348 conn(0x7f849403f7c0 0x7f849405fc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:09.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.824+0000 7f84b1ffb640 1 -- 10.20.193.48:0/2553592599 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(223..223 src has 190..223) ==== 3503+0+0 (secure 0 0 0) 0x7f84c00532c0 con 0x7f84c408c4d0 2026-02-12T18:13:09.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.824+0000 7f84c9481640 1 --2- 10.20.193.48:0/2553592599 >> v2:10.20.193.111:6812/977811348 conn(0x7f849403f7c0 0x7f849405fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:09.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.824+0000 7f84c9481640 10 monclient: get_auth_request con 0x7f849403f7c0 auth_method 0 2026-02-12T18:13:09.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.824+0000 7f84c9481640 1 -- 10.20.193.48:0/2553592599 >> v2:10.20.193.111:6812/977811348 conn(0x7f849403f7c0 msgr2=0x7f849405fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-12T18:13:09.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.824+0000 7f84c9481640 1 -- 10.20.193.48:0/2553592599 >> v2:10.20.193.111:6812/977811348 conn(0x7f849403f7c0 msgr2=0x7f849405fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:13:09.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.824+0000 7f84c9481640 1 --2- 10.20.193.48:0/2553592599 >> v2:10.20.193.111:6812/977811348 conn(0x7f849403f7c0 0x7f849405fc70 secure :-1 s=COMPRESSION_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84b4010a80 tx=0x7f84b4036000 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:13:09.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.824+0000 7f84c9481640 1 --2- 10.20.193.48:0/2553592599 >> v2:10.20.193.111:6812/977811348 conn(0x7f849403f7c0 0x7f849405fc70 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:13:09.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.826+0000 7f84b1ffb640 1 -- 10.20.193.48:0/2553592599 <== mon.8 v2:10.20.193.48:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f84c00047b0 con 0x7f84c408c4d0 2026-02-12T18:13:09.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.826+0000 7f84b1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:13:09.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.826+0000 7f84b1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:13:09.973 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.972+0000 7f84cb70c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T18:13:09.973 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.972+0000 7f84cb70c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T18:13:09.973 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.972+0000 7f84cb70c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:13:09.973 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.972+0000 7f84cb70c640 1 -- 10.20.193.48:0/2553592599 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f84c4144660 con 0x7f84c408c4d0 2026-02-12T18:13:09.974 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.972+0000 7f84b1ffb640 1 -- 10.20.193.48:0/2553592599 <== mon.8 v2:10.20.193.48:3304/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3642 (secure 0 0 0) 0x7f84c00243c0 con 0x7f84c408c4d0 2026-02-12T18:13:09.974 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.972+0000 7f84b1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T18:13:09.974 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.972+0000 7f84b1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:13:09.974 INFO:teuthology.orchestra.run.trial048.stdout:{"election_epoch":72,"quorum":[0,1,2,4,7,8],"quorum_names":["a","f","b","c","i","e"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","modified":"2026-02-12T18:05:32.850777Z","created":"2026-02-12T18:05:32.850777Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3300","nonce":0},{"type":"v1","addr":"10.20.193.48:6789","nonce":0}]},"addr":"10.20.193.48:6789/0","public_addr":"10.20.193.48:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850827+0000","crush_location":[]},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3300","nonce":0},{"type":"v1","addr":"10.20.193.111:6789","nonce":0}]},"addr":"10.20.193.111:6789/0","public_addr":"10.20.193.111:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850829+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3301","nonce":0},{"type":"v1","addr":"10.20.193.48:6790","nonce":0}]},"addr":"10.20.193.48:6790/0","public_addr":"10.20.193.48:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850830+0000","crush_location":[]},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3301","nonce":0},{"type":"v1","addr":"10.20.193.111:6790","nonce":0}]},"addr":"10.20.193.111:6790/0","public_addr":"10.20.193.111:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850833+0000","crush_location":[]},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3302","nonce":0},{"type":"v1","addr":"10.20.193.48:6791","nonce":0}]},"addr":"10.20.193.48:6791/0","public_addr":"10.20.193.48:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3302","nonce":0},{"type":"v1","addr":"10.20.193.111:6791","nonce":0}]},"addr":"10.20.193.111:6791/0","public_addr":"10.20.193.111:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850834+0000","crush_location":[]},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3303","nonce":0},{"type":"v1","addr":"10.20.193.48:6792","nonce":0}]},"addr":"10.20.193.48:6792/0","public_addr":"10.20.193.48:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3303","nonce":0},{"type":"v1","addr":"10.20.193.111:6792","nonce":0}]},"addr":"10.20.193.111:6792/0","public_addr":"10.20.193.111:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850835+0000","crush_location":[]},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3304","nonce":0},{"type":"v1","addr":"10.20.193.48:6793","nonce":0}]},"addr":"10.20.193.48:6793/0","public_addr":"10.20.193.48:6793/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850832+0000","crush_location":[]}]}} 2026-02-12T18:13:09.975 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.973+0000 7f84cb70c640 1 -- 10.20.193.48:0/2553592599 >> v2:10.20.193.111:6812/977811348 conn(0x7f849403f7c0 msgr2=0x7f849405fc70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:13:09.975 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.973+0000 7f84cb70c640 1 --2- 10.20.193.48:0/2553592599 >> v2:10.20.193.111:6812/977811348 conn(0x7f849403f7c0 0x7f849405fc70 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:09.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.973+0000 7f84cb70c640 10 monclient: shutdown 2026-02-12T18:13:09.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.973+0000 7f84cb70c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:13:09.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.973+0000 7f84cb70c640 1 -- 10.20.193.48:0/2553592599 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c408c4d0 msgr2=0x7f84c408c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:09.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.973+0000 7f84cb70c640 1 --2- 10.20.193.48:0/2553592599 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c408c4d0 0x7f84c408c8e0 secure :-1 s=READY pgs=59 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f84c4094e50 tx=0x7f84c00155f0 comp rx=0 tx=0).stop 2026-02-12T18:13:09.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.973+0000 7f84cb70c640 1 -- 10.20.193.48:0/2553592599 shutdown_connections 2026-02-12T18:13:09.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.973+0000 7f84cb70c640 1 --2- 10.20.193.48:0/2553592599 >> v2:10.20.193.111:6812/977811348 conn(0x7f849403f7c0 0x7f849405fc70 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:09.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.973+0000 7f84cb70c640 1 --2- 10.20.193.48:0/2553592599 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f84c408c4d0 0x7f84c408c8e0 unknown :-1 s=CLOSED pgs=59 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:09.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.973+0000 7f84cb70c640 1 --2- 10.20.193.48:0/2553592599 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f84c410dec0 0x7f84c4112580 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:09.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.973+0000 7f84cb70c640 1 --2- 10.20.193.48:0/2553592599 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f84a80038f0 0x7f84c4112040 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:09.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.973+0000 7f84cb70c640 1 -- 10.20.193.48:0/2553592599 >> 10.20.193.48:0/2553592599 conn(0x7f84c40546d0 msgr2=0x7f84c408e910 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:13:09.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.973+0000 7f84cb70c640 1 -- 10.20.193.48:0/2553592599 shutdown_connections 2026-02-12T18:13:09.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:09.973+0000 7f84cb70c640 1 -- 10.20.193.48:0/2553592599 wait complete. 2026-02-12T18:13:09.982 INFO:tasks.mon_thrash.ceph_manager:quorum is size 6 2026-02-12T18:13:09.982 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon a 2026-02-12T18:13:09.983 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T18:13:10.049 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.048+0000 7f49a7a1b640 10 monclient: get_monmap_and_config 2026-02-12T18:13:10.049 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.048+0000 7f49a7a1b640 10 monclient: build_initial_monmap 2026-02-12T18:13:10.049 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.048+0000 7f49a7a1b640 10 monclient: monmap: 2026-02-12T18:13:10.049 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:13:10.049 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.049 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:13:10.048621+0000 2026-02-12T18:13:10.049 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:13:10.048621+0000 2026-02-12T18:13:10.049 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:13:10.049 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.050 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:13:10.050 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:13:10.050 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:13:10.050 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:13:10.050 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:13:10.050 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:13:10.050 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:13:10.050 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:13:10.050 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:13:10.050 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:13:10.050 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:13:10.050 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.048+0000 7f49a7a1b640 1 Processor -- start 2026-02-12T18:13:10.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a7a1b640 1 -- start start 2026-02-12T18:13:10.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a7a1b640 10 monclient: init 2026-02-12T18:13:10.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a7a1b640 10 monclient: _reopen_session rank -1 2026-02-12T18:13:10.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a7a1b640 10 monclient: _add_conns ranks=[3,10,0,7,1,4,8,5,6,9,2] 2026-02-12T18:13:10.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a7a1b640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f49a005c950 0x7f49a005cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a7a1b640 10 monclient(hunting): picked mon.noname-g con 0x7f49a005c950 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:13:10.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a7a1b640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f49a005e490 0x7f49a005d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a7a1b640 10 monclient(hunting): picked mon.noname-f con 0x7f49a005e490 addr v2:10.20.193.111:3300/0 2026-02-12T18:13:10.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a7a1b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f49a013db70 addr v1:10.20.193.48:6789/0 2026-02-12T18:13:10.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a7a1b640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49a004dc20 con 0x7f49a013db70 2026-02-12T18:13:10.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a7a1b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a7a1b640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f49a005ddd0 con 0x7f49a005e490 2026-02-12T18:13:10.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a7a1b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a7a1b640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f49a005d7a0 con 0x7f49a005c950 2026-02-12T18:13:10.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a7a1b640 10 monclient(hunting): _renew_subs 2026-02-12T18:13:10.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a7a1b640 10 monclient(hunting): authenticate will time out at 1028.774548s 2026-02-12T18:13:10.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a5790640 1 -- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f49a005c950 msgr2=0x7f49a005cd20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3301/0 2026-02-12T18:13:10.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a5790640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f49a005c950 0x7f49a005cd20 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:13:10.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a5f91640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f49a013db70 0x7f49a013e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:54346/0 (socket says 10.20.193.48:54346) 2026-02-12T18:13:10.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a5f91640 1 -- 10.20.193.48:0/281958013 learned_addr learned my addr 10.20.193.48:0/281958013 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:13:10.062 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a4f8f640 1 --2- 10.20.193.48:0/281958013 >> v2:10.20.193.111:3300/0 conn(0x7f49a005e490 0x7f49a005d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.062 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a4f8f640 10 monclient(hunting): get_auth_request con 0x7f49a005e490 auth_method 0 2026-02-12T18:13:10.062 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a4f8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.062 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a4f8f640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.062 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a4f8f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.062 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a4f8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.062 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a4f8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.062 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.049+0000 7f49a4f8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.062 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.050+0000 7f49a4f8f640 10 monclient(hunting): handle_auth_done global_id 94312 payload 274 2026-02-12T18:13:10.062 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.050+0000 7f49a4f8f640 1 -- 10.20.193.48:0/281958013 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f49a005c950 msgr2=0x7f49a005cd20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:13:10.062 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.050+0000 7f49a4f8f640 1 --2- 10.20.193.48:0/281958013 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f49a005c950 0x7f49a005cd20 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.050+0000 7f49a4f8f640 1 -- 10.20.193.48:0/281958013 >> v1:10.20.193.48:6789/0 conn(0x7f49a013db70 legacy=0x7f49a013e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:13:10.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.050+0000 7f49a4f8f640 10 monclient: _finish_hunting 0 2026-02-12T18:13:10.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.050+0000 7f49a4f8f640 1 monclient: found mon.noname-f 2026-02-12T18:13:10.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.050+0000 7f49a4f8f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:13:10.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.050+0000 7f49a4f8f640 10 monclient: _send_mon_message to mon.noname-f at v2:10.20.193.111:3300/0 2026-02-12T18:13:10.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.050+0000 7f49a4f8f640 1 -- 10.20.193.48:0/281958013 --> v2:10.20.193.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49a0092990 con 0x7f49a005e490 2026-02-12T18:13:10.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.052+0000 7f49a4f8f640 1 -- 10.20.193.48:0/281958013 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49a005e490 msgr2=0x7f49a005d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:10.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.052+0000 7f49a4f8f640 1 --2- 10.20.193.48:0/281958013 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49a005e490 0x7f49a005d260 secure :-1 s=READY pgs=58 gs=3 cs=0 l=1 c_cookie=14087110164138916022 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4994004740 tx=0x7f499402ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c37f780ebd4b78b6 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.052+0000 7f498ffff640 1 -- 10.20.193.48:0/281958013 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4994035340 con 0x7f49a005e490 2026-02-12T18:13:10.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.052+0000 7f498ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.052+0000 7f498ffff640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2026-02-12T18:13:10.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.052+0000 7f498ffff640 10 monclient: dump: 2026-02-12T18:13:10.063 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.064 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.064 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.064 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.064 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.064 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.064 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.064 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.064 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.064 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.064 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.064 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.064 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.064 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.065 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.065 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.052+0000 7f498ffff640 10 monclient: _finish_auth 0 2026-02-12T18:13:10.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.052+0000 7f498ffff640 10 monclient: _check_auth_tickets 2026-02-12T18:13:10.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.052+0000 7f498ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:13:10.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.052+0000 7f498ffff640 1 -- 10.20.193.48:0/281958013 <== mon.1 v2:10.20.193.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49940354c0 con 0x7f49a005e490 2026-02-12T18:13:10.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.052+0000 7f498ffff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:13:10.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.052+0000 7f498ffff640 1 -- 10.20.193.48:0/281958013 <== mon.1 v2:10.20.193.111:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4994035af0 con 0x7f49a005e490 2026-02-12T18:13:10.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.052+0000 7f498ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.052+0000 7f498ffff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:13:10.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.052+0000 7f498ffff640 10 monclient: dump: 2026-02-12T18:13:10.065 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.066 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.066 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.066 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.066 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.066 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.066 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.066 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.066 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.066 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.066 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.066 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.066 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.067 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.067 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.067 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.052+0000 7f49a7a1b640 5 monclient: authenticate success, global_id 94312 2026-02-12T18:13:10.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.052+0000 7f49a7a1b640 10 monclient: get_monmap_and_config success 2026-02-12T18:13:10.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.052+0000 7f49a7a1b640 4 set_mon_vals no callback set 2026-02-12T18:13:10.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.053+0000 7f49a7a1b640 10 monclient: shutdown 2026-02-12T18:13:10.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.053+0000 7f49a7a1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:13:10.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.053+0000 7f49a7a1b640 1 -- 10.20.193.48:0/281958013 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49a005e490 msgr2=0x7f49a005d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.053+0000 7f49a7a1b640 1 --2- 10.20.193.48:0/281958013 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49a005e490 0x7f49a005d260 secure :-1 s=READY pgs=58 gs=3 cs=0 l=1 c_cookie=14087110164138916022 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4994004740 tx=0x7f499402ed50 comp rx=0 tx=0).stop 2026-02-12T18:13:10.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.053+0000 7f49a7a1b640 1 -- 10.20.193.48:0/281958013 shutdown_connections 2026-02-12T18:13:10.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.053+0000 7f49a7a1b640 1 --2- 10.20.193.48:0/281958013 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49a005e490 0x7f49a005d260 unknown :-1 s=CLOSED pgs=58 gs=3 cs=0 l=1 c_cookie=14087110164138916022 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.053+0000 7f49a7a1b640 1 --2- 10.20.193.48:0/281958013 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f49a005c950 0x7f49a005cd20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.053+0000 7f49a7a1b640 1 -- 10.20.193.48:0/281958013 >> 10.20.193.48:0/281958013 conn(0x7f49a00548a0 msgr2=0x7f49a0097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:13:10.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.053+0000 7f49a7a1b640 1 -- 10.20.193.48:0/281958013 shutdown_connections 2026-02-12T18:13:10.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.053+0000 7f49a7a1b640 1 -- 10.20.193.48:0/281958013 wait complete. 2026-02-12T18:13:10.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.053+0000 7f49a7a1b640 10 monclient: build_initial_monmap 2026-02-12T18:13:10.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.053+0000 7f49a7a1b640 10 monclient: monmap: 2026-02-12T18:13:10.068 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:13:10.068 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:13:10.068 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:13:10.068 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:13:10.068 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:13:10.068 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.069 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:13:10.069 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:13:10.069 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:13:10.069 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:13:10.069 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:13:10.069 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:13:10.069 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:13:10.069 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:13:10.069 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:13:10.069 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.053+0000 7f49a7a1b640 1 Processor -- start 2026-02-12T18:13:10.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.053+0000 7f49a7a1b640 1 -- start start 2026-02-12T18:13:10.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.053+0000 7f49a7a1b640 10 monclient: init 2026-02-12T18:13:10.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a7a1b640 10 monclient: _reopen_session rank -1 2026-02-12T18:13:10.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a7a1b640 10 monclient: _add_conns ranks=[3,8,1,0,6,2,7,5,4] 2026-02-12T18:13:10.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a7a1b640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f49a005c950 0x7f49a012a7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a7a1b640 10 monclient(hunting): picked mon.noname-g con 0x7f49a005c950 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:13:10.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a7a1b640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f49a005e490 0x7f49a008d3a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a7a1b640 10 monclient(hunting): picked mon.noname-e con 0x7f49a005e490 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:13:10.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a7a1b640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49a013db70 0x7f49a008d8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a7a1b640 10 monclient(hunting): picked mon.noname-f con 0x7f49a013db70 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:13:10.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a7a1b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a7a1b640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f49a0090520 con 0x7f49a013db70 2026-02-12T18:13:10.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a7a1b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a7a1b640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f49a0143ee0 con 0x7f49a005c950 2026-02-12T18:13:10.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a7a1b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a7a1b640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f49a0143b20 con 0x7f49a005e490 2026-02-12T18:13:10.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a7a1b640 10 monclient(hunting): _renew_subs 2026-02-12T18:13:10.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a7a1b640 10 monclient(hunting): authenticate will time out at 1028.779215s 2026-02-12T18:13:10.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a5790640 1 -- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f49a005c950 msgr2=0x7f49a012a7d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3301/0 2026-02-12T18:13:10.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a5790640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f49a005c950 0x7f49a012a7d0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:13:10.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a4f8f640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f49a005e490 0x7f49a008d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a4f8f640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f49a005e490 0x7f49a008d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:50124/0 (socket says 10.20.193.48:50124) 2026-02-12T18:13:10.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a4f8f640 1 -- 10.20.193.48:0/3130791658 learned_addr learned my addr 10.20.193.48:0/3130791658 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:13:10.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a4f8f640 10 monclient(hunting): get_auth_request con 0x7f49a005e490 auth_method 0 2026-02-12T18:13:10.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a4f8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a4f8f640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a4f8f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a4f8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a4f8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a4f8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a5f91640 1 --2- 10.20.193.48:0/3130791658 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49a013db70 0x7f49a008d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a5f91640 10 monclient(hunting): get_auth_request con 0x7f49a013db70 auth_method 0 2026-02-12T18:13:10.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a5f91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a5f91640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a5f91640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a4f8f640 10 monclient(hunting): handle_auth_done global_id 94328 payload 824 2026-02-12T18:13:10.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a4f8f640 1 -- 10.20.193.48:0/3130791658 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f49a005c950 msgr2=0x7f49a012a7d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:13:10.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a4f8f640 1 --2- 10.20.193.48:0/3130791658 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f49a005c950 0x7f49a012a7d0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.073 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a4f8f640 1 -- 10.20.193.48:0/3130791658 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49a013db70 msgr2=0x7f49a008d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.073 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a4f8f640 1 --2- 10.20.193.48:0/3130791658 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49a013db70 0x7f49a008d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.073 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a4f8f640 10 monclient: _finish_hunting 0 2026-02-12T18:13:10.073 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a4f8f640 1 monclient: found mon.noname-e 2026-02-12T18:13:10.073 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a4f8f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:13:10.073 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a4f8f640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:13:10.073 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.054+0000 7f49a4f8f640 1 -- 10.20.193.48:0/3130791658 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4994009420 con 0x7f49a005e490 2026-02-12T18:13:10.073 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.056+0000 7f49a4f8f640 1 -- 10.20.193.48:0/3130791658 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f49a005e490 msgr2=0x7f49a008d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:10.073 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.056+0000 7f49a4f8f640 1 --2- 10.20.193.48:0/3130791658 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f49a005e490 0x7f49a008d3a0 secure :-1 s=READY pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f499402f260 tx=0x7f49940047e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.073 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.056+0000 7f498dffb640 1 -- 10.20.193.48:0/3130791658 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f49940044f0 con 0x7f49a005e490 2026-02-12T18:13:10.073 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.056+0000 7f498dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.073 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.056+0000 7f498dffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:13:10.073 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.056+0000 7f498dffb640 10 monclient: dump: 2026-02-12T18:13:10.074 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.074 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.074 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.074 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.074 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.074 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.074 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.074 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.074 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.074 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.074 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.074 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.075 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.075 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.075 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.075 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.056+0000 7f498dffb640 10 monclient: _finish_auth 0 2026-02-12T18:13:10.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.056+0000 7f498dffb640 10 monclient: _check_auth_tickets 2026-02-12T18:13:10.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.056+0000 7f498dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:13:10.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.056+0000 7f49a7a1b640 5 monclient: authenticate success, global_id 94328 2026-02-12T18:13:10.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.056+0000 7f498dffb640 1 -- 10.20.193.48:0/3130791658 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4994004030 con 0x7f49a005e490 2026-02-12T18:13:10.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.056+0000 7f498dffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:13:10.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.056+0000 7f49a7a1b640 10 monclient: _renew_subs 2026-02-12T18:13:10.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.056+0000 7f498f7fe640 4 set_mon_vals no callback set 2026-02-12T18:13:10.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.056+0000 7f49a7a1b640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:13:10.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.056+0000 7f49a7a1b640 1 -- 10.20.193.48:0/3130791658 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49a013e7b0 con 0x7f49a005e490 2026-02-12T18:13:10.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.056+0000 7f49a7a1b640 10 monclient: _renew_subs 2026-02-12T18:13:10.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.056+0000 7f49a7a1b640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:13:10.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.056+0000 7f49a7a1b640 1 -- 10.20.193.48:0/3130791658 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f49a008ab80 con 0x7f49a005e490 2026-02-12T18:13:10.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.057+0000 7f498dffb640 1 -- 10.20.193.48:0/3130791658 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f49940041a0 con 0x7f49a005e490 2026-02-12T18:13:10.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.057+0000 7f498dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.057+0000 7f498dffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:13:10.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.057+0000 7f498dffb640 10 monclient: dump: 2026-02-12T18:13:10.076 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.076 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.076 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.076 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.077 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.077 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.077 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.077 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.077 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.077 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.077 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.077 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.077 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.077 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.077 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.077 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.057+0000 7f49a7a1b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:13:10.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.057+0000 7f49a7a1b640 1 --2- 10.20.193.48:0/3130791658 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49a008ad70 0x7f49a013cd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.057+0000 7f49a7a1b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.057+0000 7f49a7a1b640 1 -- 10.20.193.48:0/3130791658 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f49a005f140 con 0x7f49a008ad70 2026-02-12T18:13:10.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.057+0000 7f49a5790640 1 --2- 10.20.193.48:0/3130791658 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49a008ad70 0x7f49a013cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.057+0000 7f49a5790640 10 monclient: get_auth_request con 0x7f49a008ad70 auth_method 0 2026-02-12T18:13:10.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.057+0000 7f49a5790640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.057+0000 7f49a5790640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.057+0000 7f49a5790640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.057+0000 7f49a5790640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.057+0000 7f49a5790640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.057+0000 7f49a5790640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.057+0000 7f498dffb640 1 -- 10.20.193.48:0/3130791658 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f49940036d0 con 0x7f49a005e490 2026-02-12T18:13:10.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.057+0000 7f49a5790640 10 monclient(hunting): handle_auth_done global_id 6291 payload 824 2026-02-12T18:13:10.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.057+0000 7f49a5790640 1 -- 10.20.193.48:0/3130791658 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f49a0097de0 con 0x7f49a008ad70 2026-02-12T18:13:10.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.057+0000 7f498dffb640 1 --2- 10.20.193.48:0/3130791658 >> v2:10.20.193.111:6812/977811348 conn(0x7f497003f7c0 0x7f497005fc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.058+0000 7f498dffb640 1 -- 10.20.193.48:0/3130791658 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(223..223 src has 190..223) ==== 3503+0+0 (secure 0 0 0) 0x7f4994077c90 con 0x7f49a005e490 2026-02-12T18:13:10.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.058+0000 7f49a5f91640 1 --2- 10.20.193.48:0/3130791658 >> v2:10.20.193.111:6812/977811348 conn(0x7f497003f7c0 0x7f497005fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.058+0000 7f49a5f91640 10 monclient: get_auth_request con 0x7f497003f7c0 auth_method 0 2026-02-12T18:13:10.082 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.060+0000 7f49a5790640 1 -- 10.20.193.48:0/3130791658 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49a008ad70 msgr2=0x7f49a013cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:10.082 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.060+0000 7f49a5790640 1 --2- 10.20.193.48:0/3130791658 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49a008ad70 0x7f49a013cd90 secure :-1 s=READY pgs=509 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f499000b450 tx=0x7f499000b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.082 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.060+0000 7f498dffb640 1 -- 10.20.193.48:0/3130791658 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4990005530 con 0x7f49a008ad70 2026-02-12T18:13:10.082 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.060+0000 7f498dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.082 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.060+0000 7f498dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:13:10.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.060+0000 7f498dffb640 10 monclient: dump: 2026-02-12T18:13:10.083 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.083 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.083 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.083 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.083 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.083 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.083 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.083 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.083 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.083 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.083 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.083 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.084 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.084 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.084 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.084 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.060+0000 7f498dffb640 1 -- 10.20.193.48:0/3130791658 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f4990005690 con 0x7f49a008ad70 2026-02-12T18:13:10.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.060+0000 7f498dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:13:10.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.060+0000 7f498dffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:13:10.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.060+0000 7f498dffb640 1 -- 10.20.193.48:0/3130791658 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49a008ad70 msgr2=0x7f49a013cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.060+0000 7f498dffb640 1 --2- 10.20.193.48:0/3130791658 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49a008ad70 0x7f49a013cd90 secure :-1 s=READY pgs=509 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f499000b450 tx=0x7f499000b920 comp rx=0 tx=0).stop 2026-02-12T18:13:10.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.060+0000 7f498dffb640 1 -- 10.20.193.48:0/3130791658 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49a008ad70 msgr2=0x7f49a013cd90 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:13:10.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.060+0000 7f498dffb640 1 --2- 10.20.193.48:0/3130791658 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49a008ad70 0x7f49a013cd90 secure :-1 s=CLOSED pgs=509 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f499000b450 tx=0x7f499000b920 comp rx=0 tx=0).stop 2026-02-12T18:13:10.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.060+0000 7f49a5f91640 1 --2- 10.20.193.48:0/3130791658 >> v2:10.20.193.111:6812/977811348 conn(0x7f497003f7c0 0x7f497005fc70 secure :-1 s=READY pgs=352 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f499c005980 tx=0x7f499c00a040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.063+0000 7f49a7a1b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:13:10.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.063+0000 7f49a7a1b640 1 --2- 10.20.193.48:0/3130791658 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49a013d2d0 0x7f49a012b850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.063+0000 7f49a7a1b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.063+0000 7f49a7a1b640 1 -- 10.20.193.48:0/3130791658 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f49a005fd90 con 0x7f49a013d2d0 2026-02-12T18:13:10.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.063+0000 7f49a5790640 1 --2- 10.20.193.48:0/3130791658 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49a013d2d0 0x7f49a012b850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.063+0000 7f49a5790640 10 monclient: get_auth_request con 0x7f49a013d2d0 auth_method 0 2026-02-12T18:13:10.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.063+0000 7f49a5790640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.063+0000 7f49a5790640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.063+0000 7f49a5790640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.063+0000 7f49a5790640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.063+0000 7f49a5790640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.063+0000 7f49a5790640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.063+0000 7f49a5790640 10 monclient(hunting): handle_auth_done global_id 6300 payload 824 2026-02-12T18:13:10.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.063+0000 7f49a5790640 1 -- 10.20.193.48:0/3130791658 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f49a013e7b0 con 0x7f49a013d2d0 2026-02-12T18:13:10.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.066+0000 7f49a5790640 1 -- 10.20.193.48:0/3130791658 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49a013d2d0 msgr2=0x7f49a012b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:10.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.066+0000 7f49a5790640 1 --2- 10.20.193.48:0/3130791658 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49a013d2d0 0x7f49a012b850 secure :-1 s=READY pgs=510 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f499000b450 tx=0x7f4990005a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.086 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.066+0000 7f498dffb640 1 -- 10.20.193.48:0/3130791658 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f499001f070 con 0x7f49a013d2d0 2026-02-12T18:13:10.086 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.066+0000 7f498dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.086 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.066+0000 7f498dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:13:10.086 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.066+0000 7f498dffb640 10 monclient: dump: 2026-02-12T18:13:10.086 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.086 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.086 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.086 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.086 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.086 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.086 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.086 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.086 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.086 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.086 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.087 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.087 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.087 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.087 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.087 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.066+0000 7f498dffb640 1 -- 10.20.193.48:0/3130791658 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10151 (secure 0 0 0) 0x7f4990010690 con 0x7f49a013d2d0 2026-02-12T18:13:10.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.066+0000 7f498dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:13:10.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.066+0000 7f498dffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:13:10.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.066+0000 7f498dffb640 1 -- 10.20.193.48:0/3130791658 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49a013d2d0 msgr2=0x7f49a012b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.066+0000 7f498dffb640 1 --2- 10.20.193.48:0/3130791658 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49a013d2d0 0x7f49a012b850 secure :-1 s=READY pgs=510 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f499000b450 tx=0x7f4990005a90 comp rx=0 tx=0).stop 2026-02-12T18:13:10.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.066+0000 7f498dffb640 1 -- 10.20.193.48:0/3130791658 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49a013d2d0 msgr2=0x7f49a012b850 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:13:10.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.066+0000 7f498dffb640 1 --2- 10.20.193.48:0/3130791658 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f49a013d2d0 0x7f49a012b850 secure :-1 s=CLOSED pgs=510 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f499000b450 tx=0x7f4990005a90 comp rx=0 tx=0).stop 2026-02-12T18:13:10.088 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:13:10.088 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:13:10.088 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:13:10.088 INFO:teuthology.orchestra.run.trial048.stdout: "state": "leader", 2026-02-12T18:13:10.088 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 72, 2026-02-12T18:13:10.088 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 444900, 2026-02-12T18:13:10.088 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:13:10.088 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:13:10.088 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:13:10.088 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:13:10.088 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:13:10.088 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:13:10.088 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:13:10.089 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.089 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 1, 2026-02-12T18:13:10.089 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:13:10.089 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:13:10.089 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:13:10.089 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:13:10.089 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:13:10.089 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:13:10.089 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:13:10.089 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:13:10.089 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:13:10.089 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:13:10.089 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:13:10.089 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:13:10.089 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:13:10.089 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:13:10.090 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:13:10.090 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:13:10.090 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.090 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:13:10.090 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:13:10.090 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:13:10.090 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:13:10.090 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:13:10.090 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:13:10.090 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:13:10.090 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:13:10.090 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:13:10.090 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:13:10.090 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:13:10.090 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:13:10.090 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:13:10.091 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:13:10.091 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:13:10.091 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.091 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.091 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:13:10.091 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:13:10.091 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:13:10.091 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:13:10.091 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:13:10.091 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:13:10.091 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:13:10.091 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:13:10.091 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:13:10.091 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:13:10.091 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:13:10.091 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:13:10.091 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:13:10.092 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:13:10.092 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:13:10.092 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:13:10.092 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:13:10.092 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:13:10.092 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:13:10.092 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:13:10.092 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:13:10.092 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:13:10.092 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:13:10.092 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:13:10.092 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:13:10.092 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:13:10.092 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:13:10.092 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:13:10.092 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:13:10.092 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:13:10.093 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.093 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:13:10.093 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.093 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:13:10.093 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.093 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:13:10.093 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:13:10.093 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.093 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.093 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.093 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.093 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:13:10.093 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.093 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.093 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.093 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.093 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:13:10.094 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.094 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.094 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.094 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.094 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:13:10.094 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:13:10.094 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.094 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.094 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:13:10.094 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.094 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.094 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.094 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:13:10.094 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:13:10.094 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.094 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.094 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.095 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.095 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:13:10.095 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.095 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.095 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.095 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.095 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:13:10.095 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.095 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.095 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.095 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.095 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:13:10.095 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:13:10.095 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.095 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.095 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:13:10.095 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.095 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.095 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.096 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:13:10.096 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:13:10.096 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.096 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.096 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.096 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.096 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:13:10.096 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.096 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.096 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.096 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.096 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:13:10.096 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.096 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.096 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.096 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.096 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:13:10.096 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:13:10.096 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.097 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.097 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:13:10.097 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.097 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.097 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.097 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:13:10.097 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:13:10.097 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.097 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.097 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.097 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.097 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:13:10.097 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.097 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.097 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.097 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.097 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:13:10.097 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.097 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.097 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.098 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.098 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:13:10.098 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:13:10.098 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.098 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.098 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:13:10.098 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.098 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.098 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.098 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:13:10.098 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:13:10.098 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.098 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.098 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.098 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.098 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:13:10.098 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.098 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.098 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.098 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.099 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:13:10.099 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.099 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.099 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.099 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.099 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:13:10.099 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:13:10.099 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.099 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.099 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:13:10.099 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.099 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.099 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.099 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:13:10.099 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:13:10.099 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.099 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.099 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.099 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.099 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:13:10.100 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.100 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.100 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.100 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.100 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:13:10.100 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.100 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.100 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.100 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.100 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:13:10.100 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:13:10.100 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.100 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.100 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:13:10.100 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.100 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.100 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.100 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:13:10.100 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:13:10.100 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.100 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.100 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.100 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.101 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:13:10.101 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.101 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.101 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.101 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.101 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:13:10.101 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.101 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.101 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.101 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.101 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:13:10.101 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:13:10.101 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.101 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.101 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:13:10.101 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.101 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.101 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.101 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:13:10.101 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:13:10.101 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.101 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.102 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.102 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.102 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:13:10.102 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.102 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.102 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.102 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.102 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:13:10.102 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.102 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.102 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.102 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.102 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:13:10.102 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:13:10.102 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.102 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.102 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:13:10.102 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.102 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.102 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.102 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:13:10.102 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:13:10.103 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.103 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.103 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.103 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.103 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:13:10.103 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.103 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.103 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.103 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.103 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:13:10.103 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.103 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.103 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.103 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.103 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:13:10.103 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:13:10.103 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.103 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.103 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:13:10.103 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.103 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.103 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.104 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.104 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:13:10.104 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:13:10.104 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.104 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:13:10.104 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:13:10.104 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:13:10.104 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.104 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.104 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:13:10.104 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.104 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:13:10.104 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:13:10.104 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:13:10.104 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.104 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.104 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:13:10.104 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.104 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:13:10.104 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:13:10.104 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:13:10.104 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.105 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.105 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.105 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:13:10.105 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:13:10.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.066+0000 7f49a7a1b640 1 -- 10.20.193.48:0/3130791658 >> v2:10.20.193.111:6812/977811348 conn(0x7f497003f7c0 msgr2=0x7f497005fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.066+0000 7f49a7a1b640 1 --2- 10.20.193.48:0/3130791658 >> v2:10.20.193.111:6812/977811348 conn(0x7f497003f7c0 0x7f497005fc70 secure :-1 s=READY pgs=352 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f499c005980 tx=0x7f499c00a040 comp rx=0 tx=0).stop 2026-02-12T18:13:10.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.066+0000 7f49a7a1b640 10 monclient: shutdown 2026-02-12T18:13:10.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.066+0000 7f49a7a1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:13:10.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.066+0000 7f49a7a1b640 1 -- 10.20.193.48:0/3130791658 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f49a005e490 msgr2=0x7f49a008d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.066+0000 7f49a7a1b640 1 --2- 10.20.193.48:0/3130791658 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f49a005e490 0x7f49a008d3a0 secure :-1 s=READY pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f499402f260 tx=0x7f49940047e0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.066+0000 7f49a5f91640 1 -- 10.20.193.48:0/3130791658 reap_dead start 2026-02-12T18:13:10.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.066+0000 7f49a7a1b640 1 -- 10.20.193.48:0/3130791658 shutdown_connections 2026-02-12T18:13:10.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.066+0000 7f49a7a1b640 1 --2- 10.20.193.48:0/3130791658 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f49a005e490 0x7f49a008d3a0 unknown :-1 s=CLOSED pgs=60 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.066+0000 7f49a7a1b640 1 -- 10.20.193.48:0/3130791658 >> 10.20.193.48:0/3130791658 conn(0x7f49a00548a0 msgr2=0x7f49a0093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:13:10.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.066+0000 7f49a7a1b640 1 -- 10.20.193.48:0/3130791658 shutdown_connections 2026-02-12T18:13:10.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.066+0000 7f49a7a1b640 1 -- 10.20.193.48:0/3130791658 wait complete. 2026-02-12T18:13:10.106 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2026-02-12T18:13:10.107 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon b 2026-02-12T18:13:10.107 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T18:13:10.174 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb438647640 10 monclient: get_monmap_and_config 2026-02-12T18:13:10.174 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb438647640 10 monclient: build_initial_monmap 2026-02-12T18:13:10.174 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb438647640 10 monclient: monmap: 2026-02-12T18:13:10.174 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:13:10.174 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.174 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:13:10.174090+0000 2026-02-12T18:13:10.174 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:13:10.174090+0000 2026-02-12T18:13:10.174 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:13:10.174 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.174 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:13:10.174 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:13:10.174 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:13:10.174 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:13:10.175 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:13:10.175 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:13:10.175 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:13:10.175 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:13:10.175 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:13:10.175 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:13:10.175 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:13:10.175 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.176 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb438647640 1 Processor -- start 2026-02-12T18:13:10.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb438647640 1 -- start start 2026-02-12T18:13:10.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb438647640 10 monclient: init 2026-02-12T18:13:10.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb438647640 10 monclient: _reopen_session rank -1 2026-02-12T18:13:10.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb438647640 10 monclient: _add_conns ranks=[7,10,1,2,8,3,5,6,9,0,4] 2026-02-12T18:13:10.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb438647640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb43005d550 0x7fb43005d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb438647640 10 monclient(hunting): picked mon.noname-i con 0x7fb43005d550 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:13:10.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb438647640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7fb43005de60 0x7fb430141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb438647640 10 monclient(hunting): picked mon.noname-f con 0x7fb43005de60 addr v2:10.20.193.111:3300/0 2026-02-12T18:13:10.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb438647640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fb43013ef60 addr v1:10.20.193.111:6789/0 2026-02-12T18:13:10.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb438647640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb43004dc20 con 0x7fb43013ef60 2026-02-12T18:13:10.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb438647640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb438647640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7fb43008d390 con 0x7fb43005de60 2026-02-12T18:13:10.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb438647640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb438647640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fb43008d5a0 con 0x7fb43005d550 2026-02-12T18:13:10.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb438647640 10 monclient(hunting): _renew_subs 2026-02-12T18:13:10.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb438647640 10 monclient(hunting): authenticate will time out at 1028.899771s 2026-02-12T18:13:10.177 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb435bbb640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7fb43005de60 0x7fb430141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.178 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb4363bc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb43005d550 0x7fb43005d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.178 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb436bbd640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7fb43013ef60 0x7fb4301424e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.48:37712/0 (socket says 10.20.193.48:37712) 2026-02-12T18:13:10.178 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb435bbb640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7fb43005de60 0x7fb430141fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3300/0 says I am v2:10.20.193.48:58708/0 (socket says 10.20.193.48:58708) 2026-02-12T18:13:10.178 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb436bbd640 1 -- 10.20.193.48:0/686410060 learned_addr learned my addr 10.20.193.48:0/686410060 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:13:10.178 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb4363bc640 10 monclient(hunting): get_auth_request con 0x7fb43005d550 auth_method 0 2026-02-12T18:13:10.178 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb4363bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.178 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb4363bc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.178 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb4363bc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.178 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.174+0000 7fb435bbb640 10 monclient(hunting): get_auth_request con 0x7fb43005de60 auth_method 0 2026-02-12T18:13:10.178 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.175+0000 7fb435bbb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.178 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.175+0000 7fb435bbb640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.178 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.175+0000 7fb435bbb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.178 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.175+0000 7fb4363bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.178 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.175+0000 7fb4363bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.178 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.175+0000 7fb4363bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.178 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.175+0000 7fb435bbb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.178 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.175+0000 7fb435bbb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.178 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.175+0000 7fb435bbb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.175+0000 7fb435bbb640 10 monclient(hunting): handle_auth_done global_id 94330 payload 274 2026-02-12T18:13:10.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.175+0000 7fb435bbb640 1 -- 10.20.193.48:0/686410060 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb43005d550 msgr2=0x7fb43005d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:13:10.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.175+0000 7fb435bbb640 1 --2- 10.20.193.48:0/686410060 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb43005d550 0x7fb43005d920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.175+0000 7fb435bbb640 1 -- 10.20.193.48:0/686410060 >> v1:10.20.193.111:6789/0 conn(0x7fb43013ef60 legacy=0x7fb4301424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:13:10.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.175+0000 7fb435bbb640 10 monclient: _finish_hunting 0 2026-02-12T18:13:10.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.175+0000 7fb435bbb640 1 monclient: found mon.noname-f 2026-02-12T18:13:10.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.175+0000 7fb435bbb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:13:10.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.175+0000 7fb435bbb640 10 monclient: _send_mon_message to mon.noname-f at v2:10.20.193.111:3300/0 2026-02-12T18:13:10.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.175+0000 7fb435bbb640 1 -- 10.20.193.48:0/686410060 --> v2:10.20.193.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4300580e0 con 0x7fb43005de60 2026-02-12T18:13:10.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.175+0000 7fb4363bc640 1 --2- 10.20.193.48:0/686410060 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb43005d550 0x7fb43005d920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:13:10.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.177+0000 7fb435bbb640 1 -- 10.20.193.48:0/686410060 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb43005de60 msgr2=0x7fb430141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:10.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.177+0000 7fb435bbb640 1 --2- 10.20.193.48:0/686410060 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb43005de60 0x7fb430141fa0 secure :-1 s=READY pgs=60 gs=3 cs=0 l=1 c_cookie=4575982120426269313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb424004740 tx=0x7fb42402ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f81277e728bea81 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb4353ba640 1 -- 10.20.193.48:0/686410060 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb42402fe70 con 0x7fb43005de60 2026-02-12T18:13:10.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb4353ba640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb4353ba640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2026-02-12T18:13:10.184 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb4353ba640 10 monclient: dump: 2026-02-12T18:13:10.184 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.184 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.184 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.184 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.184 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.184 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.184 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.184 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.185 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.185 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.185 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.185 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.185 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.185 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.185 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.185 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb4353ba640 10 monclient: _finish_auth 0 2026-02-12T18:13:10.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb4353ba640 10 monclient: _check_auth_tickets 2026-02-12T18:13:10.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb4353ba640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:13:10.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb4353ba640 1 -- 10.20.193.48:0/686410060 <== mon.1 v2:10.20.193.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb424035340 con 0x7fb43005de60 2026-02-12T18:13:10.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb438647640 5 monclient: authenticate success, global_id 94330 2026-02-12T18:13:10.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb438647640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:13:10.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb4353ba640 10 monclient: handle_config config(0 keys) 2026-02-12T18:13:10.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb4353ba640 1 -- 10.20.193.48:0/686410060 <== mon.1 v2:10.20.193.111:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb424035970 con 0x7fb43005de60 2026-02-12T18:13:10.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb438647640 10 monclient: get_monmap_and_config success 2026-02-12T18:13:10.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb438647640 4 set_mon_vals no callback set 2026-02-12T18:13:10.185 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb4353ba640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.186 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb4353ba640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:13:10.186 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb4353ba640 10 monclient: dump: 2026-02-12T18:13:10.186 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.186 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.186 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.186 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.186 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.186 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.186 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.186 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.186 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.186 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.186 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.186 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.186 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.186 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.186 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.186 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb438647640 10 monclient: shutdown 2026-02-12T18:13:10.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb438647640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:13:10.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb438647640 1 -- 10.20.193.48:0/686410060 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb43005de60 msgr2=0x7fb430141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb438647640 1 --2- 10.20.193.48:0/686410060 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb43005de60 0x7fb430141fa0 secure :-1 s=READY pgs=60 gs=3 cs=0 l=1 c_cookie=4575982120426269313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb424004740 tx=0x7fb42402ed30 comp rx=0 tx=0).stop 2026-02-12T18:13:10.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb438647640 1 -- 10.20.193.48:0/686410060 shutdown_connections 2026-02-12T18:13:10.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb438647640 1 --2- 10.20.193.48:0/686410060 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb43005de60 0x7fb430141fa0 unknown :-1 s=CLOSED pgs=60 gs=3 cs=0 l=1 c_cookie=4575982120426269313 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb438647640 1 --2- 10.20.193.48:0/686410060 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb43005d550 0x7fb43005d920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb438647640 1 -- 10.20.193.48:0/686410060 >> 10.20.193.48:0/686410060 conn(0x7fb4300546a0 msgr2=0x7fb430054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:13:10.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb438647640 1 -- 10.20.193.48:0/686410060 shutdown_connections 2026-02-12T18:13:10.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb438647640 1 -- 10.20.193.48:0/686410060 wait complete. 2026-02-12T18:13:10.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb438647640 10 monclient: build_initial_monmap 2026-02-12T18:13:10.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.178+0000 7fb438647640 10 monclient: monmap: 2026-02-12T18:13:10.187 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:13:10.187 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:13:10.187 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:13:10.187 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:13:10.187 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:13:10.187 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.188 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:13:10.188 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:13:10.188 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:13:10.188 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:13:10.188 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:13:10.188 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:13:10.188 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:13:10.188 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:13:10.188 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:13:10.188 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb438647640 1 Processor -- start 2026-02-12T18:13:10.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb438647640 1 -- start start 2026-02-12T18:13:10.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb438647640 10 monclient: init 2026-02-12T18:13:10.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb438647640 10 monclient: _reopen_session rank -1 2026-02-12T18:13:10.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb438647640 10 monclient: _add_conns ranks=[8,0,4,3,6,5,7,1,2] 2026-02-12T18:13:10.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb438647640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb43005d550 0x7fb430131be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb438647640 10 monclient(hunting): picked mon.noname-e con 0x7fb43005d550 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:13:10.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb438647640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb43005de60 0x7fb43008a680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb438647640 10 monclient(hunting): picked mon.noname-a con 0x7fb43005de60 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:13:10.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb438647640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb43013ef60 0x7fb43008abc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb438647640 10 monclient(hunting): picked mon.noname-c con 0x7fb43013ef60 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:13:10.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb438647640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb438647640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fb43010f240 con 0x7fb43005de60 2026-02-12T18:13:10.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb438647640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb438647640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fb430132120 con 0x7fb43013ef60 2026-02-12T18:13:10.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb438647640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb438647640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fb43013dd40 con 0x7fb43005d550 2026-02-12T18:13:10.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb438647640 10 monclient(hunting): _renew_subs 2026-02-12T18:13:10.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb438647640 10 monclient(hunting): authenticate will time out at 1028.904452s 2026-02-12T18:13:10.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb4363bc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb43005d550 0x7fb430131be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb435bbb640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb43005de60 0x7fb43008a680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb436bbd640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb43013ef60 0x7fb43008abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb435bbb640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb43005de60 0x7fb43008a680 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:38764/0 (socket says 10.20.193.48:38764) 2026-02-12T18:13:10.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb436bbd640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb43013ef60 0x7fb43008abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:52472/0 (socket says 10.20.193.48:52472) 2026-02-12T18:13:10.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb435bbb640 1 -- 10.20.193.48:0/3038820040 learned_addr learned my addr 10.20.193.48:0/3038820040 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:13:10.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb435bbb640 10 monclient(hunting): get_auth_request con 0x7fb43005de60 auth_method 0 2026-02-12T18:13:10.189 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb435bbb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb435bbb640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb435bbb640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb4363bc640 10 monclient(hunting): get_auth_request con 0x7fb43005d550 auth_method 0 2026-02-12T18:13:10.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb4363bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb4363bc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb4363bc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb436bbd640 10 monclient(hunting): get_auth_request con 0x7fb43013ef60 auth_method 0 2026-02-12T18:13:10.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb436bbd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb436bbd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb436bbd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb435bbb640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb435bbb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb435bbb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb436bbd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb436bbd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb436bbd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb4363bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.190 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb4363bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb4363bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb436bbd640 10 monclient(hunting): handle_auth_done global_id 64534 payload 824 2026-02-12T18:13:10.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb436bbd640 1 -- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb43005d550 msgr2=0x7fb430131be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb436bbd640 1 --2- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb43005d550 0x7fb430131be0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb436bbd640 1 -- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb43005de60 msgr2=0x7fb43008a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb436bbd640 1 --2- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb43005de60 0x7fb43008a680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb436bbd640 10 monclient: _finish_hunting 0 2026-02-12T18:13:10.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb436bbd640 1 monclient: found mon.noname-c 2026-02-12T18:13:10.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb436bbd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:13:10.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb436bbd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:13:10.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb436bbd640 1 -- 10.20.193.48:0/3038820040 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb420009420 con 0x7fb43013ef60 2026-02-12T18:13:10.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.179+0000 7fb435bbb640 1 --2- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb43005de60 0x7fb43008a680 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:13:10.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.181+0000 7fb436bbd640 1 -- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb43013ef60 msgr2=0x7fb43008abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:10.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.181+0000 7fb436bbd640 1 --2- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb43013ef60 0x7fb43008abc0 secure :-1 s=READY pgs=132 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb42c00d440 tx=0x7fb42c00d910 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb416ffd640 1 -- 10.20.193.48:0/3038820040 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb42c006e90 con 0x7fb43013ef60 2026-02-12T18:13:10.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb416ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb416ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:13:10.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb416ffd640 10 monclient: dump: 2026-02-12T18:13:10.191 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.192 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.192 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.192 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.192 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.192 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.192 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.192 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.192 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.192 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.192 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.192 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.192 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.192 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.192 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.192 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb416ffd640 10 monclient: _finish_auth 0 2026-02-12T18:13:10.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb416ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:13:10.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb416ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:13:10.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb416ffd640 1 -- 10.20.193.48:0/3038820040 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb42c008530 con 0x7fb43013ef60 2026-02-12T18:13:10.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb416ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:13:10.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb416ffd640 1 -- 10.20.193.48:0/3038820040 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb42c0086a0 con 0x7fb43013ef60 2026-02-12T18:13:10.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb416ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb416ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:13:10.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb434bb9640 4 set_mon_vals no callback set 2026-02-12T18:13:10.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb416ffd640 10 monclient: dump: 2026-02-12T18:13:10.193 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.193 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.193 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.193 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.193 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.193 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.193 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.193 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.193 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.193 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.193 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.193 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.194 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.194 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.194 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.194 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb438647640 5 monclient: authenticate success, global_id 64534 2026-02-12T18:13:10.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb438647640 10 monclient: _renew_subs 2026-02-12T18:13:10.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb438647640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:13:10.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb438647640 1 -- 10.20.193.48:0/3038820040 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb424009420 con 0x7fb43013ef60 2026-02-12T18:13:10.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb438647640 10 monclient: _renew_subs 2026-02-12T18:13:10.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb438647640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:13:10.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb438647640 1 -- 10.20.193.48:0/3038820040 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fb43008be10 con 0x7fb43013ef60 2026-02-12T18:13:10.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb438647640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:13:10.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb438647640 1 --2- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb4301314b0 0x7fb43008b100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb438647640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb438647640 1 -- 10.20.193.48:0/3038820040 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fb43005f140 con 0x7fb4301314b0 2026-02-12T18:13:10.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb4363bc640 1 --2- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb4301314b0 0x7fb43008b100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb4363bc640 10 monclient: get_auth_request con 0x7fb4301314b0 auth_method 0 2026-02-12T18:13:10.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb4363bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb4363bc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb4363bc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb4363bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb4363bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb4363bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.182+0000 7fb416ffd640 1 -- 10.20.193.48:0/3038820040 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fb42c008070 con 0x7fb43013ef60 2026-02-12T18:13:10.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.183+0000 7fb4363bc640 10 monclient(hunting): handle_auth_done global_id 35975 payload 824 2026-02-12T18:13:10.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.183+0000 7fb4363bc640 1 -- 10.20.193.48:0/3038820040 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb43008d060 con 0x7fb4301314b0 2026-02-12T18:13:10.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.183+0000 7fb416ffd640 1 --2- 10.20.193.48:0/3038820040 >> v2:10.20.193.111:6812/977811348 conn(0x7fb40003f800 0x7fb40005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.183+0000 7fb416ffd640 1 -- 10.20.193.48:0/3038820040 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(223..223 src has 190..223) ==== 3503+0+0 (secure 0 0 0) 0x7fb42c052e90 con 0x7fb43013ef60 2026-02-12T18:13:10.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.183+0000 7fb435bbb640 1 --2- 10.20.193.48:0/3038820040 >> v2:10.20.193.111:6812/977811348 conn(0x7fb40003f800 0x7fb40005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.183+0000 7fb435bbb640 10 monclient: get_auth_request con 0x7fb40003f800 auth_method 0 2026-02-12T18:13:10.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.185+0000 7fb4363bc640 1 -- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb4301314b0 msgr2=0x7fb43008b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:10.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.185+0000 7fb4363bc640 1 --2- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb4301314b0 0x7fb43008b100 secure :-1 s=READY pgs=339 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb420011bd0 tx=0x7fb42000f610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.185+0000 7fb416ffd640 1 -- 10.20.193.48:0/3038820040 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb420011ee0 con 0x7fb4301314b0 2026-02-12T18:13:10.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.185+0000 7fb416ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.185+0000 7fb416ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:13:10.197 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.185+0000 7fb416ffd640 10 monclient: dump: 2026-02-12T18:13:10.197 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.197 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.197 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.197 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.197 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.197 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.197 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.197 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.198 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.198 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.198 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.198 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.198 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.198 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.198 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.198 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.185+0000 7fb416ffd640 1 -- 10.20.193.48:0/3038820040 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fb420004240 con 0x7fb4301314b0 2026-02-12T18:13:10.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.185+0000 7fb416ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:13:10.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.185+0000 7fb416ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:13:10.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.185+0000 7fb416ffd640 1 -- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb4301314b0 msgr2=0x7fb43008b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.185+0000 7fb416ffd640 1 --2- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb4301314b0 0x7fb43008b100 secure :-1 s=READY pgs=339 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb420011bd0 tx=0x7fb42000f610 comp rx=0 tx=0).stop 2026-02-12T18:13:10.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.185+0000 7fb416ffd640 1 -- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb4301314b0 msgr2=0x7fb43008b100 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:13:10.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.185+0000 7fb416ffd640 1 --2- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb4301314b0 0x7fb43008b100 secure :-1 s=CLOSED pgs=339 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb420011bd0 tx=0x7fb42000f610 comp rx=0 tx=0).stop 2026-02-12T18:13:10.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.185+0000 7fb435bbb640 1 --2- 10.20.193.48:0/3038820040 >> v2:10.20.193.111:6812/977811348 conn(0x7fb40003f800 0x7fb40005fcb0 secure :-1 s=READY pgs=353 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb42402ffa0 tx=0x7fb424009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.188+0000 7fb438647640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:13:10.198 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.188+0000 7fb438647640 1 --2- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb430091010 0x7fb430058b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.188+0000 7fb438647640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.188+0000 7fb438647640 1 -- 10.20.193.48:0/3038820040 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fb43005fd90 con 0x7fb430091010 2026-02-12T18:13:10.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.188+0000 7fb4363bc640 1 --2- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb430091010 0x7fb430058b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.188+0000 7fb4363bc640 10 monclient: get_auth_request con 0x7fb430091010 auth_method 0 2026-02-12T18:13:10.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.188+0000 7fb4363bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.188+0000 7fb4363bc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.188+0000 7fb4363bc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.189+0000 7fb4363bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.189+0000 7fb4363bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.189+0000 7fb4363bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.189+0000 7fb4363bc640 10 monclient(hunting): handle_auth_done global_id 35984 payload 824 2026-02-12T18:13:10.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.189+0000 7fb4363bc640 1 -- 10.20.193.48:0/3038820040 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb43005e310 con 0x7fb430091010 2026-02-12T18:13:10.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.189+0000 7fb4363bc640 1 -- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb430091010 msgr2=0x7fb430058b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-12T18:13:10.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.189+0000 7fb4363bc640 1 -- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb430091010 msgr2=0x7fb430058b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:13:10.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.189+0000 7fb4363bc640 1 --2- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb430091010 0x7fb430058b10 secure :-1 s=COMPRESSION_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb420010010 tx=0x7fb420004770 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:13:10.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.189+0000 7fb4363bc640 1 --2- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb430091010 0x7fb430058b10 unknown :-1 s=START_CONNECT pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:13:10.391 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.390+0000 7fb4363bc640 1 --2- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb430091010 0x7fb430058b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.391 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.390+0000 7fb4363bc640 10 monclient: get_auth_request con 0x7fb430091010 auth_method 0 2026-02-12T18:13:10.391 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.390+0000 7fb4363bc640 10 monclient: get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.391 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.390+0000 7fb4363bc640 10 monclient: _init_auth method 2 2026-02-12T18:13:10.392 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.390+0000 7fb4363bc640 10 monclient: _init_auth already have auth, reseting 2026-02-12T18:13:10.392 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.390+0000 7fb4363bc640 10 monclient: handle_auth_reply_more payload 9 2026-02-12T18:13:10.392 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.390+0000 7fb4363bc640 10 monclient: handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.392 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.390+0000 7fb4363bc640 10 monclient: handle_auth_reply_more responding with 132 bytes 2026-02-12T18:13:10.392 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.390+0000 7fb4363bc640 10 monclient: handle_auth_done global_id 35984 payload 293 2026-02-12T18:13:10.394 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.392+0000 7fb4363bc640 1 -- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb430091010 msgr2=0x7fb430058b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:10.394 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.392+0000 7fb4363bc640 1 --2- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb430091010 0x7fb430058b10 secure :-1 s=READY pgs=340 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb420010010 tx=0x7fb420008070 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.394 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.393+0000 7fb416ffd640 1 -- 10.20.193.48:0/3038820040 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb4200034f0 con 0x7fb430091010 2026-02-12T18:13:10.394 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.393+0000 7fb416ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.394 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.393+0000 7fb416ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:13:10.394 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.393+0000 7fb416ffd640 10 monclient: dump: 2026-02-12T18:13:10.394 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.394 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.394 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.394 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.395 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.395 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.395 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.395 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.395 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.395 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.395 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.395 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.395 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.395 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.395 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.395 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.396 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.393+0000 7fb416ffd640 1 -- 10.20.193.48:0/3038820040 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9982 (secure 0 0 0) 0x7fb420003030 con 0x7fb430091010 2026-02-12T18:13:10.396 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.393+0000 7fb416ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:13:10.396 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.393+0000 7fb416ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:13:10.396 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.393+0000 7fb416ffd640 1 -- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb430091010 msgr2=0x7fb430058b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.396 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.393+0000 7fb416ffd640 1 --2- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb430091010 0x7fb430058b10 secure :-1 s=READY pgs=340 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb420010010 tx=0x7fb420008070 comp rx=0 tx=0).stop 2026-02-12T18:13:10.396 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.393+0000 7fb416ffd640 1 -- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb430091010 msgr2=0x7fb430058b10 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:13:10.396 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.393+0000 7fb416ffd640 1 --2- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb430091010 0x7fb430058b10 secure :-1 s=CLOSED pgs=340 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb420010010 tx=0x7fb420008070 comp rx=0 tx=0).stop 2026-02-12T18:13:10.396 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:13:10.397 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:13:10.397 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:13:10.397 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:13:10.397 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 72, 2026-02-12T18:13:10.397 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 445226, 2026-02-12T18:13:10.397 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:13:10.397 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:13:10.397 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:13:10.397 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:13:10.397 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:13:10.398 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:13:10.398 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:13:10.398 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.398 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 1, 2026-02-12T18:13:10.398 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:13:10.398 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:13:10.398 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:13:10.398 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:13:10.398 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:13:10.398 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:13:10.398 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:13:10.398 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:13:10.399 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:13:10.399 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:13:10.399 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:13:10.399 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:13:10.399 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:13:10.399 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:13:10.399 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:13:10.399 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:13:10.399 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.399 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:13:10.399 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:13:10.399 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:13:10.400 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:13:10.400 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:13:10.400 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:13:10.400 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:13:10.400 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:13:10.400 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:13:10.400 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:13:10.400 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:13:10.400 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:13:10.400 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:13:10.400 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:13:10.400 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:13:10.400 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.401 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.401 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:13:10.401 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:13:10.401 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:13:10.401 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:13:10.401 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:13:10.401 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:13:10.401 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:13:10.401 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:13:10.401 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:13:10.401 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:13:10.401 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:13:10.402 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:13:10.402 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:13:10.402 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:13:10.402 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:13:10.402 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:13:10.402 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:13:10.402 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:13:10.402 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:13:10.402 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:13:10.402 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:13:10.402 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:13:10.402 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:13:10.403 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:13:10.403 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:13:10.403 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:13:10.403 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:13:10.403 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:13:10.403 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:13:10.403 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:13:10.403 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.403 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:13:10.403 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.403 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:13:10.403 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.404 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:13:10.404 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:13:10.404 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.404 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.404 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.404 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.404 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:13:10.404 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.404 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.404 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.404 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.404 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:13:10.405 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.405 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.405 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.405 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.405 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:13:10.405 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:13:10.405 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.405 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.405 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:13:10.405 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.405 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.405 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.406 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:13:10.406 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:13:10.406 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.406 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.406 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.406 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.406 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:13:10.406 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.406 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.406 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.406 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.406 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:13:10.407 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.407 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.407 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.407 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.407 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:13:10.407 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:13:10.407 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.407 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.407 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:13:10.407 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.407 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.407 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.408 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:13:10.408 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:13:10.408 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.408 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.408 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.408 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.408 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:13:10.408 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.408 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.408 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.408 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.408 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:13:10.408 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.409 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.409 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.409 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.409 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:13:10.409 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:13:10.409 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.409 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.409 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:13:10.409 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.409 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.409 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.409 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:13:10.410 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:13:10.410 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.410 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.410 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.410 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.410 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:13:10.410 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.410 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.410 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.410 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.410 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:13:10.410 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.411 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.411 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.411 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.411 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:13:10.411 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:13:10.411 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.411 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.411 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:13:10.411 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.411 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.411 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.411 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:13:10.412 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:13:10.412 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.412 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.412 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.412 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.412 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:13:10.412 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.412 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.412 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.412 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.412 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:13:10.412 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.413 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.413 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.413 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.413 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:13:10.413 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:13:10.413 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.413 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.413 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:13:10.413 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.413 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.413 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.413 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:13:10.413 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:13:10.414 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.414 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.414 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.414 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.414 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:13:10.414 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.414 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.414 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.414 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.414 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:13:10.414 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.414 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.415 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.415 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.415 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:13:10.415 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:13:10.415 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.415 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.415 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:13:10.415 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.415 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.415 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.415 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:13:10.415 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:13:10.415 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.416 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.416 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.416 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.416 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:13:10.416 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.416 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.416 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.416 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.416 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:13:10.416 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.416 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.416 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.417 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.417 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:13:10.417 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:13:10.417 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.417 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.417 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:13:10.417 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.417 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.417 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.417 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:13:10.417 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:13:10.417 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.417 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.418 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.418 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.418 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:13:10.418 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.418 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.418 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.418 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.418 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:13:10.418 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.418 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.418 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.418 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.419 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:13:10.419 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:13:10.419 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.419 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.419 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:13:10.419 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.419 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.419 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.419 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:13:10.419 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:13:10.419 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.419 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.420 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.420 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.420 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:13:10.420 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.420 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.420 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.420 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.420 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:13:10.420 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.420 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.420 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.420 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.420 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:13:10.421 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:13:10.421 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.421 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.421 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:13:10.421 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.421 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.421 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.421 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.421 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:13:10.421 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:13:10.421 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.421 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:13:10.422 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:13:10.422 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:13:10.422 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.422 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.422 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:13:10.422 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.422 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:13:10.422 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:13:10.422 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:13:10.422 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.422 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.422 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.422 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:13:10.423 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:13:10.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.393+0000 7fb438647640 1 -- 10.20.193.48:0/3038820040 >> v2:10.20.193.111:6812/977811348 conn(0x7fb40003f800 msgr2=0x7fb40005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.393+0000 7fb438647640 1 --2- 10.20.193.48:0/3038820040 >> v2:10.20.193.111:6812/977811348 conn(0x7fb40003f800 0x7fb40005fcb0 secure :-1 s=READY pgs=353 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb42402ffa0 tx=0x7fb424009040 comp rx=0 tx=0).stop 2026-02-12T18:13:10.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.393+0000 7fb438647640 10 monclient: shutdown 2026-02-12T18:13:10.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.393+0000 7fb438647640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:13:10.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.393+0000 7fb438647640 1 -- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb43013ef60 msgr2=0x7fb43008abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.393+0000 7fb438647640 1 --2- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb43013ef60 0x7fb43008abc0 secure :-1 s=READY pgs=132 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb42c00d440 tx=0x7fb42c00d910 comp rx=0 tx=0).stop 2026-02-12T18:13:10.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.393+0000 7fb436bbd640 1 -- 10.20.193.48:0/3038820040 reap_dead start 2026-02-12T18:13:10.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.393+0000 7fb438647640 1 -- 10.20.193.48:0/3038820040 shutdown_connections 2026-02-12T18:13:10.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.393+0000 7fb438647640 1 --2- 10.20.193.48:0/3038820040 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb43013ef60 0x7fb43008abc0 unknown :-1 s=CLOSED pgs=132 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.393+0000 7fb438647640 1 -- 10.20.193.48:0/3038820040 >> 10.20.193.48:0/3038820040 conn(0x7fb4300546a0 msgr2=0x7fb43013d190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:13:10.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.393+0000 7fb438647640 1 -- 10.20.193.48:0/3038820040 shutdown_connections 2026-02-12T18:13:10.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.393+0000 7fb438647640 1 -- 10.20.193.48:0/3038820040 wait complete. 2026-02-12T18:13:10.426 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2026-02-12T18:13:10.426 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon c 2026-02-12T18:13:10.426 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T18:13:10.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.493+0000 7f478b90c640 10 monclient: get_monmap_and_config 2026-02-12T18:13:10.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.493+0000 7f478b90c640 10 monclient: build_initial_monmap 2026-02-12T18:13:10.494 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.493+0000 7f478b90c640 10 monclient: monmap: 2026-02-12T18:13:10.494 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:13:10.495 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.495 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:13:10.494012+0000 2026-02-12T18:13:10.495 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:13:10.494012+0000 2026-02-12T18:13:10.495 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:13:10.495 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.495 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:13:10.495 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:13:10.495 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:13:10.495 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:13:10.495 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:13:10.495 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:13:10.495 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:13:10.496 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:13:10.496 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:13:10.496 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:13:10.496 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:13:10.496 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f478b90c640 1 Processor -- start 2026-02-12T18:13:10.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f478b90c640 1 -- start start 2026-02-12T18:13:10.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f478b90c640 10 monclient: init 2026-02-12T18:13:10.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f478b90c640 10 monclient: _reopen_session rank -1 2026-02-12T18:13:10.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f478b90c640 10 monclient: _add_conns ranks=[9,4,0,10,8,2,7,3,1,6,5] 2026-02-12T18:13:10.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f478b90c640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f478405d550 0x7f478405d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f478b90c640 10 monclient(hunting): picked mon.noname-a con 0x7f478405d550 addr v2:10.20.193.48:3300/0 2026-02-12T18:13:10.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f478b90c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f478405de60 0x7f4784141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f478b90c640 10 monclient(hunting): picked mon.noname-c con 0x7f478405de60 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:13:10.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f478b90c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f478413ef60 addr v1:10.20.193.48:6789/0 2026-02-12T18:13:10.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f478b90c640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f478404dc20 con 0x7f478413ef60 2026-02-12T18:13:10.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f478b90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f478b90c640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f478408d390 con 0x7f478405d550 2026-02-12T18:13:10.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f478b90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f478b90c640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f478408d5a0 con 0x7f478405de60 2026-02-12T18:13:10.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f478b90c640 10 monclient(hunting): _renew_subs 2026-02-12T18:13:10.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f478b90c640 10 monclient(hunting): authenticate will time out at 1029.219759s 2026-02-12T18:13:10.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f4789681640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f478405d550 0x7f478405d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f4789681640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f478405d550 0x7f478405d920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:38774/0 (socket says 10.20.193.48:38774) 2026-02-12T18:13:10.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f4789e82640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f478413ef60 0x7f47841424e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:54350/0 (socket says 10.20.193.48:54350) 2026-02-12T18:13:10.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f4789681640 1 -- 10.20.193.48:0/1318046740 learned_addr learned my addr 10.20.193.48:0/1318046740 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:13:10.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f4789681640 10 monclient(hunting): get_auth_request con 0x7f478405d550 auth_method 0 2026-02-12T18:13:10.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f4789681640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f4789681640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f4789681640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f4788e80640 1 --2- 10.20.193.48:0/1318046740 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f478405de60 0x7f4784141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f4788e80640 10 monclient(hunting): get_auth_request con 0x7f478405de60 auth_method 0 2026-02-12T18:13:10.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f4788e80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f4788e80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f4788e80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f4789681640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f4789681640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.494+0000 7f4789681640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.495+0000 7f4788e80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.495+0000 7f4788e80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.495+0000 7f4788e80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.495+0000 7f4789681640 10 monclient(hunting): handle_auth_done global_id 6318 payload 274 2026-02-12T18:13:10.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.495+0000 7f4789681640 1 -- 10.20.193.48:0/1318046740 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f478405de60 msgr2=0x7f4784141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:13:10.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.495+0000 7f4789681640 1 --2- 10.20.193.48:0/1318046740 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f478405de60 0x7f4784141fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.495+0000 7f4789681640 1 -- 10.20.193.48:0/1318046740 >> v1:10.20.193.48:6789/0 conn(0x7f478413ef60 legacy=0x7f47841424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:13:10.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.495+0000 7f4789681640 10 monclient: _finish_hunting 0 2026-02-12T18:13:10.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.495+0000 7f4789681640 1 monclient: found mon.noname-a 2026-02-12T18:13:10.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.495+0000 7f4789681640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:13:10.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.495+0000 7f4789681640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:13:10.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.495+0000 7f4789681640 1 -- 10.20.193.48:0/1318046740 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47840580e0 con 0x7f478405d550 2026-02-12T18:13:10.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.497+0000 7f4789681640 1 -- 10.20.193.48:0/1318046740 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f478405d550 msgr2=0x7f478405d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:10.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.497+0000 7f4789681640 1 --2- 10.20.193.48:0/1318046740 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f478405d550 0x7f478405d920 secure :-1 s=READY pgs=513 gs=2 cs=0 l=1 c_cookie=416397262641562813 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4774009060 tx=0x7f477402edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c7571aad3204bd server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.497+0000 7f4773fff640 1 -- 10.20.193.48:0/1318046740 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4774035340 con 0x7f478405d550 2026-02-12T18:13:10.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.497+0000 7f4773fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.497+0000 7f4773fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:13:10.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.497+0000 7f4773fff640 10 monclient: dump: 2026-02-12T18:13:10.509 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.509 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.509 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.509 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.509 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.510 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.510 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.510 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.510 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.510 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.510 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.510 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.510 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.510 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.510 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.510 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.497+0000 7f4773fff640 10 monclient: _finish_auth 0 2026-02-12T18:13:10.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.497+0000 7f4773fff640 10 monclient: _check_auth_tickets 2026-02-12T18:13:10.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.497+0000 7f4773fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:13:10.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.497+0000 7f4773fff640 1 -- 10.20.193.48:0/1318046740 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47740354c0 con 0x7f478405d550 2026-02-12T18:13:10.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.497+0000 7f478b90c640 5 monclient: authenticate success, global_id 6318 2026-02-12T18:13:10.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.497+0000 7f478b90c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:13:10.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.497+0000 7f4773fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:13:10.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.497+0000 7f4773fff640 1 -- 10.20.193.48:0/1318046740 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4774035af0 con 0x7f478405d550 2026-02-12T18:13:10.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.497+0000 7f478b90c640 10 monclient: get_monmap_and_config success 2026-02-12T18:13:10.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.497+0000 7f478b90c640 4 set_mon_vals no callback set 2026-02-12T18:13:10.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.497+0000 7f4773fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.497+0000 7f4773fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:13:10.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.497+0000 7f4773fff640 10 monclient: dump: 2026-02-12T18:13:10.511 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.512 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.512 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.512 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.512 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.512 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.512 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.512 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.512 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.512 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.512 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.512 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.512 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.512 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.513 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.513 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.498+0000 7f478b90c640 10 monclient: shutdown 2026-02-12T18:13:10.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.498+0000 7f478b90c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:13:10.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.498+0000 7f478b90c640 1 -- 10.20.193.48:0/1318046740 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f478405d550 msgr2=0x7f478405d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.498+0000 7f478b90c640 1 --2- 10.20.193.48:0/1318046740 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f478405d550 0x7f478405d920 secure :-1 s=READY pgs=513 gs=2 cs=0 l=1 c_cookie=416397262641562813 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4774009060 tx=0x7f477402edf0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.498+0000 7f478b90c640 1 -- 10.20.193.48:0/1318046740 shutdown_connections 2026-02-12T18:13:10.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.498+0000 7f478b90c640 1 --2- 10.20.193.48:0/1318046740 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f478405de60 0x7f4784141fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.498+0000 7f478b90c640 1 --2- 10.20.193.48:0/1318046740 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f478405d550 0x7f478405d920 unknown :-1 s=CLOSED pgs=513 gs=2 cs=0 l=1 c_cookie=416397262641562813 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.498+0000 7f478b90c640 1 -- 10.20.193.48:0/1318046740 >> 10.20.193.48:0/1318046740 conn(0x7f47840546a0 msgr2=0x7f4784054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:13:10.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.498+0000 7f478b90c640 1 -- 10.20.193.48:0/1318046740 shutdown_connections 2026-02-12T18:13:10.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.498+0000 7f478b90c640 1 -- 10.20.193.48:0/1318046740 wait complete. 2026-02-12T18:13:10.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.498+0000 7f478b90c640 10 monclient: build_initial_monmap 2026-02-12T18:13:10.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.498+0000 7f478b90c640 10 monclient: monmap: 2026-02-12T18:13:10.514 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:13:10.514 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:13:10.514 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:13:10.514 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:13:10.514 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:13:10.514 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.514 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:13:10.514 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:13:10.514 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:13:10.514 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:13:10.515 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:13:10.515 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:13:10.515 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:13:10.515 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:13:10.515 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:13:10.515 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.498+0000 7f478b90c640 1 Processor -- start 2026-02-12T18:13:10.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f478b90c640 1 -- start start 2026-02-12T18:13:10.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f478b90c640 10 monclient: init 2026-02-12T18:13:10.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f478b90c640 10 monclient: _reopen_session rank -1 2026-02-12T18:13:10.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f478b90c640 10 monclient: _add_conns ranks=[0,2,7,8,6,4,1,3,5] 2026-02-12T18:13:10.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f478b90c640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f478405d550 0x7f4784131580 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f478b90c640 10 monclient(hunting): picked mon.noname-a con 0x7f478405d550 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:13:10.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f478b90c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f478405de60 0x7f4784131d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f478b90c640 10 monclient(hunting): picked mon.noname-b con 0x7f478405de60 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:13:10.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f478b90c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f478413ef60 0x7f478408a680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f478b90c640 10 monclient(hunting): picked mon.noname-i con 0x7f478413ef60 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:13:10.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f478b90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f478b90c640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f4784132250 con 0x7f478405d550 2026-02-12T18:13:10.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f478b90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f478b90c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f478413dcb0 con 0x7f478405de60 2026-02-12T18:13:10.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f478b90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f478b90c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f4784120500 con 0x7f478413ef60 2026-02-12T18:13:10.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f478b90c640 10 monclient(hunting): _renew_subs 2026-02-12T18:13:10.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f478b90c640 10 monclient(hunting): authenticate will time out at 1029.224312s 2026-02-12T18:13:10.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4789681640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f478405d550 0x7f4784131580 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4789681640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f478405d550 0x7f4784131580 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:38780/0 (socket says 10.20.193.48:38780) 2026-02-12T18:13:10.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4789681640 1 -- 10.20.193.48:0/2409999157 learned_addr learned my addr 10.20.193.48:0/2409999157 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:13:10.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4789681640 10 monclient(hunting): get_auth_request con 0x7f478405d550 auth_method 0 2026-02-12T18:13:10.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4789681640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4789681640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4789681640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4789681640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4789681640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4789681640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4788e80640 1 --2- 10.20.193.48:0/2409999157 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f478405de60 0x7f4784131d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4788e80640 10 monclient(hunting): get_auth_request con 0x7f478405de60 auth_method 0 2026-02-12T18:13:10.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4788e80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4788e80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4788e80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4788e80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4788e80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4788e80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4789e82640 1 --2- 10.20.193.48:0/2409999157 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f478413ef60 0x7f478408a680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4789681640 10 monclient(hunting): handle_auth_done global_id 6327 payload 824 2026-02-12T18:13:10.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4789681640 1 -- 10.20.193.48:0/2409999157 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f478413ef60 msgr2=0x7f478408a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4789681640 1 --2- 10.20.193.48:0/2409999157 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f478413ef60 0x7f478408a680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4789681640 1 -- 10.20.193.48:0/2409999157 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f478405de60 msgr2=0x7f4784131d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4789681640 1 --2- 10.20.193.48:0/2409999157 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f478405de60 0x7f4784131d10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4789681640 10 monclient: _finish_hunting 0 2026-02-12T18:13:10.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4789681640 1 monclient: found mon.noname-a 2026-02-12T18:13:10.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4789681640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:13:10.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4789681640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:13:10.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4789681640 1 -- 10.20.193.48:0/2409999157 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47740094f0 con 0x7f478405d550 2026-02-12T18:13:10.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4789e82640 10 monclient: get_auth_request con 0x7f478413ef60 auth_method 0 2026-02-12T18:13:10.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.499+0000 7f4789e82640 1 --2- 10.20.193.48:0/2409999157 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f478413ef60 0x7f478408a680 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-12T18:13:10.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.501+0000 7f4789681640 1 -- 10.20.193.48:0/2409999157 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f478405d550 msgr2=0x7f4784131580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:10.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.501+0000 7f4789681640 1 --2- 10.20.193.48:0/2409999157 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f478405d550 0x7f4784131580 secure :-1 s=READY pgs=514 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47740099a0 tx=0x7f4774004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.501+0000 7f4771ffb640 1 -- 10.20.193.48:0/2409999157 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4774035e30 con 0x7f478405d550 2026-02-12T18:13:10.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.501+0000 7f4771ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.501+0000 7f4771ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:13:10.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.501+0000 7f4771ffb640 10 monclient: dump: 2026-02-12T18:13:10.520 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.520 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.520 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.520 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.520 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.520 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.520 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.520 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.520 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.520 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.520 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.520 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.520 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.521 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.521 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.521 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.501+0000 7f4771ffb640 10 monclient: _finish_auth 0 2026-02-12T18:13:10.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.501+0000 7f4771ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:13:10.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.501+0000 7f4771ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:13:10.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.501+0000 7f4771ffb640 1 -- 10.20.193.48:0/2409999157 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47740044f0 con 0x7f478405d550 2026-02-12T18:13:10.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.501+0000 7f478b90c640 5 monclient: authenticate success, global_id 6327 2026-02-12T18:13:10.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.501+0000 7f478b90c640 10 monclient: _renew_subs 2026-02-12T18:13:10.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.501+0000 7f478b90c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:13:10.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.501+0000 7f478b90c640 1 -- 10.20.193.48:0/2409999157 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f478410ebd0 con 0x7f478405d550 2026-02-12T18:13:10.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.501+0000 7f4771ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:13:10.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.501+0000 7f4771ffb640 1 -- 10.20.193.48:0/2409999157 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4774003b90 con 0x7f478405d550 2026-02-12T18:13:10.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.501+0000 7f4771ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.501+0000 7f4771ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:13:10.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.501+0000 7f47737fe640 4 set_mon_vals no callback set 2026-02-12T18:13:10.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.501+0000 7f4771ffb640 10 monclient: dump: 2026-02-12T18:13:10.522 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.522 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.522 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.522 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.522 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.522 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.522 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.522 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.523 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.523 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.523 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.523 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.523 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.523 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.523 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.523 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.502+0000 7f478b90c640 10 monclient: _renew_subs 2026-02-12T18:13:10.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.502+0000 7f478b90c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:13:10.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.502+0000 7f478b90c640 1 -- 10.20.193.48:0/2409999157 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4784120840 con 0x7f478405d550 2026-02-12T18:13:10.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.502+0000 7f478b90c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:13:10.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.502+0000 7f478b90c640 1 --2- 10.20.193.48:0/2409999157 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4784091010 0x7f478408abc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.502+0000 7f478b90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.502+0000 7f478b90c640 1 -- 10.20.193.48:0/2409999157 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f47840631f0 con 0x7f4784091010 2026-02-12T18:13:10.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.502+0000 7f4788e80640 1 --2- 10.20.193.48:0/2409999157 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4784091010 0x7f478408abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.502+0000 7f4788e80640 10 monclient: get_auth_request con 0x7f4784091010 auth_method 0 2026-02-12T18:13:10.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.502+0000 7f4788e80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.502+0000 7f4788e80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.502+0000 7f4788e80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.502+0000 7f4788e80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.502+0000 7f4788e80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.502+0000 7f4788e80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.502+0000 7f4771ffb640 1 -- 10.20.193.48:0/2409999157 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f4774003cf0 con 0x7f478405d550 2026-02-12T18:13:10.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.502+0000 7f4788e80640 10 monclient(hunting): handle_auth_done global_id 64552 payload 824 2026-02-12T18:13:10.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.502+0000 7f4788e80640 1 -- 10.20.193.48:0/2409999157 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f478405e310 con 0x7f4784091010 2026-02-12T18:13:10.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.503+0000 7f4771ffb640 1 --2- 10.20.193.48:0/2409999157 >> v2:10.20.193.111:6812/977811348 conn(0x7f475403f800 0x7f475405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.503+0000 7f4771ffb640 1 -- 10.20.193.48:0/2409999157 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(223..223 src has 198..223) ==== 3503+0+0 (secure 0 0 0) 0x7f4774077cf0 con 0x7f478405d550 2026-02-12T18:13:10.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.503+0000 7f4789e82640 1 --2- 10.20.193.48:0/2409999157 >> v2:10.20.193.111:6812/977811348 conn(0x7f475403f800 0x7f475405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.503+0000 7f4789e82640 10 monclient: get_auth_request con 0x7f475403f800 auth_method 0 2026-02-12T18:13:10.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.505+0000 7f4788e80640 1 -- 10.20.193.48:0/2409999157 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4784091010 msgr2=0x7f478408abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:10.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.505+0000 7f4788e80640 1 --2- 10.20.193.48:0/2409999157 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4784091010 0x7f478408abc0 secure :-1 s=READY pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f478405c9e0 tx=0x7f4778011e40 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.505+0000 7f4771ffb640 1 -- 10.20.193.48:0/2409999157 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f477800fec0 con 0x7f4784091010 2026-02-12T18:13:10.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.505+0000 7f4771ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.505+0000 7f4771ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:13:10.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.505+0000 7f4771ffb640 10 monclient: dump: 2026-02-12T18:13:10.528 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.528 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.528 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.528 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.528 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.528 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.528 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.528 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.529 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.529 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.529 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.529 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.529 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.529 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.529 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.529 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.505+0000 7f4771ffb640 1 -- 10.20.193.48:0/2409999157 <== mon.4 v2:10.20.193.48:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f4778014440 con 0x7f4784091010 2026-02-12T18:13:10.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.505+0000 7f4771ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:13:10.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.505+0000 7f4771ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:13:10.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.505+0000 7f4771ffb640 1 -- 10.20.193.48:0/2409999157 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4784091010 msgr2=0x7f478408abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.505+0000 7f4771ffb640 1 --2- 10.20.193.48:0/2409999157 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4784091010 0x7f478408abc0 secure :-1 s=READY pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f478405c9e0 tx=0x7f4778011e40 comp rx=0 tx=0).stop 2026-02-12T18:13:10.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.505+0000 7f4771ffb640 1 -- 10.20.193.48:0/2409999157 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4784091010 msgr2=0x7f478408abc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:13:10.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.505+0000 7f4771ffb640 1 --2- 10.20.193.48:0/2409999157 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4784091010 0x7f478408abc0 secure :-1 s=CLOSED pgs=136 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f478405c9e0 tx=0x7f4778011e40 comp rx=0 tx=0).stop 2026-02-12T18:13:10.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.505+0000 7f4789e82640 1 --2- 10.20.193.48:0/2409999157 >> v2:10.20.193.111:6812/977811348 conn(0x7f475403f800 0x7f475405fcb0 secure :-1 s=READY pgs=354 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4780005a20 tx=0x7f478000a040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.508+0000 7f478b90c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:13:10.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.508+0000 7f478b90c640 1 --2- 10.20.193.48:0/2409999157 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f478408b100 0x7f4784058a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.508+0000 7f478b90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.508+0000 7f478b90c640 1 -- 10.20.193.48:0/2409999157 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f478405f140 con 0x7f478408b100 2026-02-12T18:13:10.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.508+0000 7f4788e80640 1 --2- 10.20.193.48:0/2409999157 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f478408b100 0x7f4784058a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.508+0000 7f4788e80640 10 monclient: get_auth_request con 0x7f478408b100 auth_method 0 2026-02-12T18:13:10.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.508+0000 7f4788e80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.508+0000 7f4788e80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.508+0000 7f4788e80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.508+0000 7f4788e80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.508+0000 7f4788e80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.508+0000 7f4788e80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.508+0000 7f4788e80640 10 monclient(hunting): handle_auth_done global_id 64561 payload 824 2026-02-12T18:13:10.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.508+0000 7f4788e80640 1 -- 10.20.193.48:0/2409999157 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4784090330 con 0x7f478408b100 2026-02-12T18:13:10.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.511+0000 7f4788e80640 1 -- 10.20.193.48:0/2409999157 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f478408b100 msgr2=0x7f4784058a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:10.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.511+0000 7f4788e80640 1 --2- 10.20.193.48:0/2409999157 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f478408b100 0x7f4784058a80 secure :-1 s=READY pgs=137 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f478405c9e0 tx=0x7f47780047e0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.511+0000 7f4771ffb640 1 -- 10.20.193.48:0/2409999157 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4778003030 con 0x7f478408b100 2026-02-12T18:13:10.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.511+0000 7f4771ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.511+0000 7f4771ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:13:10.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.511+0000 7f4771ffb640 10 monclient: dump: 2026-02-12T18:13:10.531 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.531 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.531 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.531 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.531 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.531 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.531 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.531 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.531 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.531 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.532 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.532 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.532 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.532 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.532 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.532 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.511+0000 7f4771ffb640 1 -- 10.20.193.48:0/2409999157 <== mon.4 v2:10.20.193.48:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10149 (secure 0 0 0) 0x7f4778022550 con 0x7f478408b100 2026-02-12T18:13:10.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.511+0000 7f4771ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:13:10.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.511+0000 7f4771ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:13:10.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.511+0000 7f4771ffb640 1 -- 10.20.193.48:0/2409999157 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f478408b100 msgr2=0x7f4784058a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.511+0000 7f4771ffb640 1 --2- 10.20.193.48:0/2409999157 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f478408b100 0x7f4784058a80 secure :-1 s=READY pgs=137 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f478405c9e0 tx=0x7f47780047e0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.511+0000 7f4771ffb640 1 -- 10.20.193.48:0/2409999157 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f478408b100 msgr2=0x7f4784058a80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:13:10.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.511+0000 7f4771ffb640 1 --2- 10.20.193.48:0/2409999157 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f478408b100 0x7f4784058a80 secure :-1 s=CLOSED pgs=137 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f478405c9e0 tx=0x7f47780047e0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.533 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:13:10.533 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:13:10.533 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:13:10.533 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:13:10.533 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 72, 2026-02-12T18:13:10.533 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 171297, 2026-02-12T18:13:10.533 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:13:10.533 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:13:10.533 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:13:10.533 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:13:10.533 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:13:10.533 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:13:10.534 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:13:10.534 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.534 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 1, 2026-02-12T18:13:10.534 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:13:10.534 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:13:10.534 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:13:10.534 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:13:10.534 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:13:10.534 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:13:10.534 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:13:10.534 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:13:10.534 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:13:10.534 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:13:10.534 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:13:10.534 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:13:10.534 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:13:10.534 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:13:10.535 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:13:10.535 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:13:10.535 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.535 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:13:10.535 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:13:10.535 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:13:10.535 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:13:10.535 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:13:10.535 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:13:10.535 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:13:10.535 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:13:10.535 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:13:10.535 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:13:10.535 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:13:10.535 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:13:10.535 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:13:10.535 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:13:10.536 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:13:10.536 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.536 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.536 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:13:10.536 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:13:10.536 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:13:10.536 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:13:10.536 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:13:10.536 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:13:10.536 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:13:10.536 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:13:10.536 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:13:10.536 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:13:10.536 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:13:10.536 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:13:10.536 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:13:10.536 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:13:10.537 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:13:10.537 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:13:10.537 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:13:10.537 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:13:10.537 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:13:10.537 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:13:10.537 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:13:10.537 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:13:10.537 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:13:10.537 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:13:10.537 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:13:10.537 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:13:10.537 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:13:10.537 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:13:10.537 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:13:10.537 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:13:10.537 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.537 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:13:10.538 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.538 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:13:10.538 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.538 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:13:10.538 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:13:10.538 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.538 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.538 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.538 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.538 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:13:10.538 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.538 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.538 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.538 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.538 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:13:10.538 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.538 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.538 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.538 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.539 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:13:10.539 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:13:10.539 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.539 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.539 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:13:10.539 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.539 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.539 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.539 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:13:10.539 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:13:10.539 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.539 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.539 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.539 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.539 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:13:10.539 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.539 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.539 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.539 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.540 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:13:10.540 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.540 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.540 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.540 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.540 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:13:10.540 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:13:10.540 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.540 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.540 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:13:10.540 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.540 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.540 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.540 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:13:10.540 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:13:10.540 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.540 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.540 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.540 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.540 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:13:10.540 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.541 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.541 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.541 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.541 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:13:10.541 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.541 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.541 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.541 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.541 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:13:10.541 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:13:10.541 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.541 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.541 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:13:10.541 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.541 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.541 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.541 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:13:10.541 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:13:10.541 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.541 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.541 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.542 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.542 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:13:10.542 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.542 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.542 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.542 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.542 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:13:10.542 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.542 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.542 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.542 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.542 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:13:10.542 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:13:10.542 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.542 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.542 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:13:10.542 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.542 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.542 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.542 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:13:10.542 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:13:10.542 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.543 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.543 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.543 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.543 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:13:10.543 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.543 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.543 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.543 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.543 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:13:10.543 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.543 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.543 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.543 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.543 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:13:10.543 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:13:10.543 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.543 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.543 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:13:10.543 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.543 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.543 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.543 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:13:10.544 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:13:10.544 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.544 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.544 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.544 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.544 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:13:10.544 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.544 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.544 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.544 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.544 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:13:10.544 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.544 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.544 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.544 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.544 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:13:10.544 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:13:10.544 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.544 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.544 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:13:10.544 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.544 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.544 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.545 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:13:10.545 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:13:10.545 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.545 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.545 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.545 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.545 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:13:10.545 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.545 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.545 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.545 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.545 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:13:10.545 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.545 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.545 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.545 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.545 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:13:10.545 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:13:10.545 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.545 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.545 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:13:10.545 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.545 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.546 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.546 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:13:10.546 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:13:10.546 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.546 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.546 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.546 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.546 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:13:10.546 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.546 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.546 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.546 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.546 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:13:10.546 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.546 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.546 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.546 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.546 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:13:10.546 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:13:10.546 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.546 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.546 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:13:10.546 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.547 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.547 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.547 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:13:10.547 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:13:10.547 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.547 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.547 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.547 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.547 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:13:10.547 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.547 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.547 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.547 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.547 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:13:10.547 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.547 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.547 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.547 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.547 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:13:10.547 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:13:10.547 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.547 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.547 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:13:10.547 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.547 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.548 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.548 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.548 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:13:10.548 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:13:10.548 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.548 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:13:10.548 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:13:10.548 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:13:10.548 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.548 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.548 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:13:10.548 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.548 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:13:10.548 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:13:10.548 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:13:10.548 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.548 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.548 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:13:10.548 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.548 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:13:10.548 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:13:10.548 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:13:10.548 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.549 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.549 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.549 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:13:10.549 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:13:10.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.511+0000 7f478b90c640 1 -- 10.20.193.48:0/2409999157 >> v2:10.20.193.111:6812/977811348 conn(0x7f475403f800 msgr2=0x7f475405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.511+0000 7f478b90c640 1 --2- 10.20.193.48:0/2409999157 >> v2:10.20.193.111:6812/977811348 conn(0x7f475403f800 0x7f475405fcb0 secure :-1 s=READY pgs=354 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4780005a20 tx=0x7f478000a040 comp rx=0 tx=0).stop 2026-02-12T18:13:10.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.511+0000 7f478b90c640 10 monclient: shutdown 2026-02-12T18:13:10.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.511+0000 7f478b90c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:13:10.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.511+0000 7f478b90c640 1 -- 10.20.193.48:0/2409999157 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f478405d550 msgr2=0x7f4784131580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.511+0000 7f478b90c640 1 --2- 10.20.193.48:0/2409999157 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f478405d550 0x7f4784131580 secure :-1 s=READY pgs=514 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f47740099a0 tx=0x7f4774004770 comp rx=0 tx=0).stop 2026-02-12T18:13:10.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.511+0000 7f4789e82640 1 -- 10.20.193.48:0/2409999157 reap_dead start 2026-02-12T18:13:10.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.511+0000 7f4789e82640 1 -- 10.20.193.48:0/2409999157 reap_dead start 2026-02-12T18:13:10.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.511+0000 7f478b90c640 1 -- 10.20.193.48:0/2409999157 shutdown_connections 2026-02-12T18:13:10.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.511+0000 7f478b90c640 1 -- 10.20.193.48:0/2409999157 >> 10.20.193.48:0/2409999157 conn(0x7f47840546a0 msgr2=0x7f478413d190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:13:10.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.511+0000 7f478b90c640 1 -- 10.20.193.48:0/2409999157 shutdown_connections 2026-02-12T18:13:10.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.511+0000 7f478b90c640 1 -- 10.20.193.48:0/2409999157 wait complete. 2026-02-12T18:13:10.550 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2026-02-12T18:13:10.550 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon e 2026-02-12T18:13:10.550 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2026-02-12T18:13:10.617 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.615+0000 7f3feccb8640 10 monclient: get_monmap_and_config 2026-02-12T18:13:10.617 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.615+0000 7f3feccb8640 10 monclient: build_initial_monmap 2026-02-12T18:13:10.617 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.615+0000 7f3feccb8640 10 monclient: monmap: 2026-02-12T18:13:10.617 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:13:10.617 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.617 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:13:10.616885+0000 2026-02-12T18:13:10.617 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:13:10.616885+0000 2026-02-12T18:13:10.617 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:13:10.617 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.617 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:13:10.617 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:13:10.617 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:13:10.617 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:13:10.617 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:13:10.617 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:13:10.618 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:13:10.618 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:13:10.618 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:13:10.618 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:13:10.618 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:13:10.618 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3feccb8640 1 Processor -- start 2026-02-12T18:13:10.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3feccb8640 1 -- start start 2026-02-12T18:13:10.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3feccb8640 10 monclient: init 2026-02-12T18:13:10.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3feccb8640 10 monclient: _reopen_session rank -1 2026-02-12T18:13:10.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3feccb8640 10 monclient: _add_conns ranks=[4,0,10,5,3,2,1,6,8,9,7] 2026-02-12T18:13:10.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3feccb8640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3fe805c950 0x7f3fe805cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3feccb8640 10 monclient(hunting): picked mon.noname-c con 0x7f3fe805c950 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:13:10.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3feccb8640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f3fe805e490 addr v1:10.20.193.48:6789/0 2026-02-12T18:13:10.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3feccb8640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f3fe805d260 0x7f3fe813e280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3feccb8640 10 monclient(hunting): picked mon.noname-f con 0x7f3fe805d260 addr v2:10.20.193.111:3300/0 2026-02-12T18:13:10.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3feccb8640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fe804dc20 con 0x7f3fe805e490 2026-02-12T18:13:10.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3feccb8640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3feccb8640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f3fe805ddd0 con 0x7f3fe805d260 2026-02-12T18:13:10.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3feccb8640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3feccb8640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f3fe8092990 con 0x7f3fe805c950 2026-02-12T18:13:10.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3feccb8640 10 monclient(hunting): _renew_subs 2026-02-12T18:13:10.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3feccb8640 10 monclient(hunting): authenticate will time out at 1029.342718s 2026-02-12T18:13:10.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3fe6575640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3fe805c950 0x7f3fe805cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3fe6575640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3fe805c950 0x7f3fe805cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:52520/0 (socket says 10.20.193.48:52520) 2026-02-12T18:13:10.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3fe6575640 1 -- 10.20.193.48:0/1888676668 learned_addr learned my addr 10.20.193.48:0/1888676668 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:13:10.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3fe5d74640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f3fe805e490 0x7f3fe813db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:54358/0 (socket says 10.20.193.48:54358) 2026-02-12T18:13:10.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3fe6575640 10 monclient(hunting): get_auth_request con 0x7f3fe805c950 auth_method 0 2026-02-12T18:13:10.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3fe6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3fe6575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3fe6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3fe6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3fe6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3fe6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3fe6d76640 1 --2- 10.20.193.48:0/1888676668 >> v2:10.20.193.111:3300/0 conn(0x7f3fe805d260 0x7f3fe813e280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3fe6d76640 10 monclient(hunting): get_auth_request con 0x7f3fe805d260 auth_method 0 2026-02-12T18:13:10.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3fe6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3fe6d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3fe6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3fe6575640 10 monclient(hunting): handle_auth_done global_id 64570 payload 274 2026-02-12T18:13:10.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3fe6575640 1 -- 10.20.193.48:0/1888676668 >> v2:10.20.193.111:3300/0 conn(0x7f3fe805d260 msgr2=0x7f3fe813e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:13:10.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3fe6575640 1 --2- 10.20.193.48:0/1888676668 >> v2:10.20.193.111:3300/0 conn(0x7f3fe805d260 0x7f3fe813e280 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3fe6575640 1 -- 10.20.193.48:0/1888676668 >> v1:10.20.193.48:6789/0 conn(0x7f3fe805e490 legacy=0x7f3fe813db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:13:10.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3fe6575640 10 monclient: _finish_hunting 0 2026-02-12T18:13:10.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.616+0000 7f3fe6575640 1 monclient: found mon.noname-c 2026-02-12T18:13:10.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.617+0000 7f3fe6575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:13:10.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.617+0000 7f3fe6575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:13:10.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.617+0000 7f3fe6575640 1 -- 10.20.193.48:0/1888676668 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fe8092c70 con 0x7f3fe805c950 2026-02-12T18:13:10.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.619+0000 7f3fe6575640 1 -- 10.20.193.48:0/1888676668 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3fe805c950 msgr2=0x7f3fe805cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:10.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.619+0000 7f3fe6575640 1 --2- 10.20.193.48:0/1888676668 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3fe805c950 0x7f3fe805cd20 secure :-1 s=READY pgs=138 gs=2 cs=0 l=1 c_cookie=7143611032336677352 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3fdc009060 tx=0x7f3fdc02edf0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=63233462abfd39e8 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.619+0000 7f3fe5573640 1 -- 10.20.193.48:0/1888676668 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3fdc035340 con 0x7f3fe805c950 2026-02-12T18:13:10.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.619+0000 7f3fe5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.619+0000 7f3fe5573640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:13:10.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.619+0000 7f3fe5573640 10 monclient: dump: 2026-02-12T18:13:10.627 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.628 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.628 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.628 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.628 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.628 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.628 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.628 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.628 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.628 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.628 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.628 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.628 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.628 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.628 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.628 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.619+0000 7f3fe5573640 10 monclient: _finish_auth 0 2026-02-12T18:13:10.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.619+0000 7f3fe5573640 10 monclient: _check_auth_tickets 2026-02-12T18:13:10.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.619+0000 7f3fe5573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:13:10.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.619+0000 7f3fe5573640 1 -- 10.20.193.48:0/1888676668 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fdc0354c0 con 0x7f3fe805c950 2026-02-12T18:13:10.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.619+0000 7f3fe5573640 10 monclient: handle_config config(0 keys) 2026-02-12T18:13:10.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.619+0000 7f3fe5573640 1 -- 10.20.193.48:0/1888676668 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3fdc035af0 con 0x7f3fe805c950 2026-02-12T18:13:10.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.619+0000 7f3fe5573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.619+0000 7f3fe5573640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:13:10.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.619+0000 7f3fe5573640 10 monclient: dump: 2026-02-12T18:13:10.629 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.629 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.629 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.629 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.629 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.629 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.629 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.629 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.629 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.629 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.630 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.630 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.630 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.630 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.630 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.630 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.619+0000 7f3feccb8640 5 monclient: authenticate success, global_id 64570 2026-02-12T18:13:10.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.619+0000 7f3feccb8640 10 monclient: get_monmap_and_config success 2026-02-12T18:13:10.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.619+0000 7f3feccb8640 4 set_mon_vals no callback set 2026-02-12T18:13:10.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.620+0000 7f3feccb8640 10 monclient: shutdown 2026-02-12T18:13:10.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.620+0000 7f3feccb8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:13:10.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.620+0000 7f3feccb8640 1 -- 10.20.193.48:0/1888676668 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3fe805c950 msgr2=0x7f3fe805cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.620+0000 7f3feccb8640 1 --2- 10.20.193.48:0/1888676668 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3fe805c950 0x7f3fe805cd20 secure :-1 s=READY pgs=138 gs=2 cs=0 l=1 c_cookie=7143611032336677352 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3fdc009060 tx=0x7f3fdc02edf0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.620+0000 7f3feccb8640 1 -- 10.20.193.48:0/1888676668 shutdown_connections 2026-02-12T18:13:10.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.620+0000 7f3feccb8640 1 --2- 10.20.193.48:0/1888676668 >> v2:10.20.193.111:3300/0 conn(0x7f3fe805d260 0x7f3fe813e280 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.620+0000 7f3feccb8640 1 --2- 10.20.193.48:0/1888676668 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f3fe805c950 0x7f3fe805cd20 unknown :-1 s=CLOSED pgs=138 gs=2 cs=0 l=1 c_cookie=7143611032336677352 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.620+0000 7f3feccb8640 1 -- 10.20.193.48:0/1888676668 >> 10.20.193.48:0/1888676668 conn(0x7f3fe80548a0 msgr2=0x7f3fe8097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:13:10.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.620+0000 7f3feccb8640 1 -- 10.20.193.48:0/1888676668 shutdown_connections 2026-02-12T18:13:10.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.620+0000 7f3feccb8640 1 -- 10.20.193.48:0/1888676668 wait complete. 2026-02-12T18:13:10.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.620+0000 7f3feccb8640 10 monclient: build_initial_monmap 2026-02-12T18:13:10.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.620+0000 7f3feccb8640 10 monclient: monmap: 2026-02-12T18:13:10.631 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:13:10.631 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:13:10.631 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:13:10.631 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:13:10.631 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:13:10.631 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.631 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:13:10.631 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:13:10.631 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:13:10.631 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:13:10.631 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:13:10.631 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:13:10.631 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:13:10.632 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:13:10.632 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:13:10.632 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.620+0000 7f3feccb8640 1 Processor -- start 2026-02-12T18:13:10.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.620+0000 7f3feccb8640 1 -- start start 2026-02-12T18:13:10.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.620+0000 7f3feccb8640 10 monclient: init 2026-02-12T18:13:10.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3feccb8640 10 monclient: _reopen_session rank -1 2026-02-12T18:13:10.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3feccb8640 10 monclient: _add_conns ranks=[6,2,8,4,3,5,7,1,0] 2026-02-12T18:13:10.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3feccb8640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3fe805c950 0x7f3fe808c7d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3feccb8640 10 monclient(hunting): picked mon.noname-d con 0x7f3fe805c950 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:13:10.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3feccb8640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f3fe805d260 0x7f3fe808fd90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3feccb8640 10 monclient(hunting): picked mon.noname-b con 0x7f3fe805d260 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:13:10.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3feccb8640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3fe805e490 0x7f3fe80902d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3feccb8640 10 monclient(hunting): picked mon.noname-e con 0x7f3fe805e490 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:13:10.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3feccb8640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3feccb8640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f3fe808b7e0 con 0x7f3fe805d260 2026-02-12T18:13:10.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3feccb8640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3feccb8640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f3fe808cd10 con 0x7f3fe805c950 2026-02-12T18:13:10.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3feccb8640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3feccb8640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f3fe8142a50 con 0x7f3fe805e490 2026-02-12T18:13:10.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3feccb8640 10 monclient(hunting): _renew_subs 2026-02-12T18:13:10.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3feccb8640 10 monclient(hunting): authenticate will time out at 1029.347200s 2026-02-12T18:13:10.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe6575640 1 -- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3fe805c950 msgr2=0x7f3fe808c7d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.48:3303/0 2026-02-12T18:13:10.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe6575640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3fe805c950 0x7f3fe808c7d0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:13:10.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe5d74640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f3fe805d260 0x7f3fe808fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe6d76640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3fe805e490 0x7f3fe80902d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe5d74640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f3fe805d260 0x7f3fe808fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:34840/0 (socket says 10.20.193.48:34840) 2026-02-12T18:13:10.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe5d74640 1 -- 10.20.193.48:0/4154786560 learned_addr learned my addr 10.20.193.48:0/4154786560 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:13:10.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe5d74640 10 monclient(hunting): get_auth_request con 0x7f3fe805d260 auth_method 0 2026-02-12T18:13:10.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe5d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe5d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe5d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe6d76640 10 monclient(hunting): get_auth_request con 0x7f3fe805e490 auth_method 0 2026-02-12T18:13:10.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe6d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe6d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe6d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe6d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe6d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe6d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe5d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe5d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe5d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe6d76640 10 monclient(hunting): handle_auth_done global_id 94346 payload 824 2026-02-12T18:13:10.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe6d76640 1 -- 10.20.193.48:0/4154786560 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3fe805c950 msgr2=0x7f3fe808c7d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:13:10.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe6d76640 1 --2- 10.20.193.48:0/4154786560 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f3fe805c950 0x7f3fe808c7d0 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe6d76640 1 -- 10.20.193.48:0/4154786560 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f3fe805d260 msgr2=0x7f3fe808fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe6d76640 1 --2- 10.20.193.48:0/4154786560 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f3fe805d260 0x7f3fe808fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe6d76640 10 monclient: _finish_hunting 0 2026-02-12T18:13:10.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe6d76640 1 monclient: found mon.noname-e 2026-02-12T18:13:10.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe6d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:13:10.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe6d76640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:13:10.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe6d76640 1 -- 10.20.193.48:0/4154786560 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fdc0094f0 con 0x7f3fe805e490 2026-02-12T18:13:10.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.621+0000 7f3fe5d74640 1 --2- 10.20.193.48:0/4154786560 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f3fe805d260 0x7f3fe808fd90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:13:10.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.623+0000 7f3fe6d76640 1 -- 10.20.193.48:0/4154786560 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3fe805e490 msgr2=0x7f3fe80902d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:10.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.623+0000 7f3fe6d76640 1 --2- 10.20.193.48:0/4154786560 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3fe805e490 0x7f3fe80902d0 secure :-1 s=READY pgs=61 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3fe8142c10 tx=0x7f3fd800fc80 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.623+0000 7f3fceffd640 1 -- 10.20.193.48:0/4154786560 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3fd80054f0 con 0x7f3fe805e490 2026-02-12T18:13:10.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.623+0000 7f3fceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.623+0000 7f3fceffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:13:10.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.623+0000 7f3fceffd640 10 monclient: dump: 2026-02-12T18:13:10.635 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.635 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.635 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.635 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.635 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.635 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.635 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.635 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.635 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.636 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.636 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.636 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.636 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.636 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.636 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.636 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3fceffd640 10 monclient: _finish_auth 0 2026-02-12T18:13:10.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3fceffd640 10 monclient: _check_auth_tickets 2026-02-12T18:13:10.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3fceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:13:10.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3fceffd640 1 -- 10.20.193.48:0/4154786560 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fd8005690 con 0x7f3fe805e490 2026-02-12T18:13:10.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3feccb8640 5 monclient: authenticate success, global_id 94346 2026-02-12T18:13:10.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3fceffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:13:10.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3fceffd640 1 -- 10.20.193.48:0/4154786560 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3fd8004c70 con 0x7f3fe805e490 2026-02-12T18:13:10.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3fceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3fe4d72640 4 set_mon_vals no callback set 2026-02-12T18:13:10.636 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3fceffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:13:10.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3fceffd640 10 monclient: dump: 2026-02-12T18:13:10.637 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.637 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.637 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.637 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.637 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.637 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.637 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.637 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.637 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.637 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.637 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.637 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.637 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.637 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.637 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.637 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3feccb8640 10 monclient: _renew_subs 2026-02-12T18:13:10.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3feccb8640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:13:10.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3feccb8640 1 -- 10.20.193.48:0/4154786560 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fe8141a10 con 0x7f3fe805e490 2026-02-12T18:13:10.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3feccb8640 10 monclient: _renew_subs 2026-02-12T18:13:10.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3feccb8640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:13:10.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3feccb8640 1 -- 10.20.193.48:0/4154786560 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fe808acc0 con 0x7f3fe805e490 2026-02-12T18:13:10.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3feccb8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:13:10.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3feccb8640 1 --2- 10.20.193.48:0/4154786560 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3fe8090810 0x7f3fe812e3a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3feccb8640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3feccb8640 1 -- 10.20.193.48:0/4154786560 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f3fe8063180 con 0x7f3fe8090810 2026-02-12T18:13:10.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3fe6575640 1 --2- 10.20.193.48:0/4154786560 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3fe8090810 0x7f3fe812e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3fe6575640 10 monclient: get_auth_request con 0x7f3fe8090810 auth_method 0 2026-02-12T18:13:10.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3fe6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3fe6575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3fe6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3fe6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3fe6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3fe6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3fceffd640 1 -- 10.20.193.48:0/4154786560 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f3fd80047b0 con 0x7f3fe805e490 2026-02-12T18:13:10.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3fe6575640 10 monclient(hunting): handle_auth_done global_id 94355 payload 824 2026-02-12T18:13:10.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3fe6575640 1 -- 10.20.193.48:0/4154786560 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3fe8097de0 con 0x7f3fe8090810 2026-02-12T18:13:10.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3fceffd640 1 --2- 10.20.193.48:0/4154786560 >> v2:10.20.193.111:6812/977811348 conn(0x7f3fb403f7c0 0x7f3fb405fc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.624+0000 7f3fceffd640 1 -- 10.20.193.48:0/4154786560 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(223..223 src has 198..223) ==== 3503+0+0 (secure 0 0 0) 0x7f3fd8053b10 con 0x7f3fe805e490 2026-02-12T18:13:10.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.625+0000 7f3fe5d74640 1 --2- 10.20.193.48:0/4154786560 >> v2:10.20.193.111:6812/977811348 conn(0x7f3fb403f7c0 0x7f3fb405fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.625+0000 7f3fe5d74640 10 monclient: get_auth_request con 0x7f3fb403f7c0 auth_method 0 2026-02-12T18:13:10.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.626+0000 7f3fe6575640 1 -- 10.20.193.48:0/4154786560 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3fe8090810 msgr2=0x7f3fe812e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:10.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.626+0000 7f3fe6575640 1 --2- 10.20.193.48:0/4154786560 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3fe8090810 0x7f3fe812e3a0 secure :-1 s=READY pgs=62 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3fdc009060 tx=0x7f3fdc004770 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.627+0000 7f3fceffd640 1 -- 10.20.193.48:0/4154786560 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3fdc035db0 con 0x7f3fe8090810 2026-02-12T18:13:10.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.627+0000 7f3fceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.627+0000 7f3fceffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:13:10.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.627+0000 7f3fceffd640 10 monclient: dump: 2026-02-12T18:13:10.642 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.642 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.642 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.642 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.642 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.642 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.642 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.642 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.642 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.642 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.642 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.642 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.642 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.642 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.642 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.643 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.627+0000 7f3fceffd640 1 -- 10.20.193.48:0/4154786560 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f3fdc004030 con 0x7f3fe8090810 2026-02-12T18:13:10.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.627+0000 7f3fceffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:13:10.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.627+0000 7f3fceffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:13:10.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.627+0000 7f3fceffd640 1 -- 10.20.193.48:0/4154786560 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3fe8090810 msgr2=0x7f3fe812e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.627+0000 7f3fceffd640 1 --2- 10.20.193.48:0/4154786560 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3fe8090810 0x7f3fe812e3a0 secure :-1 s=READY pgs=62 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3fdc009060 tx=0x7f3fdc004770 comp rx=0 tx=0).stop 2026-02-12T18:13:10.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.627+0000 7f3fceffd640 1 -- 10.20.193.48:0/4154786560 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3fe8090810 msgr2=0x7f3fe812e3a0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:13:10.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.627+0000 7f3fceffd640 1 --2- 10.20.193.48:0/4154786560 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3fe8090810 0x7f3fe812e3a0 secure :-1 s=CLOSED pgs=62 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3fdc009060 tx=0x7f3fdc004770 comp rx=0 tx=0).stop 2026-02-12T18:13:10.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.627+0000 7f3fe5d74640 1 --2- 10.20.193.48:0/4154786560 >> v2:10.20.193.111:6812/977811348 conn(0x7f3fb403f7c0 0x7f3fb405fc70 secure :-1 s=READY pgs=355 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3fe808a610 tx=0x7f3fd0004a80 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.630+0000 7f3feccb8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:13:10.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.630+0000 7f3feccb8640 1 --2- 10.20.193.48:0/4154786560 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3fe812e8e0 0x7f3fe812ece0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.630+0000 7f3feccb8640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.630+0000 7f3feccb8640 1 -- 10.20.193.48:0/4154786560 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f3fe8050410 con 0x7f3fe812e8e0 2026-02-12T18:13:10.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.630+0000 7f3fe6575640 1 --2- 10.20.193.48:0/4154786560 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3fe812e8e0 0x7f3fe812ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.630+0000 7f3fe6575640 10 monclient: get_auth_request con 0x7f3fe812e8e0 auth_method 0 2026-02-12T18:13:10.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.630+0000 7f3fe6575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.630+0000 7f3fe6575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.630+0000 7f3fe6575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.630+0000 7f3fe6575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.630+0000 7f3fe6575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.630+0000 7f3fe6575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.630+0000 7f3fe6575640 10 monclient(hunting): handle_auth_done global_id 94364 payload 824 2026-02-12T18:13:10.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.630+0000 7f3fe6575640 1 -- 10.20.193.48:0/4154786560 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3fe8090be0 con 0x7f3fe812e8e0 2026-02-12T18:13:10.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.633+0000 7f3fe6575640 1 -- 10.20.193.48:0/4154786560 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3fe812e8e0 msgr2=0x7f3fe812ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:10.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.633+0000 7f3fe6575640 1 --2- 10.20.193.48:0/4154786560 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3fe812e8e0 0x7f3fe812ece0 secure :-1 s=READY pgs=63 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3fdc003680 tx=0x7f3fdc0092c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.633+0000 7f3fceffd640 1 -- 10.20.193.48:0/4154786560 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f3fdc04d070 con 0x7f3fe812e8e0 2026-02-12T18:13:10.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.633+0000 7f3fceffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.633+0000 7f3fceffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:13:10.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.633+0000 7f3fceffd640 10 monclient: dump: 2026-02-12T18:13:10.644 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.644 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.644 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.644 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.644 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.645 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.645 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.645 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.645 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.645 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.645 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.645 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.645 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.645 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.645 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.645 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.633+0000 7f3fceffd640 1 -- 10.20.193.48:0/4154786560 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9981 (secure 0 0 0) 0x7f3fdc037440 con 0x7f3fe812e8e0 2026-02-12T18:13:10.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.633+0000 7f3fceffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:13:10.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.633+0000 7f3fceffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:13:10.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.633+0000 7f3fceffd640 1 -- 10.20.193.48:0/4154786560 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3fe812e8e0 msgr2=0x7f3fe812ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.633+0000 7f3fceffd640 1 --2- 10.20.193.48:0/4154786560 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3fe812e8e0 0x7f3fe812ece0 secure :-1 s=READY pgs=63 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3fdc003680 tx=0x7f3fdc0092c0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.633+0000 7f3fceffd640 1 -- 10.20.193.48:0/4154786560 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3fe812e8e0 msgr2=0x7f3fe812ece0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:13:10.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.633+0000 7f3fceffd640 1 --2- 10.20.193.48:0/4154786560 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3fe812e8e0 0x7f3fe812ece0 secure :-1 s=CLOSED pgs=63 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3fdc003680 tx=0x7f3fdc0092c0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.646 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:13:10.646 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:13:10.646 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:13:10.646 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:13:10.646 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 72, 2026-02-12T18:13:10.646 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 36308, 2026-02-12T18:13:10.646 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:13:10.646 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:13:10.646 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:13:10.646 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:13:10.647 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:13:10.647 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:13:10.647 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:13:10.647 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.647 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 1, 2026-02-12T18:13:10.647 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:13:10.647 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:13:10.647 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:13:10.647 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:13:10.647 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:13:10.647 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:13:10.647 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:13:10.647 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:13:10.647 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:13:10.647 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:13:10.647 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:13:10.647 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:13:10.647 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:13:10.648 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:13:10.648 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:13:10.648 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:13:10.648 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.648 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:13:10.648 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:13:10.648 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:13:10.648 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:13:10.648 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:13:10.648 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:13:10.648 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:13:10.648 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:13:10.648 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:13:10.648 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:13:10.648 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:13:10.648 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:13:10.648 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:13:10.648 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:13:10.648 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:13:10.649 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.649 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.649 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:13:10.649 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:13:10.649 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:13:10.649 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:13:10.649 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:13:10.649 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:13:10.649 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:13:10.649 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:13:10.649 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:13:10.649 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:13:10.649 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:13:10.649 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:13:10.649 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:13:10.649 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:13:10.649 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:13:10.649 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:13:10.650 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:13:10.650 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:13:10.650 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:13:10.650 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:13:10.650 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:13:10.650 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:13:10.650 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:13:10.650 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:13:10.650 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:13:10.650 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:13:10.650 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:13:10.650 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:13:10.650 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:13:10.650 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:13:10.650 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.650 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:13:10.650 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.650 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:13:10.650 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.650 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:13:10.651 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:13:10.651 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.651 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.651 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.651 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.651 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:13:10.651 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.651 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.651 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.651 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.651 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:13:10.651 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.651 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.651 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.651 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.651 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:13:10.651 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:13:10.651 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.651 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.651 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:13:10.651 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.652 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.652 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.652 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:13:10.652 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:13:10.652 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.652 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.652 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.652 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.652 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:13:10.652 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.652 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.652 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.652 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.652 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:13:10.652 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.652 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.652 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.652 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.652 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:13:10.652 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:13:10.653 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.653 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.653 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:13:10.653 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.653 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.653 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.653 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:13:10.653 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:13:10.653 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.653 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.653 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.653 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.653 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:13:10.653 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.653 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.653 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.653 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.653 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:13:10.653 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.653 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.653 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.654 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.654 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:13:10.654 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:13:10.654 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.654 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.654 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:13:10.654 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.654 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.654 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.654 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:13:10.654 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:13:10.654 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.654 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.654 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.654 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.654 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:13:10.654 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.654 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.654 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.654 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.655 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:13:10.655 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.655 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.655 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.655 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.655 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:13:10.655 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:13:10.655 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.655 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.655 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:13:10.655 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.655 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.655 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.655 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:13:10.655 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:13:10.655 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.655 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.655 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.655 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.655 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:13:10.655 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.656 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.656 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.656 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.656 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:13:10.656 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.656 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.656 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.656 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.656 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:13:10.656 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:13:10.656 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.656 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.656 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:13:10.656 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.656 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.656 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.656 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:13:10.656 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:13:10.656 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.656 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.656 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.656 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.656 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:13:10.657 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.657 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.657 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.657 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.657 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:13:10.657 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.657 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.657 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.657 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.657 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:13:10.657 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:13:10.657 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.657 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.657 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:13:10.657 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.657 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.657 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.657 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:13:10.657 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:13:10.657 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.657 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.657 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.657 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.657 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:13:10.658 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.658 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.658 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.658 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.658 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:13:10.658 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.658 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.658 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.658 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.658 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:13:10.658 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:13:10.658 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.658 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.658 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:13:10.658 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.658 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.658 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.658 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:13:10.658 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:13:10.658 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.658 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.658 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.658 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.658 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:13:10.659 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.659 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.659 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.659 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.659 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:13:10.659 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.659 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.659 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.659 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.659 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:13:10.659 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:13:10.659 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.659 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.659 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:13:10.659 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.659 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.659 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.659 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:13:10.659 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:13:10.659 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.659 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.659 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.659 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.659 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:13:10.660 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.660 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.660 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.660 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.660 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:13:10.660 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.660 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.660 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.660 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.660 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:13:10.660 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:13:10.660 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.660 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.660 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:13:10.660 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.660 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.660 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.660 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.660 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:13:10.660 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:13:10.660 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.660 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:13:10.660 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:13:10.660 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:13:10.661 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.661 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.661 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:13:10.661 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.661 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:13:10.661 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:13:10.661 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:13:10.661 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.661 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.661 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.661 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:13:10.661 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:13:10.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.633+0000 7f3feccb8640 1 -- 10.20.193.48:0/4154786560 >> v2:10.20.193.111:6812/977811348 conn(0x7f3fb403f7c0 msgr2=0x7f3fb405fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.633+0000 7f3feccb8640 1 --2- 10.20.193.48:0/4154786560 >> v2:10.20.193.111:6812/977811348 conn(0x7f3fb403f7c0 0x7f3fb405fc70 secure :-1 s=READY pgs=355 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3fe808a610 tx=0x7f3fd0004a80 comp rx=0 tx=0).stop 2026-02-12T18:13:10.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.633+0000 7f3feccb8640 10 monclient: shutdown 2026-02-12T18:13:10.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.633+0000 7f3feccb8640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:13:10.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.633+0000 7f3feccb8640 1 -- 10.20.193.48:0/4154786560 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3fe805e490 msgr2=0x7f3fe80902d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.633+0000 7f3feccb8640 1 --2- 10.20.193.48:0/4154786560 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3fe805e490 0x7f3fe80902d0 secure :-1 s=READY pgs=61 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f3fe8142c10 tx=0x7f3fd800fc80 comp rx=0 tx=0).stop 2026-02-12T18:13:10.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.633+0000 7f3fe6d76640 1 -- 10.20.193.48:0/4154786560 reap_dead start 2026-02-12T18:13:10.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.633+0000 7f3feccb8640 1 -- 10.20.193.48:0/4154786560 shutdown_connections 2026-02-12T18:13:10.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.633+0000 7f3feccb8640 1 --2- 10.20.193.48:0/4154786560 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f3fe805e490 0x7f3fe80902d0 unknown :-1 s=CLOSED pgs=61 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.633+0000 7f3feccb8640 1 -- 10.20.193.48:0/4154786560 >> 10.20.193.48:0/4154786560 conn(0x7f3fe80548a0 msgr2=0x7f3fe8122fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:13:10.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.633+0000 7f3feccb8640 1 -- 10.20.193.48:0/4154786560 shutdown_connections 2026-02-12T18:13:10.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.633+0000 7f3feccb8640 1 -- 10.20.193.48:0/4154786560 wait complete. 2026-02-12T18:13:10.663 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2026-02-12T18:13:10.663 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon f 2026-02-12T18:13:10.663 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2026-02-12T18:13:10.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.728+0000 7f2c4c10c640 10 monclient: get_monmap_and_config 2026-02-12T18:13:10.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.728+0000 7f2c4c10c640 10 monclient: build_initial_monmap 2026-02-12T18:13:10.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.728+0000 7f2c4c10c640 10 monclient: monmap: 2026-02-12T18:13:10.729 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:13:10.729 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.729 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:13:10.729286+0000 2026-02-12T18:13:10.729 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:13:10.729286+0000 2026-02-12T18:13:10.729 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:13:10.730 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.730 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:13:10.730 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:13:10.730 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:13:10.730 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:13:10.730 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:13:10.730 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:13:10.730 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:13:10.730 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:13:10.730 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:13:10.730 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:13:10.730 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:13:10.730 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.728+0000 7f2c4c10c640 1 Processor -- start 2026-02-12T18:13:10.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.728+0000 7f2c4c10c640 1 -- start start 2026-02-12T18:13:10.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.728+0000 7f2c4c10c640 10 monclient: init 2026-02-12T18:13:10.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.728+0000 7f2c4c10c640 10 monclient: _reopen_session rank -1 2026-02-12T18:13:10.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4c10c640 10 monclient: _add_conns ranks=[3,9,2,7,10,5,4,0,1,8,6] 2026-02-12T18:13:10.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4c10c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2c4405d550 0x7f2c4405d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4c10c640 10 monclient(hunting): picked mon.noname-g con 0x7f2c4405d550 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:13:10.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4c10c640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f2c4405de60 0x7f2c44141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4c10c640 10 monclient(hunting): picked mon.noname-a con 0x7f2c4405de60 addr v2:10.20.193.48:3300/0 2026-02-12T18:13:10.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4c10c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2c4413ef60 0x7f2c441424e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4c10c640 10 monclient(hunting): picked mon.noname-b con 0x7f2c4413ef60 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:13:10.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4c10c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4c10c640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f2c4408d390 con 0x7f2c4405de60 2026-02-12T18:13:10.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4c10c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4c10c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f2c4408d5a0 con 0x7f2c4413ef60 2026-02-12T18:13:10.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4c10c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4c10c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2c440580e0 con 0x7f2c4405d550 2026-02-12T18:13:10.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4c10c640 10 monclient(hunting): _renew_subs 2026-02-12T18:13:10.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4c10c640 10 monclient(hunting): authenticate will time out at 1029.455051s 2026-02-12T18:13:10.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c49e81640 1 -- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2c4405d550 msgr2=0x7f2c4405d920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3301/0 2026-02-12T18:13:10.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c49e81640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2c4405d550 0x7f2c4405d920 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:13:10.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4a682640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2c4413ef60 0x7f2c441424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c49680640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f2c4405de60 0x7f2c44141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4a682640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2c4413ef60 0x7f2c441424e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:34854/0 (socket says 10.20.193.48:34854) 2026-02-12T18:13:10.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4a682640 1 -- 10.20.193.48:0/3461516303 learned_addr learned my addr 10.20.193.48:0/3461516303 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:13:10.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c49680640 1 --2- 10.20.193.48:0/3461516303 >> v2:10.20.193.48:3300/0 conn(0x7f2c4405de60 0x7f2c44141fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:38786/0 (socket says 10.20.193.48:38786) 2026-02-12T18:13:10.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c49680640 10 monclient(hunting): get_auth_request con 0x7f2c4405de60 auth_method 0 2026-02-12T18:13:10.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c49680640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c49680640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c49680640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4a682640 10 monclient(hunting): get_auth_request con 0x7f2c4413ef60 auth_method 0 2026-02-12T18:13:10.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4a682640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4a682640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4a682640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c49680640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c49680640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c49680640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4a682640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4a682640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4a682640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4a682640 10 monclient(hunting): handle_auth_done global_id 36011 payload 274 2026-02-12T18:13:10.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4a682640 1 -- 10.20.193.48:0/3461516303 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2c4405d550 msgr2=0x7f2c4405d920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:13:10.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4a682640 1 --2- 10.20.193.48:0/3461516303 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2c4405d550 0x7f2c4405d920 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4a682640 1 -- 10.20.193.48:0/3461516303 >> v2:10.20.193.48:3300/0 conn(0x7f2c4405de60 msgr2=0x7f2c44141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:13:10.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4a682640 1 --2- 10.20.193.48:0/3461516303 >> v2:10.20.193.48:3300/0 conn(0x7f2c4405de60 0x7f2c44141fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4a682640 10 monclient: _finish_hunting 0 2026-02-12T18:13:10.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4a682640 1 monclient: found mon.noname-b 2026-02-12T18:13:10.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4a682640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:13:10.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4a682640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:13:10.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c4a682640 1 -- 10.20.193.48:0/3461516303 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c4404dc20 con 0x7f2c4413ef60 2026-02-12T18:13:10.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.729+0000 7f2c49680640 1 --2- 10.20.193.48:0/3461516303 >> v2:10.20.193.48:3300/0 conn(0x7f2c4405de60 0x7f2c44141fa0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:13:10.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.731+0000 7f2c4a682640 1 -- 10.20.193.48:0/3461516303 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2c4413ef60 msgr2=0x7f2c441424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:10.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.731+0000 7f2c4a682640 1 --2- 10.20.193.48:0/3461516303 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2c4413ef60 0x7f2c441424e0 secure :-1 s=READY pgs=341 gs=2 cs=0 l=1 c_cookie=6703315040317384840 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c4000a140 tx=0x7f2c4002fef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d06f58373a6a888 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c48e7f640 1 -- 10.20.193.48:0/3461516303 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2c40030b70 con 0x7f2c4413ef60 2026-02-12T18:13:10.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c48e7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c48e7f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:13:10.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c48e7f640 10 monclient: dump: 2026-02-12T18:13:10.737 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.737 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.737 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.737 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.737 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.737 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.737 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.737 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.737 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.737 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.738 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.738 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.738 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.738 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.738 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.738 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c48e7f640 10 monclient: _finish_auth 0 2026-02-12T18:13:10.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c48e7f640 10 monclient: _check_auth_tickets 2026-02-12T18:13:10.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c48e7f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:13:10.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c48e7f640 1 -- 10.20.193.48:0/3461516303 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c40030cf0 con 0x7f2c4413ef60 2026-02-12T18:13:10.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c4c10c640 5 monclient: authenticate success, global_id 36011 2026-02-12T18:13:10.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c4c10c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:13:10.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c48e7f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:13:10.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c48e7f640 1 -- 10.20.193.48:0/3461516303 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2c40030e60 con 0x7f2c4413ef60 2026-02-12T18:13:10.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c4c10c640 10 monclient: get_monmap_and_config success 2026-02-12T18:13:10.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c4c10c640 4 set_mon_vals no callback set 2026-02-12T18:13:10.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c48e7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c48e7f640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:13:10.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c48e7f640 10 monclient: dump: 2026-02-12T18:13:10.738 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.738 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.739 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.739 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.739 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.739 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.739 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.739 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.739 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.739 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.739 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.739 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.739 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.739 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.739 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.739 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c4c10c640 10 monclient: shutdown 2026-02-12T18:13:10.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c4c10c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:13:10.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c4c10c640 1 -- 10.20.193.48:0/3461516303 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2c4413ef60 msgr2=0x7f2c441424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c4c10c640 1 --2- 10.20.193.48:0/3461516303 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2c4413ef60 0x7f2c441424e0 secure :-1 s=READY pgs=341 gs=2 cs=0 l=1 c_cookie=6703315040317384840 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c4000a140 tx=0x7f2c4002fef0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c4c10c640 1 -- 10.20.193.48:0/3461516303 shutdown_connections 2026-02-12T18:13:10.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c4c10c640 1 --2- 10.20.193.48:0/3461516303 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2c4413ef60 0x7f2c441424e0 unknown :-1 s=CLOSED pgs=341 gs=2 cs=0 l=1 c_cookie=6703315040317384840 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c4c10c640 1 --2- 10.20.193.48:0/3461516303 >> v2:10.20.193.48:3300/0 conn(0x7f2c4405de60 0x7f2c44141fa0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c4c10c640 1 --2- 10.20.193.48:0/3461516303 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2c4405d550 0x7f2c4405d920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c4c10c640 1 -- 10.20.193.48:0/3461516303 >> 10.20.193.48:0/3461516303 conn(0x7f2c440546a0 msgr2=0x7f2c44054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:13:10.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c4c10c640 1 -- 10.20.193.48:0/3461516303 shutdown_connections 2026-02-12T18:13:10.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.732+0000 7f2c4c10c640 1 -- 10.20.193.48:0/3461516303 wait complete. 2026-02-12T18:13:10.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4c10c640 10 monclient: build_initial_monmap 2026-02-12T18:13:10.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4c10c640 10 monclient: monmap: 2026-02-12T18:13:10.740 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:13:10.740 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:13:10.740 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:13:10.740 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:13:10.740 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:13:10.740 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.740 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:13:10.740 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:13:10.740 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:13:10.740 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:13:10.740 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:13:10.740 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:13:10.740 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:13:10.740 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:13:10.740 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:13:10.740 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4c10c640 1 Processor -- start 2026-02-12T18:13:10.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4c10c640 1 -- start start 2026-02-12T18:13:10.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4c10c640 10 monclient: init 2026-02-12T18:13:10.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4c10c640 10 monclient: _reopen_session rank -1 2026-02-12T18:13:10.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4c10c640 10 monclient: _add_conns ranks=[8,2,0,1,7,6,3,4,5] 2026-02-12T18:13:10.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4c10c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2c4405d550 0x7f2c44131c70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4c10c640 10 monclient(hunting): picked mon.noname-e con 0x7f2c4405d550 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:13:10.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4c10c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2c4405de60 0x7f2c4408a680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4c10c640 10 monclient(hunting): picked mon.noname-b con 0x7f2c4405de60 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:13:10.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4c10c640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f2c4413ef60 0x7f2c4408abc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4c10c640 10 monclient(hunting): picked mon.noname-a con 0x7f2c4413ef60 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:13:10.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4c10c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4c10c640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4410f380 con 0x7f2c4413ef60 2026-02-12T18:13:10.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4c10c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4c10c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f2c4413dad0 con 0x7f2c4405de60 2026-02-12T18:13:10.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4c10c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4c10c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f2c4408bcc0 con 0x7f2c4405d550 2026-02-12T18:13:10.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4c10c640 10 monclient(hunting): _renew_subs 2026-02-12T18:13:10.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4c10c640 10 monclient(hunting): authenticate will time out at 1029.459622s 2026-02-12T18:13:10.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c49680640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2c4405de60 0x7f2c4408a680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c49e81640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2c4405d550 0x7f2c44131c70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4a682640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f2c4413ef60 0x7f2c4408abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c49e81640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2c4405d550 0x7f2c44131c70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:50166/0 (socket says 10.20.193.48:50166) 2026-02-12T18:13:10.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c49e81640 1 -- 10.20.193.48:0/4168181613 learned_addr learned my addr 10.20.193.48:0/4168181613 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:13:10.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c49680640 10 monclient(hunting): get_auth_request con 0x7f2c4405de60 auth_method 0 2026-02-12T18:13:10.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c49680640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c49680640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c49680640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c49e81640 10 monclient(hunting): get_auth_request con 0x7f2c4405d550 auth_method 0 2026-02-12T18:13:10.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c49e81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c49e81640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c49e81640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4a682640 10 monclient(hunting): get_auth_request con 0x7f2c4413ef60 auth_method 0 2026-02-12T18:13:10.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4a682640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4a682640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4a682640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c49680640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c49680640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c49680640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c49e81640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c49e81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c49e81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4a682640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4a682640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.733+0000 7f2c4a682640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.734+0000 7f2c49e81640 10 monclient(hunting): handle_auth_done global_id 94373 payload 824 2026-02-12T18:13:10.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.734+0000 7f2c49e81640 1 -- 10.20.193.48:0/4168181613 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2c4405de60 msgr2=0x7f2c4408a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.734+0000 7f2c49e81640 1 --2- 10.20.193.48:0/4168181613 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2c4405de60 0x7f2c4408a680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.734+0000 7f2c49e81640 1 -- 10.20.193.48:0/4168181613 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f2c4413ef60 msgr2=0x7f2c4408abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.734+0000 7f2c49e81640 1 --2- 10.20.193.48:0/4168181613 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f2c4413ef60 0x7f2c4408abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.734+0000 7f2c49e81640 10 monclient: _finish_hunting 0 2026-02-12T18:13:10.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.734+0000 7f2c49e81640 1 monclient: found mon.noname-e 2026-02-12T18:13:10.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.734+0000 7f2c49e81640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:13:10.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.734+0000 7f2c49e81640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:13:10.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.734+0000 7f2c49e81640 1 -- 10.20.193.48:0/4168181613 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c38009420 con 0x7f2c4405d550 2026-02-12T18:13:10.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.734+0000 7f2c49680640 1 --2- 10.20.193.48:0/4168181613 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2c4405de60 0x7f2c4408a680 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:13:10.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.736+0000 7f2c49e81640 1 -- 10.20.193.48:0/4168181613 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2c4405d550 msgr2=0x7f2c44131c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:10.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.736+0000 7f2c49e81640 1 --2- 10.20.193.48:0/4168181613 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2c4405d550 0x7f2c44131c70 secure :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c3400b750 tx=0x7f2c3400bc20 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.736+0000 7f2c327fc640 1 -- 10.20.193.48:0/4168181613 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2c34003e90 con 0x7f2c4405d550 2026-02-12T18:13:10.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.736+0000 7f2c327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.736+0000 7f2c327fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:13:10.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.736+0000 7f2c327fc640 10 monclient: dump: 2026-02-12T18:13:10.746 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.746 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.746 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.746 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.746 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.746 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.747 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.747 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.747 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.747 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.747 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.747 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.747 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.747 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.747 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.747 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.736+0000 7f2c327fc640 10 monclient: _finish_auth 0 2026-02-12T18:13:10.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.736+0000 7f2c327fc640 10 monclient: _check_auth_tickets 2026-02-12T18:13:10.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.736+0000 7f2c327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:13:10.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.736+0000 7f2c327fc640 1 -- 10.20.193.48:0/4168181613 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2c34005530 con 0x7f2c4405d550 2026-02-12T18:13:10.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.736+0000 7f2c327fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:13:10.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.736+0000 7f2c327fc640 1 -- 10.20.193.48:0/4168181613 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2c340056a0 con 0x7f2c4405d550 2026-02-12T18:13:10.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.736+0000 7f2c4c10c640 5 monclient: authenticate success, global_id 94373 2026-02-12T18:13:10.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.736+0000 7f2c4c10c640 10 monclient: _renew_subs 2026-02-12T18:13:10.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.736+0000 7f2c4c10c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:13:10.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.736+0000 7f2c4c10c640 1 -- 10.20.193.48:0/4168181613 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c4000a5d0 con 0x7f2c4405d550 2026-02-12T18:13:10.747 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.736+0000 7f2c33fff640 4 set_mon_vals no callback set 2026-02-12T18:13:10.748 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.736+0000 7f2c327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.748 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.736+0000 7f2c327fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:13:10.748 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.736+0000 7f2c327fc640 10 monclient: dump: 2026-02-12T18:13:10.748 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.748 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.748 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.748 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.748 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.748 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.748 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.748 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.748 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.748 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.748 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.748 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.748 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.748 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.748 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.748 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.748 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.736+0000 7f2c4c10c640 10 monclient: _renew_subs 2026-02-12T18:13:10.748 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.736+0000 7f2c4c10c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:13:10.748 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.736+0000 7f2c4c10c640 1 -- 10.20.193.48:0/4168181613 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c441204a0 con 0x7f2c4405d550 2026-02-12T18:13:10.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.736+0000 7f2c4c10c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:13:10.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.737+0000 7f2c4c10c640 1 --2- 10.20.193.48:0/4168181613 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2c44091010 0x7f2c4408b100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.737+0000 7f2c4c10c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.737+0000 7f2c4c10c640 1 -- 10.20.193.48:0/4168181613 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4405f140 con 0x7f2c44091010 2026-02-12T18:13:10.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.737+0000 7f2c327fc640 1 -- 10.20.193.48:0/4168181613 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f2c34005070 con 0x7f2c4405d550 2026-02-12T18:13:10.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.737+0000 7f2c49680640 1 --2- 10.20.193.48:0/4168181613 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2c44091010 0x7f2c4408b100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.737+0000 7f2c327fc640 1 --2- 10.20.193.48:0/4168181613 >> v2:10.20.193.111:6812/977811348 conn(0x7f2c1403f800 0x7f2c1405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.737+0000 7f2c49680640 10 monclient: get_auth_request con 0x7f2c44091010 auth_method 0 2026-02-12T18:13:10.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.737+0000 7f2c49680640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.737+0000 7f2c49680640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.737+0000 7f2c49680640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.737+0000 7f2c327fc640 1 -- 10.20.193.48:0/4168181613 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(223..223 src has 198..223) ==== 3503+0+0 (secure 0 0 0) 0x7f2c34052480 con 0x7f2c4405d550 2026-02-12T18:13:10.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.737+0000 7f2c49680640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.737+0000 7f2c49680640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.737+0000 7f2c49680640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.737+0000 7f2c4a682640 1 --2- 10.20.193.48:0/4168181613 >> v2:10.20.193.111:6812/977811348 conn(0x7f2c1403f800 0x7f2c1405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.737+0000 7f2c4a682640 10 monclient: get_auth_request con 0x7f2c1403f800 auth_method 0 2026-02-12T18:13:10.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.737+0000 7f2c49680640 10 monclient(hunting): handle_auth_done global_id 94348 payload 824 2026-02-12T18:13:10.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.737+0000 7f2c49680640 1 -- 10.20.193.48:0/4168181613 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2c4405e310 con 0x7f2c44091010 2026-02-12T18:13:10.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.739+0000 7f2c49680640 1 -- 10.20.193.48:0/4168181613 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2c44091010 msgr2=0x7f2c4408b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:10.749 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.739+0000 7f2c49680640 1 --2- 10.20.193.48:0/4168181613 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2c44091010 0x7f2c4408b100 secure :-1 s=READY pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c4410dd90 tx=0x7f2c38009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.750 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.739+0000 7f2c4a682640 1 --2- 10.20.193.48:0/4168181613 >> v2:10.20.193.111:6812/977811348 conn(0x7f2c1403f800 0x7f2c1405fcb0 secure :-1 s=READY pgs=356 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c40007de0 tx=0x7f2c40007f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.750 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.740+0000 7f2c327fc640 1 -- 10.20.193.48:0/4168181613 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2c38004450 con 0x7f2c44091010 2026-02-12T18:13:10.750 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.740+0000 7f2c327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.750 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.740+0000 7f2c327fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:13:10.750 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.740+0000 7f2c327fc640 10 monclient: dump: 2026-02-12T18:13:10.750 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.750 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.750 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.750 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.750 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.750 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.750 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.750 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.750 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.750 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.750 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.750 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.750 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.750 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.750 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.750 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.750 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.740+0000 7f2c327fc640 1 -- 10.20.193.48:0/4168181613 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f2c380045b0 con 0x7f2c44091010 2026-02-12T18:13:10.751 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.740+0000 7f2c327fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:13:10.751 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.740+0000 7f2c327fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:13:10.751 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.740+0000 7f2c327fc640 1 -- 10.20.193.48:0/4168181613 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2c44091010 msgr2=0x7f2c4408b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.751 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.740+0000 7f2c327fc640 1 --2- 10.20.193.48:0/4168181613 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2c44091010 0x7f2c4408b100 secure :-1 s=READY pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c4410dd90 tx=0x7f2c38009f90 comp rx=0 tx=0).stop 2026-02-12T18:13:10.751 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.740+0000 7f2c327fc640 1 -- 10.20.193.48:0/4168181613 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2c44091010 msgr2=0x7f2c4408b100 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:13:10.751 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.740+0000 7f2c327fc640 1 --2- 10.20.193.48:0/4168181613 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2c44091010 0x7f2c4408b100 secure :-1 s=CLOSED pgs=61 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c4410dd90 tx=0x7f2c38009f90 comp rx=0 tx=0).stop 2026-02-12T18:13:10.751 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.743+0000 7f2c4c10c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:13:10.751 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.743+0000 7f2c4c10c640 1 --2- 10.20.193.48:0/4168181613 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2c441314f0 0x7f2c44121c80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.751 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.743+0000 7f2c4c10c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.751 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.743+0000 7f2c4c10c640 1 -- 10.20.193.48:0/4168181613 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2c4405fd90 con 0x7f2c441314f0 2026-02-12T18:13:10.751 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.743+0000 7f2c49680640 1 --2- 10.20.193.48:0/4168181613 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2c441314f0 0x7f2c44121c80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.751 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.743+0000 7f2c49680640 10 monclient: get_auth_request con 0x7f2c441314f0 auth_method 0 2026-02-12T18:13:10.751 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.743+0000 7f2c49680640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.751 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.743+0000 7f2c49680640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.751 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.743+0000 7f2c49680640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.751 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.743+0000 7f2c49680640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.751 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.743+0000 7f2c49680640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.751 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.743+0000 7f2c49680640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.751 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.743+0000 7f2c49680640 10 monclient(hunting): handle_auth_done global_id 94357 payload 824 2026-02-12T18:13:10.751 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.743+0000 7f2c49680640 1 -- 10.20.193.48:0/4168181613 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2c44057e00 con 0x7f2c441314f0 2026-02-12T18:13:10.752 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.746+0000 7f2c49680640 1 -- 10.20.193.48:0/4168181613 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2c441314f0 msgr2=0x7f2c44121c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:10.752 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.746+0000 7f2c49680640 1 --2- 10.20.193.48:0/4168181613 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2c441314f0 0x7f2c44121c80 secure :-1 s=READY pgs=62 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c38018000 tx=0x7f2c38004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.752 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.746+0000 7f2c327fc640 1 -- 10.20.193.48:0/4168181613 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2c38014440 con 0x7f2c441314f0 2026-02-12T18:13:10.752 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.746+0000 7f2c327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.752 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.746+0000 7f2c327fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:13:10.752 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.746+0000 7f2c327fc640 10 monclient: dump: 2026-02-12T18:13:10.753 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.753 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.753 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.753 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.753 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.753 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.753 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.753 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.753 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.753 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.753 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.753 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.753 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.753 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.753 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.753 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.753 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.746+0000 7f2c327fc640 1 -- 10.20.193.48:0/4168181613 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9981 (secure 0 0 0) 0x7f2c3801ea10 con 0x7f2c441314f0 2026-02-12T18:13:10.753 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.746+0000 7f2c327fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:13:10.753 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.746+0000 7f2c327fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:13:10.753 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.746+0000 7f2c327fc640 1 -- 10.20.193.48:0/4168181613 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2c441314f0 msgr2=0x7f2c44121c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.753 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.746+0000 7f2c327fc640 1 --2- 10.20.193.48:0/4168181613 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2c441314f0 0x7f2c44121c80 secure :-1 s=READY pgs=62 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c38018000 tx=0x7f2c38004770 comp rx=0 tx=0).stop 2026-02-12T18:13:10.753 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.746+0000 7f2c327fc640 1 -- 10.20.193.48:0/4168181613 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2c441314f0 msgr2=0x7f2c44121c80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:13:10.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.746+0000 7f2c327fc640 1 --2- 10.20.193.48:0/4168181613 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2c441314f0 0x7f2c44121c80 secure :-1 s=CLOSED pgs=62 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c38018000 tx=0x7f2c38004770 comp rx=0 tx=0).stop 2026-02-12T18:13:10.754 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:13:10.754 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:13:10.754 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:13:10.754 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:13:10.754 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 72, 2026-02-12T18:13:10.754 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 36419, 2026-02-12T18:13:10.754 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:13:10.754 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:13:10.754 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:13:10.754 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:13:10.754 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:13:10.754 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:13:10.754 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:13:10.754 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.755 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 1, 2026-02-12T18:13:10.755 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:13:10.755 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:13:10.755 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:13:10.755 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:13:10.755 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:13:10.755 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:13:10.755 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:13:10.755 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:13:10.755 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:13:10.755 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:13:10.755 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:13:10.755 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:13:10.755 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:13:10.755 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:13:10.755 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:13:10.755 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:13:10.755 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.755 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:13:10.755 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:13:10.756 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:13:10.756 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:13:10.756 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:13:10.756 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:13:10.756 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:13:10.756 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:13:10.756 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:13:10.756 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:13:10.756 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:13:10.756 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:13:10.756 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:13:10.756 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:13:10.756 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:13:10.756 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.756 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.756 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:13:10.756 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:13:10.756 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:13:10.756 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:13:10.756 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:13:10.756 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:13:10.756 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:13:10.756 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:13:10.757 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:13:10.757 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:13:10.757 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:13:10.757 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:13:10.757 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:13:10.757 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:13:10.757 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:13:10.757 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:13:10.757 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:13:10.757 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:13:10.757 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:13:10.757 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:13:10.757 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:13:10.757 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:13:10.757 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:13:10.757 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:13:10.757 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:13:10.757 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:13:10.757 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:13:10.757 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:13:10.757 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:13:10.757 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:13:10.758 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.758 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:13:10.758 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.758 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:13:10.758 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.758 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:13:10.758 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:13:10.758 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.758 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.758 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.758 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.758 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:13:10.758 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.758 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.758 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.758 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.758 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:13:10.758 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.758 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.758 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.758 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.758 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:13:10.759 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:13:10.759 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.759 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.759 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:13:10.759 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.759 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.759 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.759 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:13:10.759 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:13:10.759 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.759 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.759 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.759 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.759 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:13:10.759 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.759 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.759 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.759 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.759 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:13:10.759 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.759 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.759 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.759 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.760 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:13:10.760 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:13:10.760 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.760 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.760 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:13:10.760 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.760 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.760 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.760 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:13:10.760 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:13:10.760 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.760 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.760 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.760 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.760 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:13:10.760 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.760 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.760 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.760 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.760 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:13:10.760 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.760 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.760 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.761 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.761 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:13:10.761 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:13:10.761 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.761 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.761 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:13:10.761 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.761 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.761 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.761 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:13:10.761 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:13:10.761 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.761 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.761 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.761 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.761 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:13:10.761 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.761 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.761 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.761 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.761 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:13:10.761 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.762 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.762 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.762 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.762 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:13:10.762 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:13:10.762 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.762 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.762 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:13:10.762 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.762 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.762 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.762 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:13:10.762 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:13:10.762 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.762 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.762 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.762 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.762 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:13:10.762 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.762 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.762 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.762 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.762 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:13:10.762 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.763 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.763 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.763 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.763 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:13:10.763 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:13:10.763 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.763 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.763 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:13:10.763 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.763 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.763 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.763 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:13:10.763 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:13:10.763 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.763 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.763 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.763 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.763 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:13:10.763 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.763 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.763 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.763 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.763 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:13:10.763 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.764 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.764 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.764 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.764 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:13:10.764 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:13:10.764 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.764 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.764 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:13:10.764 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.764 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.764 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.764 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:13:10.764 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:13:10.764 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.764 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.764 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.764 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.764 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:13:10.764 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.764 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.764 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.764 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.764 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:13:10.764 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.764 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.764 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.765 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.765 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:13:10.765 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:13:10.765 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.765 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.765 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:13:10.765 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.765 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.765 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.765 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:13:10.765 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:13:10.765 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.765 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.765 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.765 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.765 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:13:10.765 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.765 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.765 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.765 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.765 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:13:10.765 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.765 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.765 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.765 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.765 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:13:10.766 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:13:10.766 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.766 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.766 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:13:10.766 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.766 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.766 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.766 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:13:10.766 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:13:10.766 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.766 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.766 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.766 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.766 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:13:10.766 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.766 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.766 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.766 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.766 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:13:10.766 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.766 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.766 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.766 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.766 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:13:10.766 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:13:10.767 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.767 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.767 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:13:10.767 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.767 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.767 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.767 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.767 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:13:10.767 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:13:10.767 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.767 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:13:10.767 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:13:10.767 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:13:10.767 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.767 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.767 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:13:10.767 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.767 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:13:10.767 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:13:10.767 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:13:10.767 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.767 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.767 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.767 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:13:10.767 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:13:10.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.746+0000 7f2c4c10c640 1 -- 10.20.193.48:0/4168181613 >> v2:10.20.193.111:6812/977811348 conn(0x7f2c1403f800 msgr2=0x7f2c1405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.746+0000 7f2c4c10c640 1 --2- 10.20.193.48:0/4168181613 >> v2:10.20.193.111:6812/977811348 conn(0x7f2c1403f800 0x7f2c1405fcb0 secure :-1 s=READY pgs=356 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c40007de0 tx=0x7f2c40007f90 comp rx=0 tx=0).stop 2026-02-12T18:13:10.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.746+0000 7f2c4c10c640 10 monclient: shutdown 2026-02-12T18:13:10.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.746+0000 7f2c4c10c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:13:10.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.746+0000 7f2c4c10c640 1 -- 10.20.193.48:0/4168181613 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2c4405d550 msgr2=0x7f2c44131c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.746+0000 7f2c4c10c640 1 --2- 10.20.193.48:0/4168181613 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f2c4405d550 0x7f2c44131c70 secure :-1 s=READY pgs=64 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2c3400b750 tx=0x7f2c3400bc20 comp rx=0 tx=0).stop 2026-02-12T18:13:10.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.746+0000 7f2c4a682640 1 -- 10.20.193.48:0/4168181613 reap_dead start 2026-02-12T18:13:10.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.746+0000 7f2c4a682640 1 -- 10.20.193.48:0/4168181613 reap_dead start 2026-02-12T18:13:10.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.746+0000 7f2c4c10c640 1 -- 10.20.193.48:0/4168181613 shutdown_connections 2026-02-12T18:13:10.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.746+0000 7f2c4c10c640 1 -- 10.20.193.48:0/4168181613 >> 10.20.193.48:0/4168181613 conn(0x7f2c440546a0 msgr2=0x7f2c4405cba0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:13:10.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.746+0000 7f2c4c10c640 1 -- 10.20.193.48:0/4168181613 shutdown_connections 2026-02-12T18:13:10.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.746+0000 7f2c4c10c640 1 -- 10.20.193.48:0/4168181613 wait complete. 2026-02-12T18:13:10.769 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2026-02-12T18:13:10.769 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon i 2026-02-12T18:13:10.769 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2026-02-12T18:13:10.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.833+0000 7facf3612640 10 monclient: get_monmap_and_config 2026-02-12T18:13:10.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.833+0000 7facf3612640 10 monclient: build_initial_monmap 2026-02-12T18:13:10.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.833+0000 7facf3612640 10 monclient: monmap: 2026-02-12T18:13:10.835 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:13:10.835 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.835 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:13:10.834971+0000 2026-02-12T18:13:10.835 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:13:10.834971+0000 2026-02-12T18:13:10.835 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:13:10.835 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.835 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:13:10.835 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:13:10.835 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:13:10.835 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:13:10.835 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:13:10.835 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:13:10.835 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:13:10.835 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:13:10.835 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:13:10.836 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:13:10.836 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:13:10.836 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf3612640 1 Processor -- start 2026-02-12T18:13:10.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf3612640 1 -- start start 2026-02-12T18:13:10.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf3612640 10 monclient: init 2026-02-12T18:13:10.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf3612640 10 monclient: _reopen_session rank -1 2026-02-12T18:13:10.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf3612640 10 monclient: _add_conns ranks=[8,9,0,2,5,10,6,7,1,4,3] 2026-02-12T18:13:10.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf3612640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7facec05c950 0x7facec05cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf3612640 10 monclient(hunting): picked mon.noname-e con 0x7facec05c950 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:13:10.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf3612640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7facec05e490 0x7facec05d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf3612640 10 monclient(hunting): picked mon.noname-a con 0x7facec05e490 addr v2:10.20.193.48:3300/0 2026-02-12T18:13:10.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf3612640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7facec13db70 addr v1:10.20.193.48:6789/0 2026-02-12T18:13:10.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf3612640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facec04dc20 con 0x7facec13db70 2026-02-12T18:13:10.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf3612640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf3612640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7facec05ddd0 con 0x7facec05e490 2026-02-12T18:13:10.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf3612640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf3612640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7facec05d7a0 con 0x7facec05c950 2026-02-12T18:13:10.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf3612640 10 monclient(hunting): _renew_subs 2026-02-12T18:13:10.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf3612640 10 monclient(hunting): authenticate will time out at 1029.560672s 2026-02-12T18:13:10.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf0b86640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7facec05e490 0x7facec05d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf1387640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7facec05c950 0x7facec05cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf1b88640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7facec13db70 0x7facec13e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:54364/0 (socket says 10.20.193.48:54364) 2026-02-12T18:13:10.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf1b88640 1 -- 10.20.193.48:0/3580964642 learned_addr learned my addr 10.20.193.48:0/3580964642 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:13:10.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf0b86640 10 monclient(hunting): get_auth_request con 0x7facec05e490 auth_method 0 2026-02-12T18:13:10.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf0b86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf0b86640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf0b86640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf1387640 10 monclient(hunting): get_auth_request con 0x7facec05c950 auth_method 0 2026-02-12T18:13:10.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf1387640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf1387640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf1387640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf0b86640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf0b86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf0b86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf1387640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf1387640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf1387640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf0b86640 10 monclient(hunting): handle_auth_done global_id 6354 payload 274 2026-02-12T18:13:10.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf0b86640 1 -- 10.20.193.48:0/3580964642 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7facec05c950 msgr2=0x7facec05cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:13:10.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf0b86640 1 --2- 10.20.193.48:0/3580964642 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7facec05c950 0x7facec05cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf0b86640 1 -- 10.20.193.48:0/3580964642 >> v1:10.20.193.48:6789/0 conn(0x7facec13db70 legacy=0x7facec13e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:13:10.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf0b86640 10 monclient: _finish_hunting 0 2026-02-12T18:13:10.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf0b86640 1 monclient: found mon.noname-a 2026-02-12T18:13:10.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf0b86640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:13:10.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf0b86640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:13:10.839 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.834+0000 7facf0b86640 1 -- 10.20.193.48:0/3580964642 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facec092990 con 0x7facec05e490 2026-02-12T18:13:10.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.837+0000 7facf0b86640 1 -- 10.20.193.48:0/3580964642 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7facec05e490 msgr2=0x7facec05d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:10.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.837+0000 7facf0b86640 1 --2- 10.20.193.48:0/3580964642 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7facec05e490 0x7facec05d260 secure :-1 s=READY pgs=517 gs=3 cs=0 l=1 c_cookie=14496320219508934638 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7face0004740 tx=0x7face002ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c92d466f522487ee server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.837+0000 7facdbfff640 1 -- 10.20.193.48:0/3580964642 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7face002fe50 con 0x7facec05e490 2026-02-12T18:13:10.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.837+0000 7facdbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.837+0000 7facdbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:13:10.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.837+0000 7facdbfff640 10 monclient: dump: 2026-02-12T18:13:10.841 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.841 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.841 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.841 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.841 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.841 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.841 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.841 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.842 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.842 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.842 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.842 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.842 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.842 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.842 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.842 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.837+0000 7facdbfff640 10 monclient: _finish_auth 0 2026-02-12T18:13:10.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.837+0000 7facdbfff640 10 monclient: _check_auth_tickets 2026-02-12T18:13:10.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.837+0000 7facdbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:13:10.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.837+0000 7facdbfff640 1 -- 10.20.193.48:0/3580964642 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face0035340 con 0x7facec05e490 2026-02-12T18:13:10.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.837+0000 7facf3612640 5 monclient: authenticate success, global_id 6354 2026-02-12T18:13:10.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.837+0000 7facf3612640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:13:10.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.837+0000 7facdbfff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:13:10.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.837+0000 7facf3612640 10 monclient: get_monmap_and_config success 2026-02-12T18:13:10.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.837+0000 7facdbfff640 1 -- 10.20.193.48:0/3580964642 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7face0035970 con 0x7facec05e490 2026-02-12T18:13:10.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.837+0000 7facdbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.837+0000 7facf3612640 4 set_mon_vals no callback set 2026-02-12T18:13:10.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.837+0000 7facdbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:13:10.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.837+0000 7facdbfff640 10 monclient: dump: 2026-02-12T18:13:10.842 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.842 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.842 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.843 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.843 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.843 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.843 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.843 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.843 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.843 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.843 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.843 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.843 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.843 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.843 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.843 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.837+0000 7facf3612640 10 monclient: shutdown 2026-02-12T18:13:10.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.837+0000 7facf3612640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:13:10.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.837+0000 7facf3612640 1 -- 10.20.193.48:0/3580964642 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7facec05e490 msgr2=0x7facec05d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.837+0000 7facf3612640 1 --2- 10.20.193.48:0/3580964642 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7facec05e490 0x7facec05d260 secure :-1 s=READY pgs=517 gs=3 cs=0 l=1 c_cookie=14496320219508934638 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7face0004740 tx=0x7face002ed10 comp rx=0 tx=0).stop 2026-02-12T18:13:10.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.838+0000 7facf3612640 1 -- 10.20.193.48:0/3580964642 shutdown_connections 2026-02-12T18:13:10.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.838+0000 7facf3612640 1 --2- 10.20.193.48:0/3580964642 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7facec05e490 0x7facec05d260 unknown :-1 s=CLOSED pgs=517 gs=3 cs=0 l=1 c_cookie=14496320219508934638 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.838+0000 7facf3612640 1 --2- 10.20.193.48:0/3580964642 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7facec05c950 0x7facec05cd20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.838+0000 7facf3612640 1 -- 10.20.193.48:0/3580964642 >> 10.20.193.48:0/3580964642 conn(0x7facec0548a0 msgr2=0x7facec097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:13:10.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.838+0000 7facf3612640 1 -- 10.20.193.48:0/3580964642 shutdown_connections 2026-02-12T18:13:10.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.838+0000 7facf3612640 1 -- 10.20.193.48:0/3580964642 wait complete. 2026-02-12T18:13:10.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.838+0000 7facf3612640 10 monclient: build_initial_monmap 2026-02-12T18:13:10.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.838+0000 7facf3612640 10 monclient: monmap: 2026-02-12T18:13:10.844 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:13:10.844 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:13:10.844 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:13:10.844 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:13:10.844 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:13:10.844 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.844 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:13:10.844 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:13:10.844 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:13:10.844 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:13:10.844 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:13:10.844 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:13:10.844 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:13:10.844 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:13:10.844 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:13:10.844 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.838+0000 7facf3612640 1 Processor -- start 2026-02-12T18:13:10.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.838+0000 7facf3612640 1 -- start start 2026-02-12T18:13:10.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.838+0000 7facf3612640 10 monclient: init 2026-02-12T18:13:10.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.838+0000 7facf3612640 10 monclient: _reopen_session rank -1 2026-02-12T18:13:10.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.838+0000 7facf3612640 10 monclient: _add_conns ranks=[6,8,1,4,0,7,3,2,5] 2026-02-12T18:13:10.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.838+0000 7facf3612640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7facec05c950 0x7facec12c8d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.838+0000 7facf3612640 10 monclient(hunting): picked mon.noname-d con 0x7facec05c950 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:13:10.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.838+0000 7facf3612640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7facec05e490 0x7facec08d2f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.838+0000 7facf3612640 10 monclient(hunting): picked mon.noname-e con 0x7facec05e490 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:13:10.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.838+0000 7facf3612640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7facec13db70 0x7facec08d830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.838+0000 7facf3612640 10 monclient(hunting): picked mon.noname-f con 0x7facec13db70 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:13:10.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.838+0000 7facf3612640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.838+0000 7facf3612640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7facec12ce10 con 0x7facec13db70 2026-02-12T18:13:10.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.838+0000 7facf3612640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.838+0000 7facf3612640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7facec141470 con 0x7facec05c950 2026-02-12T18:13:10.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.838+0000 7facf3612640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.838+0000 7facf3612640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7facec13e8c0 con 0x7facec05e490 2026-02-12T18:13:10.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.838+0000 7facf3612640 10 monclient(hunting): _renew_subs 2026-02-12T18:13:10.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.839+0000 7facf3612640 10 monclient(hunting): authenticate will time out at 1029.565006s 2026-02-12T18:13:10.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.839+0000 7facf1387640 1 -- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7facec05c950 msgr2=0x7facec12c8d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.48:3303/0 2026-02-12T18:13:10.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.839+0000 7facf1387640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7facec05c950 0x7facec12c8d0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:13:10.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.839+0000 7facf0b86640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7facec05e490 0x7facec08d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.839+0000 7facf0b86640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7facec05e490 0x7facec08d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:50192/0 (socket says 10.20.193.48:50192) 2026-02-12T18:13:10.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.839+0000 7facf0b86640 1 -- 10.20.193.48:0/1714109768 learned_addr learned my addr 10.20.193.48:0/1714109768 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:13:10.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.839+0000 7facf0b86640 10 monclient(hunting): get_auth_request con 0x7facec05e490 auth_method 0 2026-02-12T18:13:10.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.839+0000 7facf0b86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.839+0000 7facf0b86640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.839+0000 7facf0b86640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.839+0000 7facf0b86640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.839+0000 7facf0b86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.845 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.839+0000 7facf0b86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.839+0000 7facf1b88640 1 --2- 10.20.193.48:0/1714109768 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7facec13db70 0x7facec08d830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.839+0000 7facf0b86640 10 monclient(hunting): handle_auth_done global_id 94391 payload 824 2026-02-12T18:13:10.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.839+0000 7facf0b86640 1 -- 10.20.193.48:0/1714109768 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7facec05c950 msgr2=0x7facec12c8d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:13:10.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.839+0000 7facf0b86640 1 --2- 10.20.193.48:0/1714109768 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7facec05c950 0x7facec12c8d0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.839+0000 7facf0b86640 1 -- 10.20.193.48:0/1714109768 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7facec13db70 msgr2=0x7facec08d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.839+0000 7facf0b86640 1 --2- 10.20.193.48:0/1714109768 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7facec13db70 0x7facec08d830 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.839+0000 7facf0b86640 10 monclient: _finish_hunting 0 2026-02-12T18:13:10.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.839+0000 7facf0b86640 1 monclient: found mon.noname-e 2026-02-12T18:13:10.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.839+0000 7facf0b86640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:13:10.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.839+0000 7facf0b86640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:13:10.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.839+0000 7facf0b86640 1 -- 10.20.193.48:0/1714109768 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face0009420 con 0x7facec05e490 2026-02-12T18:13:10.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.839+0000 7facf1b88640 10 monclient: get_auth_request con 0x7facec13db70 auth_method 0 2026-02-12T18:13:10.846 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.839+0000 7facf1b88640 1 --2- 10.20.193.48:0/1714109768 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7facec13db70 0x7facec08d830 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-12T18:13:10.848 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.841+0000 7facf0b86640 1 -- 10.20.193.48:0/1714109768 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7facec05e490 msgr2=0x7facec08d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:10.848 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.841+0000 7facf0b86640 1 --2- 10.20.193.48:0/1714109768 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7facec05e490 0x7facec08d2f0 secure :-1 s=READY pgs=65 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7face002f220 tx=0x7face0004770 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.848 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.841+0000 7facd9ffb640 1 -- 10.20.193.48:0/1714109768 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7face002fdb0 con 0x7facec05e490 2026-02-12T18:13:10.848 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.841+0000 7facd9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.848 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.841+0000 7facd9ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:13:10.848 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.841+0000 7facd9ffb640 10 monclient: dump: 2026-02-12T18:13:10.848 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.848 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.848 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.848 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.848 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.848 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.849 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.849 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.849 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.849 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.849 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.849 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.849 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.849 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.849 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.849 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.841+0000 7facd9ffb640 10 monclient: _finish_auth 0 2026-02-12T18:13:10.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.841+0000 7facd9ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:13:10.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.841+0000 7facd9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:13:10.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.841+0000 7facd9ffb640 1 -- 10.20.193.48:0/1714109768 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face0004500 con 0x7facec05e490 2026-02-12T18:13:10.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.841+0000 7facd9ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:13:10.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.841+0000 7facd9ffb640 1 -- 10.20.193.48:0/1714109768 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7face0003b90 con 0x7facec05e490 2026-02-12T18:13:10.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.841+0000 7facd9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.841+0000 7facd9ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:13:10.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.841+0000 7facdb7fe640 4 set_mon_vals no callback set 2026-02-12T18:13:10.849 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.841+0000 7facd9ffb640 10 monclient: dump: 2026-02-12T18:13:10.849 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.849 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.849 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.849 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.850 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.850 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.850 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.850 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.850 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.850 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.850 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.850 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.850 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.850 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.850 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.850 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.841+0000 7facf3612640 5 monclient: authenticate success, global_id 94391 2026-02-12T18:13:10.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.841+0000 7facf3612640 10 monclient: _renew_subs 2026-02-12T18:13:10.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.841+0000 7facf3612640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:13:10.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.841+0000 7facf3612640 1 -- 10.20.193.48:0/1714109768 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facec13e390 con 0x7facec05e490 2026-02-12T18:13:10.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.841+0000 7facf3612640 10 monclient: _renew_subs 2026-02-12T18:13:10.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.841+0000 7facf3612640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:13:10.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.841+0000 7facf3612640 1 -- 10.20.193.48:0/1714109768 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7facec143b50 con 0x7facec05e490 2026-02-12T18:13:10.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.842+0000 7facf3612640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:13:10.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.842+0000 7facd9ffb640 1 -- 10.20.193.48:0/1714109768 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7face004f020 con 0x7facec05e490 2026-02-12T18:13:10.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.842+0000 7facf3612640 1 --2- 10.20.193.48:0/1714109768 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7facec13cd00 0x7facec13d0d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.842+0000 7facf3612640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.842+0000 7facf3612640 1 -- 10.20.193.48:0/1714109768 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7facec05f140 con 0x7facec13cd00 2026-02-12T18:13:10.850 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.842+0000 7facd9ffb640 1 --2- 10.20.193.48:0/1714109768 >> v2:10.20.193.111:6812/977811348 conn(0x7facbc03f7c0 0x7facbc05fc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.851 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.842+0000 7facd9ffb640 1 -- 10.20.193.48:0/1714109768 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(223..223 src has 198..223) ==== 3503+0+0 (secure 0 0 0) 0x7face0077a70 con 0x7facec05e490 2026-02-12T18:13:10.851 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.842+0000 7facf1387640 1 --2- 10.20.193.48:0/1714109768 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7facec13cd00 0x7facec13d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.851 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.842+0000 7facf1387640 10 monclient: get_auth_request con 0x7facec13cd00 auth_method 0 2026-02-12T18:13:10.851 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.842+0000 7facf1387640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.851 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.842+0000 7facf1387640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.851 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.842+0000 7facf1387640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.851 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.842+0000 7facf1b88640 1 --2- 10.20.193.48:0/1714109768 >> v2:10.20.193.111:6812/977811348 conn(0x7facbc03f7c0 0x7facbc05fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.851 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.842+0000 7facf1387640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.851 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.842+0000 7facf1387640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.851 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.842+0000 7facf1387640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.851 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.842+0000 7facf1b88640 10 monclient: get_auth_request con 0x7facbc03f7c0 auth_method 0 2026-02-12T18:13:10.851 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.842+0000 7facf1387640 10 monclient(hunting): handle_auth_done global_id 94309 payload 824 2026-02-12T18:13:10.851 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.842+0000 7facf1387640 1 -- 10.20.193.48:0/1714109768 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7facec097de0 con 0x7facec13cd00 2026-02-12T18:13:10.851 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.845+0000 7facf1b88640 1 --2- 10.20.193.48:0/1714109768 >> v2:10.20.193.111:6812/977811348 conn(0x7facbc03f7c0 0x7facbc05fc70 secure :-1 s=READY pgs=357 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7face8005980 tx=0x7face800a040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.851 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.845+0000 7facf1387640 1 -- 10.20.193.48:0/1714109768 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7facec13cd00 msgr2=0x7facec13d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:10.851 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.845+0000 7facf1387640 1 --2- 10.20.193.48:0/1714109768 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7facec13cd00 0x7facec13d0d0 secure :-1 s=READY pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7facdc00e770 tx=0x7facdc00ec40 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.851 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.845+0000 7facd9ffb640 1 -- 10.20.193.48:0/1714109768 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7facdc00cbc0 con 0x7facec13cd00 2026-02-12T18:13:10.851 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.845+0000 7facd9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.851 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.845+0000 7facd9ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:13:10.851 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.845+0000 7facd9ffb640 10 monclient: dump: 2026-02-12T18:13:10.851 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.851 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.851 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.852 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.852 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.852 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.852 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.852 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.852 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.852 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.852 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.852 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.852 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.852 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.852 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.852 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.852 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.845+0000 7facd9ffb640 1 -- 10.20.193.48:0/1714109768 <== mon.7 v2:10.20.193.111:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7facdc00cd20 con 0x7facec13cd00 2026-02-12T18:13:10.852 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.845+0000 7facd9ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:13:10.852 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.845+0000 7facd9ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:13:10.852 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.845+0000 7facd9ffb640 1 -- 10.20.193.48:0/1714109768 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7facec13cd00 msgr2=0x7facec13d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.852 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.845+0000 7facd9ffb640 1 --2- 10.20.193.48:0/1714109768 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7facec13cd00 0x7facec13d0d0 secure :-1 s=READY pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7facdc00e770 tx=0x7facdc00ec40 comp rx=0 tx=0).stop 2026-02-12T18:13:10.852 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.845+0000 7facd9ffb640 1 -- 10.20.193.48:0/1714109768 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7facec13cd00 msgr2=0x7facec13d0d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:13:10.852 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.845+0000 7facd9ffb640 1 --2- 10.20.193.48:0/1714109768 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7facec13cd00 0x7facec13d0d0 secure :-1 s=CLOSED pgs=51 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7facdc00e770 tx=0x7facdc00ec40 comp rx=0 tx=0).stop 2026-02-12T18:13:10.853 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.848+0000 7facf3612640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:13:10.853 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.848+0000 7facf3612640 1 --2- 10.20.193.48:0/1714109768 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7facec13d610 0x7facec13f070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:13:10.853 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.848+0000 7facf3612640 10 monclient(hunting): start opening mon connection 2026-02-12T18:13:10.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.848+0000 7facf3612640 1 -- 10.20.193.48:0/1714109768 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7facec05fd90 con 0x7facec13d610 2026-02-12T18:13:10.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.849+0000 7facf1387640 1 --2- 10.20.193.48:0/1714109768 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7facec13d610 0x7facec13f070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:13:10.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.849+0000 7facf1387640 10 monclient: get_auth_request con 0x7facec13d610 auth_method 0 2026-02-12T18:13:10.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.849+0000 7facf1387640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:13:10.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.849+0000 7facf1387640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:13:10.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.849+0000 7facf1387640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:13:10.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.849+0000 7facf1387640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:13:10.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.849+0000 7facf1387640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:13:10.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.849+0000 7facf1387640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:13:10.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.849+0000 7facf1387640 10 monclient(hunting): handle_auth_done global_id 94318 payload 824 2026-02-12T18:13:10.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.849+0000 7facf1387640 1 -- 10.20.193.48:0/1714109768 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7facec13d9e0 con 0x7facec13d610 2026-02-12T18:13:10.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.851+0000 7facf1387640 1 -- 10.20.193.48:0/1714109768 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7facec13d610 msgr2=0x7facec13f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:13:10.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.851+0000 7facf1387640 1 --2- 10.20.193.48:0/1714109768 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7facec13d610 0x7facec13f070 secure :-1 s=READY pgs=52 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7facdc016000 tx=0x7facdc0047e0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:13:10.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.851+0000 7facd9ffb640 1 -- 10.20.193.48:0/1714109768 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7facdc022070 con 0x7facec13d610 2026-02-12T18:13:10.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.851+0000 7facd9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:13:10.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.851+0000 7facd9ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:13:10.854 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.851+0000 7facd9ffb640 10 monclient: dump: 2026-02-12T18:13:10.854 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:13:10.854 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:13:10.854 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.854 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:13:10.854 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:13:10.854 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:13:10.855 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:13:10.855 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:13:10.855 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:13:10.855 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:13:10.855 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:13:10.855 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:13:10.855 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:13:10.855 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:13:10.855 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:13:10.855 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:13:10.855 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.851+0000 7facd9ffb640 1 -- 10.20.193.48:0/1714109768 <== mon.7 v2:10.20.193.111:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10315 (secure 0 0 0) 0x7facdc006820 con 0x7facec13d610 2026-02-12T18:13:10.855 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.851+0000 7facd9ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:13:10.855 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.851+0000 7facd9ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:13:10.855 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.851+0000 7facd9ffb640 1 -- 10.20.193.48:0/1714109768 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7facec13d610 msgr2=0x7facec13f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.855 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.851+0000 7facd9ffb640 1 --2- 10.20.193.48:0/1714109768 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7facec13d610 0x7facec13f070 secure :-1 s=READY pgs=52 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7facdc016000 tx=0x7facdc0047e0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.855 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.851+0000 7facd9ffb640 1 -- 10.20.193.48:0/1714109768 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7facec13d610 msgr2=0x7facec13f070 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:13:10.855 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.851+0000 7facd9ffb640 1 --2- 10.20.193.48:0/1714109768 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7facec13d610 0x7facec13f070 secure :-1 s=CLOSED pgs=52 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7facdc016000 tx=0x7facdc0047e0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.855 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:13:10.855 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:13:10.855 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:13:10.856 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:13:10.856 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 72, 2026-02-12T18:13:10.856 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 36535, 2026-02-12T18:13:10.856 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:13:10.856 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:13:10.856 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:13:10.856 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:13:10.856 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:13:10.856 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:13:10.856 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:13:10.856 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.856 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 2, 2026-02-12T18:13:10.856 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:13:10.856 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:13:10.856 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:13:10.856 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:13:10.856 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:13:10.856 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:13:10.856 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:13:10.856 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:13:10.856 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:13:10.856 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:13:10.856 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:13:10.857 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:13:10.857 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:13:10.857 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:13:10.857 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:13:10.857 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:13:10.857 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.857 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:13:10.857 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:13:10.857 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:13:10.857 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:13:10.857 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:13:10.857 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:13:10.857 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:13:10.857 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:13:10.857 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:13:10.857 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:13:10.857 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:13:10.857 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:13:10.857 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:13:10.857 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:13:10.857 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:13:10.857 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.857 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.857 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:13:10.858 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:13:10.858 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:13:10.858 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:13:10.858 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:13:10.858 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:13:10.858 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:13:10.858 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:13:10.858 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:13:10.858 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:13:10.858 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:13:10.858 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:13:10.858 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:13:10.858 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:13:10.858 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:13:10.858 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:13:10.858 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:13:10.858 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:13:10.858 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:13:10.858 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:13:10.858 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:13:10.858 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:13:10.858 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:13:10.858 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:13:10.858 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:13:10.858 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:13:10.859 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:13:10.859 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:13:10.859 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:13:10.859 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:13:10.859 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.859 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:13:10.859 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.859 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:13:10.859 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.859 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:13:10.859 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:13:10.859 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.859 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.859 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.859 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.859 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:13:10.859 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.859 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.859 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.859 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.859 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:13:10.859 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.859 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.859 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.860 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.860 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:13:10.860 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:13:10.860 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.860 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.860 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:13:10.860 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.860 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.860 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.860 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:13:10.860 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:13:10.860 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.860 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.860 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.860 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.860 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:13:10.860 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.860 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.860 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.860 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.860 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:13:10.860 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.860 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.860 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.860 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.860 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:13:10.861 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:13:10.861 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.861 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.861 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:13:10.861 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.861 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.861 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.861 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:13:10.861 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:13:10.861 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.861 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.861 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.861 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.861 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:13:10.861 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.861 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.861 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.861 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.861 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:13:10.861 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.861 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.861 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.861 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.861 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:13:10.862 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:13:10.862 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.862 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.862 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:13:10.862 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.862 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.862 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.862 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:13:10.862 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:13:10.862 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.862 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.862 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.862 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.862 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:13:10.862 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.862 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.862 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.862 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.862 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:13:10.862 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.862 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.862 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.862 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.862 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:13:10.862 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:13:10.862 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.863 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.863 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:13:10.863 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.863 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.863 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.863 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:13:10.863 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:13:10.863 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.863 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.863 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.863 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.863 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:13:10.863 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.863 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.863 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.863 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.863 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:13:10.863 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.863 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.863 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.863 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.863 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:13:10.863 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:13:10.863 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.863 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.864 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:13:10.864 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.864 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.864 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.864 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:13:10.864 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:13:10.864 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.864 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.864 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.864 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.864 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:13:10.864 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.864 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.864 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.864 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.864 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:13:10.864 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.864 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.864 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.864 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.864 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:13:10.864 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:13:10.864 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.864 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.864 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:13:10.865 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.865 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.865 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.865 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:13:10.865 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:13:10.865 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.865 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.865 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.865 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.865 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:13:10.865 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.865 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.865 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.865 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.865 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:13:10.865 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.865 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.865 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.865 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.865 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:13:10.865 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:13:10.865 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.865 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.865 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:13:10.865 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.866 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.866 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.866 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:13:10.866 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:13:10.866 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.866 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.866 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.866 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.866 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:13:10.866 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.866 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.866 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.866 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.866 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:13:10.866 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.866 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.866 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.866 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.866 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:13:10.866 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:13:10.866 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.866 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.866 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:13:10.866 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.866 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.867 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.867 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:13:10.867 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:13:10.867 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:13:10.867 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:13:10.867 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.867 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:13:10.867 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:13:10.867 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.867 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.867 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.867 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:13:10.867 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:13:10.867 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:13:10.867 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.867 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.867 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.867 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:13:10.867 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:13:10.867 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:13:10.867 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:13:10.867 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:13:10.867 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:13:10.867 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: "mgr": [ 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:13:10.868 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:13:10.869 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:13:10.869 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:13:10.869 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:13:10.869 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:13:10.869 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:13:10.869 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:13:10.869 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.852+0000 7facf3612640 1 -- 10.20.193.48:0/1714109768 >> v2:10.20.193.111:6812/977811348 conn(0x7facbc03f7c0 msgr2=0x7facbc05fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.869 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.852+0000 7facf3612640 1 --2- 10.20.193.48:0/1714109768 >> v2:10.20.193.111:6812/977811348 conn(0x7facbc03f7c0 0x7facbc05fc70 secure :-1 s=READY pgs=357 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7face8005980 tx=0x7face800a040 comp rx=0 tx=0).stop 2026-02-12T18:13:10.869 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.852+0000 7facf3612640 10 monclient: shutdown 2026-02-12T18:13:10.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.852+0000 7facf3612640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:13:10.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.852+0000 7facf3612640 1 -- 10.20.193.48:0/1714109768 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7facec05e490 msgr2=0x7facec08d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:13:10.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.852+0000 7facf1b88640 1 -- 10.20.193.48:0/1714109768 reap_dead start 2026-02-12T18:13:10.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.852+0000 7facf3612640 1 --2- 10.20.193.48:0/1714109768 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7facec05e490 0x7facec08d2f0 secure :-1 s=READY pgs=65 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7face002f220 tx=0x7face0004770 comp rx=0 tx=0).stop 2026-02-12T18:13:10.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.852+0000 7facf3612640 1 -- 10.20.193.48:0/1714109768 shutdown_connections 2026-02-12T18:13:10.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.852+0000 7facf3612640 1 --2- 10.20.193.48:0/1714109768 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7facec05e490 0x7facec08d2f0 unknown :-1 s=CLOSED pgs=65 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:13:10.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.852+0000 7facf3612640 1 -- 10.20.193.48:0/1714109768 >> 10.20.193.48:0/1714109768 conn(0x7facec0548a0 msgr2=0x7facec093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:13:10.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.852+0000 7facf3612640 1 -- 10.20.193.48:0/1714109768 shutdown_connections 2026-02-12T18:13:10.870 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:13:10.852+0000 7facf3612640 1 -- 10.20.193.48:0/1714109768 wait complete. 2026-02-12T18:13:10.870 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2026-02-12T18:13:10.870 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-12T18:13:13.327 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30669]: starting. 2026-02-12T18:13:13.327 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30669]: creating pool ceph_test_rados_delete_pools_parallel.trial111-30668 2026-02-12T18:13:13.327 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30669]: created object 0... 2026-02-12T18:13:13.328 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30669]: created object 25... 2026-02-12T18:13:13.328 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30669]: created object 49... 2026-02-12T18:13:13.328 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30669]: finishing. 2026-02-12T18:13:13.328 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30669]: shutting down. 2026-02-12T18:13:14.273 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[30670]: starting. 2026-02-12T18:13:14.274 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[30670]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-30668 2026-02-12T18:13:14.274 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[30670]: shutting down. 2026-02-12T18:13:16.337 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:16.337 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30703]: starting. 2026-02-12T18:13:16.338 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30703]: creating pool ceph_test_rados_delete_pools_parallel.trial111-30668 2026-02-12T18:13:16.338 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30703]: created object 0... 2026-02-12T18:13:16.338 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30703]: created object 25... 2026-02-12T18:13:16.338 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30703]: created object 49... 2026-02-12T18:13:16.338 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30703]: finishing. 2026-02-12T18:13:16.338 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30703]: shutting down. 2026-02-12T18:13:17.198 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:17.199 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30705]: starting. 2026-02-12T18:13:17.199 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30705]: listing objects. 2026-02-12T18:13:17.199 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30705]: listed object 0... 2026-02-12T18:13:17.199 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30705]: listed object 25... 2026-02-12T18:13:17.199 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30705]: saw 50 objects 2026-02-12T18:13:17.199 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30705]: shutting down. 2026-02-12T18:13:17.281 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:17.281 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[30704]: starting. 2026-02-12T18:13:17.281 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[30704]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-30668 2026-02-12T18:13:17.281 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[30704]: shutting down. 2026-02-12T18:13:17.282 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:17.282 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:17.282 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:13:17.284 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:13:19.403 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30779]: starting. 2026-02-12T18:13:19.404 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30779]: creating pool ceph_test_rados_delete_pools_parallel.trial111-30778 2026-02-12T18:13:19.404 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30779]: created object 0... 2026-02-12T18:13:19.404 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30779]: created object 25... 2026-02-12T18:13:19.404 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30779]: created object 49... 2026-02-12T18:13:19.404 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30779]: finishing. 2026-02-12T18:13:19.404 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30779]: shutting down. 2026-02-12T18:13:20.433 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[30780]: starting. 2026-02-12T18:13:20.433 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[30780]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-30778 2026-02-12T18:13:20.434 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[30780]: shutting down. 2026-02-12T18:13:22.629 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:22.629 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30813]: starting. 2026-02-12T18:13:22.629 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30813]: creating pool ceph_test_rados_delete_pools_parallel.trial111-30778 2026-02-12T18:13:22.629 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30813]: created object 0... 2026-02-12T18:13:22.630 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30813]: created object 25... 2026-02-12T18:13:22.630 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30813]: created object 49... 2026-02-12T18:13:22.630 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30813]: finishing. 2026-02-12T18:13:22.630 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30813]: shutting down. 2026-02-12T18:13:22.662 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:22.662 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30815]: starting. 2026-02-12T18:13:22.662 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30815]: listing objects. 2026-02-12T18:13:22.662 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30815]: listed object 0... 2026-02-12T18:13:22.662 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30815]: listed object 25... 2026-02-12T18:13:22.662 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30815]: saw 50 objects 2026-02-12T18:13:22.662 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30815]: shutting down. 2026-02-12T18:13:23.572 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:23.572 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[30814]: starting. 2026-02-12T18:13:23.572 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[30814]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-30778 2026-02-12T18:13:23.572 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[30814]: shutting down. 2026-02-12T18:13:23.573 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:23.573 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:23.573 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:13:23.575 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:13:25.634 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30889]: starting. 2026-02-12T18:13:25.634 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30889]: creating pool ceph_test_rados_delete_pools_parallel.trial111-30888 2026-02-12T18:13:25.634 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30889]: created object 0... 2026-02-12T18:13:25.634 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30889]: created object 25... 2026-02-12T18:13:25.634 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30889]: created object 49... 2026-02-12T18:13:25.634 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30889]: finishing. 2026-02-12T18:13:25.635 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30889]: shutting down. 2026-02-12T18:13:26.584 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[30890]: starting. 2026-02-12T18:13:26.585 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[30890]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-30888 2026-02-12T18:13:26.585 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[30890]: shutting down. 2026-02-12T18:13:29.267 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:29.267 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30923]: starting. 2026-02-12T18:13:29.267 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30923]: creating pool ceph_test_rados_delete_pools_parallel.trial111-30888 2026-02-12T18:13:29.268 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30923]: created object 0... 2026-02-12T18:13:29.268 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30923]: created object 25... 2026-02-12T18:13:29.268 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30923]: created object 49... 2026-02-12T18:13:29.268 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30923]: finishing. 2026-02-12T18:13:29.268 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[30923]: shutting down. 2026-02-12T18:13:29.299 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:29.300 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30925]: starting. 2026-02-12T18:13:29.300 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30925]: listing objects. 2026-02-12T18:13:29.300 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30925]: listed object 0... 2026-02-12T18:13:29.300 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30925]: listed object 25... 2026-02-12T18:13:29.300 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30925]: saw 50 objects 2026-02-12T18:13:29.300 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[30925]: shutting down. 2026-02-12T18:13:30.214 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:30.214 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[30924]: starting. 2026-02-12T18:13:30.215 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[30924]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-30888 2026-02-12T18:13:30.215 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[30924]: shutting down. 2026-02-12T18:13:30.215 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:30.216 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:30.216 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:13:30.218 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:13:33.028 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30999]: starting. 2026-02-12T18:13:33.028 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30999]: creating pool ceph_test_rados_delete_pools_parallel.trial111-30998 2026-02-12T18:13:33.029 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30999]: created object 0... 2026-02-12T18:13:33.029 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30999]: created object 25... 2026-02-12T18:13:33.029 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30999]: created object 49... 2026-02-12T18:13:33.029 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30999]: finishing. 2026-02-12T18:13:33.029 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[30999]: shutting down. 2026-02-12T18:13:33.957 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31000]: starting. 2026-02-12T18:13:33.958 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31000]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-30998 2026-02-12T18:13:33.958 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31000]: shutting down. 2026-02-12T18:13:36.406 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:36.407 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31033]: starting. 2026-02-12T18:13:36.407 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31033]: creating pool ceph_test_rados_delete_pools_parallel.trial111-30998 2026-02-12T18:13:36.407 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31033]: created object 0... 2026-02-12T18:13:36.407 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31033]: created object 25... 2026-02-12T18:13:36.407 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31033]: created object 49... 2026-02-12T18:13:36.407 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31033]: finishing. 2026-02-12T18:13:36.407 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31033]: shutting down. 2026-02-12T18:13:36.640 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:36.641 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31035]: starting. 2026-02-12T18:13:36.641 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31035]: listing objects. 2026-02-12T18:13:36.641 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31035]: listed object 0... 2026-02-12T18:13:36.641 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31035]: listed object 25... 2026-02-12T18:13:36.641 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31035]: saw 50 objects 2026-02-12T18:13:36.641 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31035]: shutting down. 2026-02-12T18:13:37.343 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:37.344 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31034]: starting. 2026-02-12T18:13:37.344 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31034]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-30998 2026-02-12T18:13:37.344 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31034]: shutting down. 2026-02-12T18:13:37.344 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:37.345 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:37.345 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:13:37.347 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:13:39.423 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31109]: starting. 2026-02-12T18:13:39.423 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31109]: creating pool ceph_test_rados_delete_pools_parallel.trial111-31108 2026-02-12T18:13:39.423 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31109]: created object 0... 2026-02-12T18:13:39.423 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31109]: created object 25... 2026-02-12T18:13:39.423 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31109]: created object 49... 2026-02-12T18:13:39.423 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31109]: finishing. 2026-02-12T18:13:39.424 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31109]: shutting down. 2026-02-12T18:13:40.360 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31110]: starting. 2026-02-12T18:13:40.361 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31110]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-31108 2026-02-12T18:13:40.361 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31110]: shutting down. 2026-02-12T18:13:42.626 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:42.626 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31143]: starting. 2026-02-12T18:13:42.626 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31143]: creating pool ceph_test_rados_delete_pools_parallel.trial111-31108 2026-02-12T18:13:42.627 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31143]: created object 0... 2026-02-12T18:13:42.627 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31143]: created object 25... 2026-02-12T18:13:42.627 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31143]: created object 49... 2026-02-12T18:13:42.627 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31143]: finishing. 2026-02-12T18:13:42.627 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31143]: shutting down. 2026-02-12T18:13:42.861 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:42.861 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31145]: starting. 2026-02-12T18:13:42.861 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31145]: listing objects. 2026-02-12T18:13:42.861 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31145]: listed object 0... 2026-02-12T18:13:42.861 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31145]: listed object 25... 2026-02-12T18:13:42.861 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31145]: saw 50 objects 2026-02-12T18:13:42.861 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31145]: shutting down. 2026-02-12T18:13:44.436 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:44.436 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31144]: starting. 2026-02-12T18:13:44.436 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31144]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-31108 2026-02-12T18:13:44.436 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31144]: shutting down. 2026-02-12T18:13:44.437 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:44.437 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:44.437 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:13:44.439 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:13:46.288 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31219]: starting. 2026-02-12T18:13:46.288 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31219]: creating pool ceph_test_rados_delete_pools_parallel.trial111-31218 2026-02-12T18:13:46.288 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31219]: created object 0... 2026-02-12T18:13:46.289 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31219]: created object 25... 2026-02-12T18:13:46.289 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31219]: created object 49... 2026-02-12T18:13:46.289 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31219]: finishing. 2026-02-12T18:13:46.289 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31219]: shutting down. 2026-02-12T18:13:47.228 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31220]: starting. 2026-02-12T18:13:47.228 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31220]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-31218 2026-02-12T18:13:47.228 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31220]: shutting down. 2026-02-12T18:13:49.294 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:49.294 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31253]: starting. 2026-02-12T18:13:49.295 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31253]: creating pool ceph_test_rados_delete_pools_parallel.trial111-31218 2026-02-12T18:13:49.295 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31253]: created object 0... 2026-02-12T18:13:49.295 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31253]: created object 25... 2026-02-12T18:13:49.295 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31253]: created object 49... 2026-02-12T18:13:49.295 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31253]: finishing. 2026-02-12T18:13:49.295 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31253]: shutting down. 2026-02-12T18:13:49.332 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:49.332 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31255]: starting. 2026-02-12T18:13:49.332 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31255]: listing objects. 2026-02-12T18:13:49.332 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31255]: listed object 0... 2026-02-12T18:13:49.332 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31255]: listed object 25... 2026-02-12T18:13:49.333 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31255]: saw 50 objects 2026-02-12T18:13:49.333 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31255]: shutting down. 2026-02-12T18:13:50.240 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:50.240 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31254]: starting. 2026-02-12T18:13:50.241 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31254]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-31218 2026-02-12T18:13:50.241 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31254]: shutting down. 2026-02-12T18:13:50.241 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:50.241 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:50.242 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:13:50.243 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:13:52.671 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31329]: starting. 2026-02-12T18:13:52.672 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31329]: creating pool ceph_test_rados_delete_pools_parallel.trial111-31328 2026-02-12T18:13:52.672 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31329]: created object 0... 2026-02-12T18:13:52.672 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31329]: created object 25... 2026-02-12T18:13:52.672 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31329]: created object 49... 2026-02-12T18:13:52.672 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31329]: finishing. 2026-02-12T18:13:52.672 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31329]: shutting down. 2026-02-12T18:13:53.625 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31330]: starting. 2026-02-12T18:13:53.626 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31330]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-31328 2026-02-12T18:13:53.626 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31330]: shutting down. 2026-02-12T18:13:55.292 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:55.292 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31364]: starting. 2026-02-12T18:13:55.292 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31364]: creating pool ceph_test_rados_delete_pools_parallel.trial111-31328 2026-02-12T18:13:55.292 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31364]: created object 0... 2026-02-12T18:13:55.292 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31364]: created object 25... 2026-02-12T18:13:55.292 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31364]: created object 49... 2026-02-12T18:13:55.292 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31364]: finishing. 2026-02-12T18:13:55.292 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31364]: shutting down. 2026-02-12T18:13:55.325 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:55.325 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31366]: starting. 2026-02-12T18:13:55.325 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31366]: listing objects. 2026-02-12T18:13:55.325 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31366]: listed object 0... 2026-02-12T18:13:55.325 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31366]: listed object 25... 2026-02-12T18:13:55.325 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31366]: saw 50 objects 2026-02-12T18:13:55.325 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31366]: shutting down. 2026-02-12T18:13:56.229 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:56.230 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31365]: starting. 2026-02-12T18:13:56.230 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31365]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-31328 2026-02-12T18:13:56.230 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31365]: shutting down. 2026-02-12T18:13:56.230 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:56.230 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:13:56.231 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:13:56.233 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:13:58.292 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31440]: starting. 2026-02-12T18:13:58.293 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31440]: creating pool ceph_test_rados_delete_pools_parallel.trial111-31439 2026-02-12T18:13:58.293 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31440]: created object 0... 2026-02-12T18:13:58.293 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31440]: created object 25... 2026-02-12T18:13:58.293 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31440]: created object 49... 2026-02-12T18:13:58.293 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31440]: finishing. 2026-02-12T18:13:58.293 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31440]: shutting down. 2026-02-12T18:13:59.237 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31441]: starting. 2026-02-12T18:13:59.237 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31441]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-31439 2026-02-12T18:13:59.237 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31441]: shutting down. 2026-02-12T18:14:01.459 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:01.459 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31474]: starting. 2026-02-12T18:14:01.459 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31474]: creating pool ceph_test_rados_delete_pools_parallel.trial111-31439 2026-02-12T18:14:01.459 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31474]: created object 0... 2026-02-12T18:14:01.459 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31474]: created object 25... 2026-02-12T18:14:01.459 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31474]: created object 49... 2026-02-12T18:14:01.459 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31474]: finishing. 2026-02-12T18:14:01.459 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31474]: shutting down. 2026-02-12T18:14:01.492 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:01.492 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31476]: starting. 2026-02-12T18:14:01.492 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31476]: listing objects. 2026-02-12T18:14:01.492 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31476]: listed object 0... 2026-02-12T18:14:01.492 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31476]: listed object 25... 2026-02-12T18:14:01.492 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31476]: saw 50 objects 2026-02-12T18:14:01.492 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31476]: shutting down. 2026-02-12T18:14:02.399 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:02.399 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31475]: starting. 2026-02-12T18:14:02.399 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31475]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-31439 2026-02-12T18:14:02.400 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31475]: shutting down. 2026-02-12T18:14:02.400 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:02.400 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:02.400 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:14:02.402 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:14:04.667 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31550]: starting. 2026-02-12T18:14:04.668 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31550]: creating pool ceph_test_rados_delete_pools_parallel.trial111-31549 2026-02-12T18:14:04.668 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31550]: created object 0... 2026-02-12T18:14:04.668 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31550]: created object 25... 2026-02-12T18:14:04.668 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31550]: created object 49... 2026-02-12T18:14:04.668 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31550]: finishing. 2026-02-12T18:14:04.668 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31550]: shutting down. 2026-02-12T18:14:05.227 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31551]: starting. 2026-02-12T18:14:05.227 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31551]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-31549 2026-02-12T18:14:05.227 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31551]: shutting down. 2026-02-12T18:14:07.289 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:07.289 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31584]: starting. 2026-02-12T18:14:07.289 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31584]: creating pool ceph_test_rados_delete_pools_parallel.trial111-31549 2026-02-12T18:14:07.289 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31584]: created object 0... 2026-02-12T18:14:07.289 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31584]: created object 25... 2026-02-12T18:14:07.289 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31584]: created object 49... 2026-02-12T18:14:07.289 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31584]: finishing. 2026-02-12T18:14:07.289 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31584]: shutting down. 2026-02-12T18:14:08.146 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:08.146 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31586]: starting. 2026-02-12T18:14:08.146 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31586]: listing objects. 2026-02-12T18:14:08.146 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31586]: listed object 0... 2026-02-12T18:14:08.147 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31586]: listed object 25... 2026-02-12T18:14:08.147 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31586]: saw 50 objects 2026-02-12T18:14:08.147 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31586]: shutting down. 2026-02-12T18:14:08.233 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:08.234 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31585]: starting. 2026-02-12T18:14:08.234 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31585]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-31549 2026-02-12T18:14:08.234 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31585]: shutting down. 2026-02-12T18:14:08.235 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:08.235 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:08.235 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:14:08.237 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:14:10.311 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31660]: starting. 2026-02-12T18:14:10.311 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31660]: creating pool ceph_test_rados_delete_pools_parallel.trial111-31659 2026-02-12T18:14:10.311 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31660]: created object 0... 2026-02-12T18:14:10.311 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31660]: created object 25... 2026-02-12T18:14:10.311 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31660]: created object 49... 2026-02-12T18:14:10.311 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31660]: finishing. 2026-02-12T18:14:10.311 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31660]: shutting down. 2026-02-12T18:14:11.252 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31661]: starting. 2026-02-12T18:14:11.253 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31661]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-31659 2026-02-12T18:14:11.253 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31661]: shutting down. 2026-02-12T18:14:13.334 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:13.334 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31694]: starting. 2026-02-12T18:14:13.335 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31694]: creating pool ceph_test_rados_delete_pools_parallel.trial111-31659 2026-02-12T18:14:13.335 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31694]: created object 0... 2026-02-12T18:14:13.335 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31694]: created object 25... 2026-02-12T18:14:13.335 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31694]: created object 49... 2026-02-12T18:14:13.335 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31694]: finishing. 2026-02-12T18:14:13.335 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31694]: shutting down. 2026-02-12T18:14:13.367 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:13.367 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31696]: starting. 2026-02-12T18:14:13.367 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31696]: listing objects. 2026-02-12T18:14:13.367 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31696]: listed object 0... 2026-02-12T18:14:13.367 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31696]: listed object 25... 2026-02-12T18:14:13.367 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31696]: saw 50 objects 2026-02-12T18:14:13.367 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31696]: shutting down. 2026-02-12T18:14:14.433 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:14.433 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31695]: starting. 2026-02-12T18:14:14.433 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31695]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-31659 2026-02-12T18:14:14.433 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31695]: shutting down. 2026-02-12T18:14:14.434 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:14.435 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:14.435 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:14:14.437 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:14:16.292 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31770]: starting. 2026-02-12T18:14:16.293 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31770]: creating pool ceph_test_rados_delete_pools_parallel.trial111-31769 2026-02-12T18:14:16.293 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31770]: created object 0... 2026-02-12T18:14:16.293 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31770]: created object 25... 2026-02-12T18:14:16.293 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31770]: created object 49... 2026-02-12T18:14:16.293 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31770]: finishing. 2026-02-12T18:14:16.293 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31770]: shutting down. 2026-02-12T18:14:17.241 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31771]: starting. 2026-02-12T18:14:17.241 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31771]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-31769 2026-02-12T18:14:17.241 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31771]: shutting down. 2026-02-12T18:14:19.302 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:19.303 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31804]: starting. 2026-02-12T18:14:19.303 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31804]: creating pool ceph_test_rados_delete_pools_parallel.trial111-31769 2026-02-12T18:14:19.303 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31804]: created object 0... 2026-02-12T18:14:19.303 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31804]: created object 25... 2026-02-12T18:14:19.303 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31804]: created object 49... 2026-02-12T18:14:19.303 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31804]: finishing. 2026-02-12T18:14:19.303 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31804]: shutting down. 2026-02-12T18:14:19.335 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:19.335 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31806]: starting. 2026-02-12T18:14:19.335 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31806]: listing objects. 2026-02-12T18:14:19.335 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31806]: listed object 0... 2026-02-12T18:14:19.336 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31806]: listed object 25... 2026-02-12T18:14:19.336 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31806]: saw 50 objects 2026-02-12T18:14:19.336 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31806]: shutting down. 2026-02-12T18:14:20.254 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:20.254 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31805]: starting. 2026-02-12T18:14:20.254 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31805]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-31769 2026-02-12T18:14:20.255 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31805]: shutting down. 2026-02-12T18:14:20.255 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:20.255 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:20.255 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:14:20.258 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:14:22.325 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31880]: starting. 2026-02-12T18:14:22.326 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31880]: creating pool ceph_test_rados_delete_pools_parallel.trial111-31879 2026-02-12T18:14:22.326 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31880]: created object 0... 2026-02-12T18:14:22.326 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31880]: created object 25... 2026-02-12T18:14:22.326 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31880]: created object 49... 2026-02-12T18:14:22.326 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31880]: finishing. 2026-02-12T18:14:22.326 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31880]: shutting down. 2026-02-12T18:14:23.353 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31881]: starting. 2026-02-12T18:14:23.353 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31881]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-31879 2026-02-12T18:14:23.353 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31881]: shutting down. 2026-02-12T18:14:25.286 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:25.286 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31914]: starting. 2026-02-12T18:14:25.286 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31914]: creating pool ceph_test_rados_delete_pools_parallel.trial111-31879 2026-02-12T18:14:25.286 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31914]: created object 0... 2026-02-12T18:14:25.286 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31914]: created object 25... 2026-02-12T18:14:25.287 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31914]: created object 49... 2026-02-12T18:14:25.287 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31914]: finishing. 2026-02-12T18:14:25.287 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[31914]: shutting down. 2026-02-12T18:14:25.319 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:25.319 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31916]: starting. 2026-02-12T18:14:25.319 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31916]: listing objects. 2026-02-12T18:14:25.319 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31916]: listed object 0... 2026-02-12T18:14:25.319 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31916]: listed object 25... 2026-02-12T18:14:25.319 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31916]: saw 50 objects 2026-02-12T18:14:25.320 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[31916]: shutting down. 2026-02-12T18:14:26.232 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:26.232 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31915]: starting. 2026-02-12T18:14:26.232 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31915]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-31879 2026-02-12T18:14:26.232 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[31915]: shutting down. 2026-02-12T18:14:26.233 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:26.233 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:26.233 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:14:26.235 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:14:28.293 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31990]: starting. 2026-02-12T18:14:28.293 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31990]: creating pool ceph_test_rados_delete_pools_parallel.trial111-31989 2026-02-12T18:14:28.293 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31990]: created object 0... 2026-02-12T18:14:28.293 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31990]: created object 25... 2026-02-12T18:14:28.293 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31990]: created object 49... 2026-02-12T18:14:28.293 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31990]: finishing. 2026-02-12T18:14:28.294 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[31990]: shutting down. 2026-02-12T18:14:29.239 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31991]: starting. 2026-02-12T18:14:29.239 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31991]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-31989 2026-02-12T18:14:29.239 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[31991]: shutting down. 2026-02-12T18:14:31.305 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:31.305 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32024]: starting. 2026-02-12T18:14:31.305 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32024]: creating pool ceph_test_rados_delete_pools_parallel.trial111-31989 2026-02-12T18:14:31.306 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32024]: created object 0... 2026-02-12T18:14:31.306 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32024]: created object 25... 2026-02-12T18:14:31.306 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32024]: created object 49... 2026-02-12T18:14:31.306 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32024]: finishing. 2026-02-12T18:14:31.306 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32024]: shutting down. 2026-02-12T18:14:32.167 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:32.168 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[32026]: starting. 2026-02-12T18:14:32.168 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[32026]: listing objects. 2026-02-12T18:14:32.168 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[32026]: listed object 0... 2026-02-12T18:14:32.168 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[32026]: listed object 25... 2026-02-12T18:14:32.168 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[32026]: saw 50 objects 2026-02-12T18:14:32.168 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[32026]: shutting down. 2026-02-12T18:14:32.253 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:32.254 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[32025]: starting. 2026-02-12T18:14:32.254 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[32025]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-31989 2026-02-12T18:14:32.254 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[32025]: shutting down. 2026-02-12T18:14:32.255 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:32.255 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:32.255 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:14:32.257 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:14:34.366 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[32100]: starting. 2026-02-12T18:14:34.366 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[32100]: creating pool ceph_test_rados_delete_pools_parallel.trial111-32099 2026-02-12T18:14:34.367 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[32100]: created object 0... 2026-02-12T18:14:34.367 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[32100]: created object 25... 2026-02-12T18:14:34.367 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[32100]: created object 49... 2026-02-12T18:14:34.367 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[32100]: finishing. 2026-02-12T18:14:34.367 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[32100]: shutting down. 2026-02-12T18:14:35.233 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[32101]: starting. 2026-02-12T18:14:35.233 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[32101]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-32099 2026-02-12T18:14:35.233 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[32101]: shutting down. 2026-02-12T18:14:37.374 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:37.374 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32134]: starting. 2026-02-12T18:14:37.374 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32134]: creating pool ceph_test_rados_delete_pools_parallel.trial111-32099 2026-02-12T18:14:37.375 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32134]: created object 0... 2026-02-12T18:14:37.375 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32134]: created object 25... 2026-02-12T18:14:37.375 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32134]: created object 49... 2026-02-12T18:14:37.375 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32134]: finishing. 2026-02-12T18:14:37.375 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32134]: shutting down. 2026-02-12T18:14:37.407 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:37.408 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[32136]: starting. 2026-02-12T18:14:37.408 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[32136]: listing objects. 2026-02-12T18:14:37.408 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[32136]: listed object 0... 2026-02-12T18:14:37.408 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[32136]: listed object 25... 2026-02-12T18:14:37.408 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[32136]: saw 50 objects 2026-02-12T18:14:37.408 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[32136]: shutting down. 2026-02-12T18:14:38.319 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:38.319 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[32135]: starting. 2026-02-12T18:14:38.319 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[32135]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-32099 2026-02-12T18:14:38.319 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[32135]: shutting down. 2026-02-12T18:14:38.320 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:38.320 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:38.320 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:14:38.322 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:14:40.382 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[32210]: starting. 2026-02-12T18:14:40.382 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[32210]: creating pool ceph_test_rados_delete_pools_parallel.trial111-32209 2026-02-12T18:14:40.383 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[32210]: created object 0... 2026-02-12T18:14:40.383 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[32210]: created object 25... 2026-02-12T18:14:40.383 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[32210]: created object 49... 2026-02-12T18:14:40.383 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[32210]: finishing. 2026-02-12T18:14:40.383 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[32210]: shutting down. 2026-02-12T18:14:40.871 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.h 2026-02-12T18:14:40.871 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.h 2026-02-12T18:14:40.871 INFO:tasks.ceph.mon.h:Restarting daemon 2026-02-12T18:14:40.871 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i h 2026-02-12T18:14:40.874 INFO:tasks.ceph.mon.h:Started 2026-02-12T18:14:40.875 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.d 2026-02-12T18:14:40.875 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.d 2026-02-12T18:14:40.875 INFO:tasks.ceph.mon.d:Restarting daemon 2026-02-12T18:14:40.875 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i d 2026-02-12T18:14:40.946 INFO:tasks.ceph.mon.d:Started 2026-02-12T18:14:40.946 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.g 2026-02-12T18:14:40.946 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.g 2026-02-12T18:14:40.946 INFO:tasks.ceph.mon.g:Restarting daemon 2026-02-12T18:14:40.946 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i g 2026-02-12T18:14:40.949 INFO:tasks.ceph.mon.g:Started 2026-02-12T18:14:40.949 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2026-02-12T18:14:40.949 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T18:14:41.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.015+0000 7f0876acc640 10 monclient: get_monmap_and_config 2026-02-12T18:14:41.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.015+0000 7f0876acc640 10 monclient: build_initial_monmap 2026-02-12T18:14:41.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.015+0000 7f0876acc640 10 monclient: monmap: 2026-02-12T18:14:41.017 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:41.017 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:41.017 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:14:41.016322+0000 2026-02-12T18:14:41.017 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:14:41.016322+0000 2026-02-12T18:14:41.017 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:41.017 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:41.017 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:14:41.017 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:14:41.018 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:41.018 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:41.018 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:41.018 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:41.018 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:41.018 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:41.018 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:41.018 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:14:41.018 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:14:41.018 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:41.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.015+0000 7f0876acc640 1 Processor -- start 2026-02-12T18:14:41.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.015+0000 7f0876acc640 1 -- start start 2026-02-12T18:14:41.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.015+0000 7f0876acc640 10 monclient: init 2026-02-12T18:14:41.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0876acc640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:41.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0876acc640 10 monclient: _add_conns ranks=[8,3,7,6,4,5,0,2,9,10,1] 2026-02-12T18:14:41.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0876acc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f087005dc20 0x7f0870144660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:41.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0876acc640 10 monclient(hunting): picked mon.noname-e con 0x7f087005dc20 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:14:41.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0876acc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f087005dff0 0x7f087005e3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:41.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0876acc640 10 monclient(hunting): picked mon.noname-g con 0x7f087005dff0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:14:41.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0876acc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0870089df0 0x7f087008a240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:41.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0876acc640 10 monclient(hunting): picked mon.noname-i con 0x7f0870089df0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:14:41.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0876acc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:41.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0876acc640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f0870093a30 con 0x7f087005dff0 2026-02-12T18:14:41.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0876acc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:41.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0876acc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f0870092200 con 0x7f0870089df0 2026-02-12T18:14:41.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0876acc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:41.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0876acc640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f087008b250 con 0x7f087005dc20 2026-02-12T18:14:41.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0876acc640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:41.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0876acc640 10 monclient(hunting): authenticate will time out at 1119.742151s 2026-02-12T18:14:41.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0867fff640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f087005dff0 0x7f087005e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:41.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0867fff640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f087005dff0 0x7f087005e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3301/0 says I am v2:10.20.193.48:54180/0 (socket says 10.20.193.48:54180) 2026-02-12T18:14:41.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0867fff640 1 -- 10.20.193.48:0/168581475 learned_addr learned my addr 10.20.193.48:0/168581475 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:41.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0867fff640 10 monclient(hunting): get_auth_request con 0x7f087005dff0 auth_method 0 2026-02-12T18:14:41.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0867fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:41.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0867fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:41.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0867fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:41.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0867fff640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f087005dff0 msgr2=0x7f087005e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:14:41.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0867fff640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f087005dff0 msgr2=0x7f087005e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:14:41.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f087005dff0 0x7f087005e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:41.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.016+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f087005dff0 0x7f087005e3c0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:14:41.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.018+0000 7f0875042640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0870089df0 0x7f087008a240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:41.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.018+0000 7f0874841640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f087005dc20 0x7f0870144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:41.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.018+0000 7f0875042640 10 monclient(hunting): get_auth_request con 0x7f0870089df0 auth_method 0 2026-02-12T18:14:41.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.018+0000 7f0875042640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:41.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.018+0000 7f0875042640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:41.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.018+0000 7f0875042640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:41.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.018+0000 7f0874841640 10 monclient(hunting): get_auth_request con 0x7f087005dc20 auth_method 0 2026-02-12T18:14:41.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.018+0000 7f0874841640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:41.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.018+0000 7f0874841640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:41.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.018+0000 7f0874841640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:41.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.019+0000 7f0875042640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0870089df0 msgr2=0x7f087008a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-12T18:14:41.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.019+0000 7f0875042640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0870089df0 msgr2=0x7f087008a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:14:41.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.019+0000 7f0875042640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0870089df0 0x7f087008a240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:41.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.019+0000 7f0875042640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0870089df0 0x7f087008a240 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:14:41.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.019+0000 7f0874841640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f087005dc20 msgr2=0x7f0870144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:14:41.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.019+0000 7f0874841640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f087005dc20 msgr2=0x7f0870144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:14:41.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.019+0000 7f0874841640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f087005dc20 0x7f0870144660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:41.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.019+0000 7f0874841640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f087005dc20 0x7f0870144660 unknown :-1 s=START_CONNECT pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:14:41.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.217+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f087005dff0 0x7f087005e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:41.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.217+0000 7f0867fff640 10 monclient(hunting): get_auth_request con 0x7f087005dff0 auth_method 0 2026-02-12T18:14:41.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.217+0000 7f0867fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:41.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.217+0000 7f0867fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:41.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.217+0000 7f0867fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:41.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.218+0000 7f0867fff640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f087005dff0 msgr2=0x7f087005e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:14:41.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.218+0000 7f0867fff640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f087005dff0 msgr2=0x7f087005e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:14:41.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.218+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f087005dff0 0x7f087005e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=7 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:41.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.218+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f087005dff0 0x7f087005e3c0 unknown :-1 s=START_CONNECT pgs=0 gs=8 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:14:41.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.220+0000 7f0874841640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f087005dc20 0x7f0870144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=10 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:41.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.220+0000 7f0874841640 10 monclient(hunting): get_auth_request con 0x7f087005dc20 auth_method 0 2026-02-12T18:14:41.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.220+0000 7f0874841640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:41.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.220+0000 7f0874841640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:41.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.220+0000 7f0874841640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:41.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.220+0000 7f0875042640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0870089df0 0x7f087008a240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=9 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:41.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.220+0000 7f0874841640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f087005dc20 msgr2=0x7f0870144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:14:41.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.220+0000 7f0874841640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f087005dc20 msgr2=0x7f0870144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:14:41.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.220+0000 7f0874841640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f087005dc20 0x7f0870144660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=10 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:41.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.220+0000 7f0875042640 10 monclient(hunting): get_auth_request con 0x7f0870089df0 auth_method 0 2026-02-12T18:14:41.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.220+0000 7f0875042640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:41.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.220+0000 7f0875042640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:41.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.220+0000 7f0875042640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:41.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.220+0000 7f0874841640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f087005dc20 0x7f0870144660 unknown :-1 s=START_CONNECT pgs=0 gs=11 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:14:41.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.220+0000 7f0875042640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0870089df0 msgr2=0x7f087008a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:14:41.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.220+0000 7f0875042640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0870089df0 msgr2=0x7f087008a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:14:41.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.220+0000 7f0875042640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0870089df0 0x7f087008a240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=9 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:41.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.220+0000 7f0875042640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0870089df0 0x7f087008a240 unknown :-1 s=START_CONNECT pgs=0 gs=12 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:14:41.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.619+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f087005dff0 0x7f087005e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=13 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:41.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.619+0000 7f0867fff640 10 monclient(hunting): get_auth_request con 0x7f087005dff0 auth_method 0 2026-02-12T18:14:41.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.619+0000 7f0867fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:41.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.619+0000 7f0867fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:41.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.619+0000 7f0867fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:41.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.619+0000 7f0867fff640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f087005dff0 msgr2=0x7f087005e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:14:41.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.619+0000 7f0867fff640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f087005dff0 msgr2=0x7f087005e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:14:41.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.619+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f087005dff0 0x7f087005e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=13 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:41.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.619+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f087005dff0 0x7f087005e3c0 unknown :-1 s=START_CONNECT pgs=0 gs=14 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:14:41.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.621+0000 7f0875042640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0870089df0 0x7f087008a240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=15 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:41.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.621+0000 7f0875042640 10 monclient(hunting): get_auth_request con 0x7f0870089df0 auth_method 0 2026-02-12T18:14:41.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.621+0000 7f0875042640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:41.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.621+0000 7f0875042640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:41.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.621+0000 7f0875042640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:41.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.621+0000 7f0875042640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0870089df0 msgr2=0x7f087008a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:14:41.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.621+0000 7f0875042640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0870089df0 msgr2=0x7f087008a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:14:41.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.621+0000 7f0875042640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0870089df0 0x7f087008a240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=15 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:41.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.621+0000 7f0875042640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0870089df0 0x7f087008a240 unknown :-1 s=START_CONNECT pgs=0 gs=16 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:14:41.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.622+0000 7f0874841640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f087005dc20 0x7f0870144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=17 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:41.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.622+0000 7f0874841640 10 monclient(hunting): get_auth_request con 0x7f087005dc20 auth_method 0 2026-02-12T18:14:41.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.622+0000 7f0874841640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:41.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.622+0000 7f0874841640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:41.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.622+0000 7f0874841640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:41.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.622+0000 7f0874841640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f087005dc20 msgr2=0x7f0870144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:14:41.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.622+0000 7f0874841640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f087005dc20 msgr2=0x7f0870144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:14:41.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.622+0000 7f0874841640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f087005dc20 0x7f0870144660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=17 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:41.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:41.622+0000 7f0874841640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f087005dc20 0x7f0870144660 unknown :-1 s=START_CONNECT pgs=0 gs=18 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:14:42.422 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.420+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f087005dff0 0x7f087005e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=19 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:42.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.420+0000 7f0867fff640 10 monclient(hunting): get_auth_request con 0x7f087005dff0 auth_method 0 2026-02-12T18:14:42.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.420+0000 7f0867fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:42.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.420+0000 7f0867fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:42.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.420+0000 7f0867fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:42.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.421+0000 7f0867fff640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f087005dff0 msgr2=0x7f087005e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:14:42.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.421+0000 7f0867fff640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f087005dff0 msgr2=0x7f087005e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:14:42.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.421+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f087005dff0 0x7f087005e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=19 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:42.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.421+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f087005dff0 0x7f087005e3c0 unknown :-1 s=START_CONNECT pgs=0 gs=20 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:14:42.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.422+0000 7f0875042640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0870089df0 0x7f087008a240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=21 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:42.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.422+0000 7f0875042640 10 monclient(hunting): get_auth_request con 0x7f0870089df0 auth_method 0 2026-02-12T18:14:42.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.422+0000 7f0875042640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:42.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.422+0000 7f0875042640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:42.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.422+0000 7f0875042640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:42.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.422+0000 7f0875042640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0870089df0 msgr2=0x7f087008a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:14:42.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.422+0000 7f0875042640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0870089df0 msgr2=0x7f087008a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:14:42.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.422+0000 7f0875042640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0870089df0 0x7f087008a240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=21 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:42.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.422+0000 7f0875042640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0870089df0 0x7f087008a240 unknown :-1 s=START_CONNECT pgs=0 gs=22 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:14:42.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.423+0000 7f0874841640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f087005dc20 0x7f0870144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=23 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:42.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.423+0000 7f0874841640 10 monclient(hunting): get_auth_request con 0x7f087005dc20 auth_method 0 2026-02-12T18:14:42.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.423+0000 7f0874841640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:42.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.423+0000 7f0874841640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:42.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.423+0000 7f0874841640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:42.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.423+0000 7f0874841640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f087005dc20 msgr2=0x7f0870144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:14:42.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.423+0000 7f0874841640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f087005dc20 msgr2=0x7f0870144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:14:42.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.423+0000 7f0874841640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f087005dc20 0x7f0870144660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=23 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:42.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:42.423+0000 7f0874841640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f087005dc20 0x7f0870144660 unknown :-1 s=START_CONNECT pgs=0 gs=24 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:14:44.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f08667fc640 10 monclient(hunting): tick 2026-02-12T18:14:44.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f08667fc640 10 monclient(hunting): _check_auth_tickets 2026-02-12T18:14:44.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f08667fc640 1 monclient(hunting): continuing hunt 2026-02-12T18:14:44.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f08667fc640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T18:14:44.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f08667fc640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f087005dc20 msgr2=0x7f0870144660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:14:44.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f08667fc640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f087005dc20 0x7f0870144660 unknown :-1 s=START_CONNECT pgs=0 gs=24 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:44.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f08667fc640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0870089df0 msgr2=0x7f087008a240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:14:44.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f08667fc640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0870089df0 0x7f087008a240 unknown :-1 s=START_CONNECT pgs=0 gs=22 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:44.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f08667fc640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f087005dff0 msgr2=0x7f087005e3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:14:44.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f08667fc640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f087005dff0 0x7f087005e3c0 unknown :-1 s=START_CONNECT pgs=0 gs=20 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:44.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f08667fc640 10 monclient: _add_conns ranks=[1,10,5,6,4,0,9,2] 2026-02-12T18:14:44.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f08667fc640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f08540038f0 addr v1:10.20.193.111:6789/0 2026-02-12T18:14:44.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f08667fc640 1 --2- 10.20.193.48:0/168581475 >> v2:10.20.193.111:3300/0 conn(0x7f0854025460 0x7f0854045910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:44.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f08667fc640 10 monclient(hunting): picked mon.noname-f con 0x7f0854025460 addr v2:10.20.193.111:3300/0 2026-02-12T18:14:44.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f08667fc640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f0854045fa0 0x7f0854066450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:44.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f08667fc640 10 monclient(hunting): picked mon.noname-h con 0x7f0854045fa0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:14:44.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f08667fc640 1 -- 10.20.193.48:0/168581475 --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0870060390 con 0x7f08540038f0 2026-02-12T18:14:44.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f08667fc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:44.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f08667fc640 1 -- 10.20.193.48:0/168581475 --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f0870093a30 con 0x7f0854025460 2026-02-12T18:14:44.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f08667fc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:44.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f08667fc640 1 -- 10.20.193.48:0/168581475 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f0870092200 con 0x7f0854045fa0 2026-02-12T18:14:44.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f08667fc640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:44.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f0875042640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f0854045fa0 0x7f0854066450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=27 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:44.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f0875042640 10 monclient(hunting): get_auth_request con 0x7f0854045fa0 auth_method 0 2026-02-12T18:14:44.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f0875042640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:44.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f0875042640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:44.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f0875042640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:44.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> v2:10.20.193.111:3300/0 conn(0x7f0854025460 0x7f0854045910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=26 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:44.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f0867fff640 10 monclient(hunting): get_auth_request con 0x7f0854025460 auth_method 0 2026-02-12T18:14:44.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f0867fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:44.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f0867fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:44.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f0867fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:44.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f0875042640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f0854045fa0 msgr2=0x7f0854066450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-12T18:14:44.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f0875042640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f0854045fa0 msgr2=0x7f0854066450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:14:44.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f0875042640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f0854045fa0 0x7f0854066450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=27 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:44.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.016+0000 7f0875042640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f0854045fa0 0x7f0854066450 unknown :-1 s=START_CONNECT pgs=0 gs=28 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:14:44.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.018+0000 7f0874841640 1 -- 10.20.193.48:0/168581475 >> v1:10.20.193.111:6789/0 conn(0x7f08540038f0 legacy=0x7f0854023d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:44.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.018+0000 7f0867fff640 1 -- 10.20.193.48:0/168581475 >> v2:10.20.193.111:3300/0 conn(0x7f0854025460 msgr2=0x7f0854045910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:14:44.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.018+0000 7f0867fff640 1 -- 10.20.193.48:0/168581475 >> v2:10.20.193.111:3300/0 conn(0x7f0854025460 msgr2=0x7f0854045910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:14:44.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.018+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> v2:10.20.193.111:3300/0 conn(0x7f0854025460 0x7f0854045910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=26 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:44.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.018+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> v2:10.20.193.111:3300/0 conn(0x7f0854025460 0x7f0854045910 unknown :-1 s=START_CONNECT pgs=0 gs=29 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:14:44.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.217+0000 7f0875042640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f0854045fa0 0x7f0854066450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=30 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:44.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.217+0000 7f0875042640 10 monclient(hunting): get_auth_request con 0x7f0854045fa0 auth_method 0 2026-02-12T18:14:44.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.217+0000 7f0875042640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:44.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.217+0000 7f0875042640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:44.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.217+0000 7f0875042640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:44.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.217+0000 7f0875042640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f0854045fa0 msgr2=0x7f0854066450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:14:44.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.217+0000 7f0875042640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f0854045fa0 msgr2=0x7f0854066450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:14:44.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.217+0000 7f0875042640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f0854045fa0 0x7f0854066450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=30 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:44.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.217+0000 7f0875042640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f0854045fa0 0x7f0854066450 unknown :-1 s=START_CONNECT pgs=0 gs=31 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:14:44.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.220+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> v2:10.20.193.111:3300/0 conn(0x7f0854025460 0x7f0854045910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=32 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:44.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.220+0000 7f0867fff640 10 monclient(hunting): get_auth_request con 0x7f0854025460 auth_method 0 2026-02-12T18:14:44.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.220+0000 7f0867fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:44.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.220+0000 7f0867fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:44.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.220+0000 7f0867fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:44.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.220+0000 7f0867fff640 1 -- 10.20.193.48:0/168581475 >> v2:10.20.193.111:3300/0 conn(0x7f0854025460 msgr2=0x7f0854045910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:14:44.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.220+0000 7f0867fff640 1 -- 10.20.193.48:0/168581475 >> v2:10.20.193.111:3300/0 conn(0x7f0854025460 msgr2=0x7f0854045910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:14:44.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.220+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> v2:10.20.193.111:3300/0 conn(0x7f0854025460 0x7f0854045910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=32 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:44.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.220+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> v2:10.20.193.111:3300/0 conn(0x7f0854025460 0x7f0854045910 unknown :-1 s=START_CONNECT pgs=0 gs=33 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:14:44.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.618+0000 7f0875042640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f0854045fa0 0x7f0854066450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=34 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:44.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.618+0000 7f0875042640 10 monclient(hunting): get_auth_request con 0x7f0854045fa0 auth_method 0 2026-02-12T18:14:44.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.618+0000 7f0875042640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:44.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.618+0000 7f0875042640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:44.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.618+0000 7f0875042640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:44.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.619+0000 7f0875042640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f0854045fa0 msgr2=0x7f0854066450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:14:44.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.619+0000 7f0875042640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f0854045fa0 msgr2=0x7f0854066450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:14:44.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.619+0000 7f0875042640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f0854045fa0 0x7f0854066450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=34 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:44.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.619+0000 7f0875042640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f0854045fa0 0x7f0854066450 unknown :-1 s=START_CONNECT pgs=0 gs=35 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:14:44.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.622+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> v2:10.20.193.111:3300/0 conn(0x7f0854025460 0x7f0854045910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=36 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:44.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.622+0000 7f0867fff640 10 monclient(hunting): get_auth_request con 0x7f0854025460 auth_method 0 2026-02-12T18:14:44.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.622+0000 7f0867fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:44.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.622+0000 7f0867fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:44.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.622+0000 7f0867fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:44.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.622+0000 7f0867fff640 1 -- 10.20.193.48:0/168581475 >> v2:10.20.193.111:3300/0 conn(0x7f0854025460 msgr2=0x7f0854045910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:14:44.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.622+0000 7f0867fff640 1 -- 10.20.193.48:0/168581475 >> v2:10.20.193.111:3300/0 conn(0x7f0854025460 msgr2=0x7f0854045910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:14:44.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.622+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> v2:10.20.193.111:3300/0 conn(0x7f0854025460 0x7f0854045910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=36 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:44.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:44.622+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> v2:10.20.193.111:3300/0 conn(0x7f0854025460 0x7f0854045910 unknown :-1 s=START_CONNECT pgs=0 gs=37 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:14:45.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.421+0000 7f0875042640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f0854045fa0 0x7f0854066450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=38 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:45.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.421+0000 7f0875042640 10 monclient(hunting): get_auth_request con 0x7f0854045fa0 auth_method 0 2026-02-12T18:14:45.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.421+0000 7f0875042640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:45.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.421+0000 7f0875042640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:45.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.421+0000 7f0875042640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:45.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.421+0000 7f0875042640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f0854045fa0 msgr2=0x7f0854066450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:14:45.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.421+0000 7f0875042640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f0854045fa0 msgr2=0x7f0854066450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:14:45.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.421+0000 7f0875042640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f0854045fa0 0x7f0854066450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=38 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:45.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.421+0000 7f0875042640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f0854045fa0 0x7f0854066450 unknown :-1 s=START_CONNECT pgs=0 gs=39 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:14:45.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.424+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> v2:10.20.193.111:3300/0 conn(0x7f0854025460 0x7f0854045910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=40 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:45.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.424+0000 7f0867fff640 10 monclient(hunting): get_auth_request con 0x7f0854025460 auth_method 0 2026-02-12T18:14:45.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.424+0000 7f0867fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:45.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.424+0000 7f0867fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:45.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.424+0000 7f0867fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:45.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.424+0000 7f0867fff640 1 -- 10.20.193.48:0/168581475 >> v2:10.20.193.111:3300/0 conn(0x7f0854025460 msgr2=0x7f0854045910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:14:45.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.424+0000 7f0867fff640 1 -- 10.20.193.48:0/168581475 >> v2:10.20.193.111:3300/0 conn(0x7f0854025460 msgr2=0x7f0854045910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:14:45.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.424+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> v2:10.20.193.111:3300/0 conn(0x7f0854025460 0x7f0854045910 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=40 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:45.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.424+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> v2:10.20.193.111:3300/0 conn(0x7f0854025460 0x7f0854045910 unknown :-1 s=START_CONNECT pgs=0 gs=41 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:14:45.969 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 1 -- 10.20.193.48:0/168581475 <== mon.1 v1:10.20.193.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1062052271 0 0) 0x7f0870060390 con 0x7f08540038f0 2026-02-12T18:14:45.970 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 10 monclient(hunting): _negotiate 2026-02-12T18:14:45.970 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:45.970 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:45.970 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 10 monclient(hunting): my global_id is 94762 2026-02-12T18:14:45.970 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 1 -- 10.20.193.48:0/168581475 --> v1:10.20.193.111:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f085c0035e0 con 0x7f08540038f0 2026-02-12T18:14:45.970 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 1 -- 10.20.193.48:0/168581475 <== mon.1 v1:10.20.193.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 180437599 0 0) 0x7f085c0035e0 con 0x7f08540038f0 2026-02-12T18:14:45.970 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f0854045fa0 msgr2=0x7f0854066450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:14:45.970 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f0854045fa0 0x7f0854066450 unknown :-1 s=START_CONNECT pgs=0 gs=39 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:45.970 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 1 -- 10.20.193.48:0/168581475 >> v2:10.20.193.111:3300/0 conn(0x7f0854025460 msgr2=0x7f0854045910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:14:45.970 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 1 --2- 10.20.193.48:0/168581475 >> v2:10.20.193.111:3300/0 conn(0x7f0854025460 0x7f0854045910 unknown :-1 s=START_CONNECT pgs=0 gs=41 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:45.970 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 10 monclient: _finish_hunting 0 2026-02-12T18:14:45.971 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 1 monclient: found mon.noname-f-legacy 2026-02-12T18:14:45.971 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f0875042640 1 -- 10.20.193.48:0/168581475 reap_dead start 2026-02-12T18:14:45.971 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:45.971 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 10 monclient: _send_mon_message to mon.noname-f-legacy at v1:10.20.193.111:6789/0 2026-02-12T18:14:45.971 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 1 -- 10.20.193.48:0/168581475 --> v1:10.20.193.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0854067bf0 con 0x7f08540038f0 2026-02-12T18:14:45.971 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 10 monclient: _finish_auth 0 2026-02-12T18:14:45.971 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 10 monclient: _check_auth_tickets 2026-02-12T18:14:45.971 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:45.971 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 1 -- 10.20.193.48:0/168581475 <== mon.1 v1:10.20.193.111:6789/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (unknown 3750814960 0 0) 0x7f086000cb70 con 0x7f08540038f0 2026-02-12T18:14:45.971 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:45.971 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 10 monclient: got monmap 1 from mon.noname-f-legacy (according to old e1) 2026-02-12T18:14:45.972 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 10 monclient: dump: 2026-02-12T18:14:45.972 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:45.972 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:45.972 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:45.972 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:45.972 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:45.972 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:45.972 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:45.972 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:45.972 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:45.972 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:45.972 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:45.973 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:45.973 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:45.973 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:45.973 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:45.973 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:45.973 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 1 monclient: mon.f has (v2) addrs [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] but i'm connected to v1:10.20.193.111:6789/0, reconnecting 2026-02-12T18:14:45.973 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:45.973 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 1 -- 10.20.193.48:0/168581475 >> v1:10.20.193.111:6789/0 conn(0x7f08540038f0 legacy=0x7f0854023d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:45.973 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 10 monclient: _add_conns ranks=[1,4,7,5,0,2,6,3,8] 2026-02-12T18:14:45.973 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f085c004350 0x7f085c004850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:45.973 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 10 monclient(hunting): picked mon.f con 0x7f085c004350 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:14:45.973 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f085c004f50 0x7f085c045a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:45.974 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 10 monclient(hunting): picked mon.c con 0x7f085c004f50 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:14:45.974 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f085c045f40 0x7f085c066320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:45.974 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 10 monclient(hunting): picked mon.i con 0x7f085c045f40 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:14:45.974 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:45.974 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 1 -- 10.20.193.48:0/168581475 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f0870093a30 con 0x7f085c004350 2026-02-12T18:14:45.974 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:45.974 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 1 -- 10.20.193.48:0/168581475 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f0870092200 con 0x7f085c004f50 2026-02-12T18:14:45.975 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:45.975 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 1 -- 10.20.193.48:0/168581475 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f085c066aa0 con 0x7f085c045f40 2026-02-12T18:14:45.975 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:45.975 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f08677fe640 10 monclient(hunting): _finish_auth 0 2026-02-12T18:14:45.975 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f085c004f50 0x7f085c045a00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=42 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:45.975 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f0867fff640 10 monclient(hunting): get_auth_request con 0x7f085c004f50 auth_method 0 2026-02-12T18:14:45.975 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f0867fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:45.975 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f0867fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:45.975 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f0874841640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f085c004350 0x7f085c004850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=43 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:45.975 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f0867fff640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:45.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f0874841640 10 monclient(hunting): get_auth_request con 0x7f085c004350 auth_method 0 2026-02-12T18:14:45.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f0874841640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:45.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f0874841640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:45.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f0874841640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:45.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f0867fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:45.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f0867fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:45.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f0867fff640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:14:45.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f0874841640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:45.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f0874841640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:45.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.960+0000 7f0874841640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:14:45.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.961+0000 7f0867fff640 10 monclient(hunting): handle_auth_done global_id 94762 payload 293 2026-02-12T18:14:45.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.961+0000 7f0867fff640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f085c045f40 msgr2=0x7f085c066320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:45.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.961+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f085c045f40 0x7f085c066320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=44 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:45.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.961+0000 7f0867fff640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f085c004350 msgr2=0x7f085c004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:45.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.961+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f085c004350 0x7f085c004850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=43 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:45.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.961+0000 7f0867fff640 10 monclient: _finish_hunting 0 2026-02-12T18:14:45.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.961+0000 7f0867fff640 1 monclient: found mon.c 2026-02-12T18:14:45.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.961+0000 7f0867fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:45.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.961+0000 7f0867fff640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:14:45.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.961+0000 7f0867fff640 1 -- 10.20.193.48:0/168581475 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f085c0035e0 con 0x7f085c004f50 2026-02-12T18:14:45.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.961+0000 7f0867fff640 10 monclient: _finish_auth 0 2026-02-12T18:14:45.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.961+0000 7f0867fff640 10 monclient: _check_auth_tickets 2026-02-12T18:14:45.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.961+0000 7f0867fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:45.977 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.961+0000 7f0876acc640 5 monclient: authenticate success, global_id 94762 2026-02-12T18:14:45.978 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.961+0000 7f0876acc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:14:45.978 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.963+0000 7f0867fff640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f085c004f50 msgr2=0x7f085c045a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:45.978 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.963+0000 7f0867fff640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f085c004f50 0x7f085c045a00 secure :-1 s=READY pgs=192 gs=42 cs=0 l=1 c_cookie=16470010874468375163 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08700950d0 tx=0x7f0858030b20 comp rx=0 tx=0).ready entity=mon.4 client_cookie=e4913ba0e3821a7b server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:45.978 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.964+0000 7f08677fe640 1 -- 10.20.193.48:0/168581475 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f0858035910 con 0x7f085c004f50 2026-02-12T18:14:45.978 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.964+0000 7f08677fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:45.978 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.964+0000 7f08677fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:14:45.978 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.964+0000 7f08677fe640 10 monclient: dump: 2026-02-12T18:14:45.978 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:45.978 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:45.978 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:45.978 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:45.978 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:45.979 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:45.979 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:45.979 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:45.979 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:45.979 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:45.979 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:45.979 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:45.979 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:45.979 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:45.979 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:45.979 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:45.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.964+0000 7f08677fe640 1 -- 10.20.193.48:0/168581475 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f085800c040 con 0x7f085c004f50 2026-02-12T18:14:45.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.964+0000 7f0876acc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:14:45.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.964+0000 7f08677fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:45.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.964+0000 7f08677fe640 1 -- 10.20.193.48:0/168581475 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f08580173e0 con 0x7f085c004f50 2026-02-12T18:14:45.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.964+0000 7f0876acc640 10 monclient: get_monmap_and_config success 2026-02-12T18:14:45.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.964+0000 7f08677fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:45.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.964+0000 7f0876acc640 4 set_mon_vals no callback set 2026-02-12T18:14:45.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.964+0000 7f08677fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:14:45.980 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.964+0000 7f08677fe640 10 monclient: dump: 2026-02-12T18:14:45.980 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:45.980 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:45.980 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:45.980 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:45.981 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:45.981 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:45.981 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:45.981 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:45.981 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:45.981 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:45.981 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:45.981 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:45.981 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:45.981 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:45.981 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:45.981 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:45.982 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.964+0000 7f0876acc640 10 monclient: shutdown 2026-02-12T18:14:45.982 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.964+0000 7f0876acc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:45.982 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.964+0000 7f0876acc640 1 -- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f085c004f50 msgr2=0x7f085c045a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:45.982 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.964+0000 7f0876acc640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f085c004f50 0x7f085c045a00 secure :-1 s=READY pgs=192 gs=42 cs=0 l=1 c_cookie=16470010874468375163 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f08700950d0 tx=0x7f0858030b20 comp rx=0 tx=0).stop 2026-02-12T18:14:45.982 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.964+0000 7f0876acc640 1 -- 10.20.193.48:0/168581475 shutdown_connections 2026-02-12T18:14:45.982 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.964+0000 7f0876acc640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f085c045f40 0x7f085c066320 unknown :-1 s=CLOSED pgs=0 gs=44 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:45.982 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.964+0000 7f0876acc640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f085c004f50 0x7f085c045a00 unknown :-1 s=CLOSED pgs=192 gs=42 cs=0 l=1 c_cookie=16470010874468375163 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:45.982 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.964+0000 7f0876acc640 1 --2- 10.20.193.48:0/168581475 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f085c004350 0x7f085c004850 unknown :-1 s=CLOSED pgs=0 gs=43 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:45.982 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.964+0000 7f0876acc640 1 -- 10.20.193.48:0/168581475 >> 10.20.193.48:0/168581475 conn(0x7f08700546d0 msgr2=0x7f0870054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:45.982 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.964+0000 7f0876acc640 1 -- 10.20.193.48:0/168581475 shutdown_connections 2026-02-12T18:14:45.982 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.964+0000 7f0876acc640 1 -- 10.20.193.48:0/168581475 wait complete. 2026-02-12T18:14:45.982 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.965+0000 7f0876acc640 10 monclient: build_initial_monmap 2026-02-12T18:14:45.983 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.965+0000 7f0876acc640 10 monclient: monmap: 2026-02-12T18:14:45.983 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:45.983 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:14:45.983 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:14:45.983 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:14:45.983 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:45.983 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:45.983 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:14:45.983 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:14:45.983 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:45.983 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:45.983 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:45.984 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:45.984 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:45.984 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:45.984 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:45.984 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:45.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.965+0000 7f0876acc640 1 Processor -- start 2026-02-12T18:14:45.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.965+0000 7f0876acc640 1 -- start start 2026-02-12T18:14:45.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.965+0000 7f0876acc640 10 monclient: init 2026-02-12T18:14:45.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.965+0000 7f0876acc640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:45.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.965+0000 7f0876acc640 10 monclient: _add_conns ranks=[5,4,6,7,2,3,0,8,1] 2026-02-12T18:14:45.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.965+0000 7f0876acc640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f08540038f0 0x7f0870110f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:45.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.965+0000 7f0876acc640 10 monclient(hunting): picked mon.noname-h con 0x7f08540038f0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:14:45.984 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.965+0000 7f0876acc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f085c004350 0x7f0870131110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:45.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.965+0000 7f0876acc640 10 monclient(hunting): picked mon.noname-c con 0x7f085c004350 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:14:45.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.965+0000 7f0876acc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f085c004f50 0x7f0870131650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:45.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.965+0000 7f0876acc640 10 monclient(hunting): picked mon.noname-d con 0x7f085c004f50 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:14:45.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.965+0000 7f0876acc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:45.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.965+0000 7f0876acc640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f0870110430 con 0x7f085c004350 2026-02-12T18:14:45.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.965+0000 7f0876acc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:45.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.965+0000 7f0876acc640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f0870111ef0 con 0x7f08540038f0 2026-02-12T18:14:45.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.965+0000 7f0876acc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:45.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.965+0000 7f0876acc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f08701121d0 con 0x7f085c004f50 2026-02-12T18:14:45.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.965+0000 7f0876acc640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:45.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.965+0000 7f0876acc640 10 monclient(hunting): authenticate will time out at 1124.691913s 2026-02-12T18:14:45.985 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.965+0000 7f0867fff640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f085c004350 0x7f0870131110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:45.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0867fff640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f085c004350 0x7f0870131110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:36786/0 (socket says 10.20.193.48:36786) 2026-02-12T18:14:45.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0867fff640 1 -- 10.20.193.48:0/4151174037 learned_addr learned my addr 10.20.193.48:0/4151174037 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:45.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0875042640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f085c004f50 0x7f0870131650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:45.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0867fff640 10 monclient(hunting): get_auth_request con 0x7f085c004350 auth_method 0 2026-02-12T18:14:45.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0867fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:45.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0867fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:45.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0867fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:45.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0875042640 10 monclient(hunting): get_auth_request con 0x7f085c004f50 auth_method 0 2026-02-12T18:14:45.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0875042640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:45.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0875042640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:45.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0875042640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:45.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0867fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:45.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0867fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:45.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0867fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:45.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0875042640 1 -- 10.20.193.48:0/4151174037 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f085c004f50 msgr2=0x7f0870131650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-12T18:14:45.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0875042640 1 -- 10.20.193.48:0/4151174037 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f085c004f50 msgr2=0x7f0870131650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:14:45.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0875042640 1 --2- 10.20.193.48:0/4151174037 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f085c004f50 0x7f0870131650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:45.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0874841640 1 --2- 10.20.193.48:0/4151174037 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f08540038f0 0x7f0870110f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:45.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0874841640 10 monclient(hunting): get_auth_request con 0x7f08540038f0 auth_method 0 2026-02-12T18:14:45.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0874841640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:45.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0875042640 1 --2- 10.20.193.48:0/4151174037 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f085c004f50 0x7f0870131650 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:14:45.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0874841640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:45.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0874841640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:45.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0867fff640 10 monclient(hunting): handle_auth_done global_id 65002 payload 824 2026-02-12T18:14:45.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0867fff640 1 -- 10.20.193.48:0/4151174037 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f085c004f50 msgr2=0x7f0870131650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:14:45.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0867fff640 1 --2- 10.20.193.48:0/4151174037 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f085c004f50 0x7f0870131650 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:45.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0867fff640 1 -- 10.20.193.48:0/4151174037 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f08540038f0 msgr2=0x7f0870110f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:45.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0867fff640 1 --2- 10.20.193.48:0/4151174037 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f08540038f0 0x7f0870110f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:45.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0867fff640 10 monclient: _finish_hunting 0 2026-02-12T18:14:45.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0867fff640 1 monclient: found mon.noname-c 2026-02-12T18:14:45.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0867fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:45.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0867fff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:14:45.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.966+0000 7f0867fff640 1 -- 10.20.193.48:0/4151174037 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0870131b90 con 0x7f085c004350 2026-02-12T18:14:45.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.968+0000 7f0867fff640 1 -- 10.20.193.48:0/4151174037 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f085c004350 msgr2=0x7f0870131110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:45.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.968+0000 7f0867fff640 1 --2- 10.20.193.48:0/4151174037 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f085c004350 0x7f0870131110 secure :-1 s=READY pgs=193 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0858019450 tx=0x7f0858004770 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:45.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.968+0000 7f08657fa640 1 -- 10.20.193.48:0/4151174037 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f0858044070 con 0x7f085c004350 2026-02-12T18:14:45.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.968+0000 7f08657fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:45.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.968+0000 7f08657fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:14:45.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.968+0000 7f08657fa640 10 monclient: dump: 2026-02-12T18:14:45.991 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:45.992 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:45.992 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:45.992 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:45.992 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:45.992 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:45.992 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:45.992 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:45.992 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:45.992 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:45.992 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:45.992 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:45.993 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:45.993 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:45.993 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:45.993 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:45.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.968+0000 7f08657fa640 10 monclient: _finish_auth 0 2026-02-12T18:14:45.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.968+0000 7f08657fa640 10 monclient: _check_auth_tickets 2026-02-12T18:14:45.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.968+0000 7f08657fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:45.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.968+0000 7f0876acc640 5 monclient: authenticate success, global_id 65002 2026-02-12T18:14:45.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.968+0000 7f0876acc640 10 monclient: _renew_subs 2026-02-12T18:14:45.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.968+0000 7f0876acc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:14:45.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.968+0000 7f0876acc640 1 -- 10.20.193.48:0/4151174037 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0870131d80 con 0x7f085c004350 2026-02-12T18:14:45.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.968+0000 7f08657fa640 1 -- 10.20.193.48:0/4151174037 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0858003af0 con 0x7f085c004350 2026-02-12T18:14:45.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.968+0000 7f08657fa640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:45.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.968+0000 7f08657fa640 1 -- 10.20.193.48:0/4151174037 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f0858003c60 con 0x7f085c004350 2026-02-12T18:14:45.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.968+0000 7f08657fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:45.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.968+0000 7f08657fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:14:45.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.968+0000 7f0866ffd640 4 set_mon_vals no callback set 2026-02-12T18:14:45.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.968+0000 7f08657fa640 10 monclient: dump: 2026-02-12T18:14:45.994 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:45.994 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:45.994 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:45.994 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:45.994 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:45.994 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:45.995 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:45.995 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:45.995 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:45.995 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:45.995 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:45.995 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:45.995 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:45.995 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:45.995 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:45.995 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:45.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.968+0000 7f0876acc640 10 monclient: _renew_subs 2026-02-12T18:14:45.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.968+0000 7f0876acc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:14:45.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.968+0000 7f0876acc640 1 -- 10.20.193.48:0/4151174037 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f087010f1b0 con 0x7f085c004350 2026-02-12T18:14:45.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.969+0000 7f0876acc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:45.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.969+0000 7f0876acc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:45.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.969+0000 7f0876acc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:14:45.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.969+0000 7f0876acc640 1 -- 10.20.193.48:0/4151174037 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0870131f70 con 0x7f085c004350 2026-02-12T18:14:45.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.970+0000 7f08657fa640 1 -- 10.20.193.48:0/4151174037 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f085803e450 con 0x7f085c004350 2026-02-12T18:14:45.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.970+0000 7f08657fa640 1 --2- 10.20.193.48:0/4151174037 >> v2:10.20.193.111:6812/977811348 conn(0x7f084003f800 0x7f084005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:45.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.970+0000 7f08657fa640 1 -- 10.20.193.48:0/4151174037 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(311..311 src has 215..311) ==== 3897+0+0 (secure 0 0 0) 0x7f0858079970 con 0x7f085c004350 2026-02-12T18:14:45.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.970+0000 7f0874841640 1 --2- 10.20.193.48:0/4151174037 >> v2:10.20.193.111:6812/977811348 conn(0x7f084003f800 0x7f084005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:45.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.971+0000 7f0874841640 10 monclient: get_auth_request con 0x7f084003f800 auth_method 0 2026-02-12T18:14:45.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.972+0000 7f08657fa640 1 -- 10.20.193.48:0/4151174037 <== mon.4 v2:10.20.193.48:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f085803eac0 con 0x7f085c004350 2026-02-12T18:14:45.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.972+0000 7f08657fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:45.997 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.972+0000 7f08657fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:14:45.997 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:45.973+0000 7f0874841640 1 --2- 10.20.193.48:0/4151174037 >> v2:10.20.193.111:6812/977811348 conn(0x7f084003f800 0x7f084005fcb0 secure :-1 s=READY pgs=432 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f086000c680 tx=0x7f0860008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:46.023 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[32211]: starting. 2026-02-12T18:14:46.023 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[32211]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-32209 2026-02-12T18:14:46.023 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[32211]: shutting down. 2026-02-12T18:14:46.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.120+0000 7f0876acc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T18:14:46.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.120+0000 7f0876acc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T18:14:46.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.120+0000 7f0876acc640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:14:46.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.120+0000 7f0876acc640 1 -- 10.20.193.48:0/4151174037 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0870092510 con 0x7f085c004350 2026-02-12T18:14:46.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.121+0000 7f08657fa640 1 -- 10.20.193.48:0/4151174037 <== mon.4 v2:10.20.193.48:3302/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3660 (secure 0 0 0) 0x7f0858039030 con 0x7f085c004350 2026-02-12T18:14:46.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.121+0000 7f08657fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T18:14:46.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.121+0000 7f08657fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:14:46.123 INFO:teuthology.orchestra.run.trial048.stdout:{"election_epoch":76,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","modified":"2026-02-12T18:05:32.850777Z","created":"2026-02-12T18:05:32.850777Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3300","nonce":0},{"type":"v1","addr":"10.20.193.48:6789","nonce":0}]},"addr":"10.20.193.48:6789/0","public_addr":"10.20.193.48:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850827+0000","crush_location":[]},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3300","nonce":0},{"type":"v1","addr":"10.20.193.111:6789","nonce":0}]},"addr":"10.20.193.111:6789/0","public_addr":"10.20.193.111:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850829+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3301","nonce":0},{"type":"v1","addr":"10.20.193.48:6790","nonce":0}]},"addr":"10.20.193.48:6790/0","public_addr":"10.20.193.48:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850830+0000","crush_location":[]},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3301","nonce":0},{"type":"v1","addr":"10.20.193.111:6790","nonce":0}]},"addr":"10.20.193.111:6790/0","public_addr":"10.20.193.111:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850833+0000","crush_location":[]},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3302","nonce":0},{"type":"v1","addr":"10.20.193.48:6791","nonce":0}]},"addr":"10.20.193.48:6791/0","public_addr":"10.20.193.48:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3302","nonce":0},{"type":"v1","addr":"10.20.193.111:6791","nonce":0}]},"addr":"10.20.193.111:6791/0","public_addr":"10.20.193.111:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850834+0000","crush_location":[]},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3303","nonce":0},{"type":"v1","addr":"10.20.193.48:6792","nonce":0}]},"addr":"10.20.193.48:6792/0","public_addr":"10.20.193.48:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3303","nonce":0},{"type":"v1","addr":"10.20.193.111:6792","nonce":0}]},"addr":"10.20.193.111:6792/0","public_addr":"10.20.193.111:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850835+0000","crush_location":[]},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3304","nonce":0},{"type":"v1","addr":"10.20.193.48:6793","nonce":0}]},"addr":"10.20.193.48:6793/0","public_addr":"10.20.193.48:6793/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850832+0000","crush_location":[]}]}} 2026-02-12T18:14:46.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.123+0000 7f0876acc640 1 -- 10.20.193.48:0/4151174037 >> v2:10.20.193.111:6812/977811348 conn(0x7f084003f800 msgr2=0x7f084005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:46.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.123+0000 7f0876acc640 1 --2- 10.20.193.48:0/4151174037 >> v2:10.20.193.111:6812/977811348 conn(0x7f084003f800 0x7f084005fcb0 secure :-1 s=READY pgs=432 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f086000c680 tx=0x7f0860008040 comp rx=0 tx=0).stop 2026-02-12T18:14:46.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.123+0000 7f0876acc640 10 monclient: shutdown 2026-02-12T18:14:46.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.123+0000 7f0876acc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:46.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.123+0000 7f0876acc640 1 -- 10.20.193.48:0/4151174037 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f085c004350 msgr2=0x7f0870131110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:46.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.123+0000 7f0876acc640 1 --2- 10.20.193.48:0/4151174037 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f085c004350 0x7f0870131110 secure :-1 s=READY pgs=193 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0858019450 tx=0x7f0858004770 comp rx=0 tx=0).stop 2026-02-12T18:14:46.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.123+0000 7f0876acc640 1 -- 10.20.193.48:0/4151174037 shutdown_connections 2026-02-12T18:14:46.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.123+0000 7f0876acc640 1 --2- 10.20.193.48:0/4151174037 >> v2:10.20.193.111:6812/977811348 conn(0x7f084003f800 0x7f084005fcb0 unknown :-1 s=CLOSED pgs=432 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.123+0000 7f0876acc640 1 --2- 10.20.193.48:0/4151174037 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f085c004350 0x7f0870131110 unknown :-1 s=CLOSED pgs=193 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.123+0000 7f0876acc640 1 --2- 10.20.193.48:0/4151174037 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f085c004f50 0x7f0870131650 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.123+0000 7f0876acc640 1 --2- 10.20.193.48:0/4151174037 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f08540038f0 0x7f0870110f90 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.123+0000 7f0876acc640 1 -- 10.20.193.48:0/4151174037 >> 10.20.193.48:0/4151174037 conn(0x7f08700546d0 msgr2=0x7f087005cbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:46.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.123+0000 7f0876acc640 1 -- 10.20.193.48:0/4151174037 shutdown_connections 2026-02-12T18:14:46.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.123+0000 7f0876acc640 1 -- 10.20.193.48:0/4151174037 wait complete. 2026-02-12T18:14:46.134 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2026-02-12T18:14:46.134 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2026-02-12T18:14:46.134 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T18:14:46.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.200+0000 7f69310cc640 10 monclient: get_monmap_and_config 2026-02-12T18:14:46.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.200+0000 7f69310cc640 10 monclient: build_initial_monmap 2026-02-12T18:14:46.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.200+0000 7f69310cc640 10 monclient: monmap: 2026-02-12T18:14:46.202 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:46.202 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:46.202 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:14:46.201350+0000 2026-02-12T18:14:46.202 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:14:46.201350+0000 2026-02-12T18:14:46.202 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:46.202 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.202 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:14:46.202 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:14:46.202 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:46.203 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:46.203 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:46.203 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:46.203 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:46.203 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:46.203 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:46.203 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:14:46.203 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:14:46.203 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.200+0000 7f69310cc640 1 Processor -- start 2026-02-12T18:14:46.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.200+0000 7f69310cc640 1 -- start start 2026-02-12T18:14:46.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.200+0000 7f69310cc640 10 monclient: init 2026-02-12T18:14:46.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.200+0000 7f69310cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:46.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f69310cc640 10 monclient: _add_conns ranks=[0,9,4,3,10,6,2,8,5,7,1] 2026-02-12T18:14:46.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f69310cc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f692c05d550 addr v1:10.20.193.48:6789/0 2026-02-12T18:14:46.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f69310cc640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f692c13ef60 0x7f692c183320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f69310cc640 10 monclient(hunting): picked mon.noname-a con 0x7f692c13ef60 addr v2:10.20.193.48:3300/0 2026-02-12T18:14:46.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f69310cc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f692c183860 0x7f692c1a3c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f69310cc640 10 monclient(hunting): picked mon.noname-c con 0x7f692c183860 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:14:46.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f69310cc640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f692c04dc20 con 0x7f692c05d550 2026-02-12T18:14:46.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f69310cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f69310cc640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f692c08d390 con 0x7f692c13ef60 2026-02-12T18:14:46.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f69310cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f69310cc640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f692c08d5a0 con 0x7f692c183860 2026-02-12T18:14:46.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f69310cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:46.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f69310cc640 10 monclient(hunting): authenticate will time out at 1124.927064s 2026-02-12T18:14:46.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f692a575640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f692c13ef60 0x7f692c183320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f692b577640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f692c183860 0x7f692c1a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f692a575640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f692c13ef60 0x7f692c183320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:59494/0 (socket says 10.20.193.48:59494) 2026-02-12T18:14:46.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f692a575640 1 -- 10.20.193.48:0/1158080650 learned_addr learned my addr 10.20.193.48:0/1158080650 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:46.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f692a575640 10 monclient(hunting): get_auth_request con 0x7f692c13ef60 auth_method 0 2026-02-12T18:14:46.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f692a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f692a575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f692a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f692b577640 10 monclient(hunting): get_auth_request con 0x7f692c183860 auth_method 0 2026-02-12T18:14:46.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f692b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f692b577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f692b577640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f692b577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:46.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f692b577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:46.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f692b577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:46.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f692b577640 10 monclient(hunting): handle_auth_done global_id 65020 payload 274 2026-02-12T18:14:46.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f692b577640 1 -- 10.20.193.48:0/1158080650 >> v2:10.20.193.48:3300/0 conn(0x7f692c13ef60 msgr2=0x7f692c183320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:46.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f692b577640 1 --2- 10.20.193.48:0/1158080650 >> v2:10.20.193.48:3300/0 conn(0x7f692c13ef60 0x7f692c183320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f692b577640 1 -- 10.20.193.48:0/1158080650 >> v1:10.20.193.48:6789/0 conn(0x7f692c05d550 legacy=0x7f692c05d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:46.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f692b577640 10 monclient: _finish_hunting 0 2026-02-12T18:14:46.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f692b577640 1 monclient: found mon.noname-c 2026-02-12T18:14:46.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f692b577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:46.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f692b577640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:14:46.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.201+0000 7f692b577640 1 -- 10.20.193.48:0/1158080650 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f692c0580e0 con 0x7f692c183860 2026-02-12T18:14:46.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.203+0000 7f692b577640 1 -- 10.20.193.48:0/1158080650 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f692c183860 msgr2=0x7f692c1a3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:46.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.203+0000 7f692b577640 1 --2- 10.20.193.48:0/1158080650 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f692c183860 0x7f692c1a3c40 secure :-1 s=READY pgs=199 gs=3 cs=0 l=1 c_cookie=8120040137577272328 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f691c005820 tx=0x7f691c02fdf0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=70b02d7bba351408 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:46.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f6929d74640 1 -- 10.20.193.48:0/1158080650 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f691c036340 con 0x7f692c183860 2026-02-12T18:14:46.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f6929d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:46.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f6929d74640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:14:46.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f6929d74640 10 monclient: dump: 2026-02-12T18:14:46.216 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:46.216 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:46.216 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.217 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.217 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:46.217 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.217 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:46.217 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:46.217 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:46.217 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:46.217 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:46.217 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:46.217 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:46.217 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:46.217 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:46.217 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f6929d74640 10 monclient: _finish_auth 0 2026-02-12T18:14:46.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f6929d74640 10 monclient: _check_auth_tickets 2026-02-12T18:14:46.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f6929d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:46.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f6929d74640 1 -- 10.20.193.48:0/1158080650 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f691c0364c0 con 0x7f692c183860 2026-02-12T18:14:46.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f69310cc640 5 monclient: authenticate success, global_id 65020 2026-02-12T18:14:46.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f69310cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:14:46.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f6929d74640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:46.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f6929d74640 1 -- 10.20.193.48:0/1158080650 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f691c036af0 con 0x7f692c183860 2026-02-12T18:14:46.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f6929d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:46.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f6929d74640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:14:46.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f6929d74640 10 monclient: dump: 2026-02-12T18:14:46.218 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:46.219 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:46.219 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.219 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.219 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:46.219 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.219 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:46.219 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:46.219 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:46.219 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:46.219 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:46.219 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:46.219 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:46.219 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:46.220 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:46.220 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f69310cc640 10 monclient: get_monmap_and_config success 2026-02-12T18:14:46.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f69310cc640 4 set_mon_vals no callback set 2026-02-12T18:14:46.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f69310cc640 10 monclient: shutdown 2026-02-12T18:14:46.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f69310cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:46.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f69310cc640 1 -- 10.20.193.48:0/1158080650 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f692c183860 msgr2=0x7f692c1a3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:46.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f69310cc640 1 --2- 10.20.193.48:0/1158080650 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f692c183860 0x7f692c1a3c40 secure :-1 s=READY pgs=199 gs=3 cs=0 l=1 c_cookie=8120040137577272328 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f691c005820 tx=0x7f691c02fdf0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f69310cc640 1 -- 10.20.193.48:0/1158080650 shutdown_connections 2026-02-12T18:14:46.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f69310cc640 1 --2- 10.20.193.48:0/1158080650 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f692c183860 0x7f692c1a3c40 unknown :-1 s=CLOSED pgs=199 gs=3 cs=0 l=1 c_cookie=8120040137577272328 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f69310cc640 1 --2- 10.20.193.48:0/1158080650 >> v2:10.20.193.48:3300/0 conn(0x7f692c13ef60 0x7f692c183320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f69310cc640 1 -- 10.20.193.48:0/1158080650 >> 10.20.193.48:0/1158080650 conn(0x7f692c0546a0 msgr2=0x7f692c054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:46.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f69310cc640 1 -- 10.20.193.48:0/1158080650 shutdown_connections 2026-02-12T18:14:46.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f69310cc640 1 -- 10.20.193.48:0/1158080650 wait complete. 2026-02-12T18:14:46.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f69310cc640 10 monclient: build_initial_monmap 2026-02-12T18:14:46.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.204+0000 7f69310cc640 10 monclient: monmap: 2026-02-12T18:14:46.221 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:46.221 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:14:46.221 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:14:46.221 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:14:46.221 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:46.221 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.221 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:14:46.221 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:14:46.222 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:46.222 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:46.222 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:46.222 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:46.222 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:46.222 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:46.222 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:46.222 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f69310cc640 1 Processor -- start 2026-02-12T18:14:46.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f69310cc640 1 -- start start 2026-02-12T18:14:46.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f69310cc640 10 monclient: init 2026-02-12T18:14:46.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f69310cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:46.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f69310cc640 10 monclient: _add_conns ranks=[6,1,7,0,8,3,5,4,2] 2026-02-12T18:14:46.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f69310cc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f692c05d550 0x7f692c12a790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f69310cc640 10 monclient(hunting): picked mon.noname-d con 0x7f692c05d550 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:14:46.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f69310cc640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f692c13ef60 0x7f692c128190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f69310cc640 10 monclient(hunting): picked mon.noname-f con 0x7f692c13ef60 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:14:46.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f69310cc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f692c183860 0x7f692c1286d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f69310cc640 10 monclient(hunting): picked mon.noname-i con 0x7f692c183860 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:14:46.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f69310cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f69310cc640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f692c05d220 con 0x7f692c13ef60 2026-02-12T18:14:46.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f69310cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f69310cc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f692c129540 con 0x7f692c05d550 2026-02-12T18:14:46.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f69310cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f69310cc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f692c12b120 con 0x7f692c183860 2026-02-12T18:14:46.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f69310cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:46.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f69310cc640 10 monclient(hunting): authenticate will time out at 1124.931473s 2026-02-12T18:14:46.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692ad76640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f692c05d550 0x7f692c12a790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692ad76640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f692c05d550 0x7f692c12a790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:35784/0 (socket says 10.20.193.48:35784) 2026-02-12T18:14:46.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692ad76640 1 -- 10.20.193.48:0/198876318 learned_addr learned my addr 10.20.193.48:0/198876318 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:46.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692ad76640 10 monclient(hunting): get_auth_request con 0x7f692c05d550 auth_method 0 2026-02-12T18:14:46.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692ad76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692b577640 1 --2- 10.20.193.48:0/198876318 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f692c183860 0x7f692c1286d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692a575640 1 --2- 10.20.193.48:0/198876318 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f692c13ef60 0x7f692c128190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692ad76640 1 -- 10.20.193.48:0/198876318 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f692c05d550 msgr2=0x7f692c12a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-12T18:14:46.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692ad76640 1 -- 10.20.193.48:0/198876318 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f692c05d550 msgr2=0x7f692c12a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:14:46.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692ad76640 1 --2- 10.20.193.48:0/198876318 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f692c05d550 0x7f692c12a790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:46.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692ad76640 1 --2- 10.20.193.48:0/198876318 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f692c05d550 0x7f692c12a790 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:14:46.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692b577640 10 monclient(hunting): get_auth_request con 0x7f692c183860 auth_method 0 2026-02-12T18:14:46.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692b577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692b577640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692a575640 10 monclient(hunting): get_auth_request con 0x7f692c13ef60 auth_method 0 2026-02-12T18:14:46.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692a575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692b577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:46.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692b577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:46.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692b577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:46.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:46.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:46.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.205+0000 7f692a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:46.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.206+0000 7f692b577640 10 monclient(hunting): handle_auth_done global_id 94642 payload 824 2026-02-12T18:14:46.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.206+0000 7f692b577640 1 -- 10.20.193.48:0/198876318 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f692c05d550 msgr2=0x7f692c12a790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:14:46.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.206+0000 7f692b577640 1 --2- 10.20.193.48:0/198876318 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f692c05d550 0x7f692c12a790 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.206+0000 7f692b577640 1 -- 10.20.193.48:0/198876318 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f692c13ef60 msgr2=0x7f692c128190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:46.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.206+0000 7f692b577640 1 --2- 10.20.193.48:0/198876318 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f692c13ef60 0x7f692c128190 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.206+0000 7f692b577640 10 monclient: _finish_hunting 0 2026-02-12T18:14:46.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.206+0000 7f692b577640 1 monclient: found mon.noname-i 2026-02-12T18:14:46.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.206+0000 7f692b577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:46.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.206+0000 7f692b577640 10 monclient: _send_mon_message to mon.noname-i at v2:10.20.193.111:3303/0 2026-02-12T18:14:46.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.206+0000 7f692b577640 1 -- 10.20.193.48:0/198876318 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f691c00a500 con 0x7f692c183860 2026-02-12T18:14:46.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.206+0000 7f692a575640 1 --2- 10.20.193.48:0/198876318 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f692c13ef60 0x7f692c128190 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:14:46.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.208+0000 7f692b577640 1 -- 10.20.193.48:0/198876318 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f692c183860 msgr2=0x7f692c1286d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:46.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.208+0000 7f692b577640 1 --2- 10.20.193.48:0/198876318 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f692c183860 0x7f692c1286d0 secure :-1 s=READY pgs=124 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f691c005820 tx=0x7f691c005850 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:46.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.208+0000 7f690b7fe640 1 -- 10.20.193.48:0/198876318 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f691c038900 con 0x7f692c183860 2026-02-12T18:14:46.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.208+0000 7f690b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:46.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.208+0000 7f690b7fe640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2026-02-12T18:14:46.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.208+0000 7f690b7fe640 10 monclient: dump: 2026-02-12T18:14:46.227 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:46.227 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:46.228 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.228 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.228 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:46.228 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.228 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:46.228 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:46.228 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:46.228 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:46.228 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:46.228 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:46.228 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:46.228 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:46.229 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:46.229 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.208+0000 7f690b7fe640 10 monclient: _finish_auth 0 2026-02-12T18:14:46.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.208+0000 7f690b7fe640 10 monclient: _check_auth_tickets 2026-02-12T18:14:46.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.208+0000 7f690b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:46.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.208+0000 7f69310cc640 5 monclient: authenticate success, global_id 94642 2026-02-12T18:14:46.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.208+0000 7f690b7fe640 1 -- 10.20.193.48:0/198876318 <== mon.7 v2:10.20.193.111:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f691c038a60 con 0x7f692c183860 2026-02-12T18:14:46.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.208+0000 7f690b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:46.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.208+0000 7f690b7fe640 1 -- 10.20.193.48:0/198876318 <== mon.7 v2:10.20.193.111:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f691c038bd0 con 0x7f692c183860 2026-02-12T18:14:46.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.208+0000 7f690b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:46.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.208+0000 7f690b7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:14:46.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.208+0000 7f6929573640 4 set_mon_vals no callback set 2026-02-12T18:14:46.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.208+0000 7f690b7fe640 10 monclient: dump: 2026-02-12T18:14:46.230 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:46.230 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:46.230 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.230 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.230 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:46.230 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.230 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:46.230 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:46.230 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:46.230 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:46.230 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:46.230 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:46.231 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:46.231 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:46.231 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:46.231 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.208+0000 7f69310cc640 10 monclient: _renew_subs 2026-02-12T18:14:46.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.208+0000 7f69310cc640 10 monclient: _send_mon_message to mon.i at v2:10.20.193.111:3303/0 2026-02-12T18:14:46.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.208+0000 7f69310cc640 1 -- 10.20.193.48:0/198876318 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f692c129c30 con 0x7f692c183860 2026-02-12T18:14:46.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.208+0000 7f69310cc640 10 monclient: _renew_subs 2026-02-12T18:14:46.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.208+0000 7f69310cc640 10 monclient: _send_mon_message to mon.i at v2:10.20.193.111:3303/0 2026-02-12T18:14:46.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.208+0000 7f69310cc640 1 -- 10.20.193.48:0/198876318 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f692c12b6f0 con 0x7f692c183860 2026-02-12T18:14:46.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.209+0000 7f69310cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:46.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.209+0000 7f69310cc640 1 --2- 10.20.193.48:0/198876318 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f692c091010 0x7f692c128c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.209+0000 7f69310cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.209+0000 7f69310cc640 1 -- 10.20.193.48:0/198876318 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f692c0631f0 con 0x7f692c091010 2026-02-12T18:14:46.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.209+0000 7f692ad76640 1 --2- 10.20.193.48:0/198876318 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f692c091010 0x7f692c128c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.209+0000 7f692ad76640 10 monclient: get_auth_request con 0x7f692c091010 auth_method 0 2026-02-12T18:14:46.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.209+0000 7f692ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.209+0000 7f692ad76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.209+0000 7f692ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.209+0000 7f692ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:46.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.209+0000 7f692ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:46.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.209+0000 7f692ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:46.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.209+0000 7f690b7fe640 1 -- 10.20.193.48:0/198876318 <== mon.7 v2:10.20.193.111:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f691c047020 con 0x7f692c183860 2026-02-12T18:14:46.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.209+0000 7f692ad76640 10 monclient(hunting): handle_auth_done global_id 6786 payload 824 2026-02-12T18:14:46.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.209+0000 7f692ad76640 1 -- 10.20.193.48:0/198876318 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f692c05e310 con 0x7f692c091010 2026-02-12T18:14:46.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.209+0000 7f690b7fe640 1 --2- 10.20.193.48:0/198876318 >> v2:10.20.193.111:6812/977811348 conn(0x7f68f803f800 0x7f68f805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.209+0000 7f690b7fe640 1 -- 10.20.193.48:0/198876318 <== mon.7 v2:10.20.193.111:3303/0 5 ==== osd_map(312..312 src has 215..312) ==== 3503+0+0 (secure 0 0 0) 0x7f691c078d10 con 0x7f692c183860 2026-02-12T18:14:46.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.209+0000 7f692a575640 1 --2- 10.20.193.48:0/198876318 >> v2:10.20.193.111:6812/977811348 conn(0x7f68f803f800 0x7f68f805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.209+0000 7f692a575640 10 monclient: get_auth_request con 0x7f68f803f800 auth_method 0 2026-02-12T18:14:46.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.211+0000 7f692ad76640 1 -- 10.20.193.48:0/198876318 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f692c091010 msgr2=0x7f692c128c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:46.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.211+0000 7f692ad76640 1 --2- 10.20.193.48:0/198876318 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f692c091010 0x7f692c128c10 secure :-1 s=READY pgs=610 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f692000e700 tx=0x7f692000ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:46.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.211+0000 7f690b7fe640 1 -- 10.20.193.48:0/198876318 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6920007030 con 0x7f692c091010 2026-02-12T18:14:46.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.211+0000 7f690b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:46.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.211+0000 7f690b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:14:46.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.211+0000 7f690b7fe640 10 monclient: dump: 2026-02-12T18:14:46.236 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:46.236 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:46.236 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.236 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.236 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:46.236 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.237 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:46.237 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:46.237 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:46.237 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:46.237 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:46.237 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:46.237 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:46.237 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:46.237 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:46.237 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.212+0000 7f690b7fe640 1 -- 10.20.193.48:0/198876318 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f6920006aa0 con 0x7f692c091010 2026-02-12T18:14:46.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.212+0000 7f690b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:46.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.212+0000 7f690b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:14:46.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.212+0000 7f690b7fe640 1 -- 10.20.193.48:0/198876318 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f692c091010 msgr2=0x7f692c128c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:46.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.212+0000 7f690b7fe640 1 --2- 10.20.193.48:0/198876318 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f692c091010 0x7f692c128c10 secure :-1 s=READY pgs=610 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f692000e700 tx=0x7f692000ebd0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.212+0000 7f690b7fe640 1 -- 10.20.193.48:0/198876318 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f692c091010 msgr2=0x7f692c128c10 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:46.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.212+0000 7f690b7fe640 1 --2- 10.20.193.48:0/198876318 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f692c091010 0x7f692c128c10 secure :-1 s=CLOSED pgs=610 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f692000e700 tx=0x7f692000ebd0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.212+0000 7f692a575640 1 --2- 10.20.193.48:0/198876318 >> v2:10.20.193.111:6812/977811348 conn(0x7f68f803f800 0x7f68f805fcb0 secure :-1 s=READY pgs=433 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f692c12a2a0 tx=0x7f6914008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:46.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.215+0000 7f69310cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:14:46.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.215+0000 7f69310cc640 1 --2- 10.20.193.48:0/198876318 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f692c123ba0 0x7f692c123f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.215+0000 7f69310cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.215+0000 7f69310cc640 1 -- 10.20.193.48:0/198876318 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f692c05f140 con 0x7f692c123ba0 2026-02-12T18:14:46.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.215+0000 7f692ad76640 1 --2- 10.20.193.48:0/198876318 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f692c123ba0 0x7f692c123f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.215+0000 7f692ad76640 10 monclient: get_auth_request con 0x7f692c123ba0 auth_method 0 2026-02-12T18:14:46.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.215+0000 7f692ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.215+0000 7f692ad76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.215+0000 7f692ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.215+0000 7f692ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:46.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.215+0000 7f692ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:46.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.215+0000 7f692ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:46.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.215+0000 7f692ad76640 10 monclient(hunting): handle_auth_done global_id 6795 payload 824 2026-02-12T18:14:46.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.215+0000 7f692ad76640 1 -- 10.20.193.48:0/198876318 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f692c057e00 con 0x7f692c123ba0 2026-02-12T18:14:46.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.218+0000 7f692ad76640 1 -- 10.20.193.48:0/198876318 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f692c123ba0 msgr2=0x7f692c123f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:46.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.218+0000 7f692ad76640 1 --2- 10.20.193.48:0/198876318 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f692c123ba0 0x7f692c123f70 secure :-1 s=READY pgs=611 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6920015000 tx=0x7f6920003810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:46.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.218+0000 7f690b7fe640 1 -- 10.20.193.48:0/198876318 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6920003030 con 0x7f692c123ba0 2026-02-12T18:14:46.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.218+0000 7f690b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:46.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.218+0000 7f690b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:14:46.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.218+0000 7f690b7fe640 10 monclient: dump: 2026-02-12T18:14:46.239 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:46.239 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:46.239 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.239 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.239 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:46.239 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.239 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:46.239 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:46.240 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:46.240 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:46.240 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:46.240 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:46.240 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:46.240 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:46.240 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:46.240 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.218+0000 7f690b7fe640 1 -- 10.20.193.48:0/198876318 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10184 (secure 0 0 0) 0x7f6920003190 con 0x7f692c123ba0 2026-02-12T18:14:46.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.218+0000 7f690b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:14:46.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.218+0000 7f690b7fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:14:46.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.218+0000 7f690b7fe640 1 -- 10.20.193.48:0/198876318 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f692c123ba0 msgr2=0x7f692c123f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:46.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.218+0000 7f690b7fe640 1 --2- 10.20.193.48:0/198876318 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f692c123ba0 0x7f692c123f70 secure :-1 s=READY pgs=611 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6920015000 tx=0x7f6920003810 comp rx=0 tx=0).stop 2026-02-12T18:14:46.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.218+0000 7f690b7fe640 1 -- 10.20.193.48:0/198876318 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f692c123ba0 msgr2=0x7f692c123f70 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:46.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.218+0000 7f690b7fe640 1 --2- 10.20.193.48:0/198876318 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f692c123ba0 0x7f692c123f70 secure :-1 s=CLOSED pgs=611 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6920015000 tx=0x7f6920003810 comp rx=0 tx=0).stop 2026-02-12T18:14:46.241 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:14:46.241 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:14:46.241 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:14:46.241 INFO:teuthology.orchestra.run.trial048.stdout: "state": "leader", 2026-02-12T18:14:46.241 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 76, 2026-02-12T18:14:46.241 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 541053, 2026-02-12T18:14:46.241 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:14:46.241 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:14:46.241 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:14:46.242 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:14:46.242 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:14:46.242 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:14:46.242 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:14:46.242 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:14:46.242 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:14:46.242 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:14:46.242 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:46.242 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:14:46.242 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:46.242 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:14:46.242 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:14:46.242 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:46.242 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:46.242 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:46.242 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:46.243 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:46.243 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:46.243 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:46.243 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:46.243 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:46.243 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:46.243 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:46.243 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:46.243 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:46.243 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:46.243 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:14:46.243 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:14:46.243 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:46.243 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:46.243 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:46.244 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:46.244 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:46.244 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:46.244 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:46.244 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:46.244 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:46.244 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:46.244 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:46.244 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:46.244 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:46.244 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.244 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.244 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:14:46.244 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:14:46.244 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:14:46.244 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:14:46.245 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:14:46.245 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:14:46.245 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:46.245 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:46.245 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:14:46.245 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:14:46.245 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:14:46.245 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:14:46.245 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:14:46.245 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:14:46.245 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:14:46.245 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:46.245 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:14:46.245 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:46.245 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:46.245 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:46.246 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:46.246 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:46.246 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:46.246 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:46.246 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:46.246 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:46.246 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:46.246 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:46.246 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:46.246 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:46.246 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:46.246 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:14:46.246 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.246 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:14:46.246 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.246 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:14:46.246 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:14:46.247 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.247 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.247 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.247 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.247 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:14:46.247 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.247 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.247 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.247 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.247 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:14:46.247 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.247 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.247 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.247 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.247 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:14:46.247 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:14:46.247 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.247 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.247 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:14:46.248 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.248 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.248 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.248 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:14:46.248 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:14:46.248 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.248 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.248 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.248 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.248 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:14:46.248 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.248 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.248 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.248 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.248 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:14:46.248 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.248 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.248 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.248 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.249 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:14:46.249 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:14:46.249 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.249 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.249 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:14:46.249 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.249 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.249 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.249 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:14:46.249 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:14:46.249 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.249 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.249 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.249 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.249 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:14:46.249 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.249 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.249 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.249 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.249 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:14:46.250 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.250 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.250 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.250 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.250 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:14:46.250 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:14:46.250 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.250 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.250 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:14:46.250 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.250 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.250 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.250 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:14:46.250 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:14:46.250 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.250 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.250 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.250 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.250 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:14:46.250 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.251 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.251 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.251 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.251 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:14:46.251 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.251 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.251 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.251 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.251 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:14:46.251 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:14:46.251 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.251 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.251 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:14:46.251 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.251 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.251 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.251 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:14:46.251 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:14:46.251 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.251 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.251 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.252 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.252 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:14:46.252 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.252 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.252 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.252 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.252 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:14:46.252 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.252 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.252 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.252 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.252 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:14:46.252 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:14:46.252 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.252 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.252 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:46.252 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.252 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.252 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.252 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:14:46.252 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:14:46.252 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.253 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.253 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.253 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.253 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:14:46.253 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.253 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.253 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.253 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.253 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:14:46.253 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.253 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.253 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.253 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.253 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:14:46.253 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:14:46.253 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.253 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.253 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:14:46.253 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.253 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.253 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.253 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:14:46.254 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:14:46.254 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.254 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.254 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.254 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.254 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:14:46.254 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.254 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.254 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.254 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.254 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:14:46.254 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.254 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.254 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.254 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.254 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:14:46.254 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:14:46.254 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.254 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.254 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:46.254 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.254 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.255 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.255 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:14:46.255 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:14:46.255 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.255 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.255 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.255 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.255 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:14:46.255 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.255 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.255 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.255 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.255 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:14:46.255 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.255 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.255 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.255 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.255 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:14:46.255 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:14:46.255 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.255 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.255 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:14:46.255 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.256 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.256 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.256 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:14:46.256 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:14:46.256 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.256 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.256 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.256 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.256 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:14:46.256 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.256 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.256 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.256 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.256 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:14:46.256 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.256 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.256 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.256 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.256 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:14:46.256 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:14:46.256 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.256 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.256 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:14:46.257 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.257 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.257 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.257 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.257 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:14:46.257 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:14:46.257 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.257 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:46.257 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:46.257 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:46.257 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.257 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:46.257 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:14:46.257 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.257 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:46.257 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:46.257 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:46.257 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.257 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:46.257 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:14:46.257 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.257 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:46.257 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:46.257 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:14:46.258 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.258 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.258 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.258 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:14:46.258 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:14:46.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.218+0000 7f69310cc640 1 -- 10.20.193.48:0/198876318 >> v2:10.20.193.111:6812/977811348 conn(0x7f68f803f800 msgr2=0x7f68f805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:46.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.218+0000 7f69310cc640 1 --2- 10.20.193.48:0/198876318 >> v2:10.20.193.111:6812/977811348 conn(0x7f68f803f800 0x7f68f805fcb0 secure :-1 s=READY pgs=433 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f692c12a2a0 tx=0x7f6914008040 comp rx=0 tx=0).stop 2026-02-12T18:14:46.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.218+0000 7f69310cc640 10 monclient: shutdown 2026-02-12T18:14:46.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.218+0000 7f69310cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:46.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.218+0000 7f69310cc640 1 -- 10.20.193.48:0/198876318 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f692c183860 msgr2=0x7f692c1286d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:46.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.218+0000 7f692b577640 1 -- 10.20.193.48:0/198876318 reap_dead start 2026-02-12T18:14:46.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.218+0000 7f69310cc640 1 --2- 10.20.193.48:0/198876318 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f692c183860 0x7f692c1286d0 secure :-1 s=READY pgs=124 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f691c005820 tx=0x7f691c005850 comp rx=0 tx=0).stop 2026-02-12T18:14:46.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.218+0000 7f69310cc640 1 -- 10.20.193.48:0/198876318 shutdown_connections 2026-02-12T18:14:46.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.218+0000 7f69310cc640 1 --2- 10.20.193.48:0/198876318 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f692c183860 0x7f692c1286d0 unknown :-1 s=CLOSED pgs=124 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.218+0000 7f69310cc640 1 -- 10.20.193.48:0/198876318 >> 10.20.193.48:0/198876318 conn(0x7f692c0546a0 msgr2=0x7f692c08a680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:46.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.218+0000 7f69310cc640 1 -- 10.20.193.48:0/198876318 shutdown_connections 2026-02-12T18:14:46.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.218+0000 7f69310cc640 1 -- 10.20.193.48:0/198876318 wait complete. 2026-02-12T18:14:46.259 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:14:46.259 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2026-02-12T18:14:46.260 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T18:14:46.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.325+0000 7f44cb90c640 10 monclient: get_monmap_and_config 2026-02-12T18:14:46.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.325+0000 7f44cb90c640 10 monclient: build_initial_monmap 2026-02-12T18:14:46.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.325+0000 7f44cb90c640 10 monclient: monmap: 2026-02-12T18:14:46.327 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:46.328 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:46.328 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:14:46.326858+0000 2026-02-12T18:14:46.328 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:14:46.326858+0000 2026-02-12T18:14:46.328 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:46.328 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.328 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:14:46.328 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:14:46.328 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:46.328 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:46.328 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:46.328 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:46.328 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:46.328 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:46.328 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:46.329 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:14:46.329 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:14:46.329 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.326+0000 7f44cb90c640 1 Processor -- start 2026-02-12T18:14:46.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.326+0000 7f44cb90c640 1 -- start start 2026-02-12T18:14:46.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.326+0000 7f44cb90c640 10 monclient: init 2026-02-12T18:14:46.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.326+0000 7f44cb90c640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:46.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.326+0000 7f44cb90c640 10 monclient: _add_conns ranks=[5,7,6,0,2,4,10,1,9,8,3] 2026-02-12T18:14:46.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.326+0000 7f44cb90c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f44c40951a0 0x7f44c4093850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.326+0000 7f44cb90c640 10 monclient(hunting): picked mon.noname-h con 0x7f44c40951a0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:14:46.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.326+0000 7f44cb90c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f44c4096ad0 0x7f44c4095570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.326+0000 7f44cb90c640 10 monclient(hunting): picked mon.noname-i con 0x7f44c4096ad0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:14:46.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.326+0000 7f44cb90c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f44c4095ab0 0x7f44c41a4ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.326+0000 7f44cb90c640 10 monclient(hunting): picked mon.noname-d con 0x7f44c4095ab0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:14:46.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.326+0000 7f44cb90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.326+0000 7f44cb90c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f44c4096900 con 0x7f44c40951a0 2026-02-12T18:14:46.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.326+0000 7f44cb90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.326+0000 7f44cb90c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f44c4092260 con 0x7f44c4095ab0 2026-02-12T18:14:46.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.326+0000 7f44cb90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.326+0000 7f44cb90c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f44c4093070 con 0x7f44c4096ad0 2026-02-12T18:14:46.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.326+0000 7f44cb90c640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:46.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.326+0000 7f44cb90c640 10 monclient(hunting): authenticate will time out at 1125.052900s 2026-02-12T18:14:46.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c9e82640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f44c4095ab0 0x7f44c41a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c9e82640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f44c4095ab0 0x7f44c41a4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:35786/0 (socket says 10.20.193.48:35786) 2026-02-12T18:14:46.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c9e82640 1 -- 10.20.193.48:0/1391218502 learned_addr learned my addr 10.20.193.48:0/1391218502 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:46.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c9e82640 10 monclient(hunting): get_auth_request con 0x7f44c4095ab0 auth_method 0 2026-02-12T18:14:46.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c9e82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c9e82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c9e82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c9681640 1 --2- 10.20.193.48:0/1391218502 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f44c40951a0 0x7f44c4093850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c8e80640 1 --2- 10.20.193.48:0/1391218502 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f44c4096ad0 0x7f44c4095570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c9681640 10 monclient(hunting): get_auth_request con 0x7f44c40951a0 auth_method 0 2026-02-12T18:14:46.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c9681640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c9681640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c9681640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c8e80640 10 monclient(hunting): get_auth_request con 0x7f44c4096ad0 auth_method 0 2026-02-12T18:14:46.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c8e80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c8e80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c8e80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c9e82640 1 -- 10.20.193.48:0/1391218502 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f44c4095ab0 msgr2=0x7f44c41a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-12T18:14:46.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c9e82640 1 -- 10.20.193.48:0/1391218502 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f44c4095ab0 msgr2=0x7f44c41a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:14:46.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c9e82640 1 --2- 10.20.193.48:0/1391218502 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f44c4095ab0 0x7f44c41a4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:46.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c9e82640 1 --2- 10.20.193.48:0/1391218502 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f44c4095ab0 0x7f44c41a4ba0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:14:46.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c9681640 1 -- 10.20.193.48:0/1391218502 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f44c40951a0 msgr2=0x7f44c4093850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:14:46.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c9681640 1 -- 10.20.193.48:0/1391218502 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f44c40951a0 msgr2=0x7f44c4093850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:14:46.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c9681640 1 --2- 10.20.193.48:0/1391218502 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f44c40951a0 0x7f44c4093850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:46.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c9681640 1 --2- 10.20.193.48:0/1391218502 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f44c40951a0 0x7f44c4093850 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:14:46.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c8e80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:46.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c8e80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:46.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c8e80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:46.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c8e80640 10 monclient(hunting): handle_auth_done global_id 94660 payload 274 2026-02-12T18:14:46.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c8e80640 1 -- 10.20.193.48:0/1391218502 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f44c4095ab0 msgr2=0x7f44c41a4ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:14:46.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c8e80640 1 --2- 10.20.193.48:0/1391218502 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f44c4095ab0 0x7f44c41a4ba0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c8e80640 1 -- 10.20.193.48:0/1391218502 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f44c40951a0 msgr2=0x7f44c4093850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:14:46.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c8e80640 1 --2- 10.20.193.48:0/1391218502 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f44c40951a0 0x7f44c4093850 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c8e80640 10 monclient: _finish_hunting 0 2026-02-12T18:14:46.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c8e80640 1 monclient: found mon.noname-i 2026-02-12T18:14:46.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c8e80640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:46.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c8e80640 10 monclient: _send_mon_message to mon.noname-i at v2:10.20.193.111:3303/0 2026-02-12T18:14:46.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.327+0000 7f44c8e80640 1 -- 10.20.193.48:0/1391218502 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44c404dc20 con 0x7f44c4096ad0 2026-02-12T18:14:46.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.329+0000 7f44c8e80640 1 -- 10.20.193.48:0/1391218502 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f44c4096ad0 msgr2=0x7f44c4095570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:46.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.329+0000 7f44c8e80640 1 --2- 10.20.193.48:0/1391218502 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f44c4096ad0 0x7f44c4095570 secure :-1 s=READY pgs=126 gs=3 cs=0 l=1 c_cookie=4995623850374947987 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44b8009830 tx=0x7f44b802ed30 comp rx=0 tx=0).ready entity=mon.7 client_cookie=4554056c89116493 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:46.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44b3fff640 1 -- 10.20.193.48:0/1391218502 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f44b802fe70 con 0x7f44c4096ad0 2026-02-12T18:14:46.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:46.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44b3fff640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2026-02-12T18:14:46.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44b3fff640 10 monclient: dump: 2026-02-12T18:14:46.339 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:46.339 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:46.339 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.339 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.339 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:46.339 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.339 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:46.339 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:46.339 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:46.339 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:46.339 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:46.339 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:46.339 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:46.340 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:46.340 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:46.340 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44b3fff640 10 monclient: _finish_auth 0 2026-02-12T18:14:46.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44b3fff640 10 monclient: _check_auth_tickets 2026-02-12T18:14:46.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:46.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44b3fff640 1 -- 10.20.193.48:0/1391218502 <== mon.7 v2:10.20.193.111:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44b8035340 con 0x7f44c4096ad0 2026-02-12T18:14:46.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44b3fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:46.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44cb90c640 5 monclient: authenticate success, global_id 94660 2026-02-12T18:14:46.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44b3fff640 1 -- 10.20.193.48:0/1391218502 <== mon.7 v2:10.20.193.111:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f44b8035970 con 0x7f44c4096ad0 2026-02-12T18:14:46.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44cb90c640 10 monclient: get_monmap_and_config success 2026-02-12T18:14:46.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44cb90c640 4 set_mon_vals no callback set 2026-02-12T18:14:46.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44b3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:46.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44b3fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:14:46.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44b3fff640 10 monclient: dump: 2026-02-12T18:14:46.340 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:46.341 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:46.341 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.341 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.341 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:46.341 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.341 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:46.341 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:46.341 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:46.341 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:46.341 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:46.341 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:46.341 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:46.341 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:46.341 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:46.341 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44cb90c640 10 monclient: shutdown 2026-02-12T18:14:46.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44cb90c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:46.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44cb90c640 1 -- 10.20.193.48:0/1391218502 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f44c4096ad0 msgr2=0x7f44c4095570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:46.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44cb90c640 1 --2- 10.20.193.48:0/1391218502 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f44c4096ad0 0x7f44c4095570 secure :-1 s=READY pgs=126 gs=3 cs=0 l=1 c_cookie=4995623850374947987 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44b8009830 tx=0x7f44b802ed30 comp rx=0 tx=0).stop 2026-02-12T18:14:46.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44cb90c640 1 -- 10.20.193.48:0/1391218502 shutdown_connections 2026-02-12T18:14:46.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44cb90c640 1 --2- 10.20.193.48:0/1391218502 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f44c4096ad0 0x7f44c4095570 unknown :-1 s=CLOSED pgs=126 gs=3 cs=0 l=1 c_cookie=4995623850374947987 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44cb90c640 1 --2- 10.20.193.48:0/1391218502 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f44c4095ab0 0x7f44c41a4ba0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44cb90c640 1 --2- 10.20.193.48:0/1391218502 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f44c40951a0 0x7f44c4093850 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44cb90c640 1 -- 10.20.193.48:0/1391218502 >> 10.20.193.48:0/1391218502 conn(0x7f44c40548c0 msgr2=0x7f44c40973a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:46.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44cb90c640 1 -- 10.20.193.48:0/1391218502 shutdown_connections 2026-02-12T18:14:46.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.330+0000 7f44cb90c640 1 -- 10.20.193.48:0/1391218502 wait complete. 2026-02-12T18:14:46.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44cb90c640 10 monclient: build_initial_monmap 2026-02-12T18:14:46.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44cb90c640 10 monclient: monmap: 2026-02-12T18:14:46.342 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:46.342 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:14:46.342 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:14:46.342 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:14:46.343 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:46.343 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.343 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:14:46.343 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:14:46.343 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:46.343 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:46.343 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:46.343 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:46.343 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:46.343 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:46.343 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:46.343 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44cb90c640 1 Processor -- start 2026-02-12T18:14:46.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44cb90c640 1 -- start start 2026-02-12T18:14:46.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44cb90c640 10 monclient: init 2026-02-12T18:14:46.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44cb90c640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:46.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44cb90c640 10 monclient: _add_conns ranks=[1,3,6,7,4,8,0,5,2] 2026-02-12T18:14:46.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44cb90c640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f44c40951a0 0x7f44c41db070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44cb90c640 10 monclient(hunting): picked mon.noname-f con 0x7f44c40951a0 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:14:46.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44cb90c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f44c4095ab0 0x7f44c41ada10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44cb90c640 10 monclient(hunting): picked mon.noname-g con 0x7f44c4095ab0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:14:46.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44cb90c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f44c4096ad0 0x7f44c41adf50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44cb90c640 10 monclient(hunting): picked mon.noname-d con 0x7f44c4096ad0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:14:46.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44cb90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44cb90c640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f44c40901a0 con 0x7f44c40951a0 2026-02-12T18:14:46.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44cb90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44cb90c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f44c41978a0 con 0x7f44c4095ab0 2026-02-12T18:14:46.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44cb90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44cb90c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f44c408d120 con 0x7f44c4096ad0 2026-02-12T18:14:46.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44cb90c640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:46.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44cb90c640 10 monclient(hunting): authenticate will time out at 1125.057692s 2026-02-12T18:14:46.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44c9e82640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f44c4096ad0 0x7f44c41adf50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44c9e82640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f44c4096ad0 0x7f44c41adf50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:35802/0 (socket says 10.20.193.48:35802) 2026-02-12T18:14:46.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44c9e82640 1 -- 10.20.193.48:0/1914155814 learned_addr learned my addr 10.20.193.48:0/1914155814 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:46.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44c9e82640 10 monclient(hunting): get_auth_request con 0x7f44c4096ad0 auth_method 0 2026-02-12T18:14:46.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44c9e82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44c9e82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44c9e82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44c9681640 1 --2- 10.20.193.48:0/1914155814 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f44c40951a0 0x7f44c41db070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44c9681640 10 monclient(hunting): get_auth_request con 0x7f44c40951a0 auth_method 0 2026-02-12T18:14:46.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44c9681640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44c9681640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44c9681640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44c9e82640 1 -- 10.20.193.48:0/1914155814 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f44c4096ad0 msgr2=0x7f44c41adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-12T18:14:46.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44c9e82640 1 -- 10.20.193.48:0/1914155814 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f44c4096ad0 msgr2=0x7f44c41adf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:14:46.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44c9e82640 1 --2- 10.20.193.48:0/1914155814 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f44c4096ad0 0x7f44c41adf50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:46.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44c8e80640 1 --2- 10.20.193.48:0/1914155814 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f44c4095ab0 0x7f44c41ada10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44c9e82640 1 --2- 10.20.193.48:0/1914155814 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f44c4096ad0 0x7f44c41adf50 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:14:46.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44c8e80640 10 monclient(hunting): get_auth_request con 0x7f44c4095ab0 auth_method 0 2026-02-12T18:14:46.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44c8e80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44c8e80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44c8e80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44c9681640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:46.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44c9681640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:46.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.331+0000 7f44c9681640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:46.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.332+0000 7f44c8e80640 1 -- 10.20.193.48:0/1914155814 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f44c4095ab0 msgr2=0x7f44c41ada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-12T18:14:46.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.332+0000 7f44c8e80640 1 -- 10.20.193.48:0/1914155814 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f44c4095ab0 msgr2=0x7f44c41ada10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:14:46.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.332+0000 7f44c8e80640 1 --2- 10.20.193.48:0/1914155814 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f44c4095ab0 0x7f44c41ada10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:46.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.332+0000 7f44c8e80640 1 --2- 10.20.193.48:0/1914155814 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f44c4095ab0 0x7f44c41ada10 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:14:46.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.332+0000 7f44c9681640 10 monclient(hunting): handle_auth_done global_id 94789 payload 824 2026-02-12T18:14:46.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.332+0000 7f44c9681640 1 -- 10.20.193.48:0/1914155814 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f44c4096ad0 msgr2=0x7f44c41adf50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:14:46.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.332+0000 7f44c9681640 1 --2- 10.20.193.48:0/1914155814 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f44c4096ad0 0x7f44c41adf50 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.332+0000 7f44c9681640 1 -- 10.20.193.48:0/1914155814 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f44c4095ab0 msgr2=0x7f44c41ada10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:14:46.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.332+0000 7f44c9681640 1 --2- 10.20.193.48:0/1914155814 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f44c4095ab0 0x7f44c41ada10 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.332+0000 7f44c9681640 10 monclient: _finish_hunting 0 2026-02-12T18:14:46.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.332+0000 7f44c9681640 1 monclient: found mon.noname-f 2026-02-12T18:14:46.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.332+0000 7f44c9681640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:46.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.332+0000 7f44c9681640 10 monclient: _send_mon_message to mon.noname-f at v2:10.20.193.111:3300/0 2026-02-12T18:14:46.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.332+0000 7f44c9681640 1 -- 10.20.193.48:0/1914155814 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44b8009420 con 0x7f44c40951a0 2026-02-12T18:14:46.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.334+0000 7f44c9681640 1 -- 10.20.193.48:0/1914155814 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f44c40951a0 msgr2=0x7f44c41db070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:46.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.334+0000 7f44c9681640 1 --2- 10.20.193.48:0/1914155814 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f44c40951a0 0x7f44c41db070 secure :-1 s=READY pgs=149 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44b400e810 tx=0x7f44b400ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:46.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.334+0000 7f44b1ffb640 1 -- 10.20.193.48:0/1914155814 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f44b400ee20 con 0x7f44c40951a0 2026-02-12T18:14:46.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.334+0000 7f44b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:46.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.334+0000 7f44b1ffb640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2026-02-12T18:14:46.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.334+0000 7f44b1ffb640 10 monclient: dump: 2026-02-12T18:14:46.352 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:46.352 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:46.352 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.352 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.352 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:46.352 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.352 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:46.352 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:46.352 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:46.353 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:46.353 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:46.353 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:46.353 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:46.353 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:46.353 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:46.353 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.334+0000 7f44b1ffb640 10 monclient: _finish_auth 0 2026-02-12T18:14:46.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.334+0000 7f44b1ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:14:46.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.334+0000 7f44b1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:46.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.334+0000 7f44b1ffb640 1 -- 10.20.193.48:0/1914155814 <== mon.1 v2:10.20.193.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f44b400cda0 con 0x7f44c40951a0 2026-02-12T18:14:46.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.334+0000 7f44cb90c640 5 monclient: authenticate success, global_id 94789 2026-02-12T18:14:46.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.334+0000 7f44cb90c640 10 monclient: _renew_subs 2026-02-12T18:14:46.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.334+0000 7f44cb90c640 10 monclient: _send_mon_message to mon.f at v2:10.20.193.111:3300/0 2026-02-12T18:14:46.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.334+0000 7f44cb90c640 1 -- 10.20.193.48:0/1914155814 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44c4198f50 con 0x7f44c40951a0 2026-02-12T18:14:46.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.334+0000 7f44b1ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:46.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.334+0000 7f44b1ffb640 1 -- 10.20.193.48:0/1914155814 <== mon.1 v2:10.20.193.111:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f44b40138d0 con 0x7f44c40951a0 2026-02-12T18:14:46.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.334+0000 7f44b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:46.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.334+0000 7f44b1ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:14:46.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.334+0000 7f44b37fe640 4 set_mon_vals no callback set 2026-02-12T18:14:46.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.334+0000 7f44b1ffb640 10 monclient: dump: 2026-02-12T18:14:46.354 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:46.354 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:46.354 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.354 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.354 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:46.354 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.354 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:46.354 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:46.354 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:46.354 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:46.354 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:46.354 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:46.354 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:46.355 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:46.355 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:46.355 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.334+0000 7f44cb90c640 10 monclient: _renew_subs 2026-02-12T18:14:46.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.334+0000 7f44cb90c640 10 monclient: _send_mon_message to mon.f at v2:10.20.193.111:3300/0 2026-02-12T18:14:46.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.334+0000 7f44cb90c640 1 -- 10.20.193.48:0/1914155814 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44c408d630 con 0x7f44c40951a0 2026-02-12T18:14:46.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.335+0000 7f44cb90c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:46.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.335+0000 7f44cb90c640 1 --2- 10.20.193.48:0/1914155814 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f44c4195fe0 0x7f44c41ae8e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.335+0000 7f44cb90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.335+0000 7f44cb90c640 1 -- 10.20.193.48:0/1914155814 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f44c405f140 con 0x7f44c4195fe0 2026-02-12T18:14:46.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.335+0000 7f44c9681640 1 --2- 10.20.193.48:0/1914155814 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f44c40951a0 0x7f44c41db070 secure :-1 s=READY pgs=149 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44b400e810 tx=0x7f44b400ece0 comp rx=0 tx=0).queue_received will delay after 1.77092e+09 on 0x7f44b4052360 osd_map(312..312 src has 215..312) 2026-02-12T18:14:46.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.335+0000 7f44b1ffb640 1 -- 10.20.193.48:0/1914155814 <== mon.1 v2:10.20.193.111:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f44b4022020 con 0x7f44c40951a0 2026-02-12T18:14:46.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.335+0000 7f44c8e80640 1 --2- 10.20.193.48:0/1914155814 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f44c4195fe0 0x7f44c41ae8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.335+0000 7f44c8e80640 10 monclient: get_auth_request con 0x7f44c4195fe0 auth_method 0 2026-02-12T18:14:46.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.335+0000 7f44c8e80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.335+0000 7f44c8e80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.355 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.335+0000 7f44c8e80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.335+0000 7f44c8e80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:46.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.335+0000 7f44c8e80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:46.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.335+0000 7f44c8e80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:46.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.335+0000 7f44b1ffb640 1 --2- 10.20.193.48:0/1914155814 >> v2:10.20.193.111:6812/977811348 conn(0x7f449403f7f0 0x7f449405fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.335+0000 7f44c8e80640 10 monclient(hunting): handle_auth_done global_id 36407 payload 824 2026-02-12T18:14:46.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.335+0000 7f44c8e80640 1 -- 10.20.193.48:0/1914155814 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f44c4095f20 con 0x7f44c4195fe0 2026-02-12T18:14:46.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.335+0000 7f44c9e82640 1 --2- 10.20.193.48:0/1914155814 >> v2:10.20.193.111:6812/977811348 conn(0x7f449403f7f0 0x7f449405fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.335+0000 7f44c9e82640 10 monclient: get_auth_request con 0x7f449403f7f0 auth_method 0 2026-02-12T18:14:46.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.337+0000 7f44c8e80640 1 -- 10.20.193.48:0/1914155814 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f44c4195fe0 msgr2=0x7f44c41ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:46.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.337+0000 7f44c8e80640 1 --2- 10.20.193.48:0/1914155814 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f44c4195fe0 0x7f44c41ae8e0 secure :-1 s=READY pgs=385 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44c40983a0 tx=0x7f44b8004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:46.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.338+0000 7f44b1ffb640 1 -- 10.20.193.48:0/1914155814 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f44b80044e0 con 0x7f44c4195fe0 2026-02-12T18:14:46.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.338+0000 7f44b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:46.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.338+0000 7f44b1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:14:46.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.338+0000 7f44b1ffb640 10 monclient: dump: 2026-02-12T18:14:46.356 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:46.356 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:46.357 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.357 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.357 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:46.357 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.357 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:46.357 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:46.357 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:46.357 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:46.357 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:46.357 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:46.357 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:46.357 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:46.357 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:46.357 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.338+0000 7f44c9e82640 1 --2- 10.20.193.48:0/1914155814 >> v2:10.20.193.111:6812/977811348 conn(0x7f449403f7f0 0x7f449405fca0 secure :-1 s=READY pgs=437 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44c41dc0c0 tx=0x7f44c0009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:46.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.338+0000 7f44b1ffb640 1 -- 10.20.193.48:0/1914155814 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f44b8035d20 con 0x7f44c4195fe0 2026-02-12T18:14:46.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.338+0000 7f44b1ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:46.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.338+0000 7f44b1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:14:46.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.338+0000 7f44b1ffb640 1 -- 10.20.193.48:0/1914155814 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f44c4195fe0 msgr2=0x7f44c41ae8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:46.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.338+0000 7f44b1ffb640 1 --2- 10.20.193.48:0/1914155814 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f44c4195fe0 0x7f44c41ae8e0 secure :-1 s=READY pgs=385 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44c40983a0 tx=0x7f44b8004770 comp rx=0 tx=0).stop 2026-02-12T18:14:46.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.338+0000 7f44b1ffb640 1 -- 10.20.193.48:0/1914155814 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f44c4195fe0 msgr2=0x7f44c41ae8e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:46.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.338+0000 7f44b1ffb640 1 --2- 10.20.193.48:0/1914155814 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f44c4195fe0 0x7f44c41ae8e0 secure :-1 s=CLOSED pgs=385 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44c40983a0 tx=0x7f44b8004770 comp rx=0 tx=0).stop 2026-02-12T18:14:46.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.341+0000 7f44cb90c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:14:46.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.341+0000 7f44cb90c640 1 --2- 10.20.193.48:0/1914155814 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f44c41963b0 0x7f44c41aee20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.341+0000 7f44cb90c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.341+0000 7f44cb90c640 1 -- 10.20.193.48:0/1914155814 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f44c405fd90 con 0x7f44c41963b0 2026-02-12T18:14:46.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.341+0000 7f44c8e80640 1 --2- 10.20.193.48:0/1914155814 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f44c41963b0 0x7f44c41aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.341+0000 7f44c8e80640 10 monclient: get_auth_request con 0x7f44c41963b0 auth_method 0 2026-02-12T18:14:46.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.341+0000 7f44c8e80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.341+0000 7f44c8e80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.341+0000 7f44c8e80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.341+0000 7f44c8e80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:46.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.341+0000 7f44c8e80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:46.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.341+0000 7f44c8e80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:46.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.342+0000 7f44c8e80640 10 monclient(hunting): handle_auth_done global_id 36416 payload 824 2026-02-12T18:14:46.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.342+0000 7f44c8e80640 1 -- 10.20.193.48:0/1914155814 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f44c405dc10 con 0x7f44c41963b0 2026-02-12T18:14:46.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.344+0000 7f44c8e80640 1 -- 10.20.193.48:0/1914155814 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f44c41963b0 msgr2=0x7f44c41aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:46.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.344+0000 7f44c8e80640 1 --2- 10.20.193.48:0/1914155814 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f44c41963b0 0x7f44c41aee20 secure :-1 s=READY pgs=386 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44b802ffa0 tx=0x7f44b8009210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:46.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.344+0000 7f44b1ffb640 1 -- 10.20.193.48:0/1914155814 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f44b8037b10 con 0x7f44c41963b0 2026-02-12T18:14:46.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.344+0000 7f44b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:46.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.344+0000 7f44b1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:14:46.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.344+0000 7f44b1ffb640 10 monclient: dump: 2026-02-12T18:14:46.359 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:46.359 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:46.359 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.359 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.359 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:46.359 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.359 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:46.359 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:46.359 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:46.359 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:46.359 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:46.359 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:46.359 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:46.360 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:46.360 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:46.360 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.344+0000 7f44b1ffb640 1 -- 10.20.193.48:0/1914155814 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10182 (secure 0 0 0) 0x7f44b8050070 con 0x7f44c41963b0 2026-02-12T18:14:46.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.344+0000 7f44b1ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:14:46.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.344+0000 7f44b1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:14:46.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.344+0000 7f44b1ffb640 1 -- 10.20.193.48:0/1914155814 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f44c41963b0 msgr2=0x7f44c41aee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:46.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.344+0000 7f44b1ffb640 1 --2- 10.20.193.48:0/1914155814 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f44c41963b0 0x7f44c41aee20 secure :-1 s=READY pgs=386 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44b802ffa0 tx=0x7f44b8009210 comp rx=0 tx=0).stop 2026-02-12T18:14:46.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.344+0000 7f44b1ffb640 1 -- 10.20.193.48:0/1914155814 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f44c41963b0 msgr2=0x7f44c41aee20 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:46.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.344+0000 7f44b1ffb640 1 --2- 10.20.193.48:0/1914155814 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f44c41963b0 0x7f44c41aee20 secure :-1 s=CLOSED pgs=386 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44b802ffa0 tx=0x7f44b8009210 comp rx=0 tx=0).stop 2026-02-12T18:14:46.360 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:14:46.360 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:14:46.360 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:14:46.361 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:14:46.361 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 76, 2026-02-12T18:14:46.361 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 541178, 2026-02-12T18:14:46.361 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:14:46.361 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:14:46.361 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:14:46.361 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:14:46.361 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:14:46.361 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:14:46.361 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:14:46.361 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:14:46.361 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:14:46.361 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:14:46.361 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:46.361 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:14:46.361 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:46.361 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:14:46.361 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:14:46.362 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:46.362 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:46.362 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:46.362 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:46.362 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:46.362 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:46.362 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:46.362 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:46.362 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:46.362 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:46.362 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:46.362 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:46.362 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:46.362 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:46.362 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:14:46.362 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:14:46.362 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:46.362 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:46.362 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:46.362 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:46.363 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:46.363 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:46.363 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:46.363 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:46.363 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:46.363 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:46.363 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:46.363 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:46.363 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:46.363 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.363 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.363 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:14:46.363 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:14:46.363 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:14:46.363 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:14:46.363 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:14:46.363 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:14:46.363 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:46.363 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:46.363 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:14:46.364 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:14:46.364 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:14:46.364 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:14:46.364 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:14:46.364 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:14:46.364 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:14:46.364 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:46.364 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:14:46.364 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:46.364 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:46.364 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:46.364 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:46.364 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:46.364 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:46.364 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:46.364 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:46.364 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:46.364 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:46.364 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:46.364 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:46.365 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:46.365 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:46.365 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:14:46.365 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.365 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:14:46.365 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.365 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:14:46.365 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:14:46.365 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.365 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.365 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.365 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.365 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:14:46.365 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.365 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.365 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.365 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.365 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:14:46.365 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.365 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.365 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.365 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.366 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:14:46.366 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:14:46.366 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.366 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.366 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:14:46.366 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.366 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.366 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.366 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:14:46.366 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:14:46.366 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.366 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.366 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.366 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.366 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:14:46.366 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.366 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.366 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.366 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.366 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:14:46.367 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.367 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.367 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.367 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.367 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:14:46.367 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:14:46.367 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.367 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.367 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:14:46.367 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.367 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.367 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.367 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:14:46.367 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:14:46.367 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.367 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.367 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.367 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.367 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:14:46.367 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.367 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.367 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.368 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.368 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:14:46.368 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.368 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.368 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.368 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.368 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:14:46.368 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:14:46.368 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.368 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.368 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:14:46.368 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.368 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.368 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.368 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:14:46.368 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:14:46.368 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.368 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.368 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.368 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.368 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:14:46.368 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.369 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.369 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.369 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.369 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:14:46.369 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.369 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.369 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.369 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.369 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:14:46.369 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:14:46.369 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.369 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.369 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:14:46.369 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.369 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.369 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.369 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:14:46.369 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:14:46.369 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.369 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.369 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.369 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.369 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:14:46.369 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.369 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.369 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.370 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.370 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:14:46.370 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.370 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.370 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.370 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.370 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:14:46.370 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:14:46.370 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.370 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.370 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:46.370 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.370 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.370 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.370 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:14:46.370 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:14:46.370 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.370 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.370 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.370 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.370 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:14:46.370 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.370 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.370 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.370 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.371 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:14:46.371 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.371 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.371 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.371 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.371 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:14:46.371 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:14:46.371 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.371 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.371 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:14:46.371 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.371 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.371 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.371 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:14:46.371 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:14:46.371 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.371 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.371 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.371 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.371 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:14:46.371 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.371 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.371 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.371 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.371 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:14:46.372 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.372 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.372 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.372 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.372 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:14:46.372 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:14:46.372 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.372 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.372 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:46.372 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.372 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.372 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.372 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:14:46.372 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:14:46.372 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.372 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.372 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.372 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.372 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:14:46.372 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.372 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.372 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.372 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.372 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:14:46.373 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.373 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.373 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.373 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.373 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:14:46.373 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:14:46.373 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.373 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.373 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:14:46.373 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.373 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.373 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.373 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:14:46.373 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:14:46.373 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.373 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.373 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.373 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.373 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:14:46.373 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.373 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.373 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.373 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.373 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:14:46.373 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.373 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:46.374 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:14:46.375 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.375 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:46.375 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:46.375 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:14:46.375 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.375 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.375 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.375 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:14:46.375 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:14:46.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.344+0000 7f44cb90c640 1 -- 10.20.193.48:0/1914155814 >> v2:10.20.193.111:6812/977811348 conn(0x7f449403f7f0 msgr2=0x7f449405fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:46.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.344+0000 7f44cb90c640 1 --2- 10.20.193.48:0/1914155814 >> v2:10.20.193.111:6812/977811348 conn(0x7f449403f7f0 0x7f449405fca0 secure :-1 s=READY pgs=437 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44c41dc0c0 tx=0x7f44c0009040 comp rx=0 tx=0).stop 2026-02-12T18:14:46.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.345+0000 7f44cb90c640 10 monclient: shutdown 2026-02-12T18:14:46.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.345+0000 7f44cb90c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:46.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.345+0000 7f44cb90c640 1 -- 10.20.193.48:0/1914155814 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f44c40951a0 msgr2=0x7f44c41db070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:46.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.345+0000 7f44cb90c640 1 --2- 10.20.193.48:0/1914155814 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f44c40951a0 0x7f44c41db070 secure :-1 s=READY pgs=149 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f44b400e810 tx=0x7f44b400ece0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.345+0000 7f44c9e82640 1 -- 10.20.193.48:0/1914155814 reap_dead start 2026-02-12T18:14:46.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.345+0000 7f44b1ffb640 1 -- 10.20.193.48:0/1914155814 <== mon.1 v2:10.20.193.111:3300/0 5 ==== osd_map(312..312 src has 215..312) ==== 3503+0+0 (unknown 0 0 0) 0x7f44b4052360 con 0x7f44c40951a0 2026-02-12T18:14:46.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.345+0000 7f44c9e82640 1 -- 10.20.193.48:0/1914155814 reap_dead start 2026-02-12T18:14:46.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.345+0000 7f44cb90c640 1 -- 10.20.193.48:0/1914155814 shutdown_connections 2026-02-12T18:14:46.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.345+0000 7f44cb90c640 1 -- 10.20.193.48:0/1914155814 >> 10.20.193.48:0/1914155814 conn(0x7f44c40548c0 msgr2=0x7f44c408d840 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:46.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.345+0000 7f44cb90c640 1 -- 10.20.193.48:0/1914155814 shutdown_connections 2026-02-12T18:14:46.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.345+0000 7f44cb90c640 1 -- 10.20.193.48:0/1914155814 wait complete. 2026-02-12T18:14:46.376 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:14:46.377 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2026-02-12T18:14:46.377 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T18:14:46.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.441+0000 7f6e478cc640 10 monclient: get_monmap_and_config 2026-02-12T18:14:46.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.441+0000 7f6e478cc640 10 monclient: build_initial_monmap 2026-02-12T18:14:46.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.441+0000 7f6e478cc640 10 monclient: monmap: 2026-02-12T18:14:46.443 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:46.443 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:46.443 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:14:46.443016+0000 2026-02-12T18:14:46.443 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:14:46.443016+0000 2026-02-12T18:14:46.443 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:46.444 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.444 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:14:46.444 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:14:46.444 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:46.444 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:46.444 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:46.444 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:46.444 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:46.444 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:46.444 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:46.444 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:14:46.444 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:14:46.444 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.446 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e478cc640 1 Processor -- start 2026-02-12T18:14:46.446 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e478cc640 1 -- start start 2026-02-12T18:14:46.446 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e478cc640 10 monclient: init 2026-02-12T18:14:46.446 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e478cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:46.446 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e478cc640 10 monclient: _add_conns ranks=[6,8,0,4,1,2,10,9,5,7,3] 2026-02-12T18:14:46.446 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e478cc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6e4005c950 0x7f6e4005cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e478cc640 10 monclient(hunting): picked mon.noname-d con 0x7f6e4005c950 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:14:46.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e478cc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6e4005e490 0x7f6e4005d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e478cc640 10 monclient(hunting): picked mon.noname-e con 0x7f6e4005e490 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:14:46.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e478cc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6e4013db70 addr v1:10.20.193.48:6789/0 2026-02-12T18:14:46.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e478cc640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e4004dc20 con 0x7f6e4013db70 2026-02-12T18:14:46.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e478cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e478cc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f6e4005ddd0 con 0x7f6e4005c950 2026-02-12T18:14:46.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e478cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e478cc640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f6e4005d7a0 con 0x7f6e4005e490 2026-02-12T18:14:46.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e478cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:46.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e478cc640 10 monclient(hunting): authenticate will time out at 1125.168717s 2026-02-12T18:14:46.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e45641640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6e4005c950 0x7f6e4005cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e45641640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6e4005c950 0x7f6e4005cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:35810/0 (socket says 10.20.193.48:35810) 2026-02-12T18:14:46.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e45641640 1 -- 10.20.193.48:0/3318288965 learned_addr learned my addr 10.20.193.48:0/3318288965 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:46.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e45641640 10 monclient(hunting): get_auth_request con 0x7f6e4005c950 auth_method 0 2026-02-12T18:14:46.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e44e40640 1 --2- 10.20.193.48:0/3318288965 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6e4005e490 0x7f6e4005d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e45641640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e45641640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e45641640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e44e40640 10 monclient(hunting): get_auth_request con 0x7f6e4005e490 auth_method 0 2026-02-12T18:14:46.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e44e40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e44e40640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e44e40640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e45641640 1 -- 10.20.193.48:0/3318288965 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6e4005c950 msgr2=0x7f6e4005cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:14:46.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e45641640 1 -- 10.20.193.48:0/3318288965 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6e4005c950 msgr2=0x7f6e4005cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:14:46.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e44e40640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:46.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e44e40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:46.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e45641640 1 --2- 10.20.193.48:0/3318288965 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6e4005c950 0x7f6e4005cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:46.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e44e40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:46.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.442+0000 7f6e45641640 1 --2- 10.20.193.48:0/3318288965 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6e4005c950 0x7f6e4005cd20 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:14:46.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.443+0000 7f6e44e40640 10 monclient(hunting): handle_auth_done global_id 94724 payload 274 2026-02-12T18:14:46.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.443+0000 7f6e44e40640 1 -- 10.20.193.48:0/3318288965 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6e4005c950 msgr2=0x7f6e4005cd20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:14:46.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.443+0000 7f6e44e40640 1 --2- 10.20.193.48:0/3318288965 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6e4005c950 0x7f6e4005cd20 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.443+0000 7f6e44e40640 1 -- 10.20.193.48:0/3318288965 >> v1:10.20.193.48:6789/0 conn(0x7f6e4013db70 legacy=0x7f6e4013dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:46.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.443+0000 7f6e44e40640 10 monclient: _finish_hunting 0 2026-02-12T18:14:46.449 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.443+0000 7f6e44e40640 1 monclient: found mon.noname-e 2026-02-12T18:14:46.449 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.443+0000 7f6e44e40640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:46.449 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.443+0000 7f6e44e40640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:14:46.449 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.443+0000 7f6e44e40640 1 -- 10.20.193.48:0/3318288965 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e40092990 con 0x7f6e4005e490 2026-02-12T18:14:46.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.445+0000 7f6e44e40640 1 -- 10.20.193.48:0/3318288965 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6e4005e490 msgr2=0x7f6e4005d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:46.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.445+0000 7f6e44e40640 1 --2- 10.20.193.48:0/3318288965 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6e4005e490 0x7f6e4005d260 secure :-1 s=READY pgs=121 gs=3 cs=0 l=1 c_cookie=11472673013786784821 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e34009800 tx=0x7f6e3402ed50 comp rx=0 tx=0).ready entity=mon.8 client_cookie=9f371f523af8b435 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:46.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.445+0000 7f6e2ffff640 1 -- 10.20.193.48:0/3318288965 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6e3402fe90 con 0x7f6e4005e490 2026-02-12T18:14:46.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.445+0000 7f6e2ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:46.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.445+0000 7f6e2ffff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:14:46.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.445+0000 7f6e2ffff640 10 monclient: dump: 2026-02-12T18:14:46.454 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:46.454 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:46.454 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.454 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.454 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:46.455 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.455 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:46.455 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:46.455 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:46.455 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:46.455 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:46.455 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:46.455 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:46.455 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:46.455 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:46.455 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.445+0000 7f6e2ffff640 10 monclient: _finish_auth 0 2026-02-12T18:14:46.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.445+0000 7f6e2ffff640 10 monclient: _check_auth_tickets 2026-02-12T18:14:46.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.445+0000 7f6e2ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:46.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.445+0000 7f6e2ffff640 1 -- 10.20.193.48:0/3318288965 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e34035340 con 0x7f6e4005e490 2026-02-12T18:14:46.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.445+0000 7f6e478cc640 5 monclient: authenticate success, global_id 94724 2026-02-12T18:14:46.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.445+0000 7f6e478cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:14:46.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.445+0000 7f6e2ffff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:46.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.445+0000 7f6e2ffff640 1 -- 10.20.193.48:0/3318288965 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6e34035970 con 0x7f6e4005e490 2026-02-12T18:14:46.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.445+0000 7f6e2ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:46.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.445+0000 7f6e2ffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:14:46.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.445+0000 7f6e2ffff640 10 monclient: dump: 2026-02-12T18:14:46.456 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:46.456 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:46.456 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.456 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.456 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:46.456 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.456 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:46.456 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:46.456 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:46.456 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:46.456 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:46.456 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:46.456 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:46.456 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:46.456 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:46.456 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.445+0000 7f6e478cc640 10 monclient: get_monmap_and_config success 2026-02-12T18:14:46.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.445+0000 7f6e478cc640 4 set_mon_vals no callback set 2026-02-12T18:14:46.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.446+0000 7f6e478cc640 10 monclient: shutdown 2026-02-12T18:14:46.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.446+0000 7f6e478cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:46.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.446+0000 7f6e478cc640 1 -- 10.20.193.48:0/3318288965 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6e4005e490 msgr2=0x7f6e4005d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:46.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.446+0000 7f6e478cc640 1 --2- 10.20.193.48:0/3318288965 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6e4005e490 0x7f6e4005d260 secure :-1 s=READY pgs=121 gs=3 cs=0 l=1 c_cookie=11472673013786784821 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e34009800 tx=0x7f6e3402ed50 comp rx=0 tx=0).stop 2026-02-12T18:14:46.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.446+0000 7f6e478cc640 1 -- 10.20.193.48:0/3318288965 shutdown_connections 2026-02-12T18:14:46.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.446+0000 7f6e478cc640 1 --2- 10.20.193.48:0/3318288965 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6e4005e490 0x7f6e4005d260 unknown :-1 s=CLOSED pgs=121 gs=3 cs=0 l=1 c_cookie=11472673013786784821 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.446+0000 7f6e478cc640 1 --2- 10.20.193.48:0/3318288965 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6e4005c950 0x7f6e4005cd20 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.446+0000 7f6e478cc640 1 -- 10.20.193.48:0/3318288965 >> 10.20.193.48:0/3318288965 conn(0x7f6e400548a0 msgr2=0x7f6e40097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:46.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.446+0000 7f6e478cc640 1 -- 10.20.193.48:0/3318288965 shutdown_connections 2026-02-12T18:14:46.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.446+0000 7f6e478cc640 1 -- 10.20.193.48:0/3318288965 wait complete. 2026-02-12T18:14:46.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.446+0000 7f6e478cc640 10 monclient: build_initial_monmap 2026-02-12T18:14:46.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.446+0000 7f6e478cc640 10 monclient: monmap: 2026-02-12T18:14:46.457 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:46.457 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:14:46.457 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:14:46.457 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:14:46.458 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:46.458 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.458 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:14:46.458 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:14:46.458 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:46.458 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:46.458 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:46.458 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:46.458 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:46.458 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:46.458 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:46.458 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.446+0000 7f6e478cc640 1 Processor -- start 2026-02-12T18:14:46.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.446+0000 7f6e478cc640 1 -- start start 2026-02-12T18:14:46.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.446+0000 7f6e478cc640 10 monclient: init 2026-02-12T18:14:46.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e478cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:46.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e478cc640 10 monclient: _add_conns ranks=[5,6,1,0,2,8,4,7,3] 2026-02-12T18:14:46.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e478cc640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6e4005c950 0x7f6e4013cc90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e478cc640 10 monclient(hunting): picked mon.noname-h con 0x7f6e4005c950 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:14:46.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e478cc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6e4005e490 0x7f6e4013d1d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e478cc640 10 monclient(hunting): picked mon.noname-d con 0x7f6e4005e490 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:14:46.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e478cc640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f6e4013db70 0x7f6e4008ebe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e478cc640 10 monclient(hunting): picked mon.noname-f con 0x7f6e4013db70 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:14:46.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e478cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e478cc640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6e4008a5c0 con 0x7f6e4013db70 2026-02-12T18:14:46.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e478cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e478cc640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f6e40143e20 con 0x7f6e4005c950 2026-02-12T18:14:46.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e478cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e478cc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f6e40142310 con 0x7f6e4005e490 2026-02-12T18:14:46.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e478cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:46.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e478cc640 10 monclient(hunting): authenticate will time out at 1125.173111s 2026-02-12T18:14:46.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e44e40640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6e4005e490 0x7f6e4013d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e44e40640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6e4005e490 0x7f6e4013d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:35824/0 (socket says 10.20.193.48:35824) 2026-02-12T18:14:46.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e44e40640 1 -- 10.20.193.48:0/2723508284 learned_addr learned my addr 10.20.193.48:0/2723508284 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:46.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e44e40640 10 monclient(hunting): get_auth_request con 0x7f6e4005e490 auth_method 0 2026-02-12T18:14:46.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e44e40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e44e40640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e44e40640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e44e40640 1 -- 10.20.193.48:0/2723508284 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6e4005e490 msgr2=0x7f6e4013d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-12T18:14:46.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e44e40640 1 -- 10.20.193.48:0/2723508284 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6e4005e490 msgr2=0x7f6e4013d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:14:46.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e44e40640 1 --2- 10.20.193.48:0/2723508284 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6e4005e490 0x7f6e4013d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:46.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45641640 1 --2- 10.20.193.48:0/2723508284 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6e4005c950 0x7f6e4013cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e44e40640 1 --2- 10.20.193.48:0/2723508284 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6e4005e490 0x7f6e4013d1d0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:14:46.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45641640 10 monclient(hunting): get_auth_request con 0x7f6e4005c950 auth_method 0 2026-02-12T18:14:46.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45641640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45641640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45641640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45e42640 1 --2- 10.20.193.48:0/2723508284 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f6e4013db70 0x7f6e4008ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45e42640 10 monclient(hunting): get_auth_request con 0x7f6e4013db70 auth_method 0 2026-02-12T18:14:46.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45e42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45e42640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45e42640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45641640 1 -- 10.20.193.48:0/2723508284 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6e4005c950 msgr2=0x7f6e4013cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-12T18:14:46.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45641640 1 -- 10.20.193.48:0/2723508284 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6e4005c950 msgr2=0x7f6e4013cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:14:46.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45641640 1 --2- 10.20.193.48:0/2723508284 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6e4005c950 0x7f6e4013cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:46.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45641640 1 --2- 10.20.193.48:0/2723508284 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6e4005c950 0x7f6e4013cc90 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:14:46.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45e42640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:46.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45e42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:46.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45e42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:46.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45e42640 10 monclient(hunting): handle_auth_done global_id 94798 payload 824 2026-02-12T18:14:46.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45e42640 1 -- 10.20.193.48:0/2723508284 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6e4005e490 msgr2=0x7f6e4013d1d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:14:46.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45e42640 1 --2- 10.20.193.48:0/2723508284 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6e4005e490 0x7f6e4013d1d0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45e42640 1 -- 10.20.193.48:0/2723508284 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6e4005c950 msgr2=0x7f6e4013cc90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:14:46.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45e42640 1 --2- 10.20.193.48:0/2723508284 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6e4005c950 0x7f6e4013cc90 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45e42640 10 monclient: _finish_hunting 0 2026-02-12T18:14:46.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45e42640 1 monclient: found mon.noname-f 2026-02-12T18:14:46.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45e42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:46.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45e42640 10 monclient: _send_mon_message to mon.noname-f at v2:10.20.193.111:3300/0 2026-02-12T18:14:46.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.447+0000 7f6e45e42640 1 -- 10.20.193.48:0/2723508284 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e34009420 con 0x7f6e4013db70 2026-02-12T18:14:46.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.449+0000 7f6e45e42640 1 -- 10.20.193.48:0/2723508284 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f6e4013db70 msgr2=0x7f6e4008ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:46.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.449+0000 7f6e45e42640 1 --2- 10.20.193.48:0/2723508284 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f6e4013db70 0x7f6e4008ebe0 secure :-1 s=READY pgs=150 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e3c00d430 tx=0x7f6e3c00d900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:46.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e2dffb640 1 -- 10.20.193.48:0/2723508284 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6e3c007e30 con 0x7f6e4013db70 2026-02-12T18:14:46.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e2dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:46.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e2dffb640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2026-02-12T18:14:46.462 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e2dffb640 10 monclient: dump: 2026-02-12T18:14:46.462 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:46.462 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:46.462 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.462 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.462 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:46.462 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.462 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:46.462 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:46.462 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:46.462 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:46.462 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:46.462 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:46.462 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:46.462 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:46.462 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:46.463 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e2dffb640 10 monclient: _finish_auth 0 2026-02-12T18:14:46.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e2dffb640 10 monclient: _check_auth_tickets 2026-02-12T18:14:46.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e2dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:46.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e2dffb640 1 -- 10.20.193.48:0/2723508284 <== mon.1 v2:10.20.193.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e3c013840 con 0x7f6e4013db70 2026-02-12T18:14:46.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e2dffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:46.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e2dffb640 1 -- 10.20.193.48:0/2723508284 <== mon.1 v2:10.20.193.111:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6e3c013e70 con 0x7f6e4013db70 2026-02-12T18:14:46.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e478cc640 5 monclient: authenticate success, global_id 94798 2026-02-12T18:14:46.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e478cc640 10 monclient: _renew_subs 2026-02-12T18:14:46.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e478cc640 10 monclient: _send_mon_message to mon.f at v2:10.20.193.111:3300/0 2026-02-12T18:14:46.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e2f7fe640 4 set_mon_vals no callback set 2026-02-12T18:14:46.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e478cc640 1 -- 10.20.193.48:0/2723508284 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e40090570 con 0x7f6e4013db70 2026-02-12T18:14:46.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e2dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:46.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e2dffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:14:46.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e2dffb640 10 monclient: dump: 2026-02-12T18:14:46.463 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:46.463 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:46.463 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.464 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.464 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:46.464 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.464 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:46.464 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:46.464 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:46.464 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:46.464 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:46.464 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:46.464 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:46.464 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:46.464 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:46.464 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e478cc640 10 monclient: _renew_subs 2026-02-12T18:14:46.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e478cc640 10 monclient: _send_mon_message to mon.f at v2:10.20.193.111:3300/0 2026-02-12T18:14:46.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e478cc640 1 -- 10.20.193.48:0/2723508284 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e4013d710 con 0x7f6e4013db70 2026-02-12T18:14:46.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e478cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:46.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e478cc640 1 --2- 10.20.193.48:0/2723508284 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6e400910d0 0x7f6e4008f120 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e478cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e478cc640 1 -- 10.20.193.48:0/2723508284 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f6e40055e20 con 0x7f6e400910d0 2026-02-12T18:14:46.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e45641640 1 --2- 10.20.193.48:0/2723508284 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6e400910d0 0x7f6e4008f120 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e45641640 10 monclient: get_auth_request con 0x7f6e400910d0 auth_method 0 2026-02-12T18:14:46.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e45641640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e45641640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e45641640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e45641640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:46.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e45641640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:46.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.450+0000 7f6e45641640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:46.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.451+0000 7f6e2dffb640 1 -- 10.20.193.48:0/2723508284 <== mon.1 v2:10.20.193.111:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f6e3c01a070 con 0x7f6e4013db70 2026-02-12T18:14:46.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.451+0000 7f6e45641640 10 monclient(hunting): handle_auth_done global_id 65038 payload 824 2026-02-12T18:14:46.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.451+0000 7f6e45641640 1 -- 10.20.193.48:0/2723508284 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6e40097de0 con 0x7f6e400910d0 2026-02-12T18:14:46.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.451+0000 7f6e2dffb640 1 --2- 10.20.193.48:0/2723508284 >> v2:10.20.193.111:6812/977811348 conn(0x7f6e1003f730 0x7f6e1005fbe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.451+0000 7f6e2dffb640 1 -- 10.20.193.48:0/2723508284 <== mon.1 v2:10.20.193.111:3300/0 5 ==== osd_map(312..312 src has 215..312) ==== 3503+0+0 (secure 0 0 0) 0x7f6e3c053b20 con 0x7f6e4013db70 2026-02-12T18:14:46.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.451+0000 7f6e44e40640 1 --2- 10.20.193.48:0/2723508284 >> v2:10.20.193.111:6812/977811348 conn(0x7f6e1003f730 0x7f6e1005fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.451+0000 7f6e44e40640 10 monclient: get_auth_request con 0x7f6e1003f730 auth_method 0 2026-02-12T18:14:46.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.453+0000 7f6e45641640 1 -- 10.20.193.48:0/2723508284 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6e400910d0 msgr2=0x7f6e4008f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:46.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.453+0000 7f6e45641640 1 --2- 10.20.193.48:0/2723508284 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6e400910d0 0x7f6e4008f120 secure :-1 s=READY pgs=200 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e30004740 tx=0x7f6e30010c30 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:46.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.453+0000 7f6e2dffb640 1 -- 10.20.193.48:0/2723508284 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6e30004030 con 0x7f6e400910d0 2026-02-12T18:14:46.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.453+0000 7f6e2dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:46.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.453+0000 7f6e2dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:14:46.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.453+0000 7f6e2dffb640 10 monclient: dump: 2026-02-12T18:14:46.468 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:46.468 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:46.468 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.468 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.468 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:46.468 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.468 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:46.468 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:46.468 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:46.468 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:46.468 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:46.468 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:46.468 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:46.468 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:46.469 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:46.469 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.453+0000 7f6e2dffb640 1 -- 10.20.193.48:0/2723508284 <== mon.4 v2:10.20.193.48:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f6e3000c050 con 0x7f6e400910d0 2026-02-12T18:14:46.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.453+0000 7f6e2dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:46.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.453+0000 7f6e2dffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:14:46.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.453+0000 7f6e2dffb640 1 -- 10.20.193.48:0/2723508284 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6e400910d0 msgr2=0x7f6e4008f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:46.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.453+0000 7f6e2dffb640 1 --2- 10.20.193.48:0/2723508284 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6e400910d0 0x7f6e4008f120 secure :-1 s=READY pgs=200 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e30004740 tx=0x7f6e30010c30 comp rx=0 tx=0).stop 2026-02-12T18:14:46.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.453+0000 7f6e2dffb640 1 -- 10.20.193.48:0/2723508284 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6e400910d0 msgr2=0x7f6e4008f120 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:46.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.453+0000 7f6e2dffb640 1 --2- 10.20.193.48:0/2723508284 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6e400910d0 0x7f6e4008f120 secure :-1 s=CLOSED pgs=200 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e30004740 tx=0x7f6e30010c30 comp rx=0 tx=0).stop 2026-02-12T18:14:46.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.453+0000 7f6e44e40640 1 --2- 10.20.193.48:0/2723508284 >> v2:10.20.193.111:6812/977811348 conn(0x7f6e1003f730 0x7f6e1005fbe0 secure :-1 s=READY pgs=438 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e4013ec50 tx=0x7f6e34039040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:46.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.456+0000 7f6e478cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:14:46.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.456+0000 7f6e478cc640 1 --2- 10.20.193.48:0/2723508284 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6e4008f660 0x7f6e4012c860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.456+0000 7f6e478cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.456+0000 7f6e478cc640 1 -- 10.20.193.48:0/2723508284 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f6e4005f140 con 0x7f6e4008f660 2026-02-12T18:14:46.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.456+0000 7f6e45641640 1 --2- 10.20.193.48:0/2723508284 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6e4008f660 0x7f6e4012c860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.456+0000 7f6e45641640 10 monclient: get_auth_request con 0x7f6e4008f660 auth_method 0 2026-02-12T18:14:46.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.456+0000 7f6e45641640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.456+0000 7f6e45641640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.456+0000 7f6e45641640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.457+0000 7f6e45641640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:46.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.457+0000 7f6e45641640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:46.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.457+0000 7f6e45641640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:46.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.457+0000 7f6e45641640 10 monclient(hunting): handle_auth_done global_id 65047 payload 824 2026-02-12T18:14:46.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.457+0000 7f6e45641640 1 -- 10.20.193.48:0/2723508284 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6e4008fa60 con 0x7f6e4008f660 2026-02-12T18:14:46.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.459+0000 7f6e45641640 1 -- 10.20.193.48:0/2723508284 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6e4008f660 msgr2=0x7f6e4012c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:46.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.459+0000 7f6e45641640 1 --2- 10.20.193.48:0/2723508284 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6e4008f660 0x7f6e4012c860 secure :-1 s=READY pgs=201 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e30004000 tx=0x7f6e30004770 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:46.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.459+0000 7f6e2dffb640 1 -- 10.20.193.48:0/2723508284 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6e30020860 con 0x7f6e4008f660 2026-02-12T18:14:46.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.459+0000 7f6e2dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:46.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.459+0000 7f6e2dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:14:46.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.459+0000 7f6e2dffb640 10 monclient: dump: 2026-02-12T18:14:46.470 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:46.470 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:46.470 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.470 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.470 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:46.470 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.470 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:46.471 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:46.471 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:46.471 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:46.471 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:46.471 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:46.471 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:46.471 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:46.471 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:46.471 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.459+0000 7f6e2dffb640 1 -- 10.20.193.48:0/2723508284 <== mon.4 v2:10.20.193.48:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10015 (secure 0 0 0) 0x7f6e300036d0 con 0x7f6e4008f660 2026-02-12T18:14:46.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.459+0000 7f6e2dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:14:46.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.459+0000 7f6e2dffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:14:46.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.459+0000 7f6e2dffb640 1 -- 10.20.193.48:0/2723508284 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6e4008f660 msgr2=0x7f6e4012c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:46.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.459+0000 7f6e2dffb640 1 --2- 10.20.193.48:0/2723508284 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6e4008f660 0x7f6e4012c860 secure :-1 s=READY pgs=201 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e30004000 tx=0x7f6e30004770 comp rx=0 tx=0).stop 2026-02-12T18:14:46.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.459+0000 7f6e2dffb640 1 -- 10.20.193.48:0/2723508284 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6e4008f660 msgr2=0x7f6e4012c860 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:46.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.459+0000 7f6e2dffb640 1 --2- 10.20.193.48:0/2723508284 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6e4008f660 0x7f6e4012c860 unknown :-1 s=CLOSED pgs=201 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.472 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:14:46.472 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:14:46.472 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:14:46.472 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:14:46.472 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 76, 2026-02-12T18:14:46.472 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 267246, 2026-02-12T18:14:46.472 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:14:46.472 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:14:46.472 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:14:46.472 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:14:46.472 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:14:46.472 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:14:46.472 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:14:46.472 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:14:46.473 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:14:46.473 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:14:46.473 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:46.473 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:14:46.473 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:46.473 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:14:46.473 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:14:46.473 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:46.473 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:46.473 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:46.473 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:46.473 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:46.473 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:46.473 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:46.473 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:46.473 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:46.473 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:46.473 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:46.473 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:46.473 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:46.474 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:46.474 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:14:46.474 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:14:46.474 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:46.474 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:46.474 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:46.474 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:46.474 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:46.474 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:46.474 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:46.474 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:46.474 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:46.474 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:46.474 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:46.474 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:46.474 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:46.474 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.474 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.474 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:14:46.474 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:14:46.475 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:14:46.475 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:14:46.475 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:14:46.475 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:14:46.475 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:46.475 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:46.475 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:14:46.475 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:14:46.475 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:14:46.475 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:14:46.475 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:14:46.475 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:14:46.475 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:14:46.475 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:46.475 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:14:46.475 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:46.475 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:46.475 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:46.475 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:46.475 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:46.476 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:46.476 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:46.476 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:46.476 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:46.476 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:46.476 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:46.476 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:46.476 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:46.476 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:46.476 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:14:46.476 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.476 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:14:46.476 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.476 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:14:46.476 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:14:46.476 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.476 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.476 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.476 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.476 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:14:46.476 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.477 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.477 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.477 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.477 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:14:46.477 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.477 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.477 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.477 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.477 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:14:46.477 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:14:46.477 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.477 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.477 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:14:46.477 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.477 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.477 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.477 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:14:46.478 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:14:46.478 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.478 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.478 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.478 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.478 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:14:46.478 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.478 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.478 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.478 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.478 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:14:46.478 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.478 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.478 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.478 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.478 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:14:46.478 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:14:46.478 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.478 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.478 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:14:46.478 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.479 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.479 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.479 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:14:46.479 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:14:46.479 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.479 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.479 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.479 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.479 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:14:46.479 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.479 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.479 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.479 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.479 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:14:46.479 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.479 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.479 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.479 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.479 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:14:46.479 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:14:46.479 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.479 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.479 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:14:46.479 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.480 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.480 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.480 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:14:46.480 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:14:46.480 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.480 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.480 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.480 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.480 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:14:46.480 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.480 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.480 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.480 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.480 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:14:46.480 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.480 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.480 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.480 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.480 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:14:46.480 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:14:46.480 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.480 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.480 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:14:46.481 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.481 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.481 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.481 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:14:46.481 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:14:46.481 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.481 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.481 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.481 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.481 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:14:46.481 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.481 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.481 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.481 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.481 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:14:46.481 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.481 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.481 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.481 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.481 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:14:46.481 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:14:46.481 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.481 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.482 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:46.482 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.482 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.482 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.482 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:14:46.482 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:14:46.482 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.482 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.482 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.482 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.482 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:14:46.482 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.482 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.482 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.482 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.482 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:14:46.482 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.482 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.482 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.482 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.482 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:14:46.482 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:14:46.482 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.482 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.483 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:14:46.483 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.483 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.483 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.483 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:14:46.483 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:14:46.483 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.483 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.483 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.483 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.483 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:14:46.483 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.483 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.483 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.483 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.483 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:14:46.483 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.483 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.483 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.483 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.483 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:14:46.483 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:14:46.483 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.483 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.483 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:46.484 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.484 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.484 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.484 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:14:46.484 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:14:46.484 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.484 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.484 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.484 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.484 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:14:46.484 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.484 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.484 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.484 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.484 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:14:46.484 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.484 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.484 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.484 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.484 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:14:46.484 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:14:46.484 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.484 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.484 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:14:46.485 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.485 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.485 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.485 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:14:46.485 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:14:46.485 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:46.485 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:46.485 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.485 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:46.485 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:14:46.485 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.485 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.485 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.485 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:46.485 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:14:46.485 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:46.485 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.485 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.485 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.485 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:14:46.485 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:14:46.485 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:46.485 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:46.485 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:14:46.486 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:46.486 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.486 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.486 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.486 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:14:46.486 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:14:46.486 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.486 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:46.486 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:46.486 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:46.486 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.486 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:46.486 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:14:46.486 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:46.486 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:46.486 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:46.486 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:46.486 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:46.486 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:46.486 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:46.486 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:14:46.486 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:14:46.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.459+0000 7f6e478cc640 1 -- 10.20.193.48:0/2723508284 >> v2:10.20.193.111:6812/977811348 conn(0x7f6e1003f730 msgr2=0x7f6e1005fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:46.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.459+0000 7f6e478cc640 1 --2- 10.20.193.48:0/2723508284 >> v2:10.20.193.111:6812/977811348 conn(0x7f6e1003f730 0x7f6e1005fbe0 secure :-1 s=READY pgs=438 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e4013ec50 tx=0x7f6e34039040 comp rx=0 tx=0).stop 2026-02-12T18:14:46.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.459+0000 7f6e478cc640 10 monclient: shutdown 2026-02-12T18:14:46.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.459+0000 7f6e478cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:46.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.459+0000 7f6e478cc640 1 -- 10.20.193.48:0/2723508284 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f6e4013db70 msgr2=0x7f6e4008ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:46.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.459+0000 7f6e45e42640 1 -- 10.20.193.48:0/2723508284 reap_dead start 2026-02-12T18:14:46.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.459+0000 7f6e478cc640 1 --2- 10.20.193.48:0/2723508284 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f6e4013db70 0x7f6e4008ebe0 secure :-1 s=READY pgs=150 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6e3c00d430 tx=0x7f6e3c00d900 comp rx=0 tx=0).stop 2026-02-12T18:14:46.488 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.460+0000 7f6e478cc640 1 -- 10.20.193.48:0/2723508284 shutdown_connections 2026-02-12T18:14:46.488 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.460+0000 7f6e478cc640 1 --2- 10.20.193.48:0/2723508284 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f6e4013db70 0x7f6e4008ebe0 unknown :-1 s=CLOSED pgs=150 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.488 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.460+0000 7f6e478cc640 1 -- 10.20.193.48:0/2723508284 >> 10.20.193.48:0/2723508284 conn(0x7f6e400548a0 msgr2=0x7f6e40093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:46.488 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.460+0000 7f6e478cc640 1 -- 10.20.193.48:0/2723508284 shutdown_connections 2026-02-12T18:14:46.488 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.460+0000 7f6e478cc640 1 -- 10.20.193.48:0/2723508284 wait complete. 2026-02-12T18:14:46.488 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:14:46.488 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2026-02-12T18:14:46.488 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2026-02-12T18:14:46.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.554+0000 7f32bd48c640 10 monclient: get_monmap_and_config 2026-02-12T18:14:46.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.554+0000 7f32bd48c640 10 monclient: build_initial_monmap 2026-02-12T18:14:46.555 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.554+0000 7f32bd48c640 10 monclient: monmap: 2026-02-12T18:14:46.555 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:46.555 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:46.555 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:14:46.555386+0000 2026-02-12T18:14:46.556 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:14:46.555386+0000 2026-02-12T18:14:46.556 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:46.556 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.556 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:14:46.556 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:14:46.556 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:46.556 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:46.556 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:46.556 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:46.556 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:46.556 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:46.556 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:46.556 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:14:46.556 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:14:46.556 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.554+0000 7f32bd48c640 1 Processor -- start 2026-02-12T18:14:46.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.554+0000 7f32bd48c640 1 -- start start 2026-02-12T18:14:46.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.554+0000 7f32bd48c640 10 monclient: init 2026-02-12T18:14:46.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32bd48c640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:46.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32bd48c640 10 monclient: _add_conns ranks=[1,2,0,10,5,7,6,3,4,8,9] 2026-02-12T18:14:46.557 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32bd48c640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f32b805c950 addr v1:10.20.193.111:6789/0 2026-02-12T18:14:46.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32bd48c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f32b805e490 0x7f32b81857b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32bd48c640 10 monclient(hunting): picked mon.noname-b con 0x7f32b805e490 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:14:46.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32bd48c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f32b805d430 addr v1:10.20.193.48:6789/0 2026-02-12T18:14:46.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32bd48c640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32b804dc20 con 0x7f32b805d430 2026-02-12T18:14:46.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32bd48c640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32b805ddd0 con 0x7f32b805c950 2026-02-12T18:14:46.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32bd48c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32bd48c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f32b8092990 con 0x7f32b805e490 2026-02-12T18:14:46.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32bd48c640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:46.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32bd48c640 10 monclient(hunting): authenticate will time out at 1125.281128s 2026-02-12T18:14:46.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32b77fe640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f32b805d430 0x7f32b81a5d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:53398/0 (socket says 10.20.193.48:53398) 2026-02-12T18:14:46.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32b67fc640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f32b805e490 0x7f32b81857b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32b77fe640 1 -- 10.20.193.48:0/634770743 learned_addr learned my addr 10.20.193.48:0/634770743 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:14:46.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32b67fc640 10 monclient(hunting): get_auth_request con 0x7f32b805e490 auth_method 0 2026-02-12T18:14:46.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32b67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32b67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32b67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32b67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:46.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32b67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:46.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32b67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:46.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32b67fc640 10 monclient(hunting): handle_auth_done global_id 36425 payload 274 2026-02-12T18:14:46.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32b67fc640 1 -- 10.20.193.48:0/634770743 >> v1:10.20.193.111:6789/0 conn(0x7f32b805c950 legacy=0x7f32b805cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:46.558 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32b67fc640 1 -- 10.20.193.48:0/634770743 >> v1:10.20.193.48:6789/0 conn(0x7f32b805d430 legacy=0x7f32b81a5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:46.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32b67fc640 10 monclient: _finish_hunting 0 2026-02-12T18:14:46.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32b67fc640 1 monclient: found mon.noname-b 2026-02-12T18:14:46.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32b67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:46.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32b67fc640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:14:46.559 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.555+0000 7f32b67fc640 1 -- 10.20.193.48:0/634770743 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b8092c70 con 0x7f32b805e490 2026-02-12T18:14:46.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32b67fc640 1 -- 10.20.193.48:0/634770743 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f32b805e490 msgr2=0x7f32b81857b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:46.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32b67fc640 1 --2- 10.20.193.48:0/634770743 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f32b805e490 0x7f32b81857b0 secure :-1 s=READY pgs=387 gs=3 cs=0 l=1 c_cookie=13313290919074821057 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32a0009800 tx=0x7f32a002ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8c24f8dd6e373c1 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:46.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32b5ffb640 1 -- 10.20.193.48:0/634770743 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f32a0035340 con 0x7f32b805e490 2026-02-12T18:14:46.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:46.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32b5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:14:46.560 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32b5ffb640 10 monclient: dump: 2026-02-12T18:14:46.560 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:46.560 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:46.560 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.560 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.560 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:46.560 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.561 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:46.561 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:46.561 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:46.561 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:46.561 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:46.561 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:46.561 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:46.561 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:46.561 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:46.561 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32b5ffb640 10 monclient: _finish_auth 0 2026-02-12T18:14:46.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32b5ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:14:46.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32b5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:46.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32b5ffb640 1 -- 10.20.193.48:0/634770743 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a00354c0 con 0x7f32b805e490 2026-02-12T18:14:46.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32bd48c640 5 monclient: authenticate success, global_id 36425 2026-02-12T18:14:46.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32bd48c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:14:46.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32b5ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:46.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32b5ffb640 1 -- 10.20.193.48:0/634770743 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f32a0035af0 con 0x7f32b805e490 2026-02-12T18:14:46.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32bd48c640 10 monclient: get_monmap_and_config success 2026-02-12T18:14:46.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32bd48c640 4 set_mon_vals no callback set 2026-02-12T18:14:46.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32b5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:46.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32b5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:14:46.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32b5ffb640 10 monclient: dump: 2026-02-12T18:14:46.562 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:46.562 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:46.562 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.562 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.562 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:46.562 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.562 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:46.562 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:46.562 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:46.562 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:46.562 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:46.562 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:46.562 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:46.562 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:46.562 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:46.562 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32bd48c640 10 monclient: shutdown 2026-02-12T18:14:46.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32bd48c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:46.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32bd48c640 1 -- 10.20.193.48:0/634770743 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f32b805e490 msgr2=0x7f32b81857b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:46.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32bd48c640 1 --2- 10.20.193.48:0/634770743 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f32b805e490 0x7f32b81857b0 secure :-1 s=READY pgs=387 gs=3 cs=0 l=1 c_cookie=13313290919074821057 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32a0009800 tx=0x7f32a002ed50 comp rx=0 tx=0).stop 2026-02-12T18:14:46.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32bd48c640 1 -- 10.20.193.48:0/634770743 shutdown_connections 2026-02-12T18:14:46.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32bd48c640 1 --2- 10.20.193.48:0/634770743 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f32b805e490 0x7f32b81857b0 unknown :-1 s=CLOSED pgs=387 gs=3 cs=0 l=1 c_cookie=13313290919074821057 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32bd48c640 1 -- 10.20.193.48:0/634770743 >> 10.20.193.48:0/634770743 conn(0x7f32b80548a0 msgr2=0x7f32b8097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:46.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32bd48c640 1 -- 10.20.193.48:0/634770743 shutdown_connections 2026-02-12T18:14:46.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.558+0000 7f32bd48c640 1 -- 10.20.193.48:0/634770743 wait complete. 2026-02-12T18:14:46.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32bd48c640 10 monclient: build_initial_monmap 2026-02-12T18:14:46.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32bd48c640 10 monclient: monmap: 2026-02-12T18:14:46.563 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:46.563 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:14:46.563 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:14:46.563 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:14:46.563 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:46.563 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.563 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:14:46.563 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:14:46.563 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:46.563 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:46.563 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:46.563 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:46.563 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:46.563 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:46.563 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:46.563 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32bd48c640 1 Processor -- start 2026-02-12T18:14:46.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32bd48c640 1 -- start start 2026-02-12T18:14:46.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32bd48c640 10 monclient: init 2026-02-12T18:14:46.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32bd48c640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:46.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32bd48c640 10 monclient: _add_conns ranks=[7,1,2,0,6,3,8,5,4] 2026-02-12T18:14:46.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32bd48c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f32b805c950 0x7f32b8090060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32bd48c640 10 monclient(hunting): picked mon.noname-i con 0x7f32b805c950 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:14:46.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32bd48c640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f32b805d430 0x7f32b80905a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32bd48c640 10 monclient(hunting): picked mon.noname-f con 0x7f32b805d430 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:14:46.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32bd48c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f32b805e490 0x7f32b8090ae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32bd48c640 10 monclient(hunting): picked mon.noname-b con 0x7f32b805e490 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:14:46.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32bd48c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32bd48c640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f32b808b920 con 0x7f32b805d430 2026-02-12T18:14:46.566 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32bd48c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32bd48c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f32b808ce00 con 0x7f32b805e490 2026-02-12T18:14:46.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32bd48c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32bd48c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f32b81429f0 con 0x7f32b805c950 2026-02-12T18:14:46.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32bd48c640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:46.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32bd48c640 10 monclient(hunting): authenticate will time out at 1125.285499s 2026-02-12T18:14:46.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b77fe640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f32b805e490 0x7f32b8090ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b77fe640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f32b805e490 0x7f32b8090ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:58664/0 (socket says 10.20.193.48:58664) 2026-02-12T18:14:46.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b77fe640 1 -- 10.20.193.48:0/490576348 learned_addr learned my addr 10.20.193.48:0/490576348 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:46.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b77fe640 10 monclient(hunting): get_auth_request con 0x7f32b805e490 auth_method 0 2026-02-12T18:14:46.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b77fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b77fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b77fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b77fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:46.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b77fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:46.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b77fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:46.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b6ffd640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f32b805c950 0x7f32b8090060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b67fc640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f32b805d430 0x7f32b80905a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b6ffd640 10 monclient(hunting): get_auth_request con 0x7f32b805c950 auth_method 0 2026-02-12T18:14:46.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b67fc640 10 monclient(hunting): get_auth_request con 0x7f32b805d430 auth_method 0 2026-02-12T18:14:46.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:46.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:46.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:46.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b77fe640 10 monclient(hunting): handle_auth_done global_id 36434 payload 824 2026-02-12T18:14:46.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b77fe640 1 -- 10.20.193.48:0/490576348 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f32b805c950 msgr2=0x7f32b8090060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:46.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b77fe640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f32b805c950 0x7f32b8090060 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b77fe640 1 -- 10.20.193.48:0/490576348 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f32b805d430 msgr2=0x7f32b80905a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:46.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b77fe640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f32b805d430 0x7f32b80905a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:46.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b77fe640 10 monclient: _finish_hunting 0 2026-02-12T18:14:46.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b77fe640 1 monclient: found mon.noname-b 2026-02-12T18:14:46.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:46.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b77fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:14:46.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.559+0000 7f32b77fe640 1 -- 10.20.193.48:0/490576348 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a0009420 con 0x7f32b805e490 2026-02-12T18:14:46.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32b77fe640 1 -- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f32b805e490 msgr2=0x7f32b8090ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:46.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32b77fe640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f32b805e490 0x7f32b8090ae0 secure :-1 s=READY pgs=388 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32a800d500 tx=0x7f32a800d9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:46.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32977fe640 1 -- 10.20.193.48:0/490576348 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f32a8006e90 con 0x7f32b805e490 2026-02-12T18:14:46.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:46.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32977fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:14:46.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32977fe640 10 monclient: dump: 2026-02-12T18:14:46.568 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:46.568 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:46.569 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.569 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.569 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:46.569 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.569 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:46.569 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:46.569 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:46.569 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:46.569 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:46.569 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:46.569 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:46.569 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:46.569 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:46.569 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32977fe640 10 monclient: _finish_auth 0 2026-02-12T18:14:46.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32977fe640 10 monclient: _check_auth_tickets 2026-02-12T18:14:46.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:46.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32bd48c640 5 monclient: authenticate success, global_id 36434 2026-02-12T18:14:46.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32977fe640 1 -- 10.20.193.48:0/490576348 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32a8008530 con 0x7f32b805e490 2026-02-12T18:14:46.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32977fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:46.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32977fe640 1 -- 10.20.193.48:0/490576348 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f32a80086a0 con 0x7f32b805e490 2026-02-12T18:14:46.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32bd48c640 10 monclient: _renew_subs 2026-02-12T18:14:46.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32bd48c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:14:46.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32bd48c640 1 -- 10.20.193.48:0/490576348 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b808be70 con 0x7f32b805e490 2026-02-12T18:14:46.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32b57fa640 4 set_mon_vals no callback set 2026-02-12T18:14:46.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:46.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32977fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:14:46.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32977fe640 10 monclient: dump: 2026-02-12T18:14:46.570 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:46.570 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:46.570 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.570 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:46.570 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:46.570 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:46.570 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:46.570 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:46.570 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:46.570 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:46.570 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:46.570 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:46.570 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:46.570 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:46.570 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:46.570 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:46.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32bd48c640 10 monclient: _renew_subs 2026-02-12T18:14:46.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32bd48c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:14:46.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32bd48c640 1 -- 10.20.193.48:0/490576348 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b808b2e0 con 0x7f32b805e490 2026-02-12T18:14:46.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32bd48c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:46.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32bd48c640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 0x7f32b813fc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32bd48c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:46.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32bd48c640 1 -- 10.20.193.48:0/490576348 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f32b805d2b0 con 0x7f32b808ab80 2026-02-12T18:14:46.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32b6ffd640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 0x7f32b813fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32b6ffd640 10 monclient: get_auth_request con 0x7f32b808ab80 auth_method 0 2026-02-12T18:14:46.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:46.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32b6ffd640 1 -- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 msgr2=0x7f32b813fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-12T18:14:46.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32b6ffd640 1 -- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 msgr2=0x7f32b813fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:14:46.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32b6ffd640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 0x7f32b813fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:46.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.562+0000 7f32b6ffd640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 0x7f32b813fc70 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:14:46.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.563+0000 7f32977fe640 1 -- 10.20.193.48:0/490576348 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f32a8008070 con 0x7f32b805e490 2026-02-12T18:14:46.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.563+0000 7f32977fe640 1 --2- 10.20.193.48:0/490576348 >> v2:10.20.193.111:6812/977811348 conn(0x7f328403f800 0x7f328405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:46.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.563+0000 7f32977fe640 1 -- 10.20.193.48:0/490576348 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(312..312 src has 215..312) ==== 3503+0+0 (secure 0 0 0) 0x7f32a8052f40 con 0x7f32b805e490 2026-02-12T18:14:46.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.563+0000 7f32b67fc640 1 --2- 10.20.193.48:0/490576348 >> v2:10.20.193.111:6812/977811348 conn(0x7f328403f800 0x7f328405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.571 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.563+0000 7f32b67fc640 10 monclient: get_auth_request con 0x7f328403f800 auth_method 0 2026-02-12T18:14:46.572 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.566+0000 7f32b67fc640 1 --2- 10.20.193.48:0/490576348 >> v2:10.20.193.111:6812/977811348 conn(0x7f328403f800 0x7f328405fcb0 secure :-1 s=READY pgs=439 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32a0004740 tx=0x7f32a0039040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:46.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.763+0000 7f32b6ffd640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 0x7f32b813fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:46.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.763+0000 7f32b6ffd640 10 monclient: get_auth_request con 0x7f32b808ab80 auth_method 0 2026-02-12T18:14:46.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.763+0000 7f32b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:46.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.763+0000 7f32b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:46.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.763+0000 7f32b6ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:46.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.763+0000 7f32b6ffd640 1 -- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 msgr2=0x7f32b813fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-12T18:14:46.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.763+0000 7f32b6ffd640 1 -- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 msgr2=0x7f32b813fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:14:46.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.763+0000 7f32b6ffd640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 0x7f32b813fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:46.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:46.763+0000 7f32b6ffd640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 0x7f32b813fc70 unknown :-1 s=START_CONNECT pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:14:47.166 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:47.165+0000 7f32b6ffd640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 0x7f32b813fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:47.166 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:47.165+0000 7f32b6ffd640 10 monclient: get_auth_request con 0x7f32b808ab80 auth_method 0 2026-02-12T18:14:47.167 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:47.165+0000 7f32b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:47.167 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:47.165+0000 7f32b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:47.167 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:47.165+0000 7f32b6ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:47.167 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:47.165+0000 7f32b6ffd640 1 -- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 msgr2=0x7f32b813fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-12T18:14:47.167 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:47.165+0000 7f32b6ffd640 1 -- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 msgr2=0x7f32b813fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:14:47.167 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:47.165+0000 7f32b6ffd640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 0x7f32b813fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=9 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:47.167 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:47.165+0000 7f32b6ffd640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 0x7f32b813fc70 unknown :-1 s=START_CONNECT pgs=0 gs=10 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:14:47.967 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:47.966+0000 7f32b6ffd640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 0x7f32b813fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=11 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:47.967 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:47.966+0000 7f32b6ffd640 10 monclient: get_auth_request con 0x7f32b808ab80 auth_method 0 2026-02-12T18:14:47.967 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:47.966+0000 7f32b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:47.967 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:47.966+0000 7f32b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:47.968 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:47.966+0000 7f32b6ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:47.968 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:47.966+0000 7f32b6ffd640 1 -- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 msgr2=0x7f32b813fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-12T18:14:47.968 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:47.966+0000 7f32b6ffd640 1 -- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 msgr2=0x7f32b813fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:14:47.968 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:47.966+0000 7f32b6ffd640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 0x7f32b813fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=11 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:47.968 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:47.966+0000 7f32b6ffd640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 0x7f32b813fc70 unknown :-1 s=START_CONNECT pgs=0 gs=12 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:14:48.118 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:48.118 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32377]: starting. 2026-02-12T18:14:48.119 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32377]: creating pool ceph_test_rados_delete_pools_parallel.trial111-32209 2026-02-12T18:14:48.119 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32377]: created object 0... 2026-02-12T18:14:48.119 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32377]: created object 25... 2026-02-12T18:14:48.119 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32377]: created object 49... 2026-02-12T18:14:48.119 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32377]: finishing. 2026-02-12T18:14:48.119 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32377]: shutting down. 2026-02-12T18:14:48.151 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:48.152 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[32379]: starting. 2026-02-12T18:14:48.152 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[32379]: listing objects. 2026-02-12T18:14:48.152 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[32379]: listed object 0... 2026-02-12T18:14:48.152 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[32379]: listed object 25... 2026-02-12T18:14:48.152 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[32379]: saw 50 objects 2026-02-12T18:14:48.152 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[32379]: shutting down. 2026-02-12T18:14:49.063 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:49.063 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[32378]: starting. 2026-02-12T18:14:49.063 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[32378]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-32209 2026-02-12T18:14:49.064 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[32378]: shutting down. 2026-02-12T18:14:49.064 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:49.064 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:49.064 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:14:49.067 DEBUG:teuthology.orchestra.run.trial111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2026-02-12T18:14:49.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:49.559+0000 7f32967fc640 10 monclient: tick 2026-02-12T18:14:49.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:49.559+0000 7f32967fc640 10 monclient: _check_auth_tickets 2026-02-12T18:14:49.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:49.559+0000 7f32967fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:49.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:49.559+0000 7f32967fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:49.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:49.567+0000 7f32b6ffd640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 0x7f32b813fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=13 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:49.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:49.567+0000 7f32b6ffd640 10 monclient: get_auth_request con 0x7f32b808ab80 auth_method 0 2026-02-12T18:14:49.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:49.567+0000 7f32b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:49.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:49.567+0000 7f32b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:49.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:49.567+0000 7f32b6ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:49.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:49.567+0000 7f32b6ffd640 1 -- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 msgr2=0x7f32b813fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-12T18:14:49.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:49.567+0000 7f32b6ffd640 1 -- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 msgr2=0x7f32b813fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:14:49.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:49.567+0000 7f32b6ffd640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 0x7f32b813fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=13 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:49.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:49.567+0000 7f32b6ffd640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 0x7f32b813fc70 unknown :-1 s=START_CONNECT pgs=0 gs=14 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2026-02-12T18:14:50.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.559+0000 7f32967fc640 10 monclient: tick 2026-02-12T18:14:50.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.559+0000 7f32967fc640 10 monclient: _check_auth_tickets 2026-02-12T18:14:50.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.559+0000 7f32967fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:50.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.559+0000 7f32967fc640 5 monclient: _check_tell_commands timeout tell command 1 2026-02-12T18:14:50.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.559+0000 7f32967fc640 1 -- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 msgr2=0x7f32b813fc70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:14:50.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.559+0000 7f32967fc640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 0x7f32b813fc70 unknown :-1 s=START_CONNECT pgs=0 gs=14 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:50.562 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.559+0000 7f32967fc640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f327c003600 0x7f327c023a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:50.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.559+0000 7f32967fc640 1 -- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 msgr2=0x7f32b813fc70 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:50.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.559+0000 7f32967fc640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808ab80 0x7f32b813fc70 unknown :-1 s=CLOSED pgs=0 gs=14 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:50.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.559+0000 7f32967fc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:50.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.559+0000 7f32967fc640 1 -- 10.20.193.48:0/490576348 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f327c024130 con 0x7f327c003600 2026-02-12T18:14:50.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.559+0000 7f32b6ffd640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f327c003600 0x7f327c023a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=15 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:50.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.559+0000 7f32b6ffd640 10 monclient: get_auth_request con 0x7f327c003600 auth_method 0 2026-02-12T18:14:50.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.559+0000 7f32b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:50.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.559+0000 7f32b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:50.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.559+0000 7f32b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:50.563 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.559+0000 7f32b6ffd640 1 -- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f327c003600 msgr2=0x7f327c023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-12T18:14:50.564 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.559+0000 7f32b6ffd640 1 -- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f327c003600 msgr2=0x7f327c023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:14:50.564 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.559+0000 7f32b6ffd640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f327c003600 0x7f327c023a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=15 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:50.564 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.559+0000 7f32b6ffd640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f327c003600 0x7f327c023a80 unknown :-1 s=START_CONNECT pgs=0 gs=16 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:14:50.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.760+0000 7f32b6ffd640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f327c003600 0x7f327c023a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=17 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:50.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.760+0000 7f32b6ffd640 10 monclient: get_auth_request con 0x7f327c003600 auth_method 0 2026-02-12T18:14:50.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.760+0000 7f32b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:50.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.760+0000 7f32b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:50.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.760+0000 7f32b6ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:50.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.760+0000 7f32b6ffd640 1 -- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f327c003600 msgr2=0x7f327c023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-12T18:14:50.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.760+0000 7f32b6ffd640 1 -- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f327c003600 msgr2=0x7f327c023a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:14:50.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.760+0000 7f32b6ffd640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f327c003600 0x7f327c023a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=17 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:50.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:50.760+0000 7f32b6ffd640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f327c003600 0x7f327c023a80 unknown :-1 s=START_CONNECT pgs=0 gs=18 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:14:51.162 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.161+0000 7f32b6ffd640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f327c003600 0x7f327c023a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=19 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.163 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.161+0000 7f32b6ffd640 10 monclient: get_auth_request con 0x7f327c003600 auth_method 0 2026-02-12T18:14:51.163 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.161+0000 7f32b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.163 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.161+0000 7f32b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.163 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.161+0000 7f32b6ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:51.163 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.161+0000 7f32b6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:51.163 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.161+0000 7f32b6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:51.163 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.161+0000 7f32b6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:51.163 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.161+0000 7f32b6ffd640 10 monclient(hunting): handle_auth_done global_id 104109 payload 824 2026-02-12T18:14:51.163 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.161+0000 7f32b6ffd640 1 -- 10.20.193.48:0/490576348 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f327c0242a0 con 0x7f327c003600 2026-02-12T18:14:51.165 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.163+0000 7f32b6ffd640 1 -- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f327c003600 msgr2=0x7f327c023a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:51.165 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.163+0000 7f32b6ffd640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f327c003600 0x7f327c023a80 secure :-1 s=READY pgs=13 gs=19 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32ac003770 tx=0x7f32ac01aea0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:51.165 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.163+0000 7f32977fe640 1 -- 10.20.193.48:0/490576348 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f32ac01f070 con 0x7f327c003600 2026-02-12T18:14:51.165 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.163+0000 7f32977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:51.165 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.163+0000 7f32977fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:14:51.165 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.163+0000 7f32977fe640 10 monclient: dump: 2026-02-12T18:14:51.166 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:51.166 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.166 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.166 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.166 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:51.166 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.166 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:51.166 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:51.166 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:51.166 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:51.166 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:51.166 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:51.167 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:51.167 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:51.167 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:51.167 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.167 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.163+0000 7f32977fe640 1 -- 10.20.193.48:0/490576348 <== mon.6 v2:10.20.193.48:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f32ac01a2e0 con 0x7f327c003600 2026-02-12T18:14:51.167 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.163+0000 7f32977fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:51.167 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.163+0000 7f32977fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:14:51.167 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.163+0000 7f32977fe640 1 -- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f327c003600 msgr2=0x7f327c023a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.167 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.163+0000 7f32977fe640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f327c003600 0x7f327c023a80 secure :-1 s=READY pgs=13 gs=19 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32ac003770 tx=0x7f32ac01aea0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.167 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.163+0000 7f32977fe640 1 -- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f327c003600 msgr2=0x7f327c023a80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:51.168 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.163+0000 7f32977fe640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f327c003600 0x7f327c023a80 secure :-1 s=CLOSED pgs=13 gs=19 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32ac003770 tx=0x7f32ac01aea0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.169 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.167+0000 7f32bd48c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:14:51.169 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.167+0000 7f32bd48c640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808d9b0 0x7f32b81401b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.169 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.167+0000 7f32bd48c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.169 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.167+0000 7f32bd48c640 1 -- 10.20.193.48:0/490576348 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f32b805f140 con 0x7f32b808d9b0 2026-02-12T18:14:51.169 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.167+0000 7f32b6ffd640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808d9b0 0x7f32b81401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.169 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.167+0000 7f32b6ffd640 10 monclient: get_auth_request con 0x7f32b808d9b0 auth_method 0 2026-02-12T18:14:51.169 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.167+0000 7f32b6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.170 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.167+0000 7f32b6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.170 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.167+0000 7f32b6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.170 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.167+0000 7f32b6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:51.170 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.167+0000 7f32b6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:51.170 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.167+0000 7f32b6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:51.170 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.167+0000 7f32b6ffd640 10 monclient(hunting): handle_auth_done global_id 104118 payload 824 2026-02-12T18:14:51.170 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.167+0000 7f32b6ffd640 1 -- 10.20.193.48:0/490576348 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f32b805cd20 con 0x7f32b808d9b0 2026-02-12T18:14:51.171 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.169+0000 7f32b6ffd640 1 -- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808d9b0 msgr2=0x7f32b81401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:51.172 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.169+0000 7f32b6ffd640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808d9b0 0x7f32b81401b0 secure :-1 s=READY pgs=14 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32ac021000 tx=0x7f32ac0037a0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:51.172 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.169+0000 7f32977fe640 1 -- 10.20.193.48:0/490576348 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f32ac003e30 con 0x7f32b808d9b0 2026-02-12T18:14:51.172 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.169+0000 7f32977fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:51.172 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.169+0000 7f32977fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:14:51.172 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.169+0000 7f32977fe640 10 monclient: dump: 2026-02-12T18:14:51.172 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:51.172 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.172 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.172 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.172 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:51.173 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.173 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:51.173 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:51.173 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:51.173 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:51.173 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:51.173 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:51.173 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:51.173 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:51.173 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:51.173 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.173 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.170+0000 7f32977fe640 1 -- 10.20.193.48:0/490576348 <== mon.6 v2:10.20.193.48:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7f32ac029770 con 0x7f32b808d9b0 2026-02-12T18:14:51.173 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.170+0000 7f32977fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:14:51.174 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.170+0000 7f32977fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:14:51.174 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.170+0000 7f32977fe640 1 -- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808d9b0 msgr2=0x7f32b81401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.174 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.170+0000 7f32977fe640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808d9b0 0x7f32b81401b0 secure :-1 s=READY pgs=14 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32ac021000 tx=0x7f32ac0037a0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.174 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.170+0000 7f32977fe640 1 -- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808d9b0 msgr2=0x7f32b81401b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:51.174 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.170+0000 7f32977fe640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f32b808d9b0 0x7f32b81401b0 unknown :-1 s=CLOSED pgs=14 gs=20 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.174 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.170+0000 7f32b77fe640 1 -- 10.20.193.48:0/490576348 reap_dead start 2026-02-12T18:14:51.174 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:14:51.175 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:14:51.175 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:14:51.175 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:14:51.175 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 76, 2026-02-12T18:14:51.175 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 10165, 2026-02-12T18:14:51.175 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:14:51.175 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:14:51.175 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:14:51.175 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:14:51.175 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:14:51.176 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:14:51.176 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:14:51.176 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:14:51.176 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:14:51.176 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:14:51.176 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:51.176 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 5, 2026-02-12T18:14:51.176 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:51.176 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:14:51.176 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:14:51.176 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:51.176 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:51.177 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:51.177 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:51.177 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:51.177 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:51.177 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:51.177 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:51.177 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:51.177 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:51.177 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:51.177 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:51.177 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:51.177 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:51.178 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:14:51.178 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:14:51.178 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:51.178 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:51.178 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:51.178 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:51.178 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:51.178 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:51.178 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:51.178 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:51.178 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:51.178 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:51.179 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:51.179 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:51.179 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:51.179 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.179 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.179 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:14:51.179 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:14:51.179 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:14:51.179 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:14:51.179 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:14:51.179 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:14:51.180 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:51.180 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:51.180 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:14:51.180 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:14:51.180 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:14:51.180 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:14:51.180 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:14:51.180 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:14:51.180 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:14:51.180 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:51.180 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:14:51.181 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:51.181 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:51.181 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:51.181 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:51.181 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:51.181 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:51.181 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:51.181 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:51.181 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:51.181 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:51.181 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:51.181 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:51.181 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:51.182 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:51.182 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:14:51.182 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.182 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:14:51.182 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.182 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:14:51.182 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:14:51.182 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.182 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.182 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.182 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.182 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:14:51.183 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.183 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.183 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.183 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.183 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:14:51.183 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.183 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.183 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.183 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.183 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:14:51.183 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:14:51.183 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.184 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.184 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:14:51.184 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.184 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.184 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.184 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:14:51.184 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:14:51.184 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.184 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.184 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.184 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.184 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:14:51.185 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.185 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.185 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.185 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.185 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:14:51.185 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.185 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.185 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.185 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.185 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:14:51.185 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:14:51.185 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.185 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.186 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:14:51.186 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.186 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.186 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.186 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:14:51.186 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:14:51.186 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.186 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.186 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.186 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.186 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:14:51.186 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.187 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.187 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.187 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.187 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:14:51.187 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.187 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.187 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.187 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.187 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:14:51.187 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:14:51.187 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.187 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.187 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:14:51.188 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.188 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.188 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.188 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:14:51.188 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:14:51.188 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.188 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.188 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.188 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.188 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:14:51.188 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.188 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.189 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.189 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.189 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:14:51.189 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.189 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.189 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.189 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.189 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:14:51.189 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:14:51.189 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.189 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.189 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:14:51.190 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.190 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.190 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.190 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:14:51.190 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:14:51.190 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.190 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.190 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.190 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.190 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:14:51.190 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.190 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.191 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.191 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.191 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:14:51.191 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.191 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.191 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.191 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.191 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:14:51.191 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:14:51.191 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.191 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.191 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:51.192 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.192 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.192 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.192 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:14:51.192 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:14:51.192 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.192 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.192 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.192 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.192 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:14:51.192 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.192 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.193 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.193 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.193 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:14:51.193 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.193 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.193 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.193 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.193 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:14:51.193 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:14:51.193 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.193 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.193 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:14:51.194 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.194 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.194 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.194 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:14:51.194 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:14:51.194 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.194 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.194 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.194 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.194 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:14:51.194 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.194 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.195 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.195 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.195 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:14:51.195 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.195 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.195 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.195 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.195 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:14:51.195 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:14:51.195 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.195 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.195 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:51.196 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.196 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.196 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.196 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:14:51.196 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:14:51.196 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.196 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.196 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.196 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.196 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:14:51.196 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.196 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.197 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.197 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.197 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:14:51.197 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.197 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.197 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.197 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.197 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:14:51.197 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:14:51.197 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.197 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.197 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:14:51.198 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.198 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.198 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.198 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:14:51.198 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:14:51.198 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.198 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.198 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.198 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.198 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:14:51.198 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.198 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.198 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.198 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.199 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:14:51.199 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.199 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.199 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.199 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.199 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:14:51.199 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:14:51.199 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.199 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.199 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:14:51.199 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.199 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.199 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.199 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.200 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:14:51.200 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:14:51.200 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.200 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:51.200 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:51.200 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:51.200 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.200 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:51.200 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:14:51.200 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.201 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:51.201 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:51.201 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:51.201 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.201 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.201 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.201 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:14:51.201 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:14:51.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.170+0000 7f32bd48c640 1 -- 10.20.193.48:0/490576348 >> v2:10.20.193.111:6812/977811348 conn(0x7f328403f800 msgr2=0x7f328405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.170+0000 7f32bd48c640 1 --2- 10.20.193.48:0/490576348 >> v2:10.20.193.111:6812/977811348 conn(0x7f328403f800 0x7f328405fcb0 secure :-1 s=READY pgs=439 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32a0004740 tx=0x7f32a0039040 comp rx=0 tx=0).stop 2026-02-12T18:14:51.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.170+0000 7f32bd48c640 10 monclient: shutdown 2026-02-12T18:14:51.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.170+0000 7f32bd48c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:51.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.170+0000 7f32bd48c640 1 -- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f32b805e490 msgr2=0x7f32b8090ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.170+0000 7f32bd48c640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f32b805e490 0x7f32b8090ae0 secure :-1 s=READY pgs=388 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f32a800d500 tx=0x7f32a800d9d0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.170+0000 7f32bd48c640 1 -- 10.20.193.48:0/490576348 shutdown_connections 2026-02-12T18:14:51.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.170+0000 7f32bd48c640 1 --2- 10.20.193.48:0/490576348 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f32b805e490 0x7f32b8090ae0 unknown :-1 s=CLOSED pgs=388 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.170+0000 7f32bd48c640 1 --2- 10.20.193.48:0/490576348 >> v2:10.20.193.111:6812/977811348 conn(0x7f328403f800 0x7f328405fcb0 unknown :-1 s=CLOSED pgs=439 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.170+0000 7f32bd48c640 1 -- 10.20.193.48:0/490576348 >> 10.20.193.48:0/490576348 conn(0x7f32b80548a0 msgr2=0x7f32b813f020 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:51.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.170+0000 7f32bd48c640 1 -- 10.20.193.48:0/490576348 shutdown_connections 2026-02-12T18:14:51.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.170+0000 7f32bd48c640 1 -- 10.20.193.48:0/490576348 wait complete. 2026-02-12T18:14:51.204 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:14:51.204 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2026-02-12T18:14:51.204 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2026-02-12T18:14:51.272 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.270+0000 7f336274c640 10 monclient: get_monmap_and_config 2026-02-12T18:14:51.272 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.270+0000 7f336274c640 10 monclient: build_initial_monmap 2026-02-12T18:14:51.272 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.270+0000 7f336274c640 10 monclient: monmap: 2026-02-12T18:14:51.272 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:51.272 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.272 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:14:51.271707+0000 2026-02-12T18:14:51.272 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:14:51.271707+0000 2026-02-12T18:14:51.272 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:51.273 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.273 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:14:51.273 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:14:51.273 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:51.273 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:51.273 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:51.273 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:51.273 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:51.273 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:51.273 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:51.273 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:14:51.273 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:14:51.273 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f336274c640 1 Processor -- start 2026-02-12T18:14:51.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f336274c640 1 -- start start 2026-02-12T18:14:51.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f336274c640 10 monclient: init 2026-02-12T18:14:51.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f336274c640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:51.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f336274c640 10 monclient: _add_conns ranks=[2,6,7,4,10,9,5,0,1,8,3] 2026-02-12T18:14:51.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f336274c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f335c05c950 0x7f335c05cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f336274c640 10 monclient(hunting): picked mon.noname-b con 0x7f335c05c950 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:14:51.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f336274c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f335c05e490 0x7f335c05d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f336274c640 10 monclient(hunting): picked mon.noname-d con 0x7f335c05e490 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:14:51.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f336274c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f335c13db70 0x7f335c13dfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f336274c640 10 monclient(hunting): picked mon.noname-i con 0x7f335c13db70 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:14:51.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f336274c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f336274c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f335c05ddd0 con 0x7f335c05c950 2026-02-12T18:14:51.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f336274c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f336274c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f335c05d7a0 con 0x7f335c05e490 2026-02-12T18:14:51.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f336274c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f336274c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f335c092990 con 0x7f335c13db70 2026-02-12T18:14:51.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f336274c640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:51.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f336274c640 10 monclient(hunting): authenticate will time out at 1129.997450s 2026-02-12T18:14:51.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335bfff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f335c05c950 0x7f335c05cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335b7fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f335c05e490 0x7f335c05d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335b7fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f335c05e490 0x7f335c05d260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:35922/0 (socket says 10.20.193.48:35922) 2026-02-12T18:14:51.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335b7fe640 1 -- 10.20.193.48:0/362839588 learned_addr learned my addr 10.20.193.48:0/362839588 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:51.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335bfff640 1 --2- 10.20.193.48:0/362839588 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f335c05c950 0x7f335c05cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:58672/0 (socket says 10.20.193.48:58672) 2026-02-12T18:14:51.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335b7fe640 10 monclient(hunting): get_auth_request con 0x7f335c05e490 auth_method 0 2026-02-12T18:14:51.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335bfff640 10 monclient(hunting): get_auth_request con 0x7f335c05c950 auth_method 0 2026-02-12T18:14:51.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:51.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:51.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:51.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:51.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:51.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f3360cc2640 1 --2- 10.20.193.48:0/362839588 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f335c13db70 0x7f335c13dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.285 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:51.285 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f3360cc2640 10 monclient(hunting): get_auth_request con 0x7f335c13db70 auth_method 0 2026-02-12T18:14:51.285 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f3360cc2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.285 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f3360cc2640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.285 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f3360cc2640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.285 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335b7fe640 10 monclient(hunting): handle_auth_done global_id 104127 payload 274 2026-02-12T18:14:51.285 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335b7fe640 1 -- 10.20.193.48:0/362839588 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f335c13db70 msgr2=0x7f335c13dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:51.285 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335b7fe640 1 --2- 10.20.193.48:0/362839588 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f335c13db70 0x7f335c13dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.285 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335b7fe640 1 -- 10.20.193.48:0/362839588 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f335c05c950 msgr2=0x7f335c05cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:51.285 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335b7fe640 1 --2- 10.20.193.48:0/362839588 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f335c05c950 0x7f335c05cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.285 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335b7fe640 10 monclient: _finish_hunting 0 2026-02-12T18:14:51.285 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335b7fe640 1 monclient: found mon.noname-d 2026-02-12T18:14:51.285 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:51.286 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335b7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:14:51.286 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.271+0000 7f335b7fe640 1 -- 10.20.193.48:0/362839588 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f335c04dc20 con 0x7f335c05e490 2026-02-12T18:14:51.286 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f335b7fe640 1 -- 10.20.193.48:0/362839588 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f335c05e490 msgr2=0x7f335c05d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:51.286 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f335b7fe640 1 --2- 10.20.193.48:0/362839588 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f335c05e490 0x7f335c05d260 secure :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=9932085265866352751 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f334c0098d0 tx=0x7f334c02ee20 comp rx=0 tx=0).ready entity=mon.6 client_cookie=89d5daed46dae86f server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:51.286 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f335affd640 1 -- 10.20.193.48:0/362839588 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f334c035340 con 0x7f335c05e490 2026-02-12T18:14:51.286 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f335affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:51.286 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f335affd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:14:51.286 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f335affd640 10 monclient: dump: 2026-02-12T18:14:51.286 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:51.286 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.286 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.286 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.287 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:51.287 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.287 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:51.287 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:51.287 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:51.287 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:51.287 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:51.287 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:51.287 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:51.287 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:51.287 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:51.287 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.287 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f335affd640 10 monclient: _finish_auth 0 2026-02-12T18:14:51.287 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f335affd640 10 monclient: _check_auth_tickets 2026-02-12T18:14:51.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f335affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:51.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f335affd640 1 -- 10.20.193.48:0/362839588 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f334c0354c0 con 0x7f335c05e490 2026-02-12T18:14:51.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f335affd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:51.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f335affd640 1 -- 10.20.193.48:0/362839588 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f334c035af0 con 0x7f335c05e490 2026-02-12T18:14:51.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f335affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:51.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f335affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:14:51.288 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f335affd640 10 monclient: dump: 2026-02-12T18:14:51.288 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:51.288 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.288 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.288 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.288 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:51.288 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.289 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:51.289 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:51.289 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:51.289 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:51.289 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:51.289 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:51.289 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:51.289 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:51.289 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:51.289 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.289 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f336274c640 5 monclient: authenticate success, global_id 104127 2026-02-12T18:14:51.289 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f336274c640 10 monclient: get_monmap_and_config success 2026-02-12T18:14:51.289 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f336274c640 4 set_mon_vals no callback set 2026-02-12T18:14:51.289 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f336274c640 10 monclient: shutdown 2026-02-12T18:14:51.290 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f336274c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:51.290 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f336274c640 1 -- 10.20.193.48:0/362839588 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f335c05e490 msgr2=0x7f335c05d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.290 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f336274c640 1 --2- 10.20.193.48:0/362839588 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f335c05e490 0x7f335c05d260 secure :-1 s=READY pgs=15 gs=2 cs=0 l=1 c_cookie=9932085265866352751 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f334c0098d0 tx=0x7f334c02ee20 comp rx=0 tx=0).stop 2026-02-12T18:14:51.290 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f336274c640 1 -- 10.20.193.48:0/362839588 shutdown_connections 2026-02-12T18:14:51.290 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f336274c640 1 --2- 10.20.193.48:0/362839588 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f335c13db70 0x7f335c13dfc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.290 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f336274c640 1 --2- 10.20.193.48:0/362839588 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f335c05e490 0x7f335c05d260 unknown :-1 s=CLOSED pgs=15 gs=2 cs=0 l=1 c_cookie=9932085265866352751 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.290 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f336274c640 1 --2- 10.20.193.48:0/362839588 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f335c05c950 0x7f335c05cd20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.290 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f336274c640 1 -- 10.20.193.48:0/362839588 >> 10.20.193.48:0/362839588 conn(0x7f335c0548a0 msgr2=0x7f335c097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:51.290 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f336274c640 1 -- 10.20.193.48:0/362839588 shutdown_connections 2026-02-12T18:14:51.290 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.274+0000 7f336274c640 1 -- 10.20.193.48:0/362839588 wait complete. 2026-02-12T18:14:51.290 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f336274c640 10 monclient: build_initial_monmap 2026-02-12T18:14:51.290 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f336274c640 10 monclient: monmap: 2026-02-12T18:14:51.290 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:51.291 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:14:51.291 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:14:51.291 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:14:51.291 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:51.291 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.291 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:14:51.291 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:14:51.291 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:51.291 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:51.291 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:51.291 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:51.291 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:51.291 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:51.291 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:51.292 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.292 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f336274c640 1 Processor -- start 2026-02-12T18:14:51.292 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f336274c640 1 -- start start 2026-02-12T18:14:51.292 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f336274c640 10 monclient: init 2026-02-12T18:14:51.292 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f336274c640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:51.292 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f336274c640 10 monclient: _add_conns ranks=[6,3,2,8,1,4,7,0,5] 2026-02-12T18:14:51.292 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f336274c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f335c05c950 0x7f335c12cab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.292 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f336274c640 10 monclient(hunting): picked mon.noname-d con 0x7f335c05c950 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:14:51.292 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f336274c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f335c05e490 0x7f335c08d3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.292 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f336274c640 10 monclient(hunting): picked mon.noname-g con 0x7f335c05e490 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:14:51.292 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f336274c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f335c13db70 0x7f335c13cd30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.292 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f336274c640 10 monclient(hunting): picked mon.noname-b con 0x7f335c13db70 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:14:51.292 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f336274c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.293 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f336274c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f335c12d820 con 0x7f335c13db70 2026-02-12T18:14:51.293 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f336274c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.293 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f336274c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f335c08abc0 con 0x7f335c05e490 2026-02-12T18:14:51.293 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f336274c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.293 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f336274c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f335c08aea0 con 0x7f335c05c950 2026-02-12T18:14:51.293 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f336274c640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:51.293 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f336274c640 10 monclient(hunting): authenticate will time out at 1130.001899s 2026-02-12T18:14:51.293 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f335bfff640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f335c05c950 0x7f335c12cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.293 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f335bfff640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f335c05c950 0x7f335c12cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:35926/0 (socket says 10.20.193.48:35926) 2026-02-12T18:14:51.293 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f335bfff640 1 -- 10.20.193.48:0/514966352 learned_addr learned my addr 10.20.193.48:0/514966352 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:51.293 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f335bfff640 10 monclient(hunting): get_auth_request con 0x7f335c05c950 auth_method 0 2026-02-12T18:14:51.293 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f335bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.293 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f335bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.294 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f335bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.294 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.275+0000 7f3360cc2640 1 --2- 10.20.193.48:0/514966352 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f335c13db70 0x7f335c13cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.294 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.276+0000 7f3360cc2640 10 monclient(hunting): get_auth_request con 0x7f335c13db70 auth_method 0 2026-02-12T18:14:51.294 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.276+0000 7f3360cc2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.294 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.276+0000 7f3360cc2640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.294 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.276+0000 7f3360cc2640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.294 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.276+0000 7f335bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:51.294 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.276+0000 7f335bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:51.294 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.276+0000 7f335bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:51.294 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.276+0000 7f3360cc2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:51.294 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.276+0000 7f3360cc2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:51.294 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.276+0000 7f3360cc2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:51.294 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.276+0000 7f335b7fe640 1 --2- 10.20.193.48:0/514966352 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f335c05e490 0x7f335c08d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.295 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.276+0000 7f335b7fe640 10 monclient(hunting): get_auth_request con 0x7f335c05e490 auth_method 0 2026-02-12T18:14:51.295 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.276+0000 7f335b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.295 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.276+0000 7f335b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.295 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.276+0000 7f335b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.295 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.276+0000 7f335bfff640 10 monclient(hunting): handle_auth_done global_id 104136 payload 824 2026-02-12T18:14:51.295 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.276+0000 7f335bfff640 1 -- 10.20.193.48:0/514966352 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f335c05e490 msgr2=0x7f335c08d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.295 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.276+0000 7f335bfff640 1 --2- 10.20.193.48:0/514966352 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f335c05e490 0x7f335c08d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.295 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.276+0000 7f335bfff640 1 -- 10.20.193.48:0/514966352 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f335c13db70 msgr2=0x7f335c13cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.295 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.276+0000 7f335bfff640 1 --2- 10.20.193.48:0/514966352 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f335c13db70 0x7f335c13cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.295 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.276+0000 7f335bfff640 10 monclient: _finish_hunting 0 2026-02-12T18:14:51.295 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.276+0000 7f335bfff640 1 monclient: found mon.noname-d 2026-02-12T18:14:51.295 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.276+0000 7f335bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:51.295 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.276+0000 7f335bfff640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:14:51.295 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.276+0000 7f335bfff640 1 -- 10.20.193.48:0/514966352 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f334c0094f0 con 0x7f335c05c950 2026-02-12T18:14:51.296 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f335bfff640 1 -- 10.20.193.48:0/514966352 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f335c05c950 msgr2=0x7f335c12cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:51.296 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f335bfff640 1 --2- 10.20.193.48:0/514966352 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f335c05c950 0x7f335c12cab0 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33480093f0 tx=0x7f334800ed50 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:51.296 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f3358ff9640 1 -- 10.20.193.48:0/514966352 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f334800cb50 con 0x7f335c05c950 2026-02-12T18:14:51.296 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f3358ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:51.296 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f3358ff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:14:51.296 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f3358ff9640 10 monclient: dump: 2026-02-12T18:14:51.296 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:51.296 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.296 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.296 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.296 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:51.296 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.296 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:51.296 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:51.297 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:51.297 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:51.297 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:51.297 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:51.297 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:51.297 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:51.297 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:51.297 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f3358ff9640 10 monclient: _finish_auth 0 2026-02-12T18:14:51.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f3358ff9640 10 monclient: _check_auth_tickets 2026-02-12T18:14:51.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f3358ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:51.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f3358ff9640 1 -- 10.20.193.48:0/514966352 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f334800ccd0 con 0x7f335c05c950 2026-02-12T18:14:51.297 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f3358ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:51.298 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f3358ff9640 1 -- 10.20.193.48:0/514966352 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f334800ce40 con 0x7f335c05c950 2026-02-12T18:14:51.298 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f3358ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:51.298 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f3358ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:14:51.298 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f3358ff9640 10 monclient: dump: 2026-02-12T18:14:51.298 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:51.298 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.298 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.298 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.298 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:51.298 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.298 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:51.298 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:51.298 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:51.299 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:51.299 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:51.299 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:51.299 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:51.299 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:51.299 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:51.299 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.299 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f335a7fc640 4 set_mon_vals no callback set 2026-02-12T18:14:51.299 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f336274c640 5 monclient: authenticate success, global_id 104136 2026-02-12T18:14:51.299 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f336274c640 10 monclient: _renew_subs 2026-02-12T18:14:51.299 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f336274c640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:14:51.299 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f336274c640 1 -- 10.20.193.48:0/514966352 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f335c143cd0 con 0x7f335c05c950 2026-02-12T18:14:51.299 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f336274c640 10 monclient: _renew_subs 2026-02-12T18:14:51.299 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f336274c640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:14:51.299 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f336274c640 1 -- 10.20.193.48:0/514966352 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f335c142310 con 0x7f335c05c950 2026-02-12T18:14:51.300 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f336274c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:51.300 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f336274c640 1 --2- 10.20.193.48:0/514966352 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f335c08d900 0x7f335c13d270 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.300 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f336274c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.300 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.278+0000 7f336274c640 1 -- 10.20.193.48:0/514966352 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f335c05f140 con 0x7f335c08d900 2026-02-12T18:14:51.300 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.279+0000 7f335b7fe640 1 --2- 10.20.193.48:0/514966352 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f335c08d900 0x7f335c13d270 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.300 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.279+0000 7f335b7fe640 10 monclient: get_auth_request con 0x7f335c08d900 auth_method 0 2026-02-12T18:14:51.300 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.279+0000 7f335b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.300 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.279+0000 7f335b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.300 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.279+0000 7f335b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.300 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.279+0000 7f3358ff9640 1 -- 10.20.193.48:0/514966352 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f3348011070 con 0x7f335c05c950 2026-02-12T18:14:51.300 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.279+0000 7f335b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:51.300 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.279+0000 7f335b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:51.300 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.279+0000 7f335b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:51.300 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.279+0000 7f335b7fe640 10 monclient(hunting): handle_auth_done global_id 94742 payload 824 2026-02-12T18:14:51.300 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.279+0000 7f3358ff9640 1 --2- 10.20.193.48:0/514966352 >> v2:10.20.193.111:6812/977811348 conn(0x7f332c03f7f0 0x7f332c05fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.300 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.279+0000 7f335b7fe640 1 -- 10.20.193.48:0/514966352 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f335c097de0 con 0x7f335c08d900 2026-02-12T18:14:51.301 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.279+0000 7f3358ff9640 1 -- 10.20.193.48:0/514966352 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(317..317 src has 215..317) ==== 3897+0+0 (secure 0 0 0) 0x7f3348052b50 con 0x7f335c05c950 2026-02-12T18:14:51.301 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.279+0000 7f3360cc2640 1 --2- 10.20.193.48:0/514966352 >> v2:10.20.193.111:6812/977811348 conn(0x7f332c03f7f0 0x7f332c05fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.301 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.279+0000 7f3360cc2640 10 monclient: get_auth_request con 0x7f332c03f7f0 auth_method 0 2026-02-12T18:14:51.302 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[32453]: starting. 2026-02-12T18:14:51.302 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[32453]: creating pool ceph_test_rados_delete_pools_parallel.trial111-32452 2026-02-12T18:14:51.302 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[32453]: created object 0... 2026-02-12T18:14:51.302 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[32453]: created object 25... 2026-02-12T18:14:51.302 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[32453]: created object 49... 2026-02-12T18:14:51.302 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[32453]: finishing. 2026-02-12T18:14:51.302 INFO:teuthology.orchestra.run.trial111.stdout:process_1_[32453]: shutting down. 2026-02-12T18:14:51.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.281+0000 7f335b7fe640 1 -- 10.20.193.48:0/514966352 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f335c08d900 msgr2=0x7f335c13d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:51.304 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.281+0000 7f335b7fe640 1 --2- 10.20.193.48:0/514966352 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f335c08d900 0x7f335c13d270 secure :-1 s=READY pgs=122 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f334c009820 tx=0x7f334c0047e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:51.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.281+0000 7f3358ff9640 1 -- 10.20.193.48:0/514966352 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f334c035bf0 con 0x7f335c08d900 2026-02-12T18:14:51.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.281+0000 7f3358ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:51.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.281+0000 7f3358ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:14:51.305 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.281+0000 7f3358ff9640 10 monclient: dump: 2026-02-12T18:14:51.305 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:51.305 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.305 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.305 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.305 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:51.305 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.305 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:51.305 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:51.305 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:51.305 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:51.305 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:51.305 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:51.306 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:51.306 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:51.306 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:51.306 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.281+0000 7f3360cc2640 1 --2- 10.20.193.48:0/514966352 >> v2:10.20.193.111:6812/977811348 conn(0x7f332c03f7f0 0x7f332c05fca0 secure :-1 s=READY pgs=442 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f335c090cf0 tx=0x7f3350009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:51.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.281+0000 7f3358ff9640 1 -- 10.20.193.48:0/514966352 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f334c035d50 con 0x7f335c08d900 2026-02-12T18:14:51.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.281+0000 7f3358ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:51.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.281+0000 7f3358ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:14:51.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.281+0000 7f3358ff9640 1 -- 10.20.193.48:0/514966352 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f335c08d900 msgr2=0x7f335c13d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.281+0000 7f3358ff9640 1 --2- 10.20.193.48:0/514966352 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f335c08d900 0x7f335c13d270 secure :-1 s=READY pgs=122 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f334c009820 tx=0x7f334c0047e0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.281+0000 7f3358ff9640 1 -- 10.20.193.48:0/514966352 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f335c08d900 msgr2=0x7f335c13d270 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:51.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.281+0000 7f3358ff9640 1 --2- 10.20.193.48:0/514966352 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f335c08d900 0x7f335c13d270 secure :-1 s=CLOSED pgs=122 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f334c009820 tx=0x7f334c0047e0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.285+0000 7f336274c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:14:51.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.285+0000 7f336274c640 1 --2- 10.20.193.48:0/514966352 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f335c08ecf0 0x7f335c08f0f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.306 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.285+0000 7f336274c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.285+0000 7f336274c640 1 -- 10.20.193.48:0/514966352 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f335c05fd90 con 0x7f335c08ecf0 2026-02-12T18:14:51.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.285+0000 7f335b7fe640 1 --2- 10.20.193.48:0/514966352 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f335c08ecf0 0x7f335c08f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.285+0000 7f335b7fe640 10 monclient: get_auth_request con 0x7f335c08ecf0 auth_method 0 2026-02-12T18:14:51.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.285+0000 7f335b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.285+0000 7f335b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.285+0000 7f335b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.285+0000 7f335b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:51.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.285+0000 7f335b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:51.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.285+0000 7f335b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:51.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.286+0000 7f335b7fe640 10 monclient(hunting): handle_auth_done global_id 94751 payload 824 2026-02-12T18:14:51.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.286+0000 7f335b7fe640 1 -- 10.20.193.48:0/514966352 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f335c08a600 con 0x7f335c08ecf0 2026-02-12T18:14:51.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.288+0000 7f335b7fe640 1 -- 10.20.193.48:0/514966352 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f335c08ecf0 msgr2=0x7f335c08f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:51.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.288+0000 7f335b7fe640 1 --2- 10.20.193.48:0/514966352 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f335c08ecf0 0x7f335c08f0f0 secure :-1 s=READY pgs=123 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f334c004740 tx=0x7f334c004770 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:51.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.288+0000 7f3358ff9640 1 -- 10.20.193.48:0/514966352 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f334c051070 con 0x7f335c08ecf0 2026-02-12T18:14:51.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.288+0000 7f3358ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:51.307 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.288+0000 7f3358ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:14:51.308 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.288+0000 7f3358ff9640 10 monclient: dump: 2026-02-12T18:14:51.308 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:51.308 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.308 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.308 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.308 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:51.308 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.308 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:51.308 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:51.308 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:51.308 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:51.308 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:51.308 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:51.308 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:51.308 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:51.308 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:51.308 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.308 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.288+0000 7f3358ff9640 1 -- 10.20.193.48:0/514966352 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10182 (secure 0 0 0) 0x7f334c04ce40 con 0x7f335c08ecf0 2026-02-12T18:14:51.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.288+0000 7f3358ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:14:51.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.288+0000 7f3358ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:14:51.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.288+0000 7f3358ff9640 1 -- 10.20.193.48:0/514966352 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f335c08ecf0 msgr2=0x7f335c08f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.288+0000 7f3358ff9640 1 --2- 10.20.193.48:0/514966352 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f335c08ecf0 0x7f335c08f0f0 secure :-1 s=READY pgs=123 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f334c004740 tx=0x7f334c004770 comp rx=0 tx=0).stop 2026-02-12T18:14:51.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.288+0000 7f3358ff9640 1 -- 10.20.193.48:0/514966352 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f335c08ecf0 msgr2=0x7f335c08f0f0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:51.309 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.288+0000 7f3358ff9640 1 --2- 10.20.193.48:0/514966352 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f335c08ecf0 0x7f335c08f0f0 unknown :-1 s=CLOSED pgs=123 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.309 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:14:51.309 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:14:51.309 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:14:51.309 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:14:51.309 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 76, 2026-02-12T18:14:51.309 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 136962, 2026-02-12T18:14:51.309 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:14:51.310 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:14:51.310 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:14:51.310 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:14:51.310 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:14:51.310 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:14:51.310 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:14:51.310 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:14:51.310 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:14:51.310 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:14:51.310 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:51.310 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 5, 2026-02-12T18:14:51.310 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:51.310 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:14:51.310 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:14:51.310 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:51.310 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:51.310 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:51.311 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:51.311 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:51.311 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:51.311 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:51.311 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:51.311 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:51.311 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:51.311 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:51.311 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:51.311 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:51.311 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:51.311 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:14:51.311 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:14:51.311 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:51.311 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:51.311 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:51.311 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:51.311 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:51.312 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:51.312 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:51.312 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:51.312 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:51.312 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:51.312 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:51.312 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:51.312 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:51.312 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.312 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.312 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:14:51.312 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:14:51.312 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:14:51.312 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:14:51.312 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:14:51.312 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:14:51.312 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:51.312 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:51.312 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:14:51.312 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:14:51.313 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:14:51.313 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:14:51.313 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:14:51.313 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:14:51.313 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:14:51.313 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:51.313 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:14:51.313 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:51.313 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:51.313 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:51.313 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:51.313 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:51.313 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:51.313 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:51.313 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:51.313 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:51.313 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:51.313 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:51.313 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:51.313 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:51.314 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:51.314 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:14:51.314 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.314 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:14:51.314 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.314 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:14:51.314 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:14:51.314 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.314 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.314 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.314 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.314 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:14:51.314 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.314 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.314 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.314 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.314 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:14:51.314 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.314 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.314 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.315 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.315 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:14:51.315 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:14:51.315 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.315 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.315 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:14:51.315 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.315 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.315 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.315 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:14:51.315 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:14:51.315 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.315 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.315 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.315 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.315 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:14:51.315 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.315 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.315 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.315 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.315 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:14:51.315 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.316 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.316 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.316 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.316 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:14:51.316 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:14:51.316 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.316 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.316 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:14:51.316 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.316 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.316 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.316 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:14:51.316 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:14:51.316 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.316 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.316 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.316 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.316 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:14:51.316 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.316 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.316 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.316 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.316 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:14:51.317 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.317 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.317 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.317 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.317 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:14:51.317 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:14:51.317 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.317 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.317 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:14:51.317 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.317 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.317 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.317 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:14:51.317 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:14:51.317 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.317 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.317 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.317 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.317 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:14:51.317 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.317 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.317 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.317 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.318 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:14:51.318 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.318 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.318 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.318 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.318 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:14:51.318 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:14:51.318 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.318 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.318 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:14:51.318 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.318 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.318 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.318 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:14:51.318 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:14:51.318 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.318 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.318 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.318 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.318 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:14:51.318 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.318 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.318 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.318 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.319 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:14:51.319 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.319 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.319 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.319 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.319 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:14:51.319 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:14:51.319 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.319 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.319 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:51.319 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.319 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.319 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.319 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:14:51.319 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:14:51.319 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.319 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.319 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.319 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.319 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:14:51.319 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.319 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.319 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.320 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.320 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:14:51.320 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.320 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.320 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.320 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.320 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:14:51.320 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:14:51.320 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.320 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.320 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:14:51.320 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.320 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.320 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.320 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:14:51.320 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:14:51.320 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.320 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.320 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.320 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.320 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:14:51.320 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.320 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.320 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.321 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.321 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:14:51.321 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.321 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.321 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.321 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.321 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:14:51.321 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:14:51.321 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.321 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.321 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:51.321 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.321 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.321 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.321 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:14:51.321 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:14:51.321 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.321 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.321 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.321 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.321 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:14:51.321 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.321 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.321 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.322 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.322 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:14:51.322 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.322 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.322 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.322 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.322 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:14:51.322 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:14:51.322 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.322 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.322 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:14:51.322 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.322 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.322 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.322 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:14:51.322 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:14:51.322 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.322 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.322 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.322 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.322 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:14:51.322 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.322 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.322 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.322 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.323 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:14:51.323 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.323 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.323 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.323 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.323 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:14:51.323 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:14:51.323 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.323 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.323 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:14:51.323 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.323 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.323 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.323 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.323 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:14:51.323 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:14:51.323 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.323 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:51.323 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:51.323 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:51.323 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.323 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:51.323 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:14:51.323 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.323 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:51.324 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:51.324 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:51.324 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.324 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:51.324 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:14:51.324 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.324 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:51.324 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:51.324 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:14:51.324 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.324 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.324 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.324 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:14:51.324 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:14:51.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.288+0000 7f336274c640 1 -- 10.20.193.48:0/514966352 >> v2:10.20.193.111:6812/977811348 conn(0x7f332c03f7f0 msgr2=0x7f332c05fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.288+0000 7f336274c640 1 --2- 10.20.193.48:0/514966352 >> v2:10.20.193.111:6812/977811348 conn(0x7f332c03f7f0 0x7f332c05fca0 secure :-1 s=READY pgs=442 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f335c090cf0 tx=0x7f3350009040 comp rx=0 tx=0).stop 2026-02-12T18:14:51.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.288+0000 7f336274c640 10 monclient: shutdown 2026-02-12T18:14:51.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.288+0000 7f336274c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:51.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.288+0000 7f336274c640 1 -- 10.20.193.48:0/514966352 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f335c05c950 msgr2=0x7f335c12cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.288+0000 7f336274c640 1 --2- 10.20.193.48:0/514966352 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f335c05c950 0x7f335c12cab0 secure :-1 s=READY pgs=16 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f33480093f0 tx=0x7f334800ed50 comp rx=0 tx=0).stop 2026-02-12T18:14:51.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.288+0000 7f3360cc2640 1 -- 10.20.193.48:0/514966352 reap_dead start 2026-02-12T18:14:51.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.288+0000 7f3360cc2640 1 -- 10.20.193.48:0/514966352 reap_dead start 2026-02-12T18:14:51.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.288+0000 7f336274c640 1 -- 10.20.193.48:0/514966352 shutdown_connections 2026-02-12T18:14:51.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.288+0000 7f336274c640 1 -- 10.20.193.48:0/514966352 >> 10.20.193.48:0/514966352 conn(0x7f335c0548a0 msgr2=0x7f335c093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:51.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.288+0000 7f336274c640 1 -- 10.20.193.48:0/514966352 shutdown_connections 2026-02-12T18:14:51.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.288+0000 7f336274c640 1 -- 10.20.193.48:0/514966352 wait complete. 2026-02-12T18:14:51.326 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:14:51.326 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2026-02-12T18:14:51.326 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2026-02-12T18:14:51.393 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.392+0000 7ff922f94640 10 monclient: get_monmap_and_config 2026-02-12T18:14:51.394 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.392+0000 7ff922f94640 10 monclient: build_initial_monmap 2026-02-12T18:14:51.394 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.392+0000 7ff922f94640 10 monclient: monmap: 2026-02-12T18:14:51.394 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:51.394 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.394 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:14:51.393484+0000 2026-02-12T18:14:51.394 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:14:51.393484+0000 2026-02-12T18:14:51.394 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:51.394 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.394 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:14:51.394 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:14:51.395 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:51.395 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:51.395 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:51.395 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:51.395 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:51.395 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:51.395 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:51.395 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:14:51.395 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:14:51.395 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.397 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff922f94640 1 Processor -- start 2026-02-12T18:14:51.397 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff922f94640 1 -- start start 2026-02-12T18:14:51.397 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff922f94640 10 monclient: init 2026-02-12T18:14:51.397 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff922f94640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:51.397 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff922f94640 10 monclient: _add_conns ranks=[7,6,3,8,0,5,4,9,10,1,2] 2026-02-12T18:14:51.397 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff922f94640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ff91c0951a0 0x7ff91c093850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.397 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff922f94640 10 monclient(hunting): picked mon.noname-i con 0x7ff91c0951a0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:14:51.397 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff922f94640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff91c096ad0 0x7ff91c095570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.397 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff922f94640 10 monclient(hunting): picked mon.noname-d con 0x7ff91c096ad0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:14:51.397 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff922f94640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff91c095ab0 0x7ff91c1a4ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.397 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff922f94640 10 monclient(hunting): picked mon.noname-g con 0x7ff91c095ab0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:14:51.397 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff922f94640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff922f94640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff91c096900 con 0x7ff91c095ab0 2026-02-12T18:14:51.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff922f94640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff922f94640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7ff91c092260 con 0x7ff91c096ad0 2026-02-12T18:14:51.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff922f94640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff922f94640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7ff91c093070 con 0x7ff91c0951a0 2026-02-12T18:14:51.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff922f94640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:51.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff922f94640 10 monclient(hunting): authenticate will time out at 1130.119515s 2026-02-12T18:14:51.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff913fff640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff91c096ad0 0x7ff91c095570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff913fff640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff91c096ad0 0x7ff91c095570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:35942/0 (socket says 10.20.193.48:35942) 2026-02-12T18:14:51.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff913fff640 1 -- 10.20.193.48:0/3234824754 learned_addr learned my addr 10.20.193.48:0/3234824754 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:51.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff913fff640 10 monclient(hunting): get_auth_request con 0x7ff91c096ad0 auth_method 0 2026-02-12T18:14:51.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff913fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff913fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff913fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff920d09640 1 --2- 10.20.193.48:0/3234824754 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ff91c0951a0 0x7ff91c093850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff920d09640 10 monclient(hunting): get_auth_request con 0x7ff91c0951a0 auth_method 0 2026-02-12T18:14:51.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff920d09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff920d09640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff920d09640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff913fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:51.398 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff913fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:51.399 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff913fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:51.399 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff92150a640 1 --2- 10.20.193.48:0/3234824754 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff91c095ab0 0x7ff91c1a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.399 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff92150a640 10 monclient(hunting): get_auth_request con 0x7ff91c095ab0 auth_method 0 2026-02-12T18:14:51.399 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff92150a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.399 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff92150a640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.399 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff92150a640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.399 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff913fff640 10 monclient(hunting): handle_auth_done global_id 104145 payload 274 2026-02-12T18:14:51.399 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff913fff640 1 -- 10.20.193.48:0/3234824754 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ff91c0951a0 msgr2=0x7ff91c093850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:51.399 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff913fff640 1 --2- 10.20.193.48:0/3234824754 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ff91c0951a0 0x7ff91c093850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.399 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff913fff640 1 -- 10.20.193.48:0/3234824754 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff91c095ab0 msgr2=0x7ff91c1a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:51.399 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff913fff640 1 --2- 10.20.193.48:0/3234824754 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff91c095ab0 0x7ff91c1a4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.399 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff913fff640 10 monclient: _finish_hunting 0 2026-02-12T18:14:51.399 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff913fff640 1 monclient: found mon.noname-d 2026-02-12T18:14:51.399 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff913fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:51.399 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff913fff640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:14:51.399 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff913fff640 1 -- 10.20.193.48:0/3234824754 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff91c04dc20 con 0x7ff91c096ad0 2026-02-12T18:14:51.399 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.393+0000 7ff920d09640 1 --2- 10.20.193.48:0/3234824754 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ff91c0951a0 0x7ff91c093850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:14:51.404 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.396+0000 7ff913fff640 1 -- 10.20.193.48:0/3234824754 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff91c096ad0 msgr2=0x7ff91c095570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:51.404 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.396+0000 7ff913fff640 1 --2- 10.20.193.48:0/3234824754 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff91c096ad0 0x7ff91c095570 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=18343984744644666111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff904009900 tx=0x7ff90402ee10 comp rx=0 tx=0).ready entity=mon.6 client_cookie=fe92ecef45bae2ff server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:51.404 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.396+0000 7ff9137fe640 1 -- 10.20.193.48:0/3234824754 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff904035340 con 0x7ff91c096ad0 2026-02-12T18:14:51.404 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.396+0000 7ff9137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:51.404 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.396+0000 7ff9137fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:14:51.404 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.396+0000 7ff9137fe640 10 monclient: dump: 2026-02-12T18:14:51.404 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:51.404 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.404 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.404 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.404 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:51.404 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.404 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:51.404 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:51.404 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:51.405 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:51.405 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:51.405 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:51.405 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:51.405 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:51.405 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:51.405 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.396+0000 7ff9137fe640 10 monclient: _finish_auth 0 2026-02-12T18:14:51.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.396+0000 7ff9137fe640 10 monclient: _check_auth_tickets 2026-02-12T18:14:51.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.396+0000 7ff9137fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:51.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.396+0000 7ff9137fe640 1 -- 10.20.193.48:0/3234824754 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9040354c0 con 0x7ff91c096ad0 2026-02-12T18:14:51.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.396+0000 7ff9137fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:51.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.396+0000 7ff9137fe640 1 -- 10.20.193.48:0/3234824754 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff904035af0 con 0x7ff91c096ad0 2026-02-12T18:14:51.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.396+0000 7ff922f94640 5 monclient: authenticate success, global_id 104145 2026-02-12T18:14:51.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.396+0000 7ff922f94640 10 monclient: get_monmap_and_config success 2026-02-12T18:14:51.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.396+0000 7ff922f94640 4 set_mon_vals no callback set 2026-02-12T18:14:51.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.396+0000 7ff9137fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:51.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.396+0000 7ff9137fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:14:51.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.396+0000 7ff9137fe640 10 monclient: dump: 2026-02-12T18:14:51.405 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:51.405 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.406 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.406 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.406 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:51.406 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.406 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:51.406 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:51.406 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:51.406 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:51.406 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:51.406 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:51.406 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:51.406 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:51.406 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:51.406 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.406 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.396+0000 7ff922f94640 10 monclient: shutdown 2026-02-12T18:14:51.406 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.396+0000 7ff922f94640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:51.406 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.396+0000 7ff922f94640 1 -- 10.20.193.48:0/3234824754 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff91c096ad0 msgr2=0x7ff91c095570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.406 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.396+0000 7ff922f94640 1 --2- 10.20.193.48:0/3234824754 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff91c096ad0 0x7ff91c095570 secure :-1 s=READY pgs=17 gs=1 cs=0 l=1 c_cookie=18343984744644666111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff904009900 tx=0x7ff90402ee10 comp rx=0 tx=0).stop 2026-02-12T18:14:51.406 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.397+0000 7ff922f94640 1 -- 10.20.193.48:0/3234824754 shutdown_connections 2026-02-12T18:14:51.406 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.397+0000 7ff922f94640 1 --2- 10.20.193.48:0/3234824754 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff91c095ab0 0x7ff91c1a4ba0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.407 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.397+0000 7ff922f94640 1 --2- 10.20.193.48:0/3234824754 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff91c096ad0 0x7ff91c095570 unknown :-1 s=CLOSED pgs=17 gs=1 cs=0 l=1 c_cookie=18343984744644666111 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.407 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.397+0000 7ff922f94640 1 --2- 10.20.193.48:0/3234824754 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ff91c0951a0 0x7ff91c093850 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.407 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.397+0000 7ff922f94640 1 -- 10.20.193.48:0/3234824754 >> 10.20.193.48:0/3234824754 conn(0x7ff91c0548c0 msgr2=0x7ff91c0973a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:51.407 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.397+0000 7ff922f94640 1 -- 10.20.193.48:0/3234824754 shutdown_connections 2026-02-12T18:14:51.407 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.397+0000 7ff922f94640 1 -- 10.20.193.48:0/3234824754 wait complete. 2026-02-12T18:14:51.407 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.397+0000 7ff922f94640 10 monclient: build_initial_monmap 2026-02-12T18:14:51.407 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.397+0000 7ff922f94640 10 monclient: monmap: 2026-02-12T18:14:51.407 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:51.407 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:14:51.407 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:14:51.407 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:14:51.407 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:51.407 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.407 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:14:51.407 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:14:51.407 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:51.407 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:51.407 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:51.407 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:51.407 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:51.407 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:51.408 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:51.408 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.397+0000 7ff922f94640 1 Processor -- start 2026-02-12T18:14:51.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.397+0000 7ff922f94640 1 -- start start 2026-02-12T18:14:51.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.397+0000 7ff922f94640 10 monclient: init 2026-02-12T18:14:51.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff922f94640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:51.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff922f94640 10 monclient: _add_conns ranks=[2,5,1,3,0,4,6,8,7] 2026-02-12T18:14:51.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff922f94640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff91c0951a0 0x7ff91c1daf40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff922f94640 10 monclient(hunting): picked mon.noname-b con 0x7ff91c0951a0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:14:51.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff922f94640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff91c095ab0 0x7ff91c1b0c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff922f94640 10 monclient(hunting): picked mon.noname-h con 0x7ff91c095ab0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:14:51.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff922f94640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff91c096ad0 0x7ff91c198810 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff922f94640 10 monclient(hunting): picked mon.noname-f con 0x7ff91c096ad0 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:14:51.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff922f94640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff922f94640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff91c08d090 con 0x7ff91c096ad0 2026-02-12T18:14:51.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff922f94640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff922f94640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7ff91c1db480 con 0x7ff91c0951a0 2026-02-12T18:14:51.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff922f94640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff922f94640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7ff91c090070 con 0x7ff91c095ab0 2026-02-12T18:14:51.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff922f94640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:51.409 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff922f94640 10 monclient(hunting): authenticate will time out at 1130.124138s 2026-02-12T18:14:51.409 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff920d09640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff91c0951a0 0x7ff91c1daf40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.409 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff920d09640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff91c0951a0 0x7ff91c1daf40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:58686/0 (socket says 10.20.193.48:58686) 2026-02-12T18:14:51.409 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff920d09640 1 -- 10.20.193.48:0/384357817 learned_addr learned my addr 10.20.193.48:0/384357817 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:51.409 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff920d09640 10 monclient(hunting): get_auth_request con 0x7ff91c0951a0 auth_method 0 2026-02-12T18:14:51.409 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff920d09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.409 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff920d09640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.409 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff920d09640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.409 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff920d09640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:51.409 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff920d09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:51.409 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff920d09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:51.409 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff92150a640 1 --2- 10.20.193.48:0/384357817 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff91c096ad0 0x7ff91c198810 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.409 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff92150a640 10 monclient(hunting): get_auth_request con 0x7ff91c096ad0 auth_method 0 2026-02-12T18:14:51.409 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff92150a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.409 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff92150a640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.409 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff92150a640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.409 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff913fff640 1 --2- 10.20.193.48:0/384357817 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff91c095ab0 0x7ff91c1b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.409 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff913fff640 10 monclient(hunting): get_auth_request con 0x7ff91c095ab0 auth_method 0 2026-02-12T18:14:51.409 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff913fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.409 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff913fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.409 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff913fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.410 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff92150a640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:51.410 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff92150a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:51.410 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff92150a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:51.410 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff920d09640 10 monclient(hunting): handle_auth_done global_id 36461 payload 824 2026-02-12T18:14:51.410 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff920d09640 1 -- 10.20.193.48:0/384357817 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff91c095ab0 msgr2=0x7ff91c1b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.410 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff920d09640 1 --2- 10.20.193.48:0/384357817 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff91c095ab0 0x7ff91c1b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.410 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff920d09640 1 -- 10.20.193.48:0/384357817 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff91c096ad0 msgr2=0x7ff91c198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.410 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff920d09640 1 --2- 10.20.193.48:0/384357817 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff91c096ad0 0x7ff91c198810 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.410 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff920d09640 10 monclient: _finish_hunting 0 2026-02-12T18:14:51.410 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff920d09640 1 monclient: found mon.noname-b 2026-02-12T18:14:51.410 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff920d09640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:51.410 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff920d09640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:14:51.410 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.398+0000 7ff920d09640 1 -- 10.20.193.48:0/384357817 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9040094f0 con 0x7ff91c0951a0 2026-02-12T18:14:51.410 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.400+0000 7ff920d09640 1 -- 10.20.193.48:0/384357817 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff91c0951a0 msgr2=0x7ff91c1daf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:51.410 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.400+0000 7ff920d09640 1 --2- 10.20.193.48:0/384357817 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff91c0951a0 0x7ff91c1daf40 secure :-1 s=READY pgs=389 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff90c00e7c0 tx=0x7ff90c00ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:51.410 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.400+0000 7ff9117fa640 1 -- 10.20.193.48:0/384357817 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff90c00ee90 con 0x7ff91c0951a0 2026-02-12T18:14:51.410 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.400+0000 7ff9117fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:51.410 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.400+0000 7ff9117fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:14:51.410 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.400+0000 7ff9117fa640 10 monclient: dump: 2026-02-12T18:14:51.410 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:51.410 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.410 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.411 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.411 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:51.411 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.411 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:51.411 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:51.411 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:51.411 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:51.411 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:51.411 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:51.411 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:51.411 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:51.411 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:51.411 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.411 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.400+0000 7ff9117fa640 10 monclient: _finish_auth 0 2026-02-12T18:14:51.411 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.400+0000 7ff9117fa640 10 monclient: _check_auth_tickets 2026-02-12T18:14:51.411 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.400+0000 7ff9117fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:51.411 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.400+0000 7ff9117fa640 1 -- 10.20.193.48:0/384357817 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff90c0044f0 con 0x7ff91c0951a0 2026-02-12T18:14:51.411 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.400+0000 7ff922f94640 5 monclient: authenticate success, global_id 36461 2026-02-12T18:14:51.411 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.400+0000 7ff922f94640 10 monclient: _renew_subs 2026-02-12T18:14:51.411 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.400+0000 7ff922f94640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:14:51.411 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.400+0000 7ff922f94640 1 -- 10.20.193.48:0/384357817 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff91c19c350 con 0x7ff91c0951a0 2026-02-12T18:14:51.412 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.400+0000 7ff9117fa640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:51.412 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.400+0000 7ff9117fa640 1 -- 10.20.193.48:0/384357817 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff90c00cda0 con 0x7ff91c0951a0 2026-02-12T18:14:51.412 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.400+0000 7ff9117fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:51.412 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.400+0000 7ff9117fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:14:51.412 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.400+0000 7ff912ffd640 4 set_mon_vals no callback set 2026-02-12T18:14:51.412 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.400+0000 7ff9117fa640 10 monclient: dump: 2026-02-12T18:14:51.412 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:51.412 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.412 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.412 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.412 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:51.412 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.412 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:51.412 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:51.412 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:51.412 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:51.412 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:51.412 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:51.412 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:51.412 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:51.412 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:51.412 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.400+0000 7ff922f94640 10 monclient: _renew_subs 2026-02-12T18:14:51.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.400+0000 7ff922f94640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:14:51.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.400+0000 7ff922f94640 1 -- 10.20.193.48:0/384357817 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff91c19b510 con 0x7ff91c0951a0 2026-02-12T18:14:51.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.401+0000 7ff922f94640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:51.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.401+0000 7ff922f94640 1 --2- 10.20.193.48:0/384357817 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff91c19ae30 0x7ff91c198d50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.401+0000 7ff922f94640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.401+0000 7ff922f94640 1 -- 10.20.193.48:0/384357817 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff91c05f140 con 0x7ff91c19ae30 2026-02-12T18:14:51.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.401+0000 7ff9117fa640 1 -- 10.20.193.48:0/384357817 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7ff90c00c8e0 con 0x7ff91c0951a0 2026-02-12T18:14:51.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.401+0000 7ff913fff640 1 --2- 10.20.193.48:0/384357817 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff91c19ae30 0x7ff91c198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.401+0000 7ff913fff640 10 monclient: get_auth_request con 0x7ff91c19ae30 auth_method 0 2026-02-12T18:14:51.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.401+0000 7ff913fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.401+0000 7ff913fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.401+0000 7ff913fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.401+0000 7ff9117fa640 1 --2- 10.20.193.48:0/384357817 >> v2:10.20.193.111:6812/977811348 conn(0x7ff8ec03f800 0x7ff8ec05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.401+0000 7ff9117fa640 1 -- 10.20.193.48:0/384357817 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(317..317 src has 215..317) ==== 3897+0+0 (secure 0 0 0) 0x7ff90c052b00 con 0x7ff91c0951a0 2026-02-12T18:14:51.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.401+0000 7ff913fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:51.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.401+0000 7ff913fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:51.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.401+0000 7ff913fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:51.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.401+0000 7ff92150a640 1 --2- 10.20.193.48:0/384357817 >> v2:10.20.193.111:6812/977811348 conn(0x7ff8ec03f800 0x7ff8ec05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.401+0000 7ff92150a640 10 monclient: get_auth_request con 0x7ff8ec03f800 auth_method 0 2026-02-12T18:14:51.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.402+0000 7ff913fff640 10 monclient(hunting): handle_auth_done global_id 94843 payload 824 2026-02-12T18:14:51.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.402+0000 7ff913fff640 1 -- 10.20.193.48:0/384357817 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff91c095f20 con 0x7ff91c19ae30 2026-02-12T18:14:51.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.404+0000 7ff92150a640 1 --2- 10.20.193.48:0/384357817 >> v2:10.20.193.111:6812/977811348 conn(0x7ff8ec03f800 0x7ff8ec05fcb0 secure :-1 s=READY pgs=443 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff91c096350 tx=0x7ff918009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:51.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.404+0000 7ff913fff640 1 -- 10.20.193.48:0/384357817 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff91c19ae30 msgr2=0x7ff91c198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:51.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.404+0000 7ff913fff640 1 --2- 10.20.193.48:0/384357817 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff91c19ae30 0x7ff91c198d50 secure :-1 s=READY pgs=153 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff904009900 tx=0x7ff904004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:51.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.404+0000 7ff9117fa640 1 -- 10.20.193.48:0/384357817 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff904035de0 con 0x7ff91c19ae30 2026-02-12T18:14:51.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.404+0000 7ff9117fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:51.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.404+0000 7ff9117fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:14:51.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.404+0000 7ff9117fa640 10 monclient: dump: 2026-02-12T18:14:51.416 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:51.416 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.416 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.416 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.416 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:51.416 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.416 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:51.416 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:51.416 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:51.416 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:51.416 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:51.416 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:51.416 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:51.416 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:51.416 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:51.416 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.404+0000 7ff9117fa640 1 -- 10.20.193.48:0/384357817 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7ff904037440 con 0x7ff91c19ae30 2026-02-12T18:14:51.417 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.404+0000 7ff9117fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:51.417 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.404+0000 7ff9117fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:14:51.417 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.404+0000 7ff9117fa640 1 -- 10.20.193.48:0/384357817 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff91c19ae30 msgr2=0x7ff91c198d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.417 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.404+0000 7ff9117fa640 1 --2- 10.20.193.48:0/384357817 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff91c19ae30 0x7ff91c198d50 secure :-1 s=READY pgs=153 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff904009900 tx=0x7ff904004770 comp rx=0 tx=0).stop 2026-02-12T18:14:51.417 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.404+0000 7ff9117fa640 1 -- 10.20.193.48:0/384357817 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff91c19ae30 msgr2=0x7ff91c198d50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:51.417 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.404+0000 7ff9117fa640 1 --2- 10.20.193.48:0/384357817 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff91c19ae30 0x7ff91c198d50 secure :-1 s=CLOSED pgs=153 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff904009900 tx=0x7ff904004770 comp rx=0 tx=0).stop 2026-02-12T18:14:51.417 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.408+0000 7ff922f94640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:14:51.417 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.408+0000 7ff922f94640 1 --2- 10.20.193.48:0/384357817 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff91c1b11d0 0x7ff91c199290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.417 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.408+0000 7ff922f94640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.417 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.408+0000 7ff922f94640 1 -- 10.20.193.48:0/384357817 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff91c05fd90 con 0x7ff91c1b11d0 2026-02-12T18:14:51.417 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.408+0000 7ff913fff640 1 --2- 10.20.193.48:0/384357817 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff91c1b11d0 0x7ff91c199290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.417 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.408+0000 7ff913fff640 10 monclient: get_auth_request con 0x7ff91c1b11d0 auth_method 0 2026-02-12T18:14:51.417 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.408+0000 7ff913fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.417 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.408+0000 7ff913fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.417 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.408+0000 7ff913fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.417 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.408+0000 7ff913fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:51.417 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.408+0000 7ff913fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:51.417 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.408+0000 7ff913fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:51.417 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.408+0000 7ff913fff640 10 monclient(hunting): handle_auth_done global_id 94852 payload 824 2026-02-12T18:14:51.417 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.408+0000 7ff913fff640 1 -- 10.20.193.48:0/384357817 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff91c05dc10 con 0x7ff91c1b11d0 2026-02-12T18:14:51.417 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.411+0000 7ff913fff640 1 -- 10.20.193.48:0/384357817 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff91c1b11d0 msgr2=0x7ff91c199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:51.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.411+0000 7ff913fff640 1 --2- 10.20.193.48:0/384357817 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff91c1b11d0 0x7ff91c199290 secure :-1 s=READY pgs=154 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9040098d0 tx=0x7ff9040092c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:51.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.411+0000 7ff9117fa640 1 -- 10.20.193.48:0/384357817 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff90404d500 con 0x7ff91c1b11d0 2026-02-12T18:14:51.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.411+0000 7ff9117fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:51.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.411+0000 7ff9117fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:14:51.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.411+0000 7ff9117fa640 10 monclient: dump: 2026-02-12T18:14:51.418 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:51.418 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.418 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.418 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.418 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:51.418 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.418 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:51.418 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:51.418 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:51.418 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:51.418 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:51.418 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:51.418 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:51.418 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:51.418 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:51.418 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.411+0000 7ff9117fa640 1 -- 10.20.193.48:0/384357817 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10182 (secure 0 0 0) 0x7ff90404d660 con 0x7ff91c1b11d0 2026-02-12T18:14:51.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.411+0000 7ff9117fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:14:51.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.411+0000 7ff9117fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:14:51.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.411+0000 7ff9117fa640 1 -- 10.20.193.48:0/384357817 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff91c1b11d0 msgr2=0x7ff91c199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.411+0000 7ff9117fa640 1 --2- 10.20.193.48:0/384357817 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff91c1b11d0 0x7ff91c199290 secure :-1 s=READY pgs=154 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9040098d0 tx=0x7ff9040092c0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.411+0000 7ff9117fa640 1 -- 10.20.193.48:0/384357817 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff91c1b11d0 msgr2=0x7ff91c199290 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:51.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.411+0000 7ff9117fa640 1 --2- 10.20.193.48:0/384357817 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff91c1b11d0 0x7ff91c199290 secure :-1 s=CLOSED pgs=154 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff9040098d0 tx=0x7ff9040092c0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.419 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:14:51.419 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:14:51.419 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:14:51.419 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:14:51.419 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 76, 2026-02-12T18:14:51.419 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 137085, 2026-02-12T18:14:51.419 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:14:51.419 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:14:51.420 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:14:51.420 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:14:51.420 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:14:51.420 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:14:51.420 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:14:51.420 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:14:51.420 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:14:51.420 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:14:51.420 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:51.420 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 5, 2026-02-12T18:14:51.420 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:51.420 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:14:51.420 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:14:51.420 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:51.420 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:51.420 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:51.420 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:51.420 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:51.420 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:51.420 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:51.421 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:51.421 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:51.421 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:51.421 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:51.421 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:51.421 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:51.421 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:51.421 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:14:51.421 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:14:51.421 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:51.421 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:51.421 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:51.421 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:51.421 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:51.421 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:51.421 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:51.421 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:51.421 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:51.421 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:51.421 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:51.421 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:51.422 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:51.422 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.422 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.422 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:14:51.422 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:14:51.422 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:14:51.422 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:14:51.422 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:14:51.422 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:14:51.422 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:51.422 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:51.422 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:14:51.422 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:14:51.422 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:14:51.422 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:14:51.422 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:14:51.422 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:14:51.422 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:14:51.422 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:51.422 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:14:51.422 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:51.423 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:51.423 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:51.423 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:51.423 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:51.423 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:51.423 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:51.423 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:51.423 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:51.423 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:51.423 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:51.423 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:51.423 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:51.423 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:51.423 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:14:51.423 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.423 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:14:51.423 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.423 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:14:51.423 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:14:51.423 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.423 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.423 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.424 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.424 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:14:51.424 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.424 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.424 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.424 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.424 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:14:51.424 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.424 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.424 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.424 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.424 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:14:51.424 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:14:51.424 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.424 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.424 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:14:51.424 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.424 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.424 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.424 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:14:51.424 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:14:51.424 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.425 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.425 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.425 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.425 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:14:51.425 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.425 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.425 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.425 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.425 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:14:51.425 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.425 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.425 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.425 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.425 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:14:51.425 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:14:51.425 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.425 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.425 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:14:51.425 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.425 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.425 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.425 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:14:51.426 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:14:51.426 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.426 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.426 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.426 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.426 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:14:51.426 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.426 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.426 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.426 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.426 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:14:51.426 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.426 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.426 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.426 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.426 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:14:51.426 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:14:51.426 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.426 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.426 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:14:51.426 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.426 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.426 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.427 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:14:51.427 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:14:51.427 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.427 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.427 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.427 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.427 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:14:51.427 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.427 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.427 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.427 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.427 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:14:51.427 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.427 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.427 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.427 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.427 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:14:51.427 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:14:51.427 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.427 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.427 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:14:51.427 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.427 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.428 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.428 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:14:51.428 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:14:51.428 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.428 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.428 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.428 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.428 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:14:51.428 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.428 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.428 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.428 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.428 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:14:51.428 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.428 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.428 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.428 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.428 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:14:51.428 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:14:51.428 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.428 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.428 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:51.428 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.428 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.428 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.429 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:14:51.429 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:14:51.429 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.429 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.429 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.429 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.429 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:14:51.429 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.429 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.429 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.429 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.429 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:14:51.429 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.429 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.429 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.429 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.429 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:14:51.429 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:14:51.429 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.429 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.429 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:14:51.429 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.429 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.429 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.429 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:14:51.430 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:14:51.430 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.430 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.430 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.430 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.430 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:14:51.430 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.430 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.430 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.430 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.430 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:14:51.430 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.430 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.430 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.430 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.430 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:14:51.430 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:14:51.430 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.430 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.430 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:51.430 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.430 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.430 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.430 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:14:51.430 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:14:51.430 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.431 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.431 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.431 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.431 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:14:51.431 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.431 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.431 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.431 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.431 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:14:51.431 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.431 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.431 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.431 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.431 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:14:51.431 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:14:51.431 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.431 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.431 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:14:51.431 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.431 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.431 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.431 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:14:51.431 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:14:51.431 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.431 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:51.432 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:51.433 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.433 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:51.433 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:14:51.433 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.433 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:51.433 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:51.433 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:51.433 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.433 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:51.433 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:14:51.433 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.433 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:51.433 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:51.433 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:14:51.433 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.433 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.433 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.433 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:14:51.433 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:14:51.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.411+0000 7ff922f94640 1 -- 10.20.193.48:0/384357817 >> v2:10.20.193.111:6812/977811348 conn(0x7ff8ec03f800 msgr2=0x7ff8ec05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.411+0000 7ff922f94640 1 --2- 10.20.193.48:0/384357817 >> v2:10.20.193.111:6812/977811348 conn(0x7ff8ec03f800 0x7ff8ec05fcb0 secure :-1 s=READY pgs=443 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff91c096350 tx=0x7ff918009040 comp rx=0 tx=0).stop 2026-02-12T18:14:51.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.411+0000 7ff922f94640 10 monclient: shutdown 2026-02-12T18:14:51.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.411+0000 7ff922f94640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:51.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.411+0000 7ff922f94640 1 -- 10.20.193.48:0/384357817 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff91c0951a0 msgr2=0x7ff91c1daf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.411+0000 7ff922f94640 1 --2- 10.20.193.48:0/384357817 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff91c0951a0 0x7ff91c1daf40 secure :-1 s=READY pgs=389 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff90c00e7c0 tx=0x7ff90c00ec90 comp rx=0 tx=0).stop 2026-02-12T18:14:51.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.411+0000 7ff92150a640 1 -- 10.20.193.48:0/384357817 reap_dead start 2026-02-12T18:14:51.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.411+0000 7ff922f94640 1 -- 10.20.193.48:0/384357817 shutdown_connections 2026-02-12T18:14:51.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.411+0000 7ff922f94640 1 --2- 10.20.193.48:0/384357817 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff91c0951a0 0x7ff91c1daf40 unknown :-1 s=CLOSED pgs=389 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.412+0000 7ff922f94640 1 -- 10.20.193.48:0/384357817 >> 10.20.193.48:0/384357817 conn(0x7ff91c0548c0 msgr2=0x7ff91c08f730 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:51.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.412+0000 7ff922f94640 1 -- 10.20.193.48:0/384357817 shutdown_connections 2026-02-12T18:14:51.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.412+0000 7ff922f94640 1 -- 10.20.193.48:0/384357817 wait complete. 2026-02-12T18:14:51.435 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:14:51.435 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2026-02-12T18:14:51.435 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2026-02-12T18:14:51.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.500+0000 7f58b74cc640 10 monclient: get_monmap_and_config 2026-02-12T18:14:51.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.500+0000 7f58b74cc640 10 monclient: build_initial_monmap 2026-02-12T18:14:51.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.500+0000 7f58b74cc640 10 monclient: monmap: 2026-02-12T18:14:51.502 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:51.502 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.502 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:14:51.501301+0000 2026-02-12T18:14:51.502 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:14:51.501301+0000 2026-02-12T18:14:51.502 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:51.502 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.502 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:14:51.503 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:14:51.503 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:51.503 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:51.503 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:51.503 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:51.503 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:51.503 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:51.503 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:51.503 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:14:51.503 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:14:51.503 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.500+0000 7f58b74cc640 1 Processor -- start 2026-02-12T18:14:51.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.500+0000 7f58b74cc640 1 -- start start 2026-02-12T18:14:51.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.500+0000 7f58b74cc640 10 monclient: init 2026-02-12T18:14:51.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.500+0000 7f58b74cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:51.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.500+0000 7f58b74cc640 10 monclient: _add_conns ranks=[3,0,6,5,8,10,4,7,9,1,2] 2026-02-12T18:14:51.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.500+0000 7f58b74cc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f58b005c950 0x7f58b005cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.500+0000 7f58b74cc640 10 monclient(hunting): picked mon.noname-g con 0x7f58b005c950 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:14:51.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.500+0000 7f58b74cc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f58b005e490 addr v1:10.20.193.48:6789/0 2026-02-12T18:14:51.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.500+0000 7f58b74cc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f58b005d260 0x7f58b013e280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.500+0000 7f58b74cc640 10 monclient(hunting): picked mon.noname-d con 0x7f58b005d260 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:14:51.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.500+0000 7f58b74cc640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b004dc20 con 0x7f58b005e490 2026-02-12T18:14:51.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.500+0000 7f58b74cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.500+0000 7f58b74cc640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f58b005ddd0 con 0x7f58b005c950 2026-02-12T18:14:51.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.500+0000 7f58b74cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.500+0000 7f58b74cc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f58b0092990 con 0x7f58b005d260 2026-02-12T18:14:51.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b74cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:51.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b74cc640 10 monclient(hunting): authenticate will time out at 1130.227004s 2026-02-12T18:14:51.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b5a42640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f58b005d260 0x7f58b013e280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b5241640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f58b005c950 0x7f58b005cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b4a40640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f58b005e490 0x7f58b013db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:53402/0 (socket says 10.20.193.48:53402) 2026-02-12T18:14:51.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b4a40640 1 -- 10.20.193.48:0/1717119754 learned_addr learned my addr 10.20.193.48:0/1717119754 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:14:51.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b5a42640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f58b005d260 0x7f58b013e280 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:35948/0 (socket says 10.20.193.48:35948) 2026-02-12T18:14:51.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b5a42640 10 monclient(hunting): get_auth_request con 0x7f58b005d260 auth_method 0 2026-02-12T18:14:51.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b5a42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b5a42640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b5a42640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b5241640 10 monclient(hunting): get_auth_request con 0x7f58b005c950 auth_method 0 2026-02-12T18:14:51.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b5241640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b5241640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b5241640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b5a42640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:51.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b5a42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:51.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b5a42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:51.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b5241640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:51.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b5241640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:51.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b5241640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:51.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b5a42640 10 monclient(hunting): handle_auth_done global_id 104154 payload 274 2026-02-12T18:14:51.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b5a42640 1 -- 10.20.193.48:0/1717119754 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f58b005c950 msgr2=0x7f58b005cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:51.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b5a42640 1 --2- 10.20.193.48:0/1717119754 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f58b005c950 0x7f58b005cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b5a42640 1 -- 10.20.193.48:0/1717119754 >> v1:10.20.193.48:6789/0 conn(0x7f58b005e490 legacy=0x7f58b013db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:51.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b5a42640 10 monclient: _finish_hunting 0 2026-02-12T18:14:51.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b5a42640 1 monclient: found mon.noname-d 2026-02-12T18:14:51.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b5a42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:51.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b5a42640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:14:51.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.501+0000 7f58b5a42640 1 -- 10.20.193.48:0/1717119754 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b0092c70 con 0x7f58b005d260 2026-02-12T18:14:51.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.503+0000 7f58b5a42640 1 -- 10.20.193.48:0/1717119754 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f58b005d260 msgr2=0x7f58b013e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:51.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.503+0000 7f58b5a42640 1 --2- 10.20.193.48:0/1717119754 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f58b005d260 0x7f58b013e280 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=2024580512219921145 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58ac00a910 tx=0x7f58ac02fdb0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=1c18c13fca0bfaf9 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:51.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.503+0000 7f589ffff640 1 -- 10.20.193.48:0/1717119754 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f58ac036340 con 0x7f58b005d260 2026-02-12T18:14:51.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.503+0000 7f589ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:51.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.503+0000 7f589ffff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:14:51.508 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.503+0000 7f589ffff640 10 monclient: dump: 2026-02-12T18:14:51.508 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:51.508 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.508 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.508 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.508 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:51.508 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.508 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:51.509 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:51.509 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:51.509 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:51.509 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:51.509 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:51.509 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:51.509 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:51.509 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:51.509 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.504+0000 7f589ffff640 10 monclient: _finish_auth 0 2026-02-12T18:14:51.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.504+0000 7f589ffff640 10 monclient: _check_auth_tickets 2026-02-12T18:14:51.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.504+0000 7f589ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:51.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.504+0000 7f589ffff640 1 -- 10.20.193.48:0/1717119754 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58ac0364c0 con 0x7f58b005d260 2026-02-12T18:14:51.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.504+0000 7f589ffff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:51.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.504+0000 7f589ffff640 1 -- 10.20.193.48:0/1717119754 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f58ac036af0 con 0x7f58b005d260 2026-02-12T18:14:51.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.504+0000 7f58b74cc640 5 monclient: authenticate success, global_id 104154 2026-02-12T18:14:51.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.504+0000 7f58b74cc640 10 monclient: get_monmap_and_config success 2026-02-12T18:14:51.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.504+0000 7f58b74cc640 4 set_mon_vals no callback set 2026-02-12T18:14:51.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.504+0000 7f589ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:51.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.504+0000 7f589ffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:14:51.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.504+0000 7f589ffff640 10 monclient: dump: 2026-02-12T18:14:51.509 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:51.509 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.510 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.510 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.510 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:51.510 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.510 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:51.510 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:51.510 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:51.510 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:51.510 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:51.510 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:51.510 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:51.510 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:51.510 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:51.510 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.504+0000 7f58b74cc640 10 monclient: shutdown 2026-02-12T18:14:51.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.504+0000 7f58b74cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:51.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.504+0000 7f58b74cc640 1 -- 10.20.193.48:0/1717119754 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f58b005d260 msgr2=0x7f58b013e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.504+0000 7f58b74cc640 1 --2- 10.20.193.48:0/1717119754 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f58b005d260 0x7f58b013e280 secure :-1 s=READY pgs=18 gs=2 cs=0 l=1 c_cookie=2024580512219921145 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58ac00a910 tx=0x7f58ac02fdb0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.504+0000 7f58b74cc640 1 -- 10.20.193.48:0/1717119754 shutdown_connections 2026-02-12T18:14:51.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.504+0000 7f58b74cc640 1 --2- 10.20.193.48:0/1717119754 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f58b005d260 0x7f58b013e280 unknown :-1 s=CLOSED pgs=18 gs=2 cs=0 l=1 c_cookie=2024580512219921145 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.504+0000 7f58b74cc640 1 --2- 10.20.193.48:0/1717119754 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f58b005c950 0x7f58b005cd20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.504+0000 7f58b74cc640 1 -- 10.20.193.48:0/1717119754 >> 10.20.193.48:0/1717119754 conn(0x7f58b00548a0 msgr2=0x7f58b0097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:51.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.504+0000 7f58b74cc640 1 -- 10.20.193.48:0/1717119754 shutdown_connections 2026-02-12T18:14:51.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.504+0000 7f58b74cc640 1 -- 10.20.193.48:0/1717119754 wait complete. 2026-02-12T18:14:51.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.504+0000 7f58b74cc640 10 monclient: build_initial_monmap 2026-02-12T18:14:51.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.504+0000 7f58b74cc640 10 monclient: monmap: 2026-02-12T18:14:51.511 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:51.511 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:14:51.511 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:14:51.511 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:14:51.511 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:51.511 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.511 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:14:51.511 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:14:51.511 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:51.511 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:51.511 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:51.511 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:51.511 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:51.511 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:51.511 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:51.511 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b74cc640 1 Processor -- start 2026-02-12T18:14:51.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b74cc640 1 -- start start 2026-02-12T18:14:51.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b74cc640 10 monclient: init 2026-02-12T18:14:51.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b74cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:51.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b74cc640 10 monclient: _add_conns ranks=[6,1,7,3,4,2,8,5,0] 2026-02-12T18:14:51.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b74cc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f58b005c950 0x7f58b012da90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b74cc640 10 monclient(hunting): picked mon.noname-d con 0x7f58b005c950 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:14:51.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b74cc640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f58b005d260 0x7f58b008d440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b74cc640 10 monclient(hunting): picked mon.noname-f con 0x7f58b005d260 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:14:51.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b74cc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f58b005e490 0x7f58b013dec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b74cc640 10 monclient(hunting): picked mon.noname-i con 0x7f58b005e490 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:14:51.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b74cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b74cc640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f58b0142bb0 con 0x7f58b005d260 2026-02-12T18:14:51.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b74cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b74cc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f58b008bc30 con 0x7f58b005c950 2026-02-12T18:14:51.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b74cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b74cc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f58b0142570 con 0x7f58b005e490 2026-02-12T18:14:51.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b74cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:51.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b74cc640 10 monclient(hunting): authenticate will time out at 1130.231431s 2026-02-12T18:14:51.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b5241640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f58b005c950 0x7f58b012da90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b5241640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f58b005c950 0x7f58b012da90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:35964/0 (socket says 10.20.193.48:35964) 2026-02-12T18:14:51.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b5241640 1 -- 10.20.193.48:0/457458855 learned_addr learned my addr 10.20.193.48:0/457458855 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:51.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b5241640 10 monclient(hunting): get_auth_request con 0x7f58b005c950 auth_method 0 2026-02-12T18:14:51.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b5241640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b5241640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b5241640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b5241640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:51.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b5241640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:51.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b5241640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:51.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b5a42640 1 --2- 10.20.193.48:0/457458855 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f58b005e490 0x7f58b013dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b5a42640 10 monclient(hunting): get_auth_request con 0x7f58b005e490 auth_method 0 2026-02-12T18:14:51.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b5a42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b5a42640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b5a42640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b4a40640 1 --2- 10.20.193.48:0/457458855 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f58b005d260 0x7f58b008d440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b5241640 10 monclient(hunting): handle_auth_done global_id 104163 payload 824 2026-02-12T18:14:51.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b5241640 1 -- 10.20.193.48:0/457458855 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f58b005e490 msgr2=0x7f58b013dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b5241640 1 --2- 10.20.193.48:0/457458855 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f58b005e490 0x7f58b013dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b5241640 1 -- 10.20.193.48:0/457458855 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f58b005d260 msgr2=0x7f58b008d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b5241640 1 --2- 10.20.193.48:0/457458855 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f58b005d260 0x7f58b008d440 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b5241640 10 monclient: _finish_hunting 0 2026-02-12T18:14:51.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b5241640 1 monclient: found mon.noname-d 2026-02-12T18:14:51.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b5241640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:51.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b5241640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:14:51.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.505+0000 7f58b5241640 1 -- 10.20.193.48:0/457458855 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58ac00a500 con 0x7f58b005c950 2026-02-12T18:14:51.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.507+0000 7f58b5241640 1 -- 10.20.193.48:0/457458855 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f58b005c950 msgr2=0x7f58b012da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:51.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.507+0000 7f58b5241640 1 --2- 10.20.193.48:0/457458855 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f58b005c950 0x7f58b012da90 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58a00093f0 tx=0x7f58a000ed50 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:51.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f589dffb640 1 -- 10.20.193.48:0/457458855 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f58a000cb50 con 0x7f58b005c950 2026-02-12T18:14:51.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f589dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:51.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f589dffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:14:51.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f589dffb640 10 monclient: dump: 2026-02-12T18:14:51.517 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:51.517 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.517 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.517 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.517 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:51.517 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.517 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:51.517 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:51.517 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:51.517 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:51.517 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:51.517 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:51.517 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:51.518 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:51.518 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:51.518 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f589dffb640 10 monclient: _finish_auth 0 2026-02-12T18:14:51.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f589dffb640 10 monclient: _check_auth_tickets 2026-02-12T18:14:51.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f589dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:51.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f58b74cc640 5 monclient: authenticate success, global_id 104163 2026-02-12T18:14:51.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f58b74cc640 10 monclient: _renew_subs 2026-02-12T18:14:51.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f58b74cc640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:14:51.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f58b74cc640 1 -- 10.20.193.48:0/457458855 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58b0091600 con 0x7f58b005c950 2026-02-12T18:14:51.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f589dffb640 1 -- 10.20.193.48:0/457458855 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f58a000ccd0 con 0x7f58b005c950 2026-02-12T18:14:51.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f589dffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:51.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f589dffb640 1 -- 10.20.193.48:0/457458855 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f58a000ce40 con 0x7f58b005c950 2026-02-12T18:14:51.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f589dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:51.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f589f7fe640 4 set_mon_vals no callback set 2026-02-12T18:14:51.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f589dffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:14:51.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f589dffb640 10 monclient: dump: 2026-02-12T18:14:51.518 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:51.518 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.518 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.518 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.518 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:51.518 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.519 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:51.519 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:51.519 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:51.519 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:51.519 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:51.519 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:51.519 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:51.519 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:51.519 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:51.519 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f58b74cc640 10 monclient: _renew_subs 2026-02-12T18:14:51.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f58b74cc640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:14:51.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f58b74cc640 1 -- 10.20.193.48:0/457458855 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f58b008b670 con 0x7f58b005c950 2026-02-12T18:14:51.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f58b74cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:51.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f58b74cc640 1 --2- 10.20.193.48:0/457458855 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f58b008d980 0x7f58b012a510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f58b74cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f58b74cc640 1 -- 10.20.193.48:0/457458855 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f58b005f140 con 0x7f58b008d980 2026-02-12T18:14:51.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f58b4a40640 1 --2- 10.20.193.48:0/457458855 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f58b008d980 0x7f58b012a510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f58b4a40640 10 monclient: get_auth_request con 0x7f58b008d980 auth_method 0 2026-02-12T18:14:51.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f58b4a40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f58b4a40640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f58b4a40640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f589dffb640 1 -- 10.20.193.48:0/457458855 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f58a0011070 con 0x7f58b005c950 2026-02-12T18:14:51.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f58b4a40640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:51.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f58b4a40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:51.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f58b4a40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:51.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f589dffb640 1 --2- 10.20.193.48:0/457458855 >> v2:10.20.193.111:6812/977811348 conn(0x7f588003f800 0x7f588005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.508+0000 7f589dffb640 1 -- 10.20.193.48:0/457458855 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(317..317 src has 215..317) ==== 3897+0+0 (secure 0 0 0) 0x7f58a0052bf0 con 0x7f58b005c950 2026-02-12T18:14:51.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.509+0000 7f58b5a42640 1 --2- 10.20.193.48:0/457458855 >> v2:10.20.193.111:6812/977811348 conn(0x7f588003f800 0x7f588005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.509+0000 7f58b5a42640 10 monclient: get_auth_request con 0x7f588003f800 auth_method 0 2026-02-12T18:14:51.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.509+0000 7f58b4a40640 10 monclient(hunting): handle_auth_done global_id 104133 payload 824 2026-02-12T18:14:51.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.509+0000 7f58b4a40640 1 -- 10.20.193.48:0/457458855 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f58b0097de0 con 0x7f58b008d980 2026-02-12T18:14:51.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.511+0000 7f58b4a40640 1 -- 10.20.193.48:0/457458855 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f58b008d980 msgr2=0x7f58b012a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:51.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.511+0000 7f58b4a40640 1 --2- 10.20.193.48:0/457458855 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f58b008d980 0x7f58b012a510 secure :-1 s=READY pgs=11 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58b0089f70 tx=0x7f58a400d8b0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:51.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.511+0000 7f58b5a42640 1 --2- 10.20.193.48:0/457458855 >> v2:10.20.193.111:6812/977811348 conn(0x7f588003f800 0x7f588005fcb0 secure :-1 s=READY pgs=444 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58ac005820 tx=0x7f58ac034000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:51.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.511+0000 7f589dffb640 1 -- 10.20.193.48:0/457458855 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f58a4005db0 con 0x7f58b008d980 2026-02-12T18:14:51.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.511+0000 7f589dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:51.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.511+0000 7f589dffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:14:51.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.511+0000 7f589dffb640 10 monclient: dump: 2026-02-12T18:14:51.520 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:51.520 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.520 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.520 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.520 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:51.520 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.520 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:51.520 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:51.521 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:51.521 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:51.521 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:51.521 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:51.521 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:51.521 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:51.521 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:51.521 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.511+0000 7f589dffb640 1 -- 10.20.193.48:0/457458855 <== mon.3 v2:10.20.193.111:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f58a4007070 con 0x7f58b008d980 2026-02-12T18:14:51.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.511+0000 7f589dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:51.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.511+0000 7f589dffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:14:51.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.511+0000 7f589dffb640 1 -- 10.20.193.48:0/457458855 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f58b008d980 msgr2=0x7f58b012a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.511+0000 7f589dffb640 1 --2- 10.20.193.48:0/457458855 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f58b008d980 0x7f58b012a510 secure :-1 s=READY pgs=11 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58b0089f70 tx=0x7f58a400d8b0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.511+0000 7f589dffb640 1 -- 10.20.193.48:0/457458855 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f58b008d980 msgr2=0x7f58b012a510 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:51.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.511+0000 7f589dffb640 1 --2- 10.20.193.48:0/457458855 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f58b008d980 0x7f58b012a510 secure :-1 s=CLOSED pgs=11 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58b0089f70 tx=0x7f58a400d8b0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.515+0000 7f58b74cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:14:51.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.515+0000 7f58b74cc640 1 --2- 10.20.193.48:0/457458855 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f58b012aa50 0x7f58b012ae50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.515+0000 7f58b74cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.515+0000 7f58b74cc640 1 -- 10.20.193.48:0/457458855 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f58b005fd90 con 0x7f58b012aa50 2026-02-12T18:14:51.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.515+0000 7f58b4a40640 1 --2- 10.20.193.48:0/457458855 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f58b012aa50 0x7f58b012ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.515+0000 7f58b4a40640 10 monclient: get_auth_request con 0x7f58b012aa50 auth_method 0 2026-02-12T18:14:51.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.515+0000 7f58b4a40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.515+0000 7f58b4a40640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.515+0000 7f58b4a40640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.515+0000 7f58b4a40640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:51.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.515+0000 7f58b4a40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:51.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.515+0000 7f58b4a40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:51.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.516+0000 7f58b4a40640 10 monclient(hunting): handle_auth_done global_id 104142 payload 824 2026-02-12T18:14:51.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.516+0000 7f58b4a40640 1 -- 10.20.193.48:0/457458855 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f58b012b390 con 0x7f58b012aa50 2026-02-12T18:14:51.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.518+0000 7f58b4a40640 1 -- 10.20.193.48:0/457458855 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f58b012aa50 msgr2=0x7f58b012ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:51.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.518+0000 7f58b4a40640 1 --2- 10.20.193.48:0/457458855 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f58b012aa50 0x7f58b012ae50 secure :-1 s=READY pgs=12 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58a4013000 tx=0x7f58a4004a00 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:51.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.518+0000 7f589dffb640 1 -- 10.20.193.48:0/457458855 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f58a4022070 con 0x7f58b012aa50 2026-02-12T18:14:51.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.518+0000 7f589dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:51.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.518+0000 7f589dffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:14:51.523 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.518+0000 7f589dffb640 10 monclient: dump: 2026-02-12T18:14:51.523 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:51.523 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.523 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.524 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.524 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:51.524 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.524 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:51.524 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:51.524 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:51.524 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:51.524 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:51.524 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:51.524 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:51.524 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:51.524 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:51.524 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.518+0000 7f589dffb640 1 -- 10.20.193.48:0/457458855 <== mon.3 v2:10.20.193.111:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7f58a4027470 con 0x7f58b012aa50 2026-02-12T18:14:51.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.518+0000 7f589dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:14:51.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.518+0000 7f589dffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:14:51.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.518+0000 7f589dffb640 1 -- 10.20.193.48:0/457458855 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f58b012aa50 msgr2=0x7f58b012ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.518+0000 7f589dffb640 1 --2- 10.20.193.48:0/457458855 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f58b012aa50 0x7f58b012ae50 secure :-1 s=READY pgs=12 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58a4013000 tx=0x7f58a4004a00 comp rx=0 tx=0).stop 2026-02-12T18:14:51.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.518+0000 7f589dffb640 1 -- 10.20.193.48:0/457458855 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f58b012aa50 msgr2=0x7f58b012ae50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:51.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.518+0000 7f589dffb640 1 --2- 10.20.193.48:0/457458855 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f58b012aa50 0x7f58b012ae50 secure :-1 s=CLOSED pgs=12 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58a4013000 tx=0x7f58a4004a00 comp rx=0 tx=0).stop 2026-02-12T18:14:51.525 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:14:51.525 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:14:51.525 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:14:51.525 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:14:51.525 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 76, 2026-02-12T18:14:51.525 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 10512, 2026-02-12T18:14:51.525 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:14:51.525 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:14:51.525 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:14:51.525 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:14:51.525 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:14:51.525 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:14:51.525 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:14:51.525 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:14:51.525 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:14:51.525 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:14:51.525 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:51.525 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 5, 2026-02-12T18:14:51.525 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:51.526 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:14:51.526 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:14:51.526 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:51.526 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:51.526 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:51.526 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:51.526 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:51.526 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:51.526 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:51.526 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:51.526 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:51.526 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:51.526 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:51.526 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:51.526 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:51.526 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:51.526 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:14:51.526 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:14:51.526 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:51.526 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:51.526 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:51.526 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:51.526 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:51.527 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:51.527 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:51.527 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:51.527 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:51.527 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:51.527 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:51.527 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:51.527 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:51.527 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.527 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.527 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:14:51.527 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:14:51.527 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:14:51.527 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:14:51.527 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:14:51.527 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:14:51.527 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:51.527 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:51.527 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:14:51.527 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:14:51.527 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:14:51.527 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:14:51.527 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:14:51.528 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:14:51.528 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:14:51.528 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:51.528 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:14:51.528 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:51.528 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:51.528 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:51.528 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:51.528 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:51.528 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:51.528 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:51.528 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:51.528 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:51.528 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:51.528 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:51.528 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:51.528 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:51.528 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:51.528 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:14:51.528 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.528 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:14:51.528 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.529 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:14:51.529 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:14:51.529 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.529 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.529 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.529 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.529 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:14:51.529 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.529 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.529 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.529 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.529 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:14:51.529 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.529 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.529 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.529 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.529 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:14:51.529 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:14:51.529 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.529 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.529 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:14:51.529 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.529 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.530 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.530 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:14:51.530 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:14:51.530 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.530 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.530 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.530 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.530 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:14:51.530 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.530 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.530 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.530 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.530 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:14:51.530 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.530 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.530 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.530 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.530 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:14:51.530 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:14:51.530 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.530 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.530 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:14:51.530 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.530 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.531 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.531 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:14:51.531 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:14:51.531 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.531 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.531 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.531 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.531 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:14:51.531 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.531 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.531 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.531 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.531 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:14:51.531 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.531 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.531 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.531 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.531 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:14:51.531 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:14:51.531 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.531 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.531 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:14:51.531 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.532 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.532 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.532 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:14:51.532 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:14:51.532 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.532 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.532 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.532 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.532 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:14:51.532 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.532 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.532 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.532 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.532 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:14:51.532 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.532 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.532 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.532 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.532 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:14:51.532 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:14:51.532 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.532 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.532 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:14:51.532 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.532 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.533 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.533 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:14:51.533 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:14:51.533 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.533 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.533 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.533 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.533 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:14:51.533 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.533 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.533 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.533 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.533 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:14:51.533 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.533 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.533 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.533 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.533 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:14:51.533 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:14:51.533 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.533 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.533 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:51.533 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.533 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.533 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.534 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:14:51.534 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:14:51.534 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.534 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.534 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.534 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.534 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:14:51.534 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.534 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.534 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.534 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.534 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:14:51.534 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.534 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.534 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.534 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.534 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:14:51.534 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:14:51.534 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.534 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.534 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:14:51.534 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.534 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.534 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.534 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:14:51.534 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:14:51.535 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.535 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.535 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.535 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.535 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:14:51.535 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.535 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.535 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.535 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.535 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:14:51.535 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.535 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.535 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.535 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.535 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:14:51.535 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:14:51.535 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.535 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.535 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:51.535 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.535 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.535 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.535 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:14:51.535 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:14:51.535 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.536 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.536 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.536 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.536 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:14:51.536 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.536 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.536 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.536 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.536 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:14:51.536 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.536 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.536 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.536 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.536 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:14:51.536 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:14:51.536 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.536 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.536 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:14:51.536 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.536 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.536 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.536 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:14:51.536 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:14:51.536 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:51.536 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:51.537 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.537 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:51.537 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:14:51.537 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.537 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.537 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.537 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:51.537 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:14:51.537 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:51.537 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.537 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.537 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.537 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:14:51.537 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:14:51.537 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:51.537 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:51.537 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:14:51.537 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:51.537 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.537 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.537 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.537 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:14:51.537 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:14:51.537 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.537 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:51.537 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:51.538 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:51.538 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.538 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:51.538 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:14:51.538 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:51.538 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:51.538 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:51.538 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:51.538 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:51.538 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:51.538 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:51.538 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:14:51.538 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:14:51.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.518+0000 7f58b74cc640 1 -- 10.20.193.48:0/457458855 >> v2:10.20.193.111:6812/977811348 conn(0x7f588003f800 msgr2=0x7f588005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.518+0000 7f58b74cc640 1 --2- 10.20.193.48:0/457458855 >> v2:10.20.193.111:6812/977811348 conn(0x7f588003f800 0x7f588005fcb0 secure :-1 s=READY pgs=444 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58ac005820 tx=0x7f58ac034000 comp rx=0 tx=0).stop 2026-02-12T18:14:51.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.518+0000 7f58b74cc640 10 monclient: shutdown 2026-02-12T18:14:51.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.519+0000 7f58b5a42640 1 -- 10.20.193.48:0/457458855 reap_dead start 2026-02-12T18:14:51.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.519+0000 7f58b74cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:51.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.519+0000 7f58b74cc640 1 -- 10.20.193.48:0/457458855 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f58b005c950 msgr2=0x7f58b012da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.519+0000 7f58b74cc640 1 --2- 10.20.193.48:0/457458855 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f58b005c950 0x7f58b012da90 secure :-1 s=READY pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f58a00093f0 tx=0x7f58a000ed50 comp rx=0 tx=0).stop 2026-02-12T18:14:51.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.519+0000 7f58b74cc640 1 -- 10.20.193.48:0/457458855 shutdown_connections 2026-02-12T18:14:51.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.519+0000 7f58b74cc640 1 --2- 10.20.193.48:0/457458855 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f58b005c950 0x7f58b012da90 unknown :-1 s=CLOSED pgs=19 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.519+0000 7f58b74cc640 1 -- 10.20.193.48:0/457458855 >> 10.20.193.48:0/457458855 conn(0x7f58b00548a0 msgr2=0x7f58b0123070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:51.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.519+0000 7f58b74cc640 1 -- 10.20.193.48:0/457458855 shutdown_connections 2026-02-12T18:14:51.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.519+0000 7f58b74cc640 1 -- 10.20.193.48:0/457458855 wait complete. 2026-02-12T18:14:51.539 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:14:51.539 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2026-02-12T18:14:51.540 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2026-02-12T18:14:51.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.603+0000 7f9e1c0cc640 10 monclient: get_monmap_and_config 2026-02-12T18:14:51.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.603+0000 7f9e1c0cc640 10 monclient: build_initial_monmap 2026-02-12T18:14:51.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.603+0000 7f9e1c0cc640 10 monclient: monmap: 2026-02-12T18:14:51.605 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:51.606 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.606 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:14:51.604917+0000 2026-02-12T18:14:51.606 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:14:51.604917+0000 2026-02-12T18:14:51.606 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:51.606 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.606 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:14:51.606 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:14:51.606 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:51.606 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:51.606 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:51.606 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:51.606 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:51.607 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:51.607 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:51.607 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:14:51.607 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:14:51.607 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1c0cc640 1 Processor -- start 2026-02-12T18:14:51.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1c0cc640 1 -- start start 2026-02-12T18:14:51.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1c0cc640 10 monclient: init 2026-02-12T18:14:51.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1c0cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:51.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1c0cc640 10 monclient: _add_conns ranks=[6,3,5,4,10,7,2,8,1,0,9] 2026-02-12T18:14:51.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1c0cc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9e1405d550 0x7f9e1405d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1c0cc640 10 monclient(hunting): picked mon.noname-d con 0x7f9e1405d550 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:14:51.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1c0cc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9e1405de60 0x7f9e14141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1c0cc640 10 monclient(hunting): picked mon.noname-g con 0x7f9e1405de60 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:14:51.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1c0cc640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e1413ef60 0x7f9e141424e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1c0cc640 10 monclient(hunting): picked mon.noname-h con 0x7f9e1413ef60 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:14:51.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1c0cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1c0cc640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f9e1408d390 con 0x7f9e1405de60 2026-02-12T18:14:51.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1c0cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1c0cc640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f9e1408d5a0 con 0x7f9e1413ef60 2026-02-12T18:14:51.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1c0cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1c0cc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f9e140580e0 con 0x7f9e1405d550 2026-02-12T18:14:51.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1c0cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:51.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1c0cc640 10 monclient(hunting): authenticate will time out at 1130.330643s 2026-02-12T18:14:51.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e19e41640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9e1405d550 0x7f9e1405d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e19e41640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9e1405d550 0x7f9e1405d920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:35980/0 (socket says 10.20.193.48:35980) 2026-02-12T18:14:51.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e19e41640 1 -- 10.20.193.48:0/2376243329 learned_addr learned my addr 10.20.193.48:0/2376243329 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:51.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e19e41640 10 monclient(hunting): get_auth_request con 0x7f9e1405d550 auth_method 0 2026-02-12T18:14:51.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e19e41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e19e41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e19e41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e19640640 1 --2- 10.20.193.48:0/2376243329 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9e1405de60 0x7f9e14141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1a642640 1 --2- 10.20.193.48:0/2376243329 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e1413ef60 0x7f9e141424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e19e41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:51.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e19e41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:51.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e19e41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:51.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e19640640 10 monclient(hunting): get_auth_request con 0x7f9e1405de60 auth_method 0 2026-02-12T18:14:51.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e19640640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e19640640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e19640640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1a642640 10 monclient(hunting): get_auth_request con 0x7f9e1413ef60 auth_method 0 2026-02-12T18:14:51.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1a642640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1a642640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1a642640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1a642640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:51.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1a642640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:51.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e1a642640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:51.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e19640640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:51.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.604+0000 7f9e19640640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:51.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.605+0000 7f9e19640640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:51.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.605+0000 7f9e19e41640 10 monclient(hunting): handle_auth_done global_id 104172 payload 274 2026-02-12T18:14:51.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.605+0000 7f9e19e41640 1 -- 10.20.193.48:0/2376243329 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e1413ef60 msgr2=0x7f9e141424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:51.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.605+0000 7f9e19e41640 1 --2- 10.20.193.48:0/2376243329 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e1413ef60 0x7f9e141424e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.605+0000 7f9e19e41640 1 -- 10.20.193.48:0/2376243329 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9e1405de60 msgr2=0x7f9e14141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:51.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.605+0000 7f9e19e41640 1 --2- 10.20.193.48:0/2376243329 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9e1405de60 0x7f9e14141fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.605+0000 7f9e19e41640 10 monclient: _finish_hunting 0 2026-02-12T18:14:51.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.605+0000 7f9e19e41640 1 monclient: found mon.noname-d 2026-02-12T18:14:51.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.605+0000 7f9e19e41640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:51.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.605+0000 7f9e19e41640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:14:51.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.605+0000 7f9e19e41640 1 -- 10.20.193.48:0/2376243329 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e1404dc20 con 0x7f9e1405d550 2026-02-12T18:14:51.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.605+0000 7f9e19e41640 1 -- 10.20.193.48:0/2376243329 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9e1405d550 msgr2=0x7f9e1405d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:14:51.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.605+0000 7f9e19e41640 1 -- 10.20.193.48:0/2376243329 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9e1405d550 msgr2=0x7f9e1405d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:14:51.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.605+0000 7f9e19e41640 1 --2- 10.20.193.48:0/2376243329 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9e1405d550 0x7f9e1405d920 secure :-1 s=COMPRESSION_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e040098d0 tx=0x7f9e0402ee20 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:51.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.605+0000 7f9e19e41640 1 --2- 10.20.193.48:0/2376243329 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9e1405d550 0x7f9e1405d920 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:14:51.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e19e41640 1 --2- 10.20.193.48:0/2376243329 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9e1405d550 0x7f9e1405d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e19e41640 10 monclient: get_auth_request con 0x7f9e1405d550 auth_method 0 2026-02-12T18:14:51.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e19e41640 0 --2- 10.20.193.48:0/2376243329 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9e1405d550 0x7f9e1405d920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2026-02-12T18:14:51.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e19e41640 1 --2- 10.20.193.48:0/2376243329 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9e1405d550 0x7f9e1405d920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e18e3f640 10 monclient: ms_handle_reset current mon [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:14:51.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e18e3f640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:51.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e18e3f640 1 -- 10.20.193.48:0/2376243329 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9e1405d550 msgr2=0x7f9e1405d920 unknown :-1 s=STATE_CLOSED l=0).mark_down 2026-02-12T18:14:51.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e18e3f640 1 --2- 10.20.193.48:0/2376243329 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9e1405d550 0x7f9e1405d920 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e18e3f640 10 monclient: _add_conns ranks=[9,4,8,0,10,1,7,2] 2026-02-12T18:14:51.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e18e3f640 1 --2- 10.20.193.48:0/2376243329 >> v2:10.20.193.48:3300/0 conn(0x7f9dfc0036f0 0x7f9dfc023b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e18e3f640 10 monclient(hunting): picked mon.noname-a con 0x7f9dfc0036f0 addr v2:10.20.193.48:3300/0 2026-02-12T18:14:51.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e18e3f640 1 --2- 10.20.193.48:0/2376243329 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9dfc024350 0x7f9dfc0447d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e18e3f640 10 monclient(hunting): picked mon.noname-c con 0x7f9dfc024350 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:14:51.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e18e3f640 1 --2- 10.20.193.48:0/2376243329 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9dfc0451a0 0x7f9dfc065650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e18e3f640 10 monclient(hunting): picked mon.noname-e con 0x7f9dfc0451a0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:14:51.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e18e3f640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e18e3f640 1 -- 10.20.193.48:0/2376243329 --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f9dfc065fd0 con 0x7f9dfc0036f0 2026-02-12T18:14:51.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e18e3f640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e18e3f640 1 -- 10.20.193.48:0/2376243329 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f9dfc066110 con 0x7f9dfc024350 2026-02-12T18:14:51.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e18e3f640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e18e3f640 1 -- 10.20.193.48:0/2376243329 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f9dfc0662d0 con 0x7f9dfc0451a0 2026-02-12T18:14:51.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e18e3f640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:51.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e18e3f640 10 monclient(hunting): ms_handle_reset stray mon [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:14:51.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e19e41640 1 --2- 10.20.193.48:0/2376243329 >> v2:10.20.193.48:3300/0 conn(0x7f9dfc0036f0 0x7f9dfc023b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e19640640 1 --2- 10.20.193.48:0/2376243329 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9dfc024350 0x7f9dfc0447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e19e41640 10 monclient(hunting): get_auth_request con 0x7f9dfc0036f0 auth_method 0 2026-02-12T18:14:51.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e19e41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e19e41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e19e41640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:51.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e1a642640 1 --2- 10.20.193.48:0/2376243329 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9dfc0451a0 0x7f9dfc065650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=8 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e19640640 10 monclient(hunting): get_auth_request con 0x7f9dfc024350 auth_method 0 2026-02-12T18:14:51.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e19640640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e19640640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e19640640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:51.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e1a642640 10 monclient(hunting): get_auth_request con 0x7f9dfc0451a0 auth_method 0 2026-02-12T18:14:51.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e1a642640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e1a642640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e1a642640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:51.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e19e41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:51.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e19e41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:51.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e19e41640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:14:51.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e19640640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:51.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e19640640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:51.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e19640640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:14:51.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e1a642640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:51.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e1a642640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:51.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e1a642640 10 monclient(hunting): handle_auth_reply_more responding with 132 bytes 2026-02-12T18:14:51.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e1a642640 10 monclient(hunting): handle_auth_done global_id 104172 payload 293 2026-02-12T18:14:51.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e1a642640 1 -- 10.20.193.48:0/2376243329 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9dfc024350 msgr2=0x7f9dfc0447d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:51.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e1a642640 1 --2- 10.20.193.48:0/2376243329 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9dfc024350 0x7f9dfc0447d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=7 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e1a642640 1 -- 10.20.193.48:0/2376243329 >> v2:10.20.193.48:3300/0 conn(0x7f9dfc0036f0 msgr2=0x7f9dfc023b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:51.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e1a642640 1 --2- 10.20.193.48:0/2376243329 >> v2:10.20.193.48:3300/0 conn(0x7f9dfc0036f0 0x7f9dfc023b30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e1a642640 10 monclient: _finish_hunting 0 2026-02-12T18:14:51.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e1a642640 1 monclient: found mon.noname-e 2026-02-12T18:14:51.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e1a642640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:51.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e1a642640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:14:51.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e1a642640 1 -- 10.20.193.48:0/2376243329 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dfc066550 con 0x7f9dfc0451a0 2026-02-12T18:14:51.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e19640640 1 --2- 10.20.193.48:0/2376243329 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9dfc024350 0x7f9dfc0447d0 unknown :-1 s=CLOSED pgs=0 gs=7 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:14:51.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e19e41640 1 --2- 10.20.193.48:0/2376243329 >> v2:10.20.193.48:3300/0 conn(0x7f9dfc0036f0 0x7f9dfc023b30 unknown :-1 s=CLOSED pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:14:51.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.806+0000 7f9e1a642640 1 -- 10.20.193.48:0/2376243329 reap_dead start 2026-02-12T18:14:51.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.808+0000 7f9e1a642640 1 -- 10.20.193.48:0/2376243329 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9dfc0451a0 msgr2=0x7f9dfc065650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:51.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.808+0000 7f9e1a642640 1 --2- 10.20.193.48:0/2376243329 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9dfc0451a0 0x7f9dfc065650 secure :-1 s=READY pgs=124 gs=8 cs=0 l=1 c_cookie=9099890505247276843 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e14090780 tx=0x7f9e040092c0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=7e494e338436bf2b server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:51.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.808+0000 7f9e18e3f640 1 -- 10.20.193.48:0/2376243329 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9e1000fc20 con 0x7f9dfc0451a0 2026-02-12T18:14:51.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.808+0000 7f9e18e3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:51.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.808+0000 7f9e18e3f640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:14:51.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.808+0000 7f9e18e3f640 10 monclient: dump: 2026-02-12T18:14:51.822 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:51.822 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.822 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.822 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.822 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:51.823 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.823 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:51.823 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:51.823 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:51.823 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:51.823 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:51.823 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:51.823 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:51.823 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:51.823 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:51.823 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.808+0000 7f9e18e3f640 10 monclient: _finish_auth 0 2026-02-12T18:14:51.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.808+0000 7f9e18e3f640 10 monclient: _check_auth_tickets 2026-02-12T18:14:51.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.808+0000 7f9e18e3f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:51.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.808+0000 7f9e18e3f640 1 -- 10.20.193.48:0/2376243329 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e1000fdc0 con 0x7f9dfc0451a0 2026-02-12T18:14:51.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.808+0000 7f9e18e3f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:51.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.808+0000 7f9e18e3f640 1 -- 10.20.193.48:0/2376243329 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9e10014df0 con 0x7f9dfc0451a0 2026-02-12T18:14:51.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.808+0000 7f9e18e3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:51.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.808+0000 7f9e18e3f640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:14:51.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.808+0000 7f9e18e3f640 10 monclient: dump: 2026-02-12T18:14:51.824 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:51.824 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.824 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.824 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.825 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:51.825 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.825 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:51.825 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:51.825 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:51.825 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:51.825 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:51.825 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:51.825 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:51.825 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:51.825 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:51.825 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.808+0000 7f9e1c0cc640 5 monclient: authenticate success, global_id 104172 2026-02-12T18:14:51.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.808+0000 7f9e1c0cc640 10 monclient: get_monmap_and_config success 2026-02-12T18:14:51.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.808+0000 7f9e1c0cc640 4 set_mon_vals no callback set 2026-02-12T18:14:51.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.808+0000 7f9e1c0cc640 10 monclient: shutdown 2026-02-12T18:14:51.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.808+0000 7f9e1c0cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:51.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.808+0000 7f9e1c0cc640 1 -- 10.20.193.48:0/2376243329 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9dfc0451a0 msgr2=0x7f9dfc065650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.808+0000 7f9e1c0cc640 1 --2- 10.20.193.48:0/2376243329 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9dfc0451a0 0x7f9dfc065650 secure :-1 s=READY pgs=124 gs=8 cs=0 l=1 c_cookie=9099890505247276843 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e14090780 tx=0x7f9e040092c0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.809+0000 7f9e1c0cc640 1 -- 10.20.193.48:0/2376243329 shutdown_connections 2026-02-12T18:14:51.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.809+0000 7f9e1c0cc640 1 --2- 10.20.193.48:0/2376243329 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9dfc0451a0 0x7f9dfc065650 unknown :-1 s=CLOSED pgs=124 gs=8 cs=0 l=1 c_cookie=9099890505247276843 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.809+0000 7f9e1c0cc640 1 -- 10.20.193.48:0/2376243329 >> 10.20.193.48:0/2376243329 conn(0x7f9e140546a0 msgr2=0x7f9e14054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:51.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.809+0000 7f9e1c0cc640 1 -- 10.20.193.48:0/2376243329 shutdown_connections 2026-02-12T18:14:51.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.809+0000 7f9e1c0cc640 1 -- 10.20.193.48:0/2376243329 wait complete. 2026-02-12T18:14:51.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.809+0000 7f9e1c0cc640 10 monclient: build_initial_monmap 2026-02-12T18:14:51.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.809+0000 7f9e1c0cc640 10 monclient: monmap: 2026-02-12T18:14:51.827 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:51.827 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:14:51.827 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:14:51.827 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:14:51.827 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:51.827 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.827 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:14:51.827 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:14:51.827 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:51.827 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:51.827 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:51.828 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:51.828 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:51.828 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:51.828 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:51.828 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.809+0000 7f9e1c0cc640 1 Processor -- start 2026-02-12T18:14:51.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.809+0000 7f9e1c0cc640 1 -- start start 2026-02-12T18:14:51.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.809+0000 7f9e1c0cc640 10 monclient: init 2026-02-12T18:14:51.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.809+0000 7f9e1c0cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:51.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.809+0000 7f9e1c0cc640 10 monclient: _add_conns ranks=[3,5,6,2,7,4,0,8,1] 2026-02-12T18:14:51.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.809+0000 7f9e1c0cc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9dfc0451a0 0x7f9e141312a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.809+0000 7f9e1c0cc640 10 monclient(hunting): picked mon.noname-g con 0x7f9dfc0451a0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:14:51.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.809+0000 7f9e1c0cc640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e1408a680 0x7f9e1408aab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.809+0000 7f9e1c0cc640 10 monclient(hunting): picked mon.noname-h con 0x7f9e1408a680 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:14:51.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.809+0000 7f9e1c0cc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9e1408aff0 0x7f9e14115a60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1c0cc640 10 monclient(hunting): picked mon.noname-d con 0x7f9e1408aff0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:14:51.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1c0cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1c0cc640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f9e1410ef40 con 0x7f9dfc0451a0 2026-02-12T18:14:51.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1c0cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1c0cc640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f9e14132190 con 0x7f9e1408a680 2026-02-12T18:14:51.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1c0cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1c0cc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f9e1413dcd0 con 0x7f9e1408aff0 2026-02-12T18:14:51.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1c0cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:51.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1c0cc640 10 monclient(hunting): authenticate will time out at 1130.536015s 2026-02-12T18:14:51.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1a642640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9e1408aff0 0x7f9e14115a60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1a642640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9e1408aff0 0x7f9e14115a60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:36008/0 (socket says 10.20.193.48:36008) 2026-02-12T18:14:51.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1a642640 1 -- 10.20.193.48:0/1758612535 learned_addr learned my addr 10.20.193.48:0/1758612535 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:51.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1a642640 10 monclient(hunting): get_auth_request con 0x7f9e1408aff0 auth_method 0 2026-02-12T18:14:51.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1a642640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1a642640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1a642640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1a642640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:51.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1a642640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:51.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1a642640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:51.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e19640640 1 --2- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e1408a680 0x7f9e1408aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e19e41640 1 --2- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9dfc0451a0 0x7f9e141312a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e19e41640 10 monclient(hunting): get_auth_request con 0x7f9dfc0451a0 auth_method 0 2026-02-12T18:14:51.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e19e41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e19e41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e19e41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e19640640 10 monclient(hunting): get_auth_request con 0x7f9e1408a680 auth_method 0 2026-02-12T18:14:51.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e19640640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e19640640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e19640640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1a642640 10 monclient(hunting): handle_auth_done global_id 104181 payload 824 2026-02-12T18:14:51.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1a642640 1 -- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e1408a680 msgr2=0x7f9e1408aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1a642640 1 --2- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e1408a680 0x7f9e1408aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1a642640 1 -- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9dfc0451a0 msgr2=0x7f9e141312a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1a642640 1 --2- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9dfc0451a0 0x7f9e141312a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:51.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1a642640 10 monclient: _finish_hunting 0 2026-02-12T18:14:51.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1a642640 1 monclient: found mon.noname-d 2026-02-12T18:14:51.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1a642640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:51.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1a642640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:14:51.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.810+0000 7f9e1a642640 1 -- 10.20.193.48:0/1758612535 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e140904b0 con 0x7f9e1408aff0 2026-02-12T18:14:51.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.812+0000 7f9e1a642640 1 -- 10.20.193.48:0/1758612535 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9e1408aff0 msgr2=0x7f9e14115a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:51.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.812+0000 7f9e1a642640 1 --2- 10.20.193.48:0/1758612535 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9e1408aff0 0x7f9e14115a60 secure :-1 s=READY pgs=20 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e1000aae0 tx=0x7f9e100058c0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:51.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.812+0000 7f9e027fc640 1 -- 10.20.193.48:0/1758612535 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9e10022070 con 0x7f9e1408aff0 2026-02-12T18:14:51.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.812+0000 7f9e027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:51.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.812+0000 7f9e027fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:14:51.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.812+0000 7f9e027fc640 10 monclient: dump: 2026-02-12T18:14:51.833 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:51.833 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.833 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.833 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.833 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:51.833 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.833 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:51.833 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:51.833 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:51.833 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:51.833 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:51.834 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:51.834 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:51.834 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:51.834 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:51.834 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.812+0000 7f9e027fc640 10 monclient: _finish_auth 0 2026-02-12T18:14:51.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.812+0000 7f9e027fc640 10 monclient: _check_auth_tickets 2026-02-12T18:14:51.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.812+0000 7f9e027fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:51.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.812+0000 7f9e027fc640 1 -- 10.20.193.48:0/1758612535 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e1000fc20 con 0x7f9e1408aff0 2026-02-12T18:14:51.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.812+0000 7f9e027fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:51.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.812+0000 7f9e027fc640 1 -- 10.20.193.48:0/1758612535 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9e10014df0 con 0x7f9e1408aff0 2026-02-12T18:14:51.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.812+0000 7f9e027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:51.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.812+0000 7f9e027fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:14:51.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.812+0000 7f9e03fff640 4 set_mon_vals no callback set 2026-02-12T18:14:51.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.812+0000 7f9e027fc640 10 monclient: dump: 2026-02-12T18:14:51.835 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:51.835 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.835 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.835 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.835 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:51.835 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.835 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:51.835 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:51.835 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:51.836 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:51.836 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:51.836 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:51.836 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:51.836 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:51.836 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:51.836 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.836 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.812+0000 7f9e1c0cc640 5 monclient: authenticate success, global_id 104181 2026-02-12T18:14:51.836 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.812+0000 7f9e1c0cc640 10 monclient: _renew_subs 2026-02-12T18:14:51.836 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.812+0000 7f9e1c0cc640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:14:51.836 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.812+0000 7f9e1c0cc640 1 -- 10.20.193.48:0/1758612535 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e1408be40 con 0x7f9e1408aff0 2026-02-12T18:14:51.836 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.812+0000 7f9e1c0cc640 10 monclient: _renew_subs 2026-02-12T18:14:51.836 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.812+0000 7f9e1c0cc640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:14:51.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.812+0000 7f9e1c0cc640 1 -- 10.20.193.48:0/1758612535 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e1410ec60 con 0x7f9e1408aff0 2026-02-12T18:14:51.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.813+0000 7f9e1c0cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:51.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.813+0000 7f9e1c0cc640 1 --2- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e14091010 0x7f9e14058a50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.813+0000 7f9e1c0cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.813+0000 7f9e1c0cc640 1 -- 10.20.193.48:0/1758612535 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f9e140631f0 con 0x7f9e14091010 2026-02-12T18:14:51.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.813+0000 7f9e027fc640 1 -- 10.20.193.48:0/1758612535 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f9e10012070 con 0x7f9e1408aff0 2026-02-12T18:14:51.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.813+0000 7f9e19e41640 1 --2- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e14091010 0x7f9e14058a50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.813+0000 7f9e19e41640 10 monclient: get_auth_request con 0x7f9e14091010 auth_method 0 2026-02-12T18:14:51.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.813+0000 7f9e19e41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.813+0000 7f9e19e41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.813+0000 7f9e19e41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.837 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.813+0000 7f9e027fc640 1 --2- 10.20.193.48:0/1758612535 >> v2:10.20.193.111:6812/977811348 conn(0x7f9de403f730 0x7f9de405fbe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.813+0000 7f9e027fc640 1 -- 10.20.193.48:0/1758612535 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(317..317 src has 215..317) ==== 3897+0+0 (secure 0 0 0) 0x7f9e10054500 con 0x7f9e1408aff0 2026-02-12T18:14:51.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.813+0000 7f9e19e41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:51.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.813+0000 7f9e19e41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:51.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.813+0000 7f9e19e41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:51.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.813+0000 7f9e19640640 1 --2- 10.20.193.48:0/1758612535 >> v2:10.20.193.111:6812/977811348 conn(0x7f9de403f730 0x7f9de405fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.813+0000 7f9e19640640 10 monclient: get_auth_request con 0x7f9de403f730 auth_method 0 2026-02-12T18:14:51.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.813+0000 7f9e19e41640 10 monclient(hunting): handle_auth_done global_id 104135 payload 824 2026-02-12T18:14:51.838 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.813+0000 7f9e19e41640 1 -- 10.20.193.48:0/1758612535 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9e14090330 con 0x7f9e14091010 2026-02-12T18:14:51.840 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.816+0000 7f9e19640640 1 --2- 10.20.193.48:0/1758612535 >> v2:10.20.193.111:6812/977811348 conn(0x7f9de403f730 0x7f9de405fbe0 secure :-1 s=READY pgs=445 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e14131200 tx=0x7f9e08008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:51.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.816+0000 7f9e19e41640 1 -- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e14091010 msgr2=0x7f9e14058a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:51.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.816+0000 7f9e19e41640 1 --2- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e14091010 0x7f9e14058a50 secure :-1 s=READY pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e14058220 tx=0x7f9e04004770 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:51.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.816+0000 7f9e027fc640 1 -- 10.20.193.48:0/1758612535 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9e0403f070 con 0x7f9e14091010 2026-02-12T18:14:51.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.816+0000 7f9e027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:51.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.816+0000 7f9e027fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:14:51.841 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.816+0000 7f9e027fc640 10 monclient: dump: 2026-02-12T18:14:51.841 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:51.841 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:51.841 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.841 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:51.841 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:51.841 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:51.842 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:51.842 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:51.842 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:51.842 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:51.842 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:51.842 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:51.842 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:51.842 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:51.842 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:51.842 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:51.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.816+0000 7f9e027fc640 1 -- 10.20.193.48:0/1758612535 <== mon.5 v2:10.20.193.111:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f9e04004590 con 0x7f9e14091010 2026-02-12T18:14:51.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.816+0000 7f9e027fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:51.842 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.816+0000 7f9e027fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:14:51.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.816+0000 7f9e027fc640 1 -- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e14091010 msgr2=0x7f9e14058a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:51.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.816+0000 7f9e027fc640 1 --2- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e14091010 0x7f9e14058a50 secure :-1 s=READY pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e14058220 tx=0x7f9e04004770 comp rx=0 tx=0).stop 2026-02-12T18:14:51.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.816+0000 7f9e027fc640 1 -- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e14091010 msgr2=0x7f9e14058a50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:51.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.816+0000 7f9e027fc640 1 --2- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e14091010 0x7f9e14058a50 secure :-1 s=CLOSED pgs=12 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e14058220 tx=0x7f9e04004770 comp rx=0 tx=0).stop 2026-02-12T18:14:51.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.819+0000 7f9e1c0cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:14:51.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.819+0000 7f9e1c0cc640 1 --2- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e141317e0 0x7f9e14058f90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:51.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.819+0000 7f9e1c0cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:51.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.819+0000 7f9e1c0cc640 1 -- 10.20.193.48:0/1758612535 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f9e14050410 con 0x7f9e141317e0 2026-02-12T18:14:51.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.820+0000 7f9e19e41640 1 --2- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e141317e0 0x7f9e14058f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:51.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.820+0000 7f9e19e41640 10 monclient: get_auth_request con 0x7f9e141317e0 auth_method 0 2026-02-12T18:14:51.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.820+0000 7f9e19e41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:51.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.820+0000 7f9e19e41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:51.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.820+0000 7f9e19e41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:51.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.820+0000 7f9e19e41640 1 -- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e141317e0 msgr2=0x7f9e14058f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-12T18:14:51.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.820+0000 7f9e19e41640 1 -- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e141317e0 msgr2=0x7f9e14058f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:14:51.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.820+0000 7f9e19e41640 1 --2- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e141317e0 0x7f9e14058f90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:51.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:51.820+0000 7f9e19e41640 1 --2- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e141317e0 0x7f9e14058f90 unknown :-1 s=START_CONNECT pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:14:52.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.022+0000 7f9e19e41640 1 --2- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e141317e0 0x7f9e14058f90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:52.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.022+0000 7f9e19e41640 10 monclient: get_auth_request con 0x7f9e141317e0 auth_method 0 2026-02-12T18:14:52.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.022+0000 7f9e19e41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:52.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.022+0000 7f9e19e41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:52.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.022+0000 7f9e19e41640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:14:52.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.022+0000 7f9e19e41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:52.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.022+0000 7f9e19e41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:52.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.022+0000 7f9e19e41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:52.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.022+0000 7f9e19e41640 10 monclient(hunting): handle_auth_done global_id 104153 payload 824 2026-02-12T18:14:52.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.022+0000 7f9e19e41640 1 -- 10.20.193.48:0/1758612535 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9e1405e310 con 0x7f9e141317e0 2026-02-12T18:14:52.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.025+0000 7f9e19e41640 1 -- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e141317e0 msgr2=0x7f9e14058f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:52.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.025+0000 7f9e19e41640 1 --2- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e141317e0 0x7f9e14058f90 secure :-1 s=READY pgs=13 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e0402ffd0 tx=0x7f9e0402ee20 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:52.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.025+0000 7f9e027fc640 1 -- 10.20.193.48:0/1758612535 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9e0404f070 con 0x7f9e141317e0 2026-02-12T18:14:52.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.025+0000 7f9e027fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:52.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.025+0000 7f9e027fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:14:52.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.025+0000 7f9e027fc640 10 monclient: dump: 2026-02-12T18:14:52.028 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:52.028 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:52.028 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:52.028 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:52.028 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:52.028 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:52.028 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:52.028 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:52.028 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:52.028 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:52.028 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:52.028 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:52.029 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:52.029 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:52.029 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:52.029 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:52.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.025+0000 7f9e027fc640 1 -- 10.20.193.48:0/1758612535 <== mon.5 v2:10.20.193.111:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7f9e040495b0 con 0x7f9e141317e0 2026-02-12T18:14:52.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.025+0000 7f9e027fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:14:52.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.025+0000 7f9e027fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:14:52.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.025+0000 7f9e027fc640 1 -- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e141317e0 msgr2=0x7f9e14058f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:52.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.025+0000 7f9e027fc640 1 --2- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e141317e0 0x7f9e14058f90 secure :-1 s=READY pgs=13 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e0402ffd0 tx=0x7f9e0402ee20 comp rx=0 tx=0).stop 2026-02-12T18:14:52.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.025+0000 7f9e027fc640 1 -- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e141317e0 msgr2=0x7f9e14058f90 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:52.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.025+0000 7f9e027fc640 1 --2- 10.20.193.48:0/1758612535 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9e141317e0 0x7f9e14058f90 secure :-1 s=CLOSED pgs=13 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e0402ffd0 tx=0x7f9e0402ee20 comp rx=0 tx=0).stop 2026-02-12T18:14:52.030 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:14:52.030 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:14:52.030 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:14:52.030 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:14:52.030 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 76, 2026-02-12T18:14:52.030 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 11092, 2026-02-12T18:14:52.031 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:14:52.031 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:14:52.031 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:14:52.031 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:14:52.031 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:14:52.031 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:14:52.031 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:14:52.031 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:14:52.031 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:14:52.031 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:14:52.031 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:52.032 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 5, 2026-02-12T18:14:52.032 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:52.032 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:14:52.032 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:14:52.032 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:52.032 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:52.032 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:52.032 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:52.032 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:52.032 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:52.032 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:52.032 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:52.033 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:52.033 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:52.033 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:52.033 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:52.033 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:52.033 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:52.033 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:14:52.033 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:14:52.033 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:52.033 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:52.033 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:52.034 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:52.034 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:52.034 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:52.034 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:52.034 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:52.034 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:52.034 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:52.034 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:52.034 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:52.034 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:52.034 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:52.034 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.035 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:14:52.035 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:14:52.035 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:14:52.035 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:14:52.035 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:14:52.035 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:14:52.035 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:52.035 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:52.035 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:14:52.035 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:14:52.036 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:14:52.036 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:14:52.036 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:14:52.036 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:14:52.036 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:14:52.036 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:52.036 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:14:52.036 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:52.036 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:52.036 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:52.036 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:52.036 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:52.037 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:52.037 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:52.037 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:52.037 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:52.037 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:52.037 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:52.037 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:52.037 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:52.037 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:52.037 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:14:52.038 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.038 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:14:52.038 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.038 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:14:52.038 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:14:52.038 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:52.038 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:52.038 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.038 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:52.038 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:14:52.038 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.039 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.039 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.039 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:52.039 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:14:52.039 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.039 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:52.039 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:52.039 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.039 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:14:52.039 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:14:52.039 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:52.039 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:52.040 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:14:52.040 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:52.040 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.040 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.040 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:14:52.040 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:14:52.040 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:52.040 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:52.040 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.040 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:52.040 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:14:52.041 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.041 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.041 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.041 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:52.041 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:14:52.041 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.041 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:52.041 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:52.041 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.041 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:14:52.041 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:14:52.041 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:52.042 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:52.042 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:14:52.042 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:52.042 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.042 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.042 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:14:52.042 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:14:52.042 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:52.042 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:52.042 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.042 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:52.043 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:14:52.043 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.043 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.043 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.043 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:52.043 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:14:52.043 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.043 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:52.043 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:52.043 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.043 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:14:52.043 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:14:52.044 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:52.044 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:52.044 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:14:52.044 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:52.044 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.044 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.044 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:14:52.044 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:14:52.044 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:52.044 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:52.044 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.044 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:52.044 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:14:52.045 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.045 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.045 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.045 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:52.045 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:14:52.045 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.045 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:52.045 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:52.045 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.045 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:14:52.045 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:14:52.046 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:52.046 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:52.046 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:14:52.046 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:52.046 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.046 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.046 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:14:52.046 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:14:52.046 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:52.046 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:52.046 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.046 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:52.047 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:14:52.047 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.047 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.047 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.047 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:52.047 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:14:52.047 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.047 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:52.047 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:52.047 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.047 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:14:52.047 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:14:52.048 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:52.048 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:52.048 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:52.048 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:52.048 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.048 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.048 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:14:52.048 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:14:52.048 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:52.048 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:52.048 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.048 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:52.049 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:14:52.049 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.049 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.049 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.049 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:52.049 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:14:52.049 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.049 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:52.049 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:52.049 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.049 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:14:52.050 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:14:52.050 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:52.050 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:52.050 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:14:52.050 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:52.050 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.050 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.050 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:14:52.050 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:14:52.050 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:52.051 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:52.051 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.051 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:52.051 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:14:52.051 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.051 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.051 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.051 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:52.051 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:14:52.051 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.051 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:52.052 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:52.052 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.052 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:14:52.052 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:14:52.052 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:52.052 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:52.052 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:52.052 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:52.052 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.052 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.052 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:14:52.053 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:14:52.053 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:52.053 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:52.053 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.053 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:52.053 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:14:52.053 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.053 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.053 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.053 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:52.054 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:14:52.054 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.054 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:52.054 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:52.054 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.054 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:14:52.054 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:14:52.054 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:52.054 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:52.054 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:14:52.054 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:52.054 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.055 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.055 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:14:52.055 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:14:52.055 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:52.055 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:52.055 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.055 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:52.055 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:14:52.055 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.055 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.055 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.055 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:52.056 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:14:52.056 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.056 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:52.056 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:52.056 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.056 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:14:52.056 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:14:52.056 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:52.056 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:52.056 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:14:52.056 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:52.056 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:52.056 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:52.057 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.057 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:14:52.057 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:14:52.057 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.057 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:52.057 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:52.057 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:52.057 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:52.057 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:52.057 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:14:52.057 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.057 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:52.057 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:52.058 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:52.058 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:52.058 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:52.058 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.058 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:14:52.058 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:14:52.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.025+0000 7f9e1c0cc640 1 -- 10.20.193.48:0/1758612535 >> v2:10.20.193.111:6812/977811348 conn(0x7f9de403f730 msgr2=0x7f9de405fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:52.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.025+0000 7f9e1c0cc640 1 --2- 10.20.193.48:0/1758612535 >> v2:10.20.193.111:6812/977811348 conn(0x7f9de403f730 0x7f9de405fbe0 secure :-1 s=READY pgs=445 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e14131200 tx=0x7f9e08008040 comp rx=0 tx=0).stop 2026-02-12T18:14:52.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.025+0000 7f9e1c0cc640 10 monclient: shutdown 2026-02-12T18:14:52.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.025+0000 7f9e1c0cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:52.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.025+0000 7f9e1c0cc640 1 -- 10.20.193.48:0/1758612535 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9e1408aff0 msgr2=0x7f9e14115a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:52.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.025+0000 7f9e1c0cc640 1 --2- 10.20.193.48:0/1758612535 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9e1408aff0 0x7f9e14115a60 secure :-1 s=READY pgs=20 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9e1000aae0 tx=0x7f9e100058c0 comp rx=0 tx=0).stop 2026-02-12T18:14:52.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.025+0000 7f9e1a642640 1 -- 10.20.193.48:0/1758612535 reap_dead start 2026-02-12T18:14:52.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.025+0000 7f9e1a642640 1 -- 10.20.193.48:0/1758612535 reap_dead start 2026-02-12T18:14:52.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.025+0000 7f9e1c0cc640 1 -- 10.20.193.48:0/1758612535 shutdown_connections 2026-02-12T18:14:52.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.025+0000 7f9e1c0cc640 1 -- 10.20.193.48:0/1758612535 >> 10.20.193.48:0/1758612535 conn(0x7f9e140546a0 msgr2=0x7f9e14122c90 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:52.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.025+0000 7f9e1c0cc640 1 -- 10.20.193.48:0/1758612535 shutdown_connections 2026-02-12T18:14:52.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.025+0000 7f9e1c0cc640 1 -- 10.20.193.48:0/1758612535 wait complete. 2026-02-12T18:14:52.061 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:14:52.062 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2026-02-12T18:14:52.062 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2026-02-12T18:14:52.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.126+0000 7f2f4bec3640 10 monclient: get_monmap_and_config 2026-02-12T18:14:52.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.126+0000 7f2f4bec3640 10 monclient: build_initial_monmap 2026-02-12T18:14:52.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.126+0000 7f2f4bec3640 10 monclient: monmap: 2026-02-12T18:14:52.128 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:52.128 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:52.128 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:14:52.127385+0000 2026-02-12T18:14:52.128 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:14:52.127385+0000 2026-02-12T18:14:52.128 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:52.128 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:52.128 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:14:52.128 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:14:52.129 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:52.129 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:52.129 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:52.129 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:52.129 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:52.129 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:52.129 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:52.129 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:14:52.129 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:14:52.129 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:52.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.126+0000 7f2f4bec3640 1 Processor -- start 2026-02-12T18:14:52.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.126+0000 7f2f4bec3640 1 -- start start 2026-02-12T18:14:52.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.126+0000 7f2f4bec3640 10 monclient: init 2026-02-12T18:14:52.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f4bec3640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:52.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f4bec3640 10 monclient: _add_conns ranks=[2,1,0,8,10,4,5,9,6,7,3] 2026-02-12T18:14:52.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f4bec3640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2f4408ff60 0x7f2f44140f10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:52.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f4bec3640 10 monclient(hunting): picked mon.noname-b con 0x7f2f4408ff60 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:14:52.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f4bec3640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f2f44090330 addr v1:10.20.193.111:6789/0 2026-02-12T18:14:52.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f4bec3640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f2f44090700 addr v1:10.20.193.48:6789/0 2026-02-12T18:14:52.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f4bec3640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f4404dc20 con 0x7f2f44090700 2026-02-12T18:14:52.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f4bec3640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f4408edc0 con 0x7f2f44090330 2026-02-12T18:14:52.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f4bec3640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:52.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f4bec3640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f2f4405eb90 con 0x7f2f4408ff60 2026-02-12T18:14:52.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f4bec3640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:52.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f4bec3640 10 monclient(hunting): authenticate will time out at 1130.853151s 2026-02-12T18:14:52.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f49c38640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2f4408ff60 0x7f2f44140f10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:52.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f4a439640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f2f44090700 0x7f2f4408a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:53408/0 (socket says 10.20.193.48:53408) 2026-02-12T18:14:52.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f4a439640 1 -- 10.20.193.48:0/1265727429 learned_addr learned my addr 10.20.193.48:0/1265727429 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:14:52.141 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f49c38640 10 monclient(hunting): get_auth_request con 0x7f2f4408ff60 auth_method 0 2026-02-12T18:14:52.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f49c38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:52.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f49c38640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:52.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f49c38640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:52.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f49c38640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:52.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f49c38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:52.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f49c38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:52.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f49c38640 10 monclient(hunting): handle_auth_done global_id 36470 payload 274 2026-02-12T18:14:52.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f49c38640 1 -- 10.20.193.48:0/1265727429 >> v1:10.20.193.111:6789/0 conn(0x7f2f44090330 legacy=0x7f2f4408a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:52.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f49c38640 1 -- 10.20.193.48:0/1265727429 >> v1:10.20.193.48:6789/0 conn(0x7f2f44090700 legacy=0x7f2f4408a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:52.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f49c38640 10 monclient: _finish_hunting 0 2026-02-12T18:14:52.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f49c38640 1 monclient: found mon.noname-b 2026-02-12T18:14:52.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f49c38640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:52.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f49c38640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:14:52.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.127+0000 7f2f49c38640 1 -- 10.20.193.48:0/1265727429 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f4405d4a0 con 0x7f2f4408ff60 2026-02-12T18:14:52.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f49c38640 1 -- 10.20.193.48:0/1265727429 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2f4408ff60 msgr2=0x7f2f44140f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:52.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f49c38640 1 --2- 10.20.193.48:0/1265727429 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2f4408ff60 0x7f2f44140f10 secure :-1 s=READY pgs=390 gs=3 cs=0 l=1 c_cookie=12635878630163005913 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f34009800 tx=0x7f2f3402ecf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af5ba8aa97d0c1d9 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:52.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f48c36640 1 -- 10.20.193.48:0/1265727429 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2f34035340 con 0x7f2f4408ff60 2026-02-12T18:14:52.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f48c36640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:52.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f48c36640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:14:52.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f48c36640 10 monclient: dump: 2026-02-12T18:14:52.143 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:52.143 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:52.143 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:52.143 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:52.144 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:52.144 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:52.144 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:52.144 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:52.144 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:52.144 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:52.144 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:52.144 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:52.144 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:52.144 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:52.144 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:52.144 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:52.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f48c36640 10 monclient: _finish_auth 0 2026-02-12T18:14:52.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f48c36640 10 monclient: _check_auth_tickets 2026-02-12T18:14:52.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f48c36640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:52.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f4bec3640 5 monclient: authenticate success, global_id 36470 2026-02-12T18:14:52.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f48c36640 1 -- 10.20.193.48:0/1265727429 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f340354c0 con 0x7f2f4408ff60 2026-02-12T18:14:52.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f4bec3640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:14:52.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f48c36640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:52.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f4bec3640 10 monclient: get_monmap_and_config success 2026-02-12T18:14:52.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f48c36640 1 -- 10.20.193.48:0/1265727429 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2f34035af0 con 0x7f2f4408ff60 2026-02-12T18:14:52.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f4bec3640 4 set_mon_vals no callback set 2026-02-12T18:14:52.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f48c36640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:52.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f48c36640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:14:52.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f48c36640 10 monclient: dump: 2026-02-12T18:14:52.146 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:52.146 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:52.146 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:52.146 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:52.146 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:52.146 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:52.146 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:52.146 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:52.146 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:52.146 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:52.146 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:52.146 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:52.147 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:52.147 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:52.147 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:52.147 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:52.147 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f4bec3640 10 monclient: shutdown 2026-02-12T18:14:52.147 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f4bec3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:52.147 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f4bec3640 1 -- 10.20.193.48:0/1265727429 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2f4408ff60 msgr2=0x7f2f44140f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:52.147 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f4bec3640 1 --2- 10.20.193.48:0/1265727429 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2f4408ff60 0x7f2f44140f10 secure :-1 s=READY pgs=390 gs=3 cs=0 l=1 c_cookie=12635878630163005913 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f34009800 tx=0x7f2f3402ecf0 comp rx=0 tx=0).stop 2026-02-12T18:14:52.147 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f4bec3640 1 -- 10.20.193.48:0/1265727429 shutdown_connections 2026-02-12T18:14:52.147 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f4bec3640 1 --2- 10.20.193.48:0/1265727429 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f2f4408ff60 0x7f2f44140f10 unknown :-1 s=CLOSED pgs=390 gs=3 cs=0 l=1 c_cookie=12635878630163005913 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:52.147 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f4bec3640 1 -- 10.20.193.48:0/1265727429 >> 10.20.193.48:0/1265727429 conn(0x7f2f44094420 msgr2=0x7f2f44094820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:52.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f4bec3640 1 -- 10.20.193.48:0/1265727429 shutdown_connections 2026-02-12T18:14:52.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f4bec3640 1 -- 10.20.193.48:0/1265727429 wait complete. 2026-02-12T18:14:52.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f4bec3640 10 monclient: build_initial_monmap 2026-02-12T18:14:52.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.130+0000 7f2f4bec3640 10 monclient: monmap: 2026-02-12T18:14:52.148 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:52.148 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:14:52.148 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:14:52.148 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:14:52.148 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:52.148 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:52.148 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:14:52.148 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:14:52.149 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:52.149 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:52.149 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:52.149 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:52.149 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:52.149 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:52.149 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:52.149 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:52.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4bec3640 1 Processor -- start 2026-02-12T18:14:52.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4bec3640 1 -- start start 2026-02-12T18:14:52.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4bec3640 10 monclient: init 2026-02-12T18:14:52.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4bec3640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:52.149 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4bec3640 10 monclient: _add_conns ranks=[3,5,1,2,0,6,4,7,8] 2026-02-12T18:14:52.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4bec3640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2f4408ff60 0x7f2f441274f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:52.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4bec3640 10 monclient(hunting): picked mon.noname-g con 0x7f2f4408ff60 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:14:52.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4bec3640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f2f44090330 0x7f2f44127a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:52.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4bec3640 10 monclient(hunting): picked mon.noname-h con 0x7f2f44090330 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:14:52.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4bec3640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2f44090700 0x7f2f44127f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:52.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4bec3640 10 monclient(hunting): picked mon.noname-f con 0x7f2f44090700 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:14:52.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4bec3640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:52.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4bec3640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f2f44129720 con 0x7f2f44090700 2026-02-12T18:14:52.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4bec3640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:52.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4bec3640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f2f4413f0a0 con 0x7f2f4408ff60 2026-02-12T18:14:52.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4bec3640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:52.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4bec3640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f2f44129af0 con 0x7f2f44090330 2026-02-12T18:14:52.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4bec3640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:52.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4bec3640 10 monclient(hunting): authenticate will time out at 1130.857460s 2026-02-12T18:14:52.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4a439640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2f44090700 0x7f2f44127f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:52.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4a439640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2f44090700 0x7f2f44127f70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3300/0 says I am v2:10.20.193.48:34720/0 (socket says 10.20.193.48:34720) 2026-02-12T18:14:52.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4a439640 1 -- 10.20.193.48:0/2150278328 learned_addr learned my addr 10.20.193.48:0/2150278328 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:52.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4a439640 10 monclient(hunting): get_auth_request con 0x7f2f44090700 auth_method 0 2026-02-12T18:14:52.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4a439640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:52.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4a439640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:52.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4a439640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:52.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f49437640 1 --2- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f2f44090330 0x7f2f44127a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:52.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f49437640 10 monclient(hunting): get_auth_request con 0x7f2f44090330 auth_method 0 2026-02-12T18:14:52.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f49437640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:52.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f49437640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:52.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f49437640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:52.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f49c38640 1 --2- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2f4408ff60 0x7f2f441274f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:52.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f49c38640 10 monclient(hunting): get_auth_request con 0x7f2f4408ff60 auth_method 0 2026-02-12T18:14:52.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f49c38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:52.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f49c38640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:52.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f49c38640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:52.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4a439640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:52.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4a439640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:52.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4a439640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:52.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f49437640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:52.152 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f49437640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:52.153 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f49437640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:52.153 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f49c38640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:52.153 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f49c38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:52.153 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f49c38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:52.153 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4a439640 10 monclient(hunting): handle_auth_done global_id 94861 payload 824 2026-02-12T18:14:52.153 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4a439640 1 -- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f2f44090330 msgr2=0x7f2f44127a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:52.153 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4a439640 1 --2- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f2f44090330 0x7f2f44127a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:52.153 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4a439640 1 -- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2f4408ff60 msgr2=0x7f2f441274f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:52.153 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.131+0000 7f2f4a439640 1 --2- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f2f4408ff60 0x7f2f441274f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:52.153 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.132+0000 7f2f4a439640 10 monclient: _finish_hunting 0 2026-02-12T18:14:52.153 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.132+0000 7f2f4a439640 1 monclient: found mon.noname-f 2026-02-12T18:14:52.153 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.132+0000 7f2f4a439640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:52.153 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.132+0000 7f2f4a439640 10 monclient: _send_mon_message to mon.noname-f at v2:10.20.193.111:3300/0 2026-02-12T18:14:52.154 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.132+0000 7f2f4a439640 1 -- 10.20.193.48:0/2150278328 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f34009420 con 0x7f2f44090700 2026-02-12T18:14:52.154 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.134+0000 7f2f4a439640 1 -- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2f44090700 msgr2=0x7f2f44127f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:52.154 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.134+0000 7f2f4a439640 1 --2- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2f44090700 0x7f2f44127f70 secure :-1 s=READY pgs=156 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f4000d500 tx=0x7f2f4000d9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:52.154 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.134+0000 7f2f327fc640 1 -- 10.20.193.48:0/2150278328 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2f40006e90 con 0x7f2f44090700 2026-02-12T18:14:52.154 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.134+0000 7f2f327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:52.154 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.134+0000 7f2f327fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2026-02-12T18:14:52.154 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.134+0000 7f2f327fc640 10 monclient: dump: 2026-02-12T18:14:52.154 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:52.154 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:52.154 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:52.154 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:52.154 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:52.154 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:52.155 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:52.155 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:52.155 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:52.155 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:52.155 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:52.155 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:52.155 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:52.155 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:52.155 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:52.155 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:52.155 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.134+0000 7f2f327fc640 10 monclient: _finish_auth 0 2026-02-12T18:14:52.155 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.134+0000 7f2f327fc640 10 monclient: _check_auth_tickets 2026-02-12T18:14:52.155 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.134+0000 7f2f327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:52.155 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.134+0000 7f2f4bec3640 5 monclient: authenticate success, global_id 94861 2026-02-12T18:14:52.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.134+0000 7f2f4bec3640 10 monclient: _renew_subs 2026-02-12T18:14:52.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.134+0000 7f2f4bec3640 10 monclient: _send_mon_message to mon.f at v2:10.20.193.111:3300/0 2026-02-12T18:14:52.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.134+0000 7f2f4bec3640 1 -- 10.20.193.48:0/2150278328 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f4412ac40 con 0x7f2f44090700 2026-02-12T18:14:52.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.134+0000 7f2f327fc640 1 -- 10.20.193.48:0/2150278328 <== mon.1 v2:10.20.193.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f40008070 con 0x7f2f44090700 2026-02-12T18:14:52.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.134+0000 7f2f327fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:52.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.134+0000 7f2f327fc640 1 -- 10.20.193.48:0/2150278328 <== mon.1 v2:10.20.193.111:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2f400086a0 con 0x7f2f44090700 2026-02-12T18:14:52.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.134+0000 7f2f327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:52.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.134+0000 7f2f327fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:14:52.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.134+0000 7f2f33fff640 4 set_mon_vals no callback set 2026-02-12T18:14:52.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.134+0000 7f2f327fc640 10 monclient: dump: 2026-02-12T18:14:52.156 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:52.156 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:52.156 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:52.156 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:52.157 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:52.157 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:52.157 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:52.157 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:52.157 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:52.157 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:52.157 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:52.157 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:52.157 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:52.157 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:52.157 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:52.157 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:52.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.134+0000 7f2f4bec3640 10 monclient: _renew_subs 2026-02-12T18:14:52.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.134+0000 7f2f4bec3640 10 monclient: _send_mon_message to mon.f at v2:10.20.193.111:3300/0 2026-02-12T18:14:52.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.134+0000 7f2f4bec3640 1 -- 10.20.193.48:0/2150278328 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f44143670 con 0x7f2f44090700 2026-02-12T18:14:52.157 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.135+0000 7f2f4bec3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:52.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.135+0000 7f2f4bec3640 1 --2- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2f4404d1c0 0x7f2f4404d590 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:52.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.135+0000 7f2f4bec3640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:52.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.135+0000 7f2f4bec3640 1 -- 10.20.193.48:0/2150278328 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f2f44056980 con 0x7f2f4404d1c0 2026-02-12T18:14:52.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.135+0000 7f2f49c38640 1 --2- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2f4404d1c0 0x7f2f4404d590 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:52.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.135+0000 7f2f49c38640 10 monclient: get_auth_request con 0x7f2f4404d1c0 auth_method 0 2026-02-12T18:14:52.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.135+0000 7f2f49c38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:52.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.135+0000 7f2f49c38640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:52.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.135+0000 7f2f49c38640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:52.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.135+0000 7f2f327fc640 1 -- 10.20.193.48:0/2150278328 <== mon.1 v2:10.20.193.111:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f2f400081e0 con 0x7f2f44090700 2026-02-12T18:14:52.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.135+0000 7f2f49c38640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:52.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.135+0000 7f2f49c38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:52.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.135+0000 7f2f49c38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:52.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.135+0000 7f2f327fc640 1 --2- 10.20.193.48:0/2150278328 >> v2:10.20.193.111:6812/977811348 conn(0x7f2f1403f800 0x7f2f1405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:52.158 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.135+0000 7f2f327fc640 1 -- 10.20.193.48:0/2150278328 <== mon.1 v2:10.20.193.111:3300/0 5 ==== osd_map(317..317 src has 215..317) ==== 3897+0+0 (secure 0 0 0) 0x7f2f400530c0 con 0x7f2f44090700 2026-02-12T18:14:52.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.135+0000 7f2f49c38640 10 monclient(hunting): handle_auth_done global_id 94723 payload 824 2026-02-12T18:14:52.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.135+0000 7f2f49c38640 1 -- 10.20.193.48:0/2150278328 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f4405e820 con 0x7f2f4404d1c0 2026-02-12T18:14:52.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.135+0000 7f2f49437640 1 --2- 10.20.193.48:0/2150278328 >> v2:10.20.193.111:6812/977811348 conn(0x7f2f1403f800 0x7f2f1405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:52.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.135+0000 7f2f49437640 10 monclient: get_auth_request con 0x7f2f1403f800 auth_method 0 2026-02-12T18:14:52.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.137+0000 7f2f49c38640 1 -- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2f4404d1c0 msgr2=0x7f2f4404d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:52.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.137+0000 7f2f49c38640 1 --2- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2f4404d1c0 0x7f2f4404d590 secure :-1 s=READY pgs=130 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f3402ed30 tx=0x7f2f34004770 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:52.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.138+0000 7f2f49437640 1 --2- 10.20.193.48:0/2150278328 >> v2:10.20.193.111:6812/977811348 conn(0x7f2f1403f800 0x7f2f1405fcb0 secure :-1 s=READY pgs=446 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f44127260 tx=0x7f2f38007ec0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:52.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.138+0000 7f2f327fc640 1 -- 10.20.193.48:0/2150278328 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2f340044f0 con 0x7f2f4404d1c0 2026-02-12T18:14:52.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.138+0000 7f2f327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:52.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.138+0000 7f2f327fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:14:52.159 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.138+0000 7f2f327fc640 10 monclient: dump: 2026-02-12T18:14:52.159 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:52.159 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:52.159 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:52.160 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:52.160 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:52.160 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:52.160 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:52.160 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:52.160 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:52.160 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:52.160 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:52.160 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:52.160 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:52.160 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:52.160 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:52.160 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:52.160 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.138+0000 7f2f327fc640 1 -- 10.20.193.48:0/2150278328 <== mon.7 v2:10.20.193.111:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f2f34004030 con 0x7f2f4404d1c0 2026-02-12T18:14:52.160 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.138+0000 7f2f327fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:52.160 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.138+0000 7f2f327fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:14:52.161 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.138+0000 7f2f327fc640 1 -- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2f4404d1c0 msgr2=0x7f2f4404d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:52.161 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.138+0000 7f2f327fc640 1 --2- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2f4404d1c0 0x7f2f4404d590 secure :-1 s=READY pgs=130 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f3402ed30 tx=0x7f2f34004770 comp rx=0 tx=0).stop 2026-02-12T18:14:52.161 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.138+0000 7f2f327fc640 1 -- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2f4404d1c0 msgr2=0x7f2f4404d590 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:52.161 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.138+0000 7f2f327fc640 1 --2- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2f4404d1c0 0x7f2f4404d590 secure :-1 s=CLOSED pgs=130 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f3402ed30 tx=0x7f2f34004770 comp rx=0 tx=0).stop 2026-02-12T18:14:52.163 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.141+0000 7f2f4bec3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:14:52.163 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.141+0000 7f2f4bec3640 1 --2- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2f44115920 0x7f2f44115d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:52.163 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.141+0000 7f2f4bec3640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:52.163 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.141+0000 7f2f4bec3640 1 -- 10.20.193.48:0/2150278328 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f2f44050410 con 0x7f2f44115920 2026-02-12T18:14:52.163 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.141+0000 7f2f49c38640 1 --2- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2f44115920 0x7f2f44115d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:52.163 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.141+0000 7f2f49c38640 10 monclient: get_auth_request con 0x7f2f44115920 auth_method 0 2026-02-12T18:14:52.163 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.141+0000 7f2f49c38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:52.163 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.141+0000 7f2f49c38640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:52.163 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.141+0000 7f2f49c38640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:52.163 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.141+0000 7f2f49c38640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:52.163 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.141+0000 7f2f49c38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:52.163 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.141+0000 7f2f49c38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:52.163 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.142+0000 7f2f49c38640 10 monclient(hunting): handle_auth_done global_id 94732 payload 824 2026-02-12T18:14:52.164 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.142+0000 7f2f49c38640 1 -- 10.20.193.48:0/2150278328 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2f4408b090 con 0x7f2f44115920 2026-02-12T18:14:52.164 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.144+0000 7f2f49c38640 1 -- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2f44115920 msgr2=0x7f2f44115d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:52.164 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.144+0000 7f2f49c38640 1 --2- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2f44115920 0x7f2f44115d20 secure :-1 s=READY pgs=131 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f340090b0 tx=0x7f2f34009210 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:52.164 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.144+0000 7f2f327fc640 1 -- 10.20.193.48:0/2150278328 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f2f34004650 con 0x7f2f44115920 2026-02-12T18:14:52.164 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.144+0000 7f2f327fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:52.164 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.144+0000 7f2f327fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:14:52.164 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.144+0000 7f2f327fc640 10 monclient: dump: 2026-02-12T18:14:52.164 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:52.164 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:52.164 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:52.164 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:52.164 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:52.164 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:52.164 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:52.164 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:52.164 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:52.164 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:52.165 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:52.165 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:52.165 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:52.165 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:52.165 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:52.165 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:52.165 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.144+0000 7f2f327fc640 1 -- 10.20.193.48:0/2150278328 <== mon.7 v2:10.20.193.111:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10349 (secure 0 0 0) 0x7f2f34037650 con 0x7f2f44115920 2026-02-12T18:14:52.165 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.144+0000 7f2f327fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:14:52.165 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.144+0000 7f2f327fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:14:52.165 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.144+0000 7f2f327fc640 1 -- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2f44115920 msgr2=0x7f2f44115d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:52.165 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.144+0000 7f2f327fc640 1 --2- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2f44115920 0x7f2f44115d20 secure :-1 s=READY pgs=131 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f340090b0 tx=0x7f2f34009210 comp rx=0 tx=0).stop 2026-02-12T18:14:52.165 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.144+0000 7f2f327fc640 1 -- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2f44115920 msgr2=0x7f2f44115d20 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:52.165 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.144+0000 7f2f327fc640 1 --2- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f2f44115920 0x7f2f44115d20 secure :-1 s=CLOSED pgs=131 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f340090b0 tx=0x7f2f34009210 comp rx=0 tx=0).stop 2026-02-12T18:14:52.166 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:14:52.166 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:14:52.166 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:14:52.166 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:14:52.166 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 76, 2026-02-12T18:14:52.166 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 137828, 2026-02-12T18:14:52.166 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:14:52.166 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:14:52.166 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:14:52.166 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:14:52.166 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:14:52.166 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:14:52.166 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:14:52.166 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:14:52.166 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:14:52.167 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:14:52.167 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:52.167 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 6, 2026-02-12T18:14:52.167 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:52.167 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:14:52.167 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:14:52.167 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:52.167 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:52.167 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:52.167 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:52.167 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:52.167 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:52.167 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:52.167 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:52.167 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:52.167 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:52.167 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:52.167 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:52.168 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:52.168 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:52.168 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:14:52.168 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:14:52.168 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:52.168 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:52.168 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:52.168 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:52.168 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:52.168 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:52.168 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:52.168 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:52.168 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:52.168 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:52.168 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:52.168 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:52.168 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:52.168 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:52.169 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.169 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:14:52.169 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:14:52.169 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:14:52.169 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:14:52.169 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:14:52.169 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:14:52.169 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:52.169 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:52.169 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:14:52.169 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:14:52.169 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:14:52.169 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:14:52.169 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:14:52.169 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:14:52.169 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:14:52.169 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:52.169 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:14:52.169 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:52.170 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:52.170 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:52.170 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:52.170 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:52.170 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:52.170 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:52.170 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:52.170 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:52.170 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:52.170 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:52.170 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:52.170 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:52.170 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:52.170 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:14:52.170 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.170 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:14:52.170 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.170 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:14:52.170 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:14:52.170 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:52.171 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:52.171 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.171 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:52.171 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:14:52.171 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.171 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.171 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.171 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:52.171 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:14:52.171 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.171 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:52.171 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:52.171 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.171 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:14:52.171 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:14:52.171 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:52.171 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:52.171 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:14:52.171 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:52.171 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.172 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.172 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:14:52.172 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:14:52.172 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:52.172 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:52.172 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.172 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:52.172 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:14:52.172 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.172 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.172 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.172 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:52.172 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:14:52.172 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.172 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:52.172 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:52.172 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.172 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:14:52.172 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:14:52.172 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:52.172 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:52.173 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:14:52.173 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:52.173 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.173 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.173 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:14:52.173 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:14:52.173 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:52.173 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:52.173 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.173 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:52.173 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:14:52.173 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.173 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.173 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.173 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:52.173 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:14:52.173 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.173 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:52.173 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:52.173 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.173 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:14:52.174 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:14:52.174 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:52.174 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:52.174 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:14:52.174 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:52.174 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.174 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.174 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:14:52.174 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:14:52.174 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:52.174 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:52.174 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.174 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:52.174 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:14:52.174 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.174 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.174 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.174 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:52.174 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:14:52.174 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.174 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:52.174 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:52.174 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.174 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:14:52.175 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:14:52.175 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:52.175 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:52.175 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:14:52.175 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:52.175 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.175 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.175 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:14:52.175 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:14:52.175 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:52.175 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:52.175 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.175 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:52.175 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:14:52.175 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.175 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.175 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.175 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:52.175 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:14:52.175 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.175 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:52.175 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:52.175 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.176 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:14:52.176 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:14:52.176 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:52.176 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:52.176 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:52.176 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:52.176 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.176 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.176 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:14:52.176 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:14:52.176 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:52.176 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:52.176 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.176 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:52.176 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:14:52.176 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.176 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.176 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.176 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:52.176 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:14:52.176 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.176 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:52.176 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:52.176 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.176 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:14:52.176 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:14:52.177 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:52.177 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:52.177 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:14:52.177 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:52.177 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.177 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.177 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:14:52.177 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:14:52.177 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:52.177 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:52.177 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.177 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:52.177 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:14:52.177 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.177 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.177 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.177 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:52.177 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:14:52.177 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.177 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:52.177 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:52.177 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.177 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:14:52.177 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:14:52.177 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:52.178 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:52.178 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:52.178 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:52.178 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.178 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.178 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:14:52.178 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:14:52.178 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:52.178 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:52.178 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.178 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:52.178 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:14:52.178 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.178 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.178 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.178 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:52.178 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:14:52.178 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.178 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:52.178 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:52.178 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.178 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:14:52.178 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:14:52.178 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:52.178 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:52.179 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:14:52.179 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:52.179 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.179 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.179 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:14:52.179 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:14:52.179 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:52.179 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:52.179 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.179 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:52.179 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:14:52.179 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.179 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.179 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.179 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:52.179 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:14:52.179 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:52.179 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:52.179 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:52.179 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.179 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:14:52.179 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:14:52.179 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:52.179 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:52.180 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:14:52.180 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:52.180 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:52.180 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:52.180 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.180 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:14:52.180 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:14:52.180 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.180 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:52.180 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:52.180 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:52.180 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:52.180 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:52.180 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:14:52.180 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.180 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:52.180 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:52.180 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:14:52.180 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:52.180 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:52.180 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:14:52.180 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.180 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:52.180 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:52.180 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:14:52.180 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:52.181 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:52.181 INFO:teuthology.orchestra.run.trial048.stdout: "mgr": [ 2026-02-12T18:14:52.181 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:52.181 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:52.181 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:52.181 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:52.181 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:52.181 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:52.181 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:52.181 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:14:52.181 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:14:52.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.144+0000 7f2f4bec3640 1 -- 10.20.193.48:0/2150278328 >> v2:10.20.193.111:6812/977811348 conn(0x7f2f1403f800 msgr2=0x7f2f1405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:52.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.144+0000 7f2f4bec3640 1 --2- 10.20.193.48:0/2150278328 >> v2:10.20.193.111:6812/977811348 conn(0x7f2f1403f800 0x7f2f1405fcb0 secure :-1 s=READY pgs=446 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f44127260 tx=0x7f2f38007ec0 comp rx=0 tx=0).stop 2026-02-12T18:14:52.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.144+0000 7f2f4bec3640 10 monclient: shutdown 2026-02-12T18:14:52.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.144+0000 7f2f4bec3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:52.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.144+0000 7f2f4bec3640 1 -- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2f44090700 msgr2=0x7f2f44127f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:52.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.144+0000 7f2f4bec3640 1 --2- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2f44090700 0x7f2f44127f70 secure :-1 s=READY pgs=156 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f2f4000d500 tx=0x7f2f4000d9d0 comp rx=0 tx=0).stop 2026-02-12T18:14:52.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.144+0000 7f2f4a439640 1 -- 10.20.193.48:0/2150278328 reap_dead start 2026-02-12T18:14:52.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.145+0000 7f2f4bec3640 1 -- 10.20.193.48:0/2150278328 shutdown_connections 2026-02-12T18:14:52.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.145+0000 7f2f4bec3640 1 --2- 10.20.193.48:0/2150278328 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f2f44090700 0x7f2f44127f70 unknown :-1 s=CLOSED pgs=156 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:52.183 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.145+0000 7f2f4bec3640 1 -- 10.20.193.48:0/2150278328 >> 10.20.193.48:0/2150278328 conn(0x7f2f44094420 msgr2=0x7f2f441422d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:52.183 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.145+0000 7f2f4bec3640 1 -- 10.20.193.48:0/2150278328 shutdown_connections 2026-02-12T18:14:52.183 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.145+0000 7f2f4bec3640 1 -- 10.20.193.48:0/2150278328 wait complete. 2026-02-12T18:14:52.183 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:14:52.183 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-12T18:14:52.183 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-12T18:14:52.243 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[32454]: starting. 2026-02-12T18:14:52.243 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[32454]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-32452 2026-02-12T18:14:52.243 INFO:teuthology.orchestra.run.trial111.stdout:process_2_[32454]: shutting down. 2026-02-12T18:14:52.252 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.251+0000 7fbddd3b9640 10 monclient: get_monmap_and_config 2026-02-12T18:14:52.252 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.251+0000 7fbddd3b9640 10 monclient: build_initial_monmap 2026-02-12T18:14:52.252 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.251+0000 7fbddd3b9640 10 monclient: monmap: 2026-02-12T18:14:52.252 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:52.252 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:52.252 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:14:52.252229+0000 2026-02-12T18:14:52.252 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:14:52.252229+0000 2026-02-12T18:14:52.252 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:52.252 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:52.252 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:14:52.252 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:14:52.252 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:52.252 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:52.253 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:52.253 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:52.253 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:52.253 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:52.253 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:52.253 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:14:52.253 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:14:52.253 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:52.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.251+0000 7fbddd3b9640 1 Processor -- start 2026-02-12T18:14:52.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.251+0000 7fbddd3b9640 1 -- start start 2026-02-12T18:14:52.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.251+0000 7fbddd3b9640 10 monclient: init 2026-02-12T18:14:52.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.251+0000 7fbddd3b9640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:52.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.251+0000 7fbddd3b9640 10 monclient: _add_conns ranks=[9,3,1,2,8,5,10,4,6,7,0] 2026-02-12T18:14:52.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.251+0000 7fbddd3b9640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fbdd805dc20 0x7fbdd8144660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:52.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.251+0000 7fbddd3b9640 10 monclient(hunting): picked mon.noname-a con 0x7fbdd805dc20 addr v2:10.20.193.48:3300/0 2026-02-12T18:14:52.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.251+0000 7fbddd3b9640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fbdd805dff0 0x7fbdd805e3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:52.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.251+0000 7fbddd3b9640 10 monclient(hunting): picked mon.noname-g con 0x7fbdd805dff0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:14:52.254 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.251+0000 7fbddd3b9640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fbdd8089df0 addr v1:10.20.193.111:6789/0 2026-02-12T18:14:52.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.251+0000 7fbddd3b9640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbdd8060390 con 0x7fbdd8089df0 2026-02-12T18:14:52.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.251+0000 7fbddd3b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:52.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.251+0000 7fbddd3b9640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7fbdd808b0d0 con 0x7fbdd805dc20 2026-02-12T18:14:52.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.251+0000 7fbddd3b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:52.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.251+0000 7fbddd3b9640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd8093a30 con 0x7fbdd805dff0 2026-02-12T18:14:52.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.251+0000 7fbddd3b9640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:52.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.251+0000 7fbddd3b9640 10 monclient(hunting): authenticate will time out at 1130.977909s 2026-02-12T18:14:52.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.251+0000 7fbdd6ffd640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fbdd805dc20 0x7fbdd8144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:52.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.251+0000 7fbdd6ffd640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fbdd805dc20 0x7fbdd8144660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:59522/0 (socket says 10.20.193.48:59522) 2026-02-12T18:14:52.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.251+0000 7fbdd6ffd640 1 -- 10.20.193.48:0/2546180830 learned_addr learned my addr 10.20.193.48:0/2546180830 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:52.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.252+0000 7fbdd6ffd640 10 monclient(hunting): get_auth_request con 0x7fbdd805dc20 auth_method 0 2026-02-12T18:14:52.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.252+0000 7fbdd6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:52.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.252+0000 7fbdd6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:52.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.252+0000 7fbdd6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:52.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.252+0000 7fbdd6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:52.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.252+0000 7fbdd6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:52.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.252+0000 7fbdd6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:52.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.252+0000 7fbdd67fc640 1 --2- 10.20.193.48:0/2546180830 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fbdd805dff0 0x7fbdd805e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:52.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.252+0000 7fbdd67fc640 10 monclient(hunting): get_auth_request con 0x7fbdd805dff0 auth_method 0 2026-02-12T18:14:52.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.252+0000 7fbdd67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:52.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.252+0000 7fbdd67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:52.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.252+0000 7fbdd67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:52.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.252+0000 7fbdd6ffd640 10 monclient(hunting): handle_auth_done global_id 6831 payload 274 2026-02-12T18:14:52.255 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.252+0000 7fbdd6ffd640 1 -- 10.20.193.48:0/2546180830 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fbdd805dff0 msgr2=0x7fbdd805e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:52.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.252+0000 7fbdd6ffd640 1 --2- 10.20.193.48:0/2546180830 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fbdd805dff0 0x7fbdd805e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:52.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.252+0000 7fbdd6ffd640 1 -- 10.20.193.48:0/2546180830 >> v1:10.20.193.111:6789/0 conn(0x7fbdd8089df0 legacy=0x7fbdd808a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:52.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.252+0000 7fbdd6ffd640 10 monclient: _finish_hunting 0 2026-02-12T18:14:52.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.252+0000 7fbdd6ffd640 1 monclient: found mon.noname-a 2026-02-12T18:14:52.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.252+0000 7fbdd6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:52.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.252+0000 7fbdd6ffd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:14:52.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.252+0000 7fbdd6ffd640 1 -- 10.20.193.48:0/2546180830 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdd8092200 con 0x7fbdd805dc20 2026-02-12T18:14:52.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.254+0000 7fbdd6ffd640 1 -- 10.20.193.48:0/2546180830 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbdd805dc20 msgr2=0x7fbdd8144660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:52.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.254+0000 7fbdd6ffd640 1 --2- 10.20.193.48:0/2546180830 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbdd805dc20 0x7fbdd8144660 secure :-1 s=READY pgs=622 gs=2 cs=0 l=1 c_cookie=17275920927478764919 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdcc009060 tx=0x7fbdcc02ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc0668d421bd577 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:52.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.254+0000 7fbdd5ffb640 1 -- 10.20.193.48:0/2546180830 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fbdcc035340 con 0x7fbdd805dc20 2026-02-12T18:14:52.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.254+0000 7fbdd5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:52.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.254+0000 7fbdd5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:14:52.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.254+0000 7fbdd5ffb640 10 monclient: dump: 2026-02-12T18:14:52.258 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:52.258 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:52.258 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:52.258 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:52.258 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:52.258 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:52.258 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:52.258 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:52.258 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:52.258 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:52.258 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:52.258 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:52.258 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:52.259 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:52.259 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:52.259 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:52.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.254+0000 7fbdd5ffb640 10 monclient: _finish_auth 0 2026-02-12T18:14:52.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.254+0000 7fbdd5ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:14:52.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.254+0000 7fbdd5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:52.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.254+0000 7fbdd5ffb640 1 -- 10.20.193.48:0/2546180830 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdcc0354c0 con 0x7fbdd805dc20 2026-02-12T18:14:52.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.254+0000 7fbddd3b9640 5 monclient: authenticate success, global_id 6831 2026-02-12T18:14:52.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.254+0000 7fbddd3b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:14:52.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.254+0000 7fbdd5ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:52.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.254+0000 7fbddd3b9640 10 monclient: get_monmap_and_config success 2026-02-12T18:14:52.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.254+0000 7fbdd5ffb640 1 -- 10.20.193.48:0/2546180830 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fbdcc035af0 con 0x7fbdd805dc20 2026-02-12T18:14:52.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.254+0000 7fbddd3b9640 4 set_mon_vals no callback set 2026-02-12T18:14:52.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.254+0000 7fbdd5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:52.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.254+0000 7fbdd5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:14:52.259 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.254+0000 7fbdd5ffb640 10 monclient: dump: 2026-02-12T18:14:52.259 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:52.259 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:52.259 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:52.259 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:52.259 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:52.259 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:52.259 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:52.259 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:52.259 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:52.259 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:52.260 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:52.260 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:52.260 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:52.260 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:52.260 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:52.260 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:52.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.255+0000 7fbddd3b9640 10 monclient: shutdown 2026-02-12T18:14:52.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.255+0000 7fbddd3b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:52.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.255+0000 7fbddd3b9640 1 -- 10.20.193.48:0/2546180830 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbdd805dc20 msgr2=0x7fbdd8144660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:52.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.255+0000 7fbddd3b9640 1 --2- 10.20.193.48:0/2546180830 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbdd805dc20 0x7fbdd8144660 secure :-1 s=READY pgs=622 gs=2 cs=0 l=1 c_cookie=17275920927478764919 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdcc009060 tx=0x7fbdcc02ee80 comp rx=0 tx=0).stop 2026-02-12T18:14:52.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.255+0000 7fbddd3b9640 1 -- 10.20.193.48:0/2546180830 shutdown_connections 2026-02-12T18:14:52.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.255+0000 7fbddd3b9640 1 --2- 10.20.193.48:0/2546180830 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fbdd805dff0 0x7fbdd805e3e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:52.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.255+0000 7fbddd3b9640 1 --2- 10.20.193.48:0/2546180830 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fbdd805dc20 0x7fbdd8144660 unknown :-1 s=CLOSED pgs=622 gs=2 cs=0 l=1 c_cookie=17275920927478764919 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:52.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.255+0000 7fbddd3b9640 1 -- 10.20.193.48:0/2546180830 >> 10.20.193.48:0/2546180830 conn(0x7fbdd80546d0 msgr2=0x7fbdd8054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:52.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.255+0000 7fbddd3b9640 1 -- 10.20.193.48:0/2546180830 shutdown_connections 2026-02-12T18:14:52.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.255+0000 7fbddd3b9640 1 -- 10.20.193.48:0/2546180830 wait complete. 2026-02-12T18:14:52.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.255+0000 7fbddd3b9640 10 monclient: build_initial_monmap 2026-02-12T18:14:52.260 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.255+0000 7fbddd3b9640 10 monclient: monmap: 2026-02-12T18:14:52.260 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:52.260 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:14:52.260 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:14:52.260 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:14:52.260 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:52.260 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:52.260 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:14:52.261 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:14:52.261 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:52.261 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:52.261 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:52.261 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:52.261 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:52.261 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:52.261 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:52.261 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:52.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.255+0000 7fbddd3b9640 1 Processor -- start 2026-02-12T18:14:52.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.255+0000 7fbddd3b9640 1 -- start start 2026-02-12T18:14:52.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.255+0000 7fbddd3b9640 10 monclient: init 2026-02-12T18:14:52.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.255+0000 7fbddd3b9640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:52.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbddd3b9640 10 monclient: _add_conns ranks=[7,3,5,6,1,0,2,4,8] 2026-02-12T18:14:52.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbddd3b9640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fbdd805dc20 0x7fbdd8131aa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:52.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbddd3b9640 10 monclient(hunting): picked mon.noname-i con 0x7fbdd805dc20 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:14:52.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbddd3b9640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fbdd805dff0 0x7fbdd810db60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:52.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbddd3b9640 10 monclient(hunting): picked mon.noname-g con 0x7fbdd805dff0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:14:52.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbddd3b9640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fbdd8089df0 0x7fbdd810e0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:52.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbddd3b9640 10 monclient(hunting): picked mon.noname-h con 0x7fbdd8089df0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:14:52.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbddd3b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:52.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbddd3b9640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fbdd8141b90 con 0x7fbdd805dff0 2026-02-12T18:14:52.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbddd3b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:52.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbddd3b9640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fbdd8142310 con 0x7fbdd8089df0 2026-02-12T18:14:52.261 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbddd3b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:52.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbddd3b9640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fbdd8131fe0 con 0x7fbdd805dc20 2026-02-12T18:14:52.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbddd3b9640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:52.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbddd3b9640 10 monclient(hunting): authenticate will time out at 1130.982056s 2026-02-12T18:14:52.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd67fc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fbdd805dff0 0x7fbdd810db60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:52.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd67fc640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fbdd805dff0 0x7fbdd810db60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3301/0 says I am v2:10.20.193.48:52880/0 (socket says 10.20.193.48:52880) 2026-02-12T18:14:52.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd67fc640 1 -- 10.20.193.48:0/182294080 learned_addr learned my addr 10.20.193.48:0/182294080 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:52.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd67fc640 10 monclient(hunting): get_auth_request con 0x7fbdd805dff0 auth_method 0 2026-02-12T18:14:52.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd67fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:52.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd67fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:52.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd67fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:52.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd6ffd640 1 --2- 10.20.193.48:0/182294080 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fbdd805dc20 0x7fbdd8131aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:52.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd6ffd640 10 monclient(hunting): get_auth_request con 0x7fbdd805dc20 auth_method 0 2026-02-12T18:14:52.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd6ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:52.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd6ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:52.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd6ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:52.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd67fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:52.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd67fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:52.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd67fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:52.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd6ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:52.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd6ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:52.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd6ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:52.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd67fc640 10 monclient(hunting): handle_auth_done global_id 104196 payload 824 2026-02-12T18:14:52.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd67fc640 1 -- 10.20.193.48:0/182294080 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fbdd805dc20 msgr2=0x7fbdd8131aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:52.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd67fc640 1 --2- 10.20.193.48:0/182294080 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fbdd805dc20 0x7fbdd8131aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:52.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd67fc640 1 -- 10.20.193.48:0/182294080 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fbdd8089df0 msgr2=0x7fbdd810e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:52.262 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd67fc640 1 --2- 10.20.193.48:0/182294080 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fbdd8089df0 0x7fbdd810e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:52.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd67fc640 10 monclient: _finish_hunting 0 2026-02-12T18:14:52.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd67fc640 1 monclient: found mon.noname-g 2026-02-12T18:14:52.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:52.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd67fc640 10 monclient: _send_mon_message to mon.noname-g at v2:10.20.193.111:3301/0 2026-02-12T18:14:52.263 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.256+0000 7fbdd67fc640 1 -- 10.20.193.48:0/182294080 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdcc0094f0 con 0x7fbdd805dff0 2026-02-12T18:14:52.264 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.258+0000 7fbdd67fc640 1 -- 10.20.193.48:0/182294080 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fbdd805dff0 msgr2=0x7fbdd810db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:52.264 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.258+0000 7fbdd67fc640 1 --2- 10.20.193.48:0/182294080 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fbdd805dff0 0x7fbdd810db60 secure :-1 s=READY pgs=14 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdc000e810 tx=0x7fbdc000ece0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:52.264 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.258+0000 7fbdb77fe640 1 -- 10.20.193.48:0/182294080 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fbdc00036d0 con 0x7fbdd805dff0 2026-02-12T18:14:52.264 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.258+0000 7fbdb77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:52.264 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.258+0000 7fbdb77fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2026-02-12T18:14:52.264 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.258+0000 7fbdb77fe640 10 monclient: dump: 2026-02-12T18:14:52.264 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:52.264 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:52.264 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:52.264 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:52.264 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:52.264 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:52.264 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:52.265 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:52.265 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:52.265 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:52.265 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:52.265 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:52.265 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:52.265 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:52.265 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:52.265 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:52.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.259+0000 7fbdb77fe640 10 monclient: _finish_auth 0 2026-02-12T18:14:52.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.259+0000 7fbdb77fe640 10 monclient: _check_auth_tickets 2026-02-12T18:14:52.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.259+0000 7fbdb77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:52.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.259+0000 7fbddd3b9640 5 monclient: authenticate success, global_id 104196 2026-02-12T18:14:52.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.259+0000 7fbddd3b9640 10 monclient: _renew_subs 2026-02-12T18:14:52.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.259+0000 7fbddd3b9640 10 monclient: _send_mon_message to mon.g at v2:10.20.193.111:3301/0 2026-02-12T18:14:52.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.259+0000 7fbddd3b9640 1 -- 10.20.193.48:0/182294080 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdd810f260 con 0x7fbdd805dff0 2026-02-12T18:14:52.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.259+0000 7fbdb77fe640 1 -- 10.20.193.48:0/182294080 <== mon.3 v2:10.20.193.111:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbdc0003830 con 0x7fbdd805dff0 2026-02-12T18:14:52.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.259+0000 7fbdb77fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:52.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.259+0000 7fbdb77fe640 1 -- 10.20.193.48:0/182294080 <== mon.3 v2:10.20.193.111:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fbdc00039a0 con 0x7fbdd805dff0 2026-02-12T18:14:52.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.259+0000 7fbdb77fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:52.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.259+0000 7fbdd57fa640 4 set_mon_vals no callback set 2026-02-12T18:14:52.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.259+0000 7fbdb77fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:14:52.265 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.259+0000 7fbdb77fe640 10 monclient: dump: 2026-02-12T18:14:52.265 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:52.265 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:52.265 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:52.266 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:52.266 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:52.266 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:52.266 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:52.266 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:52.266 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:52.266 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:52.266 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:52.266 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:52.266 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:52.266 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:52.266 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:52.266 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:52.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.259+0000 7fbddd3b9640 10 monclient: _renew_subs 2026-02-12T18:14:52.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.259+0000 7fbddd3b9640 10 monclient: _send_mon_message to mon.g at v2:10.20.193.111:3301/0 2026-02-12T18:14:52.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.259+0000 7fbddd3b9640 1 -- 10.20.193.48:0/182294080 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdd8110ca0 con 0x7fbdd805dff0 2026-02-12T18:14:52.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.259+0000 7fbddd3b9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:52.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.259+0000 7fbddd3b9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:52.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.259+0000 7fbddd3b9640 10 monclient: _send_mon_message to mon.g at v2:10.20.193.111:3301/0 2026-02-12T18:14:52.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.259+0000 7fbddd3b9640 1 -- 10.20.193.48:0/182294080 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdd8092510 con 0x7fbdd805dff0 2026-02-12T18:14:52.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.259+0000 7fbdb77fe640 1 -- 10.20.193.48:0/182294080 <== mon.3 v2:10.20.193.111:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fbdc0004240 con 0x7fbdd805dff0 2026-02-12T18:14:52.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.260+0000 7fbdb77fe640 1 --2- 10.20.193.48:0/182294080 >> v2:10.20.193.111:6812/977811348 conn(0x7fbda403f7f0 0x7fbda405fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:52.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.260+0000 7fbdb77fe640 1 -- 10.20.193.48:0/182294080 <== mon.3 v2:10.20.193.111:3301/0 5 ==== osd_map(318..318 src has 215..318) ==== 3503+0+0 (secure 0 0 0) 0x7fbdc00529a0 con 0x7fbdd805dff0 2026-02-12T18:14:52.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.260+0000 7fbdd6ffd640 1 --2- 10.20.193.48:0/182294080 >> v2:10.20.193.111:6812/977811348 conn(0x7fbda403f7f0 0x7fbda405fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:52.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.260+0000 7fbdd6ffd640 10 monclient: get_auth_request con 0x7fbda403f7f0 auth_method 0 2026-02-12T18:14:52.266 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.262+0000 7fbdb77fe640 1 -- 10.20.193.48:0/182294080 <== mon.3 v2:10.20.193.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fbdc000c670 con 0x7fbdd805dff0 2026-02-12T18:14:52.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.262+0000 7fbdb77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:52.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.262+0000 7fbdb77fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:14:52.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.262+0000 7fbdd6ffd640 1 --2- 10.20.193.48:0/182294080 >> v2:10.20.193.111:6812/977811348 conn(0x7fbda403f7f0 0x7fbda405fca0 secure :-1 s=READY pgs=450 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdcc02eec0 tx=0x7fbdcc033000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:52.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.407+0000 7fbddd3b9640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-12T18:14:52.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.407+0000 7fbddd3b9640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-12T18:14:52.409 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.407+0000 7fbddd3b9640 10 monclient: _send_mon_message to mon.g at v2:10.20.193.111:3301/0 2026-02-12T18:14:52.409 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.407+0000 7fbddd3b9640 1 -- 10.20.193.48:0/182294080 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fbdd810f260 con 0x7fbdd805dff0 2026-02-12T18:14:52.410 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.408+0000 7fbdb77fe640 1 -- 10.20.193.48:0/182294080 <== mon.3 v2:10.20.193.111:3301/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fbdd810f260 con 0x7fbdd805dff0 2026-02-12T18:14:52.410 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.408+0000 7fbdb77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-12T18:14:52.410 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.408+0000 7fbdb77fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:14:52.412 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.410+0000 7fbddd3b9640 1 -- 10.20.193.48:0/182294080 >> v2:10.20.193.111:6812/977811348 conn(0x7fbda403f7f0 msgr2=0x7fbda405fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:52.412 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.410+0000 7fbddd3b9640 1 --2- 10.20.193.48:0/182294080 >> v2:10.20.193.111:6812/977811348 conn(0x7fbda403f7f0 0x7fbda405fca0 secure :-1 s=READY pgs=450 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdcc02eec0 tx=0x7fbdcc033000 comp rx=0 tx=0).stop 2026-02-12T18:14:52.412 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.410+0000 7fbddd3b9640 10 monclient: shutdown 2026-02-12T18:14:52.412 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.410+0000 7fbddd3b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:52.412 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.410+0000 7fbddd3b9640 1 -- 10.20.193.48:0/182294080 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fbdd805dff0 msgr2=0x7fbdd810db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:52.412 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.410+0000 7fbddd3b9640 1 --2- 10.20.193.48:0/182294080 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fbdd805dff0 0x7fbdd810db60 secure :-1 s=READY pgs=14 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbdc000e810 tx=0x7fbdc000ece0 comp rx=0 tx=0).stop 2026-02-12T18:14:52.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.410+0000 7fbddd3b9640 1 -- 10.20.193.48:0/182294080 shutdown_connections 2026-02-12T18:14:52.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.410+0000 7fbddd3b9640 1 --2- 10.20.193.48:0/182294080 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fbdd8089df0 0x7fbdd810e0a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:52.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.410+0000 7fbddd3b9640 1 --2- 10.20.193.48:0/182294080 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fbdd805dff0 0x7fbdd810db60 unknown :-1 s=CLOSED pgs=14 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:52.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.410+0000 7fbddd3b9640 1 --2- 10.20.193.48:0/182294080 >> v2:10.20.193.111:6812/977811348 conn(0x7fbda403f7f0 0x7fbda405fca0 unknown :-1 s=CLOSED pgs=450 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:52.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.410+0000 7fbddd3b9640 1 --2- 10.20.193.48:0/182294080 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fbdd805dc20 0x7fbdd8131aa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:52.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.410+0000 7fbddd3b9640 1 -- 10.20.193.48:0/182294080 >> 10.20.193.48:0/182294080 conn(0x7fbdd80546d0 msgr2=0x7fbdd8124db0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:52.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.410+0000 7fbddd3b9640 1 -- 10.20.193.48:0/182294080 shutdown_connections 2026-02-12T18:14:52.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:52.410+0000 7fbddd3b9640 1 -- 10.20.193.48:0/182294080 wait complete. 2026-02-12T18:14:52.420 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-12T18:14:52.441 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.437+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:52.441 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.437+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=11,kv=11,logm=58} crc {auth=3396487060,config=1618278320,health=2341443149,kv=84047893,logm=2138155282}) 2026-02-12T18:14:52.441 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.437+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=17,config=2,health=13,kv=12,logm=56} crc {auth=208779054,config=1618278320,health=3113755863,kv=2857826951,logm=270949299}) 2026-02-12T18:14:52.441 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.437+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:52.441 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.437+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=11,kv=11,logm=58} crc {auth=3396487060,config=1618278320,health=2341443149,kv=84047893,logm=2138155282}) 2026-02-12T18:14:52.441 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.437+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=18,config=2,health=13,kv=11,logm=56} crc {auth=2008967804,config=3625383534,health=702036140,kv=1775932005,logm=3936392453}) 2026-02-12T18:14:52.441 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.437+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:52.442 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.437+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=11,kv=11,logm=58} crc {auth=3396487060,config=1618278320,health=2341443149,kv=84047893,logm=2138155282}) 2026-02-12T18:14:52.442 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.437+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=18,config=2,health=13,kv=12,logm=55} crc {auth=2008967804,config=1618278320,health=702036140,kv=2857826951,logm=2807155017}) 2026-02-12T18:14:52.442 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.437+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:52.442 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.437+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=11,kv=11,logm=58} crc {auth=3396487060,config=1618278320,health=2341443149,kv=84047893,logm=2138155282}) 2026-02-12T18:14:52.442 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.437+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=17,config=2,health=13,kv=12,logm=56} crc {auth=1555177741,config=1618278320,health=702036140,kv=2857826951,logm=1808921280}) 2026-02-12T18:14:52.442 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.437+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:52.442 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.437+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=11,kv=11,logm=58} crc {auth=3396487060,config=1618278320,health=2341443149,kv=84047893,logm=2138155282}) 2026-02-12T18:14:52.442 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.437+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=18,config=2,health=12,kv=12,logm=56} crc {auth=2008967804,config=1618278320,health=291079056,kv=3454882238,logm=249755989}) 2026-02-12T18:14:52.442 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.437+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:52.442 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.437+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=11,kv=11,logm=58} crc {auth=3396487060,config=1618278320,health=2341443149,kv=84047893,logm=2138155282}) 2026-02-12T18:14:52.442 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.438+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=18,config=1,health=13,kv=12,logm=56} crc {auth=2008967804,config=2457401934,health=702036140,kv=2857826951,logm=2295558417}) 2026-02-12T18:14:52.443 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.438+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:52.443 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.438+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=11,kv=11,logm=58} crc {auth=3396487060,config=1618278320,health=2341443149,kv=84047893,logm=2138155282}) 2026-02-12T18:14:52.443 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.438+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=16,config=2,health=13,kv=12,logm=57} crc {auth=543172813,config=1618278320,health=702036140,kv=2857826951,logm=514057633}) 2026-02-12T18:14:52.443 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.438+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:52.443 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.438+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=11,kv=11,logm=58} crc {auth=3396487060,config=1618278320,health=2341443149,kv=84047893,logm=2138155282}) 2026-02-12T18:14:52.443 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.438+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=16,config=2,health=11,kv=12,logm=59} crc {auth=2510936023,config=1618278320,health=2992602962,kv=2857826951,logm=62150116}) 2026-02-12T18:14:53.011 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.975+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.012 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.975+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1252859869}) 2026-02-12T18:14:53.012 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.975+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3766994917}) 2026-02-12T18:14:53.012 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.975+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.012 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.975+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1252859869}) 2026-02-12T18:14:53.012 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.975+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3174270142}) 2026-02-12T18:14:53.012 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.975+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.012 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.975+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1252859869}) 2026-02-12T18:14:53.012 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.975+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3251018710}) 2026-02-12T18:14:53.013 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.975+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.013 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.975+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1252859869}) 2026-02-12T18:14:53.013 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.975+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=669042732}) 2026-02-12T18:14:53.013 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.975+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.013 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.975+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1252859869}) 2026-02-12T18:14:53.013 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.975+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3030451086}) 2026-02-12T18:14:53.013 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.975+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.013 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.975+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1252859869}) 2026-02-12T18:14:53.013 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.976+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1462779051}) 2026-02-12T18:14:53.013 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.976+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.013 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.976+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1252859869}) 2026-02-12T18:14:53.013 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.976+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2719385226}) 2026-02-12T18:14:53.013 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.976+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.014 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.976+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1252859869}) 2026-02-12T18:14:53.014 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.976+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2429566971}) 2026-02-12T18:14:53.014 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.977+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.014 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.977+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3800887814}) 2026-02-12T18:14:53.014 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.977+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2094578805}) 2026-02-12T18:14:53.014 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.977+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.014 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.977+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3800887814}) 2026-02-12T18:14:53.014 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.977+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3467255825}) 2026-02-12T18:14:53.014 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.977+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.014 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.977+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3800887814}) 2026-02-12T18:14:53.014 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.977+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3068161421}) 2026-02-12T18:14:53.014 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.977+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.015 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.977+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3800887814}) 2026-02-12T18:14:53.015 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.977+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2625351022}) 2026-02-12T18:14:53.015 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.977+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.015 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.977+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3800887814}) 2026-02-12T18:14:53.015 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.977+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2120533748}) 2026-02-12T18:14:53.015 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.977+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.015 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.977+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3800887814}) 2026-02-12T18:14:53.015 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.977+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2601147916}) 2026-02-12T18:14:53.015 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.977+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.015 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.977+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3800887814}) 2026-02-12T18:14:53.016 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.977+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3720385577}) 2026-02-12T18:14:53.016 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.977+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.016 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.977+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3800887814}) 2026-02-12T18:14:53.016 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.977+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1061332800}) 2026-02-12T18:14:53.016 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.978+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.016 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.979+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4264257149}) 2026-02-12T18:14:53.016 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.979+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1795194574}) 2026-02-12T18:14:53.016 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.979+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.016 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.979+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4264257149}) 2026-02-12T18:14:53.016 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.979+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2887794187}) 2026-02-12T18:14:53.016 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.979+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.016 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.979+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4264257149}) 2026-02-12T18:14:53.016 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.979+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1245021721}) 2026-02-12T18:14:53.017 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.979+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.017 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.979+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4264257149}) 2026-02-12T18:14:53.017 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.979+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4086823316}) 2026-02-12T18:14:53.017 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.979+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.017 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.979+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4264257149}) 2026-02-12T18:14:53.017 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.979+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2961477037}) 2026-02-12T18:14:53.017 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.979+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.017 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.979+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4264257149}) 2026-02-12T18:14:53.017 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.979+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=640528643}) 2026-02-12T18:14:53.017 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.979+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.017 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.979+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4264257149}) 2026-02-12T18:14:53.017 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.979+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2710307044}) 2026-02-12T18:14:53.017 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.979+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.018 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.979+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4264257149}) 2026-02-12T18:14:53.018 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.979+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2430183282}) 2026-02-12T18:14:53.018 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.980+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.018 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.980+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=143562436}) 2026-02-12T18:14:53.018 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.980+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1904762224}) 2026-02-12T18:14:53.018 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.980+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.018 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.980+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=143562436}) 2026-02-12T18:14:53.018 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.980+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=866541319}) 2026-02-12T18:14:53.018 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.980+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.018 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.980+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=143562436}) 2026-02-12T18:14:53.018 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.980+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2567700506}) 2026-02-12T18:14:53.018 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.980+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.018 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.980+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=143562436}) 2026-02-12T18:14:53.018 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.980+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1542535872}) 2026-02-12T18:14:53.019 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.980+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.019 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.980+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=143562436}) 2026-02-12T18:14:53.019 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.980+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2663137170}) 2026-02-12T18:14:53.019 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.980+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.019 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.980+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=143562436}) 2026-02-12T18:14:53.019 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.980+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1513772248}) 2026-02-12T18:14:53.019 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.980+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.019 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.980+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=143562436}) 2026-02-12T18:14:53.019 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.980+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3026653707}) 2026-02-12T18:14:53.019 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.980+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.019 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.980+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=143562436}) 2026-02-12T18:14:53.019 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.980+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3131630670}) 2026-02-12T18:14:53.019 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.981+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.019 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.981+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=477848770}) 2026-02-12T18:14:53.019 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.981+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3683440404}) 2026-02-12T18:14:53.019 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.981+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.020 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.981+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=477848770}) 2026-02-12T18:14:53.020 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.981+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2650838158}) 2026-02-12T18:14:53.020 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.981+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.020 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.981+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=477848770}) 2026-02-12T18:14:53.020 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.981+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2621946889}) 2026-02-12T18:14:53.020 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.981+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.020 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.981+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=477848770}) 2026-02-12T18:14:53.020 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.981+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=797913005}) 2026-02-12T18:14:53.020 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.981+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.020 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.981+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=477848770}) 2026-02-12T18:14:53.020 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.981+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3459535141}) 2026-02-12T18:14:53.020 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.981+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.020 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.981+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=477848770}) 2026-02-12T18:14:53.020 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.981+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1830041479}) 2026-02-12T18:14:53.020 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.981+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.021 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.981+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=477848770}) 2026-02-12T18:14:53.021 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.981+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2733998664}) 2026-02-12T18:14:53.021 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.981+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.021 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.981+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=477848770}) 2026-02-12T18:14:53.021 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.981+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3990781032}) 2026-02-12T18:14:53.021 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.982+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.021 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.982+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2917249622}) 2026-02-12T18:14:53.021 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.982+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4261030002}) 2026-02-12T18:14:53.021 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.982+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.021 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.982+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2917249622}) 2026-02-12T18:14:53.021 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.982+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3772892652}) 2026-02-12T18:14:53.021 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.982+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.021 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.982+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2917249622}) 2026-02-12T18:14:53.021 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.982+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1683753453}) 2026-02-12T18:14:53.021 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.982+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.021 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.982+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2917249622}) 2026-02-12T18:14:53.022 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.982+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1720054537}) 2026-02-12T18:14:53.022 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.982+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.022 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.982+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2917249622}) 2026-02-12T18:14:53.022 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.982+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3315192646}) 2026-02-12T18:14:53.022 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.982+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.022 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.982+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2917249622}) 2026-02-12T18:14:53.022 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.982+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2881847879}) 2026-02-12T18:14:53.022 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.982+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.022 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.982+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2917249622}) 2026-02-12T18:14:53.022 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.982+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2821450519}) 2026-02-12T18:14:53.022 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.982+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.022 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.982+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2917249622}) 2026-02-12T18:14:53.022 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.982+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2901585251}) 2026-02-12T18:14:53.022 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.983+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.022 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.983+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=155968137}) 2026-02-12T18:14:53.022 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.983+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=793052214}) 2026-02-12T18:14:53.022 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.983+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.023 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.983+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=155968137}) 2026-02-12T18:14:53.023 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.983+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=246297812}) 2026-02-12T18:14:53.023 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.983+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.023 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.983+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=155968137}) 2026-02-12T18:14:53.023 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.983+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=687559190}) 2026-02-12T18:14:53.023 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.983+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.023 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.983+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=155968137}) 2026-02-12T18:14:53.023 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.983+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3317907365}) 2026-02-12T18:14:53.023 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.983+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.023 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.983+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=155968137}) 2026-02-12T18:14:53.023 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.983+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3591742858}) 2026-02-12T18:14:53.023 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.983+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.023 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.983+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=155968137}) 2026-02-12T18:14:53.023 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.983+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3232511318}) 2026-02-12T18:14:53.023 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.983+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.023 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.983+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=155968137}) 2026-02-12T18:14:53.023 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.983+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=277788730}) 2026-02-12T18:14:53.024 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.983+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.024 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.983+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=155968137}) 2026-02-12T18:14:53.024 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.983+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2768204212}) 2026-02-12T18:14:53.024 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.984+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.024 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.984+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1916294293}) 2026-02-12T18:14:53.024 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.984+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3939544269}) 2026-02-12T18:14:53.024 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.984+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.024 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.984+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1916294293}) 2026-02-12T18:14:53.024 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.984+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2355690798}) 2026-02-12T18:14:53.024 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.984+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.024 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.984+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1916294293}) 2026-02-12T18:14:53.024 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.984+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4293011735}) 2026-02-12T18:14:53.024 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.984+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.024 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.984+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1916294293}) 2026-02-12T18:14:53.024 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.984+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1654336071}) 2026-02-12T18:14:53.025 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.984+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.025 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.984+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1916294293}) 2026-02-12T18:14:53.025 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.984+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1397047992}) 2026-02-12T18:14:53.025 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.984+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.025 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.984+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1916294293}) 2026-02-12T18:14:53.025 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.984+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=289588634}) 2026-02-12T18:14:53.025 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.984+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.025 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.984+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1916294293}) 2026-02-12T18:14:53.025 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.984+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1222755379}) 2026-02-12T18:14:53.025 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.984+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.025 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.984+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1916294293}) 2026-02-12T18:14:53.025 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.984+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3579204925}) 2026-02-12T18:14:53.025 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.985+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.025 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.985+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2202307417}) 2026-02-12T18:14:53.025 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.985+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2286558764}) 2026-02-12T18:14:53.025 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.985+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.025 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.985+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2202307417}) 2026-02-12T18:14:53.026 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.985+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3406268382}) 2026-02-12T18:14:53.026 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.985+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.026 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.985+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2202307417}) 2026-02-12T18:14:53.026 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.985+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4279859954}) 2026-02-12T18:14:53.026 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.985+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.026 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.985+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2202307417}) 2026-02-12T18:14:53.026 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.985+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2298124965}) 2026-02-12T18:14:53.026 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.985+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.026 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.985+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2202307417}) 2026-02-12T18:14:53.026 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.985+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2441235302}) 2026-02-12T18:14:53.026 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.985+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.026 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.985+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2202307417}) 2026-02-12T18:14:53.026 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.985+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1910282585}) 2026-02-12T18:14:53.026 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.985+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.026 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.985+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2202307417}) 2026-02-12T18:14:53.026 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.985+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2764829024}) 2026-02-12T18:14:53.026 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.985+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.026 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.985+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2202307417}) 2026-02-12T18:14:53.027 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.985+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3481708391}) 2026-02-12T18:14:53.027 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.986+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.027 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.986+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=252066107}) 2026-02-12T18:14:53.027 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.986+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2247893192}) 2026-02-12T18:14:53.027 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.986+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.027 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.986+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=252066107}) 2026-02-12T18:14:53.027 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.986+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3659425098}) 2026-02-12T18:14:53.027 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.986+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.027 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.986+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=252066107}) 2026-02-12T18:14:53.027 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.986+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1870304624}) 2026-02-12T18:14:53.027 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.986+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.027 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.986+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=252066107}) 2026-02-12T18:14:53.027 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.986+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1311407257}) 2026-02-12T18:14:53.027 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.986+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.027 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.986+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=252066107}) 2026-02-12T18:14:53.027 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.986+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3556024936}) 2026-02-12T18:14:53.027 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.986+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.027 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.986+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=252066107}) 2026-02-12T18:14:53.027 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.986+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1711869688}) 2026-02-12T18:14:53.028 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.986+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.028 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.986+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=252066107}) 2026-02-12T18:14:53.028 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.986+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3617502508}) 2026-02-12T18:14:53.028 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.986+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.028 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.986+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=252066107}) 2026-02-12T18:14:53.028 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.986+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=54014956}) 2026-02-12T18:14:53.028 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.987+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.028 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.987+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1028433685}) 2026-02-12T18:14:53.028 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.987+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2525423642}) 2026-02-12T18:14:53.028 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.987+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.028 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.987+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1028433685}) 2026-02-12T18:14:53.028 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.987+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3954456668}) 2026-02-12T18:14:53.028 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.987+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.028 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.987+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1028433685}) 2026-02-12T18:14:53.028 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.987+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=977043581}) 2026-02-12T18:14:53.028 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.987+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.028 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.987+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1028433685}) 2026-02-12T18:14:53.028 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.987+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1883909948}) 2026-02-12T18:14:53.028 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.987+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.028 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.987+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1028433685}) 2026-02-12T18:14:53.029 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.987+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3244288956}) 2026-02-12T18:14:53.029 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.987+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.029 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.987+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1028433685}) 2026-02-12T18:14:53.029 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.987+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2171539772}) 2026-02-12T18:14:53.029 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.987+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.029 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.987+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1028433685}) 2026-02-12T18:14:53.029 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.987+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3545886066}) 2026-02-12T18:14:53.029 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.987+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.029 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.987+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1028433685}) 2026-02-12T18:14:53.029 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.987+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1888261631}) 2026-02-12T18:14:53.029 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.988+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.029 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.988+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1726024560}) 2026-02-12T18:14:53.029 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.988+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2141271443}) 2026-02-12T18:14:53.029 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.988+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.029 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.988+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1726024560}) 2026-02-12T18:14:53.029 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.988+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=988342792}) 2026-02-12T18:14:53.029 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.988+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.029 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.988+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1726024560}) 2026-02-12T18:14:53.030 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.988+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=517205732}) 2026-02-12T18:14:53.030 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.988+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.030 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.988+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1726024560}) 2026-02-12T18:14:53.030 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.988+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=631193909}) 2026-02-12T18:14:53.030 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.988+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.030 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.988+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1726024560}) 2026-02-12T18:14:53.030 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.988+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=330866799}) 2026-02-12T18:14:53.030 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.988+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.030 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.988+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1726024560}) 2026-02-12T18:14:53.030 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.988+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3962776342}) 2026-02-12T18:14:53.030 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.988+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.030 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.988+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1726024560}) 2026-02-12T18:14:53.030 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.988+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2787407781}) 2026-02-12T18:14:53.030 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.988+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.030 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.988+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1726024560}) 2026-02-12T18:14:53.030 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.988+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=526930120}) 2026-02-12T18:14:53.030 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.989+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.030 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.989+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2780233820}) 2026-02-12T18:14:53.030 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.989+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2932632666}) 2026-02-12T18:14:53.030 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.989+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.031 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.989+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2780233820}) 2026-02-12T18:14:53.031 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.989+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4234399097}) 2026-02-12T18:14:53.031 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.989+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.031 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.989+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2780233820}) 2026-02-12T18:14:53.031 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.989+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1218958845}) 2026-02-12T18:14:53.031 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.989+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.031 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.989+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2780233820}) 2026-02-12T18:14:53.031 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.989+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2228301746}) 2026-02-12T18:14:53.031 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.989+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.031 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.989+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2780233820}) 2026-02-12T18:14:53.031 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.989+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4262160737}) 2026-02-12T18:14:53.031 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.989+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.031 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.989+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2780233820}) 2026-02-12T18:14:53.031 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.989+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=391383800}) 2026-02-12T18:14:53.031 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.989+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.031 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.989+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2780233820}) 2026-02-12T18:14:53.031 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.989+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2146443606}) 2026-02-12T18:14:53.031 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.989+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.031 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.989+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2780233820}) 2026-02-12T18:14:53.031 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.989+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=538602104}) 2026-02-12T18:14:53.031 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.990+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.032 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.990+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=136529717}) 2026-02-12T18:14:53.032 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.990+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=863282322}) 2026-02-12T18:14:53.032 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.990+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.032 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.990+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=136529717}) 2026-02-12T18:14:53.032 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.990+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3252484016}) 2026-02-12T18:14:53.032 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.990+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.032 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.990+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=136529717}) 2026-02-12T18:14:53.032 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.990+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2584864927}) 2026-02-12T18:14:53.032 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.990+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.032 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.990+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=136529717}) 2026-02-12T18:14:53.032 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.990+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1062315390}) 2026-02-12T18:14:53.032 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.990+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.032 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.990+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=136529717}) 2026-02-12T18:14:53.032 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.990+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1450425475}) 2026-02-12T18:14:53.032 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.990+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.032 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.990+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=136529717}) 2026-02-12T18:14:53.032 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.990+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=465758012}) 2026-02-12T18:14:53.032 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.990+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.032 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.990+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=136529717}) 2026-02-12T18:14:53.032 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.990+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3077579746}) 2026-02-12T18:14:53.032 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.990+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.032 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.990+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=136529717}) 2026-02-12T18:14:53.032 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.990+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=905107401}) 2026-02-12T18:14:53.033 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.991+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.033 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.991+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2833654209}) 2026-02-12T18:14:53.033 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.991+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1320325520}) 2026-02-12T18:14:53.033 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.991+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.033 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.991+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2833654209}) 2026-02-12T18:14:53.033 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.991+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=475125714}) 2026-02-12T18:14:53.033 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.991+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.033 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.991+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2833654209}) 2026-02-12T18:14:53.033 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.991+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2692312056}) 2026-02-12T18:14:53.033 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.991+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.033 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.991+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2833654209}) 2026-02-12T18:14:53.033 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.991+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=678939995}) 2026-02-12T18:14:53.033 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.991+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.033 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.991+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2833654209}) 2026-02-12T18:14:53.033 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.991+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3897578712}) 2026-02-12T18:14:53.033 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.991+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.033 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.991+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2833654209}) 2026-02-12T18:14:53.033 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.991+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1626893782}) 2026-02-12T18:14:53.033 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.991+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.033 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.991+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2833654209}) 2026-02-12T18:14:53.033 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.991+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=867485758}) 2026-02-12T18:14:53.033 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.991+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.034 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.991+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2833654209}) 2026-02-12T18:14:53.034 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.991+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2283265404}) 2026-02-12T18:14:53.034 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.034 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1720294137}) 2026-02-12T18:14:53.034 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=662809406}) 2026-02-12T18:14:53.034 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.034 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1720294137}) 2026-02-12T18:14:53.034 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=235540519}) 2026-02-12T18:14:53.034 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.034 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1720294137}) 2026-02-12T18:14:53.034 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=915665818}) 2026-02-12T18:14:53.034 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.034 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1720294137}) 2026-02-12T18:14:53.034 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1994428720}) 2026-02-12T18:14:53.034 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.034 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1720294137}) 2026-02-12T18:14:53.034 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2760317979}) 2026-02-12T18:14:53.034 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.034 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1720294137}) 2026-02-12T18:14:53.034 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2080605419}) 2026-02-12T18:14:53.034 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.035 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1720294137}) 2026-02-12T18:14:53.035 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2615438118}) 2026-02-12T18:14:53.035 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.035 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1720294137}) 2026-02-12T18:14:53.035 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.992+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=761869260}) 2026-02-12T18:14:53.035 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.035 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3930545696}) 2026-02-12T18:14:53.035 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3898781308}) 2026-02-12T18:14:53.035 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.035 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3930545696}) 2026-02-12T18:14:53.035 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=487837020}) 2026-02-12T18:14:53.035 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.035 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3930545696}) 2026-02-12T18:14:53.035 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2211927634}) 2026-02-12T18:14:53.035 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.035 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3930545696}) 2026-02-12T18:14:53.035 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=190709381}) 2026-02-12T18:14:53.035 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.035 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3930545696}) 2026-02-12T18:14:53.035 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2206592355}) 2026-02-12T18:14:53.035 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.035 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3930545696}) 2026-02-12T18:14:53.035 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1694230787}) 2026-02-12T18:14:53.035 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.036 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3930545696}) 2026-02-12T18:14:53.036 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=828555005}) 2026-02-12T18:14:53.036 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.036 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3930545696}) 2026-02-12T18:14:53.036 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.993+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1613161606}) 2026-02-12T18:14:53.036 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.036 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2375799715}) 2026-02-12T18:14:53.036 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1494698206}) 2026-02-12T18:14:53.036 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.036 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2375799715}) 2026-02-12T18:14:53.036 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3944327092}) 2026-02-12T18:14:53.036 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.036 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2375799715}) 2026-02-12T18:14:53.036 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4078666132}) 2026-02-12T18:14:53.036 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.036 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2375799715}) 2026-02-12T18:14:53.036 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1518609816}) 2026-02-12T18:14:53.036 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.036 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2375799715}) 2026-02-12T18:14:53.036 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=484233939}) 2026-02-12T18:14:53.036 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.036 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2375799715}) 2026-02-12T18:14:53.036 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=142796653}) 2026-02-12T18:14:53.037 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.037 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2375799715}) 2026-02-12T18:14:53.037 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=163030856}) 2026-02-12T18:14:53.037 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.037 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2375799715}) 2026-02-12T18:14:53.037 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:52.994+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1520180085}) 2026-02-12T18:14:53.037 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.006+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.037 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.006+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=597771913}) 2026-02-12T18:14:53.037 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.006+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2120896670}) 2026-02-12T18:14:53.037 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.006+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.037 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.006+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=597771913}) 2026-02-12T18:14:53.037 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.006+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=630356778}) 2026-02-12T18:14:53.037 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.006+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.037 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.006+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=597771913}) 2026-02-12T18:14:53.037 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.006+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3194358994}) 2026-02-12T18:14:53.037 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.006+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.037 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.006+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=597771913}) 2026-02-12T18:14:53.037 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.006+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4239229411}) 2026-02-12T18:14:53.037 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.006+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.037 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.006+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=597771913}) 2026-02-12T18:14:53.037 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.006+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3568330220}) 2026-02-12T18:14:53.037 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.006+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.037 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.006+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=597771913}) 2026-02-12T18:14:53.038 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.006+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2260354545}) 2026-02-12T18:14:53.038 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.006+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.038 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.006+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=597771913}) 2026-02-12T18:14:53.038 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.006+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4283034788}) 2026-02-12T18:14:53.038 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.006+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.038 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.006+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=597771913}) 2026-02-12T18:14:53.038 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.006+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=383244241}) 2026-02-12T18:14:53.360 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.361 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2559255856}) 2026-02-12T18:14:53.361 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=259648775}) 2026-02-12T18:14:53.361 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.361 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2559255856}) 2026-02-12T18:14:53.361 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=179102948}) 2026-02-12T18:14:53.361 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.361 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2559255856}) 2026-02-12T18:14:53.361 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1440753141}) 2026-02-12T18:14:53.361 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.362 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2559255856}) 2026-02-12T18:14:53.362 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2403764946}) 2026-02-12T18:14:53.362 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.362 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2559255856}) 2026-02-12T18:14:53.362 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3428500719}) 2026-02-12T18:14:53.362 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.362 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2559255856}) 2026-02-12T18:14:53.362 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2115444306}) 2026-02-12T18:14:53.362 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.362 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2559255856}) 2026-02-12T18:14:53.362 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2473794536}) 2026-02-12T18:14:53.362 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.362 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2559255856}) 2026-02-12T18:14:53.363 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=868089483}) 2026-02-12T18:14:53.363 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.363 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3057011129}) 2026-02-12T18:14:53.363 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2068402764}) 2026-02-12T18:14:53.363 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.363 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3057011129}) 2026-02-12T18:14:53.363 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=409681409}) 2026-02-12T18:14:53.363 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.325+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.363 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3057011129}) 2026-02-12T18:14:53.363 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1847020217}) 2026-02-12T18:14:53.363 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.363 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3057011129}) 2026-02-12T18:14:53.363 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=217521336}) 2026-02-12T18:14:53.363 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.364 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3057011129}) 2026-02-12T18:14:53.364 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2798763772}) 2026-02-12T18:14:53.364 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.364 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3057011129}) 2026-02-12T18:14:53.364 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1019936576}) 2026-02-12T18:14:53.364 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.364 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3057011129}) 2026-02-12T18:14:53.364 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=23218471}) 2026-02-12T18:14:53.364 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.364 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3057011129}) 2026-02-12T18:14:53.364 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2162322557}) 2026-02-12T18:14:53.364 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.364 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=956818348}) 2026-02-12T18:14:53.364 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3454844031}) 2026-02-12T18:14:53.365 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.365 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=956818348}) 2026-02-12T18:14:53.365 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4238842336}) 2026-02-12T18:14:53.365 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.365 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=956818348}) 2026-02-12T18:14:53.365 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=440135232}) 2026-02-12T18:14:53.365 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.365 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=956818348}) 2026-02-12T18:14:53.365 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1226416123}) 2026-02-12T18:14:53.365 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.365 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=956818348}) 2026-02-12T18:14:53.365 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3103838308}) 2026-02-12T18:14:53.365 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.365 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=956818348}) 2026-02-12T18:14:53.365 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.326+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2993110672}) 2026-02-12T18:14:53.366 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.366 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=956818348}) 2026-02-12T18:14:53.366 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2516326246}) 2026-02-12T18:14:53.366 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.366 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=956818348}) 2026-02-12T18:14:53.366 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1620602468}) 2026-02-12T18:14:53.366 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.366 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3228109457}) 2026-02-12T18:14:53.366 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2011573253}) 2026-02-12T18:14:53.366 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.366 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3228109457}) 2026-02-12T18:14:53.366 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3473006042}) 2026-02-12T18:14:53.366 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.366 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3228109457}) 2026-02-12T18:14:53.366 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3925888222}) 2026-02-12T18:14:53.366 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.367 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3228109457}) 2026-02-12T18:14:53.367 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3549717377}) 2026-02-12T18:14:53.367 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.367 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3228109457}) 2026-02-12T18:14:53.367 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4117942000}) 2026-02-12T18:14:53.367 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.367 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3228109457}) 2026-02-12T18:14:53.367 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3187641854}) 2026-02-12T18:14:53.367 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.367 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3228109457}) 2026-02-12T18:14:53.367 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1033283899}) 2026-02-12T18:14:53.367 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.367 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3228109457}) 2026-02-12T18:14:53.367 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.327+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=865133963}) 2026-02-12T18:14:53.367 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.328+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.367 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.328+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3456621020}) 2026-02-12T18:14:53.368 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.328+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1735081690}) 2026-02-12T18:14:53.368 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.328+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.368 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.328+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3456621020}) 2026-02-12T18:14:53.368 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.328+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2587183936}) 2026-02-12T18:14:53.368 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.328+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.368 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.328+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3456621020}) 2026-02-12T18:14:53.368 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.328+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2620960338}) 2026-02-12T18:14:53.368 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.328+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.368 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.328+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3456621020}) 2026-02-12T18:14:53.368 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.328+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1654307128}) 2026-02-12T18:14:53.368 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.328+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.368 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.328+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3456621020}) 2026-02-12T18:14:53.368 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.328+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2480186919}) 2026-02-12T18:14:53.368 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.328+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.368 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.328+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3456621020}) 2026-02-12T18:14:53.368 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.328+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=344819008}) 2026-02-12T18:14:53.368 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.328+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.369 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.328+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3456621020}) 2026-02-12T18:14:53.369 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.328+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3830334595}) 2026-02-12T18:14:53.369 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.328+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.369 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.328+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3456621020}) 2026-02-12T18:14:53.369 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.328+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2185765798}) 2026-02-12T18:14:53.369 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.329+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.369 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.329+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2823377510}) 2026-02-12T18:14:53.369 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.329+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1493518318}) 2026-02-12T18:14:53.369 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.329+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.369 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.329+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2823377510}) 2026-02-12T18:14:53.369 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.329+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4230538714}) 2026-02-12T18:14:53.369 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.329+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.369 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.329+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2823377510}) 2026-02-12T18:14:53.369 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.329+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=439425524}) 2026-02-12T18:14:53.369 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.329+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.369 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.329+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2823377510}) 2026-02-12T18:14:53.369 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.329+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=982385068}) 2026-02-12T18:14:53.370 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.329+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.370 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.329+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2823377510}) 2026-02-12T18:14:53.370 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.329+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4236689172}) 2026-02-12T18:14:53.370 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.329+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.370 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.329+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2823377510}) 2026-02-12T18:14:53.370 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.329+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3559931643}) 2026-02-12T18:14:53.370 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.329+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.370 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.329+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2823377510}) 2026-02-12T18:14:53.370 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.329+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1694192506}) 2026-02-12T18:14:53.370 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.329+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.370 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.329+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2823377510}) 2026-02-12T18:14:53.370 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.329+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2112496078}) 2026-02-12T18:14:53.370 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.330+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.370 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.330+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3237741544}) 2026-02-12T18:14:53.370 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.330+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1195678490}) 2026-02-12T18:14:53.370 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.330+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.370 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.330+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3237741544}) 2026-02-12T18:14:53.371 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.330+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=862424308}) 2026-02-12T18:14:53.371 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.330+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.371 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.330+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3237741544}) 2026-02-12T18:14:53.371 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.330+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4241105088}) 2026-02-12T18:14:53.371 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.330+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.371 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.330+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3237741544}) 2026-02-12T18:14:53.371 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.330+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1375313042}) 2026-02-12T18:14:53.371 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.330+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.371 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.330+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3237741544}) 2026-02-12T18:14:53.371 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.330+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3337153237}) 2026-02-12T18:14:53.371 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.330+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.371 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.330+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3237741544}) 2026-02-12T18:14:53.371 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.330+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3460687467}) 2026-02-12T18:14:53.371 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.330+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.371 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.330+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3237741544}) 2026-02-12T18:14:53.371 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.330+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3017948167}) 2026-02-12T18:14:53.371 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.330+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.371 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.330+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3237741544}) 2026-02-12T18:14:53.372 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.330+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2078645497}) 2026-02-12T18:14:53.372 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.331+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.372 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.331+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=997916186}) 2026-02-12T18:14:53.372 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.331+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=412410559}) 2026-02-12T18:14:53.372 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.331+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.372 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.331+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=997916186}) 2026-02-12T18:14:53.372 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.331+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3117992511}) 2026-02-12T18:14:53.372 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.331+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.372 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.331+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=997916186}) 2026-02-12T18:14:53.372 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.331+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=586637534}) 2026-02-12T18:14:53.372 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.331+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.372 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.331+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=997916186}) 2026-02-12T18:14:53.372 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.331+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2406742117}) 2026-02-12T18:14:53.372 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.331+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.372 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.331+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=997916186}) 2026-02-12T18:14:53.372 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.331+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=49277300}) 2026-02-12T18:14:53.372 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.331+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.373 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.331+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=997916186}) 2026-02-12T18:14:53.373 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.331+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=25021410}) 2026-02-12T18:14:53.373 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.331+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.373 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.331+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=997916186}) 2026-02-12T18:14:53.373 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.331+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1892776602}) 2026-02-12T18:14:53.373 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.331+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.373 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.331+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=997916186}) 2026-02-12T18:14:53.373 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.331+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=918575907}) 2026-02-12T18:14:53.373 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.332+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.373 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.332+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4241785494}) 2026-02-12T18:14:53.373 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.332+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1994218282}) 2026-02-12T18:14:53.373 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.332+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.373 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.332+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4241785494}) 2026-02-12T18:14:53.373 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.332+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1833970698}) 2026-02-12T18:14:53.373 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.332+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.373 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.332+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4241785494}) 2026-02-12T18:14:53.373 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.332+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2910996895}) 2026-02-12T18:14:53.373 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.332+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.374 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.332+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4241785494}) 2026-02-12T18:14:53.374 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.332+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2368551950}) 2026-02-12T18:14:53.374 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.332+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.374 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.332+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4241785494}) 2026-02-12T18:14:53.374 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.332+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3398190766}) 2026-02-12T18:14:53.374 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.332+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.374 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.332+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4241785494}) 2026-02-12T18:14:53.374 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.332+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3515731781}) 2026-02-12T18:14:53.374 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.332+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.374 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.332+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4241785494}) 2026-02-12T18:14:53.374 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.332+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=668410222}) 2026-02-12T18:14:53.374 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.332+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.374 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.332+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4241785494}) 2026-02-12T18:14:53.374 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.332+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1000244592}) 2026-02-12T18:14:53.374 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.333+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.374 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.333+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573281585}) 2026-02-12T18:14:53.374 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.333+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3055588383}) 2026-02-12T18:14:53.374 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.333+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.375 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.333+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573281585}) 2026-02-12T18:14:53.375 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.333+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=327529091}) 2026-02-12T18:14:53.375 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.333+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.375 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.333+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573281585}) 2026-02-12T18:14:53.375 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.333+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=900645533}) 2026-02-12T18:14:53.375 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.333+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.375 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.333+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573281585}) 2026-02-12T18:14:53.375 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.333+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3686442223}) 2026-02-12T18:14:53.375 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.333+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.375 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.333+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573281585}) 2026-02-12T18:14:53.375 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.333+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2408796791}) 2026-02-12T18:14:53.375 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.333+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.375 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.333+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573281585}) 2026-02-12T18:14:53.375 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.333+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=355346001}) 2026-02-12T18:14:53.375 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.333+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.375 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.333+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573281585}) 2026-02-12T18:14:53.375 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.333+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2041680}) 2026-02-12T18:14:53.375 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.333+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.376 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.333+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573281585}) 2026-02-12T18:14:53.376 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.333+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3445529434}) 2026-02-12T18:14:53.376 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.376 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=430727806}) 2026-02-12T18:14:53.376 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2851590367}) 2026-02-12T18:14:53.376 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.376 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=430727806}) 2026-02-12T18:14:53.376 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3083597748}) 2026-02-12T18:14:53.376 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.376 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=430727806}) 2026-02-12T18:14:53.376 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1312533853}) 2026-02-12T18:14:53.376 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.376 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=430727806}) 2026-02-12T18:14:53.376 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3340647250}) 2026-02-12T18:14:53.376 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.376 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=430727806}) 2026-02-12T18:14:53.376 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3678192551}) 2026-02-12T18:14:53.376 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.376 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=430727806}) 2026-02-12T18:14:53.376 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2537425477}) 2026-02-12T18:14:53.377 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.377 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=430727806}) 2026-02-12T18:14:53.377 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1293826128}) 2026-02-12T18:14:53.377 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.377 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=430727806}) 2026-02-12T18:14:53.377 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=465432430}) 2026-02-12T18:14:53.377 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.377 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2624979997}) 2026-02-12T18:14:53.377 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=460602002}) 2026-02-12T18:14:53.377 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.377 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2624979997}) 2026-02-12T18:14:53.377 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1780979755}) 2026-02-12T18:14:53.377 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.377 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2624979997}) 2026-02-12T18:14:53.377 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=740153922}) 2026-02-12T18:14:53.377 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.334+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.377 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2624979997}) 2026-02-12T18:14:53.377 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1005331422}) 2026-02-12T18:14:53.377 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.378 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2624979997}) 2026-02-12T18:14:53.378 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2011497943}) 2026-02-12T18:14:53.378 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.378 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2624979997}) 2026-02-12T18:14:53.378 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2369163992}) 2026-02-12T18:14:53.378 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.378 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2624979997}) 2026-02-12T18:14:53.378 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2245507883}) 2026-02-12T18:14:53.378 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.378 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2624979997}) 2026-02-12T18:14:53.378 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=238958099}) 2026-02-12T18:14:53.378 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.378 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1190628981}) 2026-02-12T18:14:53.378 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2122491026}) 2026-02-12T18:14:53.378 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.378 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1190628981}) 2026-02-12T18:14:53.378 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4054560024}) 2026-02-12T18:14:53.378 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.378 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1190628981}) 2026-02-12T18:14:53.378 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1325675897}) 2026-02-12T18:14:53.378 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.379 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1190628981}) 2026-02-12T18:14:53.379 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=466994517}) 2026-02-12T18:14:53.379 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.379 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1190628981}) 2026-02-12T18:14:53.379 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3573023436}) 2026-02-12T18:14:53.379 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.379 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1190628981}) 2026-02-12T18:14:53.379 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1605221540}) 2026-02-12T18:14:53.379 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.379 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1190628981}) 2026-02-12T18:14:53.379 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2897689423}) 2026-02-12T18:14:53.379 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.379 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1190628981}) 2026-02-12T18:14:53.379 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.335+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1738666110}) 2026-02-12T18:14:53.379 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.336+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.379 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.336+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365634611}) 2026-02-12T18:14:53.379 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.336+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=703735379}) 2026-02-12T18:14:53.379 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.336+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.379 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.336+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365634611}) 2026-02-12T18:14:53.379 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.336+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2042303396}) 2026-02-12T18:14:53.379 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.336+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.379 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.336+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365634611}) 2026-02-12T18:14:53.379 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.336+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=328930855}) 2026-02-12T18:14:53.380 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.336+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.380 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.336+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365634611}) 2026-02-12T18:14:53.380 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.336+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3762328834}) 2026-02-12T18:14:53.380 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.336+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.380 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.336+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365634611}) 2026-02-12T18:14:53.380 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.336+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3423524431}) 2026-02-12T18:14:53.380 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.336+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.380 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.336+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365634611}) 2026-02-12T18:14:53.380 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.336+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=153526509}) 2026-02-12T18:14:53.380 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.336+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.380 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.336+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365634611}) 2026-02-12T18:14:53.380 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.336+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1486088066}) 2026-02-12T18:14:53.380 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.336+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.380 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.336+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365634611}) 2026-02-12T18:14:53.380 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.336+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1865024465}) 2026-02-12T18:14:53.380 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.337+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.380 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.337+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=962855456}) 2026-02-12T18:14:53.380 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.337+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2325183142}) 2026-02-12T18:14:53.380 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.337+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.380 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.337+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=962855456}) 2026-02-12T18:14:53.380 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.337+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3114891539}) 2026-02-12T18:14:53.381 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.337+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.381 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.337+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=962855456}) 2026-02-12T18:14:53.381 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.337+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3793483920}) 2026-02-12T18:14:53.381 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.337+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.381 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.337+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=962855456}) 2026-02-12T18:14:53.381 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.337+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2494288053}) 2026-02-12T18:14:53.381 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.337+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.381 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.337+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=962855456}) 2026-02-12T18:14:53.381 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.337+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3135112081}) 2026-02-12T18:14:53.381 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.337+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.381 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.337+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=962855456}) 2026-02-12T18:14:53.381 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.337+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4141310687}) 2026-02-12T18:14:53.381 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.337+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.381 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.337+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=962855456}) 2026-02-12T18:14:53.381 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.337+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2284325771}) 2026-02-12T18:14:53.381 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.337+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.381 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.337+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=962855456}) 2026-02-12T18:14:53.381 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.337+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2641449187}) 2026-02-12T18:14:53.381 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.338+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.381 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.338+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2017674309}) 2026-02-12T18:14:53.381 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.338+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=914286208}) 2026-02-12T18:14:53.381 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.338+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.382 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.338+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2017674309}) 2026-02-12T18:14:53.382 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.338+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2185649044}) 2026-02-12T18:14:53.382 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.338+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.382 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.338+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2017674309}) 2026-02-12T18:14:53.382 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.338+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2252505461}) 2026-02-12T18:14:53.382 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.338+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.382 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.338+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2017674309}) 2026-02-12T18:14:53.382 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.338+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=855950420}) 2026-02-12T18:14:53.382 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.338+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.382 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.338+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2017674309}) 2026-02-12T18:14:53.382 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.338+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1718781315}) 2026-02-12T18:14:53.382 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.338+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.382 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.338+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2017674309}) 2026-02-12T18:14:53.382 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.338+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2436459794}) 2026-02-12T18:14:53.382 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.338+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.382 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.338+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2017674309}) 2026-02-12T18:14:53.382 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.338+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4012552663}) 2026-02-12T18:14:53.382 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.338+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.382 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.338+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2017674309}) 2026-02-12T18:14:53.382 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.338+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1522833166}) 2026-02-12T18:14:53.382 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.344+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.382 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.344+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4233945824}) 2026-02-12T18:14:53.382 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.344+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2434519581}) 2026-02-12T18:14:53.383 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.344+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.383 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.344+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4233945824}) 2026-02-12T18:14:53.383 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.344+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2110421806}) 2026-02-12T18:14:53.383 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.344+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.383 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.344+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4233945824}) 2026-02-12T18:14:53.383 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.344+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=689172676}) 2026-02-12T18:14:53.383 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.344+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.383 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.344+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4233945824}) 2026-02-12T18:14:53.383 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.344+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=576741101}) 2026-02-12T18:14:53.383 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.344+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.383 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.344+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4233945824}) 2026-02-12T18:14:53.383 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.344+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1014887055}) 2026-02-12T18:14:53.383 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.344+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.383 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.344+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4233945824}) 2026-02-12T18:14:53.383 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.344+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=593990532}) 2026-02-12T18:14:53.383 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.344+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.383 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.344+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4233945824}) 2026-02-12T18:14:53.383 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.344+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3160346363}) 2026-02-12T18:14:53.383 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.344+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.383 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.344+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4233945824}) 2026-02-12T18:14:53.383 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.344+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3697276481}) 2026-02-12T18:14:53.383 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.350+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.383 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.350+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=691869712}) 2026-02-12T18:14:53.383 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.350+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2360503899}) 2026-02-12T18:14:53.384 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.350+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.384 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.350+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=691869712}) 2026-02-12T18:14:53.384 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.350+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2292663881}) 2026-02-12T18:14:53.384 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.350+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.384 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.350+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=691869712}) 2026-02-12T18:14:53.384 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.350+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3017425348}) 2026-02-12T18:14:53.384 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.350+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.384 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.351+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=691869712}) 2026-02-12T18:14:53.384 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.351+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1724028414}) 2026-02-12T18:14:53.384 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.351+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.384 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.351+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=691869712}) 2026-02-12T18:14:53.384 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.351+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2398148355}) 2026-02-12T18:14:53.384 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.351+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.384 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.351+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=691869712}) 2026-02-12T18:14:53.384 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.351+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1766167460}) 2026-02-12T18:14:53.384 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.351+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.384 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.351+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=691869712}) 2026-02-12T18:14:53.384 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.351+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1907539663}) 2026-02-12T18:14:53.384 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.351+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.384 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.351+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=691869712}) 2026-02-12T18:14:53.384 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.351+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1066519973}) 2026-02-12T18:14:53.384 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.353+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.384 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.353+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=29,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=11,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=23} crc {logm=3936583432,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgrstat=2264904080,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=2313880564,osd_snap=841190635,osdmap=725208417}) 2026-02-12T18:14:53.385 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.353+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=29,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=23} crc {logm=2442741037,mdsmap=3465989318,mgr=2152480943,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=1189975704,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1290305223,osd_pg_creating=2313880564,osd_snap=841190635,osdmap=2028925402}) 2026-02-12T18:14:53.385 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.353+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.385 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.353+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=29,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=11,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=23} crc {logm=3936583432,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgrstat=2264904080,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=2313880564,osd_snap=841190635,osdmap=725208417}) 2026-02-12T18:14:53.385 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.353+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=29,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=21} crc {logm=3293997225,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=1033891035,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=2227164093,osd_pg_creating=2313880564,osd_snap=841190635,osdmap=3761453183}) 2026-02-12T18:14:53.385 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.353+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.385 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.353+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=29,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=11,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=23} crc {logm=3936583432,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgrstat=2264904080,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=2313880564,osd_snap=841190635,osdmap=725208417}) 2026-02-12T18:14:53.385 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.353+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=30,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=22} crc {logm=2042113894,mdsmap=968626843,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=1033891035,mon_config_key=1874198738,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1290305223,osd_pg_creating=2313880564,osd_snap=841190635,osdmap=4247404810}) 2026-02-12T18:14:53.385 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.353+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.385 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.353+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=29,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=11,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=23} crc {logm=3936583432,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgrstat=2264904080,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=2313880564,osd_snap=841190635,osdmap=725208417}) 2026-02-12T18:14:53.385 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.353+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=28,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=23} crc {logm=913828332,mdsmap=3465989318,mgr=1527302087,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=1012091358,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1679651515,osd_pg_creating=2313880564,osd_snap=841190635,osdmap=3622454715}) 2026-02-12T18:14:53.385 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.353+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.385 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.353+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=29,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=11,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=23} crc {logm=3936583432,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgrstat=2264904080,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=2313880564,osd_snap=841190635,osdmap=725208417}) 2026-02-12T18:14:53.385 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.353+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=29,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=27} crc {logm=1792877595,mdsmap=3465989318,mgr=3790985830,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=3667856762,mon_config_key=3511900795,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=2313880564,osd_snap=841190635,osdmap=1396684890}) 2026-02-12T18:14:53.385 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.353+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.385 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.353+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=29,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=11,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=23} crc {logm=3936583432,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgrstat=2264904080,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=2313880564,osd_snap=841190635,osdmap=725208417}) 2026-02-12T18:14:53.385 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.353+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=29,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=21} crc {logm=1711629248,mdsmap=3465989318,mgr=1001460191,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=1033891035,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=2313880564,osd_snap=841190635,osdmap=4190130738}) 2026-02-12T18:14:53.385 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.353+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.385 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.353+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=29,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=11,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=23} crc {logm=3936583432,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgrstat=2264904080,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=2313880564,osd_snap=841190635,osdmap=725208417}) 2026-02-12T18:14:53.385 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.353+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=28,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=8,monmap=2,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=24} crc {logm=2782699923,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=1114520518,mon_config_key=1654720334,monmap=3865314839,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=2313880564,osd_snap=841190635,osdmap=2188827207}) 2026-02-12T18:14:53.385 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.353+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.385 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.353+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=29,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=11,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=23} crc {logm=3936583432,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgrstat=2264904080,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=2313880564,osd_snap=841190635,osdmap=725208417}) 2026-02-12T18:14:53.386 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.353+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=30,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=21} crc {logm=2042113894,mdsmap=3465989318,mgr=2585383004,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=1033891035,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1290305223,osd_pg_creating=2313880564,osd_snap=841190635,osdmap=1464982869}) 2026-02-12T18:14:53.421 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2026-02-12T18:14:53.421 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T18:14:53.423 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.421+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.423 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.421+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=631574592}) 2026-02-12T18:14:53.423 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.421+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=477919948}) 2026-02-12T18:14:53.423 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.421+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.423 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.421+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=631574592}) 2026-02-12T18:14:53.424 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.421+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1115141147}) 2026-02-12T18:14:53.424 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.421+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.424 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.421+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=631574592}) 2026-02-12T18:14:53.424 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.421+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=650298076}) 2026-02-12T18:14:53.424 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.421+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.424 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.421+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=631574592}) 2026-02-12T18:14:53.424 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.421+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=586112937}) 2026-02-12T18:14:53.424 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.421+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.424 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.421+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=631574592}) 2026-02-12T18:14:53.424 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.421+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=3106729811}) 2026-02-12T18:14:53.424 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.421+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.424 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.421+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=631574592}) 2026-02-12T18:14:53.424 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.421+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=4290367906}) 2026-02-12T18:14:53.424 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.421+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.424 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.421+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=631574592}) 2026-02-12T18:14:53.424 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.421+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=268544734}) 2026-02-12T18:14:53.424 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.421+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.424 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.421+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=631574592}) 2026-02-12T18:14:53.424 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.421+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=3908702115}) 2026-02-12T18:14:53.427 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.424+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.427 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.424+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=47} crc {osdmap=2188344873}) 2026-02-12T18:14:53.427 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.424+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=43} crc {osdmap=2959052453}) 2026-02-12T18:14:53.427 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.424+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.427 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.424+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=47} crc {osdmap=2188344873}) 2026-02-12T18:14:53.428 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.424+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=47} crc {osdmap=234640553}) 2026-02-12T18:14:53.428 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.424+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.428 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.424+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=47} crc {osdmap=2188344873}) 2026-02-12T18:14:53.428 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.424+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=47} crc {osdmap=979480201}) 2026-02-12T18:14:53.428 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.424+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.428 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.424+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=47} crc {osdmap=2188344873}) 2026-02-12T18:14:53.428 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.424+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=42} crc {osdmap=1066437860}) 2026-02-12T18:14:53.428 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.424+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.428 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.424+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=47} crc {osdmap=2188344873}) 2026-02-12T18:14:53.428 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.424+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=44} crc {osdmap=3860815977}) 2026-02-12T18:14:53.428 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.424+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.428 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.424+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=47} crc {osdmap=2188344873}) 2026-02-12T18:14:53.428 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.424+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=43} crc {osdmap=2645131894}) 2026-02-12T18:14:53.428 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.424+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.428 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.424+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=47} crc {osdmap=2188344873}) 2026-02-12T18:14:53.428 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.424+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=46} crc {osdmap=2582643744}) 2026-02-12T18:14:53.428 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.424+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:14:53.429 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.424+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=47} crc {osdmap=2188344873}) 2026-02-12T18:14:53.429 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:14:53.424+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=43} crc {osdmap=238901652}) 2026-02-12T18:14:53.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.485+0000 7f4af26cc640 10 monclient: get_monmap_and_config 2026-02-12T18:14:53.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.485+0000 7f4af26cc640 10 monclient: build_initial_monmap 2026-02-12T18:14:53.487 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.485+0000 7f4af26cc640 10 monclient: monmap: 2026-02-12T18:14:53.487 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:53.487 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:53.487 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:14:53.486633+0000 2026-02-12T18:14:53.487 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:14:53.486633+0000 2026-02-12T18:14:53.487 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:53.487 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:53.487 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:14:53.488 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:14:53.488 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:53.488 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:53.488 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:53.488 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:53.488 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:53.488 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:53.488 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:53.488 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:14:53.488 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:14:53.488 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:53.498 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.485+0000 7f4af26cc640 1 Processor -- start 2026-02-12T18:14:53.498 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4af26cc640 1 -- start start 2026-02-12T18:14:53.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4af26cc640 10 monclient: init 2026-02-12T18:14:53.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4af26cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:53.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4af26cc640 10 monclient: _add_conns ranks=[4,0,8,7,6,3,10,5,1,9,2] 2026-02-12T18:14:53.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4af26cc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4aec144600 0x7f4aec1449d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:53.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4af26cc640 10 monclient(hunting): picked mon.noname-c con 0x7f4aec144600 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:14:53.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4af26cc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f4aec144210 addr v1:10.20.193.48:6789/0 2026-02-12T18:14:53.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4af26cc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4aec144f10 0x7f4aec08a500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:53.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4af26cc640 10 monclient(hunting): picked mon.noname-e con 0x7f4aec144f10 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:14:53.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4af26cc640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4aec060390 con 0x7f4aec144210 2026-02-12T18:14:53.499 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4af26cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:53.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4af26cc640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f4aec092be0 con 0x7f4aec144600 2026-02-12T18:14:53.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4af26cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:53.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4af26cc640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f4aec08b230 con 0x7f4aec144f10 2026-02-12T18:14:53.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4af26cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:53.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4af26cc640 10 monclient(hunting): authenticate will time out at 1132.212326s 2026-02-12T18:14:53.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4aebfff640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4aec144600 0x7f4aec1449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:53.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4aeb7fe640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f4aec144210 0x7f4aec089df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:53424/0 (socket says 10.20.193.48:53424) 2026-02-12T18:14:53.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4af0c42640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4aec144f10 0x7f4aec08a500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:53.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4aeb7fe640 1 -- 10.20.193.48:0/1457482940 learned_addr learned my addr 10.20.193.48:0/1457482940 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:14:53.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4aebfff640 10 monclient(hunting): get_auth_request con 0x7f4aec144600 auth_method 0 2026-02-12T18:14:53.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4aebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:53.500 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4aebfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:53.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4aebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:53.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4af0c42640 10 monclient(hunting): get_auth_request con 0x7f4aec144f10 auth_method 0 2026-02-12T18:14:53.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4af0c42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:53.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4af0c42640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:53.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4af0c42640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:53.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4aebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:53.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4aebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:53.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4aebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:53.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4af0c42640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:53.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4af0c42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:53.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4af0c42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:53.501 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4aebfff640 10 monclient(hunting): handle_auth_done global_id 65074 payload 274 2026-02-12T18:14:53.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4aebfff640 1 -- 10.20.193.48:0/1457482940 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4aec144f10 msgr2=0x7f4aec08a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:53.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4aebfff640 1 --2- 10.20.193.48:0/1457482940 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4aec144f10 0x7f4aec08a500 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4aebfff640 1 -- 10.20.193.48:0/1457482940 >> v1:10.20.193.48:6789/0 conn(0x7f4aec144210 legacy=0x7f4aec089df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:53.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4aebfff640 10 monclient: _finish_hunting 0 2026-02-12T18:14:53.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4aebfff640 1 monclient: found mon.noname-c 2026-02-12T18:14:53.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4aebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:53.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4aebfff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:14:53.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.486+0000 7f4aebfff640 1 -- 10.20.193.48:0/1457482940 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aec092370 con 0x7f4aec144600 2026-02-12T18:14:53.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4aebfff640 1 -- 10.20.193.48:0/1457482940 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4aec144600 msgr2=0x7f4aec1449d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:53.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4aebfff640 1 --2- 10.20.193.48:0/1457482940 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4aec144600 0x7f4aec1449d0 secure :-1 s=READY pgs=203 gs=2 cs=0 l=1 c_cookie=1929768324264147209 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ad8009830 tx=0x7f4ad802edc0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=1ac7ea110a90b909 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:53.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4aeaffd640 1 -- 10.20.193.48:0/1457482940 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4ad8035340 con 0x7f4aec144600 2026-02-12T18:14:53.502 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4aeaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:53.503 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4aeaffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:14:53.503 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4aeaffd640 10 monclient: dump: 2026-02-12T18:14:53.503 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:53.503 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:53.503 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.503 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.503 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:53.503 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:53.503 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:53.503 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:53.503 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:53.503 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:53.503 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:53.504 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:53.504 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:53.504 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:53.504 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:53.504 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:53.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4aeaffd640 10 monclient: _finish_auth 0 2026-02-12T18:14:53.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4aeaffd640 10 monclient: _check_auth_tickets 2026-02-12T18:14:53.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4aeaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:53.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4aeaffd640 1 -- 10.20.193.48:0/1457482940 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ad80354c0 con 0x7f4aec144600 2026-02-12T18:14:53.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4aeaffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:53.504 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4aeaffd640 1 -- 10.20.193.48:0/1457482940 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4ad8035af0 con 0x7f4aec144600 2026-02-12T18:14:53.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4af26cc640 5 monclient: authenticate success, global_id 65074 2026-02-12T18:14:53.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4aeaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:53.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4aeaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:14:53.505 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4aeaffd640 10 monclient: dump: 2026-02-12T18:14:53.505 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:53.505 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:53.505 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.505 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.505 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:53.505 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:53.505 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:53.505 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:53.505 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:53.506 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:53.506 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:53.506 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:53.506 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:53.506 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:53.506 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:53.506 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:53.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4af26cc640 10 monclient: get_monmap_and_config success 2026-02-12T18:14:53.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4af26cc640 4 set_mon_vals no callback set 2026-02-12T18:14:53.506 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4af26cc640 10 monclient: shutdown 2026-02-12T18:14:53.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4af26cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:53.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4af26cc640 1 -- 10.20.193.48:0/1457482940 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4aec144600 msgr2=0x7f4aec1449d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:53.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4af26cc640 1 --2- 10.20.193.48:0/1457482940 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4aec144600 0x7f4aec1449d0 secure :-1 s=READY pgs=203 gs=2 cs=0 l=1 c_cookie=1929768324264147209 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ad8009830 tx=0x7f4ad802edc0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4af26cc640 1 -- 10.20.193.48:0/1457482940 shutdown_connections 2026-02-12T18:14:53.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4af26cc640 1 --2- 10.20.193.48:0/1457482940 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4aec144f10 0x7f4aec08a500 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4af26cc640 1 --2- 10.20.193.48:0/1457482940 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4aec144600 0x7f4aec1449d0 unknown :-1 s=CLOSED pgs=203 gs=2 cs=0 l=1 c_cookie=1929768324264147209 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4af26cc640 1 -- 10.20.193.48:0/1457482940 >> 10.20.193.48:0/1457482940 conn(0x7f4aec0546d0 msgr2=0x7f4aec054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:53.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4af26cc640 1 -- 10.20.193.48:0/1457482940 shutdown_connections 2026-02-12T18:14:53.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.489+0000 7f4af26cc640 1 -- 10.20.193.48:0/1457482940 wait complete. 2026-02-12T18:14:53.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.490+0000 7f4af26cc640 10 monclient: build_initial_monmap 2026-02-12T18:14:53.507 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.490+0000 7f4af26cc640 10 monclient: monmap: 2026-02-12T18:14:53.508 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:53.508 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:14:53.508 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:14:53.508 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:14:53.508 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:53.508 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:53.508 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:14:53.508 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:14:53.508 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:53.508 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:53.509 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:53.509 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:53.509 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:53.509 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:53.509 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:53.509 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:53.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.490+0000 7f4af26cc640 1 Processor -- start 2026-02-12T18:14:53.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.490+0000 7f4af26cc640 1 -- start start 2026-02-12T18:14:53.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.490+0000 7f4af26cc640 10 monclient: init 2026-02-12T18:14:53.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.490+0000 7f4af26cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:53.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.490+0000 7f4af26cc640 10 monclient: _add_conns ranks=[1,8,6,0,5,7,3,2,4] 2026-02-12T18:14:53.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.490+0000 7f4af26cc640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f4aec144210 0x7f4aec131750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:53.509 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.490+0000 7f4af26cc640 10 monclient(hunting): picked mon.noname-f con 0x7f4aec144210 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:14:53.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.490+0000 7f4af26cc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4aec144600 0x7f4aec131c90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:53.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.490+0000 7f4af26cc640 10 monclient(hunting): picked mon.noname-e con 0x7f4aec144600 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:14:53.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.490+0000 7f4af26cc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4aec144f10 0x7f4aec10db60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:53.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.490+0000 7f4af26cc640 10 monclient(hunting): picked mon.noname-d con 0x7f4aec144f10 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:14:53.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.490+0000 7f4af26cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:53.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.490+0000 7f4af26cc640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec0977a0 con 0x7f4aec144210 2026-02-12T18:14:53.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.490+0000 7f4af26cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:53.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.490+0000 7f4af26cc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f4aec0915f0 con 0x7f4aec144f10 2026-02-12T18:14:53.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.490+0000 7f4af26cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:53.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.490+0000 7f4af26cc640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f4aec123e80 con 0x7f4aec144600 2026-02-12T18:14:53.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.490+0000 7f4af26cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:53.510 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.490+0000 7f4af26cc640 10 monclient(hunting): authenticate will time out at 1132.216880s 2026-02-12T18:14:53.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.490+0000 7f4aeb7fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4aec144600 0x7f4aec131c90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:53.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.490+0000 7f4af0c42640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4aec144f10 0x7f4aec10db60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:53.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.490+0000 7f4aeb7fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4aec144600 0x7f4aec131c90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:37104/0 (socket says 10.20.193.48:37104) 2026-02-12T18:14:53.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.490+0000 7f4aeb7fe640 1 -- 10.20.193.48:0/297178347 learned_addr learned my addr 10.20.193.48:0/297178347 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:53.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4af0c42640 10 monclient(hunting): get_auth_request con 0x7f4aec144f10 auth_method 0 2026-02-12T18:14:53.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4af0c42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:53.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4af0c42640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:53.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4af0c42640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:53.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4aeb7fe640 10 monclient(hunting): get_auth_request con 0x7f4aec144600 auth_method 0 2026-02-12T18:14:53.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4aeb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:53.511 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4aeb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:53.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4aeb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:53.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4aebfff640 1 --2- 10.20.193.48:0/297178347 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f4aec144210 0x7f4aec131750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:53.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4aebfff640 10 monclient(hunting): get_auth_request con 0x7f4aec144210 auth_method 0 2026-02-12T18:14:53.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4aebfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:53.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4aebfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:53.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4aebfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:53.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4af0c42640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:53.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4af0c42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:53.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4af0c42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:53.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4aeb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:53.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4aeb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:53.512 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4aeb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:53.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4aebfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:53.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4aebfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:53.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4aebfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:53.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4af0c42640 10 monclient(hunting): handle_auth_done global_id 104208 payload 824 2026-02-12T18:14:53.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4af0c42640 1 -- 10.20.193.48:0/297178347 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4aec144600 msgr2=0x7f4aec131c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:53.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4af0c42640 1 --2- 10.20.193.48:0/297178347 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4aec144600 0x7f4aec131c90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4af0c42640 1 -- 10.20.193.48:0/297178347 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f4aec144210 msgr2=0x7f4aec131750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:53.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4af0c42640 1 --2- 10.20.193.48:0/297178347 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f4aec144210 0x7f4aec131750 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4af0c42640 10 monclient: _finish_hunting 0 2026-02-12T18:14:53.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4af0c42640 1 monclient: found mon.noname-d 2026-02-12T18:14:53.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4af0c42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:53.513 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4af0c42640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:14:53.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.491+0000 7f4af0c42640 1 -- 10.20.193.48:0/297178347 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad8009420 con 0x7f4aec144f10 2026-02-12T18:14:53.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.493+0000 7f4af0c42640 1 -- 10.20.193.48:0/297178347 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4aec144f10 msgr2=0x7f4aec10db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:53.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.493+0000 7f4af0c42640 1 --2- 10.20.193.48:0/297178347 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4aec144f10 0x7f4aec10db60 secure :-1 s=READY pgs=21 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ae000afd0 tx=0x7f4ae000fcd0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:53.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.493+0000 7f4ae8ff9640 1 -- 10.20.193.48:0/297178347 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4ae000db50 con 0x7f4aec144f10 2026-02-12T18:14:53.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.493+0000 7f4ae8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:53.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.493+0000 7f4ae8ff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:14:53.514 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.493+0000 7f4ae8ff9640 10 monclient: dump: 2026-02-12T18:14:53.514 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:53.514 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:53.514 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.514 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.514 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:53.514 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:53.515 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:53.515 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:53.515 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:53.515 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:53.515 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:53.515 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:53.515 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:53.515 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:53.515 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:53.515 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:53.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.493+0000 7f4ae8ff9640 10 monclient: _finish_auth 0 2026-02-12T18:14:53.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.493+0000 7f4ae8ff9640 10 monclient: _check_auth_tickets 2026-02-12T18:14:53.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.493+0000 7f4ae8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:53.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.493+0000 7f4ae8ff9640 1 -- 10.20.193.48:0/297178347 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ae000dcd0 con 0x7f4aec144f10 2026-02-12T18:14:53.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.493+0000 7f4af26cc640 5 monclient: authenticate success, global_id 104208 2026-02-12T18:14:53.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.493+0000 7f4ae8ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:53.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.493+0000 7f4ae8ff9640 1 -- 10.20.193.48:0/297178347 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4ae000de40 con 0x7f4aec144f10 2026-02-12T18:14:53.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.493+0000 7f4ae8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:53.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.493+0000 7f4aea7fc640 4 set_mon_vals no callback set 2026-02-12T18:14:53.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.493+0000 7f4ae8ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:14:53.516 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.493+0000 7f4ae8ff9640 10 monclient: dump: 2026-02-12T18:14:53.516 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:53.516 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:53.516 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.516 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.516 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:53.517 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:53.517 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:53.517 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:53.517 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:53.517 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:53.517 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:53.517 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:53.517 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:53.517 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:53.517 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:53.518 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:53.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.493+0000 7f4af26cc640 10 monclient: _renew_subs 2026-02-12T18:14:53.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.493+0000 7f4af26cc640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:14:53.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.493+0000 7f4af26cc640 1 -- 10.20.193.48:0/297178347 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aec126480 con 0x7f4aec144f10 2026-02-12T18:14:53.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.493+0000 7f4af26cc640 10 monclient: _renew_subs 2026-02-12T18:14:53.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.493+0000 7f4af26cc640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:14:53.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.493+0000 7f4af26cc640 1 -- 10.20.193.48:0/297178347 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aec1103c0 con 0x7f4aec144f10 2026-02-12T18:14:53.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.494+0000 7f4af26cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:53.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.494+0000 7f4af26cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:53.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.494+0000 7f4af26cc640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:14:53.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.494+0000 7f4af26cc640 1 -- 10.20.193.48:0/297178347 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4aec1449d0 con 0x7f4aec144f10 2026-02-12T18:14:53.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.494+0000 7f4ae8ff9640 1 -- 10.20.193.48:0/297178347 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f4ae0023020 con 0x7f4aec144f10 2026-02-12T18:14:53.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.494+0000 7f4ae8ff9640 1 --2- 10.20.193.48:0/297178347 >> v2:10.20.193.111:6812/977811348 conn(0x7f4abc03f800 0x7f4abc05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:53.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.494+0000 7f4ae8ff9640 1 -- 10.20.193.48:0/297178347 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(319..319 src has 215..319) ==== 3897+0+0 (secure 0 0 0) 0x7f4ae0053e80 con 0x7f4aec144f10 2026-02-12T18:14:53.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.494+0000 7f4aebfff640 1 --2- 10.20.193.48:0/297178347 >> v2:10.20.193.111:6812/977811348 conn(0x7f4abc03f800 0x7f4abc05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:53.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.494+0000 7f4aebfff640 10 monclient: get_auth_request con 0x7f4abc03f800 auth_method 0 2026-02-12T18:14:53.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.497+0000 7f4ae8ff9640 1 -- 10.20.193.48:0/297178347 <== mon.6 v2:10.20.193.48:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f4ae001c400 con 0x7f4aec144f10 2026-02-12T18:14:53.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.497+0000 7f4ae8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:53.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.497+0000 7f4ae8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:14:53.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.497+0000 7f4aebfff640 1 --2- 10.20.193.48:0/297178347 >> v2:10.20.193.111:6812/977811348 conn(0x7f4abc03f800 0x7f4abc05fcb0 secure :-1 s=READY pgs=451 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ad8009800 tx=0x7f4ad8033000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:53.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.640+0000 7f4af26cc640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T18:14:53.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.640+0000 7f4af26cc640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T18:14:53.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.640+0000 7f4af26cc640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:14:53.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.640+0000 7f4af26cc640 1 -- 10.20.193.48:0/297178347 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4aec063790 con 0x7f4aec144f10 2026-02-12T18:14:53.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.640+0000 7f4ae8ff9640 1 -- 10.20.193.48:0/297178347 <== mon.6 v2:10.20.193.48:3303/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3660 (secure 0 0 0) 0x7f4ae001bed0 con 0x7f4aec144f10 2026-02-12T18:14:53.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.640+0000 7f4ae8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T18:14:53.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.640+0000 7f4ae8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:14:53.643 INFO:teuthology.orchestra.run.trial048.stdout:{"election_epoch":76,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","modified":"2026-02-12T18:05:32.850777Z","created":"2026-02-12T18:05:32.850777Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3300","nonce":0},{"type":"v1","addr":"10.20.193.48:6789","nonce":0}]},"addr":"10.20.193.48:6789/0","public_addr":"10.20.193.48:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850827+0000","crush_location":[]},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3300","nonce":0},{"type":"v1","addr":"10.20.193.111:6789","nonce":0}]},"addr":"10.20.193.111:6789/0","public_addr":"10.20.193.111:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850829+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3301","nonce":0},{"type":"v1","addr":"10.20.193.48:6790","nonce":0}]},"addr":"10.20.193.48:6790/0","public_addr":"10.20.193.48:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850830+0000","crush_location":[]},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3301","nonce":0},{"type":"v1","addr":"10.20.193.111:6790","nonce":0}]},"addr":"10.20.193.111:6790/0","public_addr":"10.20.193.111:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850833+0000","crush_location":[]},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3302","nonce":0},{"type":"v1","addr":"10.20.193.48:6791","nonce":0}]},"addr":"10.20.193.48:6791/0","public_addr":"10.20.193.48:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3302","nonce":0},{"type":"v1","addr":"10.20.193.111:6791","nonce":0}]},"addr":"10.20.193.111:6791/0","public_addr":"10.20.193.111:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850834+0000","crush_location":[]},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3303","nonce":0},{"type":"v1","addr":"10.20.193.48:6792","nonce":0}]},"addr":"10.20.193.48:6792/0","public_addr":"10.20.193.48:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3303","nonce":0},{"type":"v1","addr":"10.20.193.111:6792","nonce":0}]},"addr":"10.20.193.111:6792/0","public_addr":"10.20.193.111:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850835+0000","crush_location":[]},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3304","nonce":0},{"type":"v1","addr":"10.20.193.48:6793","nonce":0}]},"addr":"10.20.193.48:6793/0","public_addr":"10.20.193.48:6793/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850832+0000","crush_location":[]}]}} 2026-02-12T18:14:53.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.641+0000 7f4af26cc640 1 -- 10.20.193.48:0/297178347 >> v2:10.20.193.111:6812/977811348 conn(0x7f4abc03f800 msgr2=0x7f4abc05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:53.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.641+0000 7f4af26cc640 1 --2- 10.20.193.48:0/297178347 >> v2:10.20.193.111:6812/977811348 conn(0x7f4abc03f800 0x7f4abc05fcb0 secure :-1 s=READY pgs=451 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ad8009800 tx=0x7f4ad8033000 comp rx=0 tx=0).stop 2026-02-12T18:14:53.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.641+0000 7f4af26cc640 10 monclient: shutdown 2026-02-12T18:14:53.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.641+0000 7f4af26cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:53.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.641+0000 7f4af26cc640 1 -- 10.20.193.48:0/297178347 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4aec144f10 msgr2=0x7f4aec10db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:53.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.641+0000 7f4af26cc640 1 --2- 10.20.193.48:0/297178347 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4aec144f10 0x7f4aec10db60 secure :-1 s=READY pgs=21 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4ae000afd0 tx=0x7f4ae000fcd0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.641+0000 7f4af26cc640 1 -- 10.20.193.48:0/297178347 shutdown_connections 2026-02-12T18:14:53.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.641+0000 7f4af26cc640 1 --2- 10.20.193.48:0/297178347 >> v2:10.20.193.111:6812/977811348 conn(0x7f4abc03f800 0x7f4abc05fcb0 unknown :-1 s=CLOSED pgs=451 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.641+0000 7f4af26cc640 1 --2- 10.20.193.48:0/297178347 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f4aec144f10 0x7f4aec10db60 unknown :-1 s=CLOSED pgs=21 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.641+0000 7f4af26cc640 1 --2- 10.20.193.48:0/297178347 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4aec144600 0x7f4aec131c90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.641+0000 7f4af26cc640 1 --2- 10.20.193.48:0/297178347 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f4aec144210 0x7f4aec131750 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.641+0000 7f4af26cc640 1 -- 10.20.193.48:0/297178347 >> 10.20.193.48:0/297178347 conn(0x7f4aec0546d0 msgr2=0x7f4aec089df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:53.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.642+0000 7f4af26cc640 1 -- 10.20.193.48:0/297178347 shutdown_connections 2026-02-12T18:14:53.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.642+0000 7f4af26cc640 1 -- 10.20.193.48:0/297178347 wait complete. 2026-02-12T18:14:53.651 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2026-02-12T18:14:53.651 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2026-02-12T18:14:53.651 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2026-02-12T18:14:53.651 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T18:14:53.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.756+0000 7ff896052640 10 monclient: get_monmap_and_config 2026-02-12T18:14:53.760 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.756+0000 7ff896052640 10 monclient: build_initial_monmap 2026-02-12T18:14:53.761 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.756+0000 7ff896052640 10 monclient: monmap: 2026-02-12T18:14:53.761 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:53.761 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:53.761 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:14:53.757334+0000 2026-02-12T18:14:53.761 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:14:53.757334+0000 2026-02-12T18:14:53.761 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:53.761 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:53.762 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:14:53.762 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:14:53.762 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:53.762 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:53.762 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:53.762 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:53.762 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:53.762 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:53.762 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:53.762 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:14:53.762 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:14:53.762 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:53.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.756+0000 7ff896052640 1 Processor -- start 2026-02-12T18:14:53.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.756+0000 7ff896052640 1 -- start start 2026-02-12T18:14:53.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.756+0000 7ff896052640 10 monclient: init 2026-02-12T18:14:53.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.756+0000 7ff896052640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:53.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.756+0000 7ff896052640 10 monclient: _add_conns ranks=[5,6,4,10,7,0,8,9,2,1,3] 2026-02-12T18:14:53.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.756+0000 7ff896052640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff89005d550 0x7ff89005d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:53.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.756+0000 7ff896052640 10 monclient(hunting): picked mon.noname-h con 0x7ff89005d550 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:14:53.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.756+0000 7ff896052640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff89005de60 0x7ff890141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:53.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff896052640 10 monclient(hunting): picked mon.noname-d con 0x7ff89005de60 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:14:53.763 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff896052640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff89013ef60 0x7ff8901424e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:53.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff896052640 10 monclient(hunting): picked mon.noname-c con 0x7ff89013ef60 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:14:53.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff896052640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:53.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff896052640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7ff89008d390 con 0x7ff89013ef60 2026-02-12T18:14:53.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff896052640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:53.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff896052640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7ff89008d5a0 con 0x7ff89005d550 2026-02-12T18:14:53.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff896052640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:53.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff896052640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7ff8900580e0 con 0x7ff89005de60 2026-02-12T18:14:53.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff896052640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:53.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff896052640 10 monclient(hunting): authenticate will time out at 1132.483025s 2026-02-12T18:14:53.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88effd640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff89005de60 0x7ff890141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:53.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88ffff640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff89013ef60 0x7ff8901424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:53.764 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88effd640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff89005de60 0x7ff890141fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:36020/0 (socket says 10.20.193.48:36020) 2026-02-12T18:14:53.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88effd640 1 -- 10.20.193.48:0/29079397 learned_addr learned my addr 10.20.193.48:0/29079397 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:53.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88effd640 10 monclient(hunting): get_auth_request con 0x7ff89005de60 auth_method 0 2026-02-12T18:14:53.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:53.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:53.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:53.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88ffff640 10 monclient(hunting): get_auth_request con 0x7ff89013ef60 auth_method 0 2026-02-12T18:14:53.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:53.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:53.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:53.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:53.765 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:53.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:53.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:53.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:53.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:53.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88f7fe640 1 --2- 10.20.193.48:0/29079397 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff89005d550 0x7ff89005d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:53.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88f7fe640 10 monclient(hunting): get_auth_request con 0x7ff89005d550 auth_method 0 2026-02-12T18:14:53.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:53.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:53.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:53.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88effd640 10 monclient(hunting): handle_auth_done global_id 104217 payload 274 2026-02-12T18:14:53.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88effd640 1 -- 10.20.193.48:0/29079397 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff89005d550 msgr2=0x7ff89005d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:53.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88effd640 1 --2- 10.20.193.48:0/29079397 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff89005d550 0x7ff89005d920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88effd640 1 -- 10.20.193.48:0/29079397 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff89013ef60 msgr2=0x7ff8901424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:53.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88effd640 1 --2- 10.20.193.48:0/29079397 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff89013ef60 0x7ff8901424e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88effd640 10 monclient: _finish_hunting 0 2026-02-12T18:14:53.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88effd640 1 monclient: found mon.noname-d 2026-02-12T18:14:53.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:53.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88effd640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:14:53.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.757+0000 7ff88effd640 1 -- 10.20.193.48:0/29079397 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff89004dc20 con 0x7ff89005de60 2026-02-12T18:14:53.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.759+0000 7ff88effd640 1 -- 10.20.193.48:0/29079397 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff89005de60 msgr2=0x7ff890141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:53.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.759+0000 7ff88effd640 1 --2- 10.20.193.48:0/29079397 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff89005de60 0x7ff890141fa0 secure :-1 s=READY pgs=22 gs=1 cs=0 l=1 c_cookie=13909628722164590270 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8800098d0 tx=0x7ff88002ee20 comp rx=0 tx=0).ready entity=mon.6 client_cookie=c108eda05e30e6be server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:53.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.759+0000 7ff88e7fc640 1 -- 10.20.193.48:0/29079397 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff880035340 con 0x7ff89005de60 2026-02-12T18:14:53.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff88e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:53.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff88e7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:14:53.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff88e7fc640 10 monclient: dump: 2026-02-12T18:14:53.779 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:53.779 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:53.779 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.779 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.779 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:53.779 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:53.779 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:53.779 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:53.780 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:53.780 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:53.780 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:53.780 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:53.780 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:53.780 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:53.780 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:53.780 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:53.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff88e7fc640 10 monclient: _finish_auth 0 2026-02-12T18:14:53.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff88e7fc640 10 monclient: _check_auth_tickets 2026-02-12T18:14:53.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff88e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:53.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff896052640 5 monclient: authenticate success, global_id 104217 2026-02-12T18:14:53.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff896052640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:14:53.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff88e7fc640 1 -- 10.20.193.48:0/29079397 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8800354c0 con 0x7ff89005de60 2026-02-12T18:14:53.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff88e7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:53.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff88e7fc640 1 -- 10.20.193.48:0/29079397 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff880035630 con 0x7ff89005de60 2026-02-12T18:14:53.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff88e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:53.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff88e7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:14:53.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff88e7fc640 10 monclient: dump: 2026-02-12T18:14:53.781 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:53.781 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:53.781 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.782 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.782 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:53.782 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:53.782 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:53.782 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:53.782 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:53.782 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:53.782 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:53.782 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:53.782 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:53.782 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:53.782 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:53.782 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:53.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff896052640 10 monclient: get_monmap_and_config success 2026-02-12T18:14:53.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff896052640 4 set_mon_vals no callback set 2026-02-12T18:14:53.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff896052640 10 monclient: shutdown 2026-02-12T18:14:53.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff896052640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:53.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff896052640 1 -- 10.20.193.48:0/29079397 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff89005de60 msgr2=0x7ff890141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:53.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff896052640 1 --2- 10.20.193.48:0/29079397 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff89005de60 0x7ff890141fa0 secure :-1 s=READY pgs=22 gs=1 cs=0 l=1 c_cookie=13909628722164590270 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff8800098d0 tx=0x7ff88002ee20 comp rx=0 tx=0).stop 2026-02-12T18:14:53.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff896052640 1 -- 10.20.193.48:0/29079397 shutdown_connections 2026-02-12T18:14:53.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff896052640 1 --2- 10.20.193.48:0/29079397 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff89013ef60 0x7ff8901424e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff896052640 1 --2- 10.20.193.48:0/29079397 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff89005de60 0x7ff890141fa0 unknown :-1 s=CLOSED pgs=22 gs=1 cs=0 l=1 c_cookie=13909628722164590270 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff896052640 1 --2- 10.20.193.48:0/29079397 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff89005d550 0x7ff89005d920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff896052640 1 -- 10.20.193.48:0/29079397 >> 10.20.193.48:0/29079397 conn(0x7ff8900546a0 msgr2=0x7ff890054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:53.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff896052640 1 -- 10.20.193.48:0/29079397 shutdown_connections 2026-02-12T18:14:53.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff896052640 1 -- 10.20.193.48:0/29079397 wait complete. 2026-02-12T18:14:53.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff896052640 10 monclient: build_initial_monmap 2026-02-12T18:14:53.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.760+0000 7ff896052640 10 monclient: monmap: 2026-02-12T18:14:53.784 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:53.784 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:14:53.784 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:14:53.784 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:14:53.784 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:53.784 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:53.784 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:14:53.784 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:14:53.785 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:53.785 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:53.785 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:53.785 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:53.785 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:53.785 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:53.785 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:53.785 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:53.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff896052640 1 Processor -- start 2026-02-12T18:14:53.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff896052640 1 -- start start 2026-02-12T18:14:53.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff896052640 10 monclient: init 2026-02-12T18:14:53.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff896052640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:53.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff896052640 10 monclient: _add_conns ranks=[1,4,2,7,8,0,5,3,6] 2026-02-12T18:14:53.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff896052640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff89005d550 0x7ff890131080 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:53.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff896052640 10 monclient(hunting): picked mon.noname-f con 0x7ff89005d550 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:14:53.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff896052640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff89005de60 0x7ff89010b8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:53.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff896052640 10 monclient(hunting): picked mon.noname-c con 0x7ff89005de60 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:14:53.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff896052640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff89013ef60 0x7ff89010bde0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:53.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff896052640 10 monclient(hunting): picked mon.noname-b con 0x7ff89013ef60 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:14:53.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff896052640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:53.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff896052640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff8901208d0 con 0x7ff89005d550 2026-02-12T18:14:53.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff896052640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:53.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff896052640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7ff89010f520 con 0x7ff89013ef60 2026-02-12T18:14:53.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff896052640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:53.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff896052640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7ff89013dad0 con 0x7ff89005de60 2026-02-12T18:14:53.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff896052640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:53.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff896052640 10 monclient(hunting): authenticate will time out at 1132.487472s 2026-02-12T18:14:53.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88effd640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff89005de60 0x7ff89010b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:53.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88effd640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff89005de60 0x7ff89010b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:36860/0 (socket says 10.20.193.48:36860) 2026-02-12T18:14:53.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88effd640 1 -- 10.20.193.48:0/3352109825 learned_addr learned my addr 10.20.193.48:0/3352109825 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:53.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88effd640 10 monclient(hunting): get_auth_request con 0x7ff89005de60 auth_method 0 2026-02-12T18:14:53.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:53.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:53.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:53.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88ffff640 1 --2- 10.20.193.48:0/3352109825 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff89013ef60 0x7ff89010bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:53.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:53.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:53.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:53.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88ffff640 10 monclient(hunting): get_auth_request con 0x7ff89013ef60 auth_method 0 2026-02-12T18:14:53.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:53.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:53.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:53.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:53.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:53.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:53.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88f7fe640 1 --2- 10.20.193.48:0/3352109825 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff89005d550 0x7ff890131080 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:53.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88f7fe640 10 monclient(hunting): get_auth_request con 0x7ff89005d550 auth_method 0 2026-02-12T18:14:53.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:53.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:53.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:53.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88effd640 10 monclient(hunting): handle_auth_done global_id 65092 payload 824 2026-02-12T18:14:53.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88effd640 1 -- 10.20.193.48:0/3352109825 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff89013ef60 msgr2=0x7ff89010bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:53.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88effd640 1 --2- 10.20.193.48:0/3352109825 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff89013ef60 0x7ff89010bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88effd640 1 -- 10.20.193.48:0/3352109825 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff89005d550 msgr2=0x7ff890131080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:53.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88effd640 1 --2- 10.20.193.48:0/3352109825 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff89005d550 0x7ff890131080 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88effd640 10 monclient: _finish_hunting 0 2026-02-12T18:14:53.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88effd640 1 monclient: found mon.noname-c 2026-02-12T18:14:53.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:53.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88effd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:14:53.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.761+0000 7ff88effd640 1 -- 10.20.193.48:0/3352109825 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8800094f0 con 0x7ff89005de60 2026-02-12T18:14:53.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.763+0000 7ff88effd640 1 -- 10.20.193.48:0/3352109825 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff89005de60 msgr2=0x7ff89010b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:53.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.763+0000 7ff88effd640 1 --2- 10.20.193.48:0/3352109825 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff89005de60 0x7ff89010b8a0 secure :-1 s=READY pgs=204 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff880004740 tx=0x7ff880004770 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:53.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff86bfff640 1 -- 10.20.193.48:0/3352109825 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff880035340 con 0x7ff89005de60 2026-02-12T18:14:53.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff86bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:53.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff86bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:14:53.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff86bfff640 10 monclient: dump: 2026-02-12T18:14:53.790 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:53.790 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:53.790 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.791 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.791 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:53.791 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:53.791 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:53.791 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:53.791 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:53.791 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:53.791 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:53.791 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:53.791 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:53.791 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:53.792 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:53.792 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:53.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff86bfff640 10 monclient: _finish_auth 0 2026-02-12T18:14:53.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff86bfff640 10 monclient: _check_auth_tickets 2026-02-12T18:14:53.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff86bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:53.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff896052640 5 monclient: authenticate success, global_id 65092 2026-02-12T18:14:53.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff896052640 10 monclient: _renew_subs 2026-02-12T18:14:53.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff896052640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:14:53.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff896052640 1 -- 10.20.193.48:0/3352109825 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff89010d1c0 con 0x7ff89005de60 2026-02-12T18:14:53.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff86bfff640 1 -- 10.20.193.48:0/3352109825 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff880037440 con 0x7ff89005de60 2026-02-12T18:14:53.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff86bfff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:53.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff86bfff640 1 -- 10.20.193.48:0/3352109825 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff880037a70 con 0x7ff89005de60 2026-02-12T18:14:53.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff86bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:53.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff86bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:14:53.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff88dffb640 4 set_mon_vals no callback set 2026-02-12T18:14:53.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff86bfff640 10 monclient: dump: 2026-02-12T18:14:53.793 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:53.793 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:53.793 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.793 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.793 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:53.793 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:53.793 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:53.794 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:53.794 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:53.794 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:53.794 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:53.794 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:53.794 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:53.794 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:53.794 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:53.794 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:53.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff896052640 10 monclient: _renew_subs 2026-02-12T18:14:53.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff896052640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:14:53.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff896052640 1 -- 10.20.193.48:0/3352109825 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7ff89010daa0 con 0x7ff89005de60 2026-02-12T18:14:53.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff896052640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:53.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff896052640 1 --2- 10.20.193.48:0/3352109825 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff890091010 0x7ff89010c320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:53.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff896052640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:53.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff896052640 1 -- 10.20.193.48:0/3352109825 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7ff8900631f0 con 0x7ff890091010 2026-02-12T18:14:53.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff88f7fe640 1 --2- 10.20.193.48:0/3352109825 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff890091010 0x7ff89010c320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:53.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff88f7fe640 10 monclient: get_auth_request con 0x7ff890091010 auth_method 0 2026-02-12T18:14:53.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff88f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:53.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff88f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:53.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff88f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:53.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff88f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:53.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.764+0000 7ff88f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:53.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.765+0000 7ff88f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:53.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.765+0000 7ff86bfff640 1 -- 10.20.193.48:0/3352109825 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7ff880046020 con 0x7ff89005de60 2026-02-12T18:14:53.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.765+0000 7ff88f7fe640 10 monclient(hunting): handle_auth_done global_id 6840 payload 824 2026-02-12T18:14:53.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.765+0000 7ff88f7fe640 1 -- 10.20.193.48:0/3352109825 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff89008d060 con 0x7ff890091010 2026-02-12T18:14:53.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.765+0000 7ff86bfff640 1 --2- 10.20.193.48:0/3352109825 >> v2:10.20.193.111:6812/977811348 conn(0x7ff86003f800 0x7ff86005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:53.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.765+0000 7ff86bfff640 1 -- 10.20.193.48:0/3352109825 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(319..319 src has 215..319) ==== 3897+0+0 (secure 0 0 0) 0x7ff880077dd0 con 0x7ff89005de60 2026-02-12T18:14:53.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.765+0000 7ff88ffff640 1 --2- 10.20.193.48:0/3352109825 >> v2:10.20.193.111:6812/977811348 conn(0x7ff86003f800 0x7ff86005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:53.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.765+0000 7ff88ffff640 10 monclient: get_auth_request con 0x7ff86003f800 auth_method 0 2026-02-12T18:14:53.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.767+0000 7ff88f7fe640 1 -- 10.20.193.48:0/3352109825 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff890091010 msgr2=0x7ff89010c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:53.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.767+0000 7ff88f7fe640 1 --2- 10.20.193.48:0/3352109825 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff890091010 0x7ff89010c320 secure :-1 s=READY pgs=624 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff87c00bfd0 tx=0x7ff87c00f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:53.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.767+0000 7ff86bfff640 1 -- 10.20.193.48:0/3352109825 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff87c0044f0 con 0x7ff890091010 2026-02-12T18:14:53.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.767+0000 7ff86bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:53.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.767+0000 7ff86bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:14:53.796 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.767+0000 7ff86bfff640 10 monclient: dump: 2026-02-12T18:14:53.796 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:53.796 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:53.797 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.797 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.797 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:53.797 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:53.797 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:53.797 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:53.797 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:53.797 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:53.797 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:53.797 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:53.797 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:53.797 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:53.797 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:53.797 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:53.797 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.767+0000 7ff86bfff640 1 -- 10.20.193.48:0/3352109825 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7ff87c004030 con 0x7ff890091010 2026-02-12T18:14:53.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.767+0000 7ff86bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:53.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.767+0000 7ff86bfff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:14:53.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.767+0000 7ff86bfff640 1 -- 10.20.193.48:0/3352109825 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff890091010 msgr2=0x7ff89010c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:53.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.767+0000 7ff86bfff640 1 --2- 10.20.193.48:0/3352109825 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff890091010 0x7ff89010c320 secure :-1 s=READY pgs=624 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff87c00bfd0 tx=0x7ff87c00f920 comp rx=0 tx=0).stop 2026-02-12T18:14:53.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.767+0000 7ff86bfff640 1 -- 10.20.193.48:0/3352109825 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff890091010 msgr2=0x7ff89010c320 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:53.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.767+0000 7ff86bfff640 1 --2- 10.20.193.48:0/3352109825 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff890091010 0x7ff89010c320 secure :-1 s=CLOSED pgs=624 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff87c00bfd0 tx=0x7ff87c00f920 comp rx=0 tx=0).stop 2026-02-12T18:14:53.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.768+0000 7ff88ffff640 1 --2- 10.20.193.48:0/3352109825 >> v2:10.20.193.111:6812/977811348 conn(0x7ff86003f800 0x7ff86005fcb0 secure :-1 s=READY pgs=452 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff890090780 tx=0x7ff88400a2d0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:53.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.771+0000 7ff896052640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:14:53.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.771+0000 7ff896052640 1 --2- 10.20.193.48:0/3352109825 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff8901315c0 0x7ff890121c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:53.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.771+0000 7ff896052640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:53.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.771+0000 7ff896052640 1 -- 10.20.193.48:0/3352109825 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7ff890050410 con 0x7ff8901315c0 2026-02-12T18:14:53.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.771+0000 7ff88f7fe640 1 --2- 10.20.193.48:0/3352109825 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff8901315c0 0x7ff890121c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:53.798 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.771+0000 7ff88f7fe640 10 monclient: get_auth_request con 0x7ff8901315c0 auth_method 0 2026-02-12T18:14:53.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.771+0000 7ff88f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:53.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.771+0000 7ff88f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:53.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.771+0000 7ff88f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:53.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.771+0000 7ff88f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:53.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.771+0000 7ff88f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:53.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.771+0000 7ff88f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:53.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.771+0000 7ff88f7fe640 10 monclient(hunting): handle_auth_done global_id 6849 payload 824 2026-02-12T18:14:53.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.771+0000 7ff88f7fe640 1 -- 10.20.193.48:0/3352109825 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff89005e310 con 0x7ff8901315c0 2026-02-12T18:14:53.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.773+0000 7ff88f7fe640 1 -- 10.20.193.48:0/3352109825 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff8901315c0 msgr2=0x7ff890121c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:53.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.773+0000 7ff88f7fe640 1 --2- 10.20.193.48:0/3352109825 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff8901315c0 0x7ff890121c60 secure :-1 s=READY pgs=625 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff87c004000 tx=0x7ff87c004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:53.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.773+0000 7ff86bfff640 1 -- 10.20.193.48:0/3352109825 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff87c003b90 con 0x7ff8901315c0 2026-02-12T18:14:53.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.773+0000 7ff86bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:53.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.773+0000 7ff86bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:14:53.799 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.773+0000 7ff86bfff640 10 monclient: dump: 2026-02-12T18:14:53.800 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:53.800 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:53.800 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.800 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.800 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:53.800 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:53.800 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:53.800 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:53.800 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:53.800 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:53.800 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:53.800 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:53.800 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:53.800 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:53.800 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:53.800 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:53.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.773+0000 7ff86bfff640 1 -- 10.20.193.48:0/3352109825 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10184 (secure 0 0 0) 0x7ff87c003cf0 con 0x7ff8901315c0 2026-02-12T18:14:53.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.773+0000 7ff86bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:14:53.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.773+0000 7ff86bfff640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:14:53.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.773+0000 7ff86bfff640 1 -- 10.20.193.48:0/3352109825 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff8901315c0 msgr2=0x7ff890121c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:53.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.773+0000 7ff86bfff640 1 --2- 10.20.193.48:0/3352109825 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff8901315c0 0x7ff890121c60 secure :-1 s=READY pgs=625 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff87c004000 tx=0x7ff87c004770 comp rx=0 tx=0).stop 2026-02-12T18:14:53.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.773+0000 7ff86bfff640 1 -- 10.20.193.48:0/3352109825 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff8901315c0 msgr2=0x7ff890121c60 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:53.801 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.773+0000 7ff86bfff640 1 --2- 10.20.193.48:0/3352109825 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff8901315c0 0x7ff890121c60 secure :-1 s=CLOSED pgs=625 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff87c004000 tx=0x7ff87c004770 comp rx=0 tx=0).stop 2026-02-12T18:14:53.801 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:14:53.801 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:14:53.802 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:14:53.802 INFO:teuthology.orchestra.run.trial048.stdout: "state": "leader", 2026-02-12T18:14:53.802 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 76, 2026-02-12T18:14:53.802 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 548607, 2026-02-12T18:14:53.802 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:14:53.802 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:14:53.802 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:14:53.802 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:14:53.802 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:14:53.802 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:14:53.802 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:14:53.802 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:14:53.802 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:14:53.802 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:14:53.802 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:53.803 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 7, 2026-02-12T18:14:53.803 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:53.803 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:14:53.803 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:14:53.803 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:53.803 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:53.803 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:53.803 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:53.803 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:53.803 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:53.803 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:53.803 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:53.803 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:53.803 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:53.803 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:53.803 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:53.804 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:53.804 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:53.804 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:14:53.804 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:14:53.804 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:53.804 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:53.804 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:53.804 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:53.804 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:53.804 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:53.804 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:53.804 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:53.804 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:53.804 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:53.804 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:53.804 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:53.804 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:53.805 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:53.805 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.805 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:14:53.805 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:14:53.805 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:14:53.805 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:14:53.805 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:14:53.805 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:14:53.805 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:53.805 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:53.805 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:14:53.805 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:14:53.805 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:14:53.805 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:14:53.805 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:14:53.805 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:14:53.805 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:14:53.806 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:53.806 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:14:53.806 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:53.806 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:53.806 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:53.806 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:53.806 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:53.806 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:53.806 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:53.806 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:53.806 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:53.806 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:53.806 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:53.806 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:53.806 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:53.806 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:53.806 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:14:53.806 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.806 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:14:53.806 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.807 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:14:53.807 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:14:53.807 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:53.807 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:53.807 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.807 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:53.807 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:14:53.807 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.807 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.807 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.807 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:53.807 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:14:53.807 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.807 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:53.807 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:53.807 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.807 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:14:53.807 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:14:53.807 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:53.807 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:53.808 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:14:53.808 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:53.808 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.808 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.808 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:14:53.808 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:14:53.808 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:53.808 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:53.808 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.808 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:53.808 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:14:53.808 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.808 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.808 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.808 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:53.808 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:14:53.808 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.808 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:53.808 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:53.809 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.809 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:14:53.809 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:14:53.809 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:53.809 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:53.809 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:14:53.809 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:53.809 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.809 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.809 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:14:53.809 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:14:53.809 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:53.809 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:53.809 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.809 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:53.809 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:14:53.809 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.809 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.809 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.809 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:53.810 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:14:53.810 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.810 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:53.810 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:53.810 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.810 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:14:53.810 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:14:53.810 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:53.810 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:53.810 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:14:53.810 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:53.810 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.810 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.810 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:14:53.810 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:14:53.810 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:53.810 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:53.810 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.811 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:53.811 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:14:53.811 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.811 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.811 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.811 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:53.811 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:14:53.811 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.811 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:53.811 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:53.811 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.811 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:14:53.811 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:14:53.811 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:53.811 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:53.811 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:14:53.811 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:53.811 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.811 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.811 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:14:53.811 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:14:53.812 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:53.812 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:53.812 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.812 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:53.812 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:14:53.812 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.812 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.812 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.812 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:53.812 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:14:53.812 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.812 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:53.812 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:53.812 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.812 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:14:53.812 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:14:53.812 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:53.812 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:53.812 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:53.812 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:53.812 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.812 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.813 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:14:53.813 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:14:53.813 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:53.813 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:53.813 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.813 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:53.813 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:14:53.813 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.813 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.813 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.813 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:53.813 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:14:53.813 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.813 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:53.813 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:53.813 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.813 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:14:53.813 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:14:53.813 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:53.813 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:53.813 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:14:53.813 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:53.814 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.814 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.814 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:14:53.814 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:14:53.814 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:53.814 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:53.814 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.814 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:53.814 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:14:53.814 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.814 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.814 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.814 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:53.814 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:14:53.814 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.814 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:53.814 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:53.814 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.814 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:14:53.814 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:14:53.814 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:53.814 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:53.814 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:53.815 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:53.815 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.815 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.815 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:14:53.815 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:14:53.815 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:53.815 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:53.815 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.815 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:53.815 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:14:53.815 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.815 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.815 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.815 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:53.815 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:14:53.815 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.815 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:53.815 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:53.815 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.815 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:14:53.815 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:14:53.816 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:53.816 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:53.816 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:14:53.816 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:53.816 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.816 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.816 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:14:53.816 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:14:53.816 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:53.816 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:53.816 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.816 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:53.816 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:14:53.816 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.816 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.816 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.816 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:53.816 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:14:53.816 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.816 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:53.816 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:53.816 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.816 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:14:53.817 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:14:53.817 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:53.817 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:53.817 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:14:53.817 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:53.817 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:53.817 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:53.817 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.817 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:14:53.817 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:14:53.817 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.817 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:53.817 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:53.817 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:53.817 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:53.817 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:53.817 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:14:53.817 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.817 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:53.817 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:53.818 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:53.818 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:53.818 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:53.818 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:14:53.818 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.818 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:53.818 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:53.818 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:14:53.818 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:53.818 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:53.818 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.818 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:14:53.818 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:14:53.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.774+0000 7ff896052640 1 -- 10.20.193.48:0/3352109825 >> v2:10.20.193.111:6812/977811348 conn(0x7ff86003f800 msgr2=0x7ff86005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:53.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.774+0000 7ff896052640 1 --2- 10.20.193.48:0/3352109825 >> v2:10.20.193.111:6812/977811348 conn(0x7ff86003f800 0x7ff86005fcb0 secure :-1 s=READY pgs=452 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff890090780 tx=0x7ff88400a2d0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.774+0000 7ff896052640 10 monclient: shutdown 2026-02-12T18:14:53.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.774+0000 7ff896052640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:53.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.774+0000 7ff896052640 1 -- 10.20.193.48:0/3352109825 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff89005de60 msgr2=0x7ff89010b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:53.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.774+0000 7ff896052640 1 --2- 10.20.193.48:0/3352109825 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff89005de60 0x7ff89010b8a0 secure :-1 s=READY pgs=204 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff880004740 tx=0x7ff880004770 comp rx=0 tx=0).stop 2026-02-12T18:14:53.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.774+0000 7ff88ffff640 1 -- 10.20.193.48:0/3352109825 reap_dead start 2026-02-12T18:14:53.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.774+0000 7ff896052640 1 -- 10.20.193.48:0/3352109825 shutdown_connections 2026-02-12T18:14:53.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.774+0000 7ff896052640 1 --2- 10.20.193.48:0/3352109825 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff89005de60 0x7ff89010b8a0 unknown :-1 s=CLOSED pgs=204 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.774+0000 7ff896052640 1 -- 10.20.193.48:0/3352109825 >> 10.20.193.48:0/3352109825 conn(0x7ff8900546a0 msgr2=0x7ff89008a680 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:53.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.774+0000 7ff896052640 1 -- 10.20.193.48:0/3352109825 shutdown_connections 2026-02-12T18:14:53.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.774+0000 7ff896052640 1 -- 10.20.193.48:0/3352109825 wait complete. 2026-02-12T18:14:53.820 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:14:53.820 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2026-02-12T18:14:53.820 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T18:14:53.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.885+0000 7fb01c99d640 10 monclient: get_monmap_and_config 2026-02-12T18:14:53.886 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.885+0000 7fb01c99d640 10 monclient: build_initial_monmap 2026-02-12T18:14:53.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.885+0000 7fb01c99d640 10 monclient: monmap: 2026-02-12T18:14:53.887 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:53.887 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:53.887 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:14:53.886460+0000 2026-02-12T18:14:53.887 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:14:53.886460+0000 2026-02-12T18:14:53.887 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:53.887 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:53.887 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:14:53.887 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:14:53.887 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:53.887 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:53.887 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:53.887 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:53.887 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:53.888 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:53.888 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:53.888 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:14:53.888 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:14:53.888 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:53.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.885+0000 7fb01c99d640 1 Processor -- start 2026-02-12T18:14:53.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.885+0000 7fb01c99d640 1 -- start start 2026-02-12T18:14:53.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.885+0000 7fb01c99d640 10 monclient: init 2026-02-12T18:14:53.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01c99d640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:53.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01c99d640 10 monclient: _add_conns ranks=[10,6,9,5,8,2,4,7,3,1,0] 2026-02-12T18:14:53.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01c99d640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7fb0140914d0 0x7fb01405c950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:53.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01c99d640 10 monclient(hunting): picked mon.noname-f con 0x7fb0140914d0 addr v2:10.20.193.111:3300/0 2026-02-12T18:14:53.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01c99d640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb01408e210 0x7fb01405ce90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:53.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01c99d640 10 monclient(hunting): picked mon.noname-d con 0x7fb01408e210 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:14:53.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01c99d640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fb01405e4b0 0x7fb01405d3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:53.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01c99d640 10 monclient(hunting): picked mon.noname-a con 0x7fb01405e4b0 addr v2:10.20.193.48:3300/0 2026-02-12T18:14:53.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01c99d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:53.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01c99d640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7fb014093d70 con 0x7fb01405e4b0 2026-02-12T18:14:53.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01c99d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:53.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01c99d640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7fb014092f90 con 0x7fb0140914d0 2026-02-12T18:14:53.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01c99d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:53.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01c99d640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fb0140918a0 con 0x7fb01408e210 2026-02-12T18:14:53.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01c99d640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:53.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01c99d640 10 monclient(hunting): authenticate will time out at 1132.612194s 2026-02-12T18:14:53.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb019f11640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb01408e210 0x7fb01405ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:53.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb019f11640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb01408e210 0x7fb01405ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:36024/0 (socket says 10.20.193.48:36024) 2026-02-12T18:14:53.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb019f11640 1 -- 10.20.193.48:0/335310170 learned_addr learned my addr 10.20.193.48:0/335310170 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:53.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb019f11640 10 monclient(hunting): get_auth_request con 0x7fb01408e210 auth_method 0 2026-02-12T18:14:53.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb019f11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:53.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb019f11640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:53.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb019f11640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:53.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01af13640 1 --2- 10.20.193.48:0/335310170 >> v2:10.20.193.48:3300/0 conn(0x7fb01405e4b0 0x7fb01405d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:53.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01af13640 10 monclient(hunting): get_auth_request con 0x7fb01405e4b0 auth_method 0 2026-02-12T18:14:53.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01af13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:53.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01af13640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:53.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01af13640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:53.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01a712640 1 --2- 10.20.193.48:0/335310170 >> v2:10.20.193.111:3300/0 conn(0x7fb0140914d0 0x7fb01405c950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:53.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb019f11640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:53.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb019f11640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:53.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb019f11640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:53.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01a712640 10 monclient(hunting): get_auth_request con 0x7fb0140914d0 auth_method 0 2026-02-12T18:14:53.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01a712640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:53.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01a712640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:53.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01a712640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:53.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01af13640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:53.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01af13640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:53.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb01af13640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:53.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb019f11640 10 monclient(hunting): handle_auth_done global_id 104226 payload 274 2026-02-12T18:14:53.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb019f11640 1 -- 10.20.193.48:0/335310170 >> v2:10.20.193.111:3300/0 conn(0x7fb0140914d0 msgr2=0x7fb01405c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:53.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb019f11640 1 --2- 10.20.193.48:0/335310170 >> v2:10.20.193.111:3300/0 conn(0x7fb0140914d0 0x7fb01405c950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb019f11640 1 -- 10.20.193.48:0/335310170 >> v2:10.20.193.48:3300/0 conn(0x7fb01405e4b0 msgr2=0x7fb01405d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:53.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb019f11640 1 --2- 10.20.193.48:0/335310170 >> v2:10.20.193.48:3300/0 conn(0x7fb01405e4b0 0x7fb01405d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb019f11640 10 monclient: _finish_hunting 0 2026-02-12T18:14:53.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb019f11640 1 monclient: found mon.noname-d 2026-02-12T18:14:53.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb019f11640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:53.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb019f11640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:14:53.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.886+0000 7fb019f11640 1 -- 10.20.193.48:0/335310170 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01404dc20 con 0x7fb01408e210 2026-02-12T18:14:53.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.888+0000 7fb019f11640 1 -- 10.20.193.48:0/335310170 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb01408e210 msgr2=0x7fb01405ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:53.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.888+0000 7fb019f11640 1 --2- 10.20.193.48:0/335310170 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb01408e210 0x7fb01405ce90 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=3612980674088967307 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb014091270 tx=0x7fb00002edb0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=3223e2c7db6c9c8b server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:53.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb019710640 1 -- 10.20.193.48:0/335310170 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb000035340 con 0x7fb01408e210 2026-02-12T18:14:53.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb019710640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:53.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb019710640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:14:53.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb019710640 10 monclient: dump: 2026-02-12T18:14:53.901 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:53.901 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:53.901 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.901 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.901 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:53.901 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:53.901 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:53.901 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:53.901 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:53.901 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:53.901 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:53.901 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:53.902 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:53.902 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:53.902 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:53.902 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:53.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb019710640 10 monclient: _finish_auth 0 2026-02-12T18:14:53.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb019710640 10 monclient: _check_auth_tickets 2026-02-12T18:14:53.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb019710640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:53.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb019710640 1 -- 10.20.193.48:0/335310170 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0000354c0 con 0x7fb01408e210 2026-02-12T18:14:53.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb019710640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:53.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb019710640 1 -- 10.20.193.48:0/335310170 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb000035af0 con 0x7fb01408e210 2026-02-12T18:14:53.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb019710640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:53.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb019710640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:14:53.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb019710640 10 monclient: dump: 2026-02-12T18:14:53.902 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:53.903 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:53.903 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.903 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.903 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:53.903 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:53.903 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:53.903 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:53.903 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:53.903 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:53.903 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:53.903 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:53.903 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:53.903 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:53.903 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:53.903 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:53.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb01c99d640 5 monclient: authenticate success, global_id 104226 2026-02-12T18:14:53.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb01c99d640 10 monclient: get_monmap_and_config success 2026-02-12T18:14:53.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb01c99d640 4 set_mon_vals no callback set 2026-02-12T18:14:53.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb01c99d640 10 monclient: shutdown 2026-02-12T18:14:53.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb01c99d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:53.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb01c99d640 1 -- 10.20.193.48:0/335310170 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb01408e210 msgr2=0x7fb01405ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:53.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb01c99d640 1 --2- 10.20.193.48:0/335310170 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb01408e210 0x7fb01405ce90 secure :-1 s=READY pgs=23 gs=1 cs=0 l=1 c_cookie=3612980674088967307 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb014091270 tx=0x7fb00002edb0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb01c99d640 1 -- 10.20.193.48:0/335310170 shutdown_connections 2026-02-12T18:14:53.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb01c99d640 1 --2- 10.20.193.48:0/335310170 >> v2:10.20.193.48:3300/0 conn(0x7fb01405e4b0 0x7fb01405d3d0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb01c99d640 1 --2- 10.20.193.48:0/335310170 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb01408e210 0x7fb01405ce90 unknown :-1 s=CLOSED pgs=23 gs=1 cs=0 l=1 c_cookie=3612980674088967307 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb01c99d640 1 --2- 10.20.193.48:0/335310170 >> v2:10.20.193.111:3300/0 conn(0x7fb0140914d0 0x7fb01405c950 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb01c99d640 1 -- 10.20.193.48:0/335310170 >> 10.20.193.48:0/335310170 conn(0x7fb0140548a0 msgr2=0x7fb014097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:53.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb01c99d640 1 -- 10.20.193.48:0/335310170 shutdown_connections 2026-02-12T18:14:53.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.889+0000 7fb01c99d640 1 -- 10.20.193.48:0/335310170 wait complete. 2026-02-12T18:14:53.904 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01c99d640 10 monclient: build_initial_monmap 2026-02-12T18:14:53.905 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01c99d640 10 monclient: monmap: 2026-02-12T18:14:53.905 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:53.905 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:14:53.905 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:14:53.905 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:14:53.905 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:53.905 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:53.905 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:14:53.905 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:14:53.905 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:53.905 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:53.905 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:53.905 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:53.905 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:53.906 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:53.906 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:53.906 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:53.906 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01c99d640 1 Processor -- start 2026-02-12T18:14:53.906 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01c99d640 1 -- start start 2026-02-12T18:14:53.906 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01c99d640 10 monclient: init 2026-02-12T18:14:53.906 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01c99d640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:53.906 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01c99d640 10 monclient: _add_conns ranks=[7,4,8,6,1,5,3,0,2] 2026-02-12T18:14:53.906 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01c99d640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb01405e4b0 0x7fb0141ab500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:53.906 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01c99d640 10 monclient(hunting): picked mon.noname-i con 0x7fb01405e4b0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:14:53.906 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01c99d640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb01408e210 0x7fb0141aba40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:53.906 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01c99d640 10 monclient(hunting): picked mon.noname-c con 0x7fb01408e210 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:14:53.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01c99d640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb0140914d0 0x7fb014195410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:53.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01c99d640 10 monclient(hunting): picked mon.noname-e con 0x7fb0140914d0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:14:53.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01c99d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:53.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01c99d640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fb0141ac010 con 0x7fb01408e210 2026-02-12T18:14:53.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01c99d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:53.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01c99d640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fb0141978d0 con 0x7fb01405e4b0 2026-02-12T18:14:53.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01c99d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:53.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01c99d640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fb014198df0 con 0x7fb0140914d0 2026-02-12T18:14:53.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01c99d640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:53.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01c99d640 10 monclient(hunting): authenticate will time out at 1132.616599s 2026-02-12T18:14:53.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb019f11640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb01408e210 0x7fb0141aba40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:53.907 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb019f11640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb01408e210 0x7fb0141aba40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:36876/0 (socket says 10.20.193.48:36876) 2026-02-12T18:14:53.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb019f11640 1 -- 10.20.193.48:0/1083382811 learned_addr learned my addr 10.20.193.48:0/1083382811 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:53.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01af13640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb0140914d0 0x7fb014195410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:53.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb019f11640 10 monclient(hunting): get_auth_request con 0x7fb01408e210 auth_method 0 2026-02-12T18:14:53.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb019f11640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:53.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb019f11640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:53.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb019f11640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:53.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01af13640 10 monclient(hunting): get_auth_request con 0x7fb0140914d0 auth_method 0 2026-02-12T18:14:53.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01af13640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:53.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01af13640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:53.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01af13640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:53.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb019f11640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:53.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb019f11640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:53.908 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb019f11640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:53.909 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01a712640 1 --2- 10.20.193.48:0/1083382811 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb01405e4b0 0x7fb0141ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:53.909 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01af13640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:53.909 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01af13640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:53.909 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01af13640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:53.909 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01a712640 10 monclient(hunting): get_auth_request con 0x7fb01405e4b0 auth_method 0 2026-02-12T18:14:53.909 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01a712640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:53.909 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01a712640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:53.909 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb01a712640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:53.909 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb019f11640 10 monclient(hunting): handle_auth_done global_id 65101 payload 824 2026-02-12T18:14:53.909 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb019f11640 1 -- 10.20.193.48:0/1083382811 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb0140914d0 msgr2=0x7fb014195410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:53.909 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb019f11640 1 --2- 10.20.193.48:0/1083382811 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb0140914d0 0x7fb014195410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.909 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb019f11640 1 -- 10.20.193.48:0/1083382811 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb01405e4b0 msgr2=0x7fb0141ab500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:53.909 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb019f11640 1 --2- 10.20.193.48:0/1083382811 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb01405e4b0 0x7fb0141ab500 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.910 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb019f11640 10 monclient: _finish_hunting 0 2026-02-12T18:14:53.910 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb019f11640 1 monclient: found mon.noname-c 2026-02-12T18:14:53.910 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb019f11640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:53.910 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb019f11640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:14:53.910 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.890+0000 7fb019f11640 1 -- 10.20.193.48:0/1083382811 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0000094f0 con 0x7fb01408e210 2026-02-12T18:14:53.910 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7fb019f11640 1 -- 10.20.193.48:0/1083382811 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb01408e210 msgr2=0x7fb0141aba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:53.910 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7fb019f11640 1 --2- 10.20.193.48:0/1083382811 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb01408e210 0x7fb0141aba40 secure :-1 s=READY pgs=205 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb000004740 tx=0x7fb000004770 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:53.910 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7faffeffd640 1 -- 10.20.193.48:0/1083382811 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb000035340 con 0x7fb01408e210 2026-02-12T18:14:53.910 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7faffeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:53.910 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7faffeffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:14:53.910 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7faffeffd640 10 monclient: dump: 2026-02-12T18:14:53.910 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:53.910 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:53.910 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.911 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.911 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:53.911 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:53.911 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:53.911 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:53.911 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:53.911 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:53.911 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:53.911 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:53.911 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:53.911 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:53.911 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:53.911 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:53.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7faffeffd640 10 monclient: _finish_auth 0 2026-02-12T18:14:53.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7faffeffd640 10 monclient: _check_auth_tickets 2026-02-12T18:14:53.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7faffeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:53.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7faffeffd640 1 -- 10.20.193.48:0/1083382811 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb000035e00 con 0x7fb01408e210 2026-02-12T18:14:53.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7faffeffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:53.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7faffeffd640 1 -- 10.20.193.48:0/1083382811 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb000037dc0 con 0x7fb01408e210 2026-02-12T18:14:53.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7fb01c99d640 5 monclient: authenticate success, global_id 65101 2026-02-12T18:14:53.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7faffeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:53.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7fb018f0f640 4 set_mon_vals no callback set 2026-02-12T18:14:53.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7faffeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:14:53.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7faffeffd640 10 monclient: dump: 2026-02-12T18:14:53.912 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:53.912 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:53.912 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.913 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.913 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:53.913 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:53.913 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:53.913 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:53.913 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:53.913 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:53.913 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:53.913 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:53.913 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:53.913 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:53.913 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:53.913 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:53.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7fb01c99d640 10 monclient: _renew_subs 2026-02-12T18:14:53.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7fb01c99d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:14:53.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7fb01c99d640 1 -- 10.20.193.48:0/1083382811 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0141990d0 con 0x7fb01408e210 2026-02-12T18:14:53.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7fb01c99d640 10 monclient: _renew_subs 2026-02-12T18:14:53.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7fb01c99d640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:14:53.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7fb01c99d640 1 -- 10.20.193.48:0/1083382811 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7fb01408fe10 con 0x7fb01408e210 2026-02-12T18:14:53.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7fb01c99d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:53.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7fb01c99d640 1 --2- 10.20.193.48:0/1083382811 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb014195950 0x7fb014195d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:53.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7fb01c99d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:53.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.893+0000 7fb01c99d640 1 -- 10.20.193.48:0/1083382811 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fb01405f140 con 0x7fb014195950 2026-02-12T18:14:53.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.894+0000 7fb01a712640 1 --2- 10.20.193.48:0/1083382811 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb014195950 0x7fb014195d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:53.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.894+0000 7faffeffd640 1 -- 10.20.193.48:0/1083382811 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fb000046020 con 0x7fb01408e210 2026-02-12T18:14:53.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.894+0000 7fb01a712640 10 monclient: get_auth_request con 0x7fb014195950 auth_method 0 2026-02-12T18:14:53.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.894+0000 7fb01a712640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:53.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.894+0000 7fb01a712640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:53.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.894+0000 7fb01a712640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:53.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.894+0000 7fb01a712640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:53.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.894+0000 7fb01a712640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:53.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.894+0000 7fb01a712640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:53.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.894+0000 7faffeffd640 1 --2- 10.20.193.48:0/1083382811 >> v2:10.20.193.111:6812/977811348 conn(0x7fafe403f800 0x7fafe405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:53.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.894+0000 7faffeffd640 1 -- 10.20.193.48:0/1083382811 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(319..319 src has 215..319) ==== 3897+0+0 (secure 0 0 0) 0x7fb000077e80 con 0x7fb01408e210 2026-02-12T18:14:53.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.894+0000 7fb01a712640 10 monclient(hunting): handle_auth_done global_id 36497 payload 824 2026-02-12T18:14:53.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.894+0000 7fb01a712640 1 -- 10.20.193.48:0/1083382811 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb0140929d0 con 0x7fb014195950 2026-02-12T18:14:53.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.894+0000 7fb01af13640 1 --2- 10.20.193.48:0/1083382811 >> v2:10.20.193.111:6812/977811348 conn(0x7fafe403f800 0x7fafe405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:53.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.894+0000 7fb01af13640 10 monclient: get_auth_request con 0x7fafe403f800 auth_method 0 2026-02-12T18:14:53.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.896+0000 7fb01a712640 1 -- 10.20.193.48:0/1083382811 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb014195950 msgr2=0x7fb014195d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:53.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.896+0000 7fb01a712640 1 --2- 10.20.193.48:0/1083382811 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb014195950 0x7fb014195d20 secure :-1 s=READY pgs=391 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb00c010790 tx=0x7fb00c010c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:53.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.896+0000 7faffeffd640 1 -- 10.20.193.48:0/1083382811 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb00c00ebe0 con 0x7fb014195950 2026-02-12T18:14:53.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.896+0000 7faffeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:53.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.896+0000 7faffeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:14:53.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.896+0000 7faffeffd640 10 monclient: dump: 2026-02-12T18:14:53.918 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:53.918 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:53.919 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.919 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.919 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:53.919 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:53.919 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:53.919 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:53.919 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:53.919 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:53.919 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:53.919 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:53.919 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:53.919 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:53.919 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:53.919 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:53.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.896+0000 7faffeffd640 1 -- 10.20.193.48:0/1083382811 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fb00c00c050 con 0x7fb014195950 2026-02-12T18:14:53.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.896+0000 7faffeffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:53.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.896+0000 7faffeffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:14:53.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.896+0000 7faffeffd640 1 -- 10.20.193.48:0/1083382811 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb014195950 msgr2=0x7fb014195d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:53.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.896+0000 7faffeffd640 1 --2- 10.20.193.48:0/1083382811 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb014195950 0x7fb014195d20 secure :-1 s=READY pgs=391 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb00c010790 tx=0x7fb00c010c60 comp rx=0 tx=0).stop 2026-02-12T18:14:53.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.896+0000 7faffeffd640 1 -- 10.20.193.48:0/1083382811 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb014195950 msgr2=0x7fb014195d20 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:53.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.896+0000 7faffeffd640 1 --2- 10.20.193.48:0/1083382811 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb014195950 0x7fb014195d20 secure :-1 s=CLOSED pgs=391 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb00c010790 tx=0x7fb00c010c60 comp rx=0 tx=0).stop 2026-02-12T18:14:53.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.897+0000 7fb01af13640 1 --2- 10.20.193.48:0/1083382811 >> v2:10.20.193.111:6812/977811348 conn(0x7fafe403f800 0x7fafe405fcb0 secure :-1 s=READY pgs=453 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb01405e8e0 tx=0x7fb00800a2d0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:53.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.900+0000 7fb01c99d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:14:53.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.900+0000 7fb01c99d640 1 --2- 10.20.193.48:0/1083382811 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb014196260 0x7fb01408a460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:53.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.900+0000 7fb01c99d640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:53.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.900+0000 7fb01c99d640 1 -- 10.20.193.48:0/1083382811 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fb01405fd90 con 0x7fb014196260 2026-02-12T18:14:53.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.900+0000 7fb01a712640 1 --2- 10.20.193.48:0/1083382811 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb014196260 0x7fb01408a460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:53.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.900+0000 7fb01a712640 10 monclient: get_auth_request con 0x7fb014196260 auth_method 0 2026-02-12T18:14:53.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.900+0000 7fb01a712640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:53.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.900+0000 7fb01a712640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:53.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.900+0000 7fb01a712640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:53.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.900+0000 7fb01a712640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:53.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.900+0000 7fb01a712640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:53.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.900+0000 7fb01a712640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:53.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.900+0000 7fb01a712640 10 monclient(hunting): handle_auth_done global_id 36506 payload 824 2026-02-12T18:14:53.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.900+0000 7fb01a712640 1 -- 10.20.193.48:0/1083382811 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb01405de10 con 0x7fb014196260 2026-02-12T18:14:53.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.903+0000 7fb01a712640 1 -- 10.20.193.48:0/1083382811 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb014196260 msgr2=0x7fb01408a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:53.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.903+0000 7fb01a712640 1 --2- 10.20.193.48:0/1083382811 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb014196260 0x7fb01408a460 secure :-1 s=READY pgs=392 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb00c018000 tx=0x7fb00c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:53.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.903+0000 7faffeffd640 1 -- 10.20.193.48:0/1083382811 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb00c0036d0 con 0x7fb014196260 2026-02-12T18:14:53.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.903+0000 7faffeffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:53.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.903+0000 7faffeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:14:53.921 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.903+0000 7faffeffd640 10 monclient: dump: 2026-02-12T18:14:53.921 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:53.921 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:53.921 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.921 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:53.921 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:53.921 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:53.921 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:53.921 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:53.921 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:53.921 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:53.922 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:53.922 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:53.922 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:53.922 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:53.922 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:53.922 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:53.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.903+0000 7faffeffd640 1 -- 10.20.193.48:0/1083382811 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10182 (secure 0 0 0) 0x7fb00c004240 con 0x7fb014196260 2026-02-12T18:14:53.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.903+0000 7faffeffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:14:53.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.903+0000 7faffeffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:14:53.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.903+0000 7faffeffd640 1 -- 10.20.193.48:0/1083382811 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb014196260 msgr2=0x7fb01408a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:53.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.903+0000 7faffeffd640 1 --2- 10.20.193.48:0/1083382811 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb014196260 0x7fb01408a460 secure :-1 s=READY pgs=392 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb00c018000 tx=0x7fb00c004770 comp rx=0 tx=0).stop 2026-02-12T18:14:53.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.903+0000 7faffeffd640 1 -- 10.20.193.48:0/1083382811 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb014196260 msgr2=0x7fb01408a460 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:53.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.903+0000 7faffeffd640 1 --2- 10.20.193.48:0/1083382811 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb014196260 0x7fb01408a460 secure :-1 s=CLOSED pgs=392 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb00c018000 tx=0x7fb00c004770 comp rx=0 tx=0).stop 2026-02-12T18:14:53.922 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:14:53.923 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:14:53.923 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:14:53.923 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:14:53.923 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 76, 2026-02-12T18:14:53.923 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 548736, 2026-02-12T18:14:53.923 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:14:53.923 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:14:53.923 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:14:53.923 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:14:53.923 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:14:53.923 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:14:53.923 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:14:53.923 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:14:53.923 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:14:53.924 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:14:53.924 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:53.924 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 7, 2026-02-12T18:14:53.924 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:53.924 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:14:53.924 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:14:53.924 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:53.924 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:53.924 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:53.924 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:53.924 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:53.924 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:53.924 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:53.924 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:53.924 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:53.924 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:53.925 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:53.925 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:53.925 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:53.925 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:53.925 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:14:53.925 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:14:53.925 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:53.925 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:53.925 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:53.925 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:53.925 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:53.925 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:53.925 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:53.925 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:53.925 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:53.925 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:53.925 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:53.925 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:53.925 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:53.926 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:53.926 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.926 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:14:53.926 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:14:53.926 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:14:53.926 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:14:53.926 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:14:53.926 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:14:53.926 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:53.926 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:53.926 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:14:53.926 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:14:53.926 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:14:53.926 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:14:53.926 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:14:53.926 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:14:53.926 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:14:53.926 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:53.927 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:14:53.927 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:53.927 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:53.927 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:53.927 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:53.927 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:53.927 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:53.927 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:53.927 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:53.927 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:53.927 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:53.927 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:53.927 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:53.927 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:53.927 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:53.927 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:14:53.927 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.927 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:14:53.927 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.927 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:14:53.928 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:14:53.928 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:53.928 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:53.928 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.928 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:53.928 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:14:53.928 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.928 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.928 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.928 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:53.928 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:14:53.928 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.928 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:53.928 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:53.928 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.928 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:14:53.928 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:14:53.928 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:53.928 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:53.928 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:14:53.928 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:53.929 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.929 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.929 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:14:53.929 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:14:53.929 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:53.929 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:53.929 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.929 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:53.929 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:14:53.929 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.929 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.929 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.929 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:53.929 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:14:53.929 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.929 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:53.929 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:53.929 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.929 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:14:53.929 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:14:53.930 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:53.930 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:53.930 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:14:53.930 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:53.930 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.930 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.930 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:14:53.930 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:14:53.930 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:53.930 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:53.930 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.930 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:53.930 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:14:53.930 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.930 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.930 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.930 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:53.930 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:14:53.930 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.930 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:53.931 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:53.931 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.931 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:14:53.931 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:14:53.931 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:53.931 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:53.931 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:14:53.931 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:53.931 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.931 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.931 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:14:53.931 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:14:53.931 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:53.931 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:53.931 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.931 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:53.931 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:14:53.931 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.931 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.931 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.932 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:53.932 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:14:53.932 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.932 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:53.932 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:53.932 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.932 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:14:53.932 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:14:53.932 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:53.932 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:53.932 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:14:53.932 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:53.932 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.932 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.932 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:14:53.932 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:14:53.932 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:53.932 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:53.932 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.932 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:53.932 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:14:53.932 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.932 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.933 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.933 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:53.933 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:14:53.933 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.933 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:53.933 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:53.933 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.933 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:14:53.933 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:14:53.933 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:53.933 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:53.933 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:53.933 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:53.933 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.933 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.933 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:14:53.933 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:14:53.933 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:53.933 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:53.933 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.933 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:53.933 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:14:53.933 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.934 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.934 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.934 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:53.934 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:14:53.934 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.934 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:53.934 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:53.934 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.934 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:14:53.934 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:14:53.934 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:53.934 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:53.934 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:14:53.934 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:53.934 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.934 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.934 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:14:53.934 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:14:53.934 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:53.934 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:53.934 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.934 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:53.934 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:14:53.934 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.935 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.935 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.935 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:53.935 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:14:53.935 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.935 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:53.935 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:53.935 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.935 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:14:53.935 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:14:53.935 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:53.935 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:53.935 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:53.935 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:53.935 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.935 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.935 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:14:53.935 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:14:53.935 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:53.935 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:53.935 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.935 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:53.935 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:14:53.935 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.935 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.936 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.936 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:53.936 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:14:53.936 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.936 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:53.936 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:53.936 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.936 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:14:53.936 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:14:53.936 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:53.936 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:53.936 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:14:53.936 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:53.936 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.936 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.936 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:14:53.936 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:14:53.936 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:53.936 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:53.936 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.936 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:53.936 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:14:53.936 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.936 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.937 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:53.938 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:53.938 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:53.938 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:53.938 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:53.938 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:14:53.938 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:53.938 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:53.938 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:53.938 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:14:53.938 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:53.938 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:53.938 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:53.938 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:14:53.938 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:14:53.939 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.903+0000 7fb01c99d640 1 -- 10.20.193.48:0/1083382811 >> v2:10.20.193.111:6812/977811348 conn(0x7fafe403f800 msgr2=0x7fafe405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:53.939 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.903+0000 7fb01c99d640 1 --2- 10.20.193.48:0/1083382811 >> v2:10.20.193.111:6812/977811348 conn(0x7fafe403f800 0x7fafe405fcb0 secure :-1 s=READY pgs=453 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb01405e8e0 tx=0x7fb00800a2d0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.939 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.903+0000 7fb01c99d640 10 monclient: shutdown 2026-02-12T18:14:53.939 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.903+0000 7fb01c99d640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:53.939 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.903+0000 7fb01c99d640 1 -- 10.20.193.48:0/1083382811 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb01408e210 msgr2=0x7fb0141aba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:53.939 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.903+0000 7fb01c99d640 1 --2- 10.20.193.48:0/1083382811 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb01408e210 0x7fb0141aba40 secure :-1 s=READY pgs=205 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb000004740 tx=0x7fb000004770 comp rx=0 tx=0).stop 2026-02-12T18:14:53.939 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.903+0000 7fb01af13640 1 -- 10.20.193.48:0/1083382811 reap_dead start 2026-02-12T18:14:53.939 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.903+0000 7fb01c99d640 1 -- 10.20.193.48:0/1083382811 shutdown_connections 2026-02-12T18:14:53.939 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.903+0000 7fb01c99d640 1 --2- 10.20.193.48:0/1083382811 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb01408e210 0x7fb0141aba40 unknown :-1 s=CLOSED pgs=205 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:53.939 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.903+0000 7fb01c99d640 1 -- 10.20.193.48:0/1083382811 >> 10.20.193.48:0/1083382811 conn(0x7fb0140548a0 msgr2=0x7fb0141aed40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:53.939 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.903+0000 7fb01c99d640 1 -- 10.20.193.48:0/1083382811 shutdown_connections 2026-02-12T18:14:53.939 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:53.903+0000 7fb01c99d640 1 -- 10.20.193.48:0/1083382811 wait complete. 2026-02-12T18:14:53.940 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:14:53.940 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2026-02-12T18:14:53.940 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T18:14:54.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.005+0000 7f91cfe07640 10 monclient: get_monmap_and_config 2026-02-12T18:14:54.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.005+0000 7f91cfe07640 10 monclient: build_initial_monmap 2026-02-12T18:14:54.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.005+0000 7f91cfe07640 10 monclient: monmap: 2026-02-12T18:14:54.006 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:54.006 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.006 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:14:54.006140+0000 2026-02-12T18:14:54.006 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:14:54.006140+0000 2026-02-12T18:14:54.006 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:54.007 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.007 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:14:54.007 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:14:54.007 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:54.007 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:54.007 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:54.007 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:54.007 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:54.007 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:54.007 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:54.007 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:14:54.007 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:14:54.007 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.005+0000 7f91cfe07640 1 Processor -- start 2026-02-12T18:14:54.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.005+0000 7f91cfe07640 1 -- start start 2026-02-12T18:14:54.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.005+0000 7f91cfe07640 10 monclient: init 2026-02-12T18:14:54.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.005+0000 7f91cfe07640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:54.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.005+0000 7f91cfe07640 10 monclient: _add_conns ranks=[4,2,0,9,3,8,5,10,6,1,7] 2026-02-12T18:14:54.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.005+0000 7f91cfe07640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f91c805c950 0x7f91c805cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.005+0000 7f91cfe07640 10 monclient(hunting): picked mon.noname-c con 0x7f91c805c950 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:14:54.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.005+0000 7f91cfe07640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f91c805e490 0x7f91c805d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.005+0000 7f91cfe07640 10 monclient(hunting): picked mon.noname-b con 0x7f91c805e490 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:14:54.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.005+0000 7f91cfe07640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f91c813db70 addr v1:10.20.193.48:6789/0 2026-02-12T18:14:54.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.005+0000 7f91cfe07640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91c804dc20 con 0x7f91c813db70 2026-02-12T18:14:54.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.005+0000 7f91cfe07640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.005+0000 7f91cfe07640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f91c805ddd0 con 0x7f91c805e490 2026-02-12T18:14:54.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.005+0000 7f91cfe07640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.005+0000 7f91cfe07640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f91c805d7a0 con 0x7f91c805c950 2026-02-12T18:14:54.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.005+0000 7f91cfe07640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:54.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.005+0000 7f91cfe07640 10 monclient(hunting): authenticate will time out at 1132.731900s 2026-02-12T18:14:54.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.005+0000 7f91cdb7c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f91c805c950 0x7f91c805cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.005+0000 7f91cd37b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f91c805e490 0x7f91c805d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91cdb7c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f91c805c950 0x7f91c805cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:36884/0 (socket says 10.20.193.48:36884) 2026-02-12T18:14:54.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91cdb7c640 1 -- 10.20.193.48:0/1533030329 learned_addr learned my addr 10.20.193.48:0/1533030329 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:54.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91ce37d640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f91c813db70 0x7f91c813dfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:53430/0 (socket says 10.20.193.48:53430) 2026-02-12T18:14:54.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91cdb7c640 10 monclient(hunting): get_auth_request con 0x7f91c805c950 auth_method 0 2026-02-12T18:14:54.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91cdb7c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91cdb7c640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91cdb7c640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91cd37b640 10 monclient(hunting): get_auth_request con 0x7f91c805e490 auth_method 0 2026-02-12T18:14:54.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91cd37b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91cd37b640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91cd37b640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91cd37b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91cd37b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91cd37b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91cdb7c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91cdb7c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91cdb7c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91cdb7c640 10 monclient(hunting): handle_auth_done global_id 65110 payload 274 2026-02-12T18:14:54.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91cdb7c640 1 -- 10.20.193.48:0/1533030329 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f91c805e490 msgr2=0x7f91c805d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:54.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91cdb7c640 1 --2- 10.20.193.48:0/1533030329 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f91c805e490 0x7f91c805d260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91cdb7c640 1 -- 10.20.193.48:0/1533030329 >> v1:10.20.193.48:6789/0 conn(0x7f91c813db70 legacy=0x7f91c813dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:54.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91cdb7c640 10 monclient: _finish_hunting 0 2026-02-12T18:14:54.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91cdb7c640 1 monclient: found mon.noname-c 2026-02-12T18:14:54.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91cdb7c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:54.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91cdb7c640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:14:54.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91cdb7c640 1 -- 10.20.193.48:0/1533030329 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91c8092990 con 0x7f91c805c950 2026-02-12T18:14:54.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.006+0000 7f91cd37b640 1 --2- 10.20.193.48:0/1533030329 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f91c805e490 0x7f91c805d260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:14:54.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.008+0000 7f91cdb7c640 1 -- 10.20.193.48:0/1533030329 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f91c805c950 msgr2=0x7f91c805cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.008+0000 7f91cdb7c640 1 --2- 10.20.193.48:0/1533030329 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f91c805c950 0x7f91c805cd20 secure :-1 s=READY pgs=206 gs=2 cs=0 l=1 c_cookie=14008237096063878009 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91b80098d0 tx=0x7f91b802ee20 comp rx=0 tx=0).ready entity=mon.4 client_cookie=c267416b88564379 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.008+0000 7f91ccb7a640 1 -- 10.20.193.48:0/1533030329 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f91b8035340 con 0x7f91c805c950 2026-02-12T18:14:54.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.008+0000 7f91ccb7a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.009+0000 7f91ccb7a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:14:54.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.009+0000 7f91ccb7a640 10 monclient: dump: 2026-02-12T18:14:54.018 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.018 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.018 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.018 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.018 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.018 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.018 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.018 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.019 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.019 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.019 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.019 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.019 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.019 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.019 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.019 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.009+0000 7f91ccb7a640 10 monclient: _finish_auth 0 2026-02-12T18:14:54.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.009+0000 7f91ccb7a640 10 monclient: _check_auth_tickets 2026-02-12T18:14:54.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.009+0000 7f91ccb7a640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:54.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.009+0000 7f91ccb7a640 1 -- 10.20.193.48:0/1533030329 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91b80354c0 con 0x7f91c805c950 2026-02-12T18:14:54.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.009+0000 7f91ccb7a640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:54.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.009+0000 7f91ccb7a640 1 -- 10.20.193.48:0/1533030329 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f91b8035af0 con 0x7f91c805c950 2026-02-12T18:14:54.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.009+0000 7f91cfe07640 5 monclient: authenticate success, global_id 65110 2026-02-12T18:14:54.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.009+0000 7f91ccb7a640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.009+0000 7f91ccb7a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:14:54.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.009+0000 7f91ccb7a640 10 monclient: dump: 2026-02-12T18:14:54.019 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.020 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.020 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.020 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.020 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.020 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.020 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.020 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.020 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.020 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.020 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.020 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.020 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.020 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.020 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.020 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.009+0000 7f91cfe07640 10 monclient: get_monmap_and_config success 2026-02-12T18:14:54.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.009+0000 7f91cfe07640 4 set_mon_vals no callback set 2026-02-12T18:14:54.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.009+0000 7f91cfe07640 10 monclient: shutdown 2026-02-12T18:14:54.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.009+0000 7f91cfe07640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:54.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.009+0000 7f91cfe07640 1 -- 10.20.193.48:0/1533030329 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f91c805c950 msgr2=0x7f91c805cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.009+0000 7f91cfe07640 1 --2- 10.20.193.48:0/1533030329 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f91c805c950 0x7f91c805cd20 secure :-1 s=READY pgs=206 gs=2 cs=0 l=1 c_cookie=14008237096063878009 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91b80098d0 tx=0x7f91b802ee20 comp rx=0 tx=0).stop 2026-02-12T18:14:54.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.009+0000 7f91cfe07640 1 -- 10.20.193.48:0/1533030329 shutdown_connections 2026-02-12T18:14:54.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.009+0000 7f91cfe07640 1 --2- 10.20.193.48:0/1533030329 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f91c805e490 0x7f91c805d260 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.009+0000 7f91cfe07640 1 --2- 10.20.193.48:0/1533030329 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f91c805c950 0x7f91c805cd20 unknown :-1 s=CLOSED pgs=206 gs=2 cs=0 l=1 c_cookie=14008237096063878009 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.009+0000 7f91cfe07640 1 -- 10.20.193.48:0/1533030329 >> 10.20.193.48:0/1533030329 conn(0x7f91c80548a0 msgr2=0x7f91c8097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:54.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.009+0000 7f91cfe07640 1 -- 10.20.193.48:0/1533030329 shutdown_connections 2026-02-12T18:14:54.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.009+0000 7f91cfe07640 1 -- 10.20.193.48:0/1533030329 wait complete. 2026-02-12T18:14:54.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.009+0000 7f91cfe07640 10 monclient: build_initial_monmap 2026-02-12T18:14:54.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.009+0000 7f91cfe07640 10 monclient: monmap: 2026-02-12T18:14:54.021 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:54.021 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:14:54.021 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:14:54.021 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:14:54.021 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:54.021 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.021 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:14:54.021 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:14:54.021 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:54.021 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:54.022 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:54.022 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:54.022 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:54.022 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:54.022 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:54.022 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cfe07640 1 Processor -- start 2026-02-12T18:14:54.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cfe07640 1 -- start start 2026-02-12T18:14:54.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cfe07640 10 monclient: init 2026-02-12T18:14:54.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cfe07640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:54.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cfe07640 10 monclient: _add_conns ranks=[8,2,0,5,4,3,6,7,1] 2026-02-12T18:14:54.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cfe07640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f91c805c950 0x7f91c813cde0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cfe07640 10 monclient(hunting): picked mon.noname-e con 0x7f91c805c950 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:14:54.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cfe07640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f91c805e490 0x7f91c813d320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cfe07640 10 monclient(hunting): picked mon.noname-b con 0x7f91c805e490 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:14:54.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cfe07640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f91c813db70 0x7f91c8129430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cfe07640 10 monclient(hunting): picked mon.noname-a con 0x7f91c813db70 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:14:54.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cfe07640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cfe07640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f91c8090740 con 0x7f91c813db70 2026-02-12T18:14:54.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cfe07640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cfe07640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f91c808af10 con 0x7f91c805e490 2026-02-12T18:14:54.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cfe07640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cfe07640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f91c813e830 con 0x7f91c805c950 2026-02-12T18:14:54.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cfe07640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:54.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cfe07640 10 monclient(hunting): authenticate will time out at 1132.736423s 2026-02-12T18:14:54.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cd37b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f91c805e490 0x7f91c813d320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cd37b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f91c805e490 0x7f91c813d320 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:58752/0 (socket says 10.20.193.48:58752) 2026-02-12T18:14:54.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cd37b640 1 -- 10.20.193.48:0/3688585891 learned_addr learned my addr 10.20.193.48:0/3688585891 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:54.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cd37b640 10 monclient(hunting): get_auth_request con 0x7f91c805e490 auth_method 0 2026-02-12T18:14:54.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cd37b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cd37b640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91ce37d640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f91c813db70 0x7f91c8129430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cd37b640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cdb7c640 1 --2- 10.20.193.48:0/3688585891 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f91c805c950 0x7f91c813cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91ce37d640 10 monclient(hunting): get_auth_request con 0x7f91c813db70 auth_method 0 2026-02-12T18:14:54.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91ce37d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91ce37d640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91ce37d640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cdb7c640 10 monclient(hunting): get_auth_request con 0x7f91c805c950 auth_method 0 2026-02-12T18:14:54.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cdb7c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cdb7c640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cdb7c640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cd37b640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cd37b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cd37b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91ce37d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91ce37d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91ce37d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cdb7c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cdb7c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cdb7c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cd37b640 10 monclient(hunting): handle_auth_done global_id 36524 payload 824 2026-02-12T18:14:54.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cd37b640 1 -- 10.20.193.48:0/3688585891 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f91c805c950 msgr2=0x7f91c813cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cd37b640 1 --2- 10.20.193.48:0/3688585891 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f91c805c950 0x7f91c813cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cd37b640 1 -- 10.20.193.48:0/3688585891 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f91c813db70 msgr2=0x7f91c8129430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cd37b640 1 --2- 10.20.193.48:0/3688585891 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f91c813db70 0x7f91c8129430 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cd37b640 10 monclient: _finish_hunting 0 2026-02-12T18:14:54.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cd37b640 1 monclient: found mon.noname-b 2026-02-12T18:14:54.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cd37b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:54.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cd37b640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:14:54.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.010+0000 7f91cd37b640 1 -- 10.20.193.48:0/3688585891 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91bc009420 con 0x7f91c805e490 2026-02-12T18:14:54.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.012+0000 7f91cd37b640 1 -- 10.20.193.48:0/3688585891 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f91c805e490 msgr2=0x7f91c813d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.012+0000 7f91cd37b640 1 --2- 10.20.193.48:0/3688585891 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f91c805e490 0x7f91c813d320 secure :-1 s=READY pgs=393 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91bc0096d0 tx=0x7f91bc00c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91b67fc640 1 -- 10.20.193.48:0/3688585891 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f91bc00ee90 con 0x7f91c805e490 2026-02-12T18:14:54.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91b67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91b67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:14:54.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91b67fc640 10 monclient: dump: 2026-02-12T18:14:54.025 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.025 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.025 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.025 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.025 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.025 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.025 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.025 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.025 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.026 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.026 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.026 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.026 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.026 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.026 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.026 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91b67fc640 10 monclient: _finish_auth 0 2026-02-12T18:14:54.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91b67fc640 10 monclient: _check_auth_tickets 2026-02-12T18:14:54.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91b67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:54.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91b67fc640 1 -- 10.20.193.48:0/3688585891 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91bc00ce50 con 0x7f91c805e490 2026-02-12T18:14:54.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91b67fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:54.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91b67fc640 1 -- 10.20.193.48:0/3688585891 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f91bc013df0 con 0x7f91c805e490 2026-02-12T18:14:54.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91b67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91b67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:14:54.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91b7fff640 4 set_mon_vals no callback set 2026-02-12T18:14:54.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91b67fc640 10 monclient: dump: 2026-02-12T18:14:54.026 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.026 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.026 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.027 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.027 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.027 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.027 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.027 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.027 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.027 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.027 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.027 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.027 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.027 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.027 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.027 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91cfe07640 5 monclient: authenticate success, global_id 36524 2026-02-12T18:14:54.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91cfe07640 10 monclient: _renew_subs 2026-02-12T18:14:54.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91cfe07640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:14:54.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91cfe07640 1 -- 10.20.193.48:0/3688585891 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91b80094f0 con 0x7f91c805e490 2026-02-12T18:14:54.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91cfe07640 10 monclient: _renew_subs 2026-02-12T18:14:54.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91cfe07640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:14:54.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91cfe07640 1 -- 10.20.193.48:0/3688585891 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f91c8143a80 con 0x7f91c805e490 2026-02-12T18:14:54.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91cfe07640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:54.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91cfe07640 1 --2- 10.20.193.48:0/3688585891 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f91c8129970 0x7f91c8129d40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91cfe07640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91cfe07640 1 -- 10.20.193.48:0/3688585891 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f91c8050410 con 0x7f91c8129970 2026-02-12T18:14:54.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91cdb7c640 1 --2- 10.20.193.48:0/3688585891 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f91c8129970 0x7f91c8129d40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91cdb7c640 10 monclient: get_auth_request con 0x7f91c8129970 auth_method 0 2026-02-12T18:14:54.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91cdb7c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91cdb7c640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91cdb7c640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91cdb7c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91cdb7c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91cdb7c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91b67fc640 1 -- 10.20.193.48:0/3688585891 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f91bc011070 con 0x7f91c805e490 2026-02-12T18:14:54.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91cdb7c640 10 monclient(hunting): handle_auth_done global_id 65119 payload 824 2026-02-12T18:14:54.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.013+0000 7f91cdb7c640 1 -- 10.20.193.48:0/3688585891 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f91c8097de0 con 0x7f91c8129970 2026-02-12T18:14:54.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.014+0000 7f91b67fc640 1 --2- 10.20.193.48:0/3688585891 >> v2:10.20.193.111:6812/977811348 conn(0x7f919803f800 0x7f919805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.014+0000 7f91b67fc640 1 -- 10.20.193.48:0/3688585891 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(319..319 src has 215..319) ==== 3897+0+0 (secure 0 0 0) 0x7f91bc053150 con 0x7f91c805e490 2026-02-12T18:14:54.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.014+0000 7f91ce37d640 1 --2- 10.20.193.48:0/3688585891 >> v2:10.20.193.111:6812/977811348 conn(0x7f919803f800 0x7f919805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.014+0000 7f91ce37d640 10 monclient: get_auth_request con 0x7f919803f800 auth_method 0 2026-02-12T18:14:54.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.016+0000 7f91cdb7c640 1 -- 10.20.193.48:0/3688585891 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f91c8129970 msgr2=0x7f91c8129d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.016+0000 7f91cdb7c640 1 --2- 10.20.193.48:0/3688585891 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f91c8129970 0x7f91c8129d40 secure :-1 s=READY pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91b8004740 tx=0x7f91b80047e0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.016+0000 7f91b67fc640 1 -- 10.20.193.48:0/3688585891 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f91b8035ea0 con 0x7f91c8129970 2026-02-12T18:14:54.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.016+0000 7f91b67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.016+0000 7f91b67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:14:54.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.016+0000 7f91b67fc640 10 monclient: dump: 2026-02-12T18:14:54.029 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.029 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.029 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.029 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.029 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.029 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.029 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.029 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.029 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.029 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.029 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.029 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.029 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.029 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.030 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.030 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.016+0000 7f91b67fc640 1 -- 10.20.193.48:0/3688585891 <== mon.4 v2:10.20.193.48:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f91b8042480 con 0x7f91c8129970 2026-02-12T18:14:54.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.016+0000 7f91b67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:54.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.016+0000 7f91b67fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:14:54.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.016+0000 7f91b67fc640 1 -- 10.20.193.48:0/3688585891 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f91c8129970 msgr2=0x7f91c8129d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.016+0000 7f91b67fc640 1 --2- 10.20.193.48:0/3688585891 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f91c8129970 0x7f91c8129d40 secure :-1 s=READY pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91b8004740 tx=0x7f91b80047e0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.016+0000 7f91b67fc640 1 -- 10.20.193.48:0/3688585891 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f91c8129970 msgr2=0x7f91c8129d40 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:54.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.016+0000 7f91b67fc640 1 --2- 10.20.193.48:0/3688585891 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f91c8129970 0x7f91c8129d40 secure :-1 s=CLOSED pgs=207 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91b8004740 tx=0x7f91b80047e0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.016+0000 7f91ce37d640 1 --2- 10.20.193.48:0/3688585891 >> v2:10.20.193.111:6812/977811348 conn(0x7f919803f800 0x7f919805fcb0 secure :-1 s=READY pgs=454 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91c808a880 tx=0x7f91c4008f50 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.019+0000 7f91cfe07640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:14:54.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.019+0000 7f91cfe07640 1 --2- 10.20.193.48:0/3688585891 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f91c812c9b0 0x7f91c812cdb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.019+0000 7f91cfe07640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.019+0000 7f91cfe07640 1 -- 10.20.193.48:0/3688585891 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f91c805f140 con 0x7f91c812c9b0 2026-02-12T18:14:54.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.019+0000 7f91cdb7c640 1 --2- 10.20.193.48:0/3688585891 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f91c812c9b0 0x7f91c812cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.019+0000 7f91cdb7c640 10 monclient: get_auth_request con 0x7f91c812c9b0 auth_method 0 2026-02-12T18:14:54.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.019+0000 7f91cdb7c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.019+0000 7f91cdb7c640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.019+0000 7f91cdb7c640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.019+0000 7f91cdb7c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.019+0000 7f91cdb7c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.019+0000 7f91cdb7c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.019+0000 7f91cdb7c640 10 monclient(hunting): handle_auth_done global_id 65128 payload 824 2026-02-12T18:14:54.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.019+0000 7f91cdb7c640 1 -- 10.20.193.48:0/3688585891 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f91c812a280 con 0x7f91c812c9b0 2026-02-12T18:14:54.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.022+0000 7f91cdb7c640 1 -- 10.20.193.48:0/3688585891 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f91c812c9b0 msgr2=0x7f91c812cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.022+0000 7f91cdb7c640 1 --2- 10.20.193.48:0/3688585891 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f91c812c9b0 0x7f91c812cdb0 secure :-1 s=READY pgs=208 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91b8009820 tx=0x7f91b8004770 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.022+0000 7f91b67fc640 1 -- 10.20.193.48:0/3688585891 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f91b8052070 con 0x7f91c812c9b0 2026-02-12T18:14:54.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.022+0000 7f91b67fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.022+0000 7f91b67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:14:54.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.022+0000 7f91b67fc640 10 monclient: dump: 2026-02-12T18:14:54.033 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.033 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.033 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.033 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.033 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.033 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.033 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.033 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.033 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.033 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.033 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.033 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.033 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.033 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.033 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.033 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.022+0000 7f91b67fc640 1 -- 10.20.193.48:0/3688585891 <== mon.4 v2:10.20.193.48:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10015 (secure 0 0 0) 0x7f91b804d740 con 0x7f91c812c9b0 2026-02-12T18:14:54.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.022+0000 7f91b67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:14:54.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.022+0000 7f91b67fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:14:54.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.022+0000 7f91b67fc640 1 -- 10.20.193.48:0/3688585891 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f91c812c9b0 msgr2=0x7f91c812cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.022+0000 7f91b67fc640 1 --2- 10.20.193.48:0/3688585891 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f91c812c9b0 0x7f91c812cdb0 secure :-1 s=READY pgs=208 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91b8009820 tx=0x7f91b8004770 comp rx=0 tx=0).stop 2026-02-12T18:14:54.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.022+0000 7f91b67fc640 1 -- 10.20.193.48:0/3688585891 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f91c812c9b0 msgr2=0x7f91c812cdb0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:54.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.022+0000 7f91b67fc640 1 --2- 10.20.193.48:0/3688585891 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f91c812c9b0 0x7f91c812cdb0 unknown :-1 s=CLOSED pgs=208 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.034 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:14:54.034 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:14:54.034 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:14:54.034 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:14:54.034 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 76, 2026-02-12T18:14:54.034 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 274809, 2026-02-12T18:14:54.035 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:14:54.035 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:14:54.035 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:14:54.035 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:14:54.035 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:14:54.035 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:14:54.035 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:14:54.035 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:14:54.035 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:14:54.035 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:14:54.035 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.035 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 7, 2026-02-12T18:14:54.035 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:54.035 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:14:54.035 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:14:54.035 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:54.035 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:54.035 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:54.036 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:54.036 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:54.036 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:54.036 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:54.036 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:54.036 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:54.036 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:54.036 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:54.036 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:54.036 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:54.036 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.036 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:14:54.036 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:14:54.036 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:54.036 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:54.036 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:54.036 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:54.036 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:54.036 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:54.037 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:54.037 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:54.037 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:54.037 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:54.037 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:54.037 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:54.037 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:54.037 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.037 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.037 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:14:54.037 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:14:54.037 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:14:54.037 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:14:54.037 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:14:54.037 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:14:54.037 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:54.037 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:54.037 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:14:54.037 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:14:54.037 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:14:54.038 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:14:54.038 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:14:54.038 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:14:54.038 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:14:54.038 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:54.038 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:14:54.038 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:54.038 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:54.038 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:54.038 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:54.038 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:54.038 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:54.038 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:54.038 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:54.038 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:54.038 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:54.038 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:54.038 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:54.038 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:54.038 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.038 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:14:54.039 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.039 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:14:54.039 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.039 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:14:54.039 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:14:54.039 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.039 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.039 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.039 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.039 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:14:54.039 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.039 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.039 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.039 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.039 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:14:54.039 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.039 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.039 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.039 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.039 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:14:54.039 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:14:54.039 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.040 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.040 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:14:54.040 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.040 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.040 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.040 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:14:54.040 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:14:54.040 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.040 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.040 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.040 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.040 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:14:54.040 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.040 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.040 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.040 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.040 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:14:54.040 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.040 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.040 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.040 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.040 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:14:54.041 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:14:54.041 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.041 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.041 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:14:54.041 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.041 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.041 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.041 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:14:54.041 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:14:54.041 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.041 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.041 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.041 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.041 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:14:54.041 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.041 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.041 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.041 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.041 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:14:54.041 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.041 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.041 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.042 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.042 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:14:54.042 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:14:54.042 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.042 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.042 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:14:54.042 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.042 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.042 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.042 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:14:54.042 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:14:54.042 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.042 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.042 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.042 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.042 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:14:54.042 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.042 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.042 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.042 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.042 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:14:54.042 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.043 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.043 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.043 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.043 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:14:54.043 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:14:54.043 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.043 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.043 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:14:54.043 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.043 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.043 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.043 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:14:54.043 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:14:54.043 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.043 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.043 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.043 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.043 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:14:54.043 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.043 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.043 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.043 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.043 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:14:54.043 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.043 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.044 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.044 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.044 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:14:54.044 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:14:54.044 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.044 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.044 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:54.044 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.044 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.044 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.044 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:14:54.044 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:14:54.044 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.044 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.044 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.044 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.044 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:14:54.044 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.044 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.044 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.044 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.044 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:14:54.044 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.044 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.044 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.045 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.045 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:14:54.045 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:14:54.045 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.045 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.045 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:14:54.045 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.045 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.045 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.045 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:14:54.045 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:14:54.045 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.045 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.045 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.045 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.045 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:14:54.045 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.045 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.045 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.045 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.045 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:14:54.045 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.045 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.045 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.045 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.046 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:14:54.046 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:14:54.046 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.046 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.046 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:54.046 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.046 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.046 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.046 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:14:54.046 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:14:54.046 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.046 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.046 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.046 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.046 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:14:54.046 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.046 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.046 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.046 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.046 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:14:54.046 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.046 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.046 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.046 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.046 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.047 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.048 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:14:54.048 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.048 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.048 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.048 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.048 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:14:54.048 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:14:54.048 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.048 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:54.048 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:54.048 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:54.048 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.048 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.048 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:14:54.048 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.048 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:54.048 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:54.048 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:54.048 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.048 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.048 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.048 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:14:54.048 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:14:54.049 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.022+0000 7f91cfe07640 1 -- 10.20.193.48:0/3688585891 >> v2:10.20.193.111:6812/977811348 conn(0x7f919803f800 msgr2=0x7f919805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.049 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.022+0000 7f91cfe07640 1 --2- 10.20.193.48:0/3688585891 >> v2:10.20.193.111:6812/977811348 conn(0x7f919803f800 0x7f919805fcb0 secure :-1 s=READY pgs=454 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91c808a880 tx=0x7f91c4008f50 comp rx=0 tx=0).stop 2026-02-12T18:14:54.049 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.022+0000 7f91cfe07640 10 monclient: shutdown 2026-02-12T18:14:54.049 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.022+0000 7f91cfe07640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:54.049 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.022+0000 7f91cfe07640 1 -- 10.20.193.48:0/3688585891 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f91c805e490 msgr2=0x7f91c813d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.049 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.022+0000 7f91cfe07640 1 --2- 10.20.193.48:0/3688585891 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f91c805e490 0x7f91c813d320 secure :-1 s=READY pgs=393 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f91bc0096d0 tx=0x7f91bc00c520 comp rx=0 tx=0).stop 2026-02-12T18:14:54.049 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.022+0000 7f91ce37d640 1 -- 10.20.193.48:0/3688585891 reap_dead start 2026-02-12T18:14:54.049 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.022+0000 7f91ce37d640 1 -- 10.20.193.48:0/3688585891 reap_dead start 2026-02-12T18:14:54.050 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.022+0000 7f91cfe07640 1 -- 10.20.193.48:0/3688585891 shutdown_connections 2026-02-12T18:14:54.050 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.022+0000 7f91cfe07640 1 -- 10.20.193.48:0/3688585891 >> 10.20.193.48:0/3688585891 conn(0x7f91c80548a0 msgr2=0x7f91c8093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:54.050 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.022+0000 7f91cfe07640 1 -- 10.20.193.48:0/3688585891 shutdown_connections 2026-02-12T18:14:54.050 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.022+0000 7f91cfe07640 1 -- 10.20.193.48:0/3688585891 wait complete. 2026-02-12T18:14:54.050 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:14:54.050 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2026-02-12T18:14:54.050 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2026-02-12T18:14:54.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.113+0000 7fb029992640 10 monclient: get_monmap_and_config 2026-02-12T18:14:54.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.113+0000 7fb029992640 10 monclient: build_initial_monmap 2026-02-12T18:14:54.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.113+0000 7fb029992640 10 monclient: monmap: 2026-02-12T18:14:54.115 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:54.115 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.115 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:14:54.114873+0000 2026-02-12T18:14:54.115 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:14:54.114873+0000 2026-02-12T18:14:54.115 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:54.115 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.115 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:14:54.115 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:14:54.115 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:54.115 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:54.115 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:54.115 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:54.115 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:54.115 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:54.116 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:54.116 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:14:54.116 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:14:54.116 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb029992640 1 Processor -- start 2026-02-12T18:14:54.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb029992640 1 -- start start 2026-02-12T18:14:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb029992640 10 monclient: init 2026-02-12T18:14:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb029992640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb029992640 10 monclient: _add_conns ranks=[8,4,3,6,1,2,9,5,10,0,7] 2026-02-12T18:14:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb029992640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb024140dc0 0x7fb024141190 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb029992640 10 monclient(hunting): picked mon.noname-e con 0x7fb024140dc0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:14:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb029992640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb024096d20 0x7fb024143ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb029992640 10 monclient(hunting): picked mon.noname-c con 0x7fb024096d20 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:14:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb029992640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb0241416d0 0x7fb024144420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb029992640 10 monclient(hunting): picked mon.noname-g con 0x7fb0241416d0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:14:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb029992640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb029992640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fb024096b40 con 0x7fb0241416d0 2026-02-12T18:14:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb029992640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb029992640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fb024092680 con 0x7fb024096d20 2026-02-12T18:14:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb029992640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb029992640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fb024092960 con 0x7fb024140dc0 2026-02-12T18:14:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb029992640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:54.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb029992640 10 monclient(hunting): authenticate will time out at 1132.840634s 2026-02-12T18:14:54.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb028990640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb024140dc0 0x7fb024141190 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb01bfff640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb024096d20 0x7fb024143ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb028990640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb024140dc0 0x7fb024141190 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:59676/0 (socket says 10.20.193.48:59676) 2026-02-12T18:14:54.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb028990640 1 -- 10.20.193.48:0/2967756916 learned_addr learned my addr 10.20.193.48:0/2967756916 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:54.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb028990640 10 monclient(hunting): get_auth_request con 0x7fb024140dc0 auth_method 0 2026-02-12T18:14:54.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb028990640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb028990640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb028990640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb01bfff640 10 monclient(hunting): get_auth_request con 0x7fb024096d20 auth_method 0 2026-02-12T18:14:54.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb01bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb01bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb01bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb028990640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb028990640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb029191640 1 --2- 10.20.193.48:0/2967756916 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb0241416d0 0x7fb024144420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb028990640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb029191640 10 monclient(hunting): get_auth_request con 0x7fb0241416d0 auth_method 0 2026-02-12T18:14:54.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb029191640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb029191640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb029191640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb01bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb01bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb01bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb028990640 10 monclient(hunting): handle_auth_done global_id 94814 payload 274 2026-02-12T18:14:54.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb028990640 1 -- 10.20.193.48:0/2967756916 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb024096d20 msgr2=0x7fb024143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:54.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb028990640 1 --2- 10.20.193.48:0/2967756916 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb024096d20 0x7fb024143ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb028990640 1 -- 10.20.193.48:0/2967756916 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb0241416d0 msgr2=0x7fb024144420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:54.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb028990640 1 --2- 10.20.193.48:0/2967756916 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb0241416d0 0x7fb024144420 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb028990640 10 monclient: _finish_hunting 0 2026-02-12T18:14:54.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb028990640 1 monclient: found mon.noname-e 2026-02-12T18:14:54.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb028990640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:54.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb028990640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:14:54.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb028990640 1 -- 10.20.193.48:0/2967756916 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0240693c0 con 0x7fb024140dc0 2026-02-12T18:14:54.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.114+0000 7fb029191640 1 --2- 10.20.193.48:0/2967756916 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb0241416d0 0x7fb024144420 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:14:54.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.117+0000 7fb028990640 1 -- 10.20.193.48:0/2967756916 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb024140dc0 msgr2=0x7fb024141190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.117+0000 7fb028990640 1 --2- 10.20.193.48:0/2967756916 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb024140dc0 0x7fb024141190 secure :-1 s=READY pgs=126 gs=1 cs=0 l=1 c_cookie=2157176602690743942 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0140098d0 tx=0x7fb01402eeb0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=1defd4b0e12a6e86 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb01b7fe640 1 -- 10.20.193.48:0/2967756916 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb014035340 con 0x7fb024140dc0 2026-02-12T18:14:54.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb01b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb01b7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:14:54.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb01b7fe640 10 monclient: dump: 2026-02-12T18:14:54.123 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.123 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.123 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.123 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.124 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.124 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.124 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.124 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.124 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.124 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.124 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.124 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.124 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.124 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.124 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.124 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb01b7fe640 10 monclient: _finish_auth 0 2026-02-12T18:14:54.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb01b7fe640 10 monclient: _check_auth_tickets 2026-02-12T18:14:54.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb01b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:54.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb029992640 5 monclient: authenticate success, global_id 94814 2026-02-12T18:14:54.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb01b7fe640 1 -- 10.20.193.48:0/2967756916 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0140354c0 con 0x7fb024140dc0 2026-02-12T18:14:54.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb029992640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:14:54.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb01b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:54.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb01b7fe640 1 -- 10.20.193.48:0/2967756916 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb014035af0 con 0x7fb024140dc0 2026-02-12T18:14:54.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb029992640 10 monclient: get_monmap_and_config success 2026-02-12T18:14:54.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb029992640 4 set_mon_vals no callback set 2026-02-12T18:14:54.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb01b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb01b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:14:54.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb01b7fe640 10 monclient: dump: 2026-02-12T18:14:54.125 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.125 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.125 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.125 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.125 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.125 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.125 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.125 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.125 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.125 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.125 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.125 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.125 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.125 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.125 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.125 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb029992640 10 monclient: shutdown 2026-02-12T18:14:54.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb029992640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:54.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb029992640 1 -- 10.20.193.48:0/2967756916 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb024140dc0 msgr2=0x7fb024141190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb029992640 1 --2- 10.20.193.48:0/2967756916 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb024140dc0 0x7fb024141190 secure :-1 s=READY pgs=126 gs=1 cs=0 l=1 c_cookie=2157176602690743942 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb0140098d0 tx=0x7fb01402eeb0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb029992640 1 -- 10.20.193.48:0/2967756916 shutdown_connections 2026-02-12T18:14:54.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb029992640 1 --2- 10.20.193.48:0/2967756916 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb0241416d0 0x7fb024144420 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb029992640 1 --2- 10.20.193.48:0/2967756916 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb024096d20 0x7fb024143ee0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb029992640 1 --2- 10.20.193.48:0/2967756916 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb024140dc0 0x7fb024141190 unknown :-1 s=CLOSED pgs=126 gs=1 cs=0 l=1 c_cookie=2157176602690743942 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb029992640 1 -- 10.20.193.48:0/2967756916 >> 10.20.193.48:0/2967756916 conn(0x7fb0240546d0 msgr2=0x7fb024054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:54.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.119+0000 7fb029992640 1 -- 10.20.193.48:0/2967756916 shutdown_connections 2026-02-12T18:14:54.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb029992640 1 -- 10.20.193.48:0/2967756916 wait complete. 2026-02-12T18:14:54.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb029992640 10 monclient: build_initial_monmap 2026-02-12T18:14:54.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb029992640 10 monclient: monmap: 2026-02-12T18:14:54.126 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:54.126 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:14:54.126 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:14:54.126 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:14:54.126 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:54.126 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.126 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:14:54.127 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:14:54.127 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:54.127 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:54.127 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:54.127 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:54.127 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:54.127 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:54.127 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:54.127 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb029992640 1 Processor -- start 2026-02-12T18:14:54.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb029992640 1 -- start start 2026-02-12T18:14:54.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb029992640 10 monclient: init 2026-02-12T18:14:54.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb029992640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:54.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb029992640 10 monclient: _add_conns ranks=[4,6,1,3,7,2,8,0,5] 2026-02-12T18:14:54.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb029992640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb024140dc0 0x7fb024133860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb029992640 10 monclient(hunting): picked mon.noname-c con 0x7fb024140dc0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:14:54.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb029992640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb0241416d0 0x7fb02410e7b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb029992640 10 monclient(hunting): picked mon.noname-d con 0x7fb0241416d0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:14:54.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb029992640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb02410ecf0 0x7fb02410f140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb029992640 10 monclient(hunting): picked mon.noname-f con 0x7fb02410ecf0 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:14:54.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb029992640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb029992640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb02408fa40 con 0x7fb02410ecf0 2026-02-12T18:14:54.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb029992640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb029992640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fb0241120e0 con 0x7fb024140dc0 2026-02-12T18:14:54.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb029992640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb029992640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fb0241123c0 con 0x7fb0241416d0 2026-02-12T18:14:54.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb029992640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:54.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb029992640 10 monclient(hunting): authenticate will time out at 1132.846862s 2026-02-12T18:14:54.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb028990640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb024140dc0 0x7fb024133860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb01bfff640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb0241416d0 0x7fb02410e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb028990640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb024140dc0 0x7fb024133860 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:58274/0 (socket says 10.20.193.48:58274) 2026-02-12T18:14:54.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb028990640 1 -- 10.20.193.48:0/3100756353 learned_addr learned my addr 10.20.193.48:0/3100756353 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:54.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb028990640 10 monclient(hunting): get_auth_request con 0x7fb024140dc0 auth_method 0 2026-02-12T18:14:54.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb028990640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb028990640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb028990640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb01bfff640 10 monclient(hunting): get_auth_request con 0x7fb0241416d0 auth_method 0 2026-02-12T18:14:54.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb01bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb01bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.120+0000 7fb01bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.121+0000 7fb01bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.121+0000 7fb01bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.121+0000 7fb01bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.121+0000 7fb028990640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.121+0000 7fb028990640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.121+0000 7fb028990640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.121+0000 7fb029191640 1 --2- 10.20.193.48:0/3100756353 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb02410ecf0 0x7fb02410f140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.121+0000 7fb029191640 10 monclient(hunting): get_auth_request con 0x7fb02410ecf0 auth_method 0 2026-02-12T18:14:54.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.121+0000 7fb029191640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.121+0000 7fb029191640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.121+0000 7fb029191640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.121+0000 7fb029191640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.121+0000 7fb029191640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.121+0000 7fb029191640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.121+0000 7fb01bfff640 10 monclient(hunting): handle_auth_done global_id 104235 payload 824 2026-02-12T18:14:54.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.121+0000 7fb01bfff640 1 -- 10.20.193.48:0/3100756353 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb024140dc0 msgr2=0x7fb024133860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.121+0000 7fb01bfff640 1 --2- 10.20.193.48:0/3100756353 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb024140dc0 0x7fb024133860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.121+0000 7fb01bfff640 1 -- 10.20.193.48:0/3100756353 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb02410ecf0 msgr2=0x7fb02410f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.121+0000 7fb01bfff640 1 --2- 10.20.193.48:0/3100756353 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb02410ecf0 0x7fb02410f140 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.121+0000 7fb01bfff640 10 monclient: _finish_hunting 0 2026-02-12T18:14:54.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.121+0000 7fb01bfff640 1 monclient: found mon.noname-d 2026-02-12T18:14:54.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.121+0000 7fb01bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:54.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.121+0000 7fb01bfff640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:14:54.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.121+0000 7fb01bfff640 1 -- 10.20.193.48:0/3100756353 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0140094f0 con 0x7fb0241416d0 2026-02-12T18:14:54.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.123+0000 7fb01bfff640 1 -- 10.20.193.48:0/3100756353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb0241416d0 msgr2=0x7fb02410e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.123+0000 7fb01bfff640 1 --2- 10.20.193.48:0/3100756353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb0241416d0 0x7fb02410e7b0 secure :-1 s=READY pgs=24 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb024055380 tx=0x7fb00c00ec60 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.123+0000 7fb0197fa640 1 -- 10.20.193.48:0/3100756353 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb00c00ee60 con 0x7fb0241416d0 2026-02-12T18:14:54.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.123+0000 7fb0197fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.123+0000 7fb0197fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:14:54.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.123+0000 7fb0197fa640 10 monclient: dump: 2026-02-12T18:14:54.133 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.133 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.133 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.133 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.133 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.133 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.133 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.133 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.133 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.133 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.133 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.133 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.133 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.133 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.133 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.133 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.123+0000 7fb0197fa640 10 monclient: _finish_auth 0 2026-02-12T18:14:54.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.123+0000 7fb0197fa640 10 monclient: _check_auth_tickets 2026-02-12T18:14:54.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.123+0000 7fb0197fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:54.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.123+0000 7fb0197fa640 1 -- 10.20.193.48:0/3100756353 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb00c013470 con 0x7fb0241416d0 2026-02-12T18:14:54.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.123+0000 7fb0197fa640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:54.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.123+0000 7fb0197fa640 1 -- 10.20.193.48:0/3100756353 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb00c013aa0 con 0x7fb0241416d0 2026-02-12T18:14:54.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.123+0000 7fb0197fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.123+0000 7fb01affd640 4 set_mon_vals no callback set 2026-02-12T18:14:54.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.123+0000 7fb0197fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:14:54.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.123+0000 7fb0197fa640 10 monclient: dump: 2026-02-12T18:14:54.134 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.134 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.134 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.134 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.134 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.134 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.134 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.134 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.134 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.134 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.134 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.134 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.134 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.134 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.135 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.135 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.123+0000 7fb029992640 5 monclient: authenticate success, global_id 104235 2026-02-12T18:14:54.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.123+0000 7fb029992640 10 monclient: _renew_subs 2026-02-12T18:14:54.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.123+0000 7fb029992640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:14:54.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.123+0000 7fb029992640 1 -- 10.20.193.48:0/3100756353 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0241258c0 con 0x7fb0241416d0 2026-02-12T18:14:54.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.123+0000 7fb029992640 10 monclient: _renew_subs 2026-02-12T18:14:54.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.123+0000 7fb029992640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:14:54.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.123+0000 7fb029992640 1 -- 10.20.193.48:0/3100756353 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fb024111b20 con 0x7fb0241416d0 2026-02-12T18:14:54.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.124+0000 7fb029992640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:54.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.124+0000 7fb029992640 1 --2- 10.20.193.48:0/3100756353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb024096d20 0x7fb02410f680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.124+0000 7fb029992640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.124+0000 7fb029992640 1 -- 10.20.193.48:0/3100756353 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fb02405f140 con 0x7fb024096d20 2026-02-12T18:14:54.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.124+0000 7fb01bfff640 1 --2- 10.20.193.48:0/3100756353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb0241416d0 0x7fb02410e7b0 secure :-1 s=READY pgs=24 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb024055380 tx=0x7fb00c00ec60 comp rx=0 tx=0).queue_received will delay after 1.77092e+09 on 0x7fb00c011070 mgrmap(e 5) 2026-02-12T18:14:54.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.124+0000 7fb0197fa640 1 -- 10.20.193.48:0/3100756353 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fb00c011070 con 0x7fb0241416d0 2026-02-12T18:14:54.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.124+0000 7fb028990640 1 --2- 10.20.193.48:0/3100756353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb024096d20 0x7fb02410f680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.124+0000 7fb028990640 10 monclient: get_auth_request con 0x7fb024096d20 auth_method 0 2026-02-12T18:14:54.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.124+0000 7fb028990640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.124+0000 7fb028990640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.124+0000 7fb028990640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.124+0000 7fb028990640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.124+0000 7fb028990640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.136 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.124+0000 7fb028990640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.136 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.124+0000 7fb0197fa640 1 --2- 10.20.193.48:0/3100756353 >> v2:10.20.193.111:6812/977811348 conn(0x7faff403f800 0x7faff405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.136 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.124+0000 7fb028990640 10 monclient(hunting): handle_auth_done global_id 104244 payload 824 2026-02-12T18:14:54.136 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.124+0000 7fb028990640 1 -- 10.20.193.48:0/3100756353 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb02405dc10 con 0x7fb024096d20 2026-02-12T18:14:54.136 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.124+0000 7fb029191640 1 --2- 10.20.193.48:0/3100756353 >> v2:10.20.193.111:6812/977811348 conn(0x7faff403f800 0x7faff405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.136 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.124+0000 7fb029191640 10 monclient: get_auth_request con 0x7faff403f800 auth_method 0 2026-02-12T18:14:54.136 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.126+0000 7fb028990640 1 -- 10.20.193.48:0/3100756353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb024096d20 msgr2=0x7fb02410f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.136 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.126+0000 7fb028990640 1 --2- 10.20.193.48:0/3100756353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb024096d20 0x7fb02410f680 secure :-1 s=READY pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb014009820 tx=0x7fb0140047e0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.136 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.126+0000 7fb0197fa640 1 -- 10.20.193.48:0/3100756353 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb014035de0 con 0x7fb024096d20 2026-02-12T18:14:54.136 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.126+0000 7fb0197fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.136 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.126+0000 7fb0197fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:14:54.136 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.126+0000 7fb0197fa640 10 monclient: dump: 2026-02-12T18:14:54.136 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.136 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.136 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.136 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.136 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.136 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.136 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.137 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.137 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.137 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.137 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.137 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.137 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.137 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.137 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.137 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.127+0000 7fb029191640 1 --2- 10.20.193.48:0/3100756353 >> v2:10.20.193.111:6812/977811348 conn(0x7faff403f800 0x7faff405fcb0 secure :-1 s=READY pgs=455 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb024141aa0 tx=0x7fb020009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.127+0000 7fb0197fa640 1 -- 10.20.193.48:0/3100756353 <== mon.6 v2:10.20.193.48:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fb014042480 con 0x7fb024096d20 2026-02-12T18:14:54.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.127+0000 7fb0197fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:54.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.127+0000 7fb0197fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:14:54.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.127+0000 7fb0197fa640 1 -- 10.20.193.48:0/3100756353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb024096d20 msgr2=0x7fb02410f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.127+0000 7fb0197fa640 1 --2- 10.20.193.48:0/3100756353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb024096d20 0x7fb02410f680 secure :-1 s=READY pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb014009820 tx=0x7fb0140047e0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.127+0000 7fb0197fa640 1 -- 10.20.193.48:0/3100756353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb024096d20 msgr2=0x7fb02410f680 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:54.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.127+0000 7fb0197fa640 1 --2- 10.20.193.48:0/3100756353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb024096d20 0x7fb02410f680 secure :-1 s=CLOSED pgs=25 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb014009820 tx=0x7fb0140047e0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.130+0000 7fb029992640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:14:54.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.130+0000 7fb029992640 1 --2- 10.20.193.48:0/3100756353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb02408af70 0x7fb02404d1c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.130+0000 7fb029992640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.130+0000 7fb029992640 1 -- 10.20.193.48:0/3100756353 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fb02405fd90 con 0x7fb02408af70 2026-02-12T18:14:54.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.130+0000 7fb028990640 1 --2- 10.20.193.48:0/3100756353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb02408af70 0x7fb02404d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.130+0000 7fb028990640 10 monclient: get_auth_request con 0x7fb02408af70 auth_method 0 2026-02-12T18:14:54.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.130+0000 7fb028990640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.130+0000 7fb028990640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.130+0000 7fb028990640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.130+0000 7fb028990640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.130+0000 7fb028990640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.130+0000 7fb028990640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.130+0000 7fb028990640 10 monclient(hunting): handle_auth_done global_id 104253 payload 824 2026-02-12T18:14:54.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.130+0000 7fb028990640 1 -- 10.20.193.48:0/3100756353 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb02410fbc0 con 0x7fb02408af70 2026-02-12T18:14:54.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.132+0000 7fb028990640 1 -- 10.20.193.48:0/3100756353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb02408af70 msgr2=0x7fb02404d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.132+0000 7fb028990640 1 --2- 10.20.193.48:0/3100756353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb02408af70 0x7fb02404d1c0 secure :-1 s=READY pgs=26 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb014009820 tx=0x7fb014008030 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.133+0000 7fb0197fa640 1 -- 10.20.193.48:0/3100756353 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb01404dd30 con 0x7fb02408af70 2026-02-12T18:14:54.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.133+0000 7fb0197fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.133+0000 7fb0197fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:14:54.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.133+0000 7fb0197fa640 10 monclient: dump: 2026-02-12T18:14:54.139 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.139 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.139 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.139 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.139 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.139 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.139 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.139 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.139 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.139 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.139 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.140 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.140 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.140 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.140 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.140 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.133+0000 7fb0197fa640 1 -- 10.20.193.48:0/3100756353 <== mon.6 v2:10.20.193.48:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7fb01404de90 con 0x7fb02408af70 2026-02-12T18:14:54.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.133+0000 7fb0197fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:14:54.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.133+0000 7fb0197fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:14:54.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.133+0000 7fb0197fa640 1 -- 10.20.193.48:0/3100756353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb02408af70 msgr2=0x7fb02404d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.133+0000 7fb0197fa640 1 --2- 10.20.193.48:0/3100756353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb02408af70 0x7fb02404d1c0 secure :-1 s=READY pgs=26 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb014009820 tx=0x7fb014008030 comp rx=0 tx=0).stop 2026-02-12T18:14:54.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.133+0000 7fb0197fa640 1 -- 10.20.193.48:0/3100756353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb02408af70 msgr2=0x7fb02404d1c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:54.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.133+0000 7fb0197fa640 1 --2- 10.20.193.48:0/3100756353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb02408af70 0x7fb02404d1c0 secure :-1 s=CLOSED pgs=26 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb014009820 tx=0x7fb014008030 comp rx=0 tx=0).stop 2026-02-12T18:14:54.140 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:14:54.140 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:14:54.140 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:14:54.141 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:14:54.141 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 76, 2026-02-12T18:14:54.141 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 13129, 2026-02-12T18:14:54.141 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:14:54.141 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:14:54.141 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:14:54.141 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:14:54.141 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:14:54.141 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:14:54.141 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:14:54.141 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:14:54.141 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:14:54.141 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:14:54.141 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.141 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 8, 2026-02-12T18:14:54.141 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:54.141 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:14:54.141 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:14:54.141 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:54.141 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:54.142 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:54.142 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:54.142 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:54.142 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:54.142 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:54.142 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:54.142 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:54.142 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:54.142 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:54.142 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:54.142 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:54.142 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.142 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:14:54.142 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:14:54.142 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:54.142 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:54.142 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:54.142 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:54.142 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:54.142 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:54.143 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:54.143 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:54.143 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:54.143 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:54.143 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:54.143 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:54.143 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:54.143 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.143 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.143 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:14:54.143 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:14:54.143 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:14:54.143 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:14:54.143 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:14:54.143 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:14:54.143 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:54.143 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:54.143 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:14:54.143 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:14:54.144 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:14:54.144 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:14:54.144 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:14:54.144 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:14:54.144 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:14:54.144 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:54.144 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:14:54.144 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:54.144 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:54.144 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:54.144 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:54.144 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:54.144 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:54.144 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:54.144 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:54.144 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:54.144 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:54.144 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:54.144 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:54.144 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:54.144 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.145 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:14:54.145 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.145 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:14:54.145 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.145 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:14:54.145 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:14:54.145 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.145 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.145 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.145 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.145 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:14:54.145 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.145 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.145 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.145 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.145 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:14:54.145 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.145 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.145 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.145 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.145 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:14:54.146 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:14:54.146 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.146 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.146 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:14:54.146 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.146 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.146 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.146 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:14:54.146 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:14:54.146 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.146 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.146 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.146 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.146 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:14:54.146 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.146 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.146 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.146 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.146 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:14:54.146 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.146 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.146 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.147 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.147 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:14:54.147 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:14:54.147 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.147 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.147 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:14:54.147 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.147 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.147 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.147 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:14:54.147 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:14:54.147 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.147 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.147 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.147 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.147 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:14:54.147 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.147 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.147 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.147 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.147 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:14:54.147 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.147 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.148 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.148 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.148 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:14:54.148 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:14:54.148 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.148 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.148 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:14:54.148 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.148 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.148 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.148 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:14:54.148 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:14:54.148 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.148 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.148 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.148 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.148 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:14:54.148 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.148 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.148 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.148 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.148 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:14:54.149 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.149 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.149 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.149 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.149 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:14:54.149 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:14:54.149 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.149 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.149 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:14:54.149 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.149 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.149 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.149 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:14:54.149 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:14:54.149 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.149 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.149 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.149 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.149 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:14:54.149 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.149 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.149 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.149 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.149 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:14:54.150 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.150 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.150 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.150 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.150 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:14:54.150 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:14:54.150 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.150 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.150 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:54.150 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.150 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.150 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.150 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:14:54.150 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:14:54.150 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.150 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.150 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.150 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.150 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:14:54.150 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.150 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.150 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.150 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.150 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:14:54.151 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.151 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.151 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.151 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.151 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:14:54.151 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:14:54.151 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.151 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.151 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:14:54.151 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.151 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.151 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.151 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:14:54.151 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:14:54.151 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.151 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.151 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.151 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.151 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:14:54.151 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.151 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.151 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.152 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.152 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:14:54.152 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.152 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.152 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.152 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.152 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:14:54.152 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:14:54.152 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.152 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.152 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:54.152 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.152 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.152 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.152 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:14:54.152 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:14:54.152 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.152 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.152 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.152 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.152 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:14:54.152 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.152 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.152 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.153 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.153 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:14:54.153 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.153 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.153 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.153 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.153 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:14:54.153 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:14:54.153 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.153 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.153 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:14:54.153 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.153 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.153 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.153 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:14:54.153 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:14:54.153 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.153 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.153 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.153 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.153 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:14:54.153 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.153 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.153 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.153 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.154 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:14:54.154 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.154 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.154 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.154 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.154 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:14:54.154 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:14:54.154 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.154 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.154 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:14:54.154 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.154 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.154 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.154 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.154 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:14:54.154 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:14:54.154 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.154 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:54.154 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:54.154 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:54.154 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.154 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.154 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:14:54.155 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.155 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:54.155 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:54.155 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:14:54.155 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.155 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.155 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.155 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:14:54.155 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:14:54.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.133+0000 7fb029992640 1 -- 10.20.193.48:0/3100756353 >> v2:10.20.193.111:6812/977811348 conn(0x7faff403f800 msgr2=0x7faff405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.133+0000 7fb029992640 1 --2- 10.20.193.48:0/3100756353 >> v2:10.20.193.111:6812/977811348 conn(0x7faff403f800 0x7faff405fcb0 secure :-1 s=READY pgs=455 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb024141aa0 tx=0x7fb020009040 comp rx=0 tx=0).stop 2026-02-12T18:14:54.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.133+0000 7fb029992640 10 monclient: shutdown 2026-02-12T18:14:54.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.133+0000 7fb029992640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:54.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.133+0000 7fb029992640 1 -- 10.20.193.48:0/3100756353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb0241416d0 msgr2=0x7fb02410e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.133+0000 7fb029992640 1 --2- 10.20.193.48:0/3100756353 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb0241416d0 0x7fb02410e7b0 secure :-1 s=READY pgs=24 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb024055380 tx=0x7fb00c00ec60 comp rx=0 tx=0).stop 2026-02-12T18:14:54.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.133+0000 7fb029191640 1 -- 10.20.193.48:0/3100756353 reap_dead start 2026-02-12T18:14:54.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.133+0000 7fb0197fa640 1 -- 10.20.193.48:0/3100756353 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(319..319 src has 215..319) ==== 3897+0+0 (unknown 0 0 0) 0x7fb00c052d60 con 0x7fb0241416d0 2026-02-12T18:14:54.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.133+0000 7fb029191640 1 -- 10.20.193.48:0/3100756353 reap_dead start 2026-02-12T18:14:54.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.133+0000 7fb029992640 1 -- 10.20.193.48:0/3100756353 shutdown_connections 2026-02-12T18:14:54.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.133+0000 7fb029992640 1 -- 10.20.193.48:0/3100756353 >> 10.20.193.48:0/3100756353 conn(0x7fb0240546d0 msgr2=0x7fb024127530 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:54.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.133+0000 7fb029992640 1 -- 10.20.193.48:0/3100756353 shutdown_connections 2026-02-12T18:14:54.156 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.133+0000 7fb029992640 1 -- 10.20.193.48:0/3100756353 wait complete. 2026-02-12T18:14:54.156 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:14:54.156 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2026-02-12T18:14:54.157 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2026-02-12T18:14:54.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.220+0000 7ff3a3a12640 10 monclient: get_monmap_and_config 2026-02-12T18:14:54.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.220+0000 7ff3a3a12640 10 monclient: build_initial_monmap 2026-02-12T18:14:54.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.220+0000 7ff3a3a12640 10 monclient: monmap: 2026-02-12T18:14:54.222 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:54.222 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.222 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:14:54.221614+0000 2026-02-12T18:14:54.222 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:14:54.221614+0000 2026-02-12T18:14:54.222 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:54.222 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.222 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:14:54.222 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:14:54.222 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:54.222 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:54.222 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:54.222 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:54.222 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:54.222 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:54.222 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:54.222 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:14:54.222 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:14:54.222 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.220+0000 7ff3a3a12640 1 Processor -- start 2026-02-12T18:14:54.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.220+0000 7ff3a3a12640 1 -- start start 2026-02-12T18:14:54.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.220+0000 7ff3a3a12640 10 monclient: init 2026-02-12T18:14:54.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a3a12640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:54.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a3a12640 10 monclient: _add_conns ranks=[10,2,3,8,5,7,6,4,0,9,1] 2026-02-12T18:14:54.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a3a12640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7ff39c05c950 0x7ff39c05cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a3a12640 10 monclient(hunting): picked mon.noname-f con 0x7ff39c05c950 addr v2:10.20.193.111:3300/0 2026-02-12T18:14:54.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a3a12640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff39c05e490 0x7ff39c05d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a3a12640 10 monclient(hunting): picked mon.noname-b con 0x7ff39c05e490 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:14:54.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a3a12640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff39c13db70 0x7ff39c13e010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a3a12640 10 monclient(hunting): picked mon.noname-g con 0x7ff39c13db70 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:14:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a3a12640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a3a12640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7ff39c05ddd0 con 0x7ff39c05c950 2026-02-12T18:14:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a3a12640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a3a12640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7ff39c05d7a0 con 0x7ff39c05e490 2026-02-12T18:14:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a3a12640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a3a12640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff39c092990 con 0x7ff39c13db70 2026-02-12T18:14:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a3a12640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a3a12640 10 monclient(hunting): authenticate will time out at 1132.947373s 2026-02-12T18:14:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a0f86640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff39c05e490 0x7ff39c05d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a0f86640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff39c05e490 0x7ff39c05d260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:40376/0 (socket says 10.20.193.48:40376) 2026-02-12T18:14:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a0f86640 1 -- 10.20.193.48:0/2308145743 learned_addr learned my addr 10.20.193.48:0/2308145743 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a0f86640 10 monclient(hunting): get_auth_request con 0x7ff39c05e490 auth_method 0 2026-02-12T18:14:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a0f86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a0f86640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a0f86640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a1787640 1 --2- 10.20.193.48:0/2308145743 >> v2:10.20.193.111:3300/0 conn(0x7ff39c05c950 0x7ff39c05cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a1787640 10 monclient(hunting): get_auth_request con 0x7ff39c05c950 auth_method 0 2026-02-12T18:14:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a1787640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a1787640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a1787640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a0f86640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a0f86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a0f86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a1f88640 1 --2- 10.20.193.48:0/2308145743 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff39c13db70 0x7ff39c13e010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a1f88640 10 monclient(hunting): get_auth_request con 0x7ff39c13db70 auth_method 0 2026-02-12T18:14:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a1f88640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a1f88640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a1f88640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a0f86640 10 monclient(hunting): handle_auth_done global_id 36533 payload 274 2026-02-12T18:14:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a0f86640 1 -- 10.20.193.48:0/2308145743 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff39c13db70 msgr2=0x7ff39c13e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a0f86640 1 --2- 10.20.193.48:0/2308145743 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff39c13db70 0x7ff39c13e010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a0f86640 1 -- 10.20.193.48:0/2308145743 >> v2:10.20.193.111:3300/0 conn(0x7ff39c05c950 msgr2=0x7ff39c05cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a0f86640 1 --2- 10.20.193.48:0/2308145743 >> v2:10.20.193.111:3300/0 conn(0x7ff39c05c950 0x7ff39c05cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a0f86640 10 monclient: _finish_hunting 0 2026-02-12T18:14:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a0f86640 1 monclient: found mon.noname-b 2026-02-12T18:14:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a0f86640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a0f86640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:14:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a0f86640 1 -- 10.20.193.48:0/2308145743 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39c04dc20 con 0x7ff39c05e490 2026-02-12T18:14:54.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.221+0000 7ff3a1787640 1 --2- 10.20.193.48:0/2308145743 >> v2:10.20.193.111:3300/0 conn(0x7ff39c05c950 0x7ff39c05cd20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:14:54.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff3a0f86640 1 -- 10.20.193.48:0/2308145743 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff39c05e490 msgr2=0x7ff39c05d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff3a0f86640 1 --2- 10.20.193.48:0/2308145743 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff39c05e490 0x7ff39c05d260 secure :-1 s=READY pgs=394 gs=1 cs=0 l=1 c_cookie=17593593797509049861 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff390009060 tx=0x7ff39002edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f42900580f0aee05 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff38bfff640 1 -- 10.20.193.48:0/2308145743 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff390035340 con 0x7ff39c05e490 2026-02-12T18:14:54.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff38bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff38bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:14:54.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff38bfff640 10 monclient: dump: 2026-02-12T18:14:54.229 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.229 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.229 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.229 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.229 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.229 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.229 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.229 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.229 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.229 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.229 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.229 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.229 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.229 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.229 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.230 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff38bfff640 10 monclient: _finish_auth 0 2026-02-12T18:14:54.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff38bfff640 10 monclient: _check_auth_tickets 2026-02-12T18:14:54.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff38bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:54.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff38bfff640 1 -- 10.20.193.48:0/2308145743 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3900354c0 con 0x7ff39c05e490 2026-02-12T18:14:54.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff3a3a12640 5 monclient: authenticate success, global_id 36533 2026-02-12T18:14:54.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff3a3a12640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:14:54.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff38bfff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:54.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff38bfff640 1 -- 10.20.193.48:0/2308145743 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff390035af0 con 0x7ff39c05e490 2026-02-12T18:14:54.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff3a3a12640 10 monclient: get_monmap_and_config success 2026-02-12T18:14:54.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff3a3a12640 4 set_mon_vals no callback set 2026-02-12T18:14:54.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff38bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff38bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:14:54.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff38bfff640 10 monclient: dump: 2026-02-12T18:14:54.230 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.230 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.230 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.230 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.230 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.230 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.230 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.230 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.230 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.230 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.231 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.231 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.231 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.231 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.231 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.231 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff3a3a12640 10 monclient: shutdown 2026-02-12T18:14:54.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff3a3a12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:54.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff3a3a12640 1 -- 10.20.193.48:0/2308145743 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff39c05e490 msgr2=0x7ff39c05d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff3a3a12640 1 --2- 10.20.193.48:0/2308145743 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff39c05e490 0x7ff39c05d260 secure :-1 s=READY pgs=394 gs=1 cs=0 l=1 c_cookie=17593593797509049861 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff390009060 tx=0x7ff39002edf0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff3a3a12640 1 -- 10.20.193.48:0/2308145743 shutdown_connections 2026-02-12T18:14:54.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff3a3a12640 1 --2- 10.20.193.48:0/2308145743 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff39c13db70 0x7ff39c13e010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff3a3a12640 1 --2- 10.20.193.48:0/2308145743 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff39c05e490 0x7ff39c05d260 unknown :-1 s=CLOSED pgs=394 gs=1 cs=0 l=1 c_cookie=17593593797509049861 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff3a3a12640 1 --2- 10.20.193.48:0/2308145743 >> v2:10.20.193.111:3300/0 conn(0x7ff39c05c950 0x7ff39c05cd20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff3a3a12640 1 -- 10.20.193.48:0/2308145743 >> 10.20.193.48:0/2308145743 conn(0x7ff39c0548a0 msgr2=0x7ff39c097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:54.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff3a3a12640 1 -- 10.20.193.48:0/2308145743 shutdown_connections 2026-02-12T18:14:54.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.224+0000 7ff3a3a12640 1 -- 10.20.193.48:0/2308145743 wait complete. 2026-02-12T18:14:54.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a3a12640 10 monclient: build_initial_monmap 2026-02-12T18:14:54.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a3a12640 10 monclient: monmap: 2026-02-12T18:14:54.231 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:54.231 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:14:54.231 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:14:54.231 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:14:54.231 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:54.232 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.232 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:14:54.232 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:14:54.232 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:54.232 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:54.232 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:54.232 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:54.232 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:54.232 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:54.232 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:54.232 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a3a12640 1 Processor -- start 2026-02-12T18:14:54.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a3a12640 1 -- start start 2026-02-12T18:14:54.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a3a12640 10 monclient: init 2026-02-12T18:14:54.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a3a12640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:54.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a3a12640 10 monclient: _add_conns ranks=[4,2,1,0,5,8,6,7,3] 2026-02-12T18:14:54.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a3a12640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff39c05c950 0x7ff39c08d3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a3a12640 10 monclient(hunting): picked mon.noname-c con 0x7ff39c05c950 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:14:54.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a3a12640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff39c05e490 0x7ff39c13cd50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a3a12640 10 monclient(hunting): picked mon.noname-b con 0x7ff39c05e490 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:14:54.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a3a12640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff39c13db70 0x7ff39c13d290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a3a12640 10 monclient(hunting): picked mon.noname-f con 0x7ff39c13db70 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:14:54.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a3a12640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a3a12640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff39c0902f0 con 0x7ff39c13db70 2026-02-12T18:14:54.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a3a12640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a3a12640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7ff39c0907b0 con 0x7ff39c05e490 2026-02-12T18:14:54.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a3a12640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a3a12640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7ff39c13e3e0 con 0x7ff39c05c950 2026-02-12T18:14:54.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a3a12640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:54.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a3a12640 10 monclient(hunting): authenticate will time out at 1132.951780s 2026-02-12T18:14:54.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a0f86640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff39c05e490 0x7ff39c13cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a0f86640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff39c05e490 0x7ff39c13cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:40392/0 (socket says 10.20.193.48:40392) 2026-02-12T18:14:54.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a0f86640 1 -- 10.20.193.48:0/1123933035 learned_addr learned my addr 10.20.193.48:0/1123933035 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:54.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a0f86640 10 monclient(hunting): get_auth_request con 0x7ff39c05e490 auth_method 0 2026-02-12T18:14:54.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a0f86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a0f86640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a0f86640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a1787640 1 --2- 10.20.193.48:0/1123933035 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff39c05c950 0x7ff39c08d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a1787640 10 monclient(hunting): get_auth_request con 0x7ff39c05c950 auth_method 0 2026-02-12T18:14:54.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a1787640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a1787640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a1787640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a0f86640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a0f86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a0f86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a1787640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a1787640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a1787640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a1f88640 1 --2- 10.20.193.48:0/1123933035 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff39c13db70 0x7ff39c13d290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a1f88640 10 monclient(hunting): get_auth_request con 0x7ff39c13db70 auth_method 0 2026-02-12T18:14:54.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a1f88640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a1f88640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.225+0000 7ff3a1f88640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.226+0000 7ff3a0f86640 10 monclient(hunting): handle_auth_done global_id 36542 payload 824 2026-02-12T18:14:54.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.226+0000 7ff3a0f86640 1 -- 10.20.193.48:0/1123933035 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff39c05c950 msgr2=0x7ff39c08d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.226+0000 7ff3a0f86640 1 --2- 10.20.193.48:0/1123933035 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ff39c05c950 0x7ff39c08d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.226+0000 7ff3a0f86640 1 -- 10.20.193.48:0/1123933035 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff39c13db70 msgr2=0x7ff39c13d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.226+0000 7ff3a0f86640 1 --2- 10.20.193.48:0/1123933035 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff39c13db70 0x7ff39c13d290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.226+0000 7ff3a0f86640 10 monclient: _finish_hunting 0 2026-02-12T18:14:54.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.226+0000 7ff3a0f86640 1 monclient: found mon.noname-b 2026-02-12T18:14:54.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.226+0000 7ff3a0f86640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:54.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.226+0000 7ff3a0f86640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:14:54.234 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.226+0000 7ff3a0f86640 1 -- 10.20.193.48:0/1123933035 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3900094f0 con 0x7ff39c05e490 2026-02-12T18:14:54.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff3a0f86640 1 -- 10.20.193.48:0/1123933035 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff39c05e490 msgr2=0x7ff39c13cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff3a0f86640 1 --2- 10.20.193.48:0/1123933035 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff39c05e490 0x7ff39c13cd50 secure :-1 s=READY pgs=395 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff390004740 tx=0x7ff390004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff389ffb640 1 -- 10.20.193.48:0/1123933035 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff390035e00 con 0x7ff39c05e490 2026-02-12T18:14:54.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff389ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff389ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:14:54.237 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff389ffb640 10 monclient: dump: 2026-02-12T18:14:54.237 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.237 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.237 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.237 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.237 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.237 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.237 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.237 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.237 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.237 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.237 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.237 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.237 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.237 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.237 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.238 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff389ffb640 10 monclient: _finish_auth 0 2026-02-12T18:14:54.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff389ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:14:54.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff389ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:54.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff389ffb640 1 -- 10.20.193.48:0/1123933035 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3900044f0 con 0x7ff39c05e490 2026-02-12T18:14:54.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff3a3a12640 5 monclient: authenticate success, global_id 36542 2026-02-12T18:14:54.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff3a3a12640 10 monclient: _renew_subs 2026-02-12T18:14:54.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff3a3a12640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:14:54.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff3a3a12640 1 -- 10.20.193.48:0/1123933035 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff39c143a80 con 0x7ff39c05e490 2026-02-12T18:14:54.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff389ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:54.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff389ffb640 1 -- 10.20.193.48:0/1123933035 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff390003b90 con 0x7ff39c05e490 2026-02-12T18:14:54.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff389ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff38b7fe640 4 set_mon_vals no callback set 2026-02-12T18:14:54.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff389ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:14:54.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff389ffb640 10 monclient: dump: 2026-02-12T18:14:54.238 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.238 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.238 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.238 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.238 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.238 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.238 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.238 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.239 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.239 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.239 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.239 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.239 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.239 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.239 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.239 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff3a3a12640 10 monclient: _renew_subs 2026-02-12T18:14:54.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff3a3a12640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:14:54.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff3a3a12640 1 -- 10.20.193.48:0/1123933035 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff39c08af80 con 0x7ff39c05e490 2026-02-12T18:14:54.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff3a3a12640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:54.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff3a3a12640 1 --2- 10.20.193.48:0/1123933035 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff39c08d900 0x7ff39c1293e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff3a3a12640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.228+0000 7ff3a3a12640 1 -- 10.20.193.48:0/1123933035 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7ff39c063180 con 0x7ff39c08d900 2026-02-12T18:14:54.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.229+0000 7ff3a1787640 1 --2- 10.20.193.48:0/1123933035 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff39c08d900 0x7ff39c1293e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.229+0000 7ff389ffb640 1 -- 10.20.193.48:0/1123933035 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7ff390003cf0 con 0x7ff39c05e490 2026-02-12T18:14:54.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.229+0000 7ff3a1787640 10 monclient: get_auth_request con 0x7ff39c08d900 auth_method 0 2026-02-12T18:14:54.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.229+0000 7ff3a1787640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.229+0000 7ff3a1787640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.229+0000 7ff3a1787640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.229+0000 7ff3a1787640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.229+0000 7ff3a1787640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.229+0000 7ff3a1787640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.229+0000 7ff389ffb640 1 --2- 10.20.193.48:0/1123933035 >> v2:10.20.193.111:6812/977811348 conn(0x7ff36c03f7f0 0x7ff36c05fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.229+0000 7ff389ffb640 1 -- 10.20.193.48:0/1123933035 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(319..319 src has 215..319) ==== 3897+0+0 (secure 0 0 0) 0x7ff390077fb0 con 0x7ff39c05e490 2026-02-12T18:14:54.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.229+0000 7ff3a1787640 10 monclient(hunting): handle_auth_done global_id 94823 payload 824 2026-02-12T18:14:54.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.229+0000 7ff3a1787640 1 -- 10.20.193.48:0/1123933035 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff39c13e5a0 con 0x7ff39c08d900 2026-02-12T18:14:54.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.229+0000 7ff3a1f88640 1 --2- 10.20.193.48:0/1123933035 >> v2:10.20.193.111:6812/977811348 conn(0x7ff36c03f7f0 0x7ff36c05fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.229+0000 7ff3a1f88640 1 -- 10.20.193.48:0/1123933035 >> v2:10.20.193.111:6812/977811348 conn(0x7ff36c03f7f0 msgr2=0x7ff36c05fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-12T18:14:54.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.229+0000 7ff3a1f88640 1 -- 10.20.193.48:0/1123933035 >> v2:10.20.193.111:6812/977811348 conn(0x7ff36c03f7f0 msgr2=0x7ff36c05fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:14:54.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.229+0000 7ff3a1f88640 1 --2- 10.20.193.48:0/1123933035 >> v2:10.20.193.111:6812/977811348 conn(0x7ff36c03f7f0 0x7ff36c05fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:14:54.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.229+0000 7ff3a1f88640 1 --2- 10.20.193.48:0/1123933035 >> v2:10.20.193.111:6812/977811348 conn(0x7ff36c03f7f0 0x7ff36c05fca0 unknown :-1 s=START_CONNECT pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:14:54.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.231+0000 7ff3a1787640 1 -- 10.20.193.48:0/1123933035 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff39c08d900 msgr2=0x7ff39c1293e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.231+0000 7ff3a1787640 1 --2- 10.20.193.48:0/1123933035 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff39c08d900 0x7ff39c1293e0 secure :-1 s=READY pgs=127 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff38c010820 tx=0x7ff38c010cf0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.231+0000 7ff389ffb640 1 -- 10.20.193.48:0/1123933035 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff38c00ed20 con 0x7ff39c08d900 2026-02-12T18:14:54.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.231+0000 7ff389ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.231+0000 7ff389ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:14:54.240 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.231+0000 7ff389ffb640 10 monclient: dump: 2026-02-12T18:14:54.240 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.240 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.240 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.240 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.240 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.240 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.240 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.240 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.240 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.240 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.241 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.241 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.241 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.241 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.241 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.241 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.231+0000 7ff389ffb640 1 -- 10.20.193.48:0/1123933035 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7ff38c00ee80 con 0x7ff39c08d900 2026-02-12T18:14:54.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.231+0000 7ff389ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:54.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.231+0000 7ff389ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:14:54.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.231+0000 7ff389ffb640 1 -- 10.20.193.48:0/1123933035 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff39c08d900 msgr2=0x7ff39c1293e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.231+0000 7ff389ffb640 1 --2- 10.20.193.48:0/1123933035 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff39c08d900 0x7ff39c1293e0 secure :-1 s=READY pgs=127 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff38c010820 tx=0x7ff38c010cf0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.231+0000 7ff389ffb640 1 -- 10.20.193.48:0/1123933035 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff39c08d900 msgr2=0x7ff39c1293e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:54.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.231+0000 7ff389ffb640 1 --2- 10.20.193.48:0/1123933035 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff39c08d900 0x7ff39c1293e0 secure :-1 s=CLOSED pgs=127 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff38c010820 tx=0x7ff38c010cf0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.235+0000 7ff3a3a12640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:14:54.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.235+0000 7ff3a3a12640 1 --2- 10.20.193.48:0/1123933035 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff39c129920 0x7ff39c129d20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.235+0000 7ff3a3a12640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.235+0000 7ff3a3a12640 1 -- 10.20.193.48:0/1123933035 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7ff39c05f140 con 0x7ff39c129920 2026-02-12T18:14:54.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.235+0000 7ff3a1787640 1 --2- 10.20.193.48:0/1123933035 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff39c129920 0x7ff39c129d20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.235+0000 7ff3a1787640 10 monclient: get_auth_request con 0x7ff39c129920 auth_method 0 2026-02-12T18:14:54.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.235+0000 7ff3a1787640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.235+0000 7ff3a1787640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.235+0000 7ff3a1787640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.235+0000 7ff3a1787640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.235+0000 7ff3a1787640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.235+0000 7ff3a1787640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.241 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.235+0000 7ff3a1787640 10 monclient(hunting): handle_auth_done global_id 94832 payload 824 2026-02-12T18:14:54.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.235+0000 7ff3a1787640 1 -- 10.20.193.48:0/1123933035 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff39c097de0 con 0x7ff39c129920 2026-02-12T18:14:54.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.237+0000 7ff3a1787640 1 -- 10.20.193.48:0/1123933035 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff39c129920 msgr2=0x7ff39c129d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.237+0000 7ff3a1787640 1 --2- 10.20.193.48:0/1123933035 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff39c129920 0x7ff39c129d20 secure :-1 s=READY pgs=128 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff38c010820 tx=0x7ff38c004770 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.237+0000 7ff389ffb640 1 -- 10.20.193.48:0/1123933035 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff38c0045a0 con 0x7ff39c129920 2026-02-12T18:14:54.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.237+0000 7ff389ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.237+0000 7ff389ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:14:54.242 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.237+0000 7ff389ffb640 10 monclient: dump: 2026-02-12T18:14:54.242 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.243 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.243 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.243 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.243 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.243 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.243 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.243 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.243 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.243 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.243 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.243 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.243 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.243 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.243 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.243 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.238+0000 7ff389ffb640 1 -- 10.20.193.48:0/1123933035 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10182 (secure 0 0 0) 0x7ff38c0036d0 con 0x7ff39c129920 2026-02-12T18:14:54.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.238+0000 7ff389ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:14:54.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.238+0000 7ff389ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:14:54.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.238+0000 7ff389ffb640 1 -- 10.20.193.48:0/1123933035 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff39c129920 msgr2=0x7ff39c129d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.238+0000 7ff389ffb640 1 --2- 10.20.193.48:0/1123933035 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff39c129920 0x7ff39c129d20 secure :-1 s=READY pgs=128 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff38c010820 tx=0x7ff38c004770 comp rx=0 tx=0).stop 2026-02-12T18:14:54.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.238+0000 7ff389ffb640 1 -- 10.20.193.48:0/1123933035 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff39c129920 msgr2=0x7ff39c129d20 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:54.243 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.238+0000 7ff389ffb640 1 --2- 10.20.193.48:0/1123933035 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7ff39c129920 0x7ff39c129d20 secure :-1 s=CLOSED pgs=128 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff38c010820 tx=0x7ff38c004770 comp rx=0 tx=0).stop 2026-02-12T18:14:54.244 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:14:54.244 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:14:54.244 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:14:54.244 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:14:54.244 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 76, 2026-02-12T18:14:54.244 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 139911, 2026-02-12T18:14:54.244 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:14:54.244 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:14:54.244 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:14:54.244 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:14:54.244 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:14:54.244 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:14:54.244 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:14:54.244 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:14:54.244 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:14:54.244 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:14:54.244 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.244 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 8, 2026-02-12T18:14:54.244 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:54.244 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:14:54.244 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:14:54.245 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:54.245 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:54.245 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:54.245 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:54.245 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:54.245 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:54.245 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:54.245 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:54.245 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:54.245 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:54.245 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:54.245 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:54.245 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:54.245 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.245 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:14:54.245 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:14:54.245 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:54.245 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:54.245 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:54.245 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:54.245 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:54.245 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:54.245 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:54.245 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:54.245 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:54.246 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:54.246 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:54.246 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:54.246 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:54.246 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.246 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.246 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:14:54.246 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:14:54.246 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:14:54.246 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:14:54.246 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:14:54.246 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:14:54.246 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:54.246 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:54.246 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:14:54.246 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:14:54.246 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:14:54.246 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:14:54.246 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:14:54.246 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:14:54.246 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:14:54.246 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:54.246 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:14:54.246 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:54.246 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:54.247 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:54.247 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:54.247 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:54.247 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:54.247 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:54.247 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:54.247 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:54.247 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:54.247 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:54.247 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:54.247 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:54.247 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.247 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:14:54.247 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.247 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:14:54.247 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.247 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:14:54.247 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:14:54.247 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.247 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.247 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.247 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.247 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:14:54.247 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.247 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.247 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.248 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.248 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:14:54.248 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.248 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.248 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.248 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.248 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:14:54.248 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:14:54.248 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.248 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.248 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:14:54.248 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.248 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.248 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.248 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:14:54.248 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:14:54.248 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.248 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.248 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.248 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.248 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:14:54.248 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.248 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.248 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.248 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.248 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:14:54.249 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.249 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.249 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.249 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.249 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:14:54.249 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:14:54.249 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.249 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.249 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:14:54.249 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.249 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.249 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.249 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:14:54.249 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:14:54.249 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.249 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.249 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.249 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.249 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:14:54.249 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.249 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.249 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.249 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.249 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:14:54.249 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.249 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.250 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.250 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.250 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:14:54.250 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:14:54.250 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.250 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.250 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:14:54.250 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.250 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.250 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.250 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:14:54.250 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:14:54.250 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.250 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.250 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.250 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.250 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:14:54.250 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.250 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.250 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.250 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.250 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:14:54.250 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.250 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.250 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.251 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.251 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:14:54.251 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:14:54.251 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.251 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.251 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:14:54.251 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.251 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.251 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.251 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:14:54.251 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:14:54.251 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.251 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.251 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.251 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.251 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:14:54.251 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.251 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.251 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.251 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.251 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:14:54.251 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.251 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.251 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.251 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.251 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:14:54.252 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:14:54.252 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.252 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.252 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:54.252 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.252 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.252 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.252 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:14:54.252 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:14:54.252 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.252 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.252 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.252 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.252 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:14:54.252 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.252 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.252 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.252 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.252 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:14:54.252 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.252 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.252 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.252 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.252 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:14:54.253 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:14:54.253 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.253 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.253 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:14:54.253 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.253 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.253 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.253 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:14:54.253 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:14:54.253 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.253 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.253 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.253 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.253 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:14:54.253 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.253 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.253 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.253 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.253 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:14:54.253 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.253 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.253 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.253 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.253 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:14:54.253 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:14:54.253 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.254 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.254 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:54.254 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.254 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.254 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.254 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:14:54.254 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:14:54.254 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.254 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.254 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.254 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.254 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:14:54.254 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.254 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.254 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.254 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.254 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:14:54.254 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.254 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.254 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.254 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.254 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:14:54.254 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:14:54.254 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.255 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.255 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:14:54.255 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.255 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.255 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.255 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:14:54.255 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:14:54.255 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.255 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.255 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.255 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.255 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:14:54.255 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.255 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.255 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.255 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.255 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:14:54.255 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.255 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.255 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.255 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.255 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:14:54.255 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:14:54.255 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.255 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.255 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:14:54.256 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.256 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.256 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.256 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.256 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:14:54.256 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:14:54.256 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.256 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:54.256 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:54.256 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:54.256 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.256 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.256 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:14:54.256 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.256 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:54.256 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:54.256 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:54.256 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.256 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.256 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:14:54.256 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.256 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:54.256 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:54.256 INFO:teuthology.orchestra.run.trial048.stdout: "num": 3 2026-02-12T18:14:54.256 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.256 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.257 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.257 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:14:54.257 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:14:54.257 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.238+0000 7ff3a3a12640 1 -- 10.20.193.48:0/1123933035 >> v2:10.20.193.111:6812/977811348 conn(0x7ff36c03f7f0 msgr2=0x7ff36c05fca0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:14:54.257 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.238+0000 7ff3a3a12640 1 --2- 10.20.193.48:0/1123933035 >> v2:10.20.193.111:6812/977811348 conn(0x7ff36c03f7f0 0x7ff36c05fca0 unknown :-1 s=START_CONNECT pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.257 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.238+0000 7ff3a3a12640 10 monclient: shutdown 2026-02-12T18:14:54.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.238+0000 7ff3a3a12640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:54.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.238+0000 7ff3a3a12640 1 -- 10.20.193.48:0/1123933035 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff39c05e490 msgr2=0x7ff39c13cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.238+0000 7ff3a3a12640 1 --2- 10.20.193.48:0/1123933035 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff39c05e490 0x7ff39c13cd50 secure :-1 s=READY pgs=395 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff390004740 tx=0x7ff390004770 comp rx=0 tx=0).stop 2026-02-12T18:14:54.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.238+0000 7ff3a1f88640 1 -- 10.20.193.48:0/1123933035 reap_dead start 2026-02-12T18:14:54.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.238+0000 7ff3a3a12640 1 -- 10.20.193.48:0/1123933035 shutdown_connections 2026-02-12T18:14:54.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.238+0000 7ff3a3a12640 1 --2- 10.20.193.48:0/1123933035 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff39c05e490 0x7ff39c13cd50 unknown :-1 s=CLOSED pgs=395 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.238+0000 7ff3a3a12640 1 -- 10.20.193.48:0/1123933035 >> 10.20.193.48:0/1123933035 conn(0x7ff39c0548a0 msgr2=0x7ff39c093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:54.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.238+0000 7ff3a3a12640 1 -- 10.20.193.48:0/1123933035 shutdown_connections 2026-02-12T18:14:54.258 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.238+0000 7ff3a3a12640 1 -- 10.20.193.48:0/1123933035 wait complete. 2026-02-12T18:14:54.258 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:14:54.258 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2026-02-12T18:14:54.258 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2026-02-12T18:14:54.323 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.322+0000 7f1c718cc640 10 monclient: get_monmap_and_config 2026-02-12T18:14:54.323 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.322+0000 7f1c718cc640 10 monclient: build_initial_monmap 2026-02-12T18:14:54.323 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.322+0000 7f1c718cc640 10 monclient: monmap: 2026-02-12T18:14:54.323 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:54.323 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.323 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:14:54.323155+0000 2026-02-12T18:14:54.323 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:14:54.323155+0000 2026-02-12T18:14:54.323 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:54.323 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.323 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:14:54.323 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:14:54.324 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:54.324 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:54.324 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:54.324 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:54.324 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:54.324 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:54.324 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:54.324 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:14:54.324 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:14:54.324 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.322+0000 7f1c718cc640 1 Processor -- start 2026-02-12T18:14:54.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.322+0000 7f1c718cc640 1 -- start start 2026-02-12T18:14:54.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.322+0000 7f1c718cc640 10 monclient: init 2026-02-12T18:14:54.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c718cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:54.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c718cc640 10 monclient: _add_conns ranks=[9,7,8,5,2,6,1,4,0,10,3] 2026-02-12T18:14:54.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c718cc640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f1c6c0951a0 0x7f1c6c093850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c718cc640 10 monclient(hunting): picked mon.noname-a con 0x7f1c6c0951a0 addr v2:10.20.193.48:3300/0 2026-02-12T18:14:54.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c718cc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1c6c096ad0 0x7f1c6c095570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c718cc640 10 monclient(hunting): picked mon.noname-i con 0x7f1c6c096ad0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:14:54.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c718cc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f1c6c095ab0 0x7f1c6c1a4ba0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c718cc640 10 monclient(hunting): picked mon.noname-e con 0x7f1c6c095ab0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:14:54.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c718cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c718cc640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f1c6c096900 con 0x7f1c6c0951a0 2026-02-12T18:14:54.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c718cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c718cc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f1c6c092260 con 0x7f1c6c096ad0 2026-02-12T18:14:54.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c718cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c718cc640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f1c6c093070 con 0x7f1c6c095ab0 2026-02-12T18:14:54.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c718cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:54.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c718cc640 10 monclient(hunting): authenticate will time out at 1133.049089s 2026-02-12T18:14:54.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6affd640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f1c6c0951a0 0x7f1c6c093850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6affd640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f1c6c0951a0 0x7f1c6c093850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:54142/0 (socket says 10.20.193.48:54142) 2026-02-12T18:14:54.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6affd640 1 -- 10.20.193.48:0/3921525771 learned_addr learned my addr 10.20.193.48:0/3921525771 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:54.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6affd640 10 monclient(hunting): get_auth_request con 0x7f1c6c0951a0 auth_method 0 2026-02-12T18:14:54.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6b7fe640 1 --2- 10.20.193.48:0/3921525771 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f1c6c095ab0 0x7f1c6c1a4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6b7fe640 10 monclient(hunting): get_auth_request con 0x7f1c6c095ab0 auth_method 0 2026-02-12T18:14:54.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6affd640 10 monclient(hunting): handle_auth_done global_id 6876 payload 274 2026-02-12T18:14:54.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6affd640 1 -- 10.20.193.48:0/3921525771 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f1c6c095ab0 msgr2=0x7f1c6c1a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:54.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6affd640 1 --2- 10.20.193.48:0/3921525771 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f1c6c095ab0 0x7f1c6c1a4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6affd640 1 -- 10.20.193.48:0/3921525771 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1c6c096ad0 msgr2=0x7f1c6c095570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:54.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6affd640 1 --2- 10.20.193.48:0/3921525771 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1c6c096ad0 0x7f1c6c095570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6affd640 10 monclient: _finish_hunting 0 2026-02-12T18:14:54.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6affd640 1 monclient: found mon.noname-a 2026-02-12T18:14:54.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:54.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6affd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:14:54.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.323+0000 7f1c6affd640 1 -- 10.20.193.48:0/3921525771 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c6c04dc20 con 0x7f1c6c0951a0 2026-02-12T18:14:54.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.325+0000 7f1c6affd640 1 -- 10.20.193.48:0/3921525771 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1c6c0951a0 msgr2=0x7f1c6c093850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.325+0000 7f1c6affd640 1 --2- 10.20.193.48:0/3921525771 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1c6c0951a0 0x7f1c6c093850 secure :-1 s=READY pgs=627 gs=1 cs=0 l=1 c_cookie=15829761022915498404 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c60009060 tx=0x7f1c6002edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbae9bc7da33d1a4 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.325+0000 7f1c69ffb640 1 -- 10.20.193.48:0/3921525771 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1c60035340 con 0x7f1c6c0951a0 2026-02-12T18:14:54.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.325+0000 7f1c69ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.325+0000 7f1c69ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:14:54.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.325+0000 7f1c69ffb640 10 monclient: dump: 2026-02-12T18:14:54.330 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.330 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.330 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.330 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.330 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.330 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.330 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.330 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.330 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.330 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.330 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.330 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.330 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.330 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.330 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.330 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.325+0000 7f1c69ffb640 10 monclient: _finish_auth 0 2026-02-12T18:14:54.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.325+0000 7f1c69ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:14:54.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.325+0000 7f1c69ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:54.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.326+0000 7f1c69ffb640 1 -- 10.20.193.48:0/3921525771 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c600354c0 con 0x7f1c6c0951a0 2026-02-12T18:14:54.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.326+0000 7f1c718cc640 5 monclient: authenticate success, global_id 6876 2026-02-12T18:14:54.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.326+0000 7f1c718cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:14:54.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.326+0000 7f1c69ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:54.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.326+0000 7f1c69ffb640 1 -- 10.20.193.48:0/3921525771 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1c60035af0 con 0x7f1c6c0951a0 2026-02-12T18:14:54.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.326+0000 7f1c718cc640 10 monclient: get_monmap_and_config success 2026-02-12T18:14:54.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.326+0000 7f1c718cc640 4 set_mon_vals no callback set 2026-02-12T18:14:54.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.326+0000 7f1c69ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.326+0000 7f1c69ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:14:54.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.326+0000 7f1c69ffb640 10 monclient: dump: 2026-02-12T18:14:54.331 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.331 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.331 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.331 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.331 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.331 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.331 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.331 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.331 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.331 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.331 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.331 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.331 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.331 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.331 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.331 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.326+0000 7f1c718cc640 10 monclient: shutdown 2026-02-12T18:14:54.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.326+0000 7f1c718cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:54.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.326+0000 7f1c718cc640 1 -- 10.20.193.48:0/3921525771 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1c6c0951a0 msgr2=0x7f1c6c093850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.326+0000 7f1c718cc640 1 --2- 10.20.193.48:0/3921525771 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1c6c0951a0 0x7f1c6c093850 secure :-1 s=READY pgs=627 gs=1 cs=0 l=1 c_cookie=15829761022915498404 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c60009060 tx=0x7f1c6002edf0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.326+0000 7f1c718cc640 1 -- 10.20.193.48:0/3921525771 shutdown_connections 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.326+0000 7f1c718cc640 1 --2- 10.20.193.48:0/3921525771 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f1c6c095ab0 0x7f1c6c1a4ba0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.326+0000 7f1c718cc640 1 --2- 10.20.193.48:0/3921525771 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1c6c096ad0 0x7f1c6c095570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.326+0000 7f1c718cc640 1 --2- 10.20.193.48:0/3921525771 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1c6c0951a0 0x7f1c6c093850 unknown :-1 s=CLOSED pgs=627 gs=1 cs=0 l=1 c_cookie=15829761022915498404 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.326+0000 7f1c718cc640 1 -- 10.20.193.48:0/3921525771 >> 10.20.193.48:0/3921525771 conn(0x7f1c6c0548c0 msgr2=0x7f1c6c0973a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.326+0000 7f1c718cc640 1 -- 10.20.193.48:0/3921525771 shutdown_connections 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.326+0000 7f1c718cc640 1 -- 10.20.193.48:0/3921525771 wait complete. 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c718cc640 10 monclient: build_initial_monmap 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c718cc640 10 monclient: monmap: 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c718cc640 1 Processor -- start 2026-02-12T18:14:54.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c718cc640 1 -- start start 2026-02-12T18:14:54.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c718cc640 10 monclient: init 2026-02-12T18:14:54.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c718cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:54.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c718cc640 10 monclient: _add_conns ranks=[0,6,4,5,7,3,1,2,8] 2026-02-12T18:14:54.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c718cc640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1c6c0951a0 0x7f1c6c19b0e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c718cc640 10 monclient(hunting): picked mon.noname-a con 0x7f1c6c0951a0 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:14:54.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c718cc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f1c6c095ab0 0x7f1c6c1d81f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c718cc640 10 monclient(hunting): picked mon.noname-d con 0x7f1c6c095ab0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:14:54.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c718cc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f1c6c096ad0 0x7f1c6c1b0f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c718cc640 10 monclient(hunting): picked mon.noname-c con 0x7f1c6c096ad0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:14:54.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c718cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c718cc640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6c090290 con 0x7f1c6c0951a0 2026-02-12T18:14:54.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c718cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c718cc640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f1c6c19ba00 con 0x7f1c6c096ad0 2026-02-12T18:14:54.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c718cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c718cc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f1c6c19a580 con 0x7f1c6c095ab0 2026-02-12T18:14:54.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c718cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:54.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c718cc640 10 monclient(hunting): authenticate will time out at 1133.053535s 2026-02-12T18:14:54.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6affd640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1c6c0951a0 0x7f1c6c19b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6affd640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1c6c0951a0 0x7f1c6c19b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:54154/0 (socket says 10.20.193.48:54154) 2026-02-12T18:14:54.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6affd640 1 -- 10.20.193.48:0/2917359233 learned_addr learned my addr 10.20.193.48:0/2917359233 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:54.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6affd640 10 monclient(hunting): get_auth_request con 0x7f1c6c0951a0 auth_method 0 2026-02-12T18:14:54.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6b7fe640 1 --2- 10.20.193.48:0/2917359233 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f1c6c096ad0 0x7f1c6c1b0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6b7fe640 10 monclient(hunting): get_auth_request con 0x7f1c6c096ad0 auth_method 0 2026-02-12T18:14:54.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6a7fc640 1 --2- 10.20.193.48:0/2917359233 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f1c6c095ab0 0x7f1c6c1d81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6affd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6affd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6affd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6a7fc640 10 monclient(hunting): get_auth_request con 0x7f1c6c095ab0 auth_method 0 2026-02-12T18:14:54.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6affd640 10 monclient(hunting): handle_auth_done global_id 6885 payload 824 2026-02-12T18:14:54.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6affd640 1 -- 10.20.193.48:0/2917359233 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f1c6c095ab0 msgr2=0x7f1c6c1d81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6affd640 1 --2- 10.20.193.48:0/2917359233 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f1c6c095ab0 0x7f1c6c1d81f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6affd640 1 -- 10.20.193.48:0/2917359233 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f1c6c096ad0 msgr2=0x7f1c6c1b0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6affd640 1 --2- 10.20.193.48:0/2917359233 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f1c6c096ad0 0x7f1c6c1b0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6affd640 10 monclient: _finish_hunting 0 2026-02-12T18:14:54.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6affd640 1 monclient: found mon.noname-a 2026-02-12T18:14:54.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:54.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6affd640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:14:54.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6affd640 1 -- 10.20.193.48:0/2917359233 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c600094f0 con 0x7f1c6c0951a0 2026-02-12T18:14:54.335 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.327+0000 7f1c6b7fe640 1 --2- 10.20.193.48:0/2917359233 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f1c6c096ad0 0x7f1c6c1b0f20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:14:54.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c6affd640 1 -- 10.20.193.48:0/2917359233 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1c6c0951a0 msgr2=0x7f1c6c19b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c6affd640 1 --2- 10.20.193.48:0/2917359233 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1c6c0951a0 0x7f1c6c19b0e0 secure :-1 s=READY pgs=628 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c60004740 tx=0x7f1c60004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c43fff640 1 -- 10.20.193.48:0/2917359233 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1c60035e00 con 0x7f1c6c0951a0 2026-02-12T18:14:54.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c43fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c43fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:14:54.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c43fff640 10 monclient: dump: 2026-02-12T18:14:54.337 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.337 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.337 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.337 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.337 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.337 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.337 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.337 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.337 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.337 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.337 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.337 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.337 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.337 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.337 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.337 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c43fff640 10 monclient: _finish_auth 0 2026-02-12T18:14:54.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c43fff640 10 monclient: _check_auth_tickets 2026-02-12T18:14:54.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c43fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:54.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c43fff640 1 -- 10.20.193.48:0/2917359233 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1c60037900 con 0x7f1c6c0951a0 2026-02-12T18:14:54.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c718cc640 5 monclient: authenticate success, global_id 6885 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c718cc640 10 monclient: _renew_subs 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c718cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c718cc640 1 -- 10.20.193.48:0/2917359233 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c6c19c8e0 con 0x7f1c6c0951a0 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c43fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c43fff640 1 -- 10.20.193.48:0/2917359233 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1c60040410 con 0x7f1c6c0951a0 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c43fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c697fa640 4 set_mon_vals no callback set 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c43fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c43fff640 10 monclient: dump: 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c718cc640 10 monclient: _renew_subs 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c718cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:14:54.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c718cc640 1 -- 10.20.193.48:0/2917359233 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c6c199f90 con 0x7f1c6c0951a0 2026-02-12T18:14:54.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c718cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:54.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c718cc640 1 --2- 10.20.193.48:0/2917359233 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f1c6c1b1460 0x7f1c6c1db1e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c718cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c718cc640 1 -- 10.20.193.48:0/2917359233 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6c063a20 con 0x7f1c6c1b1460 2026-02-12T18:14:54.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c43fff640 1 -- 10.20.193.48:0/2917359233 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f1c60046020 con 0x7f1c6c0951a0 2026-02-12T18:14:54.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c6a7fc640 1 --2- 10.20.193.48:0/2917359233 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f1c6c1b1460 0x7f1c6c1db1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c6a7fc640 10 monclient: get_auth_request con 0x7f1c6c1b1460 auth_method 0 2026-02-12T18:14:54.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c6a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c6a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.330+0000 7f1c6a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.331+0000 7f1c43fff640 1 --2- 10.20.193.48:0/2917359233 >> v2:10.20.193.111:6812/977811348 conn(0x7f1c3c03f7f0 0x7f1c3c05fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.331+0000 7f1c43fff640 1 -- 10.20.193.48:0/2917359233 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(319..319 src has 215..319) ==== 3897+0+0 (secure 0 0 0) 0x7f1c60077d90 con 0x7f1c6c0951a0 2026-02-12T18:14:54.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.331+0000 7f1c6a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.331+0000 7f1c6a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.331+0000 7f1c6a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.331+0000 7f1c6b7fe640 1 --2- 10.20.193.48:0/2917359233 >> v2:10.20.193.111:6812/977811348 conn(0x7f1c3c03f7f0 0x7f1c3c05fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.331+0000 7f1c6b7fe640 10 monclient: get_auth_request con 0x7f1c3c03f7f0 auth_method 0 2026-02-12T18:14:54.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.331+0000 7f1c6a7fc640 10 monclient(hunting): handle_auth_done global_id 94924 payload 824 2026-02-12T18:14:54.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.331+0000 7f1c6a7fc640 1 -- 10.20.193.48:0/2917359233 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c6c095f50 con 0x7f1c6c1b1460 2026-02-12T18:14:54.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.333+0000 7f1c6a7fc640 1 -- 10.20.193.48:0/2917359233 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f1c6c1b1460 msgr2=0x7f1c6c1db1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.333+0000 7f1c6a7fc640 1 --2- 10.20.193.48:0/2917359233 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f1c6c1b1460 0x7f1c6c1db1e0 secure :-1 s=READY pgs=158 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c6c19abf0 tx=0x7f1c540099d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.333+0000 7f1c6b7fe640 1 --2- 10.20.193.48:0/2917359233 >> v2:10.20.193.111:6812/977811348 conn(0x7f1c3c03f7f0 0x7f1c3c05fca0 secure :-1 s=READY pgs=456 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c6c19cdb0 tx=0x7f1c5c00a2d0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.333+0000 7f1c43fff640 1 -- 10.20.193.48:0/2917359233 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1c5400ee10 con 0x7f1c6c1b1460 2026-02-12T18:14:54.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.333+0000 7f1c43fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.333+0000 7f1c43fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:14:54.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.333+0000 7f1c43fff640 10 monclient: dump: 2026-02-12T18:14:54.340 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.340 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.340 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.340 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.340 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.340 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.340 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.340 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.340 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.340 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.340 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.340 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.340 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.340 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.340 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.340 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.334+0000 7f1c43fff640 1 -- 10.20.193.48:0/2917359233 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f1c5400e950 con 0x7f1c6c1b1460 2026-02-12T18:14:54.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.334+0000 7f1c43fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:54.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.334+0000 7f1c43fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:14:54.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.334+0000 7f1c43fff640 1 -- 10.20.193.48:0/2917359233 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f1c6c1b1460 msgr2=0x7f1c6c1db1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.334+0000 7f1c43fff640 1 --2- 10.20.193.48:0/2917359233 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f1c6c1b1460 0x7f1c6c1db1e0 secure :-1 s=READY pgs=158 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c6c19abf0 tx=0x7f1c540099d0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.334+0000 7f1c43fff640 1 -- 10.20.193.48:0/2917359233 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f1c6c1b1460 msgr2=0x7f1c6c1db1e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:54.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.334+0000 7f1c43fff640 1 --2- 10.20.193.48:0/2917359233 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f1c6c1b1460 0x7f1c6c1db1e0 secure :-1 s=CLOSED pgs=158 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c6c19abf0 tx=0x7f1c540099d0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.337+0000 7f1c718cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:14:54.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.337+0000 7f1c718cc640 1 --2- 10.20.193.48:0/2917359233 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f1c6c1db720 0x7f1c6c1dbaf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.337+0000 7f1c718cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.337+0000 7f1c718cc640 1 -- 10.20.193.48:0/2917359233 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f1c6c05f140 con 0x7f1c6c1db720 2026-02-12T18:14:54.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.337+0000 7f1c6a7fc640 1 --2- 10.20.193.48:0/2917359233 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f1c6c1db720 0x7f1c6c1dbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.337+0000 7f1c6a7fc640 10 monclient: get_auth_request con 0x7f1c6c1db720 auth_method 0 2026-02-12T18:14:54.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.337+0000 7f1c6a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.337+0000 7f1c6a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.337+0000 7f1c6a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.337+0000 7f1c6a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.337+0000 7f1c6a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.337+0000 7f1c6a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.337+0000 7f1c6a7fc640 10 monclient(hunting): handle_auth_done global_id 94933 payload 824 2026-02-12T18:14:54.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.337+0000 7f1c6a7fc640 1 -- 10.20.193.48:0/2917359233 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1c6c05dc10 con 0x7f1c6c1db720 2026-02-12T18:14:54.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.340+0000 7f1c6a7fc640 1 -- 10.20.193.48:0/2917359233 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f1c6c1db720 msgr2=0x7f1c6c1dbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.340+0000 7f1c6a7fc640 1 --2- 10.20.193.48:0/2917359233 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f1c6c1db720 0x7f1c6c1dbaf0 secure :-1 s=READY pgs=159 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c6c19abf0 tx=0x7f1c54004880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.340+0000 7f1c43fff640 1 -- 10.20.193.48:0/2917359233 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1c54022070 con 0x7f1c6c1db720 2026-02-12T18:14:54.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.340+0000 7f1c43fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.340+0000 7f1c43fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:14:54.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.340+0000 7f1c43fff640 10 monclient: dump: 2026-02-12T18:14:54.342 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.342 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.342 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.342 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.342 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.342 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.342 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.342 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.343 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.343 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.343 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.343 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.343 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.343 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.343 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.343 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.340+0000 7f1c43fff640 1 -- 10.20.193.48:0/2917359233 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10182 (secure 0 0 0) 0x7f1c54005e90 con 0x7f1c6c1db720 2026-02-12T18:14:54.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.340+0000 7f1c43fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:14:54.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.340+0000 7f1c43fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:14:54.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.340+0000 7f1c43fff640 1 -- 10.20.193.48:0/2917359233 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f1c6c1db720 msgr2=0x7f1c6c1dbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.340+0000 7f1c43fff640 1 --2- 10.20.193.48:0/2917359233 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f1c6c1db720 0x7f1c6c1dbaf0 secure :-1 s=READY pgs=159 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c6c19abf0 tx=0x7f1c54004880 comp rx=0 tx=0).stop 2026-02-12T18:14:54.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.340+0000 7f1c43fff640 1 -- 10.20.193.48:0/2917359233 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f1c6c1db720 msgr2=0x7f1c6c1dbaf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:54.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.340+0000 7f1c43fff640 1 --2- 10.20.193.48:0/2917359233 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f1c6c1db720 0x7f1c6c1dbaf0 secure :-1 s=CLOSED pgs=159 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c6c19abf0 tx=0x7f1c54004880 comp rx=0 tx=0).stop 2026-02-12T18:14:54.343 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:14:54.343 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:14:54.343 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:14:54.343 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:14:54.343 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 76, 2026-02-12T18:14:54.343 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 140013, 2026-02-12T18:14:54.343 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:14:54.344 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:14:54.344 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:14:54.344 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:14:54.344 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:14:54.344 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:14:54.344 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:14:54.344 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:14:54.344 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:14:54.344 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:14:54.344 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.344 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 8, 2026-02-12T18:14:54.344 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:54.344 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:14:54.344 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:14:54.344 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:54.344 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:54.344 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:54.344 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:54.344 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:54.344 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:54.344 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:54.344 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:54.344 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:54.344 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:54.344 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:54.344 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:54.345 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:54.345 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.345 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:14:54.345 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:14:54.345 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:54.345 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:54.345 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:54.345 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:54.345 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:54.345 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:54.345 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:54.345 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:54.345 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:54.345 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:54.345 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:54.345 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:54.345 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:54.345 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.345 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.345 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:14:54.345 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:14:54.345 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:14:54.345 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:14:54.345 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:14:54.345 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:14:54.345 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.346 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:14:54.347 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.347 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:14:54.347 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:14:54.347 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.347 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.347 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.347 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.347 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:14:54.347 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.347 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.347 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.347 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.347 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:14:54.347 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.347 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.347 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.347 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.347 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:14:54.347 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:14:54.347 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.347 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.347 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:14:54.347 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.347 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.347 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.347 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:14:54.348 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:14:54.348 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.348 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.348 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.348 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.348 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:14:54.348 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.348 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.348 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.348 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.348 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:14:54.348 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.348 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.348 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.348 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.348 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:14:54.348 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:14:54.348 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.348 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.348 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:14:54.348 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.348 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.348 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.348 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:14:54.348 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:14:54.348 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.349 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.349 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.349 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.349 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:14:54.349 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.349 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.349 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.349 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.349 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:14:54.349 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.349 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.349 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.349 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.349 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:14:54.349 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:14:54.349 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.349 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.349 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:14:54.349 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.349 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.349 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.349 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:14:54.349 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:14:54.349 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.349 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.349 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:14:54.350 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.351 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.352 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:14:54.352 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.352 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.352 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.352 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.352 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:14:54.352 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:14:54.352 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.352 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.352 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:14:54.352 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.352 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.352 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.352 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:14:54.352 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:14:54.352 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.352 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.352 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.352 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.352 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:14:54.352 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.352 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.352 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.352 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.352 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:14:54.352 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.353 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.353 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.353 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.353 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:14:54.353 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:14:54.353 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.353 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.353 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:54.353 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.353 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.353 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.353 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:14:54.353 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:14:54.353 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.353 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.353 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.353 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.353 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:14:54.353 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.353 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.353 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.353 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.353 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:14:54.353 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.354 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.354 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.354 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.354 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:14:54.354 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:14:54.354 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.354 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.354 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:14:54.354 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.354 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.354 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.354 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:14:54.354 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:14:54.354 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.354 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.354 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.354 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.354 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:14:54.354 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.354 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.354 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.354 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.354 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:14:54.354 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.354 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.354 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:14:54.355 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.356 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:54.356 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:54.356 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:14:54.356 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.356 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.356 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.356 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:14:54.356 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:14:54.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.340+0000 7f1c718cc640 1 -- 10.20.193.48:0/2917359233 >> v2:10.20.193.111:6812/977811348 conn(0x7f1c3c03f7f0 msgr2=0x7f1c3c05fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.340+0000 7f1c718cc640 1 --2- 10.20.193.48:0/2917359233 >> v2:10.20.193.111:6812/977811348 conn(0x7f1c3c03f7f0 0x7f1c3c05fca0 secure :-1 s=READY pgs=456 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c6c19cdb0 tx=0x7f1c5c00a2d0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.340+0000 7f1c718cc640 10 monclient: shutdown 2026-02-12T18:14:54.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.340+0000 7f1c718cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:54.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.340+0000 7f1c718cc640 1 -- 10.20.193.48:0/2917359233 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1c6c0951a0 msgr2=0x7f1c6c19b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.340+0000 7f1c718cc640 1 --2- 10.20.193.48:0/2917359233 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f1c6c0951a0 0x7f1c6c19b0e0 secure :-1 s=READY pgs=628 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f1c60004740 tx=0x7f1c60004770 comp rx=0 tx=0).stop 2026-02-12T18:14:54.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.340+0000 7f1c6b7fe640 1 -- 10.20.193.48:0/2917359233 reap_dead start 2026-02-12T18:14:54.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.340+0000 7f1c6b7fe640 1 -- 10.20.193.48:0/2917359233 reap_dead start 2026-02-12T18:14:54.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.340+0000 7f1c718cc640 1 -- 10.20.193.48:0/2917359233 shutdown_connections 2026-02-12T18:14:54.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.340+0000 7f1c718cc640 1 -- 10.20.193.48:0/2917359233 >> 10.20.193.48:0/2917359233 conn(0x7f1c6c0548c0 msgr2=0x7f1c6c08a790 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:54.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.340+0000 7f1c718cc640 1 -- 10.20.193.48:0/2917359233 shutdown_connections 2026-02-12T18:14:54.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.340+0000 7f1c718cc640 1 -- 10.20.193.48:0/2917359233 wait complete. 2026-02-12T18:14:54.357 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:14:54.357 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2026-02-12T18:14:54.357 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2026-02-12T18:14:54.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.422+0000 7f04b245b640 10 monclient: get_monmap_and_config 2026-02-12T18:14:54.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.422+0000 7f04b245b640 10 monclient: build_initial_monmap 2026-02-12T18:14:54.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.422+0000 7f04b245b640 10 monclient: monmap: 2026-02-12T18:14:54.424 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:54.424 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.424 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:14:54.423979+0000 2026-02-12T18:14:54.424 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:14:54.423979+0000 2026-02-12T18:14:54.424 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:54.424 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.424 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:14:54.424 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:14:54.424 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:54.424 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:54.424 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:54.424 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:54.424 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:54.424 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:54.425 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:54.425 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:14:54.425 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:14:54.425 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04b245b640 1 Processor -- start 2026-02-12T18:14:54.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04b245b640 1 -- start start 2026-02-12T18:14:54.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04b245b640 10 monclient: init 2026-02-12T18:14:54.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04b245b640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:54.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04b245b640 10 monclient: _add_conns ranks=[5,9,6,10,0,7,2,1,4,3,8] 2026-02-12T18:14:54.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04b245b640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f04ac08ffe0 0x7f04ac144770 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04b245b640 10 monclient(hunting): picked mon.noname-h con 0x7f04ac08ffe0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:14:54.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04b245b640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f04ac0903b0 0x7f04ac05d220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04b245b640 10 monclient(hunting): picked mon.noname-a con 0x7f04ac0903b0 addr v2:10.20.193.48:3300/0 2026-02-12T18:14:54.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04b245b640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f04ac0907c0 0x7f04ac05d760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04b245b640 10 monclient(hunting): picked mon.noname-d con 0x7f04ac0907c0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:14:54.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04b245b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04b245b640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f04ac054b00 con 0x7f04ac0903b0 2026-02-12T18:14:54.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04b245b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04b245b640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f04ac055150 con 0x7f04ac08ffe0 2026-02-12T18:14:54.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04b245b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04b245b640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f04ac08b1c0 con 0x7f04ac0907c0 2026-02-12T18:14:54.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04b245b640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:54.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04b245b640 10 monclient(hunting): authenticate will time out at 1133.149792s 2026-02-12T18:14:54.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04ab7fe640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f04ac0903b0 0x7f04ac05d220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04b09d1640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f04ac0907c0 0x7f04ac05d760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04ab7fe640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f04ac0903b0 0x7f04ac05d220 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:54166/0 (socket says 10.20.193.48:54166) 2026-02-12T18:14:54.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04ab7fe640 1 -- 10.20.193.48:0/3178271278 learned_addr learned my addr 10.20.193.48:0/3178271278 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:54.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04ab7fe640 10 monclient(hunting): get_auth_request con 0x7f04ac0903b0 auth_method 0 2026-02-12T18:14:54.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04ab7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04ab7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04ab7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04b09d1640 10 monclient(hunting): get_auth_request con 0x7f04ac0907c0 auth_method 0 2026-02-12T18:14:54.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04b09d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04b09d1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04b09d1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04abfff640 1 --2- 10.20.193.48:0/3178271278 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f04ac08ffe0 0x7f04ac144770 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04abfff640 10 monclient(hunting): get_auth_request con 0x7f04ac08ffe0 auth_method 0 2026-02-12T18:14:54.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04abfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04abfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04ab7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.423+0000 7f04ab7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.424+0000 7f04ab7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.424+0000 7f04b09d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.424+0000 7f04b09d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.424+0000 7f04b09d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.424+0000 7f04abfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.424+0000 7f04abfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.424+0000 7f04abfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.424+0000 7f04ab7fe640 10 monclient(hunting): handle_auth_done global_id 6894 payload 274 2026-02-12T18:14:54.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.424+0000 7f04ab7fe640 1 -- 10.20.193.48:0/3178271278 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f04ac0907c0 msgr2=0x7f04ac05d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:54.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.424+0000 7f04ab7fe640 1 --2- 10.20.193.48:0/3178271278 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f04ac0907c0 0x7f04ac05d760 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.424+0000 7f04ab7fe640 1 -- 10.20.193.48:0/3178271278 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f04ac08ffe0 msgr2=0x7f04ac144770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:54.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.424+0000 7f04ab7fe640 1 --2- 10.20.193.48:0/3178271278 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f04ac08ffe0 0x7f04ac144770 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.424+0000 7f04ab7fe640 10 monclient: _finish_hunting 0 2026-02-12T18:14:54.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.424+0000 7f04ab7fe640 1 monclient: found mon.noname-a 2026-02-12T18:14:54.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.424+0000 7f04ab7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:54.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.424+0000 7f04ab7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:14:54.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.424+0000 7f04ab7fe640 1 -- 10.20.193.48:0/3178271278 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04ac04dc20 con 0x7f04ac0903b0 2026-02-12T18:14:54.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.424+0000 7f04abfff640 1 --2- 10.20.193.48:0/3178271278 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f04ac08ffe0 0x7f04ac144770 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:14:54.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.424+0000 7f04b09d1640 1 --2- 10.20.193.48:0/3178271278 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f04ac0907c0 0x7f04ac05d760 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:14:54.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.426+0000 7f04ab7fe640 1 -- 10.20.193.48:0/3178271278 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f04ac0903b0 msgr2=0x7f04ac05d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.426+0000 7f04ab7fe640 1 --2- 10.20.193.48:0/3178271278 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f04ac0903b0 0x7f04ac05d220 secure :-1 s=READY pgs=629 gs=1 cs=0 l=1 c_cookie=17788648323738868770 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f049c0098d0 tx=0x7f049c02edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6ddf966f2cd9c22 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.426+0000 7f04aaffd640 1 -- 10.20.193.48:0/3178271278 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f049c035340 con 0x7f04ac0903b0 2026-02-12T18:14:54.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.426+0000 7f04aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.426+0000 7f04aaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:14:54.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.426+0000 7f04aaffd640 10 monclient: dump: 2026-02-12T18:14:54.432 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.432 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.432 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.432 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.432 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.432 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.432 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.432 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.432 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.432 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.432 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.432 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.432 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.432 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.432 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.432 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.426+0000 7f04aaffd640 10 monclient: _finish_auth 0 2026-02-12T18:14:54.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.426+0000 7f04aaffd640 10 monclient: _check_auth_tickets 2026-02-12T18:14:54.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.426+0000 7f04aaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:54.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.426+0000 7f04aaffd640 1 -- 10.20.193.48:0/3178271278 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f049c0354c0 con 0x7f04ac0903b0 2026-02-12T18:14:54.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.426+0000 7f04aaffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:54.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.426+0000 7f04aaffd640 1 -- 10.20.193.48:0/3178271278 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f049c035af0 con 0x7f04ac0903b0 2026-02-12T18:14:54.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.426+0000 7f04b245b640 5 monclient: authenticate success, global_id 6894 2026-02-12T18:14:54.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.426+0000 7f04b245b640 10 monclient: get_monmap_and_config success 2026-02-12T18:14:54.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.426+0000 7f04b245b640 4 set_mon_vals no callback set 2026-02-12T18:14:54.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.426+0000 7f04aaffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.426+0000 7f04aaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:14:54.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.426+0000 7f04aaffd640 10 monclient: dump: 2026-02-12T18:14:54.433 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.433 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.433 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.433 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.433 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.433 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.433 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.433 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.433 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.433 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.433 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.433 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.433 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.433 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.433 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.433 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.427+0000 7f04b245b640 10 monclient: shutdown 2026-02-12T18:14:54.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.427+0000 7f04b245b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:54.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.427+0000 7f04b245b640 1 -- 10.20.193.48:0/3178271278 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f04ac0903b0 msgr2=0x7f04ac05d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.427+0000 7f04b245b640 1 --2- 10.20.193.48:0/3178271278 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f04ac0903b0 0x7f04ac05d220 secure :-1 s=READY pgs=629 gs=1 cs=0 l=1 c_cookie=17788648323738868770 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f049c0098d0 tx=0x7f049c02edd0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.427+0000 7f04b245b640 1 -- 10.20.193.48:0/3178271278 shutdown_connections 2026-02-12T18:14:54.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.427+0000 7f04b245b640 1 --2- 10.20.193.48:0/3178271278 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f04ac0903b0 0x7f04ac05d220 unknown :-1 s=CLOSED pgs=629 gs=1 cs=0 l=1 c_cookie=17788648323738868770 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.427+0000 7f04b245b640 1 --2- 10.20.193.48:0/3178271278 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f04ac0907c0 0x7f04ac05d760 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.427+0000 7f04b245b640 1 --2- 10.20.193.48:0/3178271278 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f04ac08ffe0 0x7f04ac144770 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.427+0000 7f04b245b640 1 -- 10.20.193.48:0/3178271278 >> 10.20.193.48:0/3178271278 conn(0x7f04ac056d50 msgr2=0x7f04ac094120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:54.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.427+0000 7f04b245b640 1 -- 10.20.193.48:0/3178271278 shutdown_connections 2026-02-12T18:14:54.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.427+0000 7f04b245b640 1 -- 10.20.193.48:0/3178271278 wait complete. 2026-02-12T18:14:54.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.427+0000 7f04b245b640 10 monclient: build_initial_monmap 2026-02-12T18:14:54.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.427+0000 7f04b245b640 10 monclient: monmap: 2026-02-12T18:14:54.434 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:54.434 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:14:54.434 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:14:54.434 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:14:54.434 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:54.434 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.434 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:14:54.434 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:14:54.434 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:54.434 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:54.434 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:54.434 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:54.434 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:54.434 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:54.434 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:54.434 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b245b640 1 Processor -- start 2026-02-12T18:14:54.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b245b640 1 -- start start 2026-02-12T18:14:54.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b245b640 10 monclient: init 2026-02-12T18:14:54.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b245b640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:54.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b245b640 10 monclient: _add_conns ranks=[6,3,0,2,5,7,1,4,8] 2026-02-12T18:14:54.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b245b640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f04ac08ffe0 0x7f04ac12df40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b245b640 10 monclient(hunting): picked mon.noname-d con 0x7f04ac08ffe0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:14:54.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b245b640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f04ac0903b0 0x7f04ac13e0e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b245b640 10 monclient(hunting): picked mon.noname-g con 0x7f04ac0903b0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:14:54.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b245b640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f04ac0907c0 0x7f04ac13e620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b245b640 10 monclient(hunting): picked mon.noname-a con 0x7f04ac0907c0 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:14:54.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b245b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b245b640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f04ac10eab0 con 0x7f04ac0907c0 2026-02-12T18:14:54.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b245b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b245b640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f04ac10ed90 con 0x7f04ac0903b0 2026-02-12T18:14:54.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b245b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b245b640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f04ac10f070 con 0x7f04ac08ffe0 2026-02-12T18:14:54.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b245b640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:54.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b245b640 10 monclient(hunting): authenticate will time out at 1133.154379s 2026-02-12T18:14:54.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04abfff640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f04ac08ffe0 0x7f04ac12df40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b09d1640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f04ac0907c0 0x7f04ac13e620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04abfff640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f04ac08ffe0 0x7f04ac12df40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:52834/0 (socket says 10.20.193.48:52834) 2026-02-12T18:14:54.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b09d1640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f04ac0907c0 0x7f04ac13e620 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:54168/0 (socket says 10.20.193.48:54168) 2026-02-12T18:14:54.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04abfff640 1 -- 10.20.193.48:0/3227191377 learned_addr learned my addr 10.20.193.48:0/3227191377 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:54.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04abfff640 10 monclient(hunting): get_auth_request con 0x7f04ac08ffe0 auth_method 0 2026-02-12T18:14:54.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04abfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04abfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b09d1640 10 monclient(hunting): get_auth_request con 0x7f04ac0907c0 auth_method 0 2026-02-12T18:14:54.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b09d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b09d1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b09d1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04abfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04abfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04abfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b09d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b09d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b09d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04ab7fe640 1 --2- 10.20.193.48:0/3227191377 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f04ac0903b0 0x7f04ac13e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04ab7fe640 10 monclient(hunting): get_auth_request con 0x7f04ac0903b0 auth_method 0 2026-02-12T18:14:54.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04ab7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04ab7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04ab7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04ab7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04ab7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04ab7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b09d1640 10 monclient(hunting): handle_auth_done global_id 6903 payload 824 2026-02-12T18:14:54.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b09d1640 1 -- 10.20.193.48:0/3227191377 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f04ac08ffe0 msgr2=0x7f04ac12df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b09d1640 1 --2- 10.20.193.48:0/3227191377 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f04ac08ffe0 0x7f04ac12df40 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b09d1640 1 -- 10.20.193.48:0/3227191377 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f04ac0903b0 msgr2=0x7f04ac13e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b09d1640 1 --2- 10.20.193.48:0/3227191377 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f04ac0903b0 0x7f04ac13e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b09d1640 10 monclient: _finish_hunting 0 2026-02-12T18:14:54.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b09d1640 1 monclient: found mon.noname-a 2026-02-12T18:14:54.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b09d1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:54.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b09d1640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:14:54.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04b09d1640 1 -- 10.20.193.48:0/3227191377 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0498009420 con 0x7f04ac0907c0 2026-02-12T18:14:54.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.428+0000 7f04abfff640 1 --2- 10.20.193.48:0/3227191377 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f04ac08ffe0 0x7f04ac12df40 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:14:54.437 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:54.437 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32487]: starting. 2026-02-12T18:14:54.437 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32487]: creating pool ceph_test_rados_delete_pools_parallel.trial111-32452 2026-02-12T18:14:54.437 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32487]: created object 0... 2026-02-12T18:14:54.438 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32487]: created object 25... 2026-02-12T18:14:54.438 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32487]: created object 49... 2026-02-12T18:14:54.438 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32487]: finishing. 2026-02-12T18:14:54.438 INFO:teuthology.orchestra.run.trial111.stdout:process_3_[32487]: shutting down. 2026-02-12T18:14:54.440 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.430+0000 7f04b09d1640 1 -- 10.20.193.48:0/3227191377 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f04ac0907c0 msgr2=0x7f04ac13e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.440 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.430+0000 7f04b09d1640 1 --2- 10.20.193.48:0/3227191377 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f04ac0907c0 0x7f04ac13e620 secure :-1 s=READY pgs=630 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04a000fb30 tx=0x7f04a000ae70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.440 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04a8ff9640 1 -- 10.20.193.48:0/3227191377 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f04a000dd30 con 0x7f04ac0907c0 2026-02-12T18:14:54.440 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.440 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04a8ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:14:54.440 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04a8ff9640 10 monclient: dump: 2026-02-12T18:14:54.440 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.440 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.440 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.440 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.440 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.440 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.440 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.441 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.441 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.441 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.441 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.441 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.441 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.441 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.441 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.441 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04a8ff9640 10 monclient: _finish_auth 0 2026-02-12T18:14:54.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04b09d1640 1 --2- 10.20.193.48:0/3227191377 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f04ac0907c0 0x7f04ac13e620 secure :-1 s=READY pgs=630 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04a000fb30 tx=0x7f04a000ae70 comp rx=0 tx=0).queue_received will delay after 1.77092e+09 on 0x7f04a0005660 mon_map magic: 0 2026-02-12T18:14:54.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04a8ff9640 10 monclient: _check_auth_tickets 2026-02-12T18:14:54.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04a8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:54.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04a8ff9640 1 -- 10.20.193.48:0/3227191377 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04a00054f0 con 0x7f04ac0907c0 2026-02-12T18:14:54.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04b245b640 5 monclient: authenticate success, global_id 6903 2026-02-12T18:14:54.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04a8ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:54.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04b245b640 10 monclient: _renew_subs 2026-02-12T18:14:54.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04aa7fc640 4 set_mon_vals no callback set 2026-02-12T18:14:54.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04b245b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:14:54.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04b245b640 1 -- 10.20.193.48:0/3227191377 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a000a500 con 0x7f04ac0907c0 2026-02-12T18:14:54.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04b245b640 10 monclient: _renew_subs 2026-02-12T18:14:54.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04b245b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:14:54.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04b245b640 1 -- 10.20.193.48:0/3227191377 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f049c0094f0 con 0x7f04ac0907c0 2026-02-12T18:14:54.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04b245b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:54.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04b245b640 1 --2- 10.20.193.48:0/3227191377 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f04ac092020 0x7f04ac08c2b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04b245b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04b245b640 1 -- 10.20.193.48:0/3227191377 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f04ac0632e0 con 0x7f04ac092020 2026-02-12T18:14:54.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04abfff640 1 --2- 10.20.193.48:0/3227191377 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f04ac092020 0x7f04ac08c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04abfff640 10 monclient: get_auth_request con 0x7f04ac092020 auth_method 0 2026-02-12T18:14:54.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04abfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04abfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04a8ff9640 1 -- 10.20.193.48:0/3227191377 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f04a0005660 con 0x7f04ac0907c0 2026-02-12T18:14:54.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04a8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:14:54.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04a8ff9640 10 monclient: dump: 2026-02-12T18:14:54.442 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.442 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.442 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.442 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.442 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.442 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.442 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.442 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.442 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.442 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.442 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.443 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.443 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.443 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.443 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.443 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04abfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04abfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04a8ff9640 1 -- 10.20.193.48:0/3227191377 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f04a0012070 con 0x7f04ac0907c0 2026-02-12T18:14:54.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.431+0000 7f04abfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.432+0000 7f04abfff640 10 monclient(hunting): handle_auth_done global_id 104232 payload 824 2026-02-12T18:14:54.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.432+0000 7f04a8ff9640 1 --2- 10.20.193.48:0/3227191377 >> v2:10.20.193.111:6812/977811348 conn(0x7f047c03f840 0x7f047c05fcf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.432+0000 7f04abfff640 1 -- 10.20.193.48:0/3227191377 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f04ac10ef00 con 0x7f04ac092020 2026-02-12T18:14:54.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.432+0000 7f04ab7fe640 1 --2- 10.20.193.48:0/3227191377 >> v2:10.20.193.111:6812/977811348 conn(0x7f047c03f840 0x7f047c05fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.432+0000 7f04ab7fe640 10 monclient: get_auth_request con 0x7f047c03f840 auth_method 0 2026-02-12T18:14:54.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.434+0000 7f04abfff640 1 -- 10.20.193.48:0/3227191377 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f04ac092020 msgr2=0x7f04ac08c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.434+0000 7f04abfff640 1 --2- 10.20.193.48:0/3227191377 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f04ac092020 0x7f04ac08c2b0 secure :-1 s=READY pgs=15 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04980096d0 tx=0x7f049800f910 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.434+0000 7f04a8ff9640 1 -- 10.20.193.48:0/3227191377 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f049801d400 con 0x7f04ac092020 2026-02-12T18:14:54.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.434+0000 7f04a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.434+0000 7f04a8ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:14:54.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.434+0000 7f04a8ff9640 10 monclient: dump: 2026-02-12T18:14:54.443 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.443 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.443 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.443 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.444 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.444 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.444 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.444 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.444 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.444 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.444 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.444 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.444 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.444 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.444 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.444 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.434+0000 7f04ab7fe640 1 --2- 10.20.193.48:0/3227191377 >> v2:10.20.193.111:6812/977811348 conn(0x7f047c03f840 0x7f047c05fcf0 secure :-1 s=READY pgs=457 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f049c009820 tx=0x7f049c039040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.434+0000 7f04a8ff9640 1 -- 10.20.193.48:0/3227191377 <== mon.3 v2:10.20.193.111:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f0498014a00 con 0x7f04ac092020 2026-02-12T18:14:54.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.434+0000 7f04a8ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:54.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.434+0000 7f04a8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:14:54.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.434+0000 7f04a8ff9640 1 -- 10.20.193.48:0/3227191377 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f04ac092020 msgr2=0x7f04ac08c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.434+0000 7f04a8ff9640 1 --2- 10.20.193.48:0/3227191377 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f04ac092020 0x7f04ac08c2b0 secure :-1 s=READY pgs=15 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04980096d0 tx=0x7f049800f910 comp rx=0 tx=0).stop 2026-02-12T18:14:54.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.434+0000 7f04a8ff9640 1 -- 10.20.193.48:0/3227191377 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f04ac092020 msgr2=0x7f04ac08c2b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:54.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.434+0000 7f04a8ff9640 1 --2- 10.20.193.48:0/3227191377 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f04ac092020 0x7f04ac08c2b0 secure :-1 s=CLOSED pgs=15 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04980096d0 tx=0x7f049800f910 comp rx=0 tx=0).stop 2026-02-12T18:14:54.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.438+0000 7f04b245b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:14:54.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.438+0000 7f04b245b640 1 --2- 10.20.193.48:0/3227191377 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f04ac08c7f0 0x7f04ac08cbf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.438+0000 7f04b245b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.438+0000 7f04b245b640 1 -- 10.20.193.48:0/3227191377 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f04ac050410 con 0x7f04ac08c7f0 2026-02-12T18:14:54.445 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.438+0000 7f04abfff640 1 --2- 10.20.193.48:0/3227191377 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f04ac08c7f0 0x7f04ac08cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.445 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.438+0000 7f04abfff640 10 monclient: get_auth_request con 0x7f04ac08c7f0 auth_method 0 2026-02-12T18:14:54.445 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.438+0000 7f04abfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.445 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.438+0000 7f04abfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.445 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.438+0000 7f04abfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.445 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.438+0000 7f04abfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.445 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.438+0000 7f04abfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.445 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.438+0000 7f04abfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.445 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.438+0000 7f04abfff640 10 monclient(hunting): handle_auth_done global_id 104241 payload 824 2026-02-12T18:14:54.445 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.438+0000 7f04abfff640 1 -- 10.20.193.48:0/3227191377 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f04ac08a1c0 con 0x7f04ac08c7f0 2026-02-12T18:14:54.445 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.440+0000 7f04abfff640 1 -- 10.20.193.48:0/3227191377 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f04ac08c7f0 msgr2=0x7f04ac08cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.445 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.440+0000 7f04abfff640 1 --2- 10.20.193.48:0/3227191377 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f04ac08c7f0 0x7f04ac08cbf0 secure :-1 s=READY pgs=16 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04980096d0 tx=0x7f0498004770 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.446 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.441+0000 7f04a8ff9640 1 -- 10.20.193.48:0/3227191377 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f04980034f0 con 0x7f04ac08c7f0 2026-02-12T18:14:54.446 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.441+0000 7f04a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.446 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.441+0000 7f04a8ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:14:54.446 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.441+0000 7f04a8ff9640 10 monclient: dump: 2026-02-12T18:14:54.446 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.446 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.446 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.446 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.446 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.446 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.446 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.446 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.446 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.446 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.446 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.446 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.446 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.446 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.446 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.446 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.446 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.441+0000 7f04a8ff9640 1 -- 10.20.193.48:0/3227191377 <== mon.3 v2:10.20.193.111:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7f0498022770 con 0x7f04ac08c7f0 2026-02-12T18:14:54.446 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.441+0000 7f04a8ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:14:54.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.441+0000 7f04a8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:14:54.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.441+0000 7f04a8ff9640 1 -- 10.20.193.48:0/3227191377 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f04ac08c7f0 msgr2=0x7f04ac08cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.441+0000 7f04a8ff9640 1 --2- 10.20.193.48:0/3227191377 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f04ac08c7f0 0x7f04ac08cbf0 secure :-1 s=READY pgs=16 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04980096d0 tx=0x7f0498004770 comp rx=0 tx=0).stop 2026-02-12T18:14:54.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.441+0000 7f04a8ff9640 1 -- 10.20.193.48:0/3227191377 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f04ac08c7f0 msgr2=0x7f04ac08cbf0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:54.447 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.441+0000 7f04a8ff9640 1 --2- 10.20.193.48:0/3227191377 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f04ac08c7f0 0x7f04ac08cbf0 secure :-1 s=CLOSED pgs=16 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04980096d0 tx=0x7f0498004770 comp rx=0 tx=0).stop 2026-02-12T18:14:54.447 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:14:54.447 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:14:54.447 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:14:54.447 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:14:54.447 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 76, 2026-02-12T18:14:54.447 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 13434, 2026-02-12T18:14:54.447 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:14:54.447 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:14:54.447 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:14:54.447 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:14:54.447 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:14:54.447 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:14:54.447 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:14:54.447 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:14:54.448 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:14:54.448 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:14:54.448 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.448 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 8, 2026-02-12T18:14:54.448 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:54.448 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:14:54.448 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:14:54.448 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:54.448 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:54.448 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:54.448 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:54.448 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:54.448 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:54.448 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:54.448 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:54.448 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:54.448 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:54.448 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:54.448 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:54.448 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:54.448 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.448 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:14:54.448 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:14:54.448 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:54.449 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:54.449 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:54.449 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:54.449 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:54.449 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:54.449 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:54.449 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:54.449 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:54.449 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:54.449 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:54.449 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:54.449 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:54.449 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.449 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.449 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:14:54.449 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:14:54.449 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:14:54.449 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:14:54.449 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:14:54.449 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:14:54.449 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:54.449 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:54.449 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:14:54.449 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:14:54.449 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:14:54.450 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:14:54.450 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:14:54.450 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:14:54.450 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:14:54.450 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:54.450 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:14:54.450 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:54.450 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:54.450 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:54.450 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:54.450 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:54.450 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:54.450 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:54.450 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:54.450 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:54.450 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:54.450 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:54.450 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:54.450 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:54.450 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.450 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:14:54.450 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.450 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:14:54.450 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.450 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:14:54.450 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:14:54.451 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.451 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.451 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.451 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.451 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:14:54.451 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.451 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.451 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.451 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.451 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:14:54.451 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.451 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.451 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.451 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.451 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:14:54.451 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:14:54.451 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.451 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.451 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:14:54.451 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.451 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.451 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.451 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:14:54.451 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:14:54.451 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.452 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.452 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.452 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.452 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:14:54.452 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.452 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.452 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.452 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.452 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:14:54.452 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.452 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.452 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.452 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.452 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:14:54.452 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:14:54.452 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.452 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.452 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:14:54.452 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.452 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.452 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.452 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:14:54.452 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:14:54.452 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.452 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.453 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.453 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.453 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:14:54.453 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.453 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.453 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.453 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.453 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:14:54.453 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.453 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.453 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.453 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.453 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:14:54.453 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:14:54.453 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.453 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.453 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:14:54.453 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.453 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.453 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.453 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:14:54.453 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:14:54.453 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.453 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.454 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.454 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.454 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:14:54.454 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.454 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.454 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.454 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.454 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:14:54.454 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.454 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.454 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.454 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.454 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:14:54.454 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:14:54.454 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.454 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.454 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:14:54.454 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.454 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.454 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.454 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:14:54.454 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:14:54.454 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.454 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.454 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.455 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.455 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:14:54.455 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.455 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.455 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.455 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.455 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:14:54.455 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.455 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.455 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.455 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.455 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:14:54.455 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:14:54.455 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.455 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.455 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:54.455 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.455 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.455 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.455 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:14:54.455 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:14:54.455 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.455 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.455 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.455 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.456 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.457 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.457 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.457 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:14:54.457 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.457 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.457 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.457 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.457 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:14:54.457 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:14:54.457 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.457 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.457 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:54.457 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.457 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.457 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.457 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:14:54.457 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:14:54.457 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.457 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.457 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.457 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.457 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:14:54.457 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.457 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.457 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.457 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.458 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.459 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:14:54.460 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:14:54.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.441+0000 7f04b245b640 1 -- 10.20.193.48:0/3227191377 >> v2:10.20.193.111:6812/977811348 conn(0x7f047c03f840 msgr2=0x7f047c05fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.441+0000 7f04b245b640 1 --2- 10.20.193.48:0/3227191377 >> v2:10.20.193.111:6812/977811348 conn(0x7f047c03f840 0x7f047c05fcf0 secure :-1 s=READY pgs=457 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f049c009820 tx=0x7f049c039040 comp rx=0 tx=0).stop 2026-02-12T18:14:54.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.441+0000 7f04b245b640 10 monclient: shutdown 2026-02-12T18:14:54.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.441+0000 7f04b245b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:54.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.441+0000 7f04b245b640 1 -- 10.20.193.48:0/3227191377 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f04ac0907c0 msgr2=0x7f04ac13e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.441+0000 7f04b245b640 1 --2- 10.20.193.48:0/3227191377 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f04ac0907c0 0x7f04ac13e620 secure :-1 s=READY pgs=630 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f04a000fb30 tx=0x7f04a000ae70 comp rx=0 tx=0).stop 2026-02-12T18:14:54.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.441+0000 7f04b09d1640 1 -- 10.20.193.48:0/3227191377 reap_dead start 2026-02-12T18:14:54.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.441+0000 7f04b09d1640 1 -- 10.20.193.48:0/3227191377 reap_dead start 2026-02-12T18:14:54.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.441+0000 7f04a8ff9640 1 -- 10.20.193.48:0/3227191377 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(320..320 src has 215..320) ==== 3897+0+0 (unknown 0 0 0) 0x7f04a00542b0 con 0x7f04ac0907c0 2026-02-12T18:14:54.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.441+0000 7f04b245b640 1 -- 10.20.193.48:0/3227191377 shutdown_connections 2026-02-12T18:14:54.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.441+0000 7f04b245b640 1 -- 10.20.193.48:0/3227191377 >> 10.20.193.48:0/3227191377 conn(0x7f04ac056d50 msgr2=0x7f04ac1444d0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:54.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.441+0000 7f04b245b640 1 -- 10.20.193.48:0/3227191377 shutdown_connections 2026-02-12T18:14:54.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.441+0000 7f04b245b640 1 -- 10.20.193.48:0/3227191377 wait complete. 2026-02-12T18:14:54.461 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:14:54.461 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2026-02-12T18:14:54.461 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2026-02-12T18:14:54.462 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:14:54.462 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[32489]: starting. 2026-02-12T18:14:54.462 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[32489]: listing objects. 2026-02-12T18:14:54.462 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[32489]: listed object 0... 2026-02-12T18:14:54.462 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[32489]: listed object 25... 2026-02-12T18:14:54.462 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[32489]: saw 50 objects 2026-02-12T18:14:54.462 INFO:teuthology.orchestra.run.trial111.stdout:process_5_[32489]: shutting down. 2026-02-12T18:14:54.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.526+0000 7f944e0cc640 10 monclient: get_monmap_and_config 2026-02-12T18:14:54.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.526+0000 7f944e0cc640 10 monclient: build_initial_monmap 2026-02-12T18:14:54.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.526+0000 7f944e0cc640 10 monclient: monmap: 2026-02-12T18:14:54.527 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:54.527 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.527 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:14:54.527434+0000 2026-02-12T18:14:54.528 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:14:54.527434+0000 2026-02-12T18:14:54.528 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:54.528 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.528 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:14:54.528 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:14:54.528 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:54.528 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:54.528 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:54.528 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:54.528 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:54.528 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:54.528 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:54.528 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:14:54.528 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:14:54.528 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.526+0000 7f944e0cc640 1 Processor -- start 2026-02-12T18:14:54.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.526+0000 7f944e0cc640 1 -- start start 2026-02-12T18:14:54.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.526+0000 7f944e0cc640 10 monclient: init 2026-02-12T18:14:54.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f944e0cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:54.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f944e0cc640 10 monclient: _add_conns ranks=[4,2,7,1,8,9,6,10,0,5,3] 2026-02-12T18:14:54.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f944e0cc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f944805dc40 0x7f944805e010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f944e0cc640 10 monclient(hunting): picked mon.noname-c con 0x7f944805dc40 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:14:54.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f944e0cc640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9448140f30 0x7f9448089df0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f944e0cc640 10 monclient(hunting): picked mon.noname-b con 0x7f9448140f30 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:14:54.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f944e0cc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f9448141360 0x7f944808a330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f944e0cc640 10 monclient(hunting): picked mon.noname-i con 0x7f9448141360 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:14:54.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f944e0cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f944e0cc640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f9448093d10 con 0x7f9448140f30 2026-02-12T18:14:54.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f944e0cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f944e0cc640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f9448141cf0 con 0x7f944805dc40 2026-02-12T18:14:54.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f944e0cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f944e0cc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f9448093470 con 0x7f9448141360 2026-02-12T18:14:54.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f944e0cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:54.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f944e0cc640 10 monclient(hunting): authenticate will time out at 1133.253133s 2026-02-12T18:14:54.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f94477fe640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f944805dc40 0x7f944805e010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f9446ffd640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9448140f30 0x7f9448089df0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f94477fe640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f944805dc40 0x7f944805e010 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:58308/0 (socket says 10.20.193.48:58308) 2026-02-12T18:14:54.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f94477fe640 1 -- 10.20.193.48:0/562978400 learned_addr learned my addr 10.20.193.48:0/562978400 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:54.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f94477fe640 10 monclient(hunting): get_auth_request con 0x7f944805dc40 auth_method 0 2026-02-12T18:14:54.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f94477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f94477fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f94477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f9446ffd640 10 monclient(hunting): get_auth_request con 0x7f9448140f30 auth_method 0 2026-02-12T18:14:54.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f9446ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f9446ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f9446ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f94477fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f94477fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f94477fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f9446ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f9446ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f9446ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f9447fff640 1 --2- 10.20.193.48:0/562978400 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f9448141360 0x7f944808a330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f94477fe640 10 monclient(hunting): handle_auth_done global_id 65173 payload 274 2026-02-12T18:14:54.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f94477fe640 1 -- 10.20.193.48:0/562978400 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f9448141360 msgr2=0x7f944808a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:54.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f94477fe640 1 --2- 10.20.193.48:0/562978400 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f9448141360 0x7f944808a330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f94477fe640 1 -- 10.20.193.48:0/562978400 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9448140f30 msgr2=0x7f9448089df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:54.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f94477fe640 1 --2- 10.20.193.48:0/562978400 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9448140f30 0x7f9448089df0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f94477fe640 10 monclient: _finish_hunting 0 2026-02-12T18:14:54.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f94477fe640 1 monclient: found mon.noname-c 2026-02-12T18:14:54.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f94477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:54.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f94477fe640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:14:54.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f94477fe640 1 -- 10.20.193.48:0/562978400 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f944804dc20 con 0x7f944805dc40 2026-02-12T18:14:54.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f9447fff640 10 monclient: get_auth_request con 0x7f9448141360 auth_method 0 2026-02-12T18:14:54.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.527+0000 7f9447fff640 1 --2- 10.20.193.48:0/562978400 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f9448141360 0x7f944808a330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-12T18:14:54.533 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.529+0000 7f94477fe640 1 -- 10.20.193.48:0/562978400 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f944805dc40 msgr2=0x7f944805e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f94477fe640 1 --2- 10.20.193.48:0/562978400 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f944805dc40 0x7f944805e010 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=2157225400343537461 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94340098d0 tx=0x7f943402ee20 comp rx=0 tx=0).ready entity=mon.4 client_cookie=1df0011277ed2735 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f94467fc640 1 -- 10.20.193.48:0/562978400 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9434035340 con 0x7f944805dc40 2026-02-12T18:14:54.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f94467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f94467fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:14:54.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f94467fc640 10 monclient: dump: 2026-02-12T18:14:54.534 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.534 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.534 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.534 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.534 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.534 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.534 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.534 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.534 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.534 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.534 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.534 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.534 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.534 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.534 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.534 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f94467fc640 10 monclient: _finish_auth 0 2026-02-12T18:14:54.534 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f94467fc640 10 monclient: _check_auth_tickets 2026-02-12T18:14:54.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f94467fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:54.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f94467fc640 1 -- 10.20.193.48:0/562978400 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94340354c0 con 0x7f944805dc40 2026-02-12T18:14:54.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f94467fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:54.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f94467fc640 1 -- 10.20.193.48:0/562978400 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9434035af0 con 0x7f944805dc40 2026-02-12T18:14:54.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f94467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f94467fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:14:54.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f94467fc640 10 monclient: dump: 2026-02-12T18:14:54.535 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.535 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.535 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.535 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.535 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.535 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.535 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.535 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.535 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.535 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.535 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.535 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.535 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.535 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.535 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.535 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f944e0cc640 5 monclient: authenticate success, global_id 65173 2026-02-12T18:14:54.535 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f944e0cc640 10 monclient: get_monmap_and_config success 2026-02-12T18:14:54.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f944e0cc640 4 set_mon_vals no callback set 2026-02-12T18:14:54.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f944e0cc640 10 monclient: shutdown 2026-02-12T18:14:54.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f944e0cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:54.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f944e0cc640 1 -- 10.20.193.48:0/562978400 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f944805dc40 msgr2=0x7f944805e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f944e0cc640 1 --2- 10.20.193.48:0/562978400 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f944805dc40 0x7f944805e010 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=2157225400343537461 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94340098d0 tx=0x7f943402ee20 comp rx=0 tx=0).stop 2026-02-12T18:14:54.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f944e0cc640 1 -- 10.20.193.48:0/562978400 shutdown_connections 2026-02-12T18:14:54.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f944e0cc640 1 --2- 10.20.193.48:0/562978400 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f9448141360 0x7f944808a330 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f944e0cc640 1 --2- 10.20.193.48:0/562978400 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9448140f30 0x7f9448089df0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f944e0cc640 1 --2- 10.20.193.48:0/562978400 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f944805dc40 0x7f944805e010 unknown :-1 s=CLOSED pgs=209 gs=1 cs=0 l=1 c_cookie=2157225400343537461 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f944e0cc640 1 -- 10.20.193.48:0/562978400 >> 10.20.193.48:0/562978400 conn(0x7f9448097d10 msgr2=0x7f9448094010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:54.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f944e0cc640 1 -- 10.20.193.48:0/562978400 shutdown_connections 2026-02-12T18:14:54.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.530+0000 7f944e0cc640 1 -- 10.20.193.48:0/562978400 wait complete. 2026-02-12T18:14:54.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f944e0cc640 10 monclient: build_initial_monmap 2026-02-12T18:14:54.536 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f944e0cc640 10 monclient: monmap: 2026-02-12T18:14:54.536 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:54.536 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:14:54.536 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:14:54.536 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:14:54.536 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:54.536 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.536 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:14:54.536 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:14:54.536 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:54.536 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:54.536 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:54.536 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:54.537 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:54.537 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:54.537 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:54.537 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f944e0cc640 1 Processor -- start 2026-02-12T18:14:54.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f944e0cc640 1 -- start start 2026-02-12T18:14:54.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f944e0cc640 10 monclient: init 2026-02-12T18:14:54.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f944e0cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:54.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f944e0cc640 10 monclient: _add_conns ranks=[1,7,8,4,2,0,3,6,5] 2026-02-12T18:14:54.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f944e0cc640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f944805dc40 0x7f94481db170 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f944e0cc640 10 monclient(hunting): picked mon.noname-f con 0x7f944805dc40 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:14:54.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f944e0cc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f9448140f30 0x7f9448140020 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f944e0cc640 10 monclient(hunting): picked mon.noname-i con 0x7f9448140f30 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:14:54.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f944e0cc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9448141360 0x7f9448140560 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f944e0cc640 10 monclient(hunting): picked mon.noname-e con 0x7f9448141360 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:14:54.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f944e0cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f944e0cc640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f9448133360 con 0x7f944805dc40 2026-02-12T18:14:54.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f944e0cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f944e0cc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f94481db6b0 con 0x7f9448140f30 2026-02-12T18:14:54.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f944e0cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f944e0cc640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f9448056810 con 0x7f9448141360 2026-02-12T18:14:54.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f944e0cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:54.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f944e0cc640 10 monclient(hunting): authenticate will time out at 1133.257763s 2026-02-12T18:14:54.537 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f9447fff640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9448141360 0x7f9448140560 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f9447fff640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9448141360 0x7f9448140560 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:59710/0 (socket says 10.20.193.48:59710) 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f9447fff640 1 -- 10.20.193.48:0/3216877054 learned_addr learned my addr 10.20.193.48:0/3216877054 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f9447fff640 10 monclient(hunting): get_auth_request con 0x7f9448141360 auth_method 0 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f9447fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f9447fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f9447fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f9446ffd640 1 --2- 10.20.193.48:0/3216877054 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f9448140f30 0x7f9448140020 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f9447fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f9447fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f94477fe640 1 --2- 10.20.193.48:0/3216877054 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f944805dc40 0x7f94481db170 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f9447fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f9446ffd640 10 monclient(hunting): get_auth_request con 0x7f9448140f30 auth_method 0 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f9446ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f9446ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.531+0000 7f9446ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.532+0000 7f94477fe640 10 monclient(hunting): get_auth_request con 0x7f944805dc40 auth_method 0 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.532+0000 7f94477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.532+0000 7f94477fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.532+0000 7f94477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.532+0000 7f9446ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.532+0000 7f9446ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.532+0000 7f9446ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.532+0000 7f9447fff640 10 monclient(hunting): handle_auth_done global_id 94850 payload 824 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.532+0000 7f9447fff640 1 -- 10.20.193.48:0/3216877054 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f9448140f30 msgr2=0x7f9448140020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.532+0000 7f9447fff640 1 --2- 10.20.193.48:0/3216877054 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f9448140f30 0x7f9448140020 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.532+0000 7f9447fff640 1 -- 10.20.193.48:0/3216877054 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f944805dc40 msgr2=0x7f94481db170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.538 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.532+0000 7f9447fff640 1 --2- 10.20.193.48:0/3216877054 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f944805dc40 0x7f94481db170 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.532+0000 7f9447fff640 10 monclient: _finish_hunting 0 2026-02-12T18:14:54.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.532+0000 7f9447fff640 1 monclient: found mon.noname-e 2026-02-12T18:14:54.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.532+0000 7f9447fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:54.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.532+0000 7f9447fff640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:14:54.539 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.532+0000 7f9447fff640 1 -- 10.20.193.48:0/3216877054 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94340094f0 con 0x7f9448141360 2026-02-12T18:14:54.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.534+0000 7f9447fff640 1 -- 10.20.193.48:0/3216877054 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9448141360 msgr2=0x7f9448140560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.534+0000 7f9447fff640 1 --2- 10.20.193.48:0/3216877054 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9448141360 0x7f9448140560 secure :-1 s=READY pgs=129 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f943c00d740 tx=0x7f943c00dc10 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.534+0000 7f9423fff640 1 -- 10.20.193.48:0/3216877054 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f943c00de70 con 0x7f9448141360 2026-02-12T18:14:54.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.534+0000 7f9423fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.534+0000 7f9423fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:14:54.541 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.534+0000 7f9423fff640 10 monclient: dump: 2026-02-12T18:14:54.541 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.541 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.541 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.541 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.541 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.541 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.541 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.541 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.541 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.541 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.541 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.541 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.541 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.541 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.541 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.541 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.534+0000 7f9423fff640 10 monclient: _finish_auth 0 2026-02-12T18:14:54.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.534+0000 7f9423fff640 10 monclient: _check_auth_tickets 2026-02-12T18:14:54.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.534+0000 7f9423fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:54.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.534+0000 7f944e0cc640 5 monclient: authenticate success, global_id 94850 2026-02-12T18:14:54.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.534+0000 7f9423fff640 1 -- 10.20.193.48:0/3216877054 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f943c0123f0 con 0x7f9448141360 2026-02-12T18:14:54.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.534+0000 7f9423fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:54.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.534+0000 7f9423fff640 1 -- 10.20.193.48:0/3216877054 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f943c012a20 con 0x7f9448141360 2026-02-12T18:14:54.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.534+0000 7f9423fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.534+0000 7f9445ffb640 4 set_mon_vals no callback set 2026-02-12T18:14:54.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.534+0000 7f9423fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:14:54.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.534+0000 7f9423fff640 10 monclient: dump: 2026-02-12T18:14:54.542 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.542 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.542 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.542 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.542 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.542 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.542 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.542 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.542 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.542 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.542 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.542 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.542 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.542 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.542 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.543 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.534+0000 7f944e0cc640 10 monclient: _renew_subs 2026-02-12T18:14:54.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.534+0000 7f944e0cc640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:14:54.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.534+0000 7f944e0cc640 1 -- 10.20.193.48:0/3216877054 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9448090b80 con 0x7f9448141360 2026-02-12T18:14:54.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.534+0000 7f944e0cc640 10 monclient: _renew_subs 2026-02-12T18:14:54.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.534+0000 7f944e0cc640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:14:54.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.534+0000 7f944e0cc640 1 -- 10.20.193.48:0/3216877054 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f9448133830 con 0x7f9448141360 2026-02-12T18:14:54.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.535+0000 7f944e0cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:54.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.535+0000 7f944e0cc640 1 --2- 10.20.193.48:0/3216877054 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9448095410 0x7f94481346d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.535+0000 7f944e0cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.535+0000 7f944e0cc640 1 -- 10.20.193.48:0/3216877054 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f944805f140 con 0x7f9448095410 2026-02-12T18:14:54.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.535+0000 7f9447fff640 1 --2- 10.20.193.48:0/3216877054 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9448141360 0x7f9448140560 secure :-1 s=READY pgs=129 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f943c00d740 tx=0x7f943c00dc10 comp rx=0 tx=0).queue_received will delay after 1.77092e+09 on 0x7f943c053900 osd_map(320..320 src has 215..320) 2026-02-12T18:14:54.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.535+0000 7f9423fff640 1 -- 10.20.193.48:0/3216877054 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f943c021020 con 0x7f9448141360 2026-02-12T18:14:54.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.535+0000 7f94477fe640 1 --2- 10.20.193.48:0/3216877054 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9448095410 0x7f94481346d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.535+0000 7f94477fe640 10 monclient: get_auth_request con 0x7f9448095410 auth_method 0 2026-02-12T18:14:54.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.535+0000 7f94477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.535+0000 7f94477fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.535+0000 7f94477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.535+0000 7f94477fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.535+0000 7f94477fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.535+0000 7f94477fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.535+0000 7f9423fff640 1 --2- 10.20.193.48:0/3216877054 >> v2:10.20.193.111:6812/977811348 conn(0x7f941803f800 0x7f941805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.535+0000 7f94477fe640 10 monclient(hunting): handle_auth_done global_id 104225 payload 824 2026-02-12T18:14:54.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.535+0000 7f94477fe640 1 -- 10.20.193.48:0/3216877054 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9448094a40 con 0x7f9448095410 2026-02-12T18:14:54.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.535+0000 7f9446ffd640 1 --2- 10.20.193.48:0/3216877054 >> v2:10.20.193.111:6812/977811348 conn(0x7f941803f800 0x7f941805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.543 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.535+0000 7f9446ffd640 10 monclient: get_auth_request con 0x7f941803f800 auth_method 0 2026-02-12T18:14:54.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.537+0000 7f94477fe640 1 -- 10.20.193.48:0/3216877054 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9448095410 msgr2=0x7f94481346d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.537+0000 7f94477fe640 1 --2- 10.20.193.48:0/3216877054 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9448095410 0x7f94481346d0 secure :-1 s=READY pgs=17 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9434004740 tx=0x7f94340047e0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.538+0000 7f9423fff640 1 -- 10.20.193.48:0/3216877054 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9434035de0 con 0x7f9448095410 2026-02-12T18:14:54.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.538+0000 7f9423fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.538+0000 7f9423fff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:14:54.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.538+0000 7f9423fff640 10 monclient: dump: 2026-02-12T18:14:54.544 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.544 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.544 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.544 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.544 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.544 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.544 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.544 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.544 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.544 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.544 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.544 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.544 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.544 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.544 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.544 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.538+0000 7f9446ffd640 1 --2- 10.20.193.48:0/3216877054 >> v2:10.20.193.111:6812/977811348 conn(0x7f941803f800 0x7f941805fcb0 secure :-1 s=READY pgs=458 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94481324f0 tx=0x7f9438009210 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.538+0000 7f9423fff640 1 -- 10.20.193.48:0/3216877054 <== mon.5 v2:10.20.193.111:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f9434037440 con 0x7f9448095410 2026-02-12T18:14:54.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.538+0000 7f9423fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:54.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.538+0000 7f9423fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:14:54.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.538+0000 7f9423fff640 1 -- 10.20.193.48:0/3216877054 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9448095410 msgr2=0x7f94481346d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.538+0000 7f9423fff640 1 --2- 10.20.193.48:0/3216877054 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9448095410 0x7f94481346d0 secure :-1 s=READY pgs=17 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9434004740 tx=0x7f94340047e0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.538+0000 7f9423fff640 1 -- 10.20.193.48:0/3216877054 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9448095410 msgr2=0x7f94481346d0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:54.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.538+0000 7f9423fff640 1 --2- 10.20.193.48:0/3216877054 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9448095410 0x7f94481346d0 unknown :-1 s=CLOSED pgs=17 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.541+0000 7f944e0cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:14:54.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.541+0000 7f944e0cc640 1 --2- 10.20.193.48:0/3216877054 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9448130d90 0x7f9448131160 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.541+0000 7f944e0cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.541+0000 7f944e0cc640 1 -- 10.20.193.48:0/3216877054 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f944805fd90 con 0x7f9448130d90 2026-02-12T18:14:54.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.541+0000 7f94477fe640 1 --2- 10.20.193.48:0/3216877054 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9448130d90 0x7f9448131160 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.541+0000 7f94477fe640 10 monclient: get_auth_request con 0x7f9448130d90 auth_method 0 2026-02-12T18:14:54.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.541+0000 7f94477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.541+0000 7f94477fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.541+0000 7f94477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.542+0000 7f94477fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.542+0000 7f94477fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.542+0000 7f94477fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.542+0000 7f94477fe640 10 monclient(hunting): handle_auth_done global_id 104234 payload 824 2026-02-12T18:14:54.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.542+0000 7f94477fe640 1 -- 10.20.193.48:0/3216877054 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9448093a30 con 0x7f9448130d90 2026-02-12T18:14:54.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.544+0000 7f94477fe640 1 -- 10.20.193.48:0/3216877054 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9448130d90 msgr2=0x7f9448131160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.544+0000 7f94477fe640 1 --2- 10.20.193.48:0/3216877054 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9448130d90 0x7f9448131160 secure :-1 s=READY pgs=18 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9434004740 tx=0x7f9434008030 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.544+0000 7f9423fff640 1 -- 10.20.193.48:0/3216877054 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9434055430 con 0x7f9448130d90 2026-02-12T18:14:54.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.544+0000 7f9423fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.544+0000 7f9423fff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:14:54.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.544+0000 7f9423fff640 10 monclient: dump: 2026-02-12T18:14:54.547 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.547 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.547 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.547 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.547 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.547 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.547 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.547 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.547 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.547 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.547 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.547 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.547 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.547 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.547 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.547 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.544+0000 7f9423fff640 1 -- 10.20.193.48:0/3216877054 <== mon.5 v2:10.20.193.111:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7f9434041ab0 con 0x7f9448130d90 2026-02-12T18:14:54.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.544+0000 7f9423fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:14:54.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.544+0000 7f9423fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:14:54.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.544+0000 7f9423fff640 1 -- 10.20.193.48:0/3216877054 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9448130d90 msgr2=0x7f9448131160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.544+0000 7f9423fff640 1 --2- 10.20.193.48:0/3216877054 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9448130d90 0x7f9448131160 secure :-1 s=READY pgs=18 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9434004740 tx=0x7f9434008030 comp rx=0 tx=0).stop 2026-02-12T18:14:54.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.544+0000 7f9423fff640 1 -- 10.20.193.48:0/3216877054 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9448130d90 msgr2=0x7f9448131160 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:54.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.544+0000 7f9423fff640 1 --2- 10.20.193.48:0/3216877054 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9448130d90 0x7f9448131160 secure :-1 s=CLOSED pgs=18 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9434004740 tx=0x7f9434008030 comp rx=0 tx=0).stop 2026-02-12T18:14:54.548 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:14:54.548 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:14:54.548 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:14:54.548 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:14:54.548 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 76, 2026-02-12T18:14:54.548 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 13612, 2026-02-12T18:14:54.548 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:14:54.548 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:14:54.548 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:14:54.548 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:14:54.548 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:14:54.548 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:14:54.548 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:14:54.548 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:14:54.548 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:14:54.548 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:14:54.548 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.548 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 8, 2026-02-12T18:14:54.548 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:54.548 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:14:54.549 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:14:54.549 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:54.549 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:54.549 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:54.549 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:54.549 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:54.549 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:54.549 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:54.549 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:54.549 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:54.549 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:54.549 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:54.549 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:54.549 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:54.549 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.549 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:14:54.549 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:14:54.549 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:54.549 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:54.549 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:54.549 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:54.549 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:54.549 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:54.549 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:54.549 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:54.550 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:54.550 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:54.550 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:54.550 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:54.550 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:54.550 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.550 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.550 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:14:54.550 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:14:54.550 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:14:54.550 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:14:54.550 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:14:54.550 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:14:54.550 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:54.550 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:54.550 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:14:54.550 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:14:54.550 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:14:54.550 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:14:54.550 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:14:54.550 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:14:54.550 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:14:54.550 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:54.550 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:14:54.550 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:54.550 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.551 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.552 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:14:54.552 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.552 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.552 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.552 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.552 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:14:54.552 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:14:54.552 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.552 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.552 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:14:54.552 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.552 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.552 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.552 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:14:54.552 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:14:54.552 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.552 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.552 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.552 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.552 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:14:54.552 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.552 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.552 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.552 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.552 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:14:54.553 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.553 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.553 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.553 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.553 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:14:54.553 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:14:54.553 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.553 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.553 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:14:54.553 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.553 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.553 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.553 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:14:54.553 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:14:54.553 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.553 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.553 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.553 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.553 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:14:54.553 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.553 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.553 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.553 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.553 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:14:54.553 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.553 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.554 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:14:54.555 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:14:54.555 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.555 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.555 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:14:54.555 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.555 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.555 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.555 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:14:54.555 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:14:54.555 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.555 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.555 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.555 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.555 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:14:54.555 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.555 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.555 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.555 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.555 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:14:54.555 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.555 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.555 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.555 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.555 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:14:54.555 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:14:54.555 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:14:54.556 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.557 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:14:54.558 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:14:54.558 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.558 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.558 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.558 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.558 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:14:54.558 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.558 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.558 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.558 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.558 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:14:54.558 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.558 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.558 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.558 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.558 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:14:54.558 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:14:54.558 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.558 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.558 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:14:54.558 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.558 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.558 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.558 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:14:54.558 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:14:54.559 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.559 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.559 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.559 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.559 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:14:54.559 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.559 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.559 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.559 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.559 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:14:54.559 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.559 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.559 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.559 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.559 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:14:54.559 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:14:54.559 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.559 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.559 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:14:54.559 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.559 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.559 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.559 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.559 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:14:54.559 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:14:54.559 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.560 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:54.560 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:54.560 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:54.560 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.560 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.560 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:14:54.560 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.560 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:54.560 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:54.560 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:14:54.560 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.560 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.560 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.560 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:14:54.560 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:14:54.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.545+0000 7f944e0cc640 1 -- 10.20.193.48:0/3216877054 >> v2:10.20.193.111:6812/977811348 conn(0x7f941803f800 msgr2=0x7f941805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.545+0000 7f944e0cc640 1 --2- 10.20.193.48:0/3216877054 >> v2:10.20.193.111:6812/977811348 conn(0x7f941803f800 0x7f941805fcb0 secure :-1 s=READY pgs=458 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f94481324f0 tx=0x7f9438009210 comp rx=0 tx=0).stop 2026-02-12T18:14:54.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.545+0000 7f944e0cc640 10 monclient: shutdown 2026-02-12T18:14:54.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.545+0000 7f944e0cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:54.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.545+0000 7f944e0cc640 1 -- 10.20.193.48:0/3216877054 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9448141360 msgr2=0x7f9448140560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.545+0000 7f944e0cc640 1 --2- 10.20.193.48:0/3216877054 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f9448141360 0x7f9448140560 secure :-1 s=READY pgs=129 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f943c00d740 tx=0x7f943c00dc10 comp rx=0 tx=0).stop 2026-02-12T18:14:54.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.545+0000 7f9447fff640 1 -- 10.20.193.48:0/3216877054 reap_dead start 2026-02-12T18:14:54.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.545+0000 7f9447fff640 1 -- 10.20.193.48:0/3216877054 reap_dead start 2026-02-12T18:14:54.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.545+0000 7f9423fff640 1 -- 10.20.193.48:0/3216877054 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(320..320 src has 215..320) ==== 3897+0+0 (unknown 0 0 0) 0x7f943c053900 con 0x7f9448141360 2026-02-12T18:14:54.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.545+0000 7f944e0cc640 1 -- 10.20.193.48:0/3216877054 shutdown_connections 2026-02-12T18:14:54.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.545+0000 7f944e0cc640 1 -- 10.20.193.48:0/3216877054 >> 10.20.193.48:0/3216877054 conn(0x7f9448097d10 msgr2=0x7f9448089df0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:54.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.545+0000 7f944e0cc640 1 -- 10.20.193.48:0/3216877054 shutdown_connections 2026-02-12T18:14:54.561 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.545+0000 7f944e0cc640 1 -- 10.20.193.48:0/3216877054 wait complete. 2026-02-12T18:14:54.562 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:14:54.562 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2026-02-12T18:14:54.562 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2026-02-12T18:14:54.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.625+0000 7f35eb70c640 10 monclient: get_monmap_and_config 2026-02-12T18:14:54.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.625+0000 7f35eb70c640 10 monclient: build_initial_monmap 2026-02-12T18:14:54.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.625+0000 7f35eb70c640 10 monclient: monmap: 2026-02-12T18:14:54.626 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:54.626 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.626 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:14:54.626311+0000 2026-02-12T18:14:54.626 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:14:54.626311+0000 2026-02-12T18:14:54.626 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:54.626 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.627 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:14:54.627 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:14:54.627 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:54.627 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:54.627 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:54.627 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:54.627 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:54.627 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:54.627 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:54.627 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:14:54.627 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:14:54.627 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.625+0000 7f35eb70c640 1 Processor -- start 2026-02-12T18:14:54.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.625+0000 7f35eb70c640 1 -- start start 2026-02-12T18:14:54.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.625+0000 7f35eb70c640 10 monclient: init 2026-02-12T18:14:54.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.625+0000 7f35eb70c640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:54.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35eb70c640 10 monclient: _add_conns ranks=[10,9,0,8,3,5,6,7,4,2,1] 2026-02-12T18:14:54.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35eb70c640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f35e405c950 0x7f35e405cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35eb70c640 10 monclient(hunting): picked mon.noname-f con 0x7f35e405c950 addr v2:10.20.193.111:3300/0 2026-02-12T18:14:54.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35eb70c640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f35e405e490 0x7f35e405d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35eb70c640 10 monclient(hunting): picked mon.noname-a con 0x7f35e405e490 addr v2:10.20.193.48:3300/0 2026-02-12T18:14:54.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35eb70c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f35e413db70 addr v1:10.20.193.48:6789/0 2026-02-12T18:14:54.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35eb70c640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e404dc20 con 0x7f35e413db70 2026-02-12T18:14:54.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35eb70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35eb70c640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f35e405ddd0 con 0x7f35e405e490 2026-02-12T18:14:54.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35eb70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35eb70c640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f35e405d7a0 con 0x7f35e405c950 2026-02-12T18:14:54.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35eb70c640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:54.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35eb70c640 10 monclient(hunting): authenticate will time out at 1133.352057s 2026-02-12T18:14:54.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e8c80640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f35e405e490 0x7f35e405d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e8c80640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f35e405e490 0x7f35e405d260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:54174/0 (socket says 10.20.193.48:54174) 2026-02-12T18:14:54.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e8c80640 1 -- 10.20.193.48:0/976492137 learned_addr learned my addr 10.20.193.48:0/976492137 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:54.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e8c80640 10 monclient(hunting): get_auth_request con 0x7f35e405e490 auth_method 0 2026-02-12T18:14:54.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e8c80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e8c80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e8c80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e9481640 1 --2- 10.20.193.48:0/976492137 >> v2:10.20.193.111:3300/0 conn(0x7f35e405c950 0x7f35e405cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e8c80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e8c80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e8c80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e9481640 10 monclient(hunting): get_auth_request con 0x7f35e405c950 auth_method 0 2026-02-12T18:14:54.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e9481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e9481640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e9481640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e9481640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e9481640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e9481640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e9481640 10 monclient(hunting): handle_auth_done global_id 94951 payload 274 2026-02-12T18:14:54.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e9481640 1 -- 10.20.193.48:0/976492137 >> v2:10.20.193.48:3300/0 conn(0x7f35e405e490 msgr2=0x7f35e405d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:54.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e9481640 1 --2- 10.20.193.48:0/976492137 >> v2:10.20.193.48:3300/0 conn(0x7f35e405e490 0x7f35e405d260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e9481640 1 -- 10.20.193.48:0/976492137 >> v1:10.20.193.48:6789/0 conn(0x7f35e413db70 legacy=0x7f35e413dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:14:54.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e9481640 10 monclient: _finish_hunting 0 2026-02-12T18:14:54.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e9481640 1 monclient: found mon.noname-f 2026-02-12T18:14:54.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e9481640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:54.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e9481640 10 monclient: _send_mon_message to mon.noname-f at v2:10.20.193.111:3300/0 2026-02-12T18:14:54.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.626+0000 7f35e9481640 1 -- 10.20.193.48:0/976492137 --> v2:10.20.193.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e4092990 con 0x7f35e405c950 2026-02-12T18:14:54.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35e9481640 1 -- 10.20.193.48:0/976492137 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f35e405c950 msgr2=0x7f35e405cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35e9481640 1 --2- 10.20.193.48:0/976492137 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f35e405c950 0x7f35e405cd20 secure :-1 s=READY pgs=160 gs=3 cs=0 l=1 c_cookie=17801543368169776880 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35e408e130 tx=0x7f35d402ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f70bc960717866f0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35d3fff640 1 -- 10.20.193.48:0/976492137 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f35d402fe30 con 0x7f35e405c950 2026-02-12T18:14:54.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35d3fff640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2026-02-12T18:14:54.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35d3fff640 10 monclient: dump: 2026-02-12T18:14:54.632 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.632 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.632 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.632 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.632 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.632 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.632 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.632 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.632 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.632 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.632 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.632 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.632 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.632 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.632 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.632 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35d3fff640 10 monclient: _finish_auth 0 2026-02-12T18:14:54.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35d3fff640 10 monclient: _check_auth_tickets 2026-02-12T18:14:54.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35d3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:54.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35d3fff640 1 -- 10.20.193.48:0/976492137 <== mon.1 v2:10.20.193.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35d4035340 con 0x7f35e405c950 2026-02-12T18:14:54.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35eb70c640 5 monclient: authenticate success, global_id 94951 2026-02-12T18:14:54.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35eb70c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:14:54.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35d3fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:54.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35d3fff640 1 -- 10.20.193.48:0/976492137 <== mon.1 v2:10.20.193.111:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f35d4035970 con 0x7f35e405c950 2026-02-12T18:14:54.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35d3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35d3fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:14:54.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35d3fff640 10 monclient: dump: 2026-02-12T18:14:54.633 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.633 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.633 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.633 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.633 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.633 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.633 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.633 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.633 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.633 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.633 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.633 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.633 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.633 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.633 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.633 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35eb70c640 10 monclient: get_monmap_and_config success 2026-02-12T18:14:54.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35eb70c640 4 set_mon_vals no callback set 2026-02-12T18:14:54.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35eb70c640 10 monclient: shutdown 2026-02-12T18:14:54.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35eb70c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:54.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35eb70c640 1 -- 10.20.193.48:0/976492137 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f35e405c950 msgr2=0x7f35e405cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35eb70c640 1 --2- 10.20.193.48:0/976492137 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f35e405c950 0x7f35e405cd20 secure :-1 s=READY pgs=160 gs=3 cs=0 l=1 c_cookie=17801543368169776880 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35e408e130 tx=0x7f35d402ecf0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35eb70c640 1 -- 10.20.193.48:0/976492137 shutdown_connections 2026-02-12T18:14:54.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35eb70c640 1 --2- 10.20.193.48:0/976492137 >> v2:10.20.193.48:3300/0 conn(0x7f35e405e490 0x7f35e405d260 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35eb70c640 1 --2- 10.20.193.48:0/976492137 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f35e405c950 0x7f35e405cd20 unknown :-1 s=CLOSED pgs=160 gs=3 cs=0 l=1 c_cookie=17801543368169776880 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35eb70c640 1 -- 10.20.193.48:0/976492137 >> 10.20.193.48:0/976492137 conn(0x7f35e40548a0 msgr2=0x7f35e4097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:54.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35eb70c640 1 -- 10.20.193.48:0/976492137 shutdown_connections 2026-02-12T18:14:54.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.629+0000 7f35eb70c640 1 -- 10.20.193.48:0/976492137 wait complete. 2026-02-12T18:14:54.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35eb70c640 10 monclient: build_initial_monmap 2026-02-12T18:14:54.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35eb70c640 10 monclient: monmap: 2026-02-12T18:14:54.634 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:14:54.634 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:14:54.634 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:14:54.634 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:14:54.634 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:14:54.634 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.634 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:14:54.634 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:14:54.634 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:14:54.634 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:14:54.634 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:14:54.634 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:14:54.634 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:14:54.635 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:14:54.635 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:14:54.635 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35eb70c640 1 Processor -- start 2026-02-12T18:14:54.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35eb70c640 1 -- start start 2026-02-12T18:14:54.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35eb70c640 10 monclient: init 2026-02-12T18:14:54.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35eb70c640 10 monclient: _reopen_session rank -1 2026-02-12T18:14:54.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35eb70c640 10 monclient: _add_conns ranks=[4,3,5,7,0,1,2,8,6] 2026-02-12T18:14:54.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35eb70c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f35e405c950 0x7f35e412c9f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35eb70c640 10 monclient(hunting): picked mon.noname-c con 0x7f35e405c950 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:14:54.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35eb70c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f35e405e490 0x7f35e408d4c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35eb70c640 10 monclient(hunting): picked mon.noname-g con 0x7f35e405e490 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:14:54.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35eb70c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f35e413db70 0x7f35e413ce20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35eb70c640 10 monclient(hunting): picked mon.noname-h con 0x7f35e413db70 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:14:54.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35eb70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35eb70c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f35e413e3d0 con 0x7f35e405e490 2026-02-12T18:14:54.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35eb70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35eb70c640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f35e413e820 con 0x7f35e405c950 2026-02-12T18:14:54.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35eb70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35eb70c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f35e408af80 con 0x7f35e413db70 2026-02-12T18:14:54.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35eb70c640 10 monclient(hunting): _renew_subs 2026-02-12T18:14:54.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35eb70c640 10 monclient(hunting): authenticate will time out at 1133.356856s 2026-02-12T18:14:54.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35e9481640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f35e405c950 0x7f35e412c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35e9481640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f35e405c950 0x7f35e412c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:58316/0 (socket says 10.20.193.48:58316) 2026-02-12T18:14:54.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35e9481640 1 -- 10.20.193.48:0/1117463062 learned_addr learned my addr 10.20.193.48:0/1117463062 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:14:54.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35e9481640 10 monclient(hunting): get_auth_request con 0x7f35e405c950 auth_method 0 2026-02-12T18:14:54.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35e9481640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35e9481640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35e9481640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35e9481640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.630+0000 7f35e9481640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.631+0000 7f35e9481640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.631+0000 7f35e9c82640 1 --2- 10.20.193.48:0/1117463062 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f35e413db70 0x7f35e413ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.631+0000 7f35e9c82640 10 monclient(hunting): get_auth_request con 0x7f35e413db70 auth_method 0 2026-02-12T18:14:54.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.631+0000 7f35e9c82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.631+0000 7f35e9c82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.631+0000 7f35e9c82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.631+0000 7f35e8c80640 1 --2- 10.20.193.48:0/1117463062 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f35e405e490 0x7f35e408d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.631+0000 7f35e8c80640 10 monclient(hunting): get_auth_request con 0x7f35e405e490 auth_method 0 2026-02-12T18:14:54.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.631+0000 7f35e8c80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.631+0000 7f35e8c80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.631+0000 7f35e8c80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.631+0000 7f35e9481640 10 monclient(hunting): handle_auth_done global_id 65182 payload 824 2026-02-12T18:14:54.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.631+0000 7f35e9481640 1 -- 10.20.193.48:0/1117463062 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f35e413db70 msgr2=0x7f35e413ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.631+0000 7f35e9481640 1 --2- 10.20.193.48:0/1117463062 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f35e413db70 0x7f35e413ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.631+0000 7f35e9481640 1 -- 10.20.193.48:0/1117463062 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f35e405e490 msgr2=0x7f35e408d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.631+0000 7f35e9481640 1 --2- 10.20.193.48:0/1117463062 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f35e405e490 0x7f35e408d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.631+0000 7f35e9481640 10 monclient: _finish_hunting 0 2026-02-12T18:14:54.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.631+0000 7f35e9481640 1 monclient: found mon.noname-c 2026-02-12T18:14:54.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.631+0000 7f35e9481640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:14:54.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.631+0000 7f35e9481640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:14:54.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.631+0000 7f35e9481640 1 -- 10.20.193.48:0/1117463062 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35d4009420 con 0x7f35e405c950 2026-02-12T18:14:54.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.633+0000 7f35e9481640 1 -- 10.20.193.48:0/1117463062 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f35e405c950 msgr2=0x7f35e412c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.633+0000 7f35e9481640 1 --2- 10.20.193.48:0/1117463062 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f35e405c950 0x7f35e412c9f0 secure :-1 s=READY pgs=210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35d402ed30 tx=0x7f35d40047e0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.633+0000 7f35d1ffb640 1 -- 10.20.193.48:0/1117463062 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f35d40044f0 con 0x7f35e405c950 2026-02-12T18:14:54.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.633+0000 7f35d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.633+0000 7f35d1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:14:54.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.633+0000 7f35d1ffb640 10 monclient: dump: 2026-02-12T18:14:54.639 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.639 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.639 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.639 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.639 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.640 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.640 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.640 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.640 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.640 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.640 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.640 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.640 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.640 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.640 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.640 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.633+0000 7f35d1ffb640 10 monclient: _finish_auth 0 2026-02-12T18:14:54.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.633+0000 7f35d1ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:14:54.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.633+0000 7f35d1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:14:54.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.633+0000 7f35d1ffb640 1 -- 10.20.193.48:0/1117463062 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35d402fd90 con 0x7f35e405c950 2026-02-12T18:14:54.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.633+0000 7f35d1ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:14:54.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.633+0000 7f35d1ffb640 1 -- 10.20.193.48:0/1117463062 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f35d4003b90 con 0x7f35e405c950 2026-02-12T18:14:54.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.633+0000 7f35d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.633+0000 7f35d1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:14:54.640 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.633+0000 7f35d1ffb640 10 monclient: dump: 2026-02-12T18:14:54.640 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.640 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.640 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.640 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.641 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.641 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.641 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.641 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.641 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.641 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.641 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.641 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.641 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.641 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.641 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.641 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.633+0000 7f35d37fe640 4 set_mon_vals no callback set 2026-02-12T18:14:54.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.633+0000 7f35eb70c640 5 monclient: authenticate success, global_id 65182 2026-02-12T18:14:54.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.633+0000 7f35eb70c640 10 monclient: _renew_subs 2026-02-12T18:14:54.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.633+0000 7f35eb70c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:14:54.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.633+0000 7f35eb70c640 1 -- 10.20.193.48:0/1117463062 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35e4143aa0 con 0x7f35e405c950 2026-02-12T18:14:54.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.633+0000 7f35eb70c640 10 monclient: _renew_subs 2026-02-12T18:14:54.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.633+0000 7f35eb70c640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:14:54.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.633+0000 7f35eb70c640 1 -- 10.20.193.48:0/1117463062 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f35e41416e0 con 0x7f35e405c950 2026-02-12T18:14:54.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.634+0000 7f35eb70c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:54.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.634+0000 7f35eb70c640 1 --2- 10.20.193.48:0/1117463062 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f35e408da00 0x7f35e413d360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.634+0000 7f35eb70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.641 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.634+0000 7f35eb70c640 1 -- 10.20.193.48:0/1117463062 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f35e4063180 con 0x7f35e408da00 2026-02-12T18:14:54.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.634+0000 7f35e8c80640 1 --2- 10.20.193.48:0/1117463062 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f35e408da00 0x7f35e413d360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.634+0000 7f35e8c80640 10 monclient: get_auth_request con 0x7f35e408da00 auth_method 0 2026-02-12T18:14:54.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.634+0000 7f35e8c80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.634+0000 7f35e8c80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.634+0000 7f35e8c80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.634+0000 7f35d1ffb640 1 -- 10.20.193.48:0/1117463062 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f35d4003cf0 con 0x7f35e405c950 2026-02-12T18:14:54.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.634+0000 7f35e8c80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.634+0000 7f35e8c80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.634+0000 7f35e8c80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.634+0000 7f35d1ffb640 1 --2- 10.20.193.48:0/1117463062 >> v2:10.20.193.111:6812/977811348 conn(0x7f35b403f800 0x7f35b405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.634+0000 7f35e8c80640 10 monclient(hunting): handle_auth_done global_id 94786 payload 824 2026-02-12T18:14:54.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.634+0000 7f35d1ffb640 1 -- 10.20.193.48:0/1117463062 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(320..320 src has 215..320) ==== 3897+0+0 (secure 0 0 0) 0x7f35d4077d80 con 0x7f35e405c950 2026-02-12T18:14:54.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.634+0000 7f35e8c80640 1 -- 10.20.193.48:0/1117463062 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f35e408a6e0 con 0x7f35e408da00 2026-02-12T18:14:54.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.634+0000 7f35e9c82640 1 --2- 10.20.193.48:0/1117463062 >> v2:10.20.193.111:6812/977811348 conn(0x7f35b403f800 0x7f35b405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.634+0000 7f35e9c82640 10 monclient: get_auth_request con 0x7f35b403f800 auth_method 0 2026-02-12T18:14:54.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.636+0000 7f35e8c80640 1 -- 10.20.193.48:0/1117463062 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f35e408da00 msgr2=0x7f35e413d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.636+0000 7f35e8c80640 1 --2- 10.20.193.48:0/1117463062 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f35e408da00 0x7f35e413d360 secure :-1 s=READY pgs=134 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35d8004740 tx=0x7f35d8011ca0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.637+0000 7f35d1ffb640 1 -- 10.20.193.48:0/1117463062 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f35d8011ec0 con 0x7f35e408da00 2026-02-12T18:14:54.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.637+0000 7f35d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.637+0000 7f35d1ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:14:54.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.637+0000 7f35d1ffb640 10 monclient: dump: 2026-02-12T18:14:54.644 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.644 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.644 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.644 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.644 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.644 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.644 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.644 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.644 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.644 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.644 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.644 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.644 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.644 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.644 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.644 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.637+0000 7f35e9c82640 1 --2- 10.20.193.48:0/1117463062 >> v2:10.20.193.111:6812/977811348 conn(0x7f35b403f800 0x7f35b405fcb0 secure :-1 s=READY pgs=459 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35e0004850 tx=0x7f35e000a040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.637+0000 7f35d1ffb640 1 -- 10.20.193.48:0/1117463062 <== mon.7 v2:10.20.193.111:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f35d800fc20 con 0x7f35e408da00 2026-02-12T18:14:54.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.637+0000 7f35d1ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:14:54.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.637+0000 7f35d1ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:14:54.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.637+0000 7f35d1ffb640 1 -- 10.20.193.48:0/1117463062 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f35e408da00 msgr2=0x7f35e413d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.637+0000 7f35d1ffb640 1 --2- 10.20.193.48:0/1117463062 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f35e408da00 0x7f35e413d360 secure :-1 s=READY pgs=134 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35d8004740 tx=0x7f35d8011ca0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.637+0000 7f35d1ffb640 1 -- 10.20.193.48:0/1117463062 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f35e408da00 msgr2=0x7f35e413d360 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:54.644 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.637+0000 7f35d1ffb640 1 --2- 10.20.193.48:0/1117463062 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f35e408da00 0x7f35e413d360 secure :-1 s=CLOSED pgs=134 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35d8004740 tx=0x7f35d8011ca0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.640+0000 7f35eb70c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:14:54.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.640+0000 7f35eb70c640 1 --2- 10.20.193.48:0/1117463062 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f35e4129470 0x7f35e4129870 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:14:54.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.640+0000 7f35eb70c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:14:54.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.640+0000 7f35eb70c640 1 -- 10.20.193.48:0/1117463062 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f35e4050410 con 0x7f35e4129470 2026-02-12T18:14:54.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.640+0000 7f35e8c80640 1 --2- 10.20.193.48:0/1117463062 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f35e4129470 0x7f35e4129870 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:14:54.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.640+0000 7f35e8c80640 10 monclient: get_auth_request con 0x7f35e4129470 auth_method 0 2026-02-12T18:14:54.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.640+0000 7f35e8c80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:14:54.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.640+0000 7f35e8c80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:14:54.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.640+0000 7f35e8c80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:14:54.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.641+0000 7f35e8c80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:14:54.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.641+0000 7f35e8c80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:14:54.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.641+0000 7f35e8c80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:14:54.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.641+0000 7f35e8c80640 10 monclient(hunting): handle_auth_done global_id 94795 payload 824 2026-02-12T18:14:54.645 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.641+0000 7f35e8c80640 1 -- 10.20.193.48:0/1117463062 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f35e4091730 con 0x7f35e4129470 2026-02-12T18:14:54.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.643+0000 7f35e8c80640 1 -- 10.20.193.48:0/1117463062 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f35e4129470 msgr2=0x7f35e4129870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:14:54.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.643+0000 7f35e8c80640 1 --2- 10.20.193.48:0/1117463062 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f35e4129470 0x7f35e4129870 secure :-1 s=READY pgs=135 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35d8019000 tx=0x7f35d80047e0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:14:54.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.643+0000 7f35d1ffb640 1 -- 10.20.193.48:0/1117463062 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f35d8005e30 con 0x7f35e4129470 2026-02-12T18:14:54.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.643+0000 7f35d1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:14:54.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.643+0000 7f35d1ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:14:54.646 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.643+0000 7f35d1ffb640 10 monclient: dump: 2026-02-12T18:14:54.646 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:14:54.646 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:14:54.646 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.646 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:14:54.646 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:14:54.646 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:14:54.646 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:14:54.646 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:14:54.646 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:14:54.646 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:14:54.646 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:14:54.646 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:14:54.646 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:14:54.646 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:14:54.647 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:14:54.647 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:14:54.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.643+0000 7f35d1ffb640 1 -- 10.20.193.48:0/1117463062 <== mon.7 v2:10.20.193.111:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10349 (secure 0 0 0) 0x7f35d8022550 con 0x7f35e4129470 2026-02-12T18:14:54.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.643+0000 7f35d1ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:14:54.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.643+0000 7f35d1ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:14:54.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.643+0000 7f35d1ffb640 1 -- 10.20.193.48:0/1117463062 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f35e4129470 msgr2=0x7f35e4129870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.643+0000 7f35d1ffb640 1 --2- 10.20.193.48:0/1117463062 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f35e4129470 0x7f35e4129870 secure :-1 s=READY pgs=135 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35d8019000 tx=0x7f35d80047e0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.643+0000 7f35d1ffb640 1 -- 10.20.193.48:0/1117463062 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f35e4129470 msgr2=0x7f35e4129870 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:14:54.647 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.643+0000 7f35d1ffb640 1 --2- 10.20.193.48:0/1117463062 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f35e4129470 0x7f35e4129870 secure :-1 s=CLOSED pgs=135 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35d8019000 tx=0x7f35d80047e0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.647 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:14:54.647 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:14:54.647 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:14:54.647 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:14:54.647 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 76, 2026-02-12T18:14:54.647 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 140327, 2026-02-12T18:14:54.647 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:14:54.647 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:14:54.647 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:14:54.647 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:14:54.648 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:14:54.648 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:14:54.648 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:14:54.648 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:14:54.648 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:14:54.648 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:14:54.648 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.648 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 8, 2026-02-12T18:14:54.648 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:54.648 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:14:54.648 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:14:54.648 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:54.648 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:54.648 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:54.648 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:54.648 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:54.648 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:54.648 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:54.648 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:54.648 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:54.648 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:54.648 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:54.648 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:54.648 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:54.648 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.649 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:14:54.649 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:14:54.649 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:54.649 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:54.649 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:54.649 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:54.649 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:54.649 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:54.649 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:54.649 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:54.649 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:54.649 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:54.649 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:54.649 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:54.649 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:54.649 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.649 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.649 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:14:54.649 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:14:54.649 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:14:54.649 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:14:54.649 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:14:54.649 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:14:54.649 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:54.650 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:14:54.650 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:14:54.650 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:14:54.650 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:14:54.650 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:14:54.650 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:14:54.650 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:14:54.650 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:14:54.650 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:14:54.650 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:14:54.650 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:14:54.650 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:14:54.650 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:14:54.650 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:14:54.650 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:14:54.650 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:14:54.650 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:14:54.650 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:14:54.650 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:14:54.650 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:14:54.650 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:14:54.650 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:14:54.650 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:14:54.650 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.650 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:14:54.650 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.651 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:14:54.651 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.651 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:14:54.651 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:14:54.651 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.651 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.651 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.651 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.651 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:14:54.651 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.651 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.651 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.651 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.651 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:14:54.651 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.651 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.651 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.651 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.651 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:14:54.651 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:14:54.651 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.651 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.651 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:14:54.651 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.652 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.652 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.652 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:14:54.652 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:14:54.652 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.652 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.652 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.652 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.652 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:14:54.652 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.652 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.652 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.652 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.652 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:14:54.652 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.652 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.652 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.652 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.652 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:14:54.652 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:14:54.652 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.652 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.652 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:14:54.652 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.652 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.653 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.653 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:14:54.653 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:14:54.653 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.653 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.653 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.653 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.653 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:14:54.653 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.653 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.653 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.653 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.653 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:14:54.653 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.653 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.653 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.653 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.653 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:14:54.653 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:14:54.653 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.653 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.653 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:14:54.653 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.653 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.653 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.653 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.654 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.655 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.655 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.655 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:14:54.655 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.655 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.655 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.655 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.655 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:14:54.655 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.655 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.655 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.655 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.655 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:14:54.655 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:14:54.655 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.655 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.655 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:54.655 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.655 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.655 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.655 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:14:54.655 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:14:54.655 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.655 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.655 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.655 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.656 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:14:54.656 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.656 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.656 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.656 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.656 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:14:54.656 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.656 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.656 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.656 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.656 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:14:54.656 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:14:54.656 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.656 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.656 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:14:54.656 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.656 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.656 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.656 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:14:54.656 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:14:54.656 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.656 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.656 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.656 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.656 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:14:54.656 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.657 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.657 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.657 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.657 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:14:54.657 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.657 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.657 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.657 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.657 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:14:54.657 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:14:54.657 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.657 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.657 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:14:54.657 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.657 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.657 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.657 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:14:54.657 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:14:54.657 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.657 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.657 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.657 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.657 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:14:54.657 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.658 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:54.659 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:14:54.660 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.660 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.660 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:14:54.660 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.660 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:54.660 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:54.660 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:54.660 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.660 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:14:54.660 INFO:teuthology.orchestra.run.trial048.stdout: "mgr": [ 2026-02-12T18:14:54.660 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:14:54.660 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:14:54.660 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:14:54.660 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:14:54.660 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:14:54.660 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:14:54.660 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:14:54.660 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:14:54.660 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:14:54.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.644+0000 7f35eb70c640 1 -- 10.20.193.48:0/1117463062 >> v2:10.20.193.111:6812/977811348 conn(0x7f35b403f800 msgr2=0x7f35b405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.644+0000 7f35eb70c640 1 --2- 10.20.193.48:0/1117463062 >> v2:10.20.193.111:6812/977811348 conn(0x7f35b403f800 0x7f35b405fcb0 secure :-1 s=READY pgs=459 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35e0004850 tx=0x7f35e000a040 comp rx=0 tx=0).stop 2026-02-12T18:14:54.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.644+0000 7f35eb70c640 10 monclient: shutdown 2026-02-12T18:14:54.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.644+0000 7f35eb70c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:14:54.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.644+0000 7f35eb70c640 1 -- 10.20.193.48:0/1117463062 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f35e405c950 msgr2=0x7f35e412c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:14:54.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.644+0000 7f35eb70c640 1 --2- 10.20.193.48:0/1117463062 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f35e405c950 0x7f35e412c9f0 secure :-1 s=READY pgs=210 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f35d402ed30 tx=0x7f35d40047e0 comp rx=0 tx=0).stop 2026-02-12T18:14:54.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.644+0000 7f35e9c82640 1 -- 10.20.193.48:0/1117463062 reap_dead start 2026-02-12T18:14:54.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.644+0000 7f35e9c82640 1 -- 10.20.193.48:0/1117463062 reap_dead start 2026-02-12T18:14:54.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.644+0000 7f35eb70c640 1 -- 10.20.193.48:0/1117463062 shutdown_connections 2026-02-12T18:14:54.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.644+0000 7f35eb70c640 1 -- 10.20.193.48:0/1117463062 >> 10.20.193.48:0/1117463062 conn(0x7f35e40548a0 msgr2=0x7f35e4093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:14:54.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.644+0000 7f35eb70c640 1 -- 10.20.193.48:0/1117463062 shutdown_connections 2026-02-12T18:14:54.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:14:54.644+0000 7f35eb70c640 1 -- 10.20.193.48:0/1117463062 wait complete. 2026-02-12T18:14:54.662 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:14:54.662 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['d', 'h', 'i'] 2026-02-12T18:14:54.662 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['f', 'g'] 2026-02-12T18:14:54.662 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.d 2026-02-12T18:14:54.662 INFO:tasks.mon_thrash.mon_thrasher:killing mon.d 2026-02-12T18:14:54.662 DEBUG:tasks.ceph.mon.d:waiting for process to exit 2026-02-12T18:14:54.662 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:14:54.671 INFO:tasks.ceph.mon.d:Stopped 2026-02-12T18:14:54.671 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.h 2026-02-12T18:14:54.671 INFO:tasks.mon_thrash.mon_thrasher:killing mon.h 2026-02-12T18:14:54.671 DEBUG:tasks.ceph.mon.h:waiting for process to exit 2026-02-12T18:14:54.671 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:14:54.680 INFO:tasks.ceph.mon.h:Stopped 2026-02-12T18:14:54.680 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.i 2026-02-12T18:14:54.680 INFO:tasks.mon_thrash.mon_thrasher:killing mon.i 2026-02-12T18:14:54.680 DEBUG:tasks.ceph.mon.i:waiting for process to exit 2026-02-12T18:14:54.680 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:14:54.730 INFO:tasks.ceph.mon.i:Stopped 2026-02-12T18:14:54.730 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.f 2026-02-12T18:14:54.730 INFO:tasks.mon_thrash:Sending STOP to mon f 2026-02-12T18:14:54.730 INFO:tasks.ceph.mon.f:Sent signal 19 2026-02-12T18:14:54.730 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.g 2026-02-12T18:14:54.731 INFO:tasks.mon_thrash:Sending STOP to mon g 2026-02-12T18:14:54.731 INFO:tasks.ceph.mon.g:Sent signal 19 2026-02-12T18:14:54.731 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-12T18:15:09.731 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.f 2026-02-12T18:15:09.732 INFO:tasks.mon_thrash:Sending CONT to mon f 2026-02-12T18:15:09.732 INFO:tasks.ceph.mon.f:Sent signal 18 2026-02-12T18:15:09.732 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.g 2026-02-12T18:15:09.732 INFO:tasks.mon_thrash:Sending CONT to mon g 2026-02-12T18:15:09.732 INFO:tasks.ceph.mon.g:Sent signal 18 2026-02-12T18:15:09.733 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 6 2026-02-12T18:15:09.733 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T18:15:09.803 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.799+0000 7f6ed9447640 10 monclient: get_monmap_and_config 2026-02-12T18:15:09.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.799+0000 7f6ed9447640 10 monclient: build_initial_monmap 2026-02-12T18:15:09.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.799+0000 7f6ed9447640 10 monclient: monmap: 2026-02-12T18:15:09.804 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:15:09.804 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:09.804 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:15:09.800946+0000 2026-02-12T18:15:09.804 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:15:09.800946+0000 2026-02-12T18:15:09.805 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:15:09.805 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:09.805 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:15:09.805 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:15:09.805 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:15:09.805 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:15:09.805 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:15:09.805 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:15:09.806 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:15:09.806 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:15:09.806 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:15:09.806 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:15:09.806 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:15:09.806 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:09.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.800+0000 7f6ed9447640 1 Processor -- start 2026-02-12T18:15:09.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.800+0000 7f6ed9447640 1 -- start start 2026-02-12T18:15:09.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.800+0000 7f6ed9447640 10 monclient: init 2026-02-12T18:15:09.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.800+0000 7f6ed9447640 10 monclient: _reopen_session rank -1 2026-02-12T18:15:09.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.800+0000 7f6ed9447640 10 monclient: _add_conns ranks=[1,10,6,2,9,5,7,8,0,4,3] 2026-02-12T18:15:09.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.800+0000 7f6ed9447640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f6ed4093ac0 addr v1:10.20.193.111:6789/0 2026-02-12T18:15:09.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.800+0000 7f6ed9447640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f6ed413e990 0x7f6ed41831b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:09.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.800+0000 7f6ed9447640 10 monclient(hunting): picked mon.noname-f con 0x7f6ed413e990 addr v2:10.20.193.111:3300/0 2026-02-12T18:15:09.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.800+0000 7f6ed9447640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6ed405dd20 0x7f6ed41a3700 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:09.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.800+0000 7f6ed9447640 10 monclient(hunting): picked mon.noname-d con 0x7f6ed405dd20 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:15:09.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.800+0000 7f6ed9447640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ed4060390 con 0x7f6ed4093ac0 2026-02-12T18:15:09.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.800+0000 7f6ed9447640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:09.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.800+0000 7f6ed9447640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f6ed40580a0 con 0x7f6ed413e990 2026-02-12T18:15:09.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.800+0000 7f6ed9447640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:09.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.800+0000 7f6ed9447640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f6ed405e3f0 con 0x7f6ed405dd20 2026-02-12T18:15:09.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.800+0000 7f6ed9447640 10 monclient(hunting): _renew_subs 2026-02-12T18:15:09.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.800+0000 7f6ed9447640 10 monclient(hunting): authenticate will time out at 1148.526647s 2026-02-12T18:15:09.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.800+0000 7f6ed37fe640 1 -- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6ed405dd20 msgr2=0x7f6ed41a3700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.48:3303/0 2026-02-12T18:15:09.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.800+0000 7f6ed37fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6ed405dd20 0x7f6ed41a3700 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:15:09.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.800+0000 7f6ed2ffd640 1 --1- >> v1:10.20.193.111:6789/0 conn(0x7f6ed4093ac0 0x7f6ed405d610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.48:39568/0 (socket says 10.20.193.48:39568) 2026-02-12T18:15:09.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.800+0000 7f6ed2ffd640 1 -- 10.20.193.48:0/1620085484 learned_addr learned my addr 10.20.193.48:0/1620085484 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:15:09.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.800+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.111:3300/0 conn(0x7f6ed413e990 0x7f6ed41831b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:09.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.800+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request con 0x7f6ed413e990 auth_method 0 2026-02-12T18:15:09.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.800+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:09.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.800+0000 7f6ed27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:09.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.800+0000 7f6ed27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:09.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.801+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> v2:10.20.193.111:3300/0 conn(0x7f6ed413e990 msgr2=0x7f6ed41831b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:15:09.810 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.801+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> v2:10.20.193.111:3300/0 conn(0x7f6ed413e990 msgr2=0x7f6ed41831b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:15:09.810 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.801+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.111:3300/0 conn(0x7f6ed413e990 0x7f6ed41831b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:15:09.810 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.801+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.111:3300/0 conn(0x7f6ed413e990 0x7f6ed41831b0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:15:09.810 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:09.803+0000 7f6ed2ffd640 1 -- 10.20.193.48:0/1620085484 >> v1:10.20.193.111:6789/0 conn(0x7f6ed4093ac0 legacy=0x7f6ed405d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:10.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:10.001+0000 7f6ed37fe640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6ed405dd20 msgr2=0x7f6ed41a3700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.48:3303/0 2026-02-12T18:15:10.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:10.001+0000 7f6ed37fe640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6ed405dd20 0x7f6ed41a3700 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:15:10.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:10.002+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.111:3300/0 conn(0x7f6ed413e990 0x7f6ed41831b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:10.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:10.002+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request con 0x7f6ed413e990 auth_method 0 2026-02-12T18:15:10.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:10.002+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:10.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:10.002+0000 7f6ed27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:10.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:10.002+0000 7f6ed27fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:15:10.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:10.002+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> v2:10.20.193.111:3300/0 conn(0x7f6ed413e990 msgr2=0x7f6ed41831b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:15:10.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:10.002+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> v2:10.20.193.111:3300/0 conn(0x7f6ed413e990 msgr2=0x7f6ed41831b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:15:10.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:10.002+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.111:3300/0 conn(0x7f6ed413e990 0x7f6ed41831b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=6 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:15:10.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:10.002+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.111:3300/0 conn(0x7f6ed413e990 0x7f6ed41831b0 unknown :-1 s=START_CONNECT pgs=0 gs=7 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:15:10.404 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:10.402+0000 7f6ed37fe640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6ed405dd20 msgr2=0x7f6ed41a3700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.48:3303/0 2026-02-12T18:15:10.404 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:10.402+0000 7f6ed37fe640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6ed405dd20 0x7f6ed41a3700 unknown :-1 s=START_CONNECT pgs=0 gs=8 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:15:10.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:10.403+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.111:3300/0 conn(0x7f6ed413e990 0x7f6ed41831b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=9 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:10.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:10.403+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request con 0x7f6ed413e990 auth_method 0 2026-02-12T18:15:10.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:10.403+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:10.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:10.403+0000 7f6ed27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:10.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:10.403+0000 7f6ed27fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:15:10.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:10.403+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> v2:10.20.193.111:3300/0 conn(0x7f6ed413e990 msgr2=0x7f6ed41831b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:15:10.406 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:10.403+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> v2:10.20.193.111:3300/0 conn(0x7f6ed413e990 msgr2=0x7f6ed41831b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:15:10.406 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:10.403+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.111:3300/0 conn(0x7f6ed413e990 0x7f6ed41831b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=9 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:15:10.406 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:10.403+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.111:3300/0 conn(0x7f6ed413e990 0x7f6ed41831b0 unknown :-1 s=START_CONNECT pgs=0 gs=10 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:15:11.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:11.204+0000 7f6ed37fe640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6ed405dd20 msgr2=0x7f6ed41a3700 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.48:3303/0 2026-02-12T18:15:11.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:11.204+0000 7f6ed37fe640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6ed405dd20 0x7f6ed41a3700 unknown :-1 s=START_CONNECT pgs=0 gs=11 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:15:11.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:11.204+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.111:3300/0 conn(0x7f6ed413e990 0x7f6ed41831b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=12 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:11.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:11.204+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request con 0x7f6ed413e990 auth_method 0 2026-02-12T18:15:11.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:11.204+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:11.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:11.204+0000 7f6ed27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:11.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:11.204+0000 7f6ed27fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:15:11.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:11.204+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> v2:10.20.193.111:3300/0 conn(0x7f6ed413e990 msgr2=0x7f6ed41831b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:15:11.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:11.204+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> v2:10.20.193.111:3300/0 conn(0x7f6ed413e990 msgr2=0x7f6ed41831b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:15:11.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:11.204+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.111:3300/0 conn(0x7f6ed413e990 0x7f6ed41831b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=12 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:15:11.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:11.204+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.111:3300/0 conn(0x7f6ed413e990 0x7f6ed41831b0 unknown :-1 s=START_CONNECT pgs=0 gs=13 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:15:12.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed0ff9640 10 monclient(hunting): tick 2026-02-12T18:15:12.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed0ff9640 10 monclient(hunting): _check_auth_tickets 2026-02-12T18:15:12.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed0ff9640 1 monclient(hunting): continuing hunt 2026-02-12T18:15:12.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed0ff9640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T18:15:12.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed0ff9640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6ed405dd20 msgr2=0x7f6ed41a3700 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:15:12.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed0ff9640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6ed405dd20 0x7f6ed41a3700 unknown :-1 s=START_CONNECT pgs=0 gs=11 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:12.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed0ff9640 1 -- 10.20.193.48:0/1620085484 >> v2:10.20.193.111:3300/0 conn(0x7f6ed413e990 msgr2=0x7f6ed41831b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:15:12.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed0ff9640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.111:3300/0 conn(0x7f6ed413e990 0x7f6ed41831b0 unknown :-1 s=START_CONNECT pgs=0 gs=13 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:12.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed0ff9640 1 -- 10.20.193.48:0/1620085484 >> v1:10.20.193.111:6789/0 conn(0x7f6ed4093ac0 legacy=0x7f6ed405d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:12.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed0ff9640 10 monclient: _add_conns ranks=[4,3,5,9,0,2,8,7] 2026-02-12T18:15:12.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed0ff9640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6eb8003960 0x7f6eb8023d80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:12.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed0ff9640 10 monclient(hunting): picked mon.noname-c con 0x7f6eb8003960 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:15:12.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed0ff9640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6eb8024420 0x7f6eb80448a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:12.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed0ff9640 10 monclient(hunting): picked mon.noname-g con 0x7f6eb8024420 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:15:12.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed0ff9640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6eb8044f90 0x7f6eb8065410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:12.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed0ff9640 10 monclient(hunting): picked mon.noname-h con 0x7f6eb8044f90 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:15:12.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed0ff9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:12.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed0ff9640 1 -- 10.20.193.48:0/1620085484 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6ed40580a0 con 0x7f6eb8024420 2026-02-12T18:15:12.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed0ff9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:12.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed0ff9640 1 -- 10.20.193.48:0/1620085484 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f6ed405e3f0 con 0x7f6eb8003960 2026-02-12T18:15:12.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed0ff9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:12.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed0ff9640 1 -- 10.20.193.48:0/1620085484 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f6eb8065b90 con 0x7f6eb8044f90 2026-02-12T18:15:12.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed0ff9640 10 monclient(hunting): _renew_subs 2026-02-12T18:15:12.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed37fe640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6eb8044f90 msgr2=0x7f6eb8065410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:15:12.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed37fe640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6eb8044f90 0x7f6eb8065410 unknown :-1 s=START_CONNECT pgs=0 gs=16 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:15:12.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed2ffd640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6eb8003960 0x7f6eb8023d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=14 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:12.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed2ffd640 10 monclient(hunting): get_auth_request con 0x7f6eb8003960 auth_method 0 2026-02-12T18:15:12.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:12.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:12.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:12.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6eb8024420 0x7f6eb80448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=15 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:12.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request con 0x7f6eb8024420 auth_method 0 2026-02-12T18:15:12.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed2ffd640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6eb8003960 msgr2=0x7f6eb8023d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:15:12.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:12.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:12.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:12.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed2ffd640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6eb8003960 msgr2=0x7f6eb8023d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:15:12.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed2ffd640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6eb8003960 0x7f6eb8023d80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=14 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:15:12.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed2ffd640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6eb8003960 0x7f6eb8023d80 unknown :-1 s=START_CONNECT pgs=0 gs=17 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:15:12.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6eb8024420 msgr2=0x7f6eb80448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:15:12.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6eb8024420 msgr2=0x7f6eb80448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:15:12.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6eb8024420 0x7f6eb80448a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=15 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:15:12.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:12.801+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6eb8024420 0x7f6eb80448a0 unknown :-1 s=START_CONNECT pgs=0 gs=18 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:15:13.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.003+0000 7f6ed37fe640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6eb8044f90 msgr2=0x7f6eb8065410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:15:13.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.003+0000 7f6ed37fe640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6eb8044f90 0x7f6eb8065410 unknown :-1 s=START_CONNECT pgs=0 gs=19 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:15:13.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.003+0000 7f6ed2ffd640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6eb8003960 0x7f6eb8023d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=20 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:13.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.003+0000 7f6ed2ffd640 10 monclient(hunting): get_auth_request con 0x7f6eb8003960 auth_method 0 2026-02-12T18:15:13.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.003+0000 7f6ed2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:13.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.003+0000 7f6ed2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:13.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.003+0000 7f6ed2ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:15:13.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.003+0000 7f6ed2ffd640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6eb8003960 msgr2=0x7f6eb8023d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:15:13.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.003+0000 7f6ed2ffd640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6eb8003960 msgr2=0x7f6eb8023d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:15:13.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.003+0000 7f6ed2ffd640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6eb8003960 0x7f6eb8023d80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=20 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:15:13.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.003+0000 7f6ed2ffd640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6eb8003960 0x7f6eb8023d80 unknown :-1 s=START_CONNECT pgs=0 gs=22 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:15:13.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.003+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6eb8024420 0x7f6eb80448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=21 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:13.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.003+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request con 0x7f6eb8024420 auth_method 0 2026-02-12T18:15:13.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.003+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:13.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.003+0000 7f6ed27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:13.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.003+0000 7f6ed27fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:15:13.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.003+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6eb8024420 msgr2=0x7f6eb80448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:15:13.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.003+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6eb8024420 msgr2=0x7f6eb80448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:15:13.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.003+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6eb8024420 0x7f6eb80448a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=21 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:15:13.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.003+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6eb8024420 0x7f6eb80448a0 unknown :-1 s=START_CONNECT pgs=0 gs=23 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:15:13.406 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.405+0000 7f6ed2ffd640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6eb8003960 0x7f6eb8023d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=24 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:13.406 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.405+0000 7f6ed2ffd640 10 monclient(hunting): get_auth_request con 0x7f6eb8003960 auth_method 0 2026-02-12T18:15:13.407 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.405+0000 7f6ed2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:13.407 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.405+0000 7f6ed2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:13.407 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.405+0000 7f6ed2ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:15:13.407 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.405+0000 7f6ed2ffd640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6eb8003960 msgr2=0x7f6eb8023d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:15:13.407 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.405+0000 7f6ed2ffd640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6eb8003960 msgr2=0x7f6eb8023d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:15:13.407 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.405+0000 7f6ed2ffd640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6eb8003960 0x7f6eb8023d80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=24 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:15:13.407 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.405+0000 7f6ed2ffd640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6eb8003960 0x7f6eb8023d80 unknown :-1 s=START_CONNECT pgs=0 gs=26 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:15:13.407 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.405+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6eb8024420 0x7f6eb80448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=25 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:13.407 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.405+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request con 0x7f6eb8024420 auth_method 0 2026-02-12T18:15:13.407 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.405+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:13.407 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.405+0000 7f6ed27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:13.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.405+0000 7f6ed27fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:15:13.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.405+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6eb8024420 msgr2=0x7f6eb80448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:15:13.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.405+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6eb8024420 msgr2=0x7f6eb80448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:15:13.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.405+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6eb8024420 0x7f6eb80448a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=25 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:15:13.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.405+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6eb8024420 0x7f6eb80448a0 unknown :-1 s=START_CONNECT pgs=0 gs=27 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:15:13.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.405+0000 7f6ed37fe640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6eb8044f90 msgr2=0x7f6eb8065410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:15:13.408 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:13.405+0000 7f6ed37fe640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6eb8044f90 0x7f6eb8065410 unknown :-1 s=START_CONNECT pgs=0 gs=28 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:15:14.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:14.206+0000 7f6ed2ffd640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6eb8003960 0x7f6eb8023d80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=29 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:14.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:14.206+0000 7f6ed2ffd640 10 monclient(hunting): get_auth_request con 0x7f6eb8003960 auth_method 0 2026-02-12T18:15:14.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:14.206+0000 7f6ed2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:14.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:14.206+0000 7f6ed2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:14.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:14.206+0000 7f6ed2ffd640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:15:14.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:14.206+0000 7f6ed2ffd640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6eb8003960 msgr2=0x7f6eb8023d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:15:14.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:14.206+0000 7f6ed2ffd640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6eb8003960 msgr2=0x7f6eb8023d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:15:14.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:14.206+0000 7f6ed2ffd640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6eb8003960 0x7f6eb8023d80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=29 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:15:14.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:14.206+0000 7f6ed2ffd640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6eb8003960 0x7f6eb8023d80 unknown :-1 s=START_CONNECT pgs=0 gs=30 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:15:14.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:14.206+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6eb8024420 0x7f6eb80448a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=31 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:14.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:14.206+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request con 0x7f6eb8024420 auth_method 0 2026-02-12T18:15:14.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:14.206+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:14.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:14.206+0000 7f6ed27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:14.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:14.206+0000 7f6ed27fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:15:14.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:14.206+0000 7f6ed37fe640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6eb8044f90 msgr2=0x7f6eb8065410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:15:14.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:14.206+0000 7f6ed37fe640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6eb8044f90 0x7f6eb8065410 unknown :-1 s=START_CONNECT pgs=0 gs=32 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:15:14.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:14.206+0000 7f6ed1ffb640 1 -- 10.20.193.48:0/1620085484 DispatchQueue::entry inject delay of 0.002000 2026-02-12T18:15:14.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:14.206+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6eb8024420 msgr2=0x7f6eb80448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:15:14.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:14.206+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6eb8024420 msgr2=0x7f6eb80448a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:15:14.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:14.206+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6eb8024420 0x7f6eb80448a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=31 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:15:14.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:14.206+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6eb8024420 0x7f6eb80448a0 unknown :-1 s=START_CONNECT pgs=0 gs=33 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:15:15.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed0ff9640 10 monclient(hunting): tick 2026-02-12T18:15:15.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed0ff9640 10 monclient(hunting): _check_auth_tickets 2026-02-12T18:15:15.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed0ff9640 1 monclient(hunting): continuing hunt 2026-02-12T18:15:15.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed0ff9640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T18:15:15.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed0ff9640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6eb8044f90 msgr2=0x7f6eb8065410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:15:15.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed0ff9640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6eb8044f90 0x7f6eb8065410 unknown :-1 s=START_CONNECT pgs=0 gs=32 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:15.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed0ff9640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6eb8003960 msgr2=0x7f6eb8023d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:15:15.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed0ff9640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6eb8003960 0x7f6eb8023d80 unknown :-1 s=START_CONNECT pgs=0 gs=30 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:15.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed0ff9640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6eb8024420 msgr2=0x7f6eb80448a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:15:15.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed0ff9640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6eb8024420 0x7f6eb80448a0 unknown :-1 s=START_CONNECT pgs=0 gs=33 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:15.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed37fe640 1 -- 10.20.193.48:0/1620085484 reap_dead start 2026-02-12T18:15:15.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed0ff9640 10 monclient: _add_conns ranks=[0,2,9,8,7] 2026-02-12T18:15:15.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed0ff9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f6eb8045400 addr v1:10.20.193.48:6789/0 2026-02-12T18:15:15.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed0ff9640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6eb8005450 0x7f6eb8005850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:15.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed0ff9640 10 monclient(hunting): picked mon.noname-b con 0x7f6eb8005450 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:15:15.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed0ff9640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.48:3300/0 conn(0x7f6eb8005e50 0x7f6eb80062b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:15.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed0ff9640 10 monclient(hunting): picked mon.noname-a con 0x7f6eb8005e50 addr v2:10.20.193.48:3300/0 2026-02-12T18:15:15.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed0ff9640 1 -- 10.20.193.48:0/1620085484 --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ed4093e90 con 0x7f6eb8045400 2026-02-12T18:15:15.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed0ff9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:15.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed0ff9640 1 -- 10.20.193.48:0/1620085484 --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f6ed40580a0 con 0x7f6eb8005e50 2026-02-12T18:15:15.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed0ff9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:15.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed0ff9640 1 -- 10.20.193.48:0/1620085484 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f6ed405e3f0 con 0x7f6eb8005450 2026-02-12T18:15:15.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed0ff9640 10 monclient(hunting): _renew_subs 2026-02-12T18:15:15.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6eb8005450 0x7f6eb8005850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=35 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:15.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed37fe640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.48:3300/0 conn(0x7f6eb8005e50 0x7f6eb80062b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=36 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:15.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request con 0x7f6eb8005450 auth_method 0 2026-02-12T18:15:15.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:15.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:15.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:15.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed37fe640 10 monclient(hunting): get_auth_request con 0x7f6eb8005e50 auth_method 0 2026-02-12T18:15:15.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:15.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:15.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed37fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:15.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6eb8005450 msgr2=0x7f6eb8005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:15:15.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6eb8005450 msgr2=0x7f6eb8005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:15:15.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6eb8005450 0x7f6eb8005850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=35 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:15:15.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6eb8005450 0x7f6eb8005850 unknown :-1 s=START_CONNECT pgs=0 gs=37 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:15:15.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed37fe640 1 -- 10.20.193.48:0/1620085484 >> v2:10.20.193.48:3300/0 conn(0x7f6eb8005e50 msgr2=0x7f6eb80062b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-12T18:15:15.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed37fe640 1 -- 10.20.193.48:0/1620085484 >> v2:10.20.193.48:3300/0 conn(0x7f6eb8005e50 msgr2=0x7f6eb80062b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:15:15.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed37fe640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.48:3300/0 conn(0x7f6eb8005e50 0x7f6eb80062b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=36 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:15:15.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.801+0000 7f6ed37fe640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.48:3300/0 conn(0x7f6eb8005e50 0x7f6eb80062b0 unknown :-1 s=START_CONNECT pgs=0 gs=38 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:15:15.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:15.803+0000 7f6ed2ffd640 1 -- 10.20.193.48:0/1620085484 >> v1:10.20.193.48:6789/0 conn(0x7f6eb8045400 legacy=0x7f6eb8003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:16.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.002+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6eb8005450 0x7f6eb8005850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=39 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:16.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.002+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request con 0x7f6eb8005450 auth_method 0 2026-02-12T18:15:16.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.002+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:16.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.002+0000 7f6ed27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:16.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.002+0000 7f6ed27fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:15:16.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.002+0000 7f6ed37fe640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.48:3300/0 conn(0x7f6eb8005e50 0x7f6eb80062b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=40 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:16.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.002+0000 7f6ed37fe640 10 monclient(hunting): get_auth_request con 0x7f6eb8005e50 auth_method 0 2026-02-12T18:15:16.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.002+0000 7f6ed37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:16.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.002+0000 7f6ed37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:16.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.002+0000 7f6ed37fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:15:16.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.002+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6eb8005450 msgr2=0x7f6eb8005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:15:16.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.002+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6eb8005450 msgr2=0x7f6eb8005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:15:16.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.002+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6eb8005450 0x7f6eb8005850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=39 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:15:16.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.002+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6eb8005450 0x7f6eb8005850 unknown :-1 s=START_CONNECT pgs=0 gs=41 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:15:16.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.002+0000 7f6ed37fe640 1 -- 10.20.193.48:0/1620085484 >> v2:10.20.193.48:3300/0 conn(0x7f6eb8005e50 msgr2=0x7f6eb80062b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-12T18:15:16.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.002+0000 7f6ed37fe640 1 -- 10.20.193.48:0/1620085484 >> v2:10.20.193.48:3300/0 conn(0x7f6eb8005e50 msgr2=0x7f6eb80062b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:15:16.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.002+0000 7f6ed37fe640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.48:3300/0 conn(0x7f6eb8005e50 0x7f6eb80062b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=40 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:15:16.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.002+0000 7f6ed37fe640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.48:3300/0 conn(0x7f6eb8005e50 0x7f6eb80062b0 unknown :-1 s=START_CONNECT pgs=0 gs=42 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:15:16.404 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.403+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6eb8005450 0x7f6eb8005850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=43 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:16.404 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.403+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request con 0x7f6eb8005450 auth_method 0 2026-02-12T18:15:16.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.403+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:16.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.403+0000 7f6ed27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:16.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.403+0000 7f6ed27fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:15:16.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.403+0000 7f6ed37fe640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.48:3300/0 conn(0x7f6eb8005e50 0x7f6eb80062b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=44 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:16.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.403+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6eb8005450 msgr2=0x7f6eb8005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:15:16.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.403+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6eb8005450 msgr2=0x7f6eb8005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:15:16.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.403+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6eb8005450 0x7f6eb8005850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=43 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:15:16.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.403+0000 7f6ed37fe640 10 monclient(hunting): get_auth_request con 0x7f6eb8005e50 auth_method 0 2026-02-12T18:15:16.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.403+0000 7f6ed37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:16.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.403+0000 7f6ed37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:16.406 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.403+0000 7f6ed37fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:15:16.406 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.403+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6eb8005450 0x7f6eb8005850 unknown :-1 s=START_CONNECT pgs=0 gs=45 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:15:16.406 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.403+0000 7f6ed37fe640 1 -- 10.20.193.48:0/1620085484 >> v2:10.20.193.48:3300/0 conn(0x7f6eb8005e50 msgr2=0x7f6eb80062b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 12 2026-02-12T18:15:16.406 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.403+0000 7f6ed37fe640 1 -- 10.20.193.48:0/1620085484 >> v2:10.20.193.48:3300/0 conn(0x7f6eb8005e50 msgr2=0x7f6eb80062b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:15:16.406 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.403+0000 7f6ed37fe640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.48:3300/0 conn(0x7f6eb8005e50 0x7f6eb80062b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=44 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:15:16.406 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:16.403+0000 7f6ed37fe640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.48:3300/0 conn(0x7f6eb8005e50 0x7f6eb80062b0 unknown :-1 s=START_CONNECT pgs=0 gs=46 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:15:17.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:17.204+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6eb8005450 0x7f6eb8005850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=47 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:17.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:17.204+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request con 0x7f6eb8005450 auth_method 0 2026-02-12T18:15:17.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:17.204+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:17.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:17.204+0000 7f6ed27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:17.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:17.204+0000 7f6ed27fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:15:17.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:17.204+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6eb8005450 msgr2=0x7f6eb8005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:15:17.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:17.204+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6eb8005450 msgr2=0x7f6eb8005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:15:17.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:17.204+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6eb8005450 0x7f6eb8005850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=47 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:15:17.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:17.204+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6eb8005450 0x7f6eb8005850 unknown :-1 s=START_CONNECT pgs=0 gs=48 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:15:17.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:17.204+0000 7f6ed37fe640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.48:3300/0 conn(0x7f6eb8005e50 0x7f6eb80062b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=49 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:17.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:17.204+0000 7f6ed37fe640 10 monclient(hunting): get_auth_request con 0x7f6eb8005e50 auth_method 0 2026-02-12T18:15:17.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:17.204+0000 7f6ed37fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:17.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:17.204+0000 7f6ed37fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:17.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:17.204+0000 7f6ed37fe640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:15:17.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:17.204+0000 7f6ed37fe640 1 -- 10.20.193.48:0/1620085484 >> v2:10.20.193.48:3300/0 conn(0x7f6eb8005e50 msgr2=0x7f6eb80062b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:15:17.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:17.204+0000 7f6ed37fe640 1 -- 10.20.193.48:0/1620085484 >> v2:10.20.193.48:3300/0 conn(0x7f6eb8005e50 msgr2=0x7f6eb80062b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:15:17.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:17.204+0000 7f6ed37fe640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.48:3300/0 conn(0x7f6eb8005e50 0x7f6eb80062b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=49 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:15:17.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:17.204+0000 7f6ed37fe640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.48:3300/0 conn(0x7f6eb8005e50 0x7f6eb80062b0 unknown :-1 s=START_CONNECT pgs=0 gs=50 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:15:18.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed0ff9640 10 monclient(hunting): tick 2026-02-12T18:15:18.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed0ff9640 10 monclient(hunting): _check_auth_tickets 2026-02-12T18:15:18.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed0ff9640 1 monclient(hunting): continuing hunt 2026-02-12T18:15:18.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed0ff9640 10 monclient(hunting): _reopen_session rank -1 2026-02-12T18:15:18.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed0ff9640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6eb8005450 msgr2=0x7f6eb8005850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:15:18.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed0ff9640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6eb8005450 0x7f6eb8005850 unknown :-1 s=START_CONNECT pgs=0 gs=48 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:18.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed0ff9640 1 -- 10.20.193.48:0/1620085484 >> v2:10.20.193.48:3300/0 conn(0x7f6eb8005e50 msgr2=0x7f6eb80062b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:15:18.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed0ff9640 1 --2- 10.20.193.48:0/1620085484 >> v2:10.20.193.48:3300/0 conn(0x7f6eb8005e50 0x7f6eb80062b0 unknown :-1 s=START_CONNECT pgs=0 gs=50 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:18.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed0ff9640 1 -- 10.20.193.48:0/1620085484 >> v1:10.20.193.48:6789/0 conn(0x7f6eb8045400 legacy=0x7f6eb8003d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:18.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed0ff9640 10 monclient: _add_conns ranks=[7,8] 2026-02-12T18:15:18.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed0ff9640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6eb8006b30 0x7f6eb8006f00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:18.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed0ff9640 10 monclient(hunting): picked mon.noname-i con 0x7f6eb8006b30 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:15:18.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed0ff9640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6eb80075b0 0x7f6eb8007c60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:18.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed0ff9640 10 monclient(hunting): picked mon.noname-e con 0x7f6eb80075b0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:15:18.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed0ff9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:18.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed0ff9640 1 -- 10.20.193.48:0/1620085484 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f6ed40580a0 con 0x7f6eb8006b30 2026-02-12T18:15:18.805 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed0ff9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:18.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed0ff9640 1 -- 10.20.193.48:0/1620085484 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f6ed405e3f0 con 0x7f6eb80075b0 2026-02-12T18:15:18.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed0ff9640 10 monclient(hunting): _renew_subs 2026-02-12T18:15:18.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed2ffd640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6eb8006b30 msgr2=0x7f6eb8006f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3303/0 2026-02-12T18:15:18.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed2ffd640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6eb8006b30 0x7f6eb8006f00 unknown :-1 s=START_CONNECT pgs=0 gs=52 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:15:18.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6eb80075b0 0x7f6eb8007c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=51 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:18.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request con 0x7f6eb80075b0 auth_method 0 2026-02-12T18:15:18.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:18.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:18.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:18.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6eb80075b0 msgr2=0x7f6eb8007c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:15:18.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6eb80075b0 msgr2=0x7f6eb8007c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:15:18.806 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6eb80075b0 0x7f6eb8007c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=51 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:15:18.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:18.801+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6eb80075b0 0x7f6eb8007c60 unknown :-1 s=START_CONNECT pgs=0 gs=53 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:15:19.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:19.002+0000 7f6ed2ffd640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6eb8006b30 msgr2=0x7f6eb8006f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3303/0 2026-02-12T18:15:19.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:19.002+0000 7f6ed2ffd640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6eb8006b30 0x7f6eb8006f00 unknown :-1 s=START_CONNECT pgs=0 gs=54 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:15:19.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:19.002+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6eb80075b0 0x7f6eb8007c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=55 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:19.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:19.002+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request con 0x7f6eb80075b0 auth_method 0 2026-02-12T18:15:19.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:19.002+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:19.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:19.002+0000 7f6ed27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:19.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:19.002+0000 7f6ed27fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:15:19.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:19.002+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6eb80075b0 msgr2=0x7f6eb8007c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:15:19.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:19.002+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6eb80075b0 msgr2=0x7f6eb8007c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:15:19.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:19.002+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6eb80075b0 0x7f6eb8007c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=55 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:15:19.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:19.002+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6eb80075b0 0x7f6eb8007c60 unknown :-1 s=START_CONNECT pgs=0 gs=56 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2026-02-12T18:15:19.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:19.403+0000 7f6ed2ffd640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6eb8006b30 msgr2=0x7f6eb8006f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3303/0 2026-02-12T18:15:19.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:19.403+0000 7f6ed2ffd640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6eb8006b30 0x7f6eb8006f00 unknown :-1 s=START_CONNECT pgs=0 gs=57 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:15:19.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:19.403+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6eb80075b0 0x7f6eb8007c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=58 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:19.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:19.403+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request con 0x7f6eb80075b0 auth_method 0 2026-02-12T18:15:19.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:19.403+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:19.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:19.403+0000 7f6ed27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:19.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:19.403+0000 7f6ed27fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:15:19.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:19.403+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6eb80075b0 msgr2=0x7f6eb8007c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:15:19.405 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:19.403+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6eb80075b0 msgr2=0x7f6eb8007c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:15:19.406 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:19.403+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6eb80075b0 0x7f6eb8007c60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=58 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:15:19.406 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:19.403+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6eb80075b0 0x7f6eb8007c60 unknown :-1 s=START_CONNECT pgs=0 gs=59 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2026-02-12T18:15:19.973 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:15:19.973 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[32488]: starting. 2026-02-12T18:15:19.973 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[32488]: deleting pool ceph_test_rados_delete_pools_parallel.trial111-32452 2026-02-12T18:15:19.973 INFO:teuthology.orchestra.run.trial111.stdout:process_4_[32488]: shutting down. 2026-02-12T18:15:19.974 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:15:19.974 INFO:teuthology.orchestra.run.trial111.stdout:******************************* 2026-02-12T18:15:19.974 INFO:teuthology.orchestra.run.trial111.stdout:******* SUCCESS ********** 2026-02-12T18:15:19.976 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2026-02-12T18:15:19.990 INFO:tasks.mon_thrash:joining mon_thrasher 2026-02-12T18:15:20.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.204+0000 7f6ed2ffd640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6eb8006b30 msgr2=0x7f6eb8006f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3303/0 2026-02-12T18:15:20.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.204+0000 7f6ed2ffd640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6eb8006b30 0x7f6eb8006f00 unknown :-1 s=START_CONNECT pgs=0 gs=60 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2026-02-12T18:15:20.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.204+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6eb80075b0 0x7f6eb8007c60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=61 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.204+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request con 0x7f6eb80075b0 auth_method 0 2026-02-12T18:15:20.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.204+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:20.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.204+0000 7f6ed27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:20.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.204+0000 7f6ed27fc640 10 monclient(hunting): _init_auth already have auth, reseting 2026-02-12T18:15:20.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.204+0000 7f6ed27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:20.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.204+0000 7f6ed27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:20.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.204+0000 7f6ed27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:20.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.204+0000 7f6ed27fc640 10 monclient(hunting): handle_auth_done global_id 94859 payload 274 2026-02-12T18:15:20.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.204+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6eb8006b30 msgr2=0x7f6eb8006f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:15:20.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.204+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6eb8006b30 0x7f6eb8006f00 unknown :-1 s=START_CONNECT pgs=0 gs=60 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.204+0000 7f6ed27fc640 10 monclient: _finish_hunting 0 2026-02-12T18:15:20.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.204+0000 7f6ed27fc640 1 monclient: found mon.noname-e 2026-02-12T18:15:20.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.204+0000 7f6ed37fe640 1 -- 10.20.193.48:0/1620085484 reap_dead start 2026-02-12T18:15:20.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.204+0000 7f6ed27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:15:20.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.204+0000 7f6ed27fc640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:15:20.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.204+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb8007a30 con 0x7f6eb80075b0 2026-02-12T18:15:20.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.207+0000 7f6ed27fc640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6eb80075b0 msgr2=0x7f6eb8007c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:20.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.207+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6eb80075b0 0x7f6eb8007c60 secure :-1 s=READY pgs=151 gs=61 cs=0 l=1 c_cookie=3290941935637447663 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ebc004710 tx=0x7f6ebc031b00 comp rx=0 tx=0).ready entity=mon.8 client_cookie=2dabc6411a1b43ef server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:20.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.207+0000 7f6ed1ffb640 1 -- 10.20.193.48:0/1620085484 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6ebc036ca0 con 0x7f6eb80075b0 2026-02-12T18:15:20.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.207+0000 7f6ed1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:20.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.207+0000 7f6ed1ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:15:20.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.207+0000 7f6ed1ffb640 10 monclient: dump: 2026-02-12T18:15:20.214 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:20.214 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.214 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.214 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.214 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:20.214 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.215 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:20.215 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:20.215 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:20.215 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:20.215 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:20.215 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:20.215 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:20.215 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:20.215 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:20.215 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.207+0000 7f6ed1ffb640 10 monclient: _finish_auth 0 2026-02-12T18:15:20.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.207+0000 7f6ed1ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:15:20.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.207+0000 7f6ed1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:15:20.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.207+0000 7f6ed1ffb640 1 -- 10.20.193.48:0/1620085484 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ebc01e040 con 0x7f6eb80075b0 2026-02-12T18:15:20.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.207+0000 7f6ed9447640 5 monclient: authenticate success, global_id 94859 2026-02-12T18:15:20.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.207+0000 7f6ed9447640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:15:20.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.207+0000 7f6ed1ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:15:20.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.207+0000 7f6ed1ffb640 1 -- 10.20.193.48:0/1620085484 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6ebc036e40 con 0x7f6eb80075b0 2026-02-12T18:15:20.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.207+0000 7f6ed9447640 10 monclient: get_monmap_and_config success 2026-02-12T18:15:20.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.207+0000 7f6ed9447640 4 set_mon_vals no callback set 2026-02-12T18:15:20.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.207+0000 7f6ed1ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:20.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.207+0000 7f6ed1ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:15:20.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.207+0000 7f6ed1ffb640 10 monclient: dump: 2026-02-12T18:15:20.216 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:20.217 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.217 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.217 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.217 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:20.217 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.217 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:20.217 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:20.217 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:20.217 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:20.217 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:20.217 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:20.217 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:20.218 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:20.218 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:20.218 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.208+0000 7f6ed9447640 10 monclient: shutdown 2026-02-12T18:15:20.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.208+0000 7f6ed9447640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:15:20.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.208+0000 7f6ed9447640 1 -- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6eb80075b0 msgr2=0x7f6eb8007c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:20.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.208+0000 7f6ed9447640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6eb80075b0 0x7f6eb8007c60 secure :-1 s=READY pgs=151 gs=61 cs=0 l=1 c_cookie=3290941935637447663 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ebc004710 tx=0x7f6ebc031b00 comp rx=0 tx=0).stop 2026-02-12T18:15:20.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.208+0000 7f6ed9447640 1 -- 10.20.193.48:0/1620085484 shutdown_connections 2026-02-12T18:15:20.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.208+0000 7f6ed9447640 1 --2- 10.20.193.48:0/1620085484 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6eb80075b0 0x7f6eb8007c60 unknown :-1 s=CLOSED pgs=151 gs=61 cs=0 l=1 c_cookie=3290941935637447663 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.208+0000 7f6ed9447640 1 -- 10.20.193.48:0/1620085484 >> 10.20.193.48:0/1620085484 conn(0x7f6ed4054b30 msgr2=0x7f6ed4093070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:15:20.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.208+0000 7f6ed9447640 1 -- 10.20.193.48:0/1620085484 shutdown_connections 2026-02-12T18:15:20.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.208+0000 7f6ed9447640 1 -- 10.20.193.48:0/1620085484 wait complete. 2026-02-12T18:15:20.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.209+0000 7f6ed9447640 10 monclient: build_initial_monmap 2026-02-12T18:15:20.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.209+0000 7f6ed9447640 10 monclient: monmap: 2026-02-12T18:15:20.219 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:15:20.219 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:15:20.219 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:15:20.219 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:15:20.219 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:15:20.219 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.219 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:15:20.219 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:15:20.219 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:15:20.219 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:15:20.220 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:15:20.220 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:15:20.220 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:15:20.220 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:15:20.220 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:15:20.220 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.209+0000 7f6ed9447640 1 Processor -- start 2026-02-12T18:15:20.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.209+0000 7f6ed9447640 1 -- start start 2026-02-12T18:15:20.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.209+0000 7f6ed9447640 10 monclient: init 2026-02-12T18:15:20.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed9447640 10 monclient: _reopen_session rank -1 2026-02-12T18:15:20.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed9447640 10 monclient: _add_conns ranks=[1,8,6,0,5,3,4,7,2] 2026-02-12T18:15:20.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed9447640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f6ed408a570 0x7f6ed408a940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed9447640 10 monclient(hunting): picked mon.noname-f con 0x7f6ed408a570 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:15:20.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed9447640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6ed405cc90 0x7f6ed408ae80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed9447640 10 monclient(hunting): picked mon.noname-e con 0x7f6ed405cc90 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:15:20.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed9447640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6ed4130440 0x7f6ed410daa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed9447640 10 monclient(hunting): picked mon.noname-d con 0x7f6ed4130440 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:15:20.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed9447640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed9447640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f6ed410a140 con 0x7f6ed408a570 2026-02-12T18:15:20.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed9447640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed9447640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f6ed413db80 con 0x7f6ed4130440 2026-02-12T18:15:20.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed9447640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed9447640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f6ed40908b0 con 0x7f6ed405cc90 2026-02-12T18:15:20.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed9447640 10 monclient(hunting): _renew_subs 2026-02-12T18:15:20.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed9447640 10 monclient(hunting): authenticate will time out at 1158.936299s 2026-02-12T18:15:20.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed37fe640 1 -- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6ed4130440 msgr2=0x7f6ed410daa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.48:3303/0 2026-02-12T18:15:20.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed37fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6ed4130440 0x7f6ed410daa0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:15:20.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed27fc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6ed405cc90 0x7f6ed408ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed27fc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6ed405cc90 0x7f6ed408ae80 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:47120/0 (socket says 10.20.193.48:47120) 2026-02-12T18:15:20.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed27fc640 1 -- 10.20.193.48:0/3409526329 learned_addr learned my addr 10.20.193.48:0/3409526329 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:15:20.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request con 0x7f6ed405cc90 auth_method 0 2026-02-12T18:15:20.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed27fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:20.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed27fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:20.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed27fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:20.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed27fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:20.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed27fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:20.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed27fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:20.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed2ffd640 1 --2- 10.20.193.48:0/3409526329 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f6ed408a570 0x7f6ed408a940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed2ffd640 10 monclient(hunting): get_auth_request con 0x7f6ed408a570 auth_method 0 2026-02-12T18:15:20.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed2ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:20.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed2ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:20.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed2ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:20.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed27fc640 10 monclient(hunting): handle_auth_done global_id 94868 payload 824 2026-02-12T18:15:20.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed27fc640 1 -- 10.20.193.48:0/3409526329 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6ed4130440 msgr2=0x7f6ed410daa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:15:20.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/3409526329 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6ed4130440 0x7f6ed410daa0 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed27fc640 1 -- 10.20.193.48:0/3409526329 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f6ed408a570 msgr2=0x7f6ed408a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:20.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/3409526329 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f6ed408a570 0x7f6ed408a940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed27fc640 10 monclient: _finish_hunting 0 2026-02-12T18:15:20.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed27fc640 1 monclient: found mon.noname-e 2026-02-12T18:15:20.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:15:20.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed27fc640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:15:20.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.210+0000 7f6ed27fc640 1 -- 10.20.193.48:0/3409526329 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ebc00e040 con 0x7f6ed405cc90 2026-02-12T18:15:20.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.212+0000 7f6ed27fc640 1 -- 10.20.193.48:0/3409526329 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6ed405cc90 msgr2=0x7f6ed408ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:20.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.212+0000 7f6ed27fc640 1 --2- 10.20.193.48:0/3409526329 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6ed405cc90 0x7f6ed408ae80 secure :-1 s=READY pgs=152 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ebc004190 tx=0x7f6ebc004770 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:20.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.213+0000 7f6eb37fe640 1 -- 10.20.193.48:0/3409526329 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6ebc044040 con 0x7f6ed405cc90 2026-02-12T18:15:20.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.213+0000 7f6eb37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:20.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.213+0000 7f6eb37fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:15:20.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.213+0000 7f6eb37fe640 10 monclient: dump: 2026-02-12T18:15:20.227 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:20.227 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.227 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.228 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.228 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:20.228 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.228 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:20.228 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:20.228 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:20.228 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:20.228 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:20.228 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:20.228 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:20.228 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:20.228 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:20.229 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.213+0000 7f6eb37fe640 10 monclient: _finish_auth 0 2026-02-12T18:15:20.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.213+0000 7f6eb37fe640 10 monclient: _check_auth_tickets 2026-02-12T18:15:20.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.213+0000 7f6eb37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:15:20.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.213+0000 7f6eb37fe640 1 -- 10.20.193.48:0/3409526329 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ebc00c040 con 0x7f6ed405cc90 2026-02-12T18:15:20.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.213+0000 7f6ed9447640 5 monclient: authenticate success, global_id 94868 2026-02-12T18:15:20.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.213+0000 7f6ed9447640 10 monclient: _renew_subs 2026-02-12T18:15:20.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.213+0000 7f6ed9447640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:15:20.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.213+0000 7f6ed9447640 1 -- 10.20.193.48:0/3409526329 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ed408ba70 con 0x7f6ed405cc90 2026-02-12T18:15:20.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.213+0000 7f6eb37fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:15:20.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.213+0000 7f6eb37fe640 1 -- 10.20.193.48:0/3409526329 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6ebc004300 con 0x7f6ed405cc90 2026-02-12T18:15:20.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.213+0000 7f6eb37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:20.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.213+0000 7f6eb37fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:15:20.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.213+0000 7f6ed17fa640 4 set_mon_vals no callback set 2026-02-12T18:15:20.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.213+0000 7f6eb37fe640 10 monclient: dump: 2026-02-12T18:15:20.230 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:20.230 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.230 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.230 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.230 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:20.230 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.230 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:20.230 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:20.230 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:20.231 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:20.231 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:20.231 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:20.231 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:20.231 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:20.231 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:20.231 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.213+0000 7f6ed9447640 10 monclient: _renew_subs 2026-02-12T18:15:20.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.213+0000 7f6ed9447640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:15:20.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.213+0000 7f6ed9447640 1 -- 10.20.193.48:0/3409526329 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ed408b3c0 con 0x7f6ed405cc90 2026-02-12T18:15:20.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.213+0000 7f6ed9447640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:15:20.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.213+0000 7f6ed9447640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:15:20.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.213+0000 7f6ed9447640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:15:20.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.213+0000 7f6ed9447640 1 -- 10.20.193.48:0/3409526329 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ed40008d0 con 0x7f6ed405cc90 2026-02-12T18:15:20.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.213+0000 7f6eb37fe640 1 -- 10.20.193.48:0/3409526329 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f6ebc03fc20 con 0x7f6ed405cc90 2026-02-12T18:15:20.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.214+0000 7f6eb37fe640 1 --2- 10.20.193.48:0/3409526329 >> v2:10.20.193.111:6812/977811348 conn(0x7f6ea003f7c0 0x7f6ea005fc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.214+0000 7f6eb37fe640 1 -- 10.20.193.48:0/3409526329 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(321..321 src has 215..321) ==== 3503+0+0 (secure 0 0 0) 0x7f6ebc07a670 con 0x7f6ed405cc90 2026-02-12T18:15:20.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.214+0000 7f6ed2ffd640 1 --2- 10.20.193.48:0/3409526329 >> v2:10.20.193.111:6812/977811348 conn(0x7f6ea003f7c0 0x7f6ea005fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.214+0000 7f6ed2ffd640 10 monclient: get_auth_request con 0x7f6ea003f7c0 auth_method 0 2026-02-12T18:15:20.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.216+0000 7f6eb37fe640 1 -- 10.20.193.48:0/3409526329 <== mon.8 v2:10.20.193.48:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f6ebc036d70 con 0x7f6ed405cc90 2026-02-12T18:15:20.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.216+0000 7f6eb37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:15:20.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.216+0000 7f6eb37fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:15:20.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.216+0000 7f6ed2ffd640 1 --2- 10.20.193.48:0/3409526329 >> v2:10.20.193.111:6812/977811348 conn(0x7f6ea003f7c0 0x7f6ea005fc70 secure :-1 s=READY pgs=461 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ec80023d0 tx=0x7f6ec8009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:20.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.363+0000 7f6ed9447640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T18:15:20.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.363+0000 7f6ed9447640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T18:15:20.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.363+0000 7f6ed9447640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:15:20.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.363+0000 7f6ed9447640 1 -- 10.20.193.48:0/3409526329 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6ed408b580 con 0x7f6ed405cc90 2026-02-12T18:15:20.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.364+0000 7f6eb37fe640 1 -- 10.20.193.48:0/3409526329 <== mon.8 v2:10.20.193.48:3304/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3642 (secure 0 0 0) 0x7f6ebc04f070 con 0x7f6ed405cc90 2026-02-12T18:15:20.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.364+0000 7f6eb37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T18:15:20.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.364+0000 7f6eb37fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:15:20.366 INFO:teuthology.orchestra.run.trial048.stdout:{"election_epoch":86,"quorum":[0,1,2,3,4,8],"quorum_names":["a","f","b","g","c","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","modified":"2026-02-12T18:05:32.850777Z","created":"2026-02-12T18:05:32.850777Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3300","nonce":0},{"type":"v1","addr":"10.20.193.48:6789","nonce":0}]},"addr":"10.20.193.48:6789/0","public_addr":"10.20.193.48:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850827+0000","crush_location":[]},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3300","nonce":0},{"type":"v1","addr":"10.20.193.111:6789","nonce":0}]},"addr":"10.20.193.111:6789/0","public_addr":"10.20.193.111:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850829+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3301","nonce":0},{"type":"v1","addr":"10.20.193.48:6790","nonce":0}]},"addr":"10.20.193.48:6790/0","public_addr":"10.20.193.48:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850830+0000","crush_location":[]},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3301","nonce":0},{"type":"v1","addr":"10.20.193.111:6790","nonce":0}]},"addr":"10.20.193.111:6790/0","public_addr":"10.20.193.111:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850833+0000","crush_location":[]},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3302","nonce":0},{"type":"v1","addr":"10.20.193.48:6791","nonce":0}]},"addr":"10.20.193.48:6791/0","public_addr":"10.20.193.48:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3302","nonce":0},{"type":"v1","addr":"10.20.193.111:6791","nonce":0}]},"addr":"10.20.193.111:6791/0","public_addr":"10.20.193.111:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850834+0000","crush_location":[]},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3303","nonce":0},{"type":"v1","addr":"10.20.193.48:6792","nonce":0}]},"addr":"10.20.193.48:6792/0","public_addr":"10.20.193.48:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3303","nonce":0},{"type":"v1","addr":"10.20.193.111:6792","nonce":0}]},"addr":"10.20.193.111:6792/0","public_addr":"10.20.193.111:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850835+0000","crush_location":[]},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3304","nonce":0},{"type":"v1","addr":"10.20.193.48:6793","nonce":0}]},"addr":"10.20.193.48:6793/0","public_addr":"10.20.193.48:6793/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850832+0000","crush_location":[]}]}} 2026-02-12T18:15:20.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.365+0000 7f6ed9447640 1 -- 10.20.193.48:0/3409526329 >> v2:10.20.193.111:6812/977811348 conn(0x7f6ea003f7c0 msgr2=0x7f6ea005fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:20.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.365+0000 7f6ed9447640 1 --2- 10.20.193.48:0/3409526329 >> v2:10.20.193.111:6812/977811348 conn(0x7f6ea003f7c0 0x7f6ea005fc70 secure :-1 s=READY pgs=461 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ec80023d0 tx=0x7f6ec8009040 comp rx=0 tx=0).stop 2026-02-12T18:15:20.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.365+0000 7f6ed9447640 10 monclient: shutdown 2026-02-12T18:15:20.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.365+0000 7f6ed9447640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:15:20.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.365+0000 7f6ed9447640 1 -- 10.20.193.48:0/3409526329 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6ed405cc90 msgr2=0x7f6ed408ae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:20.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.365+0000 7f6ed9447640 1 --2- 10.20.193.48:0/3409526329 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6ed405cc90 0x7f6ed408ae80 secure :-1 s=READY pgs=152 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6ebc004190 tx=0x7f6ebc004770 comp rx=0 tx=0).stop 2026-02-12T18:15:20.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.365+0000 7f6ed9447640 1 -- 10.20.193.48:0/3409526329 shutdown_connections 2026-02-12T18:15:20.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.365+0000 7f6ed9447640 1 --2- 10.20.193.48:0/3409526329 >> v2:10.20.193.111:6812/977811348 conn(0x7f6ea003f7c0 0x7f6ea005fc70 unknown :-1 s=CLOSED pgs=461 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.365+0000 7f6ed9447640 1 --2- 10.20.193.48:0/3409526329 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f6ed4130440 0x7f6ed410daa0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.365+0000 7f6ed9447640 1 --2- 10.20.193.48:0/3409526329 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f6ed405cc90 0x7f6ed408ae80 unknown :-1 s=CLOSED pgs=152 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.365+0000 7f6ed9447640 1 --2- 10.20.193.48:0/3409526329 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f6ed408a570 0x7f6ed408a940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.365+0000 7f6ed9447640 1 -- 10.20.193.48:0/3409526329 >> 10.20.193.48:0/3409526329 conn(0x7f6ed4054b30 msgr2=0x7f6ed413d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:15:20.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.365+0000 7f6ed9447640 1 -- 10.20.193.48:0/3409526329 shutdown_connections 2026-02-12T18:15:20.368 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.365+0000 7f6ed9447640 1 -- 10.20.193.48:0/3409526329 wait complete. 2026-02-12T18:15:20.375 INFO:tasks.mon_thrash.ceph_manager:quorum is size 6 2026-02-12T18:15:20.376 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon a 2026-02-12T18:15:20.376 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T18:15:20.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.442+0000 7fae9790c640 10 monclient: get_monmap_and_config 2026-02-12T18:15:20.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.442+0000 7fae9790c640 10 monclient: build_initial_monmap 2026-02-12T18:15:20.445 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.442+0000 7fae9790c640 10 monclient: monmap: 2026-02-12T18:15:20.445 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:15:20.445 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.445 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:15:20.443983+0000 2026-02-12T18:15:20.445 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:15:20.443983+0000 2026-02-12T18:15:20.445 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:15:20.445 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.445 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:15:20.445 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:15:20.445 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:15:20.445 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:15:20.446 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:15:20.446 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:15:20.446 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:15:20.446 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:15:20.446 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:15:20.446 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:15:20.446 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:15:20.446 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae9790c640 1 Processor -- start 2026-02-12T18:15:20.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae9790c640 1 -- start start 2026-02-12T18:15:20.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae9790c640 10 monclient: init 2026-02-12T18:15:20.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae9790c640 10 monclient: _reopen_session rank -1 2026-02-12T18:15:20.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae9790c640 10 monclient: _add_conns ranks=[6,2,1,9,0,3,10,7,8,4,5] 2026-02-12T18:15:20.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae9790c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fae9005c950 0x7fae9005cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae9790c640 10 monclient(hunting): picked mon.noname-d con 0x7fae9005c950 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:15:20.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae9790c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fae9005e490 0x7fae9005d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae9790c640 10 monclient(hunting): picked mon.noname-b con 0x7fae9005e490 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:15:20.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae9790c640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fae9013db70 addr v1:10.20.193.111:6789/0 2026-02-12T18:15:20.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae9790c640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae9004dc20 con 0x7fae9013db70 2026-02-12T18:15:20.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae9790c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae9790c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fae9005ddd0 con 0x7fae9005e490 2026-02-12T18:15:20.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae9790c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae9790c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fae9005d7a0 con 0x7fae9005c950 2026-02-12T18:15:20.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae9790c640 10 monclient(hunting): _renew_subs 2026-02-12T18:15:20.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae9790c640 10 monclient(hunting): authenticate will time out at 1159.169695s 2026-02-12T18:15:20.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae95681640 1 -- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fae9005c950 msgr2=0x7fae9005cd20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.48:3303/0 2026-02-12T18:15:20.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae95681640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fae9005c950 0x7fae9005cd20 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:15:20.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae94e80640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fae9005e490 0x7fae9005d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae94e80640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fae9005e490 0x7fae9005d260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:54530/0 (socket says 10.20.193.48:54530) 2026-02-12T18:15:20.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae94e80640 1 -- 10.20.193.48:0/2879682916 learned_addr learned my addr 10.20.193.48:0/2879682916 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:15:20.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae94e80640 10 monclient(hunting): get_auth_request con 0x7fae9005e490 auth_method 0 2026-02-12T18:15:20.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae94e80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:20.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae94e80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:20.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae94e80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:20.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae94e80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:20.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae94e80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:20.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae94e80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:20.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae94e80640 10 monclient(hunting): handle_auth_done global_id 36560 payload 274 2026-02-12T18:15:20.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae94e80640 1 -- 10.20.193.48:0/2879682916 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fae9005c950 msgr2=0x7fae9005cd20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:15:20.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.443+0000 7fae94e80640 1 --2- 10.20.193.48:0/2879682916 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fae9005c950 0x7fae9005cd20 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.444+0000 7fae94e80640 1 -- 10.20.193.48:0/2879682916 >> v1:10.20.193.111:6789/0 conn(0x7fae9013db70 legacy=0x7fae9013dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:15:20.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.444+0000 7fae94e80640 10 monclient: _finish_hunting 0 2026-02-12T18:15:20.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.444+0000 7fae94e80640 1 monclient: found mon.noname-b 2026-02-12T18:15:20.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.444+0000 7fae94e80640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:15:20.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.444+0000 7fae94e80640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:15:20.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.444+0000 7fae94e80640 1 -- 10.20.193.48:0/2879682916 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae90092990 con 0x7fae9005e490 2026-02-12T18:15:20.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae94e80640 1 -- 10.20.193.48:0/2879682916 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fae9005e490 msgr2=0x7fae9005d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:20.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae94e80640 1 --2- 10.20.193.48:0/2879682916 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fae9005e490 0x7fae9005d260 secure :-1 s=READY pgs=414 gs=2 cs=0 l=1 c_cookie=67338299823671359 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae840098d0 tx=0x7fae8402ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef3bd3b0c4c83f server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:20.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae7ffff640 1 -- 10.20.193.48:0/2879682916 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fae8402fba0 con 0x7fae9005e490 2026-02-12T18:15:20.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae7ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:20.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae7ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:15:20.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae7ffff640 10 monclient: dump: 2026-02-12T18:15:20.461 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:20.461 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.461 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.462 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.462 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:20.462 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.462 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:20.462 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:20.462 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:20.462 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:20.462 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:20.462 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:20.462 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:20.462 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:20.462 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:20.462 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae7ffff640 10 monclient: _finish_auth 0 2026-02-12T18:15:20.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae7ffff640 10 monclient: _check_auth_tickets 2026-02-12T18:15:20.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae7ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:15:20.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae7ffff640 1 -- 10.20.193.48:0/2879682916 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae8402fd20 con 0x7fae9005e490 2026-02-12T18:15:20.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae9790c640 5 monclient: authenticate success, global_id 36560 2026-02-12T18:15:20.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae9790c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:15:20.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae7ffff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:15:20.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae7ffff640 1 -- 10.20.193.48:0/2879682916 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fae8402fe90 con 0x7fae9005e490 2026-02-12T18:15:20.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae7ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:20.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae7ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:15:20.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae7ffff640 10 monclient: dump: 2026-02-12T18:15:20.464 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:20.464 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.464 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.464 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.464 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:20.464 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.464 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:20.464 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:20.464 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:20.464 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:20.464 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:20.464 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:20.465 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:20.465 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:20.465 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:20.465 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae9790c640 10 monclient: get_monmap_and_config success 2026-02-12T18:15:20.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae9790c640 4 set_mon_vals no callback set 2026-02-12T18:15:20.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae9790c640 10 monclient: shutdown 2026-02-12T18:15:20.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae9790c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:15:20.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae9790c640 1 -- 10.20.193.48:0/2879682916 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fae9005e490 msgr2=0x7fae9005d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:20.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae9790c640 1 --2- 10.20.193.48:0/2879682916 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fae9005e490 0x7fae9005d260 secure :-1 s=READY pgs=414 gs=2 cs=0 l=1 c_cookie=67338299823671359 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae840098d0 tx=0x7fae8402ee40 comp rx=0 tx=0).stop 2026-02-12T18:15:20.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae9790c640 1 -- 10.20.193.48:0/2879682916 shutdown_connections 2026-02-12T18:15:20.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae9790c640 1 --2- 10.20.193.48:0/2879682916 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fae9005e490 0x7fae9005d260 unknown :-1 s=CLOSED pgs=414 gs=2 cs=0 l=1 c_cookie=67338299823671359 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae9790c640 1 --2- 10.20.193.48:0/2879682916 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fae9005c950 0x7fae9005cd20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae9790c640 1 -- 10.20.193.48:0/2879682916 >> 10.20.193.48:0/2879682916 conn(0x7fae900548a0 msgr2=0x7fae90097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:15:20.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.446+0000 7fae9790c640 1 -- 10.20.193.48:0/2879682916 shutdown_connections 2026-02-12T18:15:20.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.447+0000 7fae9790c640 1 -- 10.20.193.48:0/2879682916 wait complete. 2026-02-12T18:15:20.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.447+0000 7fae9790c640 10 monclient: build_initial_monmap 2026-02-12T18:15:20.466 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.447+0000 7fae9790c640 10 monclient: monmap: 2026-02-12T18:15:20.466 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:15:20.466 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:15:20.466 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:15:20.466 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:15:20.466 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:15:20.466 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.467 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:15:20.467 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:15:20.467 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:15:20.467 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:15:20.467 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:15:20.467 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:15:20.467 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:15:20.467 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:15:20.467 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:15:20.467 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.447+0000 7fae9790c640 1 Processor -- start 2026-02-12T18:15:20.467 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.447+0000 7fae9790c640 1 -- start start 2026-02-12T18:15:20.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.447+0000 7fae9790c640 10 monclient: init 2026-02-12T18:15:20.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.447+0000 7fae9790c640 10 monclient: _reopen_session rank -1 2026-02-12T18:15:20.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.447+0000 7fae9790c640 10 monclient: _add_conns ranks=[2,0,8,3,4,7,5,1,6] 2026-02-12T18:15:20.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae9790c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fae9005c950 0x7fae9012c9d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae9790c640 10 monclient(hunting): picked mon.noname-b con 0x7fae9005c950 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:15:20.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae9790c640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fae9005e490 0x7fae9008d450 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae9790c640 10 monclient(hunting): picked mon.noname-a con 0x7fae9005e490 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:15:20.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae9790c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fae9013db70 0x7fae9013ce00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae9790c640 10 monclient(hunting): picked mon.noname-e con 0x7fae9013db70 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:15:20.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae9790c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.468 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae9790c640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fae900905b0 con 0x7fae9005e490 2026-02-12T18:15:20.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae9790c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae9790c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fae90090080 con 0x7fae9005c950 2026-02-12T18:15:20.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae9790c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae9790c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fae90143c90 con 0x7fae9013db70 2026-02-12T18:15:20.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae9790c640 10 monclient(hunting): _renew_subs 2026-02-12T18:15:20.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae9790c640 10 monclient(hunting): authenticate will time out at 1159.174040s 2026-02-12T18:15:20.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95681640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fae9005c950 0x7fae9012c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95681640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fae9005c950 0x7fae9012c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:54534/0 (socket says 10.20.193.48:54534) 2026-02-12T18:15:20.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95681640 1 -- 10.20.193.48:0/1017966639 learned_addr learned my addr 10.20.193.48:0/1017966639 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:15:20.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95681640 10 monclient(hunting): get_auth_request con 0x7fae9005c950 auth_method 0 2026-02-12T18:15:20.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95681640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:20.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95681640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:20.469 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95681640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:20.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae94e80640 1 --2- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fae9005e490 0x7fae9008d450 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95e82640 1 --2- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fae9013db70 0x7fae9013ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae94e80640 10 monclient(hunting): get_auth_request con 0x7fae9005e490 auth_method 0 2026-02-12T18:15:20.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae94e80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:20.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae94e80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:20.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae94e80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:20.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95e82640 10 monclient(hunting): get_auth_request con 0x7fae9013db70 auth_method 0 2026-02-12T18:15:20.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95e82640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:20.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95e82640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:20.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95e82640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:20.470 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95681640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:20.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95681640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:20.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95681640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:20.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae94e80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:20.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae94e80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:20.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae94e80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:20.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95e82640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:20.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95e82640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:20.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95e82640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:20.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95681640 10 monclient(hunting): handle_auth_done global_id 36569 payload 824 2026-02-12T18:15:20.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95681640 1 -- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fae9013db70 msgr2=0x7fae9013ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:20.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95681640 1 --2- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fae9013db70 0x7fae9013ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95681640 1 -- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fae9005e490 msgr2=0x7fae9008d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:20.471 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95681640 1 --2- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fae9005e490 0x7fae9008d450 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95681640 10 monclient: _finish_hunting 0 2026-02-12T18:15:20.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95681640 1 monclient: found mon.noname-b 2026-02-12T18:15:20.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95681640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:15:20.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95681640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:15:20.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.448+0000 7fae95681640 1 -- 10.20.193.48:0/1017966639 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae840094f0 con 0x7fae9005c950 2026-02-12T18:15:20.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.450+0000 7fae95681640 1 -- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fae9005c950 msgr2=0x7fae9012c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:20.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.450+0000 7fae95681640 1 --2- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fae9005c950 0x7fae9012c9d0 secure :-1 s=READY pgs=415 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae8000b550 tx=0x7fae8000ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:20.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.450+0000 7fae7dffb640 1 -- 10.20.193.48:0/1017966639 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fae80003e90 con 0x7fae9005c950 2026-02-12T18:15:20.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.450+0000 7fae7dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:20.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.450+0000 7fae7dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:15:20.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.450+0000 7fae7dffb640 10 monclient: dump: 2026-02-12T18:15:20.472 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:20.473 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.473 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.473 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.473 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:20.473 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.473 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:20.473 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:20.473 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:20.473 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:20.473 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:20.473 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:20.473 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:20.473 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:20.474 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:20.474 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.450+0000 7fae7dffb640 10 monclient: _finish_auth 0 2026-02-12T18:15:20.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.450+0000 7fae7dffb640 10 monclient: _check_auth_tickets 2026-02-12T18:15:20.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.450+0000 7fae7dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:15:20.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.450+0000 7fae7dffb640 1 -- 10.20.193.48:0/1017966639 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae80006590 con 0x7fae9005c950 2026-02-12T18:15:20.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.450+0000 7fae7dffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:15:20.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.450+0000 7fae7dffb640 1 -- 10.20.193.48:0/1017966639 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fae80006700 con 0x7fae9005c950 2026-02-12T18:15:20.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.450+0000 7fae7dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:20.474 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.450+0000 7fae7f7fe640 4 set_mon_vals no callback set 2026-02-12T18:15:20.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.450+0000 7fae7dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:15:20.475 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.450+0000 7fae7dffb640 10 monclient: dump: 2026-02-12T18:15:20.475 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:20.475 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.475 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.475 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.475 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:20.475 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.475 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:20.475 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:20.475 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:20.475 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:20.475 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:20.476 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:20.476 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:20.476 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:20.476 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:20.476 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.450+0000 7fae9790c640 5 monclient: authenticate success, global_id 36569 2026-02-12T18:15:20.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.450+0000 7fae9790c640 10 monclient: _renew_subs 2026-02-12T18:15:20.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.450+0000 7fae9790c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:15:20.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.450+0000 7fae9790c640 1 -- 10.20.193.48:0/1017966639 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae9008af10 con 0x7fae9005c950 2026-02-12T18:15:20.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.450+0000 7fae9790c640 10 monclient: _renew_subs 2026-02-12T18:15:20.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.450+0000 7fae9790c640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:15:20.476 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.450+0000 7fae9790c640 1 -- 10.20.193.48:0/1017966639 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fae901422f0 con 0x7fae9005c950 2026-02-12T18:15:20.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.451+0000 7fae9790c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:15:20.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.451+0000 7fae9790c640 1 --2- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fae9008d990 0x7fae9013d340 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.451+0000 7fae9790c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.451+0000 7fae9790c640 1 -- 10.20.193.48:0/1017966639 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fae9005f140 con 0x7fae9008d990 2026-02-12T18:15:20.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.451+0000 7fae94e80640 1 --2- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fae9008d990 0x7fae9013d340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.451+0000 7fae94e80640 10 monclient: get_auth_request con 0x7fae9008d990 auth_method 0 2026-02-12T18:15:20.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.451+0000 7fae94e80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:20.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.451+0000 7fae94e80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:20.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.451+0000 7fae94e80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:20.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.451+0000 7fae94e80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:20.477 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.451+0000 7fae94e80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:20.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.451+0000 7fae94e80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:20.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.451+0000 7fae94e80640 10 monclient(hunting): handle_auth_done global_id 6930 payload 824 2026-02-12T18:15:20.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.451+0000 7fae95681640 1 --2- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fae9005c950 0x7fae9012c9d0 secure :-1 s=READY pgs=415 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae8000b550 tx=0x7fae8000ba20 comp rx=0 tx=0).queue_received will delay after 1.77092e+09 on 0x7fae800524b0 osd_map(321..321 src has 215..321) 2026-02-12T18:15:20.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.451+0000 7fae94e80640 1 -- 10.20.193.48:0/1017966639 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae90097de0 con 0x7fae9008d990 2026-02-12T18:15:20.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.451+0000 7fae7dffb640 1 -- 10.20.193.48:0/1017966639 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fae8000d040 con 0x7fae9005c950 2026-02-12T18:15:20.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.451+0000 7fae94e80640 1 -- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fae9008d990 msgr2=0x7fae9013d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-12T18:15:20.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.451+0000 7fae94e80640 1 -- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fae9008d990 msgr2=0x7fae9013d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:15:20.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.451+0000 7fae94e80640 1 --2- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fae9008d990 0x7fae9013d340 secure :-1 s=SESSION_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae840098d0 tx=0x7fae840047e0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:15:20.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.451+0000 7fae94e80640 1 --2- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fae9008d990 0x7fae9013d340 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:15:20.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.451+0000 7fae7dffb640 1 --2- 10.20.193.48:0/1017966639 >> v2:10.20.193.111:6812/977811348 conn(0x7fae6003f800 0x7fae6005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.451+0000 7fae95e82640 1 --2- 10.20.193.48:0/1017966639 >> v2:10.20.193.111:6812/977811348 conn(0x7fae6003f800 0x7fae6005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.452+0000 7fae95e82640 10 monclient: get_auth_request con 0x7fae6003f800 auth_method 0 2026-02-12T18:15:20.478 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.454+0000 7fae95e82640 1 --2- 10.20.193.48:0/1017966639 >> v2:10.20.193.111:6812/977811348 conn(0x7fae6003f800 0x7fae6005fcb0 secure :-1 s=READY pgs=462 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae8c008fd0 tx=0x7fae8c008f20 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:20.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.653+0000 7fae94e80640 1 --2- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fae9008d990 0x7fae9013d340 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.653+0000 7fae94e80640 10 monclient: get_auth_request con 0x7fae9008d990 auth_method 0 2026-02-12T18:15:20.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.653+0000 7fae94e80640 10 monclient: get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:20.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.653+0000 7fae94e80640 10 monclient: _init_auth method 2 2026-02-12T18:15:20.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.653+0000 7fae94e80640 10 monclient: _init_auth already have auth, reseting 2026-02-12T18:15:20.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.653+0000 7fae94e80640 10 monclient: handle_auth_reply_more payload 9 2026-02-12T18:15:20.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.653+0000 7fae94e80640 10 monclient: handle_auth_reply_more payload_len 9 2026-02-12T18:15:20.655 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.653+0000 7fae94e80640 10 monclient: handle_auth_reply_more responding with 132 bytes 2026-02-12T18:15:20.656 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.653+0000 7fae94e80640 10 monclient: handle_auth_done global_id 6930 payload 293 2026-02-12T18:15:20.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.655+0000 7fae94e80640 1 -- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fae9008d990 msgr2=0x7fae9013d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:20.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.655+0000 7fae94e80640 1 --2- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fae9008d990 0x7fae9013d340 secure :-1 s=READY pgs=658 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae8402fcf0 tx=0x7fae84039040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:20.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.655+0000 7fae7dffb640 1 -- 10.20.193.48:0/1017966639 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fae840413e0 con 0x7fae9008d990 2026-02-12T18:15:20.658 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.655+0000 7fae7dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:20.658 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.655+0000 7fae7dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:15:20.658 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.655+0000 7fae7dffb640 10 monclient: dump: 2026-02-12T18:15:20.658 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:20.658 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.658 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.658 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.658 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:20.658 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.658 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:20.658 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:20.658 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:20.659 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:20.659 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:20.659 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:20.659 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:20.659 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:20.659 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:20.659 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.659 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.655+0000 7fae7dffb640 1 -- 10.20.193.48:0/1017966639 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fae8402fe90 con 0x7fae9008d990 2026-02-12T18:15:20.659 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.655+0000 7fae7dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:15:20.659 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.655+0000 7fae7dffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:15:20.659 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.655+0000 7fae7dffb640 1 -- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fae9008d990 msgr2=0x7fae9013d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:20.660 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.655+0000 7fae7dffb640 1 --2- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fae9008d990 0x7fae9013d340 secure :-1 s=READY pgs=658 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae8402fcf0 tx=0x7fae84039040 comp rx=0 tx=0).stop 2026-02-12T18:15:20.660 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.655+0000 7fae7dffb640 1 -- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fae9008d990 msgr2=0x7fae9013d340 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:15:20.660 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.655+0000 7fae7dffb640 1 --2- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fae9008d990 0x7fae9013d340 secure :-1 s=CLOSED pgs=658 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae8402fcf0 tx=0x7fae84039040 comp rx=0 tx=0).stop 2026-02-12T18:15:20.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.659+0000 7fae9790c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:15:20.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.659+0000 7fae9790c640 1 --2- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fae90129450 0x7fae90129820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.661 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.659+0000 7fae9790c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.659+0000 7fae9790c640 1 -- 10.20.193.48:0/1017966639 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fae9005fd90 con 0x7fae90129450 2026-02-12T18:15:20.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.659+0000 7fae94e80640 1 --2- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fae90129450 0x7fae90129820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.659+0000 7fae94e80640 10 monclient: get_auth_request con 0x7fae90129450 auth_method 0 2026-02-12T18:15:20.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.659+0000 7fae94e80640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:20.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.659+0000 7fae94e80640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:20.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.659+0000 7fae94e80640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:20.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.659+0000 7fae94e80640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:20.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.659+0000 7fae94e80640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:20.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.659+0000 7fae94e80640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:20.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.659+0000 7fae94e80640 10 monclient(hunting): handle_auth_done global_id 6939 payload 824 2026-02-12T18:15:20.662 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.659+0000 7fae94e80640 1 -- 10.20.193.48:0/1017966639 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fae9008a7e0 con 0x7fae90129450 2026-02-12T18:15:20.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.661+0000 7fae94e80640 1 -- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fae90129450 msgr2=0x7fae90129820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:20.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.661+0000 7fae94e80640 1 --2- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fae90129450 0x7fae90129820 secure :-1 s=READY pgs=659 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae84039010 tx=0x7fae84004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:20.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.661+0000 7fae7dffb640 1 -- 10.20.193.48:0/1017966639 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fae84005e60 con 0x7fae90129450 2026-02-12T18:15:20.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.661+0000 7fae7dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:20.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.661+0000 7fae7dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:15:20.664 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.661+0000 7fae7dffb640 10 monclient: dump: 2026-02-12T18:15:20.664 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:20.665 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.665 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.665 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.665 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:20.665 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.665 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:20.665 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:20.665 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:20.665 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:20.665 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:20.665 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:20.666 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:20.666 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:20.666 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:20.666 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.662+0000 7fae7dffb640 1 -- 10.20.193.48:0/1017966639 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10151 (secure 0 0 0) 0x7fae84056370 con 0x7fae90129450 2026-02-12T18:15:20.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.662+0000 7fae7dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:15:20.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.662+0000 7fae7dffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:15:20.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.662+0000 7fae7dffb640 1 -- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fae90129450 msgr2=0x7fae90129820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:20.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.662+0000 7fae7dffb640 1 --2- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fae90129450 0x7fae90129820 secure :-1 s=READY pgs=659 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae84039010 tx=0x7fae84004770 comp rx=0 tx=0).stop 2026-02-12T18:15:20.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.662+0000 7fae7dffb640 1 -- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fae90129450 msgr2=0x7fae90129820 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:15:20.666 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.662+0000 7fae7dffb640 1 --2- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fae90129450 0x7fae90129820 secure :-1 s=CLOSED pgs=659 gs=8 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae84039010 tx=0x7fae84004770 comp rx=0 tx=0).stop 2026-02-12T18:15:20.667 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:15:20.667 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:15:20.667 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:15:20.667 INFO:teuthology.orchestra.run.trial048.stdout: "state": "leader", 2026-02-12T18:15:20.667 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 86, 2026-02-12T18:15:20.667 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 575496, 2026-02-12T18:15:20.668 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:15:20.668 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:15:20.668 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:15:20.668 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:15:20.668 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:15:20.668 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:15:20.668 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:15:20.668 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:20.668 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:15:20.668 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:15:20.668 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:15:20.668 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:15:20.669 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:15:20.669 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:15:20.669 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:15:20.669 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:15:20.669 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:15:20.669 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:15:20.669 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:15:20.669 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:15:20.669 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:15:20.669 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:15:20.669 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:15:20.670 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:15:20.670 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:15:20.670 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:20.670 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:15:20.670 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:15:20.670 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:15:20.670 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:15:20.670 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:15:20.670 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:15:20.670 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:15:20.670 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:15:20.670 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:15:20.671 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:15:20.671 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:15:20.671 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:15:20.671 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:15:20.671 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:15:20.671 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:15:20.671 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.671 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.671 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:15:20.671 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:15:20.672 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:15:20.672 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:15:20.672 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:15:20.672 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:15:20.672 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:15:20.672 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:15:20.672 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:15:20.672 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:15:20.672 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:15:20.672 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:15:20.672 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:15:20.673 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:15:20.673 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:15:20.673 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:15:20.673 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:15:20.673 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:15:20.673 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:15:20.673 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:15:20.673 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:15:20.673 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:15:20.673 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:15:20.673 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:15:20.673 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:15:20.674 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:15:20.674 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:15:20.674 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:15:20.674 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:15:20.674 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:15:20.674 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:20.674 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:15:20.674 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.674 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:15:20.674 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.674 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:15:20.674 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:15:20.675 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.675 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.675 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.675 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.675 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:15:20.675 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.675 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.675 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.675 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.675 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:15:20.675 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.675 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.676 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.676 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.676 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:15:20.676 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:15:20.676 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.676 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.676 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:15:20.676 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.676 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.676 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.676 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:15:20.676 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:15:20.677 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.677 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.677 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.677 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.677 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:15:20.677 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.677 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.677 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.677 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.677 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:15:20.678 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.678 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.678 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.678 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.678 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:15:20.678 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:15:20.678 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.678 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.678 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:15:20.678 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.678 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.678 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.678 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:15:20.679 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:15:20.679 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.679 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.679 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.679 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.679 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:15:20.679 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.679 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.679 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.679 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.679 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:15:20.679 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.680 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.680 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.680 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.680 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:15:20.680 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:15:20.680 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.680 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.680 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:15:20.680 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.680 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.680 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.680 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:15:20.681 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:15:20.681 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.681 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.681 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.681 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.681 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:15:20.681 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.681 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.681 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.681 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.681 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:15:20.681 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.682 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.682 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.682 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.682 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:15:20.682 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:15:20.682 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.682 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.682 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:15:20.682 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.682 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.682 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.683 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:15:20.683 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:15:20.683 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.683 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.683 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.683 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.683 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:15:20.683 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.683 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.683 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.683 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.683 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:15:20.684 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.684 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.684 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.684 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.684 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:15:20.684 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:15:20.684 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.684 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.684 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:15:20.684 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.684 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.684 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.684 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:15:20.684 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:15:20.685 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.685 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.685 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.685 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.685 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:15:20.685 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.685 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.685 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.685 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.685 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:15:20.685 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.685 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.685 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.685 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.686 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:15:20.686 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:15:20.686 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.686 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.686 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:15:20.686 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.686 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.686 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.686 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:15:20.686 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:15:20.686 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.686 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.686 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.687 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.687 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:15:20.687 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.687 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.687 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.687 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.687 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:15:20.687 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.687 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.687 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.687 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.687 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:15:20.687 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:15:20.688 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.688 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.688 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:15:20.688 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.688 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.688 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.688 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:15:20.688 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:15:20.688 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.688 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.688 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.688 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.688 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:15:20.689 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.689 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.689 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.689 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.689 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:15:20.689 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.689 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.689 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.689 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.689 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:15:20.689 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:15:20.689 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.689 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.690 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:15:20.690 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.690 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.690 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.690 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:15:20.690 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:15:20.690 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.690 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.690 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.690 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.690 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:15:20.690 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.690 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.690 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.691 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.691 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:15:20.691 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.691 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.691 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.691 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.691 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:15:20.691 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:15:20.691 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.691 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.691 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:15:20.691 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.691 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.691 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.691 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.692 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:15:20.692 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:15:20.692 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.692 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:15:20.692 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:15:20.692 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:15:20.692 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.692 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:20.692 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:15:20.692 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.692 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:15:20.692 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:15:20.692 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:15:20.692 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.692 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:20.693 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:15:20.693 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.693 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:15:20.693 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:15:20.693 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:15:20.693 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.693 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.693 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.693 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:15:20.693 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:15:20.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.662+0000 7fae9790c640 1 -- 10.20.193.48:0/1017966639 >> v2:10.20.193.111:6812/977811348 conn(0x7fae6003f800 msgr2=0x7fae6005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:20.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.662+0000 7fae9790c640 1 --2- 10.20.193.48:0/1017966639 >> v2:10.20.193.111:6812/977811348 conn(0x7fae6003f800 0x7fae6005fcb0 secure :-1 s=READY pgs=462 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae8c008fd0 tx=0x7fae8c008f20 comp rx=0 tx=0).stop 2026-02-12T18:15:20.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.662+0000 7fae9790c640 10 monclient: shutdown 2026-02-12T18:15:20.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.662+0000 7fae9790c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:15:20.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.662+0000 7fae9790c640 1 -- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fae9005c950 msgr2=0x7fae9012c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:20.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.662+0000 7fae9790c640 1 --2- 10.20.193.48:0/1017966639 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fae9005c950 0x7fae9012c9d0 secure :-1 s=READY pgs=415 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fae8000b550 tx=0x7fae8000ba20 comp rx=0 tx=0).stop 2026-02-12T18:15:20.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.662+0000 7fae95e82640 1 -- 10.20.193.48:0/1017966639 reap_dead start 2026-02-12T18:15:20.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.662+0000 7fae7dffb640 1 -- 10.20.193.48:0/1017966639 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(321..321 src has 215..321) ==== 3503+0+0 (unknown 0 0 0) 0x7fae800524b0 con 0x7fae9005c950 2026-02-12T18:15:20.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.662+0000 7fae95e82640 1 -- 10.20.193.48:0/1017966639 reap_dead start 2026-02-12T18:15:20.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.662+0000 7fae9790c640 1 -- 10.20.193.48:0/1017966639 shutdown_connections 2026-02-12T18:15:20.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.662+0000 7fae9790c640 1 -- 10.20.193.48:0/1017966639 >> 10.20.193.48:0/1017966639 conn(0x7fae900548a0 msgr2=0x7fae90093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:15:20.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.662+0000 7fae9790c640 1 -- 10.20.193.48:0/1017966639 shutdown_connections 2026-02-12T18:15:20.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.662+0000 7fae9790c640 1 -- 10.20.193.48:0/1017966639 wait complete. 2026-02-12T18:15:20.696 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2026-02-12T18:15:20.696 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon b 2026-02-12T18:15:20.696 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T18:15:20.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.761+0000 7f9ce73b9640 10 monclient: get_monmap_and_config 2026-02-12T18:15:20.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.761+0000 7f9ce73b9640 10 monclient: build_initial_monmap 2026-02-12T18:15:20.762 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.761+0000 7f9ce73b9640 10 monclient: monmap: 2026-02-12T18:15:20.763 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:15:20.763 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.763 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:15:20.762180+0000 2026-02-12T18:15:20.763 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:15:20.762180+0000 2026-02-12T18:15:20.763 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:15:20.763 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.763 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:15:20.763 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:15:20.763 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:15:20.763 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:15:20.763 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:15:20.763 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:15:20.763 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:15:20.763 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:15:20.764 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:15:20.764 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:15:20.764 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:15:20.764 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.761+0000 7f9ce73b9640 1 Processor -- start 2026-02-12T18:15:20.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.761+0000 7f9ce73b9640 1 -- start start 2026-02-12T18:15:20.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.761+0000 7f9ce73b9640 10 monclient: init 2026-02-12T18:15:20.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.761+0000 7f9ce73b9640 10 monclient: _reopen_session rank -1 2026-02-12T18:15:20.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.761+0000 7f9ce73b9640 10 monclient: _add_conns ranks=[9,5,0,1,3,7,8,6,4,2,10] 2026-02-12T18:15:20.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.761+0000 7f9ce73b9640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f9ce005d550 0x7f9ce005d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.761+0000 7f9ce73b9640 10 monclient(hunting): picked mon.noname-a con 0x7f9ce005d550 addr v2:10.20.193.48:3300/0 2026-02-12T18:15:20.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.761+0000 7f9ce73b9640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9ce005de60 0x7f9ce0141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.761+0000 7f9ce73b9640 10 monclient(hunting): picked mon.noname-h con 0x7f9ce005de60 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:15:20.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.761+0000 7f9ce73b9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9ce013ef60 addr v1:10.20.193.48:6789/0 2026-02-12T18:15:20.766 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.761+0000 7f9ce73b9640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ce004dc20 con 0x7f9ce013ef60 2026-02-12T18:15:20.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.761+0000 7f9ce73b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.761+0000 7f9ce73b9640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f9ce008d390 con 0x7f9ce005d550 2026-02-12T18:15:20.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.761+0000 7f9ce73b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.761+0000 7f9ce73b9640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f9ce008d5a0 con 0x7f9ce005de60 2026-02-12T18:15:20.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.761+0000 7f9ce73b9640 10 monclient(hunting): _renew_subs 2026-02-12T18:15:20.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.761+0000 7f9ce73b9640 10 monclient(hunting): authenticate will time out at 1159.487876s 2026-02-12T18:15:20.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.761+0000 7f9ce492d640 1 -- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9ce005de60 msgr2=0x7f9ce0141fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:15:20.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.761+0000 7f9ce512e640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f9ce005d550 0x7f9ce005d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.761+0000 7f9ce492d640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9ce005de60 0x7f9ce0141fa0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:15:20.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.761+0000 7f9ce512e640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f9ce005d550 0x7f9ce005d920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:35498/0 (socket says 10.20.193.48:35498) 2026-02-12T18:15:20.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.761+0000 7f9ce512e640 1 -- 10.20.193.48:0/1953984053 learned_addr learned my addr 10.20.193.48:0/1953984053 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:15:20.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.762+0000 7f9ce512e640 10 monclient(hunting): get_auth_request con 0x7f9ce005d550 auth_method 0 2026-02-12T18:15:20.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.762+0000 7f9ce512e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:20.767 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.762+0000 7f9ce512e640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:20.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.762+0000 7f9ce512e640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:20.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.762+0000 7f9ce512e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:20.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.762+0000 7f9ce512e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:20.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.762+0000 7f9ce512e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:20.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.764+0000 7f9ce592f640 1 -- 10.20.193.48:0/1953984053 >> v1:10.20.193.48:6789/0 conn(0x7f9ce013ef60 legacy=0x7f9ce01424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:20.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.764+0000 7f9ce512e640 10 monclient(hunting): handle_auth_done global_id 6948 payload 274 2026-02-12T18:15:20.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.764+0000 7f9ce512e640 1 -- 10.20.193.48:0/1953984053 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9ce005de60 msgr2=0x7f9ce0141fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:15:20.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.764+0000 7f9ce512e640 1 --2- 10.20.193.48:0/1953984053 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9ce005de60 0x7f9ce0141fa0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.764+0000 7f9ce512e640 1 -- 10.20.193.48:0/1953984053 >> v1:10.20.193.48:6789/0 conn(0x7f9ce013ef60 legacy=0x7f9ce01424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:20.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.764+0000 7f9ce512e640 10 monclient: _finish_hunting 0 2026-02-12T18:15:20.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.764+0000 7f9ce512e640 1 monclient: found mon.noname-a 2026-02-12T18:15:20.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.764+0000 7f9ce512e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:15:20.768 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.764+0000 7f9ce512e640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:15:20.769 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.764+0000 7f9ce512e640 1 -- 10.20.193.48:0/1953984053 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce00580e0 con 0x7f9ce005d550 2026-02-12T18:15:20.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.766+0000 7f9ce512e640 1 -- 10.20.193.48:0/1953984053 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9ce005d550 msgr2=0x7f9ce005d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:20.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.766+0000 7f9ce512e640 1 --2- 10.20.193.48:0/1953984053 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9ce005d550 0x7f9ce005d920 secure :-1 s=READY pgs=661 gs=2 cs=0 l=1 c_cookie=9042085303535149981 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cd0009060 tx=0x7f9cd002ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d7bf0ad31fe239d server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:20.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ccffff640 1 -- 10.20.193.48:0/1953984053 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9cd002fc30 con 0x7f9ce005d550 2026-02-12T18:15:20.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ccffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:20.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ccffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:15:20.775 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ccffff640 10 monclient: dump: 2026-02-12T18:15:20.775 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:20.775 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.775 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.775 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.776 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:20.776 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.776 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:20.776 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:20.776 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:20.776 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:20.776 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:20.776 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:20.776 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:20.776 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:20.776 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:20.776 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ccffff640 10 monclient: _finish_auth 0 2026-02-12T18:15:20.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ccffff640 10 monclient: _check_auth_tickets 2026-02-12T18:15:20.776 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ccffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:15:20.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ce73b9640 5 monclient: authenticate success, global_id 6948 2026-02-12T18:15:20.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ce73b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:15:20.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ccffff640 1 -- 10.20.193.48:0/1953984053 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cd002fdb0 con 0x7f9ce005d550 2026-02-12T18:15:20.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ccffff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:15:20.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ccffff640 1 -- 10.20.193.48:0/1953984053 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9cd0035cc0 con 0x7f9ce005d550 2026-02-12T18:15:20.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ce73b9640 10 monclient: get_monmap_and_config success 2026-02-12T18:15:20.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ce73b9640 4 set_mon_vals no callback set 2026-02-12T18:15:20.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ccffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:20.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ccffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:15:20.777 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ccffff640 10 monclient: dump: 2026-02-12T18:15:20.777 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:20.777 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.777 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.777 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.777 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:20.778 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.778 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:20.778 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:20.778 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:20.778 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:20.778 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:20.778 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:20.778 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:20.778 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:20.778 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:20.778 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ce73b9640 10 monclient: shutdown 2026-02-12T18:15:20.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ce73b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:15:20.778 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ce73b9640 1 -- 10.20.193.48:0/1953984053 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9ce005d550 msgr2=0x7f9ce005d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:20.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ce73b9640 1 --2- 10.20.193.48:0/1953984053 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9ce005d550 0x7f9ce005d920 secure :-1 s=READY pgs=661 gs=2 cs=0 l=1 c_cookie=9042085303535149981 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cd0009060 tx=0x7f9cd002ee80 comp rx=0 tx=0).stop 2026-02-12T18:15:20.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ce73b9640 1 -- 10.20.193.48:0/1953984053 shutdown_connections 2026-02-12T18:15:20.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ce73b9640 1 --2- 10.20.193.48:0/1953984053 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9ce005de60 0x7f9ce0141fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ce73b9640 1 --2- 10.20.193.48:0/1953984053 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9ce005d550 0x7f9ce005d920 unknown :-1 s=CLOSED pgs=661 gs=2 cs=0 l=1 c_cookie=9042085303535149981 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ce73b9640 1 -- 10.20.193.48:0/1953984053 >> 10.20.193.48:0/1953984053 conn(0x7f9ce00546a0 msgr2=0x7f9ce0054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:15:20.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ce73b9640 1 -- 10.20.193.48:0/1953984053 shutdown_connections 2026-02-12T18:15:20.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ce73b9640 1 -- 10.20.193.48:0/1953984053 wait complete. 2026-02-12T18:15:20.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ce73b9640 10 monclient: build_initial_monmap 2026-02-12T18:15:20.779 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ce73b9640 10 monclient: monmap: 2026-02-12T18:15:20.779 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:15:20.779 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:15:20.779 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:15:20.779 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:15:20.779 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:15:20.779 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.780 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:15:20.780 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:15:20.780 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:15:20.780 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:15:20.780 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:15:20.780 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:15:20.780 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:15:20.780 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:15:20.780 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:15:20.780 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ce73b9640 1 Processor -- start 2026-02-12T18:15:20.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ce73b9640 1 -- start start 2026-02-12T18:15:20.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.767+0000 7f9ce73b9640 10 monclient: init 2026-02-12T18:15:20.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce73b9640 10 monclient: _reopen_session rank -1 2026-02-12T18:15:20.780 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce73b9640 10 monclient: _add_conns ranks=[7,6,4,1,5,8,3,2,0] 2026-02-12T18:15:20.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce73b9640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f9ce005d550 0x7f9ce01314c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce73b9640 10 monclient(hunting): picked mon.noname-i con 0x7f9ce005d550 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:15:20.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce73b9640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9ce005de60 0x7f9ce0131a00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce73b9640 10 monclient(hunting): picked mon.noname-d con 0x7f9ce005de60 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:15:20.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce73b9640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9ce013ef60 0x7f9ce008a680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce73b9640 10 monclient(hunting): picked mon.noname-c con 0x7f9ce013ef60 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:15:20.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce73b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce73b9640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f9ce0120860 con 0x7f9ce013ef60 2026-02-12T18:15:20.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce73b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce73b9640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f9ce0120490 con 0x7f9ce005de60 2026-02-12T18:15:20.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce73b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce73b9640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f9ce010ecb0 con 0x7f9ce005d550 2026-02-12T18:15:20.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce73b9640 10 monclient(hunting): _renew_subs 2026-02-12T18:15:20.781 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce73b9640 10 monclient(hunting): authenticate will time out at 1159.494226s 2026-02-12T18:15:20.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce492d640 1 -- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9ce005de60 msgr2=0x7f9ce0131a00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.48:3303/0 2026-02-12T18:15:20.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce492d640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9ce005de60 0x7f9ce0131a00 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:15:20.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce512e640 1 -- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f9ce005d550 msgr2=0x7f9ce01314c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3303/0 2026-02-12T18:15:20.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce512e640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f9ce005d550 0x7f9ce01314c0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:15:20.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce592f640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9ce013ef60 0x7f9ce008a680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce592f640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9ce013ef60 0x7f9ce008a680 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:59920/0 (socket says 10.20.193.48:59920) 2026-02-12T18:15:20.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce592f640 1 -- 10.20.193.48:0/3299761680 learned_addr learned my addr 10.20.193.48:0/3299761680 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:15:20.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce592f640 10 monclient(hunting): get_auth_request con 0x7f9ce013ef60 auth_method 0 2026-02-12T18:15:20.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce592f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:20.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce592f640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:20.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce592f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:20.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce592f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:20.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce592f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:20.782 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce592f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:20.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce592f640 10 monclient(hunting): handle_auth_done global_id 65191 payload 824 2026-02-12T18:15:20.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce592f640 1 -- 10.20.193.48:0/3299761680 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f9ce005d550 msgr2=0x7f9ce01314c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:15:20.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce592f640 1 --2- 10.20.193.48:0/3299761680 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f9ce005d550 0x7f9ce01314c0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce592f640 1 -- 10.20.193.48:0/3299761680 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9ce005de60 msgr2=0x7f9ce0131a00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:15:20.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce592f640 1 --2- 10.20.193.48:0/3299761680 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f9ce005de60 0x7f9ce0131a00 unknown :-1 s=START_CONNECT pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce592f640 10 monclient: _finish_hunting 0 2026-02-12T18:15:20.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce592f640 1 monclient: found mon.noname-c 2026-02-12T18:15:20.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce592f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:15:20.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce592f640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:15:20.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.768+0000 7f9ce592f640 1 -- 10.20.193.48:0/3299761680 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cd00094f0 con 0x7f9ce013ef60 2026-02-12T18:15:20.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.770+0000 7f9ce592f640 1 -- 10.20.193.48:0/3299761680 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9ce013ef60 msgr2=0x7f9ce008a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:20.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.770+0000 7f9ce592f640 1 --2- 10.20.193.48:0/3299761680 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9ce013ef60 0x7f9ce008a680 secure :-1 s=READY pgs=236 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cdc00d700 tx=0x7f9cdc00dbd0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:20.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.770+0000 7f9ccdffb640 1 -- 10.20.193.48:0/3299761680 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9cdc008530 con 0x7f9ce013ef60 2026-02-12T18:15:20.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.770+0000 7f9ccdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:20.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.770+0000 7f9ccdffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:15:20.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.770+0000 7f9ccdffb640 10 monclient: dump: 2026-02-12T18:15:20.784 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:20.784 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.784 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.784 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.784 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:20.784 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.784 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:20.784 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:20.784 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:20.784 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:20.784 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:20.784 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:20.784 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:20.784 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:20.784 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:20.785 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.770+0000 7f9ccdffb640 10 monclient: _finish_auth 0 2026-02-12T18:15:20.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.770+0000 7f9ccdffb640 10 monclient: _check_auth_tickets 2026-02-12T18:15:20.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.770+0000 7f9ccdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:15:20.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.770+0000 7f9ccdffb640 1 -- 10.20.193.48:0/3299761680 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cdc0086b0 con 0x7f9ce013ef60 2026-02-12T18:15:20.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.770+0000 7f9ccdffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:15:20.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.770+0000 7f9ccdffb640 1 -- 10.20.193.48:0/3299761680 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9cdc008820 con 0x7f9ce013ef60 2026-02-12T18:15:20.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.770+0000 7f9ccdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:20.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.770+0000 7f9ccf7fe640 4 set_mon_vals no callback set 2026-02-12T18:15:20.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.770+0000 7f9ccdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:15:20.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.770+0000 7f9ccdffb640 10 monclient: dump: 2026-02-12T18:15:20.785 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:20.785 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.785 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.785 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.786 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:20.786 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.786 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:20.786 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:20.786 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:20.786 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:20.786 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:20.786 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:20.786 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:20.786 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:20.786 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:20.786 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.770+0000 7f9ce73b9640 5 monclient: authenticate success, global_id 65191 2026-02-12T18:15:20.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.770+0000 7f9ce73b9640 10 monclient: _renew_subs 2026-02-12T18:15:20.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.770+0000 7f9ce73b9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:15:20.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.770+0000 7f9ce73b9640 1 -- 10.20.193.48:0/3299761680 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce010ef90 con 0x7f9ce013ef60 2026-02-12T18:15:20.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.770+0000 7f9ce73b9640 10 monclient: _renew_subs 2026-02-12T18:15:20.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.770+0000 7f9ce73b9640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:15:20.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.770+0000 7f9ce73b9640 1 -- 10.20.193.48:0/3299761680 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce0131f40 con 0x7f9ce013ef60 2026-02-12T18:15:20.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.771+0000 7f9ce73b9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:15:20.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.771+0000 7f9ce73b9640 1 --2- 10.20.193.48:0/3299761680 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9ce0091010 0x7f9ce008abc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.771+0000 7f9ce73b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.771+0000 7f9ce73b9640 1 -- 10.20.193.48:0/3299761680 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce010f120 con 0x7f9ce0091010 2026-02-12T18:15:20.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.771+0000 7f9ce512e640 1 --2- 10.20.193.48:0/3299761680 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9ce0091010 0x7f9ce008abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.771+0000 7f9ce512e640 10 monclient: get_auth_request con 0x7f9ce0091010 auth_method 0 2026-02-12T18:15:20.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.771+0000 7f9ce512e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:20.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.771+0000 7f9ce512e640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:20.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.771+0000 7f9ce512e640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:20.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.771+0000 7f9ce512e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:20.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.771+0000 7f9ce512e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:20.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.771+0000 7f9ce512e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:20.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.771+0000 7f9ccdffb640 1 -- 10.20.193.48:0/3299761680 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f9cdc006b70 con 0x7f9ce013ef60 2026-02-12T18:15:20.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.771+0000 7f9ce512e640 10 monclient(hunting): handle_auth_done global_id 36578 payload 824 2026-02-12T18:15:20.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.771+0000 7f9ce512e640 1 -- 10.20.193.48:0/3299761680 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ce010de10 con 0x7f9ce0091010 2026-02-12T18:15:20.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.772+0000 7f9ccdffb640 1 --2- 10.20.193.48:0/3299761680 >> v2:10.20.193.111:6812/977811348 conn(0x7f9cb003f780 0x7f9cb005fc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.772+0000 7f9ccdffb640 1 -- 10.20.193.48:0/3299761680 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(322..322 src has 215..322) ==== 3503+0+0 (secure 0 0 0) 0x7f9cdc052ef0 con 0x7f9ce013ef60 2026-02-12T18:15:20.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.772+0000 7f9ce492d640 1 --2- 10.20.193.48:0/3299761680 >> v2:10.20.193.111:6812/977811348 conn(0x7f9cb003f780 0x7f9cb005fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.772+0000 7f9ce492d640 10 monclient: get_auth_request con 0x7f9cb003f780 auth_method 0 2026-02-12T18:15:20.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.774+0000 7f9ce512e640 1 -- 10.20.193.48:0/3299761680 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9ce0091010 msgr2=0x7f9ce008abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:20.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.774+0000 7f9ce512e640 1 --2- 10.20.193.48:0/3299761680 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9ce0091010 0x7f9ce008abc0 secure :-1 s=READY pgs=417 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cd002eec0 tx=0x7f9cd0004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:20.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.774+0000 7f9ccdffb640 1 -- 10.20.193.48:0/3299761680 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9cd002fc30 con 0x7f9ce0091010 2026-02-12T18:15:20.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.774+0000 7f9ccdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:20.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.774+0000 7f9ccdffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:15:20.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.774+0000 7f9ccdffb640 10 monclient: dump: 2026-02-12T18:15:20.791 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:20.791 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.791 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.791 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.791 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:20.792 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.792 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:20.792 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:20.792 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:20.792 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:20.792 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:20.792 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:20.792 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:20.792 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:20.792 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:20.792 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.774+0000 7f9ccdffb640 1 -- 10.20.193.48:0/3299761680 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f9cd0004030 con 0x7f9ce0091010 2026-02-12T18:15:20.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.774+0000 7f9ccdffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:15:20.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.774+0000 7f9ccdffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:15:20.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.774+0000 7f9ccdffb640 1 -- 10.20.193.48:0/3299761680 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9ce0091010 msgr2=0x7f9ce008abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:20.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.774+0000 7f9ccdffb640 1 --2- 10.20.193.48:0/3299761680 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9ce0091010 0x7f9ce008abc0 secure :-1 s=READY pgs=417 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cd002eec0 tx=0x7f9cd0004770 comp rx=0 tx=0).stop 2026-02-12T18:15:20.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.774+0000 7f9ccdffb640 1 -- 10.20.193.48:0/3299761680 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9ce0091010 msgr2=0x7f9ce008abc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:15:20.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.774+0000 7f9ccdffb640 1 --2- 10.20.193.48:0/3299761680 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9ce0091010 0x7f9ce008abc0 secure :-1 s=CLOSED pgs=417 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cd002eec0 tx=0x7f9cd0004770 comp rx=0 tx=0).stop 2026-02-12T18:15:20.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.774+0000 7f9ce492d640 1 --2- 10.20.193.48:0/3299761680 >> v2:10.20.193.111:6812/977811348 conn(0x7f9cb003f780 0x7f9cb005fc30 secure :-1 s=READY pgs=463 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ce005c920 tx=0x7f9cd4006d90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:20.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.777+0000 7f9ce73b9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:15:20.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.777+0000 7f9ce73b9640 1 --2- 10.20.193.48:0/3299761680 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9ce008b100 0x7f9ce0058950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.777+0000 7f9ce73b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.777+0000 7f9ce73b9640 1 -- 10.20.193.48:0/3299761680 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f9ce0050410 con 0x7f9ce008b100 2026-02-12T18:15:20.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.777+0000 7f9ce512e640 1 --2- 10.20.193.48:0/3299761680 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9ce008b100 0x7f9ce0058950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.777+0000 7f9ce512e640 10 monclient: get_auth_request con 0x7f9ce008b100 auth_method 0 2026-02-12T18:15:20.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.777+0000 7f9ce512e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:20.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.777+0000 7f9ce512e640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:20.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.777+0000 7f9ce512e640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:20.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.777+0000 7f9ce512e640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:20.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.777+0000 7f9ce512e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:20.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.777+0000 7f9ce512e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:20.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.778+0000 7f9ce512e640 10 monclient(hunting): handle_auth_done global_id 36587 payload 824 2026-02-12T18:15:20.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.778+0000 7f9ce512e640 1 -- 10.20.193.48:0/3299761680 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9ce0057e00 con 0x7f9ce008b100 2026-02-12T18:15:20.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.780+0000 7f9ce512e640 1 -- 10.20.193.48:0/3299761680 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9ce008b100 msgr2=0x7f9ce0058950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:20.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.780+0000 7f9ce512e640 1 --2- 10.20.193.48:0/3299761680 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9ce008b100 0x7f9ce0058950 secure :-1 s=READY pgs=418 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cd002eec0 tx=0x7f9cd00092c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:20.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.780+0000 7f9ccdffb640 1 -- 10.20.193.48:0/3299761680 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9cd004e070 con 0x7f9ce008b100 2026-02-12T18:15:20.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.780+0000 7f9ccdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:20.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.780+0000 7f9ccdffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:15:20.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.780+0000 7f9ccdffb640 10 monclient: dump: 2026-02-12T18:15:20.794 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:20.794 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.794 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.794 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.794 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:20.794 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.794 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:20.795 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:20.795 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:20.795 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:20.795 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:20.795 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:20.795 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:20.795 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:20.795 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:20.795 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.780+0000 7f9ccdffb640 1 -- 10.20.193.48:0/3299761680 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10316 (secure 0 0 0) 0x7f9cd0003e70 con 0x7f9ce008b100 2026-02-12T18:15:20.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.780+0000 7f9ccdffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:15:20.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.780+0000 7f9ccdffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:15:20.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.780+0000 7f9ccdffb640 1 -- 10.20.193.48:0/3299761680 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9ce008b100 msgr2=0x7f9ce0058950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:20.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.780+0000 7f9ccdffb640 1 --2- 10.20.193.48:0/3299761680 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9ce008b100 0x7f9ce0058950 secure :-1 s=READY pgs=418 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cd002eec0 tx=0x7f9cd00092c0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.780+0000 7f9ccdffb640 1 -- 10.20.193.48:0/3299761680 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9ce008b100 msgr2=0x7f9ce0058950 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:15:20.795 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.780+0000 7f9ccdffb640 1 --2- 10.20.193.48:0/3299761680 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9ce008b100 0x7f9ce0058950 secure :-1 s=CLOSED pgs=418 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cd002eec0 tx=0x7f9cd00092c0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.796 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:15:20.796 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:15:20.796 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:15:20.796 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:15:20.796 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 86, 2026-02-12T18:15:20.796 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 575614, 2026-02-12T18:15:20.796 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:15:20.796 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:15:20.796 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:15:20.796 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:15:20.796 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:15:20.796 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:15:20.797 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:15:20.797 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:20.797 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 1, 2026-02-12T18:15:20.797 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:15:20.797 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:15:20.797 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:15:20.797 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:15:20.797 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:15:20.797 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:15:20.797 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:15:20.797 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:15:20.797 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:15:20.797 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:15:20.797 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:15:20.797 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:15:20.797 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:15:20.797 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:15:20.797 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:15:20.797 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:15:20.798 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:20.798 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:15:20.798 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:15:20.798 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:15:20.798 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:15:20.798 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:15:20.798 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:15:20.798 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:15:20.798 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:15:20.798 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:15:20.798 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:15:20.798 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:15:20.798 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:15:20.798 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:15:20.798 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:15:20.798 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:15:20.799 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.799 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.799 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:15:20.799 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:15:20.799 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:15:20.799 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:15:20.799 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:15:20.799 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:15:20.799 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:15:20.799 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:15:20.799 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:15:20.799 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:15:20.799 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:15:20.799 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:15:20.799 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:15:20.799 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:15:20.799 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:15:20.799 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:15:20.799 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:15:20.800 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:15:20.800 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:15:20.800 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:15:20.800 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:15:20.800 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:15:20.800 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:15:20.800 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:15:20.800 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:15:20.800 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:15:20.800 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:15:20.800 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:15:20.800 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:15:20.800 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:15:20.800 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:20.800 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:15:20.800 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.800 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:15:20.800 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.800 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:15:20.800 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:15:20.801 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.801 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.801 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.801 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.801 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:15:20.801 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.801 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.801 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.801 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.801 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:15:20.801 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.801 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.801 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.801 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.801 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:15:20.801 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:15:20.801 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.801 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.801 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:15:20.801 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.802 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.802 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.802 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:15:20.802 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:15:20.802 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.802 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.802 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.802 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.802 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:15:20.802 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.802 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.802 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.802 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.802 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:15:20.802 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.802 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.802 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.802 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.802 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:15:20.802 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:15:20.802 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.803 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.803 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:15:20.803 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.803 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.803 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.803 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:15:20.803 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:15:20.803 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.803 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.803 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.803 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.803 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:15:20.803 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.803 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.803 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.803 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.803 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:15:20.803 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.804 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.804 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.804 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.804 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:15:20.804 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:15:20.804 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.804 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.804 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:15:20.804 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.804 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.804 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.804 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:15:20.804 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:15:20.804 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.804 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.804 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.804 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.804 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:15:20.804 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.804 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.804 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.805 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.805 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:15:20.805 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.805 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.805 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.805 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.805 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:15:20.805 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:15:20.805 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.805 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.805 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:15:20.805 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.805 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.805 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.805 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:15:20.805 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:15:20.805 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.805 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.805 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.805 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.805 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:15:20.806 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.806 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.806 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.806 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.806 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:15:20.806 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.806 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.806 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.806 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.806 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:15:20.806 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:15:20.806 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.806 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.806 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:15:20.806 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.806 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.806 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.806 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:15:20.806 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:15:20.806 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.806 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.806 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.807 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.807 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:15:20.807 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.807 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.807 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.807 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.807 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:15:20.807 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.807 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.807 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.807 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.807 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:15:20.807 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:15:20.807 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.807 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.807 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:15:20.807 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.807 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.807 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.807 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:15:20.807 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:15:20.808 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.808 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.808 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.808 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.808 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:15:20.808 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.808 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.808 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.808 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.808 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:15:20.808 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.808 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.808 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.808 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.808 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:15:20.808 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:15:20.808 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.808 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.808 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:15:20.809 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.809 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.809 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.809 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:15:20.809 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:15:20.809 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.809 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.809 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.809 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.809 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:15:20.809 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.809 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.809 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.809 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.809 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:15:20.809 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.809 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.809 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.809 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.809 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:15:20.809 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:15:20.809 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.810 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.810 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:15:20.810 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.810 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.810 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.810 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:15:20.810 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:15:20.810 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.810 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.810 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.810 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.810 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:15:20.810 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.810 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.810 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.810 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.810 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:15:20.810 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.810 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.810 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.810 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.810 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:15:20.810 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:15:20.811 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.811 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.811 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:15:20.811 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.811 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.811 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.811 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.811 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:15:20.811 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:15:20.811 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.811 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:15:20.811 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:15:20.811 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:15:20.811 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.811 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:20.811 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:15:20.811 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.811 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:15:20.811 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:15:20.811 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:15:20.811 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.811 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:20.811 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:15:20.811 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.812 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:15:20.812 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:15:20.812 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:15:20.812 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.812 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:20.812 INFO:teuthology.orchestra.run.trial048.stdout: "mgr": [ 2026-02-12T18:15:20.812 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.812 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:15:20.812 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:15:20.812 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:15:20.812 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.812 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.812 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.812 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:15:20.812 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:15:20.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.780+0000 7f9ce73b9640 1 -- 10.20.193.48:0/3299761680 >> v2:10.20.193.111:6812/977811348 conn(0x7f9cb003f780 msgr2=0x7f9cb005fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:20.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.780+0000 7f9ce73b9640 1 --2- 10.20.193.48:0/3299761680 >> v2:10.20.193.111:6812/977811348 conn(0x7f9cb003f780 0x7f9cb005fc30 secure :-1 s=READY pgs=463 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9ce005c920 tx=0x7f9cd4006d90 comp rx=0 tx=0).stop 2026-02-12T18:15:20.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.780+0000 7f9ce73b9640 10 monclient: shutdown 2026-02-12T18:15:20.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.780+0000 7f9ce73b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:15:20.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.780+0000 7f9ce73b9640 1 -- 10.20.193.48:0/3299761680 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9ce013ef60 msgr2=0x7f9ce008a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:20.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.780+0000 7f9ce592f640 1 -- 10.20.193.48:0/3299761680 reap_dead start 2026-02-12T18:15:20.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.780+0000 7f9ce73b9640 1 --2- 10.20.193.48:0/3299761680 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9ce013ef60 0x7f9ce008a680 secure :-1 s=READY pgs=236 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9cdc00d700 tx=0x7f9cdc00dbd0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.780+0000 7f9ce73b9640 1 -- 10.20.193.48:0/3299761680 shutdown_connections 2026-02-12T18:15:20.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.780+0000 7f9ce73b9640 1 --2- 10.20.193.48:0/3299761680 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9ce013ef60 0x7f9ce008a680 unknown :-1 s=CLOSED pgs=236 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.780+0000 7f9ce73b9640 1 -- 10.20.193.48:0/3299761680 >> 10.20.193.48:0/3299761680 conn(0x7f9ce00546a0 msgr2=0x7f9ce0123410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:15:20.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.780+0000 7f9ce73b9640 1 -- 10.20.193.48:0/3299761680 shutdown_connections 2026-02-12T18:15:20.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.780+0000 7f9ce73b9640 1 -- 10.20.193.48:0/3299761680 wait complete. 2026-02-12T18:15:20.814 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2026-02-12T18:15:20.814 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon c 2026-02-12T18:15:20.814 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T18:15:20.880 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.879+0000 7feea8a5b640 10 monclient: get_monmap_and_config 2026-02-12T18:15:20.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.879+0000 7feea8a5b640 10 monclient: build_initial_monmap 2026-02-12T18:15:20.881 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.879+0000 7feea8a5b640 10 monclient: monmap: 2026-02-12T18:15:20.881 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:15:20.881 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.881 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:15:20.880306+0000 2026-02-12T18:15:20.881 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:15:20.880306+0000 2026-02-12T18:15:20.881 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:15:20.881 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.881 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:15:20.881 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:15:20.881 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:15:20.881 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:15:20.881 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:15:20.881 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:15:20.881 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:15:20.881 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:15:20.881 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:15:20.881 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:15:20.881 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:15:20.881 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.879+0000 7feea8a5b640 1 Processor -- start 2026-02-12T18:15:20.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.879+0000 7feea8a5b640 1 -- start start 2026-02-12T18:15:20.882 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.879+0000 7feea8a5b640 10 monclient: init 2026-02-12T18:15:20.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.879+0000 7feea8a5b640 10 monclient: _reopen_session rank -1 2026-02-12T18:15:20.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.879+0000 7feea8a5b640 10 monclient: _add_conns ranks=[0,6,2,8,5,1,7,4,3,10,9] 2026-02-12T18:15:20.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.879+0000 7feea8a5b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7feea405d550 addr v1:10.20.193.48:6789/0 2026-02-12T18:15:20.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.879+0000 7feea8a5b640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feea413ef60 0x7feea4183320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.879+0000 7feea8a5b640 10 monclient(hunting): picked mon.noname-d con 0x7feea413ef60 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:15:20.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea8a5b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feea4183860 0x7feea41a3c40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea8a5b640 10 monclient(hunting): picked mon.noname-b con 0x7feea4183860 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:15:20.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea8a5b640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feea404dc20 con 0x7feea405d550 2026-02-12T18:15:20.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea8a5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.883 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea8a5b640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7feea408d390 con 0x7feea4183860 2026-02-12T18:15:20.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea8a5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea8a5b640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7feea408d5a0 con 0x7feea413ef60 2026-02-12T18:15:20.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea8a5b640 10 monclient(hunting): _renew_subs 2026-02-12T18:15:20.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea8a5b640 10 monclient(hunting): authenticate will time out at 1159.606042s 2026-02-12T18:15:20.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea1d74640 1 -- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feea413ef60 msgr2=0x7feea4183320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.48:3303/0 2026-02-12T18:15:20.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea1d74640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feea413ef60 0x7feea4183320 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:15:20.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea2575640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7feea405d550 0x7feea405d920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:53630/0 (socket says 10.20.193.48:53630) 2026-02-12T18:15:20.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea2575640 1 -- 10.20.193.48:0/1008436518 learned_addr learned my addr 10.20.193.48:0/1008436518 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:15:20.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea2d76640 1 --2- 10.20.193.48:0/1008436518 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feea4183860 0x7feea41a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea2d76640 10 monclient(hunting): get_auth_request con 0x7feea4183860 auth_method 0 2026-02-12T18:15:20.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:20.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea2d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:20.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:20.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:20.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:20.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:20.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea2d76640 10 monclient(hunting): handle_auth_done global_id 36596 payload 274 2026-02-12T18:15:20.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea2d76640 1 -- 10.20.193.48:0/1008436518 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feea413ef60 msgr2=0x7feea4183320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:15:20.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea2d76640 1 --2- 10.20.193.48:0/1008436518 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feea413ef60 0x7feea4183320 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea2d76640 1 -- 10.20.193.48:0/1008436518 >> v1:10.20.193.48:6789/0 conn(0x7feea405d550 legacy=0x7feea405d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:15:20.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea2d76640 10 monclient: _finish_hunting 0 2026-02-12T18:15:20.884 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea2d76640 1 monclient: found mon.noname-b 2026-02-12T18:15:20.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea2d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:15:20.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea2d76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:15:20.885 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.880+0000 7feea2d76640 1 -- 10.20.193.48:0/1008436518 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea40580e0 con 0x7feea4183860 2026-02-12T18:15:20.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.882+0000 7feea2d76640 1 -- 10.20.193.48:0/1008436518 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feea4183860 msgr2=0x7feea41a3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:20.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.882+0000 7feea2d76640 1 --2- 10.20.193.48:0/1008436518 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feea4183860 0x7feea41a3c40 secure :-1 s=READY pgs=419 gs=3 cs=0 l=1 c_cookie=15905529769563016948 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee9400a8e0 tx=0x7fee9402fe40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcbbcb0de7344ef4 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:20.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.882+0000 7feea1573640 1 -- 10.20.193.48:0/1008436518 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fee94030ba0 con 0x7feea4183860 2026-02-12T18:15:20.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.882+0000 7feea1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:20.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.882+0000 7feea1573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:15:20.887 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.882+0000 7feea1573640 10 monclient: dump: 2026-02-12T18:15:20.887 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:20.887 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.887 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.887 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.888 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:20.888 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.888 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:20.888 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:20.888 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:20.888 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:20.888 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:20.888 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:20.888 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:20.888 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:20.888 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:20.888 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.883+0000 7feea1573640 10 monclient: _finish_auth 0 2026-02-12T18:15:20.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.883+0000 7feea1573640 10 monclient: _check_auth_tickets 2026-02-12T18:15:20.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.883+0000 7feea1573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:15:20.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.883+0000 7feea1573640 1 -- 10.20.193.48:0/1008436518 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee94030d20 con 0x7feea4183860 2026-02-12T18:15:20.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.883+0000 7feea8a5b640 5 monclient: authenticate success, global_id 36596 2026-02-12T18:15:20.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.883+0000 7feea1573640 10 monclient: handle_config config(0 keys) 2026-02-12T18:15:20.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.883+0000 7feea1573640 1 -- 10.20.193.48:0/1008436518 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fee94030e90 con 0x7feea4183860 2026-02-12T18:15:20.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.883+0000 7feea1573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:20.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.883+0000 7feea1573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:15:20.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.883+0000 7feea1573640 10 monclient: dump: 2026-02-12T18:15:20.888 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:20.889 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.889 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.889 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.889 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:20.889 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.889 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:20.889 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:20.889 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:20.889 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:20.889 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:20.889 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:20.889 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:20.889 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:20.889 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:20.889 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.883+0000 7feea8a5b640 10 monclient: get_monmap_and_config success 2026-02-12T18:15:20.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.883+0000 7feea8a5b640 4 set_mon_vals no callback set 2026-02-12T18:15:20.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.883+0000 7feea8a5b640 10 monclient: shutdown 2026-02-12T18:15:20.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.883+0000 7feea8a5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:15:20.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.883+0000 7feea8a5b640 1 -- 10.20.193.48:0/1008436518 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feea4183860 msgr2=0x7feea41a3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:20.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.883+0000 7feea8a5b640 1 --2- 10.20.193.48:0/1008436518 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feea4183860 0x7feea41a3c40 secure :-1 s=READY pgs=419 gs=3 cs=0 l=1 c_cookie=15905529769563016948 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee9400a8e0 tx=0x7fee9402fe40 comp rx=0 tx=0).stop 2026-02-12T18:15:20.889 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.883+0000 7feea8a5b640 1 -- 10.20.193.48:0/1008436518 shutdown_connections 2026-02-12T18:15:20.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.883+0000 7feea8a5b640 1 --2- 10.20.193.48:0/1008436518 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feea4183860 0x7feea41a3c40 unknown :-1 s=CLOSED pgs=419 gs=3 cs=0 l=1 c_cookie=15905529769563016948 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.883+0000 7feea8a5b640 1 --2- 10.20.193.48:0/1008436518 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feea413ef60 0x7feea4183320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.883+0000 7feea8a5b640 1 -- 10.20.193.48:0/1008436518 >> 10.20.193.48:0/1008436518 conn(0x7feea40546a0 msgr2=0x7feea4054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:15:20.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.883+0000 7feea8a5b640 1 -- 10.20.193.48:0/1008436518 shutdown_connections 2026-02-12T18:15:20.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.883+0000 7feea8a5b640 1 -- 10.20.193.48:0/1008436518 wait complete. 2026-02-12T18:15:20.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.883+0000 7feea8a5b640 10 monclient: build_initial_monmap 2026-02-12T18:15:20.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.883+0000 7feea8a5b640 10 monclient: monmap: 2026-02-12T18:15:20.890 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:15:20.890 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:15:20.890 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:15:20.890 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:15:20.890 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:15:20.890 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.890 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:15:20.890 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:15:20.890 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:15:20.890 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:15:20.890 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:15:20.890 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:15:20.890 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:15:20.890 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:15:20.890 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:15:20.890 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.890 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.883+0000 7feea8a5b640 1 Processor -- start 2026-02-12T18:15:20.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.883+0000 7feea8a5b640 1 -- start start 2026-02-12T18:15:20.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea8a5b640 10 monclient: init 2026-02-12T18:15:20.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea8a5b640 10 monclient: _reopen_session rank -1 2026-02-12T18:15:20.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea8a5b640 10 monclient: _add_conns ranks=[3,1,0,5,6,4,2,8,7] 2026-02-12T18:15:20.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea8a5b640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7feea405d550 0x7feea4114d60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea8a5b640 10 monclient(hunting): picked mon.noname-g con 0x7feea405d550 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:15:20.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea8a5b640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7feea413ef60 0x7feea4115680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea8a5b640 10 monclient(hunting): picked mon.noname-f con 0x7feea413ef60 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:15:20.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea8a5b640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7feea4183860 0x7feea4125070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea8a5b640 10 monclient(hunting): picked mon.noname-a con 0x7feea4183860 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:15:20.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea8a5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea8a5b640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7feea41284c0 con 0x7feea4183860 2026-02-12T18:15:20.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea8a5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea8a5b640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7feea41152a0 con 0x7feea413ef60 2026-02-12T18:15:20.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea8a5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea8a5b640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7feea4127cd0 con 0x7feea405d550 2026-02-12T18:15:20.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea8a5b640 10 monclient(hunting): _renew_subs 2026-02-12T18:15:20.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea8a5b640 10 monclient(hunting): authenticate will time out at 1159.610236s 2026-02-12T18:15:20.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea2d76640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7feea4183860 0x7feea4125070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea2d76640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7feea4183860 0x7feea4125070 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:35506/0 (socket says 10.20.193.48:35506) 2026-02-12T18:15:20.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea2d76640 1 -- 10.20.193.48:0/574752581 learned_addr learned my addr 10.20.193.48:0/574752581 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:15:20.891 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea2d76640 10 monclient(hunting): get_auth_request con 0x7feea4183860 auth_method 0 2026-02-12T18:15:20.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea2d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:20.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea2d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:20.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea2d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:20.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea2d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:20.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea2d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:20.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea2d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:20.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea1d74640 1 --2- 10.20.193.48:0/574752581 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7feea413ef60 0x7feea4115680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea2575640 1 --2- 10.20.193.48:0/574752581 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7feea405d550 0x7feea4114d60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea1d74640 10 monclient(hunting): get_auth_request con 0x7feea413ef60 auth_method 0 2026-02-12T18:15:20.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea1d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:20.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea1d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:20.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea1d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:20.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea2575640 10 monclient(hunting): get_auth_request con 0x7feea405d550 auth_method 0 2026-02-12T18:15:20.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:20.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea2575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:20.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:20.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea2d76640 10 monclient(hunting): handle_auth_done global_id 6966 payload 824 2026-02-12T18:15:20.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea2d76640 1 -- 10.20.193.48:0/574752581 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7feea405d550 msgr2=0x7feea4114d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:20.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea2d76640 1 --2- 10.20.193.48:0/574752581 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7feea405d550 0x7feea4114d60 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea2d76640 1 -- 10.20.193.48:0/574752581 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7feea413ef60 msgr2=0x7feea4115680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:20.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea2d76640 1 --2- 10.20.193.48:0/574752581 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7feea413ef60 0x7feea4115680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea2d76640 10 monclient: _finish_hunting 0 2026-02-12T18:15:20.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea2d76640 1 monclient: found mon.noname-a 2026-02-12T18:15:20.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea2d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:15:20.892 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea2d76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:15:20.893 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.884+0000 7feea2d76640 1 -- 10.20.193.48:0/574752581 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee9400a500 con 0x7feea4183860 2026-02-12T18:15:20.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.886+0000 7feea2d76640 1 -- 10.20.193.48:0/574752581 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7feea4183860 msgr2=0x7feea4125070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:20.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.886+0000 7feea2d76640 1 --2- 10.20.193.48:0/574752581 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7feea4183860 0x7feea4125070 secure :-1 s=READY pgs=663 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee9400a830 tx=0x7fee94005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:20.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.886+0000 7fee8affd640 1 -- 10.20.193.48:0/574752581 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fee940054f0 con 0x7feea4183860 2026-02-12T18:15:20.895 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.886+0000 7fee8affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:20.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.886+0000 7fee8affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:15:20.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.886+0000 7fee8affd640 10 monclient: dump: 2026-02-12T18:15:20.896 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:20.896 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.896 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.896 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.896 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:20.896 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.896 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:20.896 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:20.896 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:20.896 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:20.896 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:20.896 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:20.896 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:20.896 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:20.896 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:20.896 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.886+0000 7fee8affd640 10 monclient: _finish_auth 0 2026-02-12T18:15:20.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.886+0000 7fee8affd640 10 monclient: _check_auth_tickets 2026-02-12T18:15:20.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.886+0000 7fee8affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:15:20.896 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.886+0000 7fee8affd640 1 -- 10.20.193.48:0/574752581 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee94030e90 con 0x7feea4183860 2026-02-12T18:15:20.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.886+0000 7feea8a5b640 5 monclient: authenticate success, global_id 6966 2026-02-12T18:15:20.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.886+0000 7feea8a5b640 10 monclient: _renew_subs 2026-02-12T18:15:20.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.886+0000 7feea8a5b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:15:20.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.886+0000 7feea8a5b640 1 -- 10.20.193.48:0/574752581 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feea408e800 con 0x7feea4183860 2026-02-12T18:15:20.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.886+0000 7fee8affd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:15:20.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.886+0000 7fee8affd640 1 -- 10.20.193.48:0/574752581 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fee94005690 con 0x7feea4183860 2026-02-12T18:15:20.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.886+0000 7fee8affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:20.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.886+0000 7feea0d72640 4 set_mon_vals no callback set 2026-02-12T18:15:20.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.886+0000 7fee8affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:15:20.897 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.886+0000 7fee8affd640 10 monclient: dump: 2026-02-12T18:15:20.897 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:20.897 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.897 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.897 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.897 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:20.897 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.897 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:20.897 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:20.897 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:20.897 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:20.897 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:20.898 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:20.898 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:20.898 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:20.898 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:20.898 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.886+0000 7feea8a5b640 10 monclient: _renew_subs 2026-02-12T18:15:20.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.886+0000 7feea8a5b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:15:20.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.886+0000 7feea8a5b640 1 -- 10.20.193.48:0/574752581 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea4128d60 con 0x7feea4183860 2026-02-12T18:15:20.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.887+0000 7feea8a5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:15:20.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.887+0000 7feea8a5b640 1 --2- 10.20.193.48:0/574752581 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7feea4091010 0x7feea41255b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.887+0000 7feea8a5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.887+0000 7feea8a5b640 1 -- 10.20.193.48:0/574752581 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7feea40631f0 con 0x7feea4091010 2026-02-12T18:15:20.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.887+0000 7fee8affd640 1 -- 10.20.193.48:0/574752581 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fee94005030 con 0x7feea4183860 2026-02-12T18:15:20.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.887+0000 7feea2575640 1 --2- 10.20.193.48:0/574752581 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7feea4091010 0x7feea41255b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.887+0000 7feea2575640 10 monclient: get_auth_request con 0x7feea4091010 auth_method 0 2026-02-12T18:15:20.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.887+0000 7feea2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:20.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.887+0000 7feea2575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:20.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.887+0000 7feea2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:20.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.887+0000 7feea2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:20.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.887+0000 7feea2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:20.898 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.887+0000 7feea2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:20.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.887+0000 7fee8affd640 1 --2- 10.20.193.48:0/574752581 >> v2:10.20.193.111:6812/977811348 conn(0x7fee7003f800 0x7fee7005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.887+0000 7fee8affd640 1 -- 10.20.193.48:0/574752581 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(322..322 src has 215..322) ==== 3503+0+0 (secure 0 0 0) 0x7fee94079000 con 0x7feea4183860 2026-02-12T18:15:20.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.887+0000 7feea2575640 10 monclient(hunting): handle_auth_done global_id 65200 payload 824 2026-02-12T18:15:20.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.887+0000 7feea2575640 1 -- 10.20.193.48:0/574752581 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feea405e030 con 0x7feea4091010 2026-02-12T18:15:20.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.887+0000 7feea1d74640 1 --2- 10.20.193.48:0/574752581 >> v2:10.20.193.111:6812/977811348 conn(0x7fee7003f800 0x7fee7005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.887+0000 7feea1d74640 10 monclient: get_auth_request con 0x7fee7003f800 auth_method 0 2026-02-12T18:15:20.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.890+0000 7feea2575640 1 -- 10.20.193.48:0/574752581 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7feea4091010 msgr2=0x7feea41255b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:20.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.890+0000 7feea2575640 1 --2- 10.20.193.48:0/574752581 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7feea4091010 0x7feea41255b0 secure :-1 s=READY pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee9800d4f0 tx=0x7fee9800d9c0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:20.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.890+0000 7fee8affd640 1 -- 10.20.193.48:0/574752581 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fee98014dd0 con 0x7feea4091010 2026-02-12T18:15:20.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.890+0000 7fee8affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:20.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.890+0000 7fee8affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:15:20.899 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.890+0000 7fee8affd640 10 monclient: dump: 2026-02-12T18:15:20.899 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:20.899 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.899 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.899 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.899 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:20.899 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.899 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:20.899 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:20.899 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:20.899 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:20.899 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:20.900 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:20.900 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:20.900 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:20.900 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:20.900 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.890+0000 7fee8affd640 1 -- 10.20.193.48:0/574752581 <== mon.4 v2:10.20.193.48:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fee98014910 con 0x7feea4091010 2026-02-12T18:15:20.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.890+0000 7fee8affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:15:20.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.890+0000 7fee8affd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:15:20.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.890+0000 7fee8affd640 1 -- 10.20.193.48:0/574752581 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7feea4091010 msgr2=0x7feea41255b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:20.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.890+0000 7fee8affd640 1 --2- 10.20.193.48:0/574752581 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7feea4091010 0x7feea41255b0 secure :-1 s=READY pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee9800d4f0 tx=0x7fee9800d9c0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.890+0000 7fee8affd640 1 -- 10.20.193.48:0/574752581 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7feea4091010 msgr2=0x7feea41255b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:15:20.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.890+0000 7fee8affd640 1 --2- 10.20.193.48:0/574752581 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7feea4091010 0x7feea41255b0 secure :-1 s=CLOSED pgs=237 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee9800d4f0 tx=0x7fee9800d9c0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.890+0000 7feea1d74640 1 --2- 10.20.193.48:0/574752581 >> v2:10.20.193.111:6812/977811348 conn(0x7fee7003f800 0x7fee7005fcb0 secure :-1 s=READY pgs=464 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee8c006fd0 tx=0x7fee8c006f40 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:20.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.893+0000 7feea8a5b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:15:20.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.893+0000 7feea8a5b640 1 --2- 10.20.193.48:0/574752581 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7feea4125af0 0x7feea4058b50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.893+0000 7feea8a5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.893+0000 7feea8a5b640 1 -- 10.20.193.48:0/574752581 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7feea405f140 con 0x7feea4125af0 2026-02-12T18:15:20.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.894+0000 7feea2575640 1 --2- 10.20.193.48:0/574752581 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7feea4125af0 0x7feea4058b50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.894+0000 7feea2575640 10 monclient: get_auth_request con 0x7feea4125af0 auth_method 0 2026-02-12T18:15:20.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.894+0000 7feea2575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:20.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.894+0000 7feea2575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:20.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.894+0000 7feea2575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:20.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.894+0000 7feea2575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:20.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.894+0000 7feea2575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:20.900 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.894+0000 7feea2575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:20.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.894+0000 7feea2575640 10 monclient(hunting): handle_auth_done global_id 65209 payload 824 2026-02-12T18:15:20.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.894+0000 7feea2575640 1 -- 10.20.193.48:0/574752581 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7feea4057e00 con 0x7feea4125af0 2026-02-12T18:15:20.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.896+0000 7feea2575640 1 -- 10.20.193.48:0/574752581 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7feea4125af0 msgr2=0x7feea4058b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:20.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.896+0000 7feea2575640 1 --2- 10.20.193.48:0/574752581 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7feea4125af0 0x7feea4058b50 secure :-1 s=READY pgs=238 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee98016000 tx=0x7fee98005990 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:20.901 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.896+0000 7fee8affd640 1 -- 10.20.193.48:0/574752581 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fee98012e70 con 0x7feea4125af0 2026-02-12T18:15:20.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.896+0000 7fee8affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:20.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.896+0000 7fee8affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:15:20.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.896+0000 7fee8affd640 10 monclient: dump: 2026-02-12T18:15:20.902 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:20.902 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.902 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.902 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.902 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:20.902 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.902 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:20.902 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:20.902 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:20.902 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:20.902 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:20.902 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:20.902 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:20.902 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:20.902 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:20.902 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.896+0000 7fee8affd640 1 -- 10.20.193.48:0/574752581 <== mon.4 v2:10.20.193.48:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+9982 (secure 0 0 0) 0x7fee980129b0 con 0x7feea4125af0 2026-02-12T18:15:20.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.896+0000 7fee8affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:15:20.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.896+0000 7fee8affd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:15:20.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.896+0000 7fee8affd640 1 -- 10.20.193.48:0/574752581 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7feea4125af0 msgr2=0x7feea4058b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:20.902 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.896+0000 7fee8affd640 1 --2- 10.20.193.48:0/574752581 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7feea4125af0 0x7feea4058b50 secure :-1 s=READY pgs=238 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee98016000 tx=0x7fee98005990 comp rx=0 tx=0).stop 2026-02-12T18:15:20.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.896+0000 7fee8affd640 1 -- 10.20.193.48:0/574752581 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7feea4125af0 msgr2=0x7feea4058b50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:15:20.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.896+0000 7fee8affd640 1 --2- 10.20.193.48:0/574752581 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7feea4125af0 0x7feea4058b50 secure :-1 s=CLOSED pgs=238 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee98016000 tx=0x7fee98005990 comp rx=0 tx=0).stop 2026-02-12T18:15:20.903 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:15:20.903 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:15:20.903 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:15:20.903 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:15:20.903 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 86, 2026-02-12T18:15:20.903 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 301683, 2026-02-12T18:15:20.903 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:15:20.903 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:15:20.903 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:15:20.903 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:15:20.903 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:15:20.903 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:15:20.903 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:15:20.903 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:20.903 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 1, 2026-02-12T18:15:20.903 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:15:20.904 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:15:20.904 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:15:20.904 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:15:20.904 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:15:20.904 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:15:20.904 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:15:20.904 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:15:20.904 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:15:20.904 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:15:20.904 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:15:20.904 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:15:20.904 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:15:20.904 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:15:20.904 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:15:20.904 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:15:20.904 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:20.904 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:15:20.904 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:15:20.904 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:15:20.904 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:15:20.904 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:15:20.904 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:15:20.904 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:15:20.905 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:15:20.905 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:15:20.905 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:15:20.905 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:15:20.905 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:15:20.905 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:15:20.905 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:15:20.905 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:15:20.905 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.905 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.905 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:15:20.905 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:15:20.905 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:15:20.905 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:15:20.905 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:15:20.905 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:15:20.905 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:15:20.905 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:15:20.905 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:15:20.905 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:15:20.905 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:15:20.905 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:15:20.905 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:15:20.905 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:15:20.906 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:15:20.906 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:15:20.906 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:15:20.906 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:15:20.906 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:15:20.906 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:15:20.906 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:15:20.906 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:15:20.906 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:15:20.906 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:15:20.906 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:15:20.906 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:15:20.906 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:15:20.906 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:15:20.906 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:15:20.906 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:15:20.906 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:20.906 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:15:20.906 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.906 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:15:20.906 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.906 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:15:20.906 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:15:20.906 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.907 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.907 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.907 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.907 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:15:20.907 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.907 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.907 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.907 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.907 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:15:20.907 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.907 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.907 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.907 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.907 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:15:20.907 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:15:20.907 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.907 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.907 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:15:20.907 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.907 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.907 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.907 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:15:20.908 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:15:20.908 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.908 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.908 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.908 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.908 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:15:20.908 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.908 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.908 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.908 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.908 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:15:20.908 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.908 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.908 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.908 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.908 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:15:20.908 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:15:20.908 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.908 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.908 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:15:20.908 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.908 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.908 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.908 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:15:20.908 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:15:20.909 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.909 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.909 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.909 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.909 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:15:20.909 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.909 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.909 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.909 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.909 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:15:20.909 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.909 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.909 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.909 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.909 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:15:20.909 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:15:20.909 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.909 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.909 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:15:20.909 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.909 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.909 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.909 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:15:20.909 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:15:20.910 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.910 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.910 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.910 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.910 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:15:20.910 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.910 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.910 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.910 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.910 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:15:20.910 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.910 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.910 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.910 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.910 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:15:20.910 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:15:20.910 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.910 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.910 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:15:20.910 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.910 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.910 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.910 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:15:20.910 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:15:20.910 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.911 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.911 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.911 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.911 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:15:20.911 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.911 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.911 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.911 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.911 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:15:20.911 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.911 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.911 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.911 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.911 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:15:20.911 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:15:20.911 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.911 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.911 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:15:20.911 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.911 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.911 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.911 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:15:20.911 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:15:20.911 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.911 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.912 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.912 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.912 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:15:20.912 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.912 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.912 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.912 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.912 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:15:20.912 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.912 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.912 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.912 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.912 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:15:20.912 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:15:20.912 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.912 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.912 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:15:20.912 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.912 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.912 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.912 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:15:20.912 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:15:20.912 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.912 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.912 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.913 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.913 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:15:20.913 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.913 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.913 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.913 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.913 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:15:20.913 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.913 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.913 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.913 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.913 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:15:20.913 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:15:20.913 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.913 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.913 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:15:20.913 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.913 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.913 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.913 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:15:20.913 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:15:20.913 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.914 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.914 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.914 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.914 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:15:20.914 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.914 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.914 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.914 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.914 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:15:20.914 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.914 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.914 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.914 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.914 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:15:20.914 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:15:20.914 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.914 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.914 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:15:20.914 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.914 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.914 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.914 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:15:20.914 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:15:20.914 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:20.914 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:20.914 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:15:20.915 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.916 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:20.916 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:15:20.916 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:20.916 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:15:20.916 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:15:20.916 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:15:20.916 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:20.916 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:20.916 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:20.916 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:15:20.916 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:15:20.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.897+0000 7feea8a5b640 1 -- 10.20.193.48:0/574752581 >> v2:10.20.193.111:6812/977811348 conn(0x7fee7003f800 msgr2=0x7fee7005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:20.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.897+0000 7feea8a5b640 1 --2- 10.20.193.48:0/574752581 >> v2:10.20.193.111:6812/977811348 conn(0x7fee7003f800 0x7fee7005fcb0 secure :-1 s=READY pgs=464 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee8c006fd0 tx=0x7fee8c006f40 comp rx=0 tx=0).stop 2026-02-12T18:15:20.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.897+0000 7feea8a5b640 10 monclient: shutdown 2026-02-12T18:15:20.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.897+0000 7feea8a5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:15:20.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.897+0000 7feea8a5b640 1 -- 10.20.193.48:0/574752581 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7feea4183860 msgr2=0x7feea4125070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:20.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.897+0000 7feea8a5b640 1 --2- 10.20.193.48:0/574752581 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7feea4183860 0x7feea4125070 secure :-1 s=READY pgs=663 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fee9400a830 tx=0x7fee94005850 comp rx=0 tx=0).stop 2026-02-12T18:15:20.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.897+0000 7feea2d76640 1 -- 10.20.193.48:0/574752581 reap_dead start 2026-02-12T18:15:20.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.897+0000 7feea2d76640 1 -- 10.20.193.48:0/574752581 reap_dead start 2026-02-12T18:15:20.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.897+0000 7feea8a5b640 1 -- 10.20.193.48:0/574752581 shutdown_connections 2026-02-12T18:15:20.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.897+0000 7feea8a5b640 1 -- 10.20.193.48:0/574752581 >> 10.20.193.48:0/574752581 conn(0x7feea40546a0 msgr2=0x7feea413d190 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:15:20.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.897+0000 7feea8a5b640 1 -- 10.20.193.48:0/574752581 shutdown_connections 2026-02-12T18:15:20.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.897+0000 7feea8a5b640 1 -- 10.20.193.48:0/574752581 wait complete. 2026-02-12T18:15:20.917 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2026-02-12T18:15:20.917 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon e 2026-02-12T18:15:20.918 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2026-02-12T18:15:20.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.982+0000 7f0e00c5b640 10 monclient: get_monmap_and_config 2026-02-12T18:15:20.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.982+0000 7f0e00c5b640 10 monclient: build_initial_monmap 2026-02-12T18:15:20.986 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.982+0000 7f0e00c5b640 10 monclient: monmap: 2026-02-12T18:15:20.986 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:15:20.986 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.986 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:15:20.983704+0000 2026-02-12T18:15:20.986 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:15:20.983704+0000 2026-02-12T18:15:20.986 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:15:20.986 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.986 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:15:20.986 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:15:20.986 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:15:20.987 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:15:20.987 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:15:20.987 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:15:20.987 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:15:20.987 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:15:20.987 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:15:20.987 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:15:20.987 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:15:20.987 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0e00c5b640 1 Processor -- start 2026-02-12T18:15:20.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0e00c5b640 1 -- start start 2026-02-12T18:15:20.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0e00c5b640 10 monclient: init 2026-02-12T18:15:20.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0e00c5b640 10 monclient: _reopen_session rank -1 2026-02-12T18:15:20.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0e00c5b640 10 monclient: _add_conns ranks=[1,10,0,9,3,8,5,7,4,6,2] 2026-02-12T18:15:20.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0e00c5b640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f0dfc0914d0 addr v1:10.20.193.111:6789/0 2026-02-12T18:15:20.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0e00c5b640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f0dfc08e210 0x7f0dfc05d060 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0e00c5b640 10 monclient(hunting): picked mon.noname-f con 0x7f0dfc08e210 addr v2:10.20.193.111:3300/0 2026-02-12T18:15:20.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0e00c5b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f0dfc05e4b0 addr v1:10.20.193.48:6789/0 2026-02-12T18:15:20.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0e00c5b640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dfc04dc20 con 0x7f0dfc05e4b0 2026-02-12T18:15:20.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0e00c5b640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dfc092f90 con 0x7f0dfc0914d0 2026-02-12T18:15:20.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0e00c5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0e00c5b640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f0dfc093db0 con 0x7f0dfc08e210 2026-02-12T18:15:20.987 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0e00c5b640 10 monclient(hunting): _renew_subs 2026-02-12T18:15:20.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0e00c5b640 10 monclient(hunting): authenticate will time out at 1159.709415s 2026-02-12T18:15:20.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0dfad76640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f0dfc05e4b0 0x7f0dfc1a5c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=2 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:53636/0 (socket says 10.20.193.48:53636) 2026-02-12T18:15:20.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0dfad76640 1 -- 10.20.193.48:0/2264303631 learned_addr learned my addr 10.20.193.48:0/2264303631 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:15:20.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0df9d74640 1 --2- 10.20.193.48:0/2264303631 >> v2:10.20.193.111:3300/0 conn(0x7f0dfc08e210 0x7f0dfc05d060 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0df9d74640 10 monclient(hunting): get_auth_request con 0x7f0dfc08e210 auth_method 0 2026-02-12T18:15:20.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0df9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:20.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0df9d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:20.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0df9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:20.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0df9d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:20.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0df9d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:20.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0df9d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:20.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0df9d74640 10 monclient(hunting): handle_auth_done global_id 94978 payload 274 2026-02-12T18:15:20.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0df9d74640 1 -- 10.20.193.48:0/2264303631 >> v1:10.20.193.111:6789/0 conn(0x7f0dfc0914d0 legacy=0x7f0dfc05c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:15:20.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0df9d74640 1 -- 10.20.193.48:0/2264303631 >> v1:10.20.193.48:6789/0 conn(0x7f0dfc05e4b0 legacy=0x7f0dfc1a5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:15:20.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0df9d74640 10 monclient: _finish_hunting 0 2026-02-12T18:15:20.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0df9d74640 1 monclient: found mon.noname-f 2026-02-12T18:15:20.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0df9d74640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:15:20.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0df9d74640 10 monclient: _send_mon_message to mon.noname-f at v2:10.20.193.111:3300/0 2026-02-12T18:15:20.988 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.983+0000 7f0df9d74640 1 -- 10.20.193.48:0/2264303631 --> v2:10.20.193.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dfc0918d0 con 0x7f0dfc08e210 2026-02-12T18:15:20.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.986+0000 7f0df9d74640 1 -- 10.20.193.48:0/2264303631 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f0dfc08e210 msgr2=0x7f0dfc05d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:20.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.986+0000 7f0df9d74640 1 --2- 10.20.193.48:0/2264303631 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f0dfc08e210 0x7f0dfc05d060 secure :-1 s=READY pgs=184 gs=3 cs=0 l=1 c_cookie=1671946914637767345 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0de4004740 tx=0x7f0de402edb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1733f2dc4a4b62b1 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:20.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.986+0000 7f0df9573640 1 -- 10.20.193.48:0/2264303631 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f0de4035340 con 0x7f0dfc08e210 2026-02-12T18:15:20.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.986+0000 7f0df9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:20.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.986+0000 7f0df9573640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2026-02-12T18:15:20.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.986+0000 7f0df9573640 10 monclient: dump: 2026-02-12T18:15:20.991 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:20.991 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.991 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.991 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.991 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:20.991 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.991 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:20.991 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:20.991 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:20.991 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:20.991 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:20.991 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:20.991 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:20.991 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:20.991 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:20.992 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.986+0000 7f0df9573640 10 monclient: _finish_auth 0 2026-02-12T18:15:20.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.986+0000 7f0df9573640 10 monclient: _check_auth_tickets 2026-02-12T18:15:20.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.986+0000 7f0df9573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:15:20.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.986+0000 7f0df9573640 1 -- 10.20.193.48:0/2264303631 <== mon.1 v2:10.20.193.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de40354c0 con 0x7f0dfc08e210 2026-02-12T18:15:20.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.986+0000 7f0df9573640 10 monclient: handle_config config(0 keys) 2026-02-12T18:15:20.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.986+0000 7f0df9573640 1 -- 10.20.193.48:0/2264303631 <== mon.1 v2:10.20.193.111:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f0de4035af0 con 0x7f0dfc08e210 2026-02-12T18:15:20.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.986+0000 7f0e00c5b640 5 monclient: authenticate success, global_id 94978 2026-02-12T18:15:20.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.986+0000 7f0e00c5b640 10 monclient: get_monmap_and_config success 2026-02-12T18:15:20.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.986+0000 7f0e00c5b640 4 set_mon_vals no callback set 2026-02-12T18:15:20.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.986+0000 7f0df9573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:20.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.986+0000 7f0df9573640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:15:20.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.986+0000 7f0df9573640 10 monclient: dump: 2026-02-12T18:15:20.992 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:20.992 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.992 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.992 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.992 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:20.992 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.992 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:20.992 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:20.993 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:20.993 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:20.993 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:20.993 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:20.993 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:20.993 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:20.993 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:20.993 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.986+0000 7f0e00c5b640 10 monclient: shutdown 2026-02-12T18:15:20.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.986+0000 7f0e00c5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:15:20.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.986+0000 7f0e00c5b640 1 -- 10.20.193.48:0/2264303631 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f0dfc08e210 msgr2=0x7f0dfc05d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:20.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.986+0000 7f0e00c5b640 1 --2- 10.20.193.48:0/2264303631 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f0dfc08e210 0x7f0dfc05d060 secure :-1 s=READY pgs=184 gs=3 cs=0 l=1 c_cookie=1671946914637767345 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0de4004740 tx=0x7f0de402edb0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.986+0000 7f0e00c5b640 1 -- 10.20.193.48:0/2264303631 shutdown_connections 2026-02-12T18:15:20.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.986+0000 7f0e00c5b640 1 --2- 10.20.193.48:0/2264303631 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f0dfc08e210 0x7f0dfc05d060 unknown :-1 s=CLOSED pgs=184 gs=3 cs=0 l=1 c_cookie=1671946914637767345 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.986+0000 7f0e00c5b640 1 -- 10.20.193.48:0/2264303631 >> 10.20.193.48:0/2264303631 conn(0x7f0dfc0548a0 msgr2=0x7f0dfc097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:15:20.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.987+0000 7f0e00c5b640 1 -- 10.20.193.48:0/2264303631 shutdown_connections 2026-02-12T18:15:20.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.987+0000 7f0e00c5b640 1 -- 10.20.193.48:0/2264303631 wait complete. 2026-02-12T18:15:20.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.987+0000 7f0e00c5b640 10 monclient: build_initial_monmap 2026-02-12T18:15:20.993 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.987+0000 7f0e00c5b640 10 monclient: monmap: 2026-02-12T18:15:20.993 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:15:20.993 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:15:20.993 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:15:20.993 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:15:20.993 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:15:20.993 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.994 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:15:20.994 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:15:20.994 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:15:20.994 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:15:20.994 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:15:20.994 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:15:20.994 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:15:20.994 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:15:20.994 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:15:20.994 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.987+0000 7f0e00c5b640 1 Processor -- start 2026-02-12T18:15:20.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.987+0000 7f0e00c5b640 1 -- start start 2026-02-12T18:15:20.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.987+0000 7f0e00c5b640 10 monclient: init 2026-02-12T18:15:20.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.987+0000 7f0e00c5b640 10 monclient: _reopen_session rank -1 2026-02-12T18:15:20.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.987+0000 7f0e00c5b640 10 monclient: _add_conns ranks=[4,7,0,6,2,1,3,8,5] 2026-02-12T18:15:20.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.987+0000 7f0e00c5b640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f0dfc05e4b0 0x7f0dfc19b110 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.987+0000 7f0e00c5b640 10 monclient(hunting): picked mon.noname-c con 0x7f0dfc05e4b0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:15:20.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.987+0000 7f0e00c5b640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0dfc08e210 0x7f0dfc1db730 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0e00c5b640 10 monclient(hunting): picked mon.noname-i con 0x7f0dfc08e210 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:15:20.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0e00c5b640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f0dfc0914d0 0x7f0dfc1b0f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:20.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0e00c5b640 10 monclient(hunting): picked mon.noname-a con 0x7f0dfc0914d0 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:15:20.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0e00c5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0e00c5b640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f0dfc19c070 con 0x7f0dfc0914d0 2026-02-12T18:15:20.994 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0e00c5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0e00c5b640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f0dfc19a130 con 0x7f0dfc05e4b0 2026-02-12T18:15:20.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0e00c5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:20.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0e00c5b640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f0dfc19c910 con 0x7f0dfc08e210 2026-02-12T18:15:20.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0e00c5b640 10 monclient(hunting): _renew_subs 2026-02-12T18:15:20.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0e00c5b640 10 monclient(hunting): authenticate will time out at 1159.714020s 2026-02-12T18:15:20.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfa575640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f0dfc05e4b0 0x7f0dfc19b110 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfa575640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f0dfc05e4b0 0x7f0dfc19b110 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:59950/0 (socket says 10.20.193.48:59950) 2026-02-12T18:15:20.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfa575640 1 -- 10.20.193.48:0/296198092 learned_addr learned my addr 10.20.193.48:0/296198092 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:15:20.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0df9d74640 1 -- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0dfc08e210 msgr2=0x7f0dfc1db730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3303/0 2026-02-12T18:15:20.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfa575640 10 monclient(hunting): get_auth_request con 0x7f0dfc05e4b0 auth_method 0 2026-02-12T18:15:20.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfa575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:20.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfa575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:20.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfa575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:20.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfad76640 1 --2- 10.20.193.48:0/296198092 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f0dfc0914d0 0x7f0dfc1b0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:20.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0df9d74640 1 --2- 10.20.193.48:0/296198092 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0dfc08e210 0x7f0dfc1db730 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:15:20.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfad76640 10 monclient(hunting): get_auth_request con 0x7f0dfc0914d0 auth_method 0 2026-02-12T18:15:20.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:20.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfad76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:20.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:20.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfa575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:20.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfa575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:20.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfa575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:20.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:20.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:20.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:20.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfa575640 10 monclient(hunting): handle_auth_done global_id 65218 payload 824 2026-02-12T18:15:20.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfa575640 1 -- 10.20.193.48:0/296198092 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0dfc08e210 msgr2=0x7f0dfc1db730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:15:20.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfa575640 1 --2- 10.20.193.48:0/296198092 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0dfc08e210 0x7f0dfc1db730 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfa575640 1 -- 10.20.193.48:0/296198092 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f0dfc0914d0 msgr2=0x7f0dfc1b0f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:20.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfa575640 1 --2- 10.20.193.48:0/296198092 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f0dfc0914d0 0x7f0dfc1b0f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:20.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfa575640 10 monclient: _finish_hunting 0 2026-02-12T18:15:20.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfa575640 1 monclient: found mon.noname-c 2026-02-12T18:15:20.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfa575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:15:20.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfa575640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:15:20.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.988+0000 7f0dfa575640 1 -- 10.20.193.48:0/296198092 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0de4009420 con 0x7f0dfc05e4b0 2026-02-12T18:15:20.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.990+0000 7f0dfa575640 1 -- 10.20.193.48:0/296198092 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f0dfc05e4b0 msgr2=0x7f0dfc19b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:20.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.990+0000 7f0dfa575640 1 --2- 10.20.193.48:0/296198092 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f0dfc05e4b0 0x7f0dfc19b110 secure :-1 s=READY pgs=239 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0df000c480 tx=0x7f0df000c950 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:20.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.990+0000 7f0de2ffd640 1 -- 10.20.193.48:0/296198092 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f0df0006d50 con 0x7f0dfc05e4b0 2026-02-12T18:15:20.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.990+0000 7f0de2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:20.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.990+0000 7f0de2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:15:20.998 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.990+0000 7f0de2ffd640 10 monclient: dump: 2026-02-12T18:15:20.998 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:20.998 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:20.998 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.998 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:20.999 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:20.999 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:20.999 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:20.999 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:20.999 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:20.999 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:20.999 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:20.999 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:20.999 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:20.999 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:20.999 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:20.999 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:20.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.990+0000 7f0de2ffd640 10 monclient: _finish_auth 0 2026-02-12T18:15:20.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.990+0000 7f0de2ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:15:20.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.990+0000 7f0de2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:15:20.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.990+0000 7f0de2ffd640 1 -- 10.20.193.48:0/296198092 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0df0007030 con 0x7f0dfc05e4b0 2026-02-12T18:15:20.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.990+0000 7f0de2ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:15:20.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.990+0000 7f0de2ffd640 1 -- 10.20.193.48:0/296198092 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f0df0007660 con 0x7f0dfc05e4b0 2026-02-12T18:15:20.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.990+0000 7f0e00c5b640 5 monclient: authenticate success, global_id 65218 2026-02-12T18:15:20.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.990+0000 7f0e00c5b640 10 monclient: _renew_subs 2026-02-12T18:15:20.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.990+0000 7f0df8d72640 4 set_mon_vals no callback set 2026-02-12T18:15:20.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.990+0000 7f0e00c5b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:15:20.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.990+0000 7f0e00c5b640 1 -- 10.20.193.48:0/296198092 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dfc08d140 con 0x7f0dfc05e4b0 2026-02-12T18:15:20.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.990+0000 7f0de2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:20.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.990+0000 7f0de2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:15:20.999 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.990+0000 7f0de2ffd640 10 monclient: dump: 2026-02-12T18:15:21.000 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:21.000 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:21.000 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.000 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.000 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:21.000 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:21.000 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:21.000 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:21.000 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:21.000 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:21.000 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:21.000 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:21.000 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:21.000 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:21.000 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:21.000 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:21.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.990+0000 7f0e00c5b640 10 monclient: _renew_subs 2026-02-12T18:15:21.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.990+0000 7f0e00c5b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:15:21.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.990+0000 7f0e00c5b640 1 -- 10.20.193.48:0/296198092 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dfc19a5b0 con 0x7f0dfc05e4b0 2026-02-12T18:15:21.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.991+0000 7f0e00c5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:15:21.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.991+0000 7f0e00c5b640 1 --2- 10.20.193.48:0/296198092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f0dfc1b14b0 0x7f0dfc1d7ce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:21.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.991+0000 7f0e00c5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:21.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.991+0000 7f0e00c5b640 1 -- 10.20.193.48:0/296198092 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f0dfc05f140 con 0x7f0dfc1b14b0 2026-02-12T18:15:21.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.991+0000 7f0df9d74640 1 --2- 10.20.193.48:0/296198092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f0dfc1b14b0 0x7f0dfc1d7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:21.000 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.991+0000 7f0df9d74640 10 monclient: get_auth_request con 0x7f0dfc1b14b0 auth_method 0 2026-02-12T18:15:21.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.991+0000 7f0df9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:21.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.991+0000 7f0df9d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:21.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.991+0000 7f0df9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:21.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.991+0000 7f0df9d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:21.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.991+0000 7f0df9d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:21.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.991+0000 7f0df9d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:21.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.991+0000 7f0de2ffd640 1 -- 10.20.193.48:0/296198092 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f0df00071a0 con 0x7f0dfc05e4b0 2026-02-12T18:15:21.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.991+0000 7f0df9d74640 10 monclient(hunting): handle_auth_done global_id 94886 payload 824 2026-02-12T18:15:21.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.991+0000 7f0df9d74640 1 -- 10.20.193.48:0/296198092 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0dfc092cb0 con 0x7f0dfc1b14b0 2026-02-12T18:15:21.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.991+0000 7f0de2ffd640 1 --2- 10.20.193.48:0/296198092 >> v2:10.20.193.111:6812/977811348 conn(0x7f0dc803f7c0 0x7f0dc805fc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:21.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.991+0000 7f0de2ffd640 1 -- 10.20.193.48:0/296198092 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(322..322 src has 215..322) ==== 3503+0+0 (secure 0 0 0) 0x7f0df0051e50 con 0x7f0dfc05e4b0 2026-02-12T18:15:21.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.991+0000 7f0dfad76640 1 --2- 10.20.193.48:0/296198092 >> v2:10.20.193.111:6812/977811348 conn(0x7f0dc803f7c0 0x7f0dc805fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:21.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.991+0000 7f0dfad76640 10 monclient: get_auth_request con 0x7f0dc803f7c0 auth_method 0 2026-02-12T18:15:21.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.993+0000 7f0df9d74640 1 -- 10.20.193.48:0/296198092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f0dfc1b14b0 msgr2=0x7f0dfc1d7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:21.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.993+0000 7f0df9d74640 1 --2- 10.20.193.48:0/296198092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f0dfc1b14b0 0x7f0dfc1d7ce0 secure :-1 s=READY pgs=156 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0de4004740 tx=0x7f0de4004770 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:21.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.993+0000 7f0de2ffd640 1 -- 10.20.193.48:0/296198092 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f0de4004500 con 0x7f0dfc1b14b0 2026-02-12T18:15:21.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.993+0000 7f0de2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:21.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.993+0000 7f0de2ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:15:21.001 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.993+0000 7f0de2ffd640 10 monclient: dump: 2026-02-12T18:15:21.001 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:21.001 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:21.001 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.001 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.001 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:21.002 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:21.002 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:21.002 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:21.002 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:21.002 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:21.002 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:21.002 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:21.002 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:21.002 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:21.002 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:21.002 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:21.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.994+0000 7f0de2ffd640 1 -- 10.20.193.48:0/296198092 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f0de4004040 con 0x7f0dfc1b14b0 2026-02-12T18:15:21.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.994+0000 7f0de2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:15:21.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.994+0000 7f0de2ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:15:21.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.994+0000 7f0de2ffd640 1 -- 10.20.193.48:0/296198092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f0dfc1b14b0 msgr2=0x7f0dfc1d7ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:21.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.994+0000 7f0de2ffd640 1 --2- 10.20.193.48:0/296198092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f0dfc1b14b0 0x7f0dfc1d7ce0 secure :-1 s=READY pgs=156 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0de4004740 tx=0x7f0de4004770 comp rx=0 tx=0).stop 2026-02-12T18:15:21.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.994+0000 7f0de2ffd640 1 -- 10.20.193.48:0/296198092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f0dfc1b14b0 msgr2=0x7f0dfc1d7ce0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:15:21.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.994+0000 7f0de2ffd640 1 --2- 10.20.193.48:0/296198092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f0dfc1b14b0 0x7f0dfc1d7ce0 secure :-1 s=CLOSED pgs=156 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0de4004740 tx=0x7f0de4004770 comp rx=0 tx=0).stop 2026-02-12T18:15:21.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.994+0000 7f0dfad76640 1 --2- 10.20.193.48:0/296198092 >> v2:10.20.193.111:6812/977811348 conn(0x7f0dc803f7c0 0x7f0dc805fc70 secure :-1 s=READY pgs=465 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0dfc19c280 tx=0x7f0dec005bb0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:21.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.997+0000 7f0e00c5b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:15:21.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.997+0000 7f0e00c5b640 1 --2- 10.20.193.48:0/296198092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f0dfc1d8220 0x7f0dfc1d8620 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:21.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.997+0000 7f0e00c5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:21.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.997+0000 7f0e00c5b640 1 -- 10.20.193.48:0/296198092 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f0dfc05fd90 con 0x7f0dfc1d8220 2026-02-12T18:15:21.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.997+0000 7f0df9d74640 1 --2- 10.20.193.48:0/296198092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f0dfc1d8220 0x7f0dfc1d8620 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:21.002 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.997+0000 7f0df9d74640 10 monclient: get_auth_request con 0x7f0dfc1d8220 auth_method 0 2026-02-12T18:15:21.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.997+0000 7f0df9d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:21.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.997+0000 7f0df9d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:21.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.997+0000 7f0df9d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:21.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.997+0000 7f0df9d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:21.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.997+0000 7f0df9d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:21.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.997+0000 7f0df9d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:21.003 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.997+0000 7f0df9d74640 10 monclient(hunting): handle_auth_done global_id 94895 payload 824 2026-02-12T18:15:21.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.997+0000 7f0df9d74640 1 -- 10.20.193.48:0/296198092 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0dfc0929d0 con 0x7f0dfc1d8220 2026-02-12T18:15:21.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.999+0000 7f0df9d74640 1 -- 10.20.193.48:0/296198092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f0dfc1d8220 msgr2=0x7f0dfc1d8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:21.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.999+0000 7f0df9d74640 1 --2- 10.20.193.48:0/296198092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f0dfc1d8220 0x7f0dfc1d8620 secure :-1 s=READY pgs=157 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0de40090b0 tx=0x7f0de4009210 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:21.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.999+0000 7f0de2ffd640 1 -- 10.20.193.48:0/296198092 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f0de404d070 con 0x7f0dfc1d8220 2026-02-12T18:15:21.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.999+0000 7f0de2ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:21.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.999+0000 7f0de2ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:15:21.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:20.999+0000 7f0de2ffd640 10 monclient: dump: 2026-02-12T18:15:21.004 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:21.004 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:21.004 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.004 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.004 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:21.004 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:21.004 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:21.004 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:21.004 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:21.004 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:21.004 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:21.004 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:21.004 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:21.004 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:21.004 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:21.004 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:21.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.000+0000 7f0de2ffd640 1 -- 10.20.193.48:0/296198092 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10149 (secure 0 0 0) 0x7f0de4040410 con 0x7f0dfc1d8220 2026-02-12T18:15:21.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.000+0000 7f0de2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:15:21.004 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.000+0000 7f0de2ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:15:21.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.000+0000 7f0de2ffd640 1 -- 10.20.193.48:0/296198092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f0dfc1d8220 msgr2=0x7f0dfc1d8620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:21.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.000+0000 7f0de2ffd640 1 --2- 10.20.193.48:0/296198092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f0dfc1d8220 0x7f0dfc1d8620 secure :-1 s=READY pgs=157 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0de40090b0 tx=0x7f0de4009210 comp rx=0 tx=0).stop 2026-02-12T18:15:21.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.000+0000 7f0de2ffd640 1 -- 10.20.193.48:0/296198092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f0dfc1d8220 msgr2=0x7f0dfc1d8620 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:15:21.005 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.000+0000 7f0de2ffd640 1 --2- 10.20.193.48:0/296198092 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f0dfc1d8220 0x7f0dfc1d8620 secure :-1 s=CLOSED pgs=157 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0de40090b0 tx=0x7f0de4009210 comp rx=0 tx=0).stop 2026-02-12T18:15:21.005 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:15:21.005 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:15:21.005 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:15:21.005 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:15:21.005 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 86, 2026-02-12T18:15:21.005 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 166674, 2026-02-12T18:15:21.005 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:15:21.005 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:15:21.005 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:15:21.005 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:15:21.005 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:15:21.005 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:15:21.005 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:15:21.005 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:21.005 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 1, 2026-02-12T18:15:21.006 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:15:21.006 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:15:21.006 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:15:21.006 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:15:21.006 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:15:21.006 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:15:21.006 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:15:21.006 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:15:21.006 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:15:21.006 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:15:21.006 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:15:21.006 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:15:21.006 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:15:21.006 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:15:21.006 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:15:21.006 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:15:21.006 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:21.006 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:15:21.006 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:15:21.006 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:15:21.006 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:15:21.006 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:15:21.006 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:15:21.006 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:15:21.006 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:15:21.007 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:15:21.007 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:15:21.007 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:15:21.007 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:15:21.007 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:15:21.007 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:15:21.007 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:15:21.007 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.007 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.007 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:15:21.007 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:15:21.007 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:15:21.007 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:15:21.007 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:15:21.007 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:15:21.007 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:15:21.007 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:15:21.007 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:15:21.007 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:15:21.007 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:15:21.007 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:15:21.007 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:15:21.007 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:15:21.007 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:15:21.007 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:15:21.007 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:15:21.008 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:15:21.008 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:15:21.008 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:15:21.008 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:15:21.008 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:15:21.008 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:15:21.008 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:15:21.008 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:15:21.008 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:15:21.008 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:15:21.008 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:15:21.008 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:15:21.008 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:15:21.008 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:21.008 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:15:21.008 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.008 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:15:21.008 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.008 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:15:21.008 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:15:21.008 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.008 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.008 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.008 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.009 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:15:21.009 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.009 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.009 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.009 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.009 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:15:21.009 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.009 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.009 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.009 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.009 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:15:21.009 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:15:21.009 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.009 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.009 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:15:21.009 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.009 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.009 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.009 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:15:21.009 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:15:21.009 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.009 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.009 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.009 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.009 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:15:21.010 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.010 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.010 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.010 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.010 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:15:21.010 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.010 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.010 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.010 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.010 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:15:21.010 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:15:21.010 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.010 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.010 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:15:21.010 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.010 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.010 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.010 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:15:21.010 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:15:21.010 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.010 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.010 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.010 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.010 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:15:21.010 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.010 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.011 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:15:21.012 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.012 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.012 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.012 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.012 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:15:21.012 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:15:21.012 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.012 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.012 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:15:21.012 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.012 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.012 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.012 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:15:21.012 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:15:21.012 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.012 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.012 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.012 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.012 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:15:21.012 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.012 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.012 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.012 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.012 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:15:21.012 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.012 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.013 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:15:21.014 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:15:21.014 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.014 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.014 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:15:21.014 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.014 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.014 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.014 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:15:21.014 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:15:21.014 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.014 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.014 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.014 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.014 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:15:21.014 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.014 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.014 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.014 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.014 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:15:21.014 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.014 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.014 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.014 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:15:21.015 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:15:21.016 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:15:21.017 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:15:21.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.000+0000 7f0e00c5b640 1 -- 10.20.193.48:0/296198092 >> v2:10.20.193.111:6812/977811348 conn(0x7f0dc803f7c0 msgr2=0x7f0dc805fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:21.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.000+0000 7f0e00c5b640 1 --2- 10.20.193.48:0/296198092 >> v2:10.20.193.111:6812/977811348 conn(0x7f0dc803f7c0 0x7f0dc805fc70 secure :-1 s=READY pgs=465 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0dfc19c280 tx=0x7f0dec005bb0 comp rx=0 tx=0).stop 2026-02-12T18:15:21.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.000+0000 7f0e00c5b640 10 monclient: shutdown 2026-02-12T18:15:21.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.000+0000 7f0e00c5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:15:21.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.000+0000 7f0dfad76640 1 -- 10.20.193.48:0/296198092 reap_dead start 2026-02-12T18:15:21.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.000+0000 7f0e00c5b640 1 -- 10.20.193.48:0/296198092 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f0dfc05e4b0 msgr2=0x7f0dfc19b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:21.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.000+0000 7f0e00c5b640 1 --2- 10.20.193.48:0/296198092 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f0dfc05e4b0 0x7f0dfc19b110 secure :-1 s=READY pgs=239 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0df000c480 tx=0x7f0df000c950 comp rx=0 tx=0).stop 2026-02-12T18:15:21.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.000+0000 7f0e00c5b640 1 -- 10.20.193.48:0/296198092 shutdown_connections 2026-02-12T18:15:21.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.000+0000 7f0e00c5b640 1 --2- 10.20.193.48:0/296198092 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f0dfc05e4b0 0x7f0dfc19b110 unknown :-1 s=CLOSED pgs=239 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:21.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.000+0000 7f0e00c5b640 1 -- 10.20.193.48:0/296198092 >> 10.20.193.48:0/296198092 conn(0x7f0dfc0548a0 msgr2=0x7f0dfc08a820 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:15:21.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.000+0000 7f0e00c5b640 1 -- 10.20.193.48:0/296198092 shutdown_connections 2026-02-12T18:15:21.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.000+0000 7f0e00c5b640 1 -- 10.20.193.48:0/296198092 wait complete. 2026-02-12T18:15:21.019 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2026-02-12T18:15:21.019 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon f 2026-02-12T18:15:21.019 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2026-02-12T18:15:21.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.083+0000 7f7958b4c640 10 monclient: get_monmap_and_config 2026-02-12T18:15:21.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.083+0000 7f7958b4c640 10 monclient: build_initial_monmap 2026-02-12T18:15:21.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.083+0000 7f7958b4c640 10 monclient: monmap: 2026-02-12T18:15:21.085 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:15:21.085 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:21.085 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:15:21.084756+0000 2026-02-12T18:15:21.085 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:15:21.084756+0000 2026-02-12T18:15:21.085 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:15:21.085 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:21.086 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:15:21.086 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:15:21.086 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:15:21.086 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:15:21.086 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:15:21.086 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:15:21.086 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:15:21.086 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:15:21.086 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:15:21.086 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:15:21.086 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:15:21.086 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:21.086 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7958b4c640 1 Processor -- start 2026-02-12T18:15:21.086 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7958b4c640 1 -- start start 2026-02-12T18:15:21.086 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7958b4c640 10 monclient: init 2026-02-12T18:15:21.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7958b4c640 10 monclient: _reopen_session rank -1 2026-02-12T18:15:21.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7958b4c640 10 monclient: _add_conns ranks=[9,7,2,8,10,1,4,0,3,6,5] 2026-02-12T18:15:21.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7958b4c640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f795405d550 0x7f795405d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:21.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7958b4c640 10 monclient(hunting): picked mon.noname-a con 0x7f795405d550 addr v2:10.20.193.48:3300/0 2026-02-12T18:15:21.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7958b4c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f795405de60 0x7f7954141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:21.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7958b4c640 10 monclient(hunting): picked mon.noname-i con 0x7f795405de60 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:15:21.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7958b4c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f795413ef60 0x7f79541424e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:21.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7958b4c640 10 monclient(hunting): picked mon.noname-b con 0x7f795413ef60 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:15:21.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7958b4c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:21.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7958b4c640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f795408d390 con 0x7f795405d550 2026-02-12T18:15:21.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7958b4c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:21.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7958b4c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f795408d5a0 con 0x7f795413ef60 2026-02-12T18:15:21.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7958b4c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:21.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7958b4c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f79540580e0 con 0x7f795405de60 2026-02-12T18:15:21.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7958b4c640 10 monclient(hunting): _renew_subs 2026-02-12T18:15:21.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7958b4c640 10 monclient(hunting): authenticate will time out at 1159.810458s 2026-02-12T18:15:21.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7951d74640 1 -- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f795405de60 msgr2=0x7f7954141fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3303/0 2026-02-12T18:15:21.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7951d74640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f795405de60 0x7f7954141fa0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:15:21.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952575640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f795405d550 0x7f795405d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:21.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952d76640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f795413ef60 0x7f79541424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:21.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952d76640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f795413ef60 0x7f79541424e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:54556/0 (socket says 10.20.193.48:54556) 2026-02-12T18:15:21.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952d76640 1 -- 10.20.193.48:0/1767661550 learned_addr learned my addr 10.20.193.48:0/1767661550 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:15:21.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952575640 10 monclient(hunting): get_auth_request con 0x7f795405d550 auth_method 0 2026-02-12T18:15:21.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:21.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:21.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:21.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952d76640 10 monclient(hunting): get_auth_request con 0x7f795413ef60 auth_method 0 2026-02-12T18:15:21.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952d76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:21.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952d76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:21.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952d76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:21.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952d76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:21.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952d76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:21.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952d76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:21.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:21.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:21.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:21.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952d76640 10 monclient(hunting): handle_auth_done global_id 36605 payload 274 2026-02-12T18:15:21.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952d76640 1 -- 10.20.193.48:0/1767661550 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f795405de60 msgr2=0x7f7954141fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:15:21.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952d76640 1 --2- 10.20.193.48:0/1767661550 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f795405de60 0x7f7954141fa0 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:21.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952d76640 1 -- 10.20.193.48:0/1767661550 >> v2:10.20.193.48:3300/0 conn(0x7f795405d550 msgr2=0x7f795405d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:15:21.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952d76640 1 --2- 10.20.193.48:0/1767661550 >> v2:10.20.193.48:3300/0 conn(0x7f795405d550 0x7f795405d920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:21.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952d76640 10 monclient: _finish_hunting 0 2026-02-12T18:15:21.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952d76640 1 monclient: found mon.noname-b 2026-02-12T18:15:21.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952d76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:15:21.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952d76640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:15:21.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.084+0000 7f7952d76640 1 -- 10.20.193.48:0/1767661550 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f795404dc20 con 0x7f795413ef60 2026-02-12T18:15:21.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7952d76640 1 -- 10.20.193.48:0/1767661550 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f795413ef60 msgr2=0x7f79541424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:21.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7952d76640 1 --2- 10.20.193.48:0/1767661550 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f795413ef60 0x7f79541424e0 secure :-1 s=READY pgs=420 gs=2 cs=0 l=1 c_cookie=7603378924217122357 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f794400a140 tx=0x7f794402fef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6984a0d8dea73e35 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:21.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7951573640 1 -- 10.20.193.48:0/1767661550 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f7944030b70 con 0x7f795413ef60 2026-02-12T18:15:21.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7951573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:21.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7951573640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:15:21.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7951573640 10 monclient: dump: 2026-02-12T18:15:21.092 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:21.092 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:21.092 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.092 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.092 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:21.092 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:21.092 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:21.092 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:21.093 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:21.093 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:21.093 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:21.093 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:21.093 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:21.093 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:21.093 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:21.093 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:21.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7951573640 10 monclient: _finish_auth 0 2026-02-12T18:15:21.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7951573640 10 monclient: _check_auth_tickets 2026-02-12T18:15:21.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7951573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:15:21.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7951573640 1 -- 10.20.193.48:0/1767661550 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7944030cf0 con 0x7f795413ef60 2026-02-12T18:15:21.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7958b4c640 5 monclient: authenticate success, global_id 36605 2026-02-12T18:15:21.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7958b4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:15:21.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7951573640 10 monclient: handle_config config(0 keys) 2026-02-12T18:15:21.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7951573640 1 -- 10.20.193.48:0/1767661550 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f7944030e60 con 0x7f795413ef60 2026-02-12T18:15:21.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7958b4c640 10 monclient: get_monmap_and_config success 2026-02-12T18:15:21.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7958b4c640 4 set_mon_vals no callback set 2026-02-12T18:15:21.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7951573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:21.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7951573640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:15:21.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7951573640 10 monclient: dump: 2026-02-12T18:15:21.093 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:21.093 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:21.094 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.094 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.094 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:21.094 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:21.094 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:21.094 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:21.094 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:21.094 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:21.094 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:21.094 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:21.094 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:21.094 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:21.094 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:21.094 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:21.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7958b4c640 10 monclient: shutdown 2026-02-12T18:15:21.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7958b4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:15:21.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7958b4c640 1 -- 10.20.193.48:0/1767661550 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f795413ef60 msgr2=0x7f79541424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:21.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7958b4c640 1 --2- 10.20.193.48:0/1767661550 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f795413ef60 0x7f79541424e0 secure :-1 s=READY pgs=420 gs=2 cs=0 l=1 c_cookie=7603378924217122357 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f794400a140 tx=0x7f794402fef0 comp rx=0 tx=0).stop 2026-02-12T18:15:21.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7958b4c640 1 -- 10.20.193.48:0/1767661550 shutdown_connections 2026-02-12T18:15:21.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7958b4c640 1 --2- 10.20.193.48:0/1767661550 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f795413ef60 0x7f79541424e0 unknown :-1 s=CLOSED pgs=420 gs=2 cs=0 l=1 c_cookie=7603378924217122357 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:21.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7958b4c640 1 --2- 10.20.193.48:0/1767661550 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f795405de60 0x7f7954141fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:21.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7958b4c640 1 --2- 10.20.193.48:0/1767661550 >> v2:10.20.193.48:3300/0 conn(0x7f795405d550 0x7f795405d920 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:21.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7958b4c640 1 -- 10.20.193.48:0/1767661550 >> 10.20.193.48:0/1767661550 conn(0x7f79540546a0 msgr2=0x7f7954054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:15:21.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7958b4c640 1 -- 10.20.193.48:0/1767661550 shutdown_connections 2026-02-12T18:15:21.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.087+0000 7f7958b4c640 1 -- 10.20.193.48:0/1767661550 wait complete. 2026-02-12T18:15:21.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.088+0000 7f7958b4c640 10 monclient: build_initial_monmap 2026-02-12T18:15:21.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.088+0000 7f7958b4c640 10 monclient: monmap: 2026-02-12T18:15:21.095 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:15:21.095 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:15:21.095 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:15:21.095 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:15:21.095 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:15:21.095 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:21.095 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:15:21.095 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:15:21.095 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:15:21.095 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:15:21.095 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:15:21.095 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:15:21.095 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:15:21.095 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:15:21.095 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:15:21.095 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:21.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.088+0000 7f7958b4c640 1 Processor -- start 2026-02-12T18:15:21.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.088+0000 7f7958b4c640 1 -- start start 2026-02-12T18:15:21.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.088+0000 7f7958b4c640 10 monclient: init 2026-02-12T18:15:21.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.088+0000 7f7958b4c640 10 monclient: _reopen_session rank -1 2026-02-12T18:15:21.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.088+0000 7f7958b4c640 10 monclient: _add_conns ranks=[8,7,5,0,6,2,1,4,3] 2026-02-12T18:15:21.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.088+0000 7f7958b4c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f795405d550 0x7f7954112940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:21.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.088+0000 7f7958b4c640 10 monclient(hunting): picked mon.noname-e con 0x7f795405d550 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:15:21.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.088+0000 7f7958b4c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f795405de60 0x7f7954112e80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:21.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.088+0000 7f7958b4c640 10 monclient(hunting): picked mon.noname-i con 0x7f795405de60 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:15:21.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.088+0000 7f7958b4c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f795413ef60 0x7f7954109760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:21.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.088+0000 7f7958b4c640 10 monclient(hunting): picked mon.noname-h con 0x7f795413ef60 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:15:21.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.088+0000 7f7958b4c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:21.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.088+0000 7f7958b4c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f795413db60 con 0x7f795413ef60 2026-02-12T18:15:21.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.088+0000 7f7958b4c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:21.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.088+0000 7f7958b4c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f795410cfa0 con 0x7f795405de60 2026-02-12T18:15:21.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.088+0000 7f7958b4c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:21.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.088+0000 7f7958b4c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f795411ff50 con 0x7f795405d550 2026-02-12T18:15:21.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.088+0000 7f7958b4c640 10 monclient(hunting): _renew_subs 2026-02-12T18:15:21.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.088+0000 7f7958b4c640 10 monclient(hunting): authenticate will time out at 1159.814982s 2026-02-12T18:15:21.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.089+0000 7f7951d74640 1 -- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f795405de60 msgr2=0x7f7954112e80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3303/0 2026-02-12T18:15:21.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.089+0000 7f7951d74640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f795405de60 0x7f7954112e80 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:15:21.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.089+0000 7f7952d76640 1 -- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f795413ef60 msgr2=0x7f7954109760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:15:21.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.089+0000 7f7952d76640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f795413ef60 0x7f7954109760 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:15:21.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.089+0000 7f7952575640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f795405d550 0x7f7954112940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:21.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.089+0000 7f7952575640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f795405d550 0x7f7954112940 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:47154/0 (socket says 10.20.193.48:47154) 2026-02-12T18:15:21.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.089+0000 7f7952575640 1 -- 10.20.193.48:0/1091589975 learned_addr learned my addr 10.20.193.48:0/1091589975 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:15:21.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.089+0000 7f7952575640 10 monclient(hunting): get_auth_request con 0x7f795405d550 auth_method 0 2026-02-12T18:15:21.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.089+0000 7f7952575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:21.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.089+0000 7f7952575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:21.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.089+0000 7f7952575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:21.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.089+0000 7f7952575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:21.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.089+0000 7f7952575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:21.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.089+0000 7f7952575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:21.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.089+0000 7f7952575640 10 monclient(hunting): handle_auth_done global_id 94904 payload 824 2026-02-12T18:15:21.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.089+0000 7f7952575640 1 -- 10.20.193.48:0/1091589975 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f795405de60 msgr2=0x7f7954112e80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:15:21.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.089+0000 7f7952575640 1 --2- 10.20.193.48:0/1091589975 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f795405de60 0x7f7954112e80 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:21.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.089+0000 7f7952575640 1 -- 10.20.193.48:0/1091589975 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f795413ef60 msgr2=0x7f7954109760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:15:21.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.089+0000 7f7952575640 1 --2- 10.20.193.48:0/1091589975 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f795413ef60 0x7f7954109760 unknown :-1 s=START_CONNECT pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:21.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.089+0000 7f7952575640 10 monclient: _finish_hunting 0 2026-02-12T18:15:21.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.089+0000 7f7952575640 1 monclient: found mon.noname-e 2026-02-12T18:15:21.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.089+0000 7f7952575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:15:21.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.089+0000 7f7952575640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:15:21.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.089+0000 7f7952575640 1 -- 10.20.193.48:0/1091589975 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f794400a5d0 con 0x7f795405d550 2026-02-12T18:15:21.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.091+0000 7f7952575640 1 -- 10.20.193.48:0/1091589975 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f795405d550 msgr2=0x7f7954112940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:21.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.091+0000 7f7952575640 1 --2- 10.20.193.48:0/1091589975 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f795405d550 0x7f7954112940 secure :-1 s=READY pgs=158 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7948006b40 tx=0x7f794800ece0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:21.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.091+0000 7f793affd640 1 -- 10.20.193.48:0/1091589975 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f7948013470 con 0x7f795405d550 2026-02-12T18:15:21.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.091+0000 7f793affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:21.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.091+0000 7f793affd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:15:21.099 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.091+0000 7f793affd640 10 monclient: dump: 2026-02-12T18:15:21.099 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:21.099 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:21.099 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.099 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.099 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:21.099 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:21.100 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:21.100 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:21.100 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:21.100 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:21.100 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:21.100 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:21.100 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:21.100 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:21.100 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:21.100 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:21.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.091+0000 7f793affd640 10 monclient: _finish_auth 0 2026-02-12T18:15:21.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.091+0000 7f793affd640 10 monclient: _check_auth_tickets 2026-02-12T18:15:21.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.091+0000 7f793affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:15:21.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.091+0000 7f793affd640 1 -- 10.20.193.48:0/1091589975 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79480135d0 con 0x7f795405d550 2026-02-12T18:15:21.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.091+0000 7f7958b4c640 5 monclient: authenticate success, global_id 94904 2026-02-12T18:15:21.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.091+0000 7f7958b4c640 10 monclient: _renew_subs 2026-02-12T18:15:21.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.091+0000 7f7958b4c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:15:21.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.091+0000 7f7958b4c640 1 -- 10.20.193.48:0/1091589975 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f795410c700 con 0x7f795405d550 2026-02-12T18:15:21.100 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.091+0000 7f793affd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:15:21.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.091+0000 7f793affd640 1 -- 10.20.193.48:0/1091589975 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f7948013c00 con 0x7f795405d550 2026-02-12T18:15:21.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.091+0000 7f793affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:21.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.091+0000 7f793affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:15:21.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.091+0000 7f7950d72640 4 set_mon_vals no callback set 2026-02-12T18:15:21.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.091+0000 7f793affd640 10 monclient: dump: 2026-02-12T18:15:21.101 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:21.101 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:21.101 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.101 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.101 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:21.101 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:21.101 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:21.101 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:21.101 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:21.101 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:21.101 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:21.101 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:21.101 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:21.101 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:21.101 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:21.101 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:21.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.091+0000 7f7958b4c640 10 monclient: _renew_subs 2026-02-12T18:15:21.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.091+0000 7f7958b4c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:15:21.101 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.091+0000 7f7958b4c640 1 -- 10.20.193.48:0/1091589975 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f795410c3d0 con 0x7f795405d550 2026-02-12T18:15:21.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.092+0000 7f7958b4c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:15:21.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.092+0000 7f7958b4c640 1 --2- 10.20.193.48:0/1091589975 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f7954091010 0x7f7954109ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:21.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.092+0000 7f7958b4c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:21.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.092+0000 7f7958b4c640 1 -- 10.20.193.48:0/1091589975 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f795410cbe0 con 0x7f7954091010 2026-02-12T18:15:21.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.092+0000 7f793affd640 1 -- 10.20.193.48:0/1091589975 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f7948011070 con 0x7f795405d550 2026-02-12T18:15:21.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.092+0000 7f7951d74640 1 --2- 10.20.193.48:0/1091589975 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f7954091010 0x7f7954109ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:21.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.092+0000 7f7951d74640 10 monclient: get_auth_request con 0x7f7954091010 auth_method 0 2026-02-12T18:15:21.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.092+0000 7f7951d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:21.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.092+0000 7f7951d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:21.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.092+0000 7f7951d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:21.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.092+0000 7f7951d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:21.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.092+0000 7f7951d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:21.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.092+0000 7f7951d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:21.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.092+0000 7f793affd640 1 --2- 10.20.193.48:0/1091589975 >> v2:10.20.193.111:6812/977811348 conn(0x7f792003f780 0x7f792005fc30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:21.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.092+0000 7f793affd640 1 -- 10.20.193.48:0/1091589975 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(322..322 src has 215..322) ==== 3503+0+0 (secure 0 0 0) 0x7f7948052bb0 con 0x7f795405d550 2026-02-12T18:15:21.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.092+0000 7f7951d74640 10 monclient(hunting): handle_auth_done global_id 94987 payload 824 2026-02-12T18:15:21.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.092+0000 7f7951d74640 1 -- 10.20.193.48:0/1091589975 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f795410d110 con 0x7f7954091010 2026-02-12T18:15:21.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.092+0000 7f7952d76640 1 --2- 10.20.193.48:0/1091589975 >> v2:10.20.193.111:6812/977811348 conn(0x7f792003f780 0x7f792005fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:21.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.092+0000 7f7952d76640 10 monclient: get_auth_request con 0x7f792003f780 auth_method 0 2026-02-12T18:15:21.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.095+0000 7f7951d74640 1 -- 10.20.193.48:0/1091589975 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f7954091010 msgr2=0x7f7954109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:21.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.095+0000 7f7951d74640 1 --2- 10.20.193.48:0/1091589975 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f7954091010 0x7f7954109ca0 secure :-1 s=READY pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f795410b2b0 tx=0x7f793c00b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:21.102 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.095+0000 7f7952d76640 1 --2- 10.20.193.48:0/1091589975 >> v2:10.20.193.111:6812/977811348 conn(0x7f792003f780 0x7f792005fc30 secure :-1 s=READY pgs=466 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f794402ff30 tx=0x7f7944007f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:21.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.095+0000 7f793affd640 1 -- 10.20.193.48:0/1091589975 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f793c003e10 con 0x7f7954091010 2026-02-12T18:15:21.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.095+0000 7f793affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:21.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.095+0000 7f793affd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:15:21.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.095+0000 7f793affd640 10 monclient: dump: 2026-02-12T18:15:21.103 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:21.103 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:21.103 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.103 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.103 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:21.103 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:21.103 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:21.103 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:21.103 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:21.103 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:21.103 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:21.103 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:21.103 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:21.103 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:21.103 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:21.103 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:21.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.095+0000 7f793affd640 1 -- 10.20.193.48:0/1091589975 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f793c005280 con 0x7f7954091010 2026-02-12T18:15:21.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.095+0000 7f793affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:15:21.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.095+0000 7f793affd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:15:21.103 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.095+0000 7f793affd640 1 -- 10.20.193.48:0/1091589975 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f7954091010 msgr2=0x7f7954109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:21.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.095+0000 7f793affd640 1 --2- 10.20.193.48:0/1091589975 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f7954091010 0x7f7954109ca0 secure :-1 s=READY pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f795410b2b0 tx=0x7f793c00b8f0 comp rx=0 tx=0).stop 2026-02-12T18:15:21.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.095+0000 7f793affd640 1 -- 10.20.193.48:0/1091589975 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f7954091010 msgr2=0x7f7954109ca0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:15:21.104 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.095+0000 7f793affd640 1 --2- 10.20.193.48:0/1091589975 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f7954091010 0x7f7954109ca0 secure :-1 s=CLOSED pgs=185 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f795410b2b0 tx=0x7f793c00b8f0 comp rx=0 tx=0).stop 2026-02-12T18:15:21.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.098+0000 7f7958b4c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:15:21.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.098+0000 7f7958b4c640 1 --2- 10.20.193.48:0/1091589975 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f795410a1e0 0x7f795410a5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:21.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.098+0000 7f7958b4c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:21.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.098+0000 7f7958b4c640 1 -- 10.20.193.48:0/1091589975 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f795405f140 con 0x7f795410a1e0 2026-02-12T18:15:21.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.098+0000 7f7951d74640 1 --2- 10.20.193.48:0/1091589975 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f795410a1e0 0x7f795410a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:21.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.098+0000 7f7951d74640 10 monclient: get_auth_request con 0x7f795410a1e0 auth_method 0 2026-02-12T18:15:21.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.098+0000 7f7951d74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:21.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.098+0000 7f7951d74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:21.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.098+0000 7f7951d74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:21.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.098+0000 7f7951d74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:21.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.098+0000 7f7951d74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:21.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.098+0000 7f7951d74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:21.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.099+0000 7f7951d74640 10 monclient(hunting): handle_auth_done global_id 94996 payload 824 2026-02-12T18:15:21.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.099+0000 7f7951d74640 1 -- 10.20.193.48:0/1091589975 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f795408d060 con 0x7f795410a1e0 2026-02-12T18:15:21.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.101+0000 7f7951d74640 1 -- 10.20.193.48:0/1091589975 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f795410a1e0 msgr2=0x7f795410a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:21.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.101+0000 7f7951d74640 1 --2- 10.20.193.48:0/1091589975 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f795410a1e0 0x7f795410a5e0 secure :-1 s=READY pgs=186 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f793c00b930 tx=0x7f793c005a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:21.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.101+0000 7f793affd640 1 -- 10.20.193.48:0/1091589975 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f793c020070 con 0x7f795410a1e0 2026-02-12T18:15:21.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.101+0000 7f793affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:21.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.101+0000 7f793affd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:15:21.105 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.101+0000 7f793affd640 10 monclient: dump: 2026-02-12T18:15:21.105 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:21.106 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:21.106 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.106 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.106 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:21.106 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:21.106 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:21.106 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:21.106 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:21.106 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:21.106 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:21.106 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:21.106 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:21.106 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:21.106 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:21.106 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:21.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.101+0000 7f793affd640 1 -- 10.20.193.48:0/1091589975 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10149 (secure 0 0 0) 0x7f793c011610 con 0x7f795410a1e0 2026-02-12T18:15:21.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.101+0000 7f793affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:15:21.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.101+0000 7f793affd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:15:21.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.101+0000 7f793affd640 1 -- 10.20.193.48:0/1091589975 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f795410a1e0 msgr2=0x7f795410a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:21.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.101+0000 7f793affd640 1 --2- 10.20.193.48:0/1091589975 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f795410a1e0 0x7f795410a5e0 secure :-1 s=READY pgs=186 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f793c00b930 tx=0x7f793c005a80 comp rx=0 tx=0).stop 2026-02-12T18:15:21.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.101+0000 7f793affd640 1 -- 10.20.193.48:0/1091589975 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f795410a1e0 msgr2=0x7f795410a5e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:15:21.106 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.101+0000 7f793affd640 1 --2- 10.20.193.48:0/1091589975 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f795410a1e0 0x7f795410a5e0 secure :-1 s=CLOSED pgs=186 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f793c00b930 tx=0x7f793c005a80 comp rx=0 tx=0).stop 2026-02-12T18:15:21.107 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:15:21.107 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:15:21.107 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:15:21.107 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:15:21.107 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 86, 2026-02-12T18:15:21.107 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 166775, 2026-02-12T18:15:21.107 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:15:21.107 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:15:21.107 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:15:21.107 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:15:21.107 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:15:21.107 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:15:21.107 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:15:21.107 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:21.107 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 1, 2026-02-12T18:15:21.107 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:15:21.107 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:15:21.107 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:15:21.107 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:15:21.107 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:15:21.108 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:15:21.108 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:15:21.108 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:15:21.108 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:15:21.108 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:15:21.108 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:15:21.108 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:15:21.108 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:15:21.108 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:15:21.108 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:15:21.108 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:15:21.108 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:21.108 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:15:21.108 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:15:21.108 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:15:21.108 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:15:21.108 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:15:21.108 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:15:21.108 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:15:21.108 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:15:21.108 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:15:21.108 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:15:21.108 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:15:21.108 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:15:21.109 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:15:21.109 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:15:21.109 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:15:21.109 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.109 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.109 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:15:21.109 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:15:21.109 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:15:21.109 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:15:21.109 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:15:21.109 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:15:21.109 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:15:21.109 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:15:21.109 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:15:21.109 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:15:21.109 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:15:21.109 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:15:21.109 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:15:21.109 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:15:21.109 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:15:21.109 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:15:21.109 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:15:21.109 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:15:21.109 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:15:21.110 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:15:21.110 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:15:21.110 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:15:21.110 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:15:21.110 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:15:21.110 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:15:21.110 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:15:21.110 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:15:21.110 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:15:21.110 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:15:21.110 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:15:21.110 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:21.110 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:15:21.110 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.110 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:15:21.110 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.110 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:15:21.110 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:15:21.110 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.110 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.110 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.110 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.110 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:15:21.110 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.110 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.111 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.111 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.111 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:15:21.111 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.111 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.111 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.111 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.111 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:15:21.111 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:15:21.111 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.111 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.111 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:15:21.111 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.111 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.111 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.111 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:15:21.111 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:15:21.111 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.111 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.111 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.111 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.111 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:15:21.111 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.111 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.111 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.112 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.112 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:15:21.112 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.112 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.112 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.112 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.112 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:15:21.112 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:15:21.112 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.112 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.112 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:15:21.112 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.112 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.112 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.112 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:15:21.112 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:15:21.112 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.112 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.112 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.112 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.112 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:15:21.112 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.112 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.112 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.112 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.113 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:15:21.113 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.113 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.113 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.113 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.113 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:15:21.113 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:15:21.113 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.113 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.113 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:15:21.113 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.113 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.113 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.113 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:15:21.113 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:15:21.113 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.113 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.113 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.113 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.113 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:15:21.113 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.113 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.113 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.113 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.114 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:15:21.114 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.114 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.114 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.114 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.114 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:15:21.114 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:15:21.114 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.114 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.114 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:15:21.114 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.114 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.114 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.114 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:15:21.114 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:15:21.114 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.114 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.114 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.114 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.114 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:15:21.114 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.114 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.114 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.114 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.115 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:15:21.115 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.115 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.115 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.115 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.115 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:15:21.115 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:15:21.115 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.115 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.115 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:15:21.115 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.115 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.115 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.115 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:15:21.115 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:15:21.115 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.115 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.115 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.115 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.115 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:15:21.115 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.115 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.115 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.115 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.116 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:15:21.116 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.116 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.116 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.116 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.116 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:15:21.116 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:15:21.116 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.116 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.116 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:15:21.116 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.116 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.116 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.116 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:15:21.116 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:15:21.116 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.116 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.116 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.116 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.116 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:15:21.116 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.116 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.116 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.116 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.116 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:15:21.116 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.117 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.117 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.117 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.117 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:15:21.117 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:15:21.117 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.117 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.117 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:15:21.117 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.117 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.117 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.117 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:15:21.117 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:15:21.117 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.117 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.117 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.117 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.117 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:15:21.117 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.117 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.117 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.117 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.117 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:15:21.117 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.118 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.119 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:15:21.119 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:15:21.119 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.119 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.119 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:15:21.119 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.119 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.119 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.119 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.119 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:15:21.119 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:15:21.119 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.119 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:15:21.119 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:15:21.119 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:15:21.119 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.119 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:21.119 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:15:21.119 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.119 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:15:21.119 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:15:21.119 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:15:21.119 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.119 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:21.119 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:15:21.120 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.120 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:15:21.120 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:15:21.120 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:15:21.120 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.120 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.120 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.120 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:15:21.120 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:15:21.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.101+0000 7f7958b4c640 1 -- 10.20.193.48:0/1091589975 >> v2:10.20.193.111:6812/977811348 conn(0x7f792003f780 msgr2=0x7f792005fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:21.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.101+0000 7f7958b4c640 1 --2- 10.20.193.48:0/1091589975 >> v2:10.20.193.111:6812/977811348 conn(0x7f792003f780 0x7f792005fc30 secure :-1 s=READY pgs=466 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f794402ff30 tx=0x7f7944007f90 comp rx=0 tx=0).stop 2026-02-12T18:15:21.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.101+0000 7f7958b4c640 10 monclient: shutdown 2026-02-12T18:15:21.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.101+0000 7f7958b4c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:15:21.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.101+0000 7f7958b4c640 1 -- 10.20.193.48:0/1091589975 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f795405d550 msgr2=0x7f7954112940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:21.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.101+0000 7f7958b4c640 1 --2- 10.20.193.48:0/1091589975 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f795405d550 0x7f7954112940 secure :-1 s=READY pgs=158 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7948006b40 tx=0x7f794800ece0 comp rx=0 tx=0).stop 2026-02-12T18:15:21.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.101+0000 7f7952d76640 1 -- 10.20.193.48:0/1091589975 reap_dead start 2026-02-12T18:15:21.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.102+0000 7f7958b4c640 1 -- 10.20.193.48:0/1091589975 shutdown_connections 2026-02-12T18:15:21.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.102+0000 7f7958b4c640 1 --2- 10.20.193.48:0/1091589975 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f795405d550 0x7f7954112940 unknown :-1 s=CLOSED pgs=158 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:21.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.102+0000 7f7958b4c640 1 -- 10.20.193.48:0/1091589975 >> 10.20.193.48:0/1091589975 conn(0x7f79540546a0 msgr2=0x7f795413c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:15:21.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.102+0000 7f7958b4c640 1 -- 10.20.193.48:0/1091589975 shutdown_connections 2026-02-12T18:15:21.121 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.102+0000 7f7958b4c640 1 -- 10.20.193.48:0/1091589975 wait complete. 2026-02-12T18:15:21.121 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2026-02-12T18:15:21.121 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 6 for mon g 2026-02-12T18:15:21.122 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2026-02-12T18:15:21.187 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.186+0000 7fa16e05b640 10 monclient: get_monmap_and_config 2026-02-12T18:15:21.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.186+0000 7fa16e05b640 10 monclient: build_initial_monmap 2026-02-12T18:15:21.188 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.186+0000 7fa16e05b640 10 monclient: monmap: 2026-02-12T18:15:21.188 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:15:21.188 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:21.188 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:15:21.187396+0000 2026-02-12T18:15:21.188 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:15:21.187396+0000 2026-02-12T18:15:21.188 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:15:21.188 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:21.188 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:15:21.189 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:15:21.189 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:15:21.189 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:15:21.189 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:15:21.189 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:15:21.189 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:15:21.189 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:15:21.189 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:15:21.189 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:15:21.189 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:15:21.189 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:21.191 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.186+0000 7fa16e05b640 1 Processor -- start 2026-02-12T18:15:21.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.186+0000 7fa16e05b640 1 -- start start 2026-02-12T18:15:21.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.186+0000 7fa16e05b640 10 monclient: init 2026-02-12T18:15:21.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa16e05b640 10 monclient: _reopen_session rank -1 2026-02-12T18:15:21.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa16e05b640 10 monclient: _add_conns ranks=[5,2,10,1,7,6,4,9,3,0,8] 2026-02-12T18:15:21.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa16e05b640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa16805d550 0x7fa16805d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:21.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa16e05b640 10 monclient(hunting): picked mon.noname-h con 0x7fa16805d550 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:15:21.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa16e05b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa16805de60 0x7fa168141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:21.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa16e05b640 10 monclient(hunting): picked mon.noname-b con 0x7fa16805de60 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:15:21.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa16e05b640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7fa16813ef60 0x7fa1681424e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:21.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa16e05b640 10 monclient(hunting): picked mon.noname-f con 0x7fa16813ef60 addr v2:10.20.193.111:3300/0 2026-02-12T18:15:21.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa16e05b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:21.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa16e05b640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7fa16808d390 con 0x7fa16813ef60 2026-02-12T18:15:21.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa16e05b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:21.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa16e05b640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fa16808d5a0 con 0x7fa16805de60 2026-02-12T18:15:21.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa16e05b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:21.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa16e05b640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fa1680580e0 con 0x7fa16805d550 2026-02-12T18:15:21.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa16e05b640 10 monclient(hunting): _renew_subs 2026-02-12T18:15:21.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa16e05b640 10 monclient(hunting): authenticate will time out at 1159.913158s 2026-02-12T18:15:21.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa1677fe640 1 -- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa16805d550 msgr2=0x7fa16805d920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:10.20.193.111:3302/0 2026-02-12T18:15:21.192 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa1677fe640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa16805d550 0x7fa16805d920 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:15:21.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa166ffd640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa16805de60 0x7fa168141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:21.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa166ffd640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa16805de60 0x7fa168141fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:54564/0 (socket says 10.20.193.48:54564) 2026-02-12T18:15:21.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa166ffd640 1 -- 10.20.193.48:0/1582160865 learned_addr learned my addr 10.20.193.48:0/1582160865 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:15:21.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa166ffd640 10 monclient(hunting): get_auth_request con 0x7fa16805de60 auth_method 0 2026-02-12T18:15:21.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa166ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:21.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa166ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:21.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa166ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:21.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa166ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:21.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa166ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:21.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa166ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:21.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa167fff640 1 --2- 10.20.193.48:0/1582160865 >> v2:10.20.193.111:3300/0 conn(0x7fa16813ef60 0x7fa1681424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:21.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa167fff640 10 monclient(hunting): get_auth_request con 0x7fa16813ef60 auth_method 0 2026-02-12T18:15:21.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa167fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:21.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa167fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:21.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa167fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:21.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa166ffd640 10 monclient(hunting): handle_auth_done global_id 36614 payload 274 2026-02-12T18:15:21.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa166ffd640 1 -- 10.20.193.48:0/1582160865 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa16805d550 msgr2=0x7fa16805d920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:15:21.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa166ffd640 1 --2- 10.20.193.48:0/1582160865 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa16805d550 0x7fa16805d920 unknown :-1 s=START_CONNECT pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:21.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa166ffd640 1 -- 10.20.193.48:0/1582160865 >> v2:10.20.193.111:3300/0 conn(0x7fa16813ef60 msgr2=0x7fa1681424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:15:21.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa166ffd640 1 --2- 10.20.193.48:0/1582160865 >> v2:10.20.193.111:3300/0 conn(0x7fa16813ef60 0x7fa1681424e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:21.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa166ffd640 10 monclient: _finish_hunting 0 2026-02-12T18:15:21.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa166ffd640 1 monclient: found mon.noname-b 2026-02-12T18:15:21.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa166ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:15:21.193 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa166ffd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:15:21.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.187+0000 7fa166ffd640 1 -- 10.20.193.48:0/1582160865 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa16804dc20 con 0x7fa16805de60 2026-02-12T18:15:21.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.189+0000 7fa166ffd640 1 -- 10.20.193.48:0/1582160865 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa16805de60 msgr2=0x7fa168141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:21.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.189+0000 7fa166ffd640 1 --2- 10.20.193.48:0/1582160865 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa16805de60 0x7fa168141fa0 secure :-1 s=READY pgs=421 gs=1 cs=0 l=1 c_cookie=16302381638435424248 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa158009060 tx=0x7fa15802ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e23db1b9f7cb47f8 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:21.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa1667fc640 1 -- 10.20.193.48:0/1582160865 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa158035340 con 0x7fa16805de60 2026-02-12T18:15:21.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa1667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:21.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa1667fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:15:21.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa1667fc640 10 monclient: dump: 2026-02-12T18:15:21.194 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:21.194 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:21.194 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.194 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.194 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:21.194 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:21.194 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:21.194 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:21.194 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:21.194 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:21.194 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:21.194 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:21.194 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:21.194 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:21.194 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:21.194 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:21.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa1667fc640 10 monclient: _finish_auth 0 2026-02-12T18:15:21.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa1667fc640 10 monclient: _check_auth_tickets 2026-02-12T18:15:21.194 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa1667fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:15:21.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa16e05b640 5 monclient: authenticate success, global_id 36614 2026-02-12T18:15:21.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa16e05b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:15:21.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa1667fc640 1 -- 10.20.193.48:0/1582160865 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1580354c0 con 0x7fa16805de60 2026-02-12T18:15:21.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa1667fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:15:21.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa1667fc640 1 -- 10.20.193.48:0/1582160865 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa158035630 con 0x7fa16805de60 2026-02-12T18:15:21.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa1667fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:21.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa1667fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:15:21.195 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa1667fc640 10 monclient: dump: 2026-02-12T18:15:21.195 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:21.195 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:21.195 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.195 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.195 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:21.195 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:21.195 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:21.195 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:21.195 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:21.195 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:21.195 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:21.195 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:21.195 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:21.195 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:21.195 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:21.196 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:21.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa16e05b640 10 monclient: get_monmap_and_config success 2026-02-12T18:15:21.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa16e05b640 4 set_mon_vals no callback set 2026-02-12T18:15:21.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa16e05b640 10 monclient: shutdown 2026-02-12T18:15:21.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa16e05b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:15:21.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa16e05b640 1 -- 10.20.193.48:0/1582160865 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa16805de60 msgr2=0x7fa168141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:21.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa16e05b640 1 --2- 10.20.193.48:0/1582160865 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa16805de60 0x7fa168141fa0 secure :-1 s=READY pgs=421 gs=1 cs=0 l=1 c_cookie=16302381638435424248 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa158009060 tx=0x7fa15802ee10 comp rx=0 tx=0).stop 2026-02-12T18:15:21.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa16e05b640 1 -- 10.20.193.48:0/1582160865 shutdown_connections 2026-02-12T18:15:21.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa16e05b640 1 --2- 10.20.193.48:0/1582160865 >> v2:10.20.193.111:3300/0 conn(0x7fa16813ef60 0x7fa1681424e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:21.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa16e05b640 1 --2- 10.20.193.48:0/1582160865 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa16805de60 0x7fa168141fa0 unknown :-1 s=CLOSED pgs=421 gs=1 cs=0 l=1 c_cookie=16302381638435424248 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:21.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa16e05b640 1 --2- 10.20.193.48:0/1582160865 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa16805d550 0x7fa16805d920 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:21.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa16e05b640 1 -- 10.20.193.48:0/1582160865 >> 10.20.193.48:0/1582160865 conn(0x7fa1680546a0 msgr2=0x7fa168054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:15:21.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa16e05b640 1 -- 10.20.193.48:0/1582160865 shutdown_connections 2026-02-12T18:15:21.196 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa16e05b640 1 -- 10.20.193.48:0/1582160865 wait complete. 2026-02-12T18:15:21.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.190+0000 7fa16e05b640 10 monclient: build_initial_monmap 2026-02-12T18:15:21.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa16e05b640 10 monclient: monmap: 2026-02-12T18:15:21.199 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:15:21.200 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:15:21.200 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:15:21.200 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:15:21.200 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:15:21.200 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:21.200 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:15:21.200 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:15:21.200 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:15:21.200 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:15:21.200 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:15:21.200 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:15:21.200 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:15:21.200 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:15:21.200 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:15:21.200 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:21.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa16e05b640 1 Processor -- start 2026-02-12T18:15:21.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa16e05b640 1 -- start start 2026-02-12T18:15:21.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa16e05b640 10 monclient: init 2026-02-12T18:15:21.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa16e05b640 10 monclient: _reopen_session rank -1 2026-02-12T18:15:21.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa16e05b640 10 monclient: _add_conns ranks=[0,2,8,4,3,7,1,5,6] 2026-02-12T18:15:21.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa16e05b640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa16805d550 0x7fa168131210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:21.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa16e05b640 10 monclient(hunting): picked mon.noname-a con 0x7fa16805d550 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:15:21.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa16e05b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa16805de60 0x7fa16808a680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:21.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa16e05b640 10 monclient(hunting): picked mon.noname-b con 0x7fa16805de60 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:15:21.200 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa16e05b640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa16813ef60 0x7fa16808abc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:21.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa16e05b640 10 monclient(hunting): picked mon.noname-e con 0x7fa16813ef60 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:15:21.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa16e05b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:21.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa16e05b640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fa168120990 con 0x7fa16805d550 2026-02-12T18:15:21.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa16e05b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:21.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa16e05b640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fa16813db40 con 0x7fa16805de60 2026-02-12T18:15:21.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa16e05b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:21.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa16e05b640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fa16810ec10 con 0x7fa16813ef60 2026-02-12T18:15:21.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa16e05b640 10 monclient(hunting): _renew_subs 2026-02-12T18:15:21.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa16e05b640 10 monclient(hunting): authenticate will time out at 1159.917520s 2026-02-12T18:15:21.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa166ffd640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa16805de60 0x7fa16808a680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:21.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa1677fe640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa16805d550 0x7fa168131210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:21.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa166ffd640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa16805de60 0x7fa16808a680 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:54568/0 (socket says 10.20.193.48:54568) 2026-02-12T18:15:21.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa166ffd640 1 -- 10.20.193.48:0/4023225188 learned_addr learned my addr 10.20.193.48:0/4023225188 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:15:21.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa166ffd640 10 monclient(hunting): get_auth_request con 0x7fa16805de60 auth_method 0 2026-02-12T18:15:21.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa166ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:21.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa166ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:21.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa166ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:21.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa1677fe640 10 monclient(hunting): get_auth_request con 0x7fa16805d550 auth_method 0 2026-02-12T18:15:21.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa1677fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:21.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa1677fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:21.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa1677fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:21.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa167fff640 1 --2- 10.20.193.48:0/4023225188 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa16813ef60 0x7fa16808abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:21.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa167fff640 10 monclient(hunting): get_auth_request con 0x7fa16813ef60 auth_method 0 2026-02-12T18:15:21.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa167fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:21.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa167fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:21.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa167fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:21.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa1677fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:21.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa1677fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:21.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa1677fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:21.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa166ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:21.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa166ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:21.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa166ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:21.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa167fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:21.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa167fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:21.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa167fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:21.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa1677fe640 10 monclient(hunting): handle_auth_done global_id 6993 payload 824 2026-02-12T18:15:21.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa1677fe640 1 -- 10.20.193.48:0/4023225188 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa16813ef60 msgr2=0x7fa16808abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:21.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa1677fe640 1 --2- 10.20.193.48:0/4023225188 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa16813ef60 0x7fa16808abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:21.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa1677fe640 1 -- 10.20.193.48:0/4023225188 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa16805de60 msgr2=0x7fa16808a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:21.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa1677fe640 1 --2- 10.20.193.48:0/4023225188 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa16805de60 0x7fa16808a680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:21.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa1677fe640 10 monclient: _finish_hunting 0 2026-02-12T18:15:21.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa1677fe640 1 monclient: found mon.noname-a 2026-02-12T18:15:21.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa1677fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:15:21.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa1677fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:15:21.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.191+0000 7fa1677fe640 1 -- 10.20.193.48:0/4023225188 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1580094f0 con 0x7fa16805d550 2026-02-12T18:15:21.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa1677fe640 1 -- 10.20.193.48:0/4023225188 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa16805d550 msgr2=0x7fa168131210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:21.202 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa1677fe640 1 --2- 10.20.193.48:0/4023225188 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa16805d550 0x7fa168131210 secure :-1 s=READY pgs=665 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa15400b4a0 tx=0x7fa15400b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:21.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa143fff640 1 -- 10.20.193.48:0/4023225188 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa154003e90 con 0x7fa16805d550 2026-02-12T18:15:21.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa143fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:21.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa143fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:15:21.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa143fff640 10 monclient: dump: 2026-02-12T18:15:21.203 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:21.203 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:21.203 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.203 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.203 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:21.203 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:21.203 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:21.203 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:21.203 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:21.203 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:21.203 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:21.203 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:21.203 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:21.203 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:21.203 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:21.203 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:21.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa143fff640 10 monclient: _finish_auth 0 2026-02-12T18:15:21.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa143fff640 10 monclient: _check_auth_tickets 2026-02-12T18:15:21.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa143fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:15:21.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa143fff640 1 -- 10.20.193.48:0/4023225188 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa154005530 con 0x7fa16805d550 2026-02-12T18:15:21.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa16e05b640 5 monclient: authenticate success, global_id 6993 2026-02-12T18:15:21.203 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa16e05b640 10 monclient: _renew_subs 2026-02-12T18:15:21.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa16e05b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:15:21.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa16e05b640 1 -- 10.20.193.48:0/4023225188 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa16810eef0 con 0x7fa16805d550 2026-02-12T18:15:21.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa143fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:15:21.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa143fff640 1 -- 10.20.193.48:0/4023225188 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa1540056a0 con 0x7fa16805d550 2026-02-12T18:15:21.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa143fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:21.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa165ffb640 4 set_mon_vals no callback set 2026-02-12T18:15:21.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa143fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:15:21.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa143fff640 10 monclient: dump: 2026-02-12T18:15:21.204 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:21.204 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:21.204 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.204 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.204 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:21.204 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:21.204 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:21.204 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:21.204 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:21.204 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:21.204 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:21.204 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:21.204 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:21.204 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:21.204 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:21.204 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:21.204 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa16e05b640 10 monclient: _renew_subs 2026-02-12T18:15:21.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa16e05b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:15:21.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa16e05b640 1 -- 10.20.193.48:0/4023225188 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa16810dcb0 con 0x7fa16805d550 2026-02-12T18:15:21.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa16e05b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:15:21.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa16e05b640 1 --2- 10.20.193.48:0/4023225188 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa168091010 0x7fa16808b100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:21.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa16e05b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:21.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa16e05b640 1 -- 10.20.193.48:0/4023225188 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa16810f080 con 0x7fa168091010 2026-02-12T18:15:21.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.194+0000 7fa143fff640 1 -- 10.20.193.48:0/4023225188 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fa154005070 con 0x7fa16805d550 2026-02-12T18:15:21.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.195+0000 7fa166ffd640 1 --2- 10.20.193.48:0/4023225188 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa168091010 0x7fa16808b100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:21.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.195+0000 7fa166ffd640 10 monclient: get_auth_request con 0x7fa168091010 auth_method 0 2026-02-12T18:15:21.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.195+0000 7fa166ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:21.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.195+0000 7fa166ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:21.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.195+0000 7fa166ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:21.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.195+0000 7fa166ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:21.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.195+0000 7fa166ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:21.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.195+0000 7fa166ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:21.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.195+0000 7fa143fff640 1 --2- 10.20.193.48:0/4023225188 >> v2:10.20.193.111:6812/977811348 conn(0x7fa13803f800 0x7fa13805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:21.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.195+0000 7fa143fff640 1 -- 10.20.193.48:0/4023225188 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(322..322 src has 215..322) ==== 3503+0+0 (secure 0 0 0) 0x7fa1540529a0 con 0x7fa16805d550 2026-02-12T18:15:21.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.195+0000 7fa167fff640 1 --2- 10.20.193.48:0/4023225188 >> v2:10.20.193.111:6812/977811348 conn(0x7fa13803f800 0x7fa13805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:21.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.195+0000 7fa167fff640 10 monclient: get_auth_request con 0x7fa13803f800 auth_method 0 2026-02-12T18:15:21.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.195+0000 7fa166ffd640 10 monclient(hunting): handle_auth_done global_id 104268 payload 824 2026-02-12T18:15:21.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.195+0000 7fa166ffd640 1 -- 10.20.193.48:0/4023225188 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa16805e310 con 0x7fa168091010 2026-02-12T18:15:21.205 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.197+0000 7fa166ffd640 1 -- 10.20.193.48:0/4023225188 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa168091010 msgr2=0x7fa16808b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:21.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.197+0000 7fa166ffd640 1 --2- 10.20.193.48:0/4023225188 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa168091010 0x7fa16808b100 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1580023d0 tx=0x7fa158004770 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:21.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.197+0000 7fa167fff640 1 --2- 10.20.193.48:0/4023225188 >> v2:10.20.193.111:6812/977811348 conn(0x7fa13803f800 0x7fa13805fcb0 secure :-1 s=READY pgs=467 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa168132260 tx=0x7fa15c009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:21.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.197+0000 7fa143fff640 1 -- 10.20.193.48:0/4023225188 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa1580045e0 con 0x7fa168091010 2026-02-12T18:15:21.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.197+0000 7fa143fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:21.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.197+0000 7fa143fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:15:21.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.197+0000 7fa143fff640 10 monclient: dump: 2026-02-12T18:15:21.206 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:21.206 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:21.206 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.206 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.206 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:21.206 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:21.206 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:21.206 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:21.206 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:21.206 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:21.206 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:21.206 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:21.206 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:21.206 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:21.206 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:21.206 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:21.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.198+0000 7fa143fff640 1 -- 10.20.193.48:0/4023225188 <== mon.3 v2:10.20.193.111:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fa158035a00 con 0x7fa168091010 2026-02-12T18:15:21.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.198+0000 7fa143fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:15:21.206 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.198+0000 7fa143fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:15:21.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.198+0000 7fa143fff640 1 -- 10.20.193.48:0/4023225188 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa168091010 msgr2=0x7fa16808b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:21.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.198+0000 7fa143fff640 1 --2- 10.20.193.48:0/4023225188 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa168091010 0x7fa16808b100 secure :-1 s=READY pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1580023d0 tx=0x7fa158004770 comp rx=0 tx=0).stop 2026-02-12T18:15:21.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.198+0000 7fa143fff640 1 -- 10.20.193.48:0/4023225188 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa168091010 msgr2=0x7fa16808b100 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:15:21.207 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.198+0000 7fa143fff640 1 --2- 10.20.193.48:0/4023225188 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa168091010 0x7fa16808b100 secure :-1 s=CLOSED pgs=37 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1580023d0 tx=0x7fa158004770 comp rx=0 tx=0).stop 2026-02-12T18:15:21.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.201+0000 7fa16e05b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:15:21.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.201+0000 7fa16e05b640 1 --2- 10.20.193.48:0/4023225188 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa168131750 0x7fa1680589e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:15:21.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.201+0000 7fa16e05b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:15:21.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.201+0000 7fa16e05b640 1 -- 10.20.193.48:0/4023225188 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fa168050410 con 0x7fa168131750 2026-02-12T18:15:21.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.201+0000 7fa166ffd640 1 --2- 10.20.193.48:0/4023225188 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa168131750 0x7fa1680589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:15:21.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.201+0000 7fa166ffd640 10 monclient: get_auth_request con 0x7fa168131750 auth_method 0 2026-02-12T18:15:21.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.201+0000 7fa166ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:15:21.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.201+0000 7fa166ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:15:21.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.201+0000 7fa166ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:15:21.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.201+0000 7fa166ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:15:21.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.201+0000 7fa166ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:15:21.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.201+0000 7fa166ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:15:21.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.202+0000 7fa166ffd640 10 monclient(hunting): handle_auth_done global_id 104277 payload 824 2026-02-12T18:15:21.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.202+0000 7fa166ffd640 1 -- 10.20.193.48:0/4023225188 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa168057e00 con 0x7fa168131750 2026-02-12T18:15:21.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.204+0000 7fa166ffd640 1 -- 10.20.193.48:0/4023225188 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa168131750 msgr2=0x7fa1680589e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:15:21.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.204+0000 7fa166ffd640 1 --2- 10.20.193.48:0/4023225188 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa168131750 0x7fa1680589e0 secure :-1 s=READY pgs=38 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1580023d0 tx=0x7fa158008030 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:15:21.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.204+0000 7fa143fff640 1 -- 10.20.193.48:0/4023225188 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa15804fe00 con 0x7fa168131750 2026-02-12T18:15:21.208 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.204+0000 7fa143fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:15:21.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.204+0000 7fa143fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:15:21.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.204+0000 7fa143fff640 10 monclient: dump: 2026-02-12T18:15:21.209 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:15:21.209 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:15:21.209 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.209 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:15:21.209 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:15:21.209 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:15:21.209 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:15:21.209 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:15:21.209 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:15:21.209 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:15:21.209 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:15:21.209 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:15:21.209 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:15:21.209 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:15:21.209 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:15:21.209 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:15:21.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.204+0000 7fa143fff640 1 -- 10.20.193.48:0/4023225188 <== mon.3 v2:10.20.193.111:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10148 (secure 0 0 0) 0x7fa158003cd0 con 0x7fa168131750 2026-02-12T18:15:21.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.204+0000 7fa143fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:15:21.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.204+0000 7fa143fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:15:21.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.204+0000 7fa143fff640 1 -- 10.20.193.48:0/4023225188 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa168131750 msgr2=0x7fa1680589e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:21.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.204+0000 7fa143fff640 1 --2- 10.20.193.48:0/4023225188 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa168131750 0x7fa1680589e0 secure :-1 s=READY pgs=38 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1580023d0 tx=0x7fa158008030 comp rx=0 tx=0).stop 2026-02-12T18:15:21.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.204+0000 7fa143fff640 1 -- 10.20.193.48:0/4023225188 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa168131750 msgr2=0x7fa1680589e0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:15:21.209 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.204+0000 7fa143fff640 1 --2- 10.20.193.48:0/4023225188 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fa168131750 0x7fa1680589e0 secure :-1 s=CLOSED pgs=38 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa1580023d0 tx=0x7fa158008030 comp rx=0 tx=0).stop 2026-02-12T18:15:21.210 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:15:21.210 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:15:21.210 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:15:21.210 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:15:21.210 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 86, 2026-02-12T18:15:21.210 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 40198, 2026-02-12T18:15:21.210 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:15:21.210 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:15:21.210 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:15:21.210 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:15:21.210 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:15:21.210 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:15:21.210 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:15:21.210 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:21.210 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 1, 2026-02-12T18:15:21.210 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:15:21.210 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:15:21.210 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:15:21.211 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:15:21.211 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:15:21.211 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:15:21.211 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:15:21.211 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:15:21.211 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:15:21.211 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:15:21.211 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:15:21.211 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:15:21.211 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:15:21.211 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:15:21.211 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:15:21.211 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:15:21.211 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:21.211 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:15:21.211 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:15:21.211 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:15:21.211 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:15:21.211 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:15:21.211 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:15:21.211 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:15:21.211 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:15:21.211 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:15:21.211 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:15:21.212 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:15:21.212 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:15:21.212 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:15:21.212 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:15:21.212 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:15:21.212 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.212 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.212 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:15:21.212 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:15:21.212 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:15:21.212 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:15:21.212 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:15:21.212 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:15:21.212 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:15:21.212 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:15:21.212 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:15:21.212 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:15:21.212 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:15:21.212 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:15:21.212 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:15:21.212 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:15:21.212 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:15:21.212 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:15:21.212 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:15:21.212 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:15:21.213 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:15:21.213 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:15:21.213 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:15:21.213 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:15:21.213 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:15:21.213 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:15:21.213 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:15:21.213 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:15:21.213 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:15:21.213 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:15:21.213 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:15:21.213 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:15:21.213 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:21.213 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:15:21.213 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.213 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:15:21.213 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.213 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:15:21.213 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:15:21.213 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.213 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.213 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.213 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.213 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:15:21.213 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.214 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.214 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.214 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.214 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:15:21.214 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.214 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.214 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.214 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.214 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:15:21.214 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:15:21.214 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.214 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.214 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:15:21.214 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.214 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.214 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.214 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:15:21.214 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:15:21.214 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.214 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.214 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.214 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.214 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:15:21.215 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.215 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.215 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.215 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.215 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:15:21.215 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.215 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.215 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.215 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.215 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:15:21.215 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:15:21.215 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.215 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.215 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:15:21.215 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.215 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.215 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.215 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:15:21.215 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:15:21.215 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.215 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.215 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.215 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.215 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:15:21.215 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.216 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.216 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.216 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.216 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:15:21.216 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.216 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.216 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.216 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.216 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:15:21.216 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:15:21.216 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.216 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.216 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:15:21.216 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.216 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.216 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.216 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:15:21.216 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:15:21.216 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.216 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.216 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.216 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.216 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:15:21.216 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.216 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.217 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.217 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.217 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:15:21.217 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.217 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.217 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.217 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.217 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:15:21.217 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:15:21.217 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.217 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.217 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:15:21.217 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.217 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.217 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.217 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:15:21.217 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:15:21.217 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.217 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.217 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.217 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.217 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:15:21.217 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.217 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.217 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.217 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.218 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:15:21.218 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.218 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.218 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.218 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.218 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:15:21.218 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:15:21.218 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.218 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.218 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:15:21.218 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.218 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.218 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.218 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:15:21.218 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:15:21.218 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.218 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.218 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.218 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.218 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:15:21.218 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.218 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.218 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.218 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.218 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:15:21.219 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.219 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.219 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.219 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.219 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:15:21.219 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:15:21.219 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.219 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.219 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:15:21.219 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.219 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.219 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.219 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:15:21.219 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:15:21.219 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.219 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.219 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.219 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.219 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:15:21.219 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.219 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.219 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.219 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.219 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:15:21.219 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.219 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.220 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.220 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.220 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:15:21.220 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:15:21.220 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.220 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.220 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:15:21.220 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.220 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.220 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.220 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:15:21.220 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:15:21.220 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.220 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.220 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.220 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.220 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:15:21.220 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.220 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.220 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.220 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.220 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:15:21.220 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.220 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:15:21.221 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:15:21.222 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:15:21.223 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:15:21.223 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:15:21.223 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:15:21.223 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:15:21.223 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:15:21.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.204+0000 7fa16e05b640 1 -- 10.20.193.48:0/4023225188 >> v2:10.20.193.111:6812/977811348 conn(0x7fa13803f800 msgr2=0x7fa13805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:21.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.204+0000 7fa16e05b640 1 --2- 10.20.193.48:0/4023225188 >> v2:10.20.193.111:6812/977811348 conn(0x7fa13803f800 0x7fa13805fcb0 secure :-1 s=READY pgs=467 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa168132260 tx=0x7fa15c009040 comp rx=0 tx=0).stop 2026-02-12T18:15:21.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.204+0000 7fa16e05b640 10 monclient: shutdown 2026-02-12T18:15:21.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.204+0000 7fa16e05b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:15:21.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.204+0000 7fa167fff640 1 -- 10.20.193.48:0/4023225188 reap_dead start 2026-02-12T18:15:21.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.204+0000 7fa16e05b640 1 -- 10.20.193.48:0/4023225188 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa16805d550 msgr2=0x7fa168131210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:15:21.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.204+0000 7fa16e05b640 1 --2- 10.20.193.48:0/4023225188 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa16805d550 0x7fa168131210 secure :-1 s=READY pgs=665 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa15400b4a0 tx=0x7fa15400b970 comp rx=0 tx=0).stop 2026-02-12T18:15:21.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.204+0000 7fa16e05b640 1 -- 10.20.193.48:0/4023225188 shutdown_connections 2026-02-12T18:15:21.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.205+0000 7fa16e05b640 1 --2- 10.20.193.48:0/4023225188 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa16805d550 0x7fa168131210 unknown :-1 s=CLOSED pgs=665 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:15:21.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.205+0000 7fa16e05b640 1 -- 10.20.193.48:0/4023225188 >> 10.20.193.48:0/4023225188 conn(0x7fa1680546a0 msgr2=0x7fa16813c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:15:21.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.205+0000 7fa16e05b640 1 -- 10.20.193.48:0/4023225188 shutdown_connections 2026-02-12T18:15:21.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:15:21.205+0000 7fa16e05b640 1 -- 10.20.193.48:0/4023225188 wait complete. 2026-02-12T18:15:21.224 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 6 2026-02-12T18:15:21.224 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2026-02-12T18:16:51.225 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.d 2026-02-12T18:16:51.225 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.d 2026-02-12T18:16:51.225 INFO:tasks.ceph.mon.d:Restarting daemon 2026-02-12T18:16:51.226 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i d 2026-02-12T18:16:51.244 INFO:tasks.ceph.mon.d:Started 2026-02-12T18:16:51.244 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.h 2026-02-12T18:16:51.244 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.h 2026-02-12T18:16:51.244 INFO:tasks.ceph.mon.h:Restarting daemon 2026-02-12T18:16:51.244 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i h 2026-02-12T18:16:51.258 INFO:tasks.ceph.mon.h:Started 2026-02-12T18:16:51.258 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.i 2026-02-12T18:16:51.258 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.i 2026-02-12T18:16:51.258 INFO:tasks.ceph.mon.i:Restarting daemon 2026-02-12T18:16:51.258 DEBUG:teuthology.orchestra.run.trial111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i i 2026-02-12T18:16:51.260 INFO:tasks.ceph.mon.i:Started 2026-02-12T18:16:51.260 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.f 2026-02-12T18:16:51.261 INFO:tasks.mon_thrash:Sending STOP to mon f 2026-02-12T18:16:51.261 INFO:tasks.ceph.mon.f:Sent signal 19 2026-02-12T18:16:51.261 INFO:tasks.mon_thrash.mon_thrasher:freezing mon.g 2026-02-12T18:16:51.261 INFO:tasks.mon_thrash:Sending STOP to mon g 2026-02-12T18:16:51.261 INFO:tasks.ceph.mon.g:Sent signal 19 2026-02-12T18:16:51.261 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2026-02-12T18:17:06.263 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.f 2026-02-12T18:17:06.263 INFO:tasks.mon_thrash:Sending CONT to mon f 2026-02-12T18:17:06.263 INFO:tasks.ceph.mon.f:Sent signal 18 2026-02-12T18:17:06.264 INFO:tasks.mon_thrash.mon_thrasher:unfreezing mon.g 2026-02-12T18:17:06.264 INFO:tasks.mon_thrash:Sending CONT to mon g 2026-02-12T18:17:06.264 INFO:tasks.ceph.mon.g:Sent signal 18 2026-02-12T18:17:06.264 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2026-02-12T18:17:06.264 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T18:17:06.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.332+0000 7feb259ed640 10 monclient: get_monmap_and_config 2026-02-12T18:17:06.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.332+0000 7feb259ed640 10 monclient: build_initial_monmap 2026-02-12T18:17:06.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.332+0000 7feb259ed640 10 monclient: monmap: 2026-02-12T18:17:06.334 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:06.334 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.334 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:06.333734+0000 2026-02-12T18:17:06.334 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:06.333734+0000 2026-02-12T18:17:06.334 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:06.334 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.335 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:06.335 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:06.335 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:06.335 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:06.335 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:06.335 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:06.335 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:06.335 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:06.335 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:06.335 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:06.335 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:06.335 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb259ed640 1 Processor -- start 2026-02-12T18:17:06.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb259ed640 1 -- start start 2026-02-12T18:17:06.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb259ed640 10 monclient: init 2026-02-12T18:17:06.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb259ed640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:06.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb259ed640 10 monclient: _add_conns ranks=[6,7,2,10,0,9,3,4,1,8,5] 2026-02-12T18:17:06.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb259ed640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feb2005dc20 0x7feb20144660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb259ed640 10 monclient(hunting): picked mon.noname-d con 0x7feb2005dc20 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:17:06.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb259ed640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7feb2005dff0 0x7feb2005e3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb259ed640 10 monclient(hunting): picked mon.noname-i con 0x7feb2005dff0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:17:06.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb259ed640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feb20089df0 0x7feb2008a240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb259ed640 10 monclient(hunting): picked mon.noname-b con 0x7feb20089df0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:17:06.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb259ed640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb259ed640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7feb20093a30 con 0x7feb20089df0 2026-02-12T18:17:06.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb259ed640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb259ed640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7feb20092200 con 0x7feb2005dc20 2026-02-12T18:17:06.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb259ed640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb259ed640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7feb2008b250 con 0x7feb2005dff0 2026-02-12T18:17:06.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb259ed640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:06.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb259ed640 10 monclient(hunting): authenticate will time out at 1265.059610s 2026-02-12T18:17:06.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1effd640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feb2005dc20 0x7feb20144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1effd640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feb2005dc20 0x7feb20144660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:51694/0 (socket says 10.20.193.48:51694) 2026-02-12T18:17:06.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1effd640 1 -- 10.20.193.48:0/175591750 learned_addr learned my addr 10.20.193.48:0/175591750 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:06.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1effd640 10 monclient(hunting): get_auth_request con 0x7feb2005dc20 auth_method 0 2026-02-12T18:17:06.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1f7fe640 1 --2- 10.20.193.48:0/175591750 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feb20089df0 0x7feb2008a240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1f7fe640 10 monclient(hunting): get_auth_request con 0x7feb20089df0 auth_method 0 2026-02-12T18:17:06.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1e7fc640 1 --2- 10.20.193.48:0/175591750 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7feb2005dff0 0x7feb2005e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1effd640 1 -- 10.20.193.48:0/175591750 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feb2005dc20 msgr2=0x7feb20144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 10 2026-02-12T18:17:06.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1effd640 1 -- 10.20.193.48:0/175591750 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feb2005dc20 msgr2=0x7feb20144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:17:06.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1effd640 1 --2- 10.20.193.48:0/175591750 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feb2005dc20 0x7feb20144660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:17:06.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1e7fc640 10 monclient(hunting): get_auth_request con 0x7feb2005dff0 auth_method 0 2026-02-12T18:17:06.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:06.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:06.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1effd640 1 --2- 10.20.193.48:0/175591750 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feb2005dc20 0x7feb20144660 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:17:06.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:06.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1e7fc640 1 -- 10.20.193.48:0/175591750 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7feb2005dff0 msgr2=0x7feb2005e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:17:06.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1e7fc640 1 -- 10.20.193.48:0/175591750 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7feb2005dff0 msgr2=0x7feb2005e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:17:06.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1e7fc640 1 --2- 10.20.193.48:0/175591750 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7feb2005dff0 0x7feb2005e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:17:06.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1f7fe640 10 monclient(hunting): handle_auth_done global_id 36632 payload 274 2026-02-12T18:17:06.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1e7fc640 1 --2- 10.20.193.48:0/175591750 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7feb2005dff0 0x7feb2005e3c0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:17:06.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1f7fe640 1 -- 10.20.193.48:0/175591750 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7feb2005dff0 msgr2=0x7feb2005e3c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:17:06.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1f7fe640 1 --2- 10.20.193.48:0/175591750 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7feb2005dff0 0x7feb2005e3c0 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1f7fe640 1 -- 10.20.193.48:0/175591750 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feb2005dc20 msgr2=0x7feb20144660 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:17:06.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1f7fe640 1 --2- 10.20.193.48:0/175591750 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feb2005dc20 0x7feb20144660 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1f7fe640 10 monclient: _finish_hunting 0 2026-02-12T18:17:06.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1f7fe640 1 monclient: found mon.noname-b 2026-02-12T18:17:06.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:06.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1f7fe640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:17:06.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.333+0000 7feb1f7fe640 1 -- 10.20.193.48:0/175591750 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb20060390 con 0x7feb20089df0 2026-02-12T18:17:06.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.336+0000 7feb1f7fe640 1 -- 10.20.193.48:0/175591750 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feb20089df0 msgr2=0x7feb2008a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:06.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.336+0000 7feb1f7fe640 1 --2- 10.20.193.48:0/175591750 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feb20089df0 0x7feb2008a240 secure :-1 s=READY pgs=465 gs=2 cs=0 l=1 c_cookie=4525681245230080704 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb1000a910 tx=0x7feb1002feb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ece731d4c9622c0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:06.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.336+0000 7feb1dffb640 1 -- 10.20.193.48:0/175591750 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7feb10036340 con 0x7feb20089df0 2026-02-12T18:17:06.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.336+0000 7feb1dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.336+0000 7feb1dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:17:06.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.336+0000 7feb1dffb640 10 monclient: dump: 2026-02-12T18:17:06.350 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.350 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.350 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.350 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.350 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.350 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.350 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.350 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.350 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.351 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.351 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.351 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.351 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.351 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.351 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.351 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.336+0000 7feb1dffb640 10 monclient: _finish_auth 0 2026-02-12T18:17:06.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.336+0000 7feb1dffb640 10 monclient: _check_auth_tickets 2026-02-12T18:17:06.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.336+0000 7feb1dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:06.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.336+0000 7feb1dffb640 1 -- 10.20.193.48:0/175591750 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb100364c0 con 0x7feb20089df0 2026-02-12T18:17:06.351 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.336+0000 7feb259ed640 5 monclient: authenticate success, global_id 36632 2026-02-12T18:17:06.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.336+0000 7feb259ed640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:17:06.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.336+0000 7feb1dffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:06.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.336+0000 7feb1dffb640 1 -- 10.20.193.48:0/175591750 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7feb10036af0 con 0x7feb20089df0 2026-02-12T18:17:06.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.336+0000 7feb259ed640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:06.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.336+0000 7feb259ed640 4 set_mon_vals no callback set 2026-02-12T18:17:06.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.336+0000 7feb1dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.336+0000 7feb1dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:17:06.352 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.336+0000 7feb1dffb640 10 monclient: dump: 2026-02-12T18:17:06.352 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.352 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.352 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.352 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.353 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.353 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.353 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.353 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.353 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.353 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.353 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.353 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.353 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.353 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.353 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.353 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.353 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.336+0000 7feb259ed640 10 monclient: shutdown 2026-02-12T18:17:06.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.336+0000 7feb259ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:06.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.336+0000 7feb259ed640 1 -- 10.20.193.48:0/175591750 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feb20089df0 msgr2=0x7feb2008a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.336+0000 7feb259ed640 1 --2- 10.20.193.48:0/175591750 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feb20089df0 0x7feb2008a240 secure :-1 s=READY pgs=465 gs=2 cs=0 l=1 c_cookie=4525681245230080704 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb1000a910 tx=0x7feb1002feb0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 1 -- 10.20.193.48:0/175591750 shutdown_connections 2026-02-12T18:17:06.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 1 --2- 10.20.193.48:0/175591750 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7feb20089df0 0x7feb2008a240 unknown :-1 s=CLOSED pgs=465 gs=2 cs=0 l=1 c_cookie=4525681245230080704 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 1 --2- 10.20.193.48:0/175591750 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7feb2005dff0 0x7feb2005e3c0 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 1 --2- 10.20.193.48:0/175591750 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feb2005dc20 0x7feb20144660 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 1 -- 10.20.193.48:0/175591750 >> 10.20.193.48:0/175591750 conn(0x7feb200546d0 msgr2=0x7feb20054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:06.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 1 -- 10.20.193.48:0/175591750 shutdown_connections 2026-02-12T18:17:06.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 1 -- 10.20.193.48:0/175591750 wait complete. 2026-02-12T18:17:06.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 10 monclient: build_initial_monmap 2026-02-12T18:17:06.354 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 10 monclient: monmap: 2026-02-12T18:17:06.355 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:06.355 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:06.355 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:06.355 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:06.355 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:06.355 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.355 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:06.355 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:06.355 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:06.355 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:06.355 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:06.355 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:06.356 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:06.356 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:06.356 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:06.356 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 1 Processor -- start 2026-02-12T18:17:06.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 1 -- start start 2026-02-12T18:17:06.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 10 monclient: init 2026-02-12T18:17:06.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:06.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 10 monclient: _add_conns ranks=[5,0,6,1,3,2,8,7,4] 2026-02-12T18:17:06.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7feb2005dc20 0x7feb20131860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 10 monclient(hunting): picked mon.noname-h con 0x7feb2005dc20 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:17:06.356 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7feb2005dff0 0x7feb2010db60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 10 monclient(hunting): picked mon.noname-a con 0x7feb2005dff0 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:17:06.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feb20089df0 0x7feb2010e0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 10 monclient(hunting): picked mon.noname-d con 0x7feb20089df0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:17:06.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7feb200914c0 con 0x7feb2005dff0 2026-02-12T18:17:06.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7feb2010fed0 con 0x7feb2005dc20 2026-02-12T18:17:06.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7feb201101b0 con 0x7feb20089df0 2026-02-12T18:17:06.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:06.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.337+0000 7feb259ed640 10 monclient(hunting): authenticate will time out at 1265.063945s 2026-02-12T18:17:06.357 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1e7fc640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7feb2005dff0 0x7feb2010db60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1e7fc640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7feb2005dff0 0x7feb2010db60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:54790/0 (socket says 10.20.193.48:54790) 2026-02-12T18:17:06.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1f7fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feb20089df0 0x7feb2010e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1e7fc640 1 -- 10.20.193.48:0/119213507 learned_addr learned my addr 10.20.193.48:0/119213507 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:06.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1e7fc640 10 monclient(hunting): get_auth_request con 0x7feb2005dff0 auth_method 0 2026-02-12T18:17:06.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1f7fe640 10 monclient(hunting): get_auth_request con 0x7feb20089df0 auth_method 0 2026-02-12T18:17:06.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1effd640 1 --2- 10.20.193.48:0/119213507 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7feb2005dc20 0x7feb20131860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.358 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:06.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:06.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1f7fe640 1 -- 10.20.193.48:0/119213507 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feb20089df0 msgr2=0x7feb2010e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2026-02-12T18:17:06.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:06.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1f7fe640 1 -- 10.20.193.48:0/119213507 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feb20089df0 msgr2=0x7feb2010e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:17:06.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1f7fe640 1 --2- 10.20.193.48:0/119213507 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feb20089df0 0x7feb2010e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:17:06.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1effd640 10 monclient(hunting): get_auth_request con 0x7feb2005dc20 auth_method 0 2026-02-12T18:17:06.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1f7fe640 1 --2- 10.20.193.48:0/119213507 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feb20089df0 0x7feb2010e0a0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:17:06.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1effd640 1 -- 10.20.193.48:0/119213507 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7feb2005dc20 msgr2=0x7feb20131860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2026-02-12T18:17:06.359 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1effd640 1 -- 10.20.193.48:0/119213507 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7feb2005dc20 msgr2=0x7feb20131860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:17:06.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1effd640 1 --2- 10.20.193.48:0/119213507 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7feb2005dc20 0x7feb20131860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:17:06.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1effd640 1 --2- 10.20.193.48:0/119213507 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7feb2005dc20 0x7feb20131860 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:17:06.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1e7fc640 10 monclient(hunting): handle_auth_done global_id 7002 payload 824 2026-02-12T18:17:06.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1e7fc640 1 -- 10.20.193.48:0/119213507 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feb20089df0 msgr2=0x7feb2010e0a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:17:06.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1e7fc640 1 --2- 10.20.193.48:0/119213507 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feb20089df0 0x7feb2010e0a0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1e7fc640 1 -- 10.20.193.48:0/119213507 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7feb2005dc20 msgr2=0x7feb20131860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:17:06.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1e7fc640 1 --2- 10.20.193.48:0/119213507 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7feb2005dc20 0x7feb20131860 unknown :-1 s=START_CONNECT pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1e7fc640 10 monclient: _finish_hunting 0 2026-02-12T18:17:06.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1e7fc640 1 monclient: found mon.noname-a 2026-02-12T18:17:06.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:06.360 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1e7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:17:06.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.338+0000 7feb1e7fc640 1 -- 10.20.193.48:0/119213507 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb1000a500 con 0x7feb2005dff0 2026-02-12T18:17:06.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.340+0000 7feb1e7fc640 1 -- 10.20.193.48:0/119213507 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7feb2005dff0 msgr2=0x7feb2010db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:06.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.340+0000 7feb1e7fc640 1 --2- 10.20.193.48:0/119213507 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7feb2005dff0 0x7feb2010db60 secure :-1 s=READY pgs=710 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb0800e7e0 tx=0x7feb0800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:06.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.340+0000 7feaf7fff640 1 -- 10.20.193.48:0/119213507 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7feb0800cda0 con 0x7feb2005dff0 2026-02-12T18:17:06.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.340+0000 7feaf7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.340+0000 7feaf7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:17:06.361 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.340+0000 7feaf7fff640 10 monclient: dump: 2026-02-12T18:17:06.361 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.361 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.361 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.361 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.361 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.362 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.362 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.362 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.362 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.362 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.362 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.362 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.362 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.362 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.362 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.362 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.362 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.340+0000 7feaf7fff640 10 monclient: _finish_auth 0 2026-02-12T18:17:06.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.340+0000 7feaf7fff640 10 monclient: _check_auth_tickets 2026-02-12T18:17:06.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.340+0000 7feaf7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:06.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.340+0000 7feaf7fff640 1 -- 10.20.193.48:0/119213507 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb08013410 con 0x7feb2005dff0 2026-02-12T18:17:06.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.340+0000 7feb259ed640 5 monclient: authenticate success, global_id 7002 2026-02-12T18:17:06.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.340+0000 7feb259ed640 10 monclient: _renew_subs 2026-02-12T18:17:06.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.340+0000 7feb259ed640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:06.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.340+0000 7feb259ed640 1 -- 10.20.193.48:0/119213507 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb20110490 con 0x7feb2005dff0 2026-02-12T18:17:06.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.340+0000 7feaf7fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:06.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.340+0000 7feaf7fff640 1 -- 10.20.193.48:0/119213507 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7feb08013a40 con 0x7feb2005dff0 2026-02-12T18:17:06.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.340+0000 7feaf7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.340+0000 7feb1d7fa640 4 set_mon_vals no callback set 2026-02-12T18:17:06.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.340+0000 7feaf7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:17:06.363 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.340+0000 7feaf7fff640 10 monclient: dump: 2026-02-12T18:17:06.364 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.364 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.364 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.364 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.364 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.364 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.364 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.364 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.364 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.364 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.364 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.364 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.364 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.365 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.365 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.365 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.340+0000 7feb259ed640 10 monclient: _renew_subs 2026-02-12T18:17:06.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.340+0000 7feb259ed640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:06.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.340+0000 7feb259ed640 1 -- 10.20.193.48:0/119213507 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb20090db0 con 0x7feb2005dff0 2026-02-12T18:17:06.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.341+0000 7feb259ed640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:06.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.341+0000 7feb259ed640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:06.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.341+0000 7feb259ed640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:06.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.341+0000 7feb259ed640 1 -- 10.20.193.48:0/119213507 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb20110680 con 0x7feb2005dff0 2026-02-12T18:17:06.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.341+0000 7feaf7fff640 1 -- 10.20.193.48:0/119213507 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7feb08013ba0 con 0x7feb2005dff0 2026-02-12T18:17:06.365 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.341+0000 7feaf7fff640 1 --2- 10.20.193.48:0/119213507 >> v2:10.20.193.111:6812/977811348 conn(0x7feaf003f800 0x7feaf005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.341+0000 7feaf7fff640 1 -- 10.20.193.48:0/119213507 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7feb08052b30 con 0x7feb2005dff0 2026-02-12T18:17:06.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.341+0000 7feb1effd640 1 --2- 10.20.193.48:0/119213507 >> v2:10.20.193.111:6812/977811348 conn(0x7feaf003f800 0x7feaf005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.366 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.341+0000 7feb1effd640 10 monclient: get_auth_request con 0x7feaf003f800 auth_method 0 2026-02-12T18:17:06.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.344+0000 7feaf7fff640 1 -- 10.20.193.48:0/119213507 <== mon.0 v2:10.20.193.48:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7feb08013580 con 0x7feb2005dff0 2026-02-12T18:17:06.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.344+0000 7feaf7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:06.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.344+0000 7feaf7fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:17:06.367 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.344+0000 7feb1effd640 1 --2- 10.20.193.48:0/119213507 >> v2:10.20.193.111:6812/977811348 conn(0x7feaf003f800 0x7feaf005fcb0 secure :-1 s=READY pgs=471 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb14006d40 tx=0x7feb14008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:06.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.487+0000 7feb259ed640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T18:17:06.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.487+0000 7feb259ed640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T18:17:06.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.487+0000 7feb259ed640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:06.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.487+0000 7feb259ed640 1 -- 10.20.193.48:0/119213507 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7feb20038a00 con 0x7feb2005dff0 2026-02-12T18:17:06.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.487+0000 7feaf7fff640 1 -- 10.20.193.48:0/119213507 <== mon.0 v2:10.20.193.48:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3660 (secure 0 0 0) 0x7feb0801b3b0 con 0x7feb2005dff0 2026-02-12T18:17:06.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.487+0000 7feaf7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T18:17:06.489 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.487+0000 7feaf7fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:17:06.490 INFO:teuthology.orchestra.run.trial048.stdout:{"election_epoch":92,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","modified":"2026-02-12T18:05:32.850777Z","created":"2026-02-12T18:05:32.850777Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3300","nonce":0},{"type":"v1","addr":"10.20.193.48:6789","nonce":0}]},"addr":"10.20.193.48:6789/0","public_addr":"10.20.193.48:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850827+0000","crush_location":[]},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3300","nonce":0},{"type":"v1","addr":"10.20.193.111:6789","nonce":0}]},"addr":"10.20.193.111:6789/0","public_addr":"10.20.193.111:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850829+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3301","nonce":0},{"type":"v1","addr":"10.20.193.48:6790","nonce":0}]},"addr":"10.20.193.48:6790/0","public_addr":"10.20.193.48:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850830+0000","crush_location":[]},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3301","nonce":0},{"type":"v1","addr":"10.20.193.111:6790","nonce":0}]},"addr":"10.20.193.111:6790/0","public_addr":"10.20.193.111:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850833+0000","crush_location":[]},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3302","nonce":0},{"type":"v1","addr":"10.20.193.48:6791","nonce":0}]},"addr":"10.20.193.48:6791/0","public_addr":"10.20.193.48:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3302","nonce":0},{"type":"v1","addr":"10.20.193.111:6791","nonce":0}]},"addr":"10.20.193.111:6791/0","public_addr":"10.20.193.111:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850834+0000","crush_location":[]},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3303","nonce":0},{"type":"v1","addr":"10.20.193.48:6792","nonce":0}]},"addr":"10.20.193.48:6792/0","public_addr":"10.20.193.48:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3303","nonce":0},{"type":"v1","addr":"10.20.193.111:6792","nonce":0}]},"addr":"10.20.193.111:6792/0","public_addr":"10.20.193.111:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850835+0000","crush_location":[]},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3304","nonce":0},{"type":"v1","addr":"10.20.193.48:6793","nonce":0}]},"addr":"10.20.193.48:6793/0","public_addr":"10.20.193.48:6793/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850832+0000","crush_location":[]}]}} 2026-02-12T18:17:06.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.489+0000 7feb259ed640 1 -- 10.20.193.48:0/119213507 >> v2:10.20.193.111:6812/977811348 conn(0x7feaf003f800 msgr2=0x7feaf005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.489+0000 7feb259ed640 1 --2- 10.20.193.48:0/119213507 >> v2:10.20.193.111:6812/977811348 conn(0x7feaf003f800 0x7feaf005fcb0 secure :-1 s=READY pgs=471 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb14006d40 tx=0x7feb14008040 comp rx=0 tx=0).stop 2026-02-12T18:17:06.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.489+0000 7feb259ed640 10 monclient: shutdown 2026-02-12T18:17:06.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.489+0000 7feb259ed640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:06.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.489+0000 7feb259ed640 1 -- 10.20.193.48:0/119213507 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7feb2005dff0 msgr2=0x7feb2010db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.491 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.489+0000 7feb259ed640 1 --2- 10.20.193.48:0/119213507 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7feb2005dff0 0x7feb2010db60 secure :-1 s=READY pgs=710 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7feb0800e7e0 tx=0x7feb0800ecb0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.492 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.489+0000 7feb259ed640 1 -- 10.20.193.48:0/119213507 shutdown_connections 2026-02-12T18:17:06.492 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.489+0000 7feb259ed640 1 --2- 10.20.193.48:0/119213507 >> v2:10.20.193.111:6812/977811348 conn(0x7feaf003f800 0x7feaf005fcb0 unknown :-1 s=CLOSED pgs=471 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.492 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.489+0000 7feb259ed640 1 --2- 10.20.193.48:0/119213507 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7feb2005dff0 0x7feb2010db60 unknown :-1 s=CLOSED pgs=710 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.492 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.489+0000 7feb259ed640 1 --2- 10.20.193.48:0/119213507 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7feb20089df0 0x7feb2010e0a0 unknown :-1 s=CLOSED pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.492 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.489+0000 7feb259ed640 1 --2- 10.20.193.48:0/119213507 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7feb2005dc20 0x7feb20131860 unknown :-1 s=CLOSED pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.492 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.489+0000 7feb259ed640 1 -- 10.20.193.48:0/119213507 >> 10.20.193.48:0/119213507 conn(0x7feb200546d0 msgr2=0x7feb20124ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:06.492 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.489+0000 7feb259ed640 1 -- 10.20.193.48:0/119213507 shutdown_connections 2026-02-12T18:17:06.492 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.489+0000 7feb259ed640 1 -- 10.20.193.48:0/119213507 wait complete. 2026-02-12T18:17:06.499 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2026-02-12T18:17:06.499 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2026-02-12T18:17:06.499 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2026-02-12T18:17:06.567 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.566+0000 7f545825b640 10 monclient: get_monmap_and_config 2026-02-12T18:17:06.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.566+0000 7f545825b640 10 monclient: build_initial_monmap 2026-02-12T18:17:06.568 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.566+0000 7f545825b640 10 monclient: monmap: 2026-02-12T18:17:06.568 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:06.568 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.568 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:06.567210+0000 2026-02-12T18:17:06.568 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:06.567210+0000 2026-02-12T18:17:06.568 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:06.568 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.568 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:06.569 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:06.569 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:06.569 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:06.569 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:06.569 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:06.569 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:06.569 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:06.569 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:06.569 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:06.569 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:06.569 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.569 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.566+0000 7f545825b640 1 Processor -- start 2026-02-12T18:17:06.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.566+0000 7f545825b640 1 -- start start 2026-02-12T18:17:06.570 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.566+0000 7f545825b640 10 monclient: init 2026-02-12T18:17:06.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f545825b640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:06.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f545825b640 10 monclient: _add_conns ranks=[5,6,1,0,3,4,10,9,7,2,8] 2026-02-12T18:17:06.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f545825b640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f54500951a0 0x7f5450093850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f545825b640 10 monclient(hunting): picked mon.noname-h con 0x7f54500951a0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:17:06.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f545825b640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5450096ad0 0x7f5450095570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.578 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f545825b640 10 monclient(hunting): picked mon.noname-d con 0x7f5450096ad0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:17:06.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f545825b640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f5450095ab0 addr v1:10.20.193.111:6789/0 2026-02-12T18:17:06.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f545825b640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f545004dc20 con 0x7f5450095ab0 2026-02-12T18:17:06.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f545825b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f545825b640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f5450096900 con 0x7f54500951a0 2026-02-12T18:17:06.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f545825b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f545825b640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f5450092260 con 0x7f5450096ad0 2026-02-12T18:17:06.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f545825b640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:06.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f545825b640 10 monclient(hunting): authenticate will time out at 1265.293085s 2026-02-12T18:17:06.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f54557cf640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5450096ad0 0x7f5450095570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f54557cf640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5450096ad0 0x7f5450095570 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:51724/0 (socket says 10.20.193.48:51724) 2026-02-12T18:17:06.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f54557cf640 1 -- 10.20.193.48:0/539835513 learned_addr learned my addr 10.20.193.48:0/539835513 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:06.579 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f54557cf640 10 monclient(hunting): get_auth_request con 0x7f5450096ad0 auth_method 0 2026-02-12T18:17:06.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f54557cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f54557cf640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f54557cf640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f5455fd0640 1 --2- 10.20.193.48:0/539835513 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f54500951a0 0x7f5450093850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f5455fd0640 10 monclient(hunting): get_auth_request con 0x7f54500951a0 auth_method 0 2026-02-12T18:17:06.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f5455fd0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f5455fd0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f5455fd0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f54557cf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:06.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f54557cf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:06.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f54557cf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:06.580 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f54557cf640 10 monclient(hunting): handle_auth_done global_id 114108 payload 274 2026-02-12T18:17:06.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f54557cf640 1 -- 10.20.193.48:0/539835513 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f54500951a0 msgr2=0x7f5450093850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:06.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f54557cf640 1 --2- 10.20.193.48:0/539835513 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f54500951a0 0x7f5450093850 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f54557cf640 1 -- 10.20.193.48:0/539835513 >> v1:10.20.193.111:6789/0 conn(0x7f5450095ab0 legacy=0x7f54501a4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:06.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f54557cf640 10 monclient: _finish_hunting 0 2026-02-12T18:17:06.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f54557cf640 1 monclient: found mon.noname-d 2026-02-12T18:17:06.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f54557cf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:06.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f54557cf640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:17:06.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.567+0000 7f54557cf640 1 -- 10.20.193.48:0/539835513 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5450093070 con 0x7f5450096ad0 2026-02-12T18:17:06.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f54557cf640 1 -- 10.20.193.48:0/539835513 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5450096ad0 msgr2=0x7f5450095570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:06.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f54557cf640 1 --2- 10.20.193.48:0/539835513 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5450096ad0 0x7f5450095570 secure :-1 s=READY pgs=20 gs=2 cs=0 l=1 c_cookie=10782451281959618600 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54440098d0 tx=0x7f544402ee20 comp rx=0 tx=0).ready entity=mon.6 client_cookie=95a2f65025288828 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:06.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f5454fce640 1 -- 10.20.193.48:0/539835513 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5444035340 con 0x7f5450096ad0 2026-02-12T18:17:06.581 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f5454fce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f5454fce640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:17:06.582 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f5454fce640 10 monclient: dump: 2026-02-12T18:17:06.582 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.582 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.582 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.582 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.582 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.582 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.582 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.582 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.582 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.582 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.583 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.583 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.583 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.583 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.583 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.583 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f5454fce640 10 monclient: _finish_auth 0 2026-02-12T18:17:06.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f5454fce640 10 monclient: _check_auth_tickets 2026-02-12T18:17:06.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f5454fce640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:06.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f5454fce640 1 -- 10.20.193.48:0/539835513 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54440354c0 con 0x7f5450096ad0 2026-02-12T18:17:06.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f545825b640 5 monclient: authenticate success, global_id 114108 2026-02-12T18:17:06.583 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f5454fce640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:06.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f5454fce640 1 -- 10.20.193.48:0/539835513 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5444035af0 con 0x7f5450096ad0 2026-02-12T18:17:06.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f545825b640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:06.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f545825b640 4 set_mon_vals no callback set 2026-02-12T18:17:06.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f5454fce640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f5454fce640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:17:06.584 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f5454fce640 10 monclient: dump: 2026-02-12T18:17:06.584 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.584 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.584 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.584 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.584 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.584 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.585 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.585 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.585 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.585 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.585 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.585 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.585 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.585 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.585 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.585 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f545825b640 10 monclient: shutdown 2026-02-12T18:17:06.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f545825b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:06.585 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f545825b640 1 -- 10.20.193.48:0/539835513 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5450096ad0 msgr2=0x7f5450095570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f545825b640 1 --2- 10.20.193.48:0/539835513 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5450096ad0 0x7f5450095570 secure :-1 s=READY pgs=20 gs=2 cs=0 l=1 c_cookie=10782451281959618600 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54440098d0 tx=0x7f544402ee20 comp rx=0 tx=0).stop 2026-02-12T18:17:06.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f545825b640 1 -- 10.20.193.48:0/539835513 shutdown_connections 2026-02-12T18:17:06.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f545825b640 1 --2- 10.20.193.48:0/539835513 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f5450096ad0 0x7f5450095570 unknown :-1 s=CLOSED pgs=20 gs=2 cs=0 l=1 c_cookie=10782451281959618600 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f545825b640 1 --2- 10.20.193.48:0/539835513 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f54500951a0 0x7f5450093850 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f545825b640 1 -- 10.20.193.48:0/539835513 >> 10.20.193.48:0/539835513 conn(0x7f54500548c0 msgr2=0x7f54500973a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:06.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f545825b640 1 -- 10.20.193.48:0/539835513 shutdown_connections 2026-02-12T18:17:06.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.570+0000 7f545825b640 1 -- 10.20.193.48:0/539835513 wait complete. 2026-02-12T18:17:06.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f545825b640 10 monclient: build_initial_monmap 2026-02-12T18:17:06.586 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f545825b640 10 monclient: monmap: 2026-02-12T18:17:06.586 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:06.586 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:06.586 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:06.587 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:06.587 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:06.587 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.587 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:06.587 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:06.587 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:06.587 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:06.587 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:06.587 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:06.587 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:06.587 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:06.587 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:06.587 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f545825b640 1 Processor -- start 2026-02-12T18:17:06.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f545825b640 1 -- start start 2026-02-12T18:17:06.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f545825b640 10 monclient: init 2026-02-12T18:17:06.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f545825b640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:06.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f545825b640 10 monclient: _add_conns ranks=[6,3,2,7,0,1,5,4,8] 2026-02-12T18:17:06.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f545825b640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f54500951a0 0x7f54501d7be0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f545825b640 10 monclient(hunting): picked mon.noname-d con 0x7f54500951a0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:17:06.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f545825b640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f5450095ab0 0x7f54501b0da0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f545825b640 10 monclient(hunting): picked mon.noname-g con 0x7f5450095ab0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:17:06.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f545825b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5450096ad0 0x7f54501b12e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f545825b640 10 monclient(hunting): picked mon.noname-b con 0x7f5450096ad0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:17:06.588 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f545825b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f545825b640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f545019bfa0 con 0x7f5450096ad0 2026-02-12T18:17:06.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f545825b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f545825b640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f54501d8560 con 0x7f5450095ab0 2026-02-12T18:17:06.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f545825b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f545825b640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f545019b8d0 con 0x7f54500951a0 2026-02-12T18:17:06.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f545825b640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:06.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f545825b640 10 monclient(hunting): authenticate will time out at 1265.297834s 2026-02-12T18:17:06.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f5455fd0640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f54500951a0 0x7f54501d7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f54567d1640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5450096ad0 0x7f54501b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f5455fd0640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f54500951a0 0x7f54501d7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:51728/0 (socket says 10.20.193.48:51728) 2026-02-12T18:17:06.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f5455fd0640 1 -- 10.20.193.48:0/2574949110 learned_addr learned my addr 10.20.193.48:0/2574949110 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:06.589 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f54567d1640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5450096ad0 0x7f54501b12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:44130/0 (socket says 10.20.193.48:44130) 2026-02-12T18:17:06.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f5455fd0640 10 monclient(hunting): get_auth_request con 0x7f54500951a0 auth_method 0 2026-02-12T18:17:06.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f5455fd0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f5455fd0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f5455fd0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f54567d1640 10 monclient(hunting): get_auth_request con 0x7f5450096ad0 auth_method 0 2026-02-12T18:17:06.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f54567d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f54567d1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f54567d1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f5455fd0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:06.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f5455fd0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:06.590 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.571+0000 7f54557cf640 1 --2- 10.20.193.48:0/2574949110 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f5450095ab0 0x7f54501b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.572+0000 7f5455fd0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:06.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.572+0000 7f54567d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:06.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.572+0000 7f54567d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:06.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.572+0000 7f54567d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:06.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.572+0000 7f54557cf640 10 monclient(hunting): get_auth_request con 0x7f5450095ab0 auth_method 0 2026-02-12T18:17:06.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.572+0000 7f54557cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.572+0000 7f54557cf640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.572+0000 7f54557cf640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.572+0000 7f54557cf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:06.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.572+0000 7f54557cf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:06.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.572+0000 7f54557cf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:06.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.572+0000 7f5455fd0640 10 monclient(hunting): handle_auth_done global_id 114117 payload 824 2026-02-12T18:17:06.591 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.572+0000 7f5455fd0640 1 -- 10.20.193.48:0/2574949110 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f5450095ab0 msgr2=0x7f54501b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.572+0000 7f5455fd0640 1 --2- 10.20.193.48:0/2574949110 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f5450095ab0 0x7f54501b0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.572+0000 7f5455fd0640 1 -- 10.20.193.48:0/2574949110 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5450096ad0 msgr2=0x7f54501b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.572+0000 7f5455fd0640 1 --2- 10.20.193.48:0/2574949110 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5450096ad0 0x7f54501b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.572+0000 7f5455fd0640 10 monclient: _finish_hunting 0 2026-02-12T18:17:06.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.572+0000 7f5455fd0640 1 monclient: found mon.noname-d 2026-02-12T18:17:06.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.572+0000 7f5455fd0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:06.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.572+0000 7f5455fd0640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:17:06.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.572+0000 7f5455fd0640 1 -- 10.20.193.48:0/2574949110 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54440094f0 con 0x7f54500951a0 2026-02-12T18:17:06.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.572+0000 7f54567d1640 1 --2- 10.20.193.48:0/2574949110 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f5450096ad0 0x7f54501b12e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:17:06.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.574+0000 7f5455fd0640 1 -- 10.20.193.48:0/2574949110 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f54500951a0 msgr2=0x7f54501d7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:06.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.574+0000 7f5455fd0640 1 --2- 10.20.193.48:0/2574949110 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f54500951a0 0x7f54501d7be0 secure :-1 s=READY pgs=21 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5440006f30 tx=0x7f544000ebd0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:06.592 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.574+0000 7f543e7fc640 1 -- 10.20.193.48:0/2574949110 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f544000ee30 con 0x7f54500951a0 2026-02-12T18:17:06.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.574+0000 7f543e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.574+0000 7f543e7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:17:06.593 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.574+0000 7f543e7fc640 10 monclient: dump: 2026-02-12T18:17:06.593 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.593 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.593 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.593 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.593 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.593 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.593 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.593 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.593 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.594 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.594 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.594 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.594 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.594 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.594 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.594 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.574+0000 7f543e7fc640 10 monclient: _finish_auth 0 2026-02-12T18:17:06.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.574+0000 7f543e7fc640 10 monclient: _check_auth_tickets 2026-02-12T18:17:06.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.574+0000 7f543e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:06.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.574+0000 7f543e7fc640 1 -- 10.20.193.48:0/2574949110 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f544000cda0 con 0x7f54500951a0 2026-02-12T18:17:06.594 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.574+0000 7f543e7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:06.595 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.574+0000 7f543e7fc640 1 -- 10.20.193.48:0/2574949110 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f54400138d0 con 0x7f54500951a0 2026-02-12T18:17:06.595 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.574+0000 7f543e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.595 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.574+0000 7f543e7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:17:06.595 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.574+0000 7f543ffff640 4 set_mon_vals no callback set 2026-02-12T18:17:06.595 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.574+0000 7f543e7fc640 10 monclient: dump: 2026-02-12T18:17:06.595 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.595 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.595 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.595 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.595 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.595 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.595 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.595 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.596 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.596 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.596 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.596 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.596 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.596 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.596 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.596 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.574+0000 7f545825b640 5 monclient: authenticate success, global_id 114117 2026-02-12T18:17:06.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.574+0000 7f545825b640 10 monclient: _renew_subs 2026-02-12T18:17:06.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.574+0000 7f545825b640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:17:06.596 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.574+0000 7f545825b640 1 -- 10.20.193.48:0/2574949110 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f545019a4e0 con 0x7f54500951a0 2026-02-12T18:17:06.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.574+0000 7f545825b640 10 monclient: _renew_subs 2026-02-12T18:17:06.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.574+0000 7f545825b640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:17:06.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.574+0000 7f545825b640 1 -- 10.20.193.48:0/2574949110 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f54501d8120 con 0x7f54500951a0 2026-02-12T18:17:06.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.575+0000 7f545825b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:06.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.575+0000 7f545825b640 1 --2- 10.20.193.48:0/2574949110 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f54501db140 0x7f54501db510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.575+0000 7f545825b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.575+0000 7f545825b640 1 -- 10.20.193.48:0/2574949110 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f54501d8370 con 0x7f54501db140 2026-02-12T18:17:06.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.575+0000 7f54557cf640 1 --2- 10.20.193.48:0/2574949110 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f54501db140 0x7f54501db510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.575+0000 7f54557cf640 10 monclient: get_auth_request con 0x7f54501db140 auth_method 0 2026-02-12T18:17:06.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.575+0000 7f54557cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.575+0000 7f54557cf640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.575+0000 7f54557cf640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.575+0000 7f54557cf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:06.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.575+0000 7f54557cf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:06.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.575+0000 7f54557cf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:06.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.575+0000 7f543e7fc640 1 -- 10.20.193.48:0/2574949110 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f5440013410 con 0x7f54500951a0 2026-02-12T18:17:06.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.575+0000 7f54557cf640 10 monclient(hunting): handle_auth_done global_id 7011 payload 824 2026-02-12T18:17:06.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.575+0000 7f54557cf640 1 -- 10.20.193.48:0/2574949110 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f545019c2f0 con 0x7f54501db140 2026-02-12T18:17:06.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.575+0000 7f543e7fc640 1 --2- 10.20.193.48:0/2574949110 >> v2:10.20.193.111:6812/977811348 conn(0x7f542003f800 0x7f542005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.575+0000 7f543e7fc640 1 -- 10.20.193.48:0/2574949110 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7f5440052ae0 con 0x7f54500951a0 2026-02-12T18:17:06.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.575+0000 7f54567d1640 1 --2- 10.20.193.48:0/2574949110 >> v2:10.20.193.111:6812/977811348 conn(0x7f542003f800 0x7f542005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.575+0000 7f54567d1640 10 monclient: get_auth_request con 0x7f542003f800 auth_method 0 2026-02-12T18:17:06.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.577+0000 7f54557cf640 1 -- 10.20.193.48:0/2574949110 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f54501db140 msgr2=0x7f54501db510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:06.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.577+0000 7f54557cf640 1 --2- 10.20.193.48:0/2574949110 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f54501db140 0x7f54501db510 secure :-1 s=READY pgs=712 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54440098d0 tx=0x7f5444004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:06.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.577+0000 7f543e7fc640 1 -- 10.20.193.48:0/2574949110 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f54440044f0 con 0x7f54501db140 2026-02-12T18:17:06.601 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.577+0000 7f543e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.602 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.577+0000 7f543e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:17:06.602 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.577+0000 7f543e7fc640 10 monclient: dump: 2026-02-12T18:17:06.602 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.602 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.602 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.602 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.602 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.602 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.602 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.602 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.602 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.602 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.602 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.603 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.603 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.603 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.603 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.603 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.578+0000 7f543e7fc640 1 -- 10.20.193.48:0/2574949110 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f5444004030 con 0x7f54501db140 2026-02-12T18:17:06.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.578+0000 7f543e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:06.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.578+0000 7f543e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:17:06.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.578+0000 7f543e7fc640 1 -- 10.20.193.48:0/2574949110 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f54501db140 msgr2=0x7f54501db510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.578+0000 7f543e7fc640 1 --2- 10.20.193.48:0/2574949110 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f54501db140 0x7f54501db510 secure :-1 s=READY pgs=712 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54440098d0 tx=0x7f5444004770 comp rx=0 tx=0).stop 2026-02-12T18:17:06.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.578+0000 7f543e7fc640 1 -- 10.20.193.48:0/2574949110 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f54501db140 msgr2=0x7f54501db510 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:17:06.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.578+0000 7f543e7fc640 1 --2- 10.20.193.48:0/2574949110 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f54501db140 0x7f54501db510 secure :-1 s=CLOSED pgs=712 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54440098d0 tx=0x7f5444004770 comp rx=0 tx=0).stop 2026-02-12T18:17:06.603 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.578+0000 7f54567d1640 1 --2- 10.20.193.48:0/2574949110 >> v2:10.20.193.111:6812/977811348 conn(0x7f542003f800 0x7f542005fcb0 secure :-1 s=READY pgs=472 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f544c008fd0 tx=0x7f544c008f20 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:06.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.581+0000 7f545825b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:17:06.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.581+0000 7f545825b640 1 --2- 10.20.193.48:0/2574949110 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f54501dba50 0x7f5450194640 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.581+0000 7f545825b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.581+0000 7f545825b640 1 -- 10.20.193.48:0/2574949110 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f545005f140 con 0x7f54501dba50 2026-02-12T18:17:06.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.581+0000 7f54557cf640 1 --2- 10.20.193.48:0/2574949110 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f54501dba50 0x7f5450194640 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.581+0000 7f54557cf640 10 monclient: get_auth_request con 0x7f54501dba50 auth_method 0 2026-02-12T18:17:06.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.581+0000 7f54557cf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.581+0000 7f54557cf640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.581+0000 7f54557cf640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.581+0000 7f54557cf640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:06.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.581+0000 7f54557cf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:06.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.581+0000 7f54557cf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:06.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.581+0000 7f54557cf640 10 monclient(hunting): handle_auth_done global_id 7020 payload 824 2026-02-12T18:17:06.604 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.581+0000 7f54557cf640 1 -- 10.20.193.48:0/2574949110 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5450095f20 con 0x7f54501dba50 2026-02-12T18:17:06.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.584+0000 7f54557cf640 1 -- 10.20.193.48:0/2574949110 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f54501dba50 msgr2=0x7f5450194640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:06.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.584+0000 7f54557cf640 1 --2- 10.20.193.48:0/2574949110 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f54501dba50 0x7f5450194640 secure :-1 s=READY pgs=713 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54440098d0 tx=0x7f5444008030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:06.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.584+0000 7f543e7fc640 1 -- 10.20.193.48:0/2574949110 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f5444004650 con 0x7f54501dba50 2026-02-12T18:17:06.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.584+0000 7f543e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.584+0000 7f543e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:17:06.605 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.584+0000 7f543e7fc640 10 monclient: dump: 2026-02-12T18:17:06.605 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.605 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.605 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.605 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.605 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.605 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.605 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.605 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.606 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.606 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.606 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.606 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.606 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.606 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.606 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.606 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.584+0000 7f543e7fc640 1 -- 10.20.193.48:0/2574949110 <== mon.0 v2:10.20.193.48:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10184 (secure 0 0 0) 0x7f5444003af0 con 0x7f54501dba50 2026-02-12T18:17:06.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.584+0000 7f543e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:17:06.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.584+0000 7f543e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:17:06.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.584+0000 7f543e7fc640 1 -- 10.20.193.48:0/2574949110 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f54501dba50 msgr2=0x7f5450194640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.584+0000 7f543e7fc640 1 --2- 10.20.193.48:0/2574949110 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f54501dba50 0x7f5450194640 secure :-1 s=READY pgs=713 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54440098d0 tx=0x7f5444008030 comp rx=0 tx=0).stop 2026-02-12T18:17:06.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.584+0000 7f543e7fc640 1 -- 10.20.193.48:0/2574949110 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f54501dba50 msgr2=0x7f5450194640 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:17:06.607 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.584+0000 7f543e7fc640 1 --2- 10.20.193.48:0/2574949110 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f54501dba50 0x7f5450194640 secure :-1 s=CLOSED pgs=713 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f54440098d0 tx=0x7f5444008030 comp rx=0 tx=0).stop 2026-02-12T18:17:06.607 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:17:06.607 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:17:06.607 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:17:06.607 INFO:teuthology.orchestra.run.trial048.stdout: "state": "leader", 2026-02-12T18:17:06.607 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 92, 2026-02-12T18:17:06.607 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 681418, 2026-02-12T18:17:06.607 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:17:06.607 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:17:06.608 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:17:06.608 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:17:06.608 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:17:06.608 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:17:06.608 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:17:06.608 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:17:06.608 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:17:06.608 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:17:06.608 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:06.608 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:17:06.608 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:17:06.608 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:17:06.608 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:17:06.608 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:06.609 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:06.609 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:06.609 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:06.609 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:06.609 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:06.609 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:06.609 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:06.609 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:06.609 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:06.609 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:06.609 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:06.609 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:06.609 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:06.609 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:17:06.609 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:17:06.609 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:06.609 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:06.610 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:06.610 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:06.610 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:06.610 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:06.610 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:06.610 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:06.610 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:06.610 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:06.610 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:06.610 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:06.610 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:06.610 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.610 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.610 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:17:06.610 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:17:06.610 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:17:06.610 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:17:06.611 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:17:06.611 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:17:06.611 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:17:06.611 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:17:06.611 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:17:06.611 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:17:06.611 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:17:06.611 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:17:06.611 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:17:06.611 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:17:06.611 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:17:06.611 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:17:06.611 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:17:06.611 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:06.611 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:06.611 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:06.612 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:06.612 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:06.612 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:06.612 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:06.612 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:06.612 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:06.612 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:06.612 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:06.612 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:06.612 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:06.612 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:06.612 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:17:06.612 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.612 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:17:06.612 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.612 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:17:06.612 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:17:06.612 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.613 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.613 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.613 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.613 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:17:06.613 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.613 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.613 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.613 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.613 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:17:06.613 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.613 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.613 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.613 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.613 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:17:06.613 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:17:06.613 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.613 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.613 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:17:06.614 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.614 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.614 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.614 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:17:06.614 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:17:06.614 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.614 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.614 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.614 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.614 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:17:06.614 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.614 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.614 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.614 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.614 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:17:06.614 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.614 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.614 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.614 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.615 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:17:06.615 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:17:06.615 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.615 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.615 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:17:06.615 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.615 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.615 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.615 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:17:06.615 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:17:06.615 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.615 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.615 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.615 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.615 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:17:06.615 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.615 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.615 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.615 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.616 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:17:06.616 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.616 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.616 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.616 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.616 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:17:06.616 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:17:06.616 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.616 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.616 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:17:06.616 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.616 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.616 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.616 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:17:06.616 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:17:06.616 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.616 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.616 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.616 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.617 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:17:06.617 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.617 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.617 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.617 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.617 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:17:06.617 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.617 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.617 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.617 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.617 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:17:06.617 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:17:06.617 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.617 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.617 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:17:06.617 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.617 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.617 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.617 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:17:06.617 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:17:06.617 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.618 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.618 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.618 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.618 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:17:06.618 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.618 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.618 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.618 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.618 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:17:06.618 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.618 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.618 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.618 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.618 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:17:06.618 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:17:06.618 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.618 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.618 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:17:06.618 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.618 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.619 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.619 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:17:06.619 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:17:06.619 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.619 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.619 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.619 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.619 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:17:06.619 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.619 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.619 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.619 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.619 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:17:06.619 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.619 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.619 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.619 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.619 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:17:06.619 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:17:06.619 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.620 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.620 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:17:06.620 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.620 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.620 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.620 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:17:06.620 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:17:06.620 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.620 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.620 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.620 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.620 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:17:06.620 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.620 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.620 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.620 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.620 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:17:06.620 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.620 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.620 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.620 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.621 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:17:06.621 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:17:06.621 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.621 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.621 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:17:06.621 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.621 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.621 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.621 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:17:06.621 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:17:06.621 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.621 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.621 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.621 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.621 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:17:06.621 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.621 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.621 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.621 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.621 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:17:06.621 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.622 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.622 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.622 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.622 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:17:06.622 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:17:06.622 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.622 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.622 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:17:06.622 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.622 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.622 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.622 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:17:06.622 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:17:06.622 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.622 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.622 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.622 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.622 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:17:06.622 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.622 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.622 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.622 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.622 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:17:06.623 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.623 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.623 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.623 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.623 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:17:06.623 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:17:06.623 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.623 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.623 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:17:06.623 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.623 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.623 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.623 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.623 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:17:06.623 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:17:06.623 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.623 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:17:06.623 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:17:06.623 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:17:06.623 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.623 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:06.623 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:17:06.623 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.623 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:17:06.624 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:17:06.624 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:17:06.624 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.624 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:06.624 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:17:06.624 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.624 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:17:06.624 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:17:06.624 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:17:06.624 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.624 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.624 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.624 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:17:06.624 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:17:06.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.584+0000 7f545825b640 1 -- 10.20.193.48:0/2574949110 >> v2:10.20.193.111:6812/977811348 conn(0x7f542003f800 msgr2=0x7f542005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.584+0000 7f545825b640 1 --2- 10.20.193.48:0/2574949110 >> v2:10.20.193.111:6812/977811348 conn(0x7f542003f800 0x7f542005fcb0 secure :-1 s=READY pgs=472 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f544c008fd0 tx=0x7f544c008f20 comp rx=0 tx=0).stop 2026-02-12T18:17:06.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.584+0000 7f545825b640 10 monclient: shutdown 2026-02-12T18:17:06.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.584+0000 7f545825b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:06.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.584+0000 7f545825b640 1 -- 10.20.193.48:0/2574949110 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f54500951a0 msgr2=0x7f54501d7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.584+0000 7f545825b640 1 --2- 10.20.193.48:0/2574949110 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f54500951a0 0x7f54501d7be0 secure :-1 s=READY pgs=21 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f5440006f30 tx=0x7f544000ebd0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.584+0000 7f54567d1640 1 -- 10.20.193.48:0/2574949110 reap_dead start 2026-02-12T18:17:06.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.584+0000 7f54567d1640 1 -- 10.20.193.48:0/2574949110 reap_dead start 2026-02-12T18:17:06.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.584+0000 7f545825b640 1 -- 10.20.193.48:0/2574949110 shutdown_connections 2026-02-12T18:17:06.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.584+0000 7f545825b640 1 -- 10.20.193.48:0/2574949110 >> 10.20.193.48:0/2574949110 conn(0x7f54500548c0 msgr2=0x7f545008d880 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:06.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.584+0000 7f545825b640 1 -- 10.20.193.48:0/2574949110 shutdown_connections 2026-02-12T18:17:06.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.584+0000 7f545825b640 1 -- 10.20.193.48:0/2574949110 wait complete. 2026-02-12T18:17:06.626 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:17:06.626 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2026-02-12T18:17:06.626 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2026-02-12T18:17:06.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.689+0000 7f88b330c640 10 monclient: get_monmap_and_config 2026-02-12T18:17:06.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.689+0000 7f88b330c640 10 monclient: build_initial_monmap 2026-02-12T18:17:06.690 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.689+0000 7f88b330c640 10 monclient: monmap: 2026-02-12T18:17:06.690 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:06.690 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.690 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:06.690226+0000 2026-02-12T18:17:06.690 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:06.690226+0000 2026-02-12T18:17:06.690 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:06.691 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.691 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:06.691 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:06.691 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:06.691 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:06.691 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:06.691 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:06.691 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:06.691 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:06.691 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:06.691 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:06.691 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:06.691 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.689+0000 7f88b330c640 1 Processor -- start 2026-02-12T18:17:06.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.689+0000 7f88b330c640 1 -- start start 2026-02-12T18:17:06.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.689+0000 7f88b330c640 10 monclient: init 2026-02-12T18:17:06.693 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.689+0000 7f88b330c640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:06.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.689+0000 7f88b330c640 10 monclient: _add_conns ranks=[8,5,10,9,6,4,2,1,0,7,3] 2026-02-12T18:17:06.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.689+0000 7f88b330c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f88ac0914d0 0x7f88ac05c950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.689+0000 7f88b330c640 10 monclient(hunting): picked mon.noname-e con 0x7f88ac0914d0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:17:06.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.689+0000 7f88b330c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f88ac08e210 0x7f88ac05ce90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.689+0000 7f88b330c640 10 monclient(hunting): picked mon.noname-h con 0x7f88ac08e210 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:17:06.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.689+0000 7f88b330c640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f88ac05e4b0 0x7f88ac05d3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.689+0000 7f88b330c640 10 monclient(hunting): picked mon.noname-f con 0x7f88ac05e4b0 addr v2:10.20.193.111:3300/0 2026-02-12T18:17:06.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.689+0000 7f88b330c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.689+0000 7f88b330c640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f88ac093d70 con 0x7f88ac05e4b0 2026-02-12T18:17:06.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.689+0000 7f88b330c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.689+0000 7f88b330c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f88ac092f90 con 0x7f88ac08e210 2026-02-12T18:17:06.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.689+0000 7f88b330c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.689+0000 7f88b330c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f88ac0918a0 con 0x7f88ac0914d0 2026-02-12T18:17:06.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.689+0000 7f88b330c640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:06.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.689+0000 7f88b330c640 10 monclient(hunting): authenticate will time out at 1265.415912s 2026-02-12T18:17:06.694 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1081640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f88ac0914d0 0x7f88ac05c950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1081640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f88ac0914d0 0x7f88ac05c950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:33646/0 (socket says 10.20.193.48:33646) 2026-02-12T18:17:06.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1081640 1 -- 10.20.193.48:0/4091376213 learned_addr learned my addr 10.20.193.48:0/4091376213 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:06.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1081640 10 monclient(hunting): get_auth_request con 0x7f88ac0914d0 auth_method 0 2026-02-12T18:17:06.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1081640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1081640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1081640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1882640 1 --2- 10.20.193.48:0/4091376213 >> v2:10.20.193.111:3300/0 conn(0x7f88ac05e4b0 0x7f88ac05d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b0880640 1 --2- 10.20.193.48:0/4091376213 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f88ac08e210 0x7f88ac05ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1882640 10 monclient(hunting): get_auth_request con 0x7f88ac05e4b0 auth_method 0 2026-02-12T18:17:06.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1882640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1882640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1882640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1081640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:06.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1081640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:06.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1081640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:06.695 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b0880640 10 monclient(hunting): get_auth_request con 0x7f88ac08e210 auth_method 0 2026-02-12T18:17:06.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b0880640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b0880640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b0880640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1882640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:06.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1882640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:06.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1882640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:06.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1081640 10 monclient(hunting): handle_auth_done global_id 94922 payload 274 2026-02-12T18:17:06.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1081640 1 -- 10.20.193.48:0/4091376213 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f88ac08e210 msgr2=0x7f88ac05ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:06.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1081640 1 --2- 10.20.193.48:0/4091376213 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f88ac08e210 0x7f88ac05ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1081640 1 -- 10.20.193.48:0/4091376213 >> v2:10.20.193.111:3300/0 conn(0x7f88ac05e4b0 msgr2=0x7f88ac05d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:06.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1081640 1 --2- 10.20.193.48:0/4091376213 >> v2:10.20.193.111:3300/0 conn(0x7f88ac05e4b0 0x7f88ac05d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1081640 10 monclient: _finish_hunting 0 2026-02-12T18:17:06.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1081640 1 monclient: found mon.noname-e 2026-02-12T18:17:06.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1081640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:06.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1081640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:17:06.696 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.690+0000 7f88b1081640 1 -- 10.20.193.48:0/4091376213 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ac04dc20 con 0x7f88ac0914d0 2026-02-12T18:17:06.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.692+0000 7f88b1081640 1 -- 10.20.193.48:0/4091376213 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f88ac0914d0 msgr2=0x7f88ac05c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:06.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.692+0000 7f88b1081640 1 --2- 10.20.193.48:0/4091376213 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f88ac0914d0 0x7f88ac05c950 secure :-1 s=READY pgs=184 gs=1 cs=0 l=1 c_cookie=1841463674719012528 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f889c009060 tx=0x7f889c02edf0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=198e3174a66986b0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:06.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f889bfff640 1 -- 10.20.193.48:0/4091376213 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f889c035340 con 0x7f88ac0914d0 2026-02-12T18:17:06.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f889bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f889bfff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:17:06.702 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f889bfff640 10 monclient: dump: 2026-02-12T18:17:06.702 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.702 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.702 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.702 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.702 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.702 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.702 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.703 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.703 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.703 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.703 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.703 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.703 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.703 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.703 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.703 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f889bfff640 10 monclient: _finish_auth 0 2026-02-12T18:17:06.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f889bfff640 10 monclient: _check_auth_tickets 2026-02-12T18:17:06.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f889bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:06.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f889bfff640 1 -- 10.20.193.48:0/4091376213 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f889c0354c0 con 0x7f88ac0914d0 2026-02-12T18:17:06.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f88b330c640 5 monclient: authenticate success, global_id 94922 2026-02-12T18:17:06.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f88b330c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:17:06.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f889bfff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:06.703 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f88b330c640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:06.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f88b330c640 4 set_mon_vals no callback set 2026-02-12T18:17:06.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f889bfff640 1 -- 10.20.193.48:0/4091376213 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f889c035630 con 0x7f88ac0914d0 2026-02-12T18:17:06.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f889bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f889bfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:17:06.704 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f889bfff640 10 monclient: dump: 2026-02-12T18:17:06.704 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.704 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.704 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.704 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.704 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.704 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.704 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.704 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.704 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.704 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.704 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.704 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.705 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.705 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.705 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.705 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f88b330c640 10 monclient: shutdown 2026-02-12T18:17:06.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f88b330c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:06.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f88b330c640 1 -- 10.20.193.48:0/4091376213 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f88ac0914d0 msgr2=0x7f88ac05c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f88b330c640 1 --2- 10.20.193.48:0/4091376213 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f88ac0914d0 0x7f88ac05c950 secure :-1 s=READY pgs=184 gs=1 cs=0 l=1 c_cookie=1841463674719012528 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f889c009060 tx=0x7f889c02edf0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f88b330c640 1 -- 10.20.193.48:0/4091376213 shutdown_connections 2026-02-12T18:17:06.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f88b330c640 1 --2- 10.20.193.48:0/4091376213 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f88ac08e210 0x7f88ac05ce90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f88b330c640 1 --2- 10.20.193.48:0/4091376213 >> v2:10.20.193.111:3300/0 conn(0x7f88ac05e4b0 0x7f88ac05d3d0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f88b330c640 1 --2- 10.20.193.48:0/4091376213 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f88ac0914d0 0x7f88ac05c950 unknown :-1 s=CLOSED pgs=184 gs=1 cs=0 l=1 c_cookie=1841463674719012528 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f88b330c640 1 -- 10.20.193.48:0/4091376213 >> 10.20.193.48:0/4091376213 conn(0x7f88ac0548a0 msgr2=0x7f88ac097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:06.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f88b330c640 1 -- 10.20.193.48:0/4091376213 shutdown_connections 2026-02-12T18:17:06.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f88b330c640 1 -- 10.20.193.48:0/4091376213 wait complete. 2026-02-12T18:17:06.705 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f88b330c640 10 monclient: build_initial_monmap 2026-02-12T18:17:06.706 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.693+0000 7f88b330c640 10 monclient: monmap: 2026-02-12T18:17:06.706 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:06.706 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:06.706 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:06.706 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:06.706 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:06.706 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.706 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:06.706 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:06.706 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:06.706 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:06.706 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:06.706 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:06.706 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:06.706 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:06.706 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:06.706 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b330c640 1 Processor -- start 2026-02-12T18:17:06.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b330c640 1 -- start start 2026-02-12T18:17:06.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b330c640 10 monclient: init 2026-02-12T18:17:06.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b330c640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:06.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b330c640 10 monclient: _add_conns ranks=[1,3,8,5,2,7,0,4,6] 2026-02-12T18:17:06.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b330c640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f88ac05e4b0 0x7f88ac1daf20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b330c640 10 monclient(hunting): picked mon.noname-f con 0x7f88ac05e4b0 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:17:06.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b330c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f88ac08e210 0x7f88ac1b0c00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b330c640 10 monclient(hunting): picked mon.noname-g con 0x7f88ac08e210 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:17:06.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b330c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f88ac0914d0 0x7f88ac198910 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b330c640 10 monclient(hunting): picked mon.noname-e con 0x7f88ac0914d0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:17:06.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b330c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b330c640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac094450 con 0x7f88ac05e4b0 2026-02-12T18:17:06.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b330c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b330c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f88ac19bd90 con 0x7f88ac08e210 2026-02-12T18:17:06.707 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b330c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b330c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f88ac19c5a0 con 0x7f88ac0914d0 2026-02-12T18:17:06.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b330c640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:06.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b330c640 10 monclient(hunting): authenticate will time out at 1265.420358s 2026-02-12T18:17:06.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b1882640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f88ac0914d0 0x7f88ac198910 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b1882640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f88ac0914d0 0x7f88ac198910 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:33648/0 (socket says 10.20.193.48:33648) 2026-02-12T18:17:06.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b1882640 1 -- 10.20.193.48:0/3484375133 learned_addr learned my addr 10.20.193.48:0/3484375133 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:06.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b1882640 10 monclient(hunting): get_auth_request con 0x7f88ac0914d0 auth_method 0 2026-02-12T18:17:06.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b1882640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b1882640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b1882640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b1882640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:06.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b1882640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:06.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b1882640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:06.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b0880640 1 --2- 10.20.193.48:0/3484375133 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f88ac08e210 0x7f88ac1b0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b1081640 1 --2- 10.20.193.48:0/3484375133 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f88ac05e4b0 0x7f88ac1daf20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b0880640 10 monclient(hunting): get_auth_request con 0x7f88ac08e210 auth_method 0 2026-02-12T18:17:06.708 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b0880640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b0880640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b0880640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b1081640 10 monclient(hunting): get_auth_request con 0x7f88ac05e4b0 auth_method 0 2026-02-12T18:17:06.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b1081640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b1081640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b1081640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b1882640 10 monclient(hunting): handle_auth_done global_id 94931 payload 824 2026-02-12T18:17:06.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b1882640 1 -- 10.20.193.48:0/3484375133 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f88ac08e210 msgr2=0x7f88ac1b0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b1882640 1 --2- 10.20.193.48:0/3484375133 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f88ac08e210 0x7f88ac1b0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b1882640 1 -- 10.20.193.48:0/3484375133 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f88ac05e4b0 msgr2=0x7f88ac1daf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b1882640 1 --2- 10.20.193.48:0/3484375133 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f88ac05e4b0 0x7f88ac1daf20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b1882640 10 monclient: _finish_hunting 0 2026-02-12T18:17:06.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b1882640 1 monclient: found mon.noname-e 2026-02-12T18:17:06.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b1882640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:06.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b1882640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:17:06.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.694+0000 7f88b1882640 1 -- 10.20.193.48:0/3484375133 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f889c0094f0 con 0x7f88ac0914d0 2026-02-12T18:17:06.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.696+0000 7f88b1882640 1 -- 10.20.193.48:0/3484375133 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f88ac0914d0 msgr2=0x7f88ac198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:06.709 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.696+0000 7f88b1882640 1 --2- 10.20.193.48:0/3484375133 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f88ac0914d0 0x7f88ac198910 secure :-1 s=READY pgs=185 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88a800f900 tx=0x7f88a800fdd0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:06.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f8899ffb640 1 -- 10.20.193.48:0/3484375133 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f88a800dbb0 con 0x7f88ac0914d0 2026-02-12T18:17:06.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f8899ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f8899ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:17:06.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f8899ffb640 10 monclient: dump: 2026-02-12T18:17:06.710 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.710 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.710 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.710 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.710 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.710 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.710 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.710 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.710 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.710 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.710 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.710 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.710 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.711 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.711 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.711 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f8899ffb640 10 monclient: _finish_auth 0 2026-02-12T18:17:06.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f8899ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:17:06.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f8899ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:06.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f88b330c640 5 monclient: authenticate success, global_id 94931 2026-02-12T18:17:06.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f8899ffb640 1 -- 10.20.193.48:0/3484375133 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88a800dd30 con 0x7f88ac0914d0 2026-02-12T18:17:06.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f8899ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:06.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f8899ffb640 1 -- 10.20.193.48:0/3484375133 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f88a800dea0 con 0x7f88ac0914d0 2026-02-12T18:17:06.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f88b330c640 10 monclient: _renew_subs 2026-02-12T18:17:06.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f88b330c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:17:06.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f88b330c640 1 -- 10.20.193.48:0/3484375133 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88ac19b3d0 con 0x7f88ac0914d0 2026-02-12T18:17:06.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f889b7fe640 4 set_mon_vals no callback set 2026-02-12T18:17:06.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f8899ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f8899ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:17:06.711 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f8899ffb640 10 monclient: dump: 2026-02-12T18:17:06.712 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.712 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.712 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.712 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.712 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.712 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.712 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.712 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.712 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.712 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.712 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.712 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.712 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.712 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.712 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.712 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f88b330c640 10 monclient: _renew_subs 2026-02-12T18:17:06.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f88b330c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:17:06.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f88b330c640 1 -- 10.20.193.48:0/3484375133 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f88ac19c2c0 con 0x7f88ac0914d0 2026-02-12T18:17:06.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f88b330c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:06.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f88b330c640 1 --2- 10.20.193.48:0/3484375133 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f88ac19ae00 0x7f88ac198e50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f88b330c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f88b330c640 1 -- 10.20.193.48:0/3484375133 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f88ac05f140 con 0x7f88ac19ae00 2026-02-12T18:17:06.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f88b1081640 1 --2- 10.20.193.48:0/3484375133 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f88ac19ae00 0x7f88ac198e50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f88b1081640 10 monclient: get_auth_request con 0x7f88ac19ae00 auth_method 0 2026-02-12T18:17:06.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f88b1081640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f88b1081640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f88b1081640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f88b1081640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:06.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f88b1081640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:06.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.697+0000 7f88b1081640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:06.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.698+0000 7f8899ffb640 1 -- 10.20.193.48:0/3484375133 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f88a8012070 con 0x7f88ac0914d0 2026-02-12T18:17:06.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.698+0000 7f88b1081640 10 monclient(hunting): handle_auth_done global_id 36650 payload 824 2026-02-12T18:17:06.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.698+0000 7f88b1081640 1 -- 10.20.193.48:0/3484375133 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f88ac0929d0 con 0x7f88ac19ae00 2026-02-12T18:17:06.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.698+0000 7f8899ffb640 1 --2- 10.20.193.48:0/3484375133 >> v2:10.20.193.111:6812/977811348 conn(0x7f887c03f800 0x7f887c05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.698+0000 7f8899ffb640 1 -- 10.20.193.48:0/3484375133 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7f88a80540e0 con 0x7f88ac0914d0 2026-02-12T18:17:06.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.698+0000 7f88b0880640 1 --2- 10.20.193.48:0/3484375133 >> v2:10.20.193.111:6812/977811348 conn(0x7f887c03f800 0x7f887c05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.698+0000 7f88b0880640 10 monclient: get_auth_request con 0x7f887c03f800 auth_method 0 2026-02-12T18:17:06.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.700+0000 7f88b1081640 1 -- 10.20.193.48:0/3484375133 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f88ac19ae00 msgr2=0x7f88ac198e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:06.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.700+0000 7f88b1081640 1 --2- 10.20.193.48:0/3484375133 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f88ac19ae00 0x7f88ac198e50 secure :-1 s=READY pgs=466 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f889c009060 tx=0x7f889c004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:06.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.700+0000 7f8899ffb640 1 -- 10.20.193.48:0/3484375133 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f889c035bf0 con 0x7f88ac19ae00 2026-02-12T18:17:06.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.700+0000 7f8899ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.700+0000 7f8899ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:17:06.714 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.700+0000 7f8899ffb640 10 monclient: dump: 2026-02-12T18:17:06.714 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.714 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.714 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.714 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.714 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.714 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.714 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.715 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.715 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.715 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.715 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.715 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.715 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.715 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.715 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.715 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.700+0000 7f8899ffb640 1 -- 10.20.193.48:0/3484375133 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f889c035d50 con 0x7f88ac19ae00 2026-02-12T18:17:06.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.700+0000 7f8899ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:06.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.700+0000 7f8899ffb640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:17:06.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.700+0000 7f8899ffb640 1 -- 10.20.193.48:0/3484375133 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f88ac19ae00 msgr2=0x7f88ac198e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.700+0000 7f8899ffb640 1 --2- 10.20.193.48:0/3484375133 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f88ac19ae00 0x7f88ac198e50 secure :-1 s=READY pgs=466 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f889c009060 tx=0x7f889c004770 comp rx=0 tx=0).stop 2026-02-12T18:17:06.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.700+0000 7f8899ffb640 1 -- 10.20.193.48:0/3484375133 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f88ac19ae00 msgr2=0x7f88ac198e50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:17:06.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.700+0000 7f8899ffb640 1 --2- 10.20.193.48:0/3484375133 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f88ac19ae00 0x7f88ac198e50 secure :-1 s=CLOSED pgs=466 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f889c009060 tx=0x7f889c004770 comp rx=0 tx=0).stop 2026-02-12T18:17:06.715 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.700+0000 7f88b0880640 1 --2- 10.20.193.48:0/3484375133 >> v2:10.20.193.111:6812/977811348 conn(0x7f887c03f800 0x7f887c05fcb0 secure :-1 s=READY pgs=473 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88ac19ad30 tx=0x7f88a0008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:06.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.704+0000 7f88b330c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:17:06.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.704+0000 7f88b330c640 1 --2- 10.20.193.48:0/3484375133 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f88ac1b1140 0x7f88ac199390 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.704+0000 7f88b330c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.704+0000 7f88b330c640 1 -- 10.20.193.48:0/3484375133 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f88ac05fd90 con 0x7f88ac1b1140 2026-02-12T18:17:06.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.704+0000 7f88b1081640 1 --2- 10.20.193.48:0/3484375133 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f88ac1b1140 0x7f88ac199390 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.704+0000 7f88b1081640 10 monclient: get_auth_request con 0x7f88ac1b1140 auth_method 0 2026-02-12T18:17:06.717 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.704+0000 7f88b1081640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.704+0000 7f88b1081640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.704+0000 7f88b1081640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.704+0000 7f88b1081640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:06.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.704+0000 7f88b1081640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:06.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.704+0000 7f88b1081640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:06.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.704+0000 7f88b1081640 10 monclient(hunting): handle_auth_done global_id 36659 payload 824 2026-02-12T18:17:06.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.704+0000 7f88b1081640 1 -- 10.20.193.48:0/3484375133 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f88ac05de10 con 0x7f88ac1b1140 2026-02-12T18:17:06.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.706+0000 7f88b1081640 1 -- 10.20.193.48:0/3484375133 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f88ac1b1140 msgr2=0x7f88ac199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:06.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.706+0000 7f88b1081640 1 --2- 10.20.193.48:0/3484375133 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f88ac1b1140 0x7f88ac199390 secure :-1 s=READY pgs=467 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f889c009820 tx=0x7f889c008030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:06.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.706+0000 7f8899ffb640 1 -- 10.20.193.48:0/3484375133 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f889c051070 con 0x7f88ac1b1140 2026-02-12T18:17:06.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.706+0000 7f8899ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.706+0000 7f8899ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:17:06.718 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.706+0000 7f8899ffb640 10 monclient: dump: 2026-02-12T18:17:06.718 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.718 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.719 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.719 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.719 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.719 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.719 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.719 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.719 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.719 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.719 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.719 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.719 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.719 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.719 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.719 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.707+0000 7f8899ffb640 1 -- 10.20.193.48:0/3484375133 <== mon.2 v2:10.20.193.48:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10349 (secure 0 0 0) 0x7f889c003e50 con 0x7f88ac1b1140 2026-02-12T18:17:06.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.707+0000 7f8899ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:17:06.719 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.707+0000 7f8899ffb640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:17:06.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.707+0000 7f8899ffb640 1 -- 10.20.193.48:0/3484375133 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f88ac1b1140 msgr2=0x7f88ac199390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.707+0000 7f8899ffb640 1 --2- 10.20.193.48:0/3484375133 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f88ac1b1140 0x7f88ac199390 secure :-1 s=READY pgs=467 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f889c009820 tx=0x7f889c008030 comp rx=0 tx=0).stop 2026-02-12T18:17:06.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.707+0000 7f8899ffb640 1 -- 10.20.193.48:0/3484375133 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f88ac1b1140 msgr2=0x7f88ac199390 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:17:06.720 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.707+0000 7f8899ffb640 1 --2- 10.20.193.48:0/3484375133 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f88ac1b1140 0x7f88ac199390 secure :-1 s=CLOSED pgs=467 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f889c009820 tx=0x7f889c008030 comp rx=0 tx=0).stop 2026-02-12T18:17:06.720 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:17:06.720 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:17:06.720 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:17:06.720 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:17:06.720 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 92, 2026-02-12T18:17:06.720 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 681539, 2026-02-12T18:17:06.720 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:17:06.720 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:17:06.721 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:17:06.721 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:17:06.721 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:17:06.721 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:17:06.721 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:17:06.721 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:17:06.721 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:17:06.721 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:17:06.721 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:06.721 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:17:06.721 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:17:06.721 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:17:06.721 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:17:06.721 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:06.721 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:06.721 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:06.721 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:06.721 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:06.722 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:06.722 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:06.722 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:06.722 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:06.722 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:06.722 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:06.722 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:06.722 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:06.722 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:06.722 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:17:06.722 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:17:06.722 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:06.722 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:06.722 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:06.722 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:06.722 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:06.722 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:06.722 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:06.722 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:06.723 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:06.723 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:06.723 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:06.723 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:06.723 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:06.723 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.723 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.723 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:17:06.723 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:17:06.723 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:17:06.723 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:17:06.723 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:17:06.723 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:17:06.723 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:17:06.723 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:17:06.723 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:17:06.723 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:17:06.723 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:17:06.724 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:17:06.724 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:17:06.724 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:17:06.724 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:17:06.724 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:17:06.724 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:17:06.724 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:06.724 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:06.724 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:06.724 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:06.724 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:06.724 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:06.724 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:06.724 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:06.724 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:06.724 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:06.724 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:06.724 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:06.724 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:06.725 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:06.725 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:17:06.725 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.725 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:17:06.725 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.725 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:17:06.725 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:17:06.725 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.725 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.725 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.725 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.725 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:17:06.725 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.725 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.725 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.725 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.725 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:17:06.725 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.726 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.726 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.726 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.726 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:17:06.726 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:17:06.726 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.726 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.726 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:17:06.726 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.726 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.726 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.726 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:17:06.726 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:17:06.726 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.726 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.726 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.726 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.726 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:17:06.726 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.726 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.727 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.727 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.727 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:17:06.727 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.727 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.727 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.727 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.727 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:17:06.727 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:17:06.727 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.727 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.727 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:17:06.727 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.727 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.727 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.727 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:17:06.727 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:17:06.727 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.727 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.727 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.728 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.728 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:17:06.728 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.728 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.728 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.728 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.728 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:17:06.728 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.728 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.728 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.728 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.728 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:17:06.728 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:17:06.728 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.728 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.728 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:17:06.728 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.728 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.728 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.728 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:17:06.728 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:17:06.728 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.728 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.729 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.729 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.729 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:17:06.729 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.729 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.729 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.729 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.729 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:17:06.729 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.729 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.729 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.729 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.729 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:17:06.729 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:17:06.729 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.729 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.729 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:17:06.729 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.729 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.729 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.729 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:17:06.729 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:17:06.730 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.730 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.730 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.730 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.730 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:17:06.730 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.730 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.730 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.730 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.730 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:17:06.730 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.730 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.730 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.730 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.730 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:17:06.730 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:17:06.730 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.730 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.730 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:17:06.730 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.730 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.730 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.731 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:17:06.731 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:17:06.731 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.731 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.731 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.731 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.731 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:17:06.731 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.731 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.731 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.731 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.731 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:17:06.731 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.731 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.731 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.731 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.731 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:17:06.731 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:17:06.731 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.731 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.731 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:17:06.731 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.731 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.732 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.732 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:17:06.732 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:17:06.732 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.732 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.732 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.732 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.732 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:17:06.732 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.732 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.732 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.732 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.732 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:17:06.732 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.732 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.732 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.732 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.732 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:17:06.732 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:17:06.732 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.732 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.732 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:17:06.732 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.732 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.733 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.733 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:17:06.733 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:17:06.733 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.733 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.733 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.733 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.733 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:17:06.733 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.733 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.733 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.733 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.733 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:17:06.733 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.733 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.733 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.733 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.733 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:17:06.733 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:17:06.733 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.733 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.733 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:17:06.733 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.733 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.733 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.734 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:17:06.734 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:17:06.734 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.734 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.734 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.734 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.734 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:17:06.734 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.734 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.734 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.734 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.734 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:17:06.734 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.734 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.734 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.734 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.734 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:17:06.734 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:17:06.734 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.734 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.734 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:17:06.734 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.734 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.734 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.734 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.735 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:17:06.735 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:17:06.735 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.735 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:17:06.735 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:17:06.735 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:17:06.735 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.735 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:06.735 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:17:06.735 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.735 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:17:06.735 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:17:06.735 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:17:06.735 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.735 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:06.735 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:17:06.735 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.735 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:17:06.735 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:17:06.735 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:17:06.735 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.735 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:06.735 INFO:teuthology.orchestra.run.trial048.stdout: "mgr": [ 2026-02-12T18:17:06.735 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.735 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:17:06.735 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:17:06.736 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:17:06.736 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.736 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.736 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.736 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:17:06.736 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:17:06.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.707+0000 7f88b330c640 1 -- 10.20.193.48:0/3484375133 >> v2:10.20.193.111:6812/977811348 conn(0x7f887c03f800 msgr2=0x7f887c05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.707+0000 7f88b330c640 1 --2- 10.20.193.48:0/3484375133 >> v2:10.20.193.111:6812/977811348 conn(0x7f887c03f800 0x7f887c05fcb0 secure :-1 s=READY pgs=473 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88ac19ad30 tx=0x7f88a0008040 comp rx=0 tx=0).stop 2026-02-12T18:17:06.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.707+0000 7f88b330c640 10 monclient: shutdown 2026-02-12T18:17:06.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.707+0000 7f88b330c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:06.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.707+0000 7f88b330c640 1 -- 10.20.193.48:0/3484375133 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f88ac0914d0 msgr2=0x7f88ac198910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.707+0000 7f88b330c640 1 --2- 10.20.193.48:0/3484375133 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f88ac0914d0 0x7f88ac198910 secure :-1 s=READY pgs=185 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f88a800f900 tx=0x7f88a800fdd0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.707+0000 7f88b1882640 1 -- 10.20.193.48:0/3484375133 reap_dead start 2026-02-12T18:17:06.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.707+0000 7f88b330c640 1 -- 10.20.193.48:0/3484375133 shutdown_connections 2026-02-12T18:17:06.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.707+0000 7f88b330c640 1 --2- 10.20.193.48:0/3484375133 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f88ac0914d0 0x7f88ac198910 unknown :-1 s=CLOSED pgs=185 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.707+0000 7f88b330c640 1 -- 10.20.193.48:0/3484375133 >> 10.20.193.48:0/3484375133 conn(0x7f88ac0548a0 msgr2=0x7f88ac0900f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:06.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.707+0000 7f88b330c640 1 -- 10.20.193.48:0/3484375133 shutdown_connections 2026-02-12T18:17:06.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.707+0000 7f88b330c640 1 -- 10.20.193.48:0/3484375133 wait complete. 2026-02-12T18:17:06.737 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:17:06.738 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2026-02-12T18:17:06.738 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2026-02-12T18:17:06.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.803+0000 7f19023ae640 10 monclient: get_monmap_and_config 2026-02-12T18:17:06.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.803+0000 7f19023ae640 10 monclient: build_initial_monmap 2026-02-12T18:17:06.804 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.803+0000 7f19023ae640 10 monclient: monmap: 2026-02-12T18:17:06.804 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:06.804 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.804 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:06.804213+0000 2026-02-12T18:17:06.804 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:06.804213+0000 2026-02-12T18:17:06.804 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:06.804 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.804 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:06.804 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:06.804 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:06.804 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:06.804 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:06.805 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:06.805 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:06.805 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:06.805 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:06.805 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:06.805 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:06.805 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.803+0000 7f19023ae640 1 Processor -- start 2026-02-12T18:17:06.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.803+0000 7f19023ae640 1 -- start start 2026-02-12T18:17:06.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.803+0000 7f19023ae640 10 monclient: init 2026-02-12T18:17:06.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.803+0000 7f19023ae640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:06.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.803+0000 7f19023ae640 10 monclient: _add_conns ranks=[3,6,4,9,0,8,5,7,1,10,2] 2026-02-12T18:17:06.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.803+0000 7f19023ae640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f18fc091550 0x7f18fc097d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.803+0000 7f19023ae640 10 monclient(hunting): picked mon.noname-g con 0x7f18fc091550 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:17:06.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.803+0000 7f19023ae640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f18fc05c950 0x7f18fc05cd40 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.803+0000 7f19023ae640 10 monclient(hunting): picked mon.noname-d con 0x7f18fc05c950 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:17:06.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.803+0000 7f19023ae640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc05d280 0x7f18fc1a4c10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.807 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.803+0000 7f19023ae640 10 monclient(hunting): picked mon.noname-c con 0x7f18fc05d280 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:17:06.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.803+0000 7f19023ae640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.803+0000 7f19023ae640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f18fc092e00 con 0x7f18fc091550 2026-02-12T18:17:06.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.803+0000 7f19023ae640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.803+0000 7f19023ae640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f18fc091d10 con 0x7f18fc05d280 2026-02-12T18:17:06.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.803+0000 7f19023ae640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.803+0000 7f19023ae640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f18fc091920 con 0x7f18fc05c950 2026-02-12T18:17:06.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.803+0000 7f19023ae640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:06.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.803+0000 7f19023ae640 10 monclient(hunting): authenticate will time out at 1265.529883s 2026-02-12T18:17:06.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.803+0000 7f18fb7fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f18fc05c950 0x7f18fc05cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f18fb7fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f18fc05c950 0x7f18fc05cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:51736/0 (socket says 10.20.193.48:51736) 2026-02-12T18:17:06.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f18fb7fe640 1 -- 10.20.193.48:0/1495526308 learned_addr learned my addr 10.20.193.48:0/1495526308 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:06.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f18fb7fe640 10 monclient(hunting): get_auth_request con 0x7f18fc05c950 auth_method 0 2026-02-12T18:17:06.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f18fb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f18fb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f18fb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f1900924640 1 --2- 10.20.193.48:0/1495526308 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc05d280 0x7f18fc1a4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f1900924640 10 monclient(hunting): get_auth_request con 0x7f18fc05d280 auth_method 0 2026-02-12T18:17:06.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f1900924640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f1900924640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.808 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f1900924640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f18fbfff640 1 --2- 10.20.193.48:0/1495526308 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f18fc091550 0x7f18fc097d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f18fb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:06.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f18fb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:06.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f18fb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:06.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f18fbfff640 10 monclient(hunting): get_auth_request con 0x7f18fc091550 auth_method 0 2026-02-12T18:17:06.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f18fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f18fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f18fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f1900924640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:06.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f1900924640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:06.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f1900924640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:06.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f18fb7fe640 10 monclient(hunting): handle_auth_done global_id 114126 payload 274 2026-02-12T18:17:06.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f18fb7fe640 1 -- 10.20.193.48:0/1495526308 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc05d280 msgr2=0x7f18fc1a4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:06.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f18fb7fe640 1 --2- 10.20.193.48:0/1495526308 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc05d280 0x7f18fc1a4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f18fb7fe640 1 -- 10.20.193.48:0/1495526308 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f18fc091550 msgr2=0x7f18fc097d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:06.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f18fb7fe640 1 --2- 10.20.193.48:0/1495526308 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f18fc091550 0x7f18fc097d10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f18fb7fe640 10 monclient: _finish_hunting 0 2026-02-12T18:17:06.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f18fb7fe640 1 monclient: found mon.noname-d 2026-02-12T18:17:06.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f18fb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:06.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f18fb7fe640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:17:06.809 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.804+0000 7f18fb7fe640 1 -- 10.20.193.48:0/1495526308 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18fc04dc20 con 0x7f18fc05c950 2026-02-12T18:17:06.813 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.806+0000 7f18fb7fe640 1 -- 10.20.193.48:0/1495526308 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f18fc05c950 msgr2=0x7f18fc05cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:06.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.806+0000 7f18fb7fe640 1 --2- 10.20.193.48:0/1495526308 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f18fc05c950 0x7f18fc05cd40 secure :-1 s=READY pgs=22 gs=1 cs=0 l=1 c_cookie=8319711044598669748 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18ec0098d0 tx=0x7f18ec02edc0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=73758d1d8732a1b4 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:06.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.806+0000 7f18faffd640 1 -- 10.20.193.48:0/1495526308 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f18ec035340 con 0x7f18fc05c950 2026-02-12T18:17:06.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.806+0000 7f18faffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.806+0000 7f18faffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:17:06.814 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.806+0000 7f18faffd640 10 monclient: dump: 2026-02-12T18:17:06.814 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.814 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.814 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.814 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.814 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.814 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.814 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.814 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.814 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.814 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.814 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.814 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.814 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.814 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.815 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.815 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.806+0000 7f18faffd640 10 monclient: _finish_auth 0 2026-02-12T18:17:06.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.806+0000 7f18faffd640 10 monclient: _check_auth_tickets 2026-02-12T18:17:06.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.806+0000 7f18faffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:06.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.806+0000 7f18faffd640 1 -- 10.20.193.48:0/1495526308 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18ec0354c0 con 0x7f18fc05c950 2026-02-12T18:17:06.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.806+0000 7f18faffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:06.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.806+0000 7f18faffd640 1 -- 10.20.193.48:0/1495526308 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f18ec035af0 con 0x7f18fc05c950 2026-02-12T18:17:06.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.806+0000 7f18faffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.806+0000 7f18faffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:17:06.815 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.806+0000 7f18faffd640 10 monclient: dump: 2026-02-12T18:17:06.815 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.815 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.815 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.815 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.815 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.815 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.815 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.815 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.815 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.815 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.816 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.816 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.816 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.816 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.816 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.816 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.806+0000 7f19023ae640 5 monclient: authenticate success, global_id 114126 2026-02-12T18:17:06.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.806+0000 7f19023ae640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:06.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.806+0000 7f19023ae640 4 set_mon_vals no callback set 2026-02-12T18:17:06.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.807+0000 7f19023ae640 10 monclient: shutdown 2026-02-12T18:17:06.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.807+0000 7f19023ae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:06.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.807+0000 7f19023ae640 1 -- 10.20.193.48:0/1495526308 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f18fc05c950 msgr2=0x7f18fc05cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.807+0000 7f19023ae640 1 --2- 10.20.193.48:0/1495526308 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f18fc05c950 0x7f18fc05cd40 secure :-1 s=READY pgs=22 gs=1 cs=0 l=1 c_cookie=8319711044598669748 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18ec0098d0 tx=0x7f18ec02edc0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.807+0000 7f19023ae640 1 -- 10.20.193.48:0/1495526308 shutdown_connections 2026-02-12T18:17:06.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.807+0000 7f19023ae640 1 --2- 10.20.193.48:0/1495526308 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc05d280 0x7f18fc1a4c10 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.807+0000 7f19023ae640 1 --2- 10.20.193.48:0/1495526308 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f18fc05c950 0x7f18fc05cd40 unknown :-1 s=CLOSED pgs=22 gs=1 cs=0 l=1 c_cookie=8319711044598669748 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.807+0000 7f19023ae640 1 --2- 10.20.193.48:0/1495526308 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f18fc091550 0x7f18fc097d10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.807+0000 7f19023ae640 1 -- 10.20.193.48:0/1495526308 >> 10.20.193.48:0/1495526308 conn(0x7f18fc0549b0 msgr2=0x7f18fc097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:06.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.807+0000 7f19023ae640 1 -- 10.20.193.48:0/1495526308 shutdown_connections 2026-02-12T18:17:06.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.807+0000 7f19023ae640 1 -- 10.20.193.48:0/1495526308 wait complete. 2026-02-12T18:17:06.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.807+0000 7f19023ae640 10 monclient: build_initial_monmap 2026-02-12T18:17:06.816 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.807+0000 7f19023ae640 10 monclient: monmap: 2026-02-12T18:17:06.817 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:06.817 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:06.817 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:06.817 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:06.817 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:06.817 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.817 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:06.817 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:06.817 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:06.817 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:06.817 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:06.817 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:06.817 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:06.817 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:06.817 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:06.817 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f19023ae640 1 Processor -- start 2026-02-12T18:17:06.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f19023ae640 1 -- start start 2026-02-12T18:17:06.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f19023ae640 10 monclient: init 2026-02-12T18:17:06.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f19023ae640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:06.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f19023ae640 10 monclient: _add_conns ranks=[1,6,4,0,5,8,7,2,3] 2026-02-12T18:17:06.817 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f19023ae640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f18fc05c950 0x7f18fc1db480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f19023ae640 10 monclient(hunting): picked mon.noname-f con 0x7f18fc05c950 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:17:06.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f19023ae640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f18fc05d280 0x7f18fc1adce0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f19023ae640 10 monclient(hunting): picked mon.noname-d con 0x7f18fc05d280 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:17:06.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f19023ae640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc091550 0x7f18fc1959a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f19023ae640 10 monclient(hunting): picked mon.noname-c con 0x7f18fc091550 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:17:06.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f19023ae640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f19023ae640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f18fc1dc470 con 0x7f18fc05c950 2026-02-12T18:17:06.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f19023ae640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f19023ae640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f18fc1db9c0 con 0x7f18fc091550 2026-02-12T18:17:06.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f19023ae640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f19023ae640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f18fc08feb0 con 0x7f18fc05d280 2026-02-12T18:17:06.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f19023ae640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:06.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f19023ae640 10 monclient(hunting): authenticate will time out at 1265.534334s 2026-02-12T18:17:06.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f18fb7fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f18fc05d280 0x7f18fc1adce0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f18fb7fe640 1 -- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f18fc05d280 msgr2=0x7f18fc1adce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2026-02-12T18:17:06.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f18fb7fe640 1 -- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f18fc05d280 msgr2=0x7f18fc1adce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2026-02-12T18:17:06.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f18fb7fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f18fc05d280 0x7f18fc1adce0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2026-02-12T18:17:06.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f18fb7fe640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f18fc05d280 0x7f18fc1adce0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2026-02-12T18:17:06.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f1900924640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc091550 0x7f18fc1959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.818 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f1900924640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc091550 0x7f18fc1959a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:40550/0 (socket says 10.20.193.48:40550) 2026-02-12T18:17:06.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f1900924640 1 -- 10.20.193.48:0/539953158 learned_addr learned my addr 10.20.193.48:0/539953158 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:06.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f1900924640 10 monclient(hunting): get_auth_request con 0x7f18fc091550 auth_method 0 2026-02-12T18:17:06.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f1900924640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f1900924640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f1900924640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f1900924640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:06.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f1900924640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:06.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f18fbfff640 1 --2- 10.20.193.48:0/539953158 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f18fc05c950 0x7f18fc1db480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f1900924640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:06.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f18fbfff640 10 monclient(hunting): get_auth_request con 0x7f18fc05c950 auth_method 0 2026-02-12T18:17:06.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f18fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f18fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f18fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f18fbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:06.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f18fbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:06.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f18fbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:06.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f1900924640 10 monclient(hunting): handle_auth_done global_id 65236 payload 824 2026-02-12T18:17:06.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f1900924640 1 -- 10.20.193.48:0/539953158 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f18fc05d280 msgr2=0x7f18fc1adce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2026-02-12T18:17:06.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f1900924640 1 --2- 10.20.193.48:0/539953158 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f18fc05d280 0x7f18fc1adce0 unknown :-1 s=START_CONNECT pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f1900924640 1 -- 10.20.193.48:0/539953158 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f18fc05c950 msgr2=0x7f18fc1db480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f1900924640 1 --2- 10.20.193.48:0/539953158 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f18fc05c950 0x7f18fc1db480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f1900924640 10 monclient: _finish_hunting 0 2026-02-12T18:17:06.819 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f1900924640 1 monclient: found mon.noname-c 2026-02-12T18:17:06.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f1900924640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:06.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f1900924640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:17:06.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.808+0000 7f1900924640 1 -- 10.20.193.48:0/539953158 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18ec0094f0 con 0x7f18fc091550 2026-02-12T18:17:06.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.810+0000 7f1900924640 1 -- 10.20.193.48:0/539953158 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc091550 msgr2=0x7f18fc1959a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:06.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.810+0000 7f1900924640 1 --2- 10.20.193.48:0/539953158 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc091550 0x7f18fc1959a0 secure :-1 s=READY pgs=272 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18f000f900 tx=0x7f18f000fdd0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:06.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f18f8ff9640 1 -- 10.20.193.48:0/539953158 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f18f000dbb0 con 0x7f18fc091550 2026-02-12T18:17:06.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f18f8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f18f8ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:17:06.820 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f18f8ff9640 10 monclient: dump: 2026-02-12T18:17:06.820 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.820 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.820 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.820 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.820 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.820 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.820 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.820 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.820 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.820 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.820 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.820 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.821 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.821 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.821 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.821 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f18f8ff9640 10 monclient: _finish_auth 0 2026-02-12T18:17:06.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f18f8ff9640 10 monclient: _check_auth_tickets 2026-02-12T18:17:06.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f18f8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:06.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f18f8ff9640 1 -- 10.20.193.48:0/539953158 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18f000dd30 con 0x7f18fc091550 2026-02-12T18:17:06.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f19023ae640 5 monclient: authenticate success, global_id 65236 2026-02-12T18:17:06.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f19023ae640 10 monclient: _renew_subs 2026-02-12T18:17:06.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f19023ae640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:17:06.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f19023ae640 1 -- 10.20.193.48:0/539953158 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18fc198560 con 0x7f18fc091550 2026-02-12T18:17:06.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f18f8ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:06.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f18f8ff9640 1 -- 10.20.193.48:0/539953158 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f18f000dea0 con 0x7f18fc091550 2026-02-12T18:17:06.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f18f8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f18fa7fc640 4 set_mon_vals no callback set 2026-02-12T18:17:06.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f18f8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:17:06.821 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f18f8ff9640 10 monclient: dump: 2026-02-12T18:17:06.821 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.821 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.821 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.821 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.822 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.822 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.822 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.822 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.822 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.822 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.822 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.822 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.822 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.822 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.822 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.822 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f19023ae640 10 monclient: _renew_subs 2026-02-12T18:17:06.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f19023ae640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:17:06.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f19023ae640 1 -- 10.20.193.48:0/539953158 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f18fc197320 con 0x7f18fc091550 2026-02-12T18:17:06.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f19023ae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:06.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f19023ae640 1 --2- 10.20.193.48:0/539953158 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc197e80 0x7f18fc195ee0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f19023ae640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f19023ae640 1 -- 10.20.193.48:0/539953158 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f18fc05f140 con 0x7f18fc197e80 2026-02-12T18:17:06.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f18fbfff640 1 --2- 10.20.193.48:0/539953158 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc197e80 0x7f18fc195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f18fbfff640 10 monclient: get_auth_request con 0x7f18fc197e80 auth_method 0 2026-02-12T18:17:06.822 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f18fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f18fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f18fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f18fbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:06.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f18fbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:06.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f18fbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:06.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.811+0000 7f18f8ff9640 1 -- 10.20.193.48:0/539953158 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f18f0012070 con 0x7f18fc091550 2026-02-12T18:17:06.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.812+0000 7f18fbfff640 10 monclient(hunting): handle_auth_done global_id 65245 payload 824 2026-02-12T18:17:06.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.812+0000 7f18fbfff640 1 -- 10.20.193.48:0/539953158 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f18fc05e720 con 0x7f18fc197e80 2026-02-12T18:17:06.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.812+0000 7f18f8ff9640 1 --2- 10.20.193.48:0/539953158 >> v2:10.20.193.111:6812/977811348 conn(0x7f18cc03f7f0 0x7f18cc05fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.812+0000 7f18f8ff9640 1 -- 10.20.193.48:0/539953158 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7f18f00540e0 con 0x7f18fc091550 2026-02-12T18:17:06.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.812+0000 7f18fb7fe640 1 --2- 10.20.193.48:0/539953158 >> v2:10.20.193.111:6812/977811348 conn(0x7f18cc03f7f0 0x7f18cc05fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.823 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.812+0000 7f18fb7fe640 10 monclient: get_auth_request con 0x7f18cc03f7f0 auth_method 0 2026-02-12T18:17:06.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.814+0000 7f18fbfff640 1 -- 10.20.193.48:0/539953158 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc197e80 msgr2=0x7f18fc195ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:06.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.814+0000 7f18fbfff640 1 --2- 10.20.193.48:0/539953158 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc197e80 0x7f18fc195ee0 secure :-1 s=READY pgs=273 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18e8009fd0 tx=0x7f18e8011a70 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:06.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.814+0000 7f18f8ff9640 1 -- 10.20.193.48:0/539953158 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f18e8004530 con 0x7f18fc197e80 2026-02-12T18:17:06.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.814+0000 7f18f8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.814+0000 7f18f8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:17:06.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.814+0000 7f18f8ff9640 10 monclient: dump: 2026-02-12T18:17:06.825 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.825 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.825 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.825 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.825 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.825 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.825 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.826 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.826 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.826 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.826 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.826 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.826 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.826 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.826 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.826 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.814+0000 7f18f8ff9640 1 -- 10.20.193.48:0/539953158 <== mon.4 v2:10.20.193.48:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f18e80036d0 con 0x7f18fc197e80 2026-02-12T18:17:06.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.814+0000 7f18f8ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:06.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.814+0000 7f18f8ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:17:06.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.814+0000 7f18f8ff9640 1 -- 10.20.193.48:0/539953158 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc197e80 msgr2=0x7f18fc195ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.814+0000 7f18f8ff9640 1 --2- 10.20.193.48:0/539953158 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc197e80 0x7f18fc195ee0 secure :-1 s=READY pgs=273 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18e8009fd0 tx=0x7f18e8011a70 comp rx=0 tx=0).stop 2026-02-12T18:17:06.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.814+0000 7f18f8ff9640 1 -- 10.20.193.48:0/539953158 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc197e80 msgr2=0x7f18fc195ee0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:17:06.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.814+0000 7f18f8ff9640 1 --2- 10.20.193.48:0/539953158 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc197e80 0x7f18fc195ee0 secure :-1 s=CLOSED pgs=273 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18e8009fd0 tx=0x7f18e8011a70 comp rx=0 tx=0).stop 2026-02-12T18:17:06.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.814+0000 7f18fb7fe640 1 --2- 10.20.193.48:0/539953158 >> v2:10.20.193.111:6812/977811348 conn(0x7f18cc03f7f0 0x7f18cc05fca0 secure :-1 s=READY pgs=474 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18ec02ee00 tx=0x7f18ec033000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:06.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.817+0000 7f19023ae640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:17:06.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.817+0000 7f19023ae640 1 --2- 10.20.193.48:0/539953158 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc1ae220 0x7f18fc196420 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.817+0000 7f19023ae640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.817+0000 7f19023ae640 1 -- 10.20.193.48:0/539953158 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f18fc1ae5f0 con 0x7f18fc1ae220 2026-02-12T18:17:06.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.817+0000 7f18fbfff640 1 --2- 10.20.193.48:0/539953158 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc1ae220 0x7f18fc196420 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.817+0000 7f18fbfff640 10 monclient: get_auth_request con 0x7f18fc1ae220 auth_method 0 2026-02-12T18:17:06.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.817+0000 7f18fbfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.817+0000 7f18fbfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.817+0000 7f18fbfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.817+0000 7f18fbfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:06.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.817+0000 7f18fbfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:06.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.817+0000 7f18fbfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:06.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.818+0000 7f18fbfff640 10 monclient(hunting): handle_auth_done global_id 65254 payload 824 2026-02-12T18:17:06.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.818+0000 7f18fbfff640 1 -- 10.20.193.48:0/539953158 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f18fc092b20 con 0x7f18fc1ae220 2026-02-12T18:17:06.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.820+0000 7f18fbfff640 1 -- 10.20.193.48:0/539953158 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc1ae220 msgr2=0x7f18fc196420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:06.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.820+0000 7f18fbfff640 1 --2- 10.20.193.48:0/539953158 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc1ae220 0x7f18fc196420 secure :-1 s=READY pgs=274 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18e8017000 tx=0x7f18e8004770 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:06.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.820+0000 7f18f8ff9640 1 -- 10.20.193.48:0/539953158 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f18e8025070 con 0x7f18fc1ae220 2026-02-12T18:17:06.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.820+0000 7f18f8ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.820+0000 7f18f8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:17:06.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.820+0000 7f18f8ff9640 10 monclient: dump: 2026-02-12T18:17:06.827 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.827 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.827 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.827 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.827 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.828 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.828 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.828 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.828 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.828 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.828 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.828 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.828 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.828 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.828 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.828 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.820+0000 7f18f8ff9640 1 -- 10.20.193.48:0/539953158 <== mon.4 v2:10.20.193.48:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10015 (secure 0 0 0) 0x7f18e8003e90 con 0x7f18fc1ae220 2026-02-12T18:17:06.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.820+0000 7f18f8ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:17:06.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.820+0000 7f18f8ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:17:06.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.820+0000 7f18f8ff9640 1 -- 10.20.193.48:0/539953158 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc1ae220 msgr2=0x7f18fc196420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.820+0000 7f18f8ff9640 1 --2- 10.20.193.48:0/539953158 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc1ae220 0x7f18fc196420 secure :-1 s=READY pgs=274 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18e8017000 tx=0x7f18e8004770 comp rx=0 tx=0).stop 2026-02-12T18:17:06.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.820+0000 7f18f8ff9640 1 -- 10.20.193.48:0/539953158 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc1ae220 msgr2=0x7f18fc196420 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:17:06.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.820+0000 7f18f8ff9640 1 --2- 10.20.193.48:0/539953158 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc1ae220 0x7f18fc196420 unknown :-1 s=CLOSED pgs=274 gs=7 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.829 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:17:06.829 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:17:06.829 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:17:06.829 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:17:06.829 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 92, 2026-02-12T18:17:06.829 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 407607, 2026-02-12T18:17:06.829 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:17:06.829 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:17:06.829 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:17:06.829 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:17:06.829 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:17:06.829 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:17:06.829 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:17:06.829 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:17:06.829 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:17:06.829 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:17:06.829 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:06.829 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:17:06.830 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:17:06.830 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:17:06.830 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:17:06.830 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:06.830 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:06.830 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:06.830 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:06.830 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:06.830 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:06.830 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:06.830 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:06.830 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:06.830 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:06.830 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:06.830 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:06.830 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:06.830 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:06.830 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:17:06.830 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:17:06.830 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:06.830 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:06.831 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:06.831 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:06.831 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:06.831 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:06.831 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:06.831 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:06.831 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:06.831 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:06.831 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:06.831 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:06.831 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:06.831 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.831 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.831 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:17:06.831 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:17:06.831 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:17:06.831 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:17:06.831 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:17:06.831 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:17:06.831 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:17:06.831 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:17:06.832 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:17:06.832 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:17:06.832 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:17:06.832 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:17:06.832 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:17:06.832 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:17:06.832 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:17:06.832 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:17:06.832 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:17:06.832 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:06.832 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:06.832 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:06.832 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:06.832 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:06.832 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:06.832 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:06.832 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:06.832 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:06.832 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:06.832 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:06.832 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:06.833 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:06.833 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:06.833 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:17:06.833 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.833 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:17:06.833 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.833 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:17:06.833 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:17:06.833 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.833 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.833 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.833 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.833 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:17:06.833 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.833 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.833 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.833 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.833 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:17:06.833 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.833 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.833 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.833 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.834 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:17:06.834 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:17:06.834 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.834 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.834 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:17:06.834 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.834 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.834 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.834 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:17:06.834 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:17:06.834 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.834 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.834 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.834 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.834 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:17:06.834 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.834 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.834 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.834 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.834 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:17:06.834 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.834 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.835 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.835 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.835 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:17:06.835 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:17:06.835 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.835 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.835 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:17:06.835 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.835 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.835 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.835 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:17:06.835 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:17:06.835 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.835 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.835 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.835 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.835 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:17:06.835 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.835 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.835 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.835 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.835 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:17:06.835 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.836 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.836 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.836 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.836 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:17:06.836 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:17:06.836 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.836 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.836 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:17:06.836 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.836 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.836 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.836 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:17:06.836 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:17:06.836 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.836 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.836 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.836 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.836 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:17:06.836 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.836 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.836 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.836 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.836 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:17:06.836 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.837 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.837 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.837 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.837 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:17:06.837 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:17:06.837 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.837 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.837 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:17:06.837 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.837 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.837 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.837 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:17:06.837 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:17:06.837 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.837 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.837 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.837 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.837 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:17:06.837 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.837 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.837 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.837 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.837 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:17:06.837 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.838 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.838 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.838 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.838 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:17:06.838 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:17:06.838 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.838 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.838 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:17:06.838 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.838 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.838 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.838 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:17:06.838 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:17:06.838 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.838 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.838 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.838 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.838 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:17:06.838 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.838 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.838 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.838 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.838 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:17:06.839 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.839 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.839 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.839 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.839 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:17:06.839 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:17:06.839 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.839 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.839 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:17:06.839 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.839 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.839 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.839 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:17:06.839 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:17:06.839 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.839 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.839 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.839 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.839 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:17:06.839 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.839 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.839 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.839 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.839 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:17:06.840 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.840 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.840 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.840 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.840 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:17:06.840 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:17:06.840 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.840 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.840 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:17:06.840 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.840 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.840 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.840 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:17:06.840 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:17:06.840 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.840 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.840 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.840 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.840 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:17:06.840 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.840 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.840 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.840 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.841 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:17:06.841 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.841 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.841 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.841 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.841 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:17:06.841 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:17:06.841 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.841 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.841 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:17:06.841 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.841 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.841 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.841 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:17:06.841 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:17:06.841 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.841 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.841 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.841 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.841 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:17:06.841 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.841 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.841 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.841 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.841 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:17:06.842 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.842 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.842 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.842 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.842 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:17:06.842 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:17:06.842 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.842 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.842 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:17:06.842 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.842 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.842 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.842 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.842 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:17:06.842 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:17:06.842 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.842 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:17:06.842 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:17:06.842 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:17:06.842 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.842 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:06.842 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:17:06.842 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.842 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:17:06.842 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:17:06.842 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:17:06.843 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.843 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.843 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.843 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:17:06.843 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:17:06.843 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.820+0000 7f19023ae640 1 -- 10.20.193.48:0/539953158 >> v2:10.20.193.111:6812/977811348 conn(0x7f18cc03f7f0 msgr2=0x7f18cc05fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.820+0000 7f19023ae640 1 --2- 10.20.193.48:0/539953158 >> v2:10.20.193.111:6812/977811348 conn(0x7f18cc03f7f0 0x7f18cc05fca0 secure :-1 s=READY pgs=474 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18ec02ee00 tx=0x7f18ec033000 comp rx=0 tx=0).stop 2026-02-12T18:17:06.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.820+0000 7f19023ae640 10 monclient: shutdown 2026-02-12T18:17:06.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.820+0000 7f19023ae640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:06.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.820+0000 7f19023ae640 1 -- 10.20.193.48:0/539953158 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc091550 msgr2=0x7f18fc1959a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.820+0000 7f19023ae640 1 --2- 10.20.193.48:0/539953158 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f18fc091550 0x7f18fc1959a0 secure :-1 s=READY pgs=272 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f18f000f900 tx=0x7f18f000fdd0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.820+0000 7f1900924640 1 -- 10.20.193.48:0/539953158 reap_dead start 2026-02-12T18:17:06.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.820+0000 7f1900924640 1 -- 10.20.193.48:0/539953158 reap_dead start 2026-02-12T18:17:06.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.820+0000 7f19023ae640 1 -- 10.20.193.48:0/539953158 shutdown_connections 2026-02-12T18:17:06.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.820+0000 7f19023ae640 1 -- 10.20.193.48:0/539953158 >> 10.20.193.48:0/539953158 conn(0x7f18fc0549b0 msgr2=0x7f18fc1b0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:06.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.820+0000 7f19023ae640 1 -- 10.20.193.48:0/539953158 shutdown_connections 2026-02-12T18:17:06.844 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.820+0000 7f19023ae640 1 -- 10.20.193.48:0/539953158 wait complete. 2026-02-12T18:17:06.844 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:17:06.844 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2026-02-12T18:17:06.844 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2026-02-12T18:17:06.909 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.907+0000 7fe85254c640 10 monclient: get_monmap_and_config 2026-02-12T18:17:06.909 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.907+0000 7fe85254c640 10 monclient: build_initial_monmap 2026-02-12T18:17:06.909 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.907+0000 7fe85254c640 10 monclient: monmap: 2026-02-12T18:17:06.909 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:06.909 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.909 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:06.908954+0000 2026-02-12T18:17:06.910 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:06.908954+0000 2026-02-12T18:17:06.910 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:06.910 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.910 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:06.910 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:06.910 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:06.910 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:06.910 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:06.910 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:06.910 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:06.910 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:06.910 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:06.911 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:06.911 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:06.911 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe85254c640 1 Processor -- start 2026-02-12T18:17:06.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe85254c640 1 -- start start 2026-02-12T18:17:06.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe85254c640 10 monclient: init 2026-02-12T18:17:06.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe85254c640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:06.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe85254c640 10 monclient: _add_conns ranks=[5,7,0,6,1,3,9,10,2,8,4] 2026-02-12T18:17:06.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe85254c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe84c05d550 0x7fe84c05d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe85254c640 10 monclient(hunting): picked mon.noname-h con 0x7fe84c05d550 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:17:06.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe85254c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe84c05de60 0x7fe84c141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe85254c640 10 monclient(hunting): picked mon.noname-i con 0x7fe84c05de60 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:17:06.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe85254c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fe84c13ef60 addr v1:10.20.193.48:6789/0 2026-02-12T18:17:06.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe85254c640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe84c04dc20 con 0x7fe84c13ef60 2026-02-12T18:17:06.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe85254c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe85254c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fe84c08d390 con 0x7fe84c05d550 2026-02-12T18:17:06.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe85254c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe85254c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fe84c08d5a0 con 0x7fe84c05de60 2026-02-12T18:17:06.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe85254c640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:06.912 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe85254c640 10 monclient(hunting): authenticate will time out at 1265.634698s 2026-02-12T18:17:06.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe850ac2640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7fe84c13ef60 0x7fe84c1424e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:44016/0 (socket says 10.20.193.48:44016) 2026-02-12T18:17:06.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe850ac2640 1 -- 10.20.193.48:0/3026687669 learned_addr learned my addr 10.20.193.48:0/3026687669 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:17:06.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe84bfff640 1 --2- 10.20.193.48:0/3026687669 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe84c05d550 0x7fe84c05d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe84b7fe640 1 --2- 10.20.193.48:0/3026687669 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe84c05de60 0x7fe84c141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe84bfff640 10 monclient(hunting): get_auth_request con 0x7fe84c05d550 auth_method 0 2026-02-12T18:17:06.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe84bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe84bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe84bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe84b7fe640 10 monclient(hunting): get_auth_request con 0x7fe84c05de60 auth_method 0 2026-02-12T18:17:06.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe84b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe84b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.908+0000 7fe84b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.909+0000 7fe84bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:06.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.909+0000 7fe84bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:06.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.909+0000 7fe84bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:06.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.909+0000 7fe84b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:06.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.909+0000 7fe84b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:06.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.909+0000 7fe84b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:06.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.909+0000 7fe84bfff640 10 monclient(hunting): handle_auth_done global_id 114125 payload 274 2026-02-12T18:17:06.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.909+0000 7fe84bfff640 1 -- 10.20.193.48:0/3026687669 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe84c05de60 msgr2=0x7fe84c141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:06.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.909+0000 7fe84bfff640 1 --2- 10.20.193.48:0/3026687669 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe84c05de60 0x7fe84c141fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.909+0000 7fe84bfff640 1 -- 10.20.193.48:0/3026687669 >> v1:10.20.193.48:6789/0 conn(0x7fe84c13ef60 legacy=0x7fe84c1424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:06.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.909+0000 7fe84bfff640 10 monclient: _finish_hunting 0 2026-02-12T18:17:06.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.909+0000 7fe84bfff640 1 monclient: found mon.noname-h 2026-02-12T18:17:06.913 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.909+0000 7fe84bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:06.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.909+0000 7fe84bfff640 10 monclient: _send_mon_message to mon.noname-h at v2:10.20.193.111:3302/0 2026-02-12T18:17:06.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.909+0000 7fe84bfff640 1 -- 10.20.193.48:0/3026687669 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe84c0580e0 con 0x7fe84c05d550 2026-02-12T18:17:06.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.911+0000 7fe84bfff640 1 -- 10.20.193.48:0/3026687669 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe84c05d550 msgr2=0x7fe84c05d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:06.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.911+0000 7fe84bfff640 1 --2- 10.20.193.48:0/3026687669 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe84c05d550 0x7fe84c05d920 secure :-1 s=READY pgs=20 gs=2 cs=0 l=1 c_cookie=9698910353865489417 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe838009800 tx=0x7fe83802ed50 comp rx=0 tx=0).ready entity=mon.5 client_cookie=869973946e82bc09 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:06.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe84affd640 1 -- 10.20.193.48:0/3026687669 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe83802fe90 con 0x7fe84c05d550 2026-02-12T18:17:06.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe84affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe84affd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2026-02-12T18:17:06.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe84affd640 10 monclient: dump: 2026-02-12T18:17:06.916 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.916 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.916 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.916 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.916 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.916 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.916 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.916 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.916 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.916 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.916 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.916 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.916 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.916 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.916 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.916 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe84affd640 10 monclient: _finish_auth 0 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe84affd640 10 monclient: _check_auth_tickets 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe84affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe85254c640 5 monclient: authenticate success, global_id 114125 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe85254c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe84affd640 1 -- 10.20.193.48:0/3026687669 <== mon.5 v2:10.20.193.111:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe838035340 con 0x7fe84c05d550 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe84affd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe84affd640 1 -- 10.20.193.48:0/3026687669 <== mon.5 v2:10.20.193.111:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe8380354b0 con 0x7fe84c05d550 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe84affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe84affd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe84affd640 10 monclient: dump: 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe85254c640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:06.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe85254c640 4 set_mon_vals no callback set 2026-02-12T18:17:06.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe85254c640 10 monclient: shutdown 2026-02-12T18:17:06.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe85254c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:06.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe85254c640 1 -- 10.20.193.48:0/3026687669 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe84c05d550 msgr2=0x7fe84c05d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe85254c640 1 --2- 10.20.193.48:0/3026687669 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe84c05d550 0x7fe84c05d920 secure :-1 s=READY pgs=20 gs=2 cs=0 l=1 c_cookie=9698910353865489417 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe838009800 tx=0x7fe83802ed50 comp rx=0 tx=0).stop 2026-02-12T18:17:06.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe85254c640 1 -- 10.20.193.48:0/3026687669 shutdown_connections 2026-02-12T18:17:06.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe85254c640 1 --2- 10.20.193.48:0/3026687669 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fe84c05de60 0x7fe84c141fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe85254c640 1 --2- 10.20.193.48:0/3026687669 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe84c05d550 0x7fe84c05d920 unknown :-1 s=CLOSED pgs=20 gs=2 cs=0 l=1 c_cookie=9698910353865489417 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe85254c640 1 -- 10.20.193.48:0/3026687669 >> 10.20.193.48:0/3026687669 conn(0x7fe84c0546a0 msgr2=0x7fe84c054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:06.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe85254c640 1 -- 10.20.193.48:0/3026687669 shutdown_connections 2026-02-12T18:17:06.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.912+0000 7fe85254c640 1 -- 10.20.193.48:0/3026687669 wait complete. 2026-02-12T18:17:06.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe85254c640 10 monclient: build_initial_monmap 2026-02-12T18:17:06.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe85254c640 10 monclient: monmap: 2026-02-12T18:17:06.918 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:06.918 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:06.918 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:06.918 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:06.918 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:06.918 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.918 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:06.918 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:06.918 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:06.918 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:06.918 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:06.918 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:06.918 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:06.919 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:06.919 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:06.919 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe85254c640 1 Processor -- start 2026-02-12T18:17:06.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe85254c640 1 -- start start 2026-02-12T18:17:06.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe85254c640 10 monclient: init 2026-02-12T18:17:06.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe85254c640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:06.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe85254c640 10 monclient: _add_conns ranks=[8,4,5,7,1,3,0,6,2] 2026-02-12T18:17:06.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe85254c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe84c05d550 0x7fe84c131bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe85254c640 10 monclient(hunting): picked mon.noname-e con 0x7fe84c05d550 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:17:06.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe85254c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe84c05de60 0x7fe84c08a680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe85254c640 10 monclient(hunting): picked mon.noname-c con 0x7fe84c05de60 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:17:06.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe85254c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe84c13ef60 0x7fe84c08abc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe85254c640 10 monclient(hunting): picked mon.noname-h con 0x7fe84c13ef60 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:17:06.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe85254c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe85254c640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fe84c13dd40 con 0x7fe84c05de60 2026-02-12T18:17:06.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe85254c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe85254c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fe84c10f1d0 con 0x7fe84c13ef60 2026-02-12T18:17:06.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe85254c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe85254c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fe84c08c240 con 0x7fe84c05d550 2026-02-12T18:17:06.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe85254c640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:06.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe85254c640 10 monclient(hunting): authenticate will time out at 1265.639602s 2026-02-12T18:17:06.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84bfff640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe84c05d550 0x7fe84c131bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84b7fe640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe84c05de60 0x7fe84c08a680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.919 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84bfff640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe84c05d550 0x7fe84c131bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:33658/0 (socket says 10.20.193.48:33658) 2026-02-12T18:17:06.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84bfff640 1 -- 10.20.193.48:0/4147004586 learned_addr learned my addr 10.20.193.48:0/4147004586 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:06.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84bfff640 10 monclient(hunting): get_auth_request con 0x7fe84c05d550 auth_method 0 2026-02-12T18:17:06.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84b7fe640 10 monclient(hunting): get_auth_request con 0x7fe84c05de60 auth_method 0 2026-02-12T18:17:06.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:06.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:06.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:06.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:06.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:06.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:06.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe850ac2640 1 --2- 10.20.193.48:0/4147004586 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe84c13ef60 0x7fe84c08abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84bfff640 10 monclient(hunting): handle_auth_done global_id 94940 payload 824 2026-02-12T18:17:06.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84bfff640 1 -- 10.20.193.48:0/4147004586 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe84c13ef60 msgr2=0x7fe84c08abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84bfff640 1 --2- 10.20.193.48:0/4147004586 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fe84c13ef60 0x7fe84c08abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84bfff640 1 -- 10.20.193.48:0/4147004586 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe84c05de60 msgr2=0x7fe84c08a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84bfff640 1 --2- 10.20.193.48:0/4147004586 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fe84c05de60 0x7fe84c08a680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84bfff640 10 monclient: _finish_hunting 0 2026-02-12T18:17:06.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84bfff640 1 monclient: found mon.noname-e 2026-02-12T18:17:06.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:06.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84bfff640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:17:06.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.913+0000 7fe84bfff640 1 -- 10.20.193.48:0/4147004586 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe838009420 con 0x7fe84c05d550 2026-02-12T18:17:06.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe84bfff640 1 -- 10.20.193.48:0/4147004586 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe84c05d550 msgr2=0x7fe84c131bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:06.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe84bfff640 1 --2- 10.20.193.48:0/4147004586 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe84c05d550 0x7fe84c131bb0 secure :-1 s=READY pgs=186 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8380090b0 tx=0x7fe8380047e0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:06.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe848ff9640 1 -- 10.20.193.48:0/4147004586 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe838035dc0 con 0x7fe84c05d550 2026-02-12T18:17:06.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe848ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe848ff9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:17:06.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe848ff9640 10 monclient: dump: 2026-02-12T18:17:06.922 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe848ff9640 10 monclient: _finish_auth 0 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe848ff9640 10 monclient: _check_auth_tickets 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe848ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe848ff9640 1 -- 10.20.193.48:0/4147004586 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8380044f0 con 0x7fe84c05d550 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe85254c640 5 monclient: authenticate success, global_id 94940 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe85254c640 10 monclient: _renew_subs 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe85254c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe85254c640 1 -- 10.20.193.48:0/4147004586 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe84c10f4b0 con 0x7fe84c05d550 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe848ff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe848ff9640 1 -- 10.20.193.48:0/4147004586 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe838003b90 con 0x7fe84c05d550 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe848ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe84a7fc640 4 set_mon_vals no callback set 2026-02-12T18:17:06.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe848ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:17:06.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe848ff9640 10 monclient: dump: 2026-02-12T18:17:06.924 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.924 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.924 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.924 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.924 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.924 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.924 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.924 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.924 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.924 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.924 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.924 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.924 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.924 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.924 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.924 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe85254c640 10 monclient: _renew_subs 2026-02-12T18:17:06.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe85254c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:17:06.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe85254c640 1 -- 10.20.193.48:0/4147004586 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fe84c10eef0 con 0x7fe84c05d550 2026-02-12T18:17:06.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe85254c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:06.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe85254c640 1 --2- 10.20.193.48:0/4147004586 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe84c091010 0x7fe84c08b100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe85254c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe85254c640 1 -- 10.20.193.48:0/4147004586 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fe84c05f140 con 0x7fe84c091010 2026-02-12T18:17:06.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.916+0000 7fe84b7fe640 1 --2- 10.20.193.48:0/4147004586 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe84c091010 0x7fe84c08b100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.917+0000 7fe84b7fe640 10 monclient: get_auth_request con 0x7fe84c091010 auth_method 0 2026-02-12T18:17:06.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.917+0000 7fe84b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.917+0000 7fe84b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.917+0000 7fe84b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.917+0000 7fe848ff9640 1 -- 10.20.193.48:0/4147004586 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fe838003cf0 con 0x7fe84c05d550 2026-02-12T18:17:06.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.917+0000 7fe84b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:06.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.917+0000 7fe84b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:06.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.917+0000 7fe84b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:06.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.917+0000 7fe848ff9640 1 --2- 10.20.193.48:0/4147004586 >> v2:10.20.193.111:6812/977811348 conn(0x7fe81c03f800 0x7fe81c05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.917+0000 7fe84b7fe640 10 monclient(hunting): handle_auth_done global_id 114135 payload 824 2026-02-12T18:17:06.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.917+0000 7fe84b7fe640 1 -- 10.20.193.48:0/4147004586 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe84c05e310 con 0x7fe84c091010 2026-02-12T18:17:06.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.917+0000 7fe848ff9640 1 -- 10.20.193.48:0/4147004586 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7fe838077a60 con 0x7fe84c05d550 2026-02-12T18:17:06.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.917+0000 7fe850ac2640 1 --2- 10.20.193.48:0/4147004586 >> v2:10.20.193.111:6812/977811348 conn(0x7fe81c03f800 0x7fe81c05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.917+0000 7fe850ac2640 10 monclient: get_auth_request con 0x7fe81c03f800 auth_method 0 2026-02-12T18:17:06.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.919+0000 7fe84b7fe640 1 -- 10.20.193.48:0/4147004586 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe84c091010 msgr2=0x7fe84c08b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:06.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.919+0000 7fe84b7fe640 1 --2- 10.20.193.48:0/4147004586 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe84c091010 0x7fe84c08b100 secure :-1 s=READY pgs=23 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe84c05ca70 tx=0x7fe83c011e40 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:06.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.919+0000 7fe848ff9640 1 -- 10.20.193.48:0/4147004586 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe83c00fdc0 con 0x7fe84c091010 2026-02-12T18:17:06.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.919+0000 7fe848ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.919+0000 7fe848ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:17:06.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.919+0000 7fe848ff9640 10 monclient: dump: 2026-02-12T18:17:06.925 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.925 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.925 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.925 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.925 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.925 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.926 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.926 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.926 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.926 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.926 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.926 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.926 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.926 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.926 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.926 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.919+0000 7fe848ff9640 1 -- 10.20.193.48:0/4147004586 <== mon.6 v2:10.20.193.48:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7fe83c00f900 con 0x7fe84c091010 2026-02-12T18:17:06.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.919+0000 7fe848ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:06.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.919+0000 7fe848ff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:17:06.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.919+0000 7fe848ff9640 1 -- 10.20.193.48:0/4147004586 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe84c091010 msgr2=0x7fe84c08b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.919+0000 7fe848ff9640 1 --2- 10.20.193.48:0/4147004586 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe84c091010 0x7fe84c08b100 secure :-1 s=READY pgs=23 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe84c05ca70 tx=0x7fe83c011e40 comp rx=0 tx=0).stop 2026-02-12T18:17:06.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.919+0000 7fe848ff9640 1 -- 10.20.193.48:0/4147004586 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe84c091010 msgr2=0x7fe84c08b100 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:17:06.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.919+0000 7fe848ff9640 1 --2- 10.20.193.48:0/4147004586 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe84c091010 0x7fe84c08b100 secure :-1 s=CLOSED pgs=23 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe84c05ca70 tx=0x7fe83c011e40 comp rx=0 tx=0).stop 2026-02-12T18:17:06.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.920+0000 7fe850ac2640 1 --2- 10.20.193.48:0/4147004586 >> v2:10.20.193.111:6812/977811348 conn(0x7fe81c03f800 0x7fe81c05fcb0 secure :-1 s=READY pgs=475 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe84c120960 tx=0x7fe84000a040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:06.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.923+0000 7fe85254c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:17:06.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.923+0000 7fe85254c640 1 --2- 10.20.193.48:0/4147004586 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe84c131510 0x7fe84c058a10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:06.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.923+0000 7fe85254c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:06.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.923+0000 7fe85254c640 1 -- 10.20.193.48:0/4147004586 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fe84c05fd90 con 0x7fe84c131510 2026-02-12T18:17:06.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.923+0000 7fe84b7fe640 1 --2- 10.20.193.48:0/4147004586 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe84c131510 0x7fe84c058a10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:06.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.923+0000 7fe84b7fe640 10 monclient: get_auth_request con 0x7fe84c131510 auth_method 0 2026-02-12T18:17:06.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.923+0000 7fe84b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:06.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.923+0000 7fe84b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:06.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.923+0000 7fe84b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:06.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.923+0000 7fe84b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:06.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.923+0000 7fe84b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:06.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.923+0000 7fe84b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:06.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.923+0000 7fe84b7fe640 10 monclient(hunting): handle_auth_done global_id 114144 payload 824 2026-02-12T18:17:06.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.923+0000 7fe84b7fe640 1 -- 10.20.193.48:0/4147004586 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe84c057e00 con 0x7fe84c131510 2026-02-12T18:17:06.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.925+0000 7fe84b7fe640 1 -- 10.20.193.48:0/4147004586 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe84c131510 msgr2=0x7fe84c058a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:06.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.925+0000 7fe84b7fe640 1 --2- 10.20.193.48:0/4147004586 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe84c131510 0x7fe84c058a10 secure :-1 s=READY pgs=24 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe84c05ca70 tx=0x7fe83c004770 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:06.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.926+0000 7fe848ff9640 1 -- 10.20.193.48:0/4147004586 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fe83c01eb20 con 0x7fe84c131510 2026-02-12T18:17:06.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.926+0000 7fe848ff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:06.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.926+0000 7fe848ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:17:06.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.926+0000 7fe848ff9640 10 monclient: dump: 2026-02-12T18:17:06.928 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:06.928 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:06.928 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.928 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:06.928 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:06.928 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:06.928 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:06.928 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:06.928 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:06.928 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:06.928 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:06.928 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:06.928 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:06.929 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:06.929 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:06.929 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:06.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.926+0000 7fe848ff9640 1 -- 10.20.193.48:0/4147004586 <== mon.6 v2:10.20.193.48:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7fe83c01ec80 con 0x7fe84c131510 2026-02-12T18:17:06.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.926+0000 7fe848ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:17:06.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.926+0000 7fe848ff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:17:06.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.926+0000 7fe848ff9640 1 -- 10.20.193.48:0/4147004586 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe84c131510 msgr2=0x7fe84c058a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.926+0000 7fe848ff9640 1 --2- 10.20.193.48:0/4147004586 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe84c131510 0x7fe84c058a10 secure :-1 s=READY pgs=24 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe84c05ca70 tx=0x7fe83c004770 comp rx=0 tx=0).stop 2026-02-12T18:17:06.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.926+0000 7fe848ff9640 1 -- 10.20.193.48:0/4147004586 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe84c131510 msgr2=0x7fe84c058a10 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:17:06.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.926+0000 7fe848ff9640 1 --2- 10.20.193.48:0/4147004586 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fe84c131510 0x7fe84c058a10 secure :-1 s=CLOSED pgs=24 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe84c05ca70 tx=0x7fe83c004770 comp rx=0 tx=0).stop 2026-02-12T18:17:06.929 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:17:06.929 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:17:06.929 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:17:06.929 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:17:06.929 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 92, 2026-02-12T18:17:06.929 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 15621, 2026-02-12T18:17:06.929 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:17:06.929 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:17:06.929 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:17:06.929 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:17:06.930 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:17:06.930 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:17:06.930 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:17:06.930 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:17:06.930 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:17:06.930 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:17:06.930 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:06.930 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:17:06.930 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:17:06.930 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:17:06.930 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:17:06.930 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:06.930 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:06.930 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:06.930 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:06.930 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:06.930 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:06.930 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:06.930 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:06.930 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:06.930 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:06.930 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:06.930 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:06.930 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:06.931 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:06.931 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:17:06.931 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:17:06.931 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:06.931 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:06.931 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:06.931 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:06.931 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:06.931 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:06.931 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:06.931 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:06.931 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:06.931 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:06.931 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:06.931 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:06.931 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:06.931 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.931 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.931 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:17:06.931 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:17:06.931 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:17:06.931 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:17:06.931 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:17:06.931 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:17:06.931 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:17:06.932 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:17:06.932 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:17:06.932 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:17:06.932 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:17:06.932 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:17:06.932 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:17:06.932 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:17:06.932 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:17:06.932 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:17:06.932 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:17:06.932 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:06.932 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:06.932 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:06.932 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:06.932 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:06.932 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:06.932 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:06.932 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:06.932 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:06.932 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:06.932 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:06.932 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:06.932 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:06.932 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:06.932 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.933 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.934 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:17:06.934 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:17:06.934 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.934 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.934 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.934 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.934 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:17:06.934 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.934 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.934 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.934 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.934 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:17:06.934 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.934 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.934 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.934 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.934 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:17:06.934 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:17:06.934 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.934 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.934 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:17:06.934 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.934 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.934 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.934 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.935 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.936 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.936 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.936 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:17:06.936 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.936 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.936 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.936 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.936 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:17:06.936 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.936 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.936 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.936 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.936 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:17:06.936 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:17:06.936 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.936 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.936 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:17:06.936 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.936 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.936 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.936 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:17:06.936 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:17:06.936 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.936 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.936 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:17:06.937 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.938 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.938 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.938 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.938 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:17:06.938 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.938 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.938 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.938 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.938 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:17:06.938 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:17:06.938 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.938 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.938 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:17:06.938 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.938 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.938 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.938 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:17:06.938 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:17:06.938 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.938 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.938 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.938 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.938 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:17:06.938 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.938 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.938 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.939 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.939 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:17:06.939 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.939 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.939 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.939 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.939 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:17:06.939 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:17:06.939 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.939 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.939 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:17:06.939 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.939 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.939 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.939 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:17:06.939 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:17:06.939 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.939 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.939 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.939 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.939 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:17:06.939 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.939 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.939 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.939 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.940 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:17:06.940 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.940 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.940 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.940 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.940 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:17:06.940 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:17:06.940 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.940 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.940 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:17:06.940 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.940 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.940 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.940 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:17:06.940 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:17:06.940 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:06.940 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:06.940 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.940 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:06.940 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:17:06.940 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.940 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.940 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.940 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:06.940 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:17:06.940 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:06.941 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:06.942 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:06.942 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:17:06.942 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:17:06.942 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.926+0000 7fe85254c640 1 -- 10.20.193.48:0/4147004586 >> v2:10.20.193.111:6812/977811348 conn(0x7fe81c03f800 msgr2=0x7fe81c05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.942 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.926+0000 7fe85254c640 1 --2- 10.20.193.48:0/4147004586 >> v2:10.20.193.111:6812/977811348 conn(0x7fe81c03f800 0x7fe81c05fcb0 secure :-1 s=READY pgs=475 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe84c120960 tx=0x7fe84000a040 comp rx=0 tx=0).stop 2026-02-12T18:17:06.942 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.926+0000 7fe85254c640 10 monclient: shutdown 2026-02-12T18:17:06.943 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.926+0000 7fe85254c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:06.943 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.926+0000 7fe85254c640 1 -- 10.20.193.48:0/4147004586 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe84c05d550 msgr2=0x7fe84c131bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:06.943 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.926+0000 7fe85254c640 1 --2- 10.20.193.48:0/4147004586 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe84c05d550 0x7fe84c131bb0 secure :-1 s=READY pgs=186 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fe8380090b0 tx=0x7fe8380047e0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.943 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.926+0000 7fe850ac2640 1 -- 10.20.193.48:0/4147004586 reap_dead start 2026-02-12T18:17:06.943 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.926+0000 7fe85254c640 1 -- 10.20.193.48:0/4147004586 shutdown_connections 2026-02-12T18:17:06.943 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.926+0000 7fe85254c640 1 --2- 10.20.193.48:0/4147004586 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fe84c05d550 0x7fe84c131bb0 unknown :-1 s=CLOSED pgs=186 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:06.943 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.926+0000 7fe85254c640 1 -- 10.20.193.48:0/4147004586 >> 10.20.193.48:0/4147004586 conn(0x7fe84c0546a0 msgr2=0x7fe84c13c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:06.943 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.926+0000 7fe85254c640 1 -- 10.20.193.48:0/4147004586 shutdown_connections 2026-02-12T18:17:06.943 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:06.926+0000 7fe85254c640 1 -- 10.20.193.48:0/4147004586 wait complete. 2026-02-12T18:17:06.943 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:17:06.943 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2026-02-12T18:17:06.943 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2026-02-12T18:17:07.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.007+0000 7f4f3b207640 10 monclient: get_monmap_and_config 2026-02-12T18:17:07.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.007+0000 7f4f3b207640 10 monclient: build_initial_monmap 2026-02-12T18:17:07.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.007+0000 7f4f3b207640 10 monclient: monmap: 2026-02-12T18:17:07.008 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:07.008 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.008 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:07.008374+0000 2026-02-12T18:17:07.008 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:07.008374+0000 2026-02-12T18:17:07.008 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:07.008 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.009 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:07.009 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:07.009 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:07.009 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:07.009 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:07.009 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:07.009 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:07.009 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:07.009 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:07.009 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:07.009 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:07.009 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.010 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.007+0000 7f4f3b207640 1 Processor -- start 2026-02-12T18:17:07.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.007+0000 7f4f3b207640 1 -- start start 2026-02-12T18:17:07.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.007+0000 7f4f3b207640 10 monclient: init 2026-02-12T18:17:07.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.007+0000 7f4f3b207640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:07.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3b207640 10 monclient: _add_conns ranks=[4,2,8,5,6,3,9,1,0,7,10] 2026-02-12T18:17:07.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3b207640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4f340914d0 0x7f4f3405c950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3b207640 10 monclient(hunting): picked mon.noname-c con 0x7f4f340914d0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:17:07.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3b207640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4f3408e210 0x7f4f3405ce90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3b207640 10 monclient(hunting): picked mon.noname-b con 0x7f4f3408e210 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:17:07.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3b207640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4f3405e4b0 0x7f4f3405d3d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3b207640 10 monclient(hunting): picked mon.noname-e con 0x7f4f3405e4b0 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:17:07.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3b207640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3b207640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f4f34092f90 con 0x7f4f3408e210 2026-02-12T18:17:07.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3b207640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3b207640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f4f340918a0 con 0x7f4f340914d0 2026-02-12T18:17:07.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3b207640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3b207640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f4f3405de10 con 0x7f4f3405e4b0 2026-02-12T18:17:07.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3b207640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:07.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3b207640 10 monclient(hunting): authenticate will time out at 1265.734064s 2026-02-12T18:17:07.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f38f7c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4f340914d0 0x7f4f3405c950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3977d640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4f3405e4b0 0x7f4f3405d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f2bfff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4f3408e210 0x7f4f3405ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.011 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f38f7c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4f340914d0 0x7f4f3405c950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:40586/0 (socket says 10.20.193.48:40586) 2026-02-12T18:17:07.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f38f7c640 1 -- 10.20.193.48:0/720311416 learned_addr learned my addr 10.20.193.48:0/720311416 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:07.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f38f7c640 10 monclient(hunting): get_auth_request con 0x7f4f340914d0 auth_method 0 2026-02-12T18:17:07.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3977d640 1 --2- 10.20.193.48:0/720311416 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4f3405e4b0 0x7f4f3405d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:33670/0 (socket says 10.20.193.48:33670) 2026-02-12T18:17:07.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f38f7c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f38f7c640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f38f7c640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f2bfff640 10 monclient(hunting): get_auth_request con 0x7f4f3408e210 auth_method 0 2026-02-12T18:17:07.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f2bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f2bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f2bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3977d640 10 monclient(hunting): get_auth_request con 0x7f4f3405e4b0 auth_method 0 2026-02-12T18:17:07.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3977d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3977d640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3977d640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f38f7c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f38f7c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f38f7c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3977d640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3977d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3977d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f2bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f2bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f2bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3977d640 10 monclient(hunting): handle_auth_done global_id 94949 payload 274 2026-02-12T18:17:07.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3977d640 1 -- 10.20.193.48:0/720311416 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4f340914d0 msgr2=0x7f4f3405c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:07.012 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3977d640 1 --2- 10.20.193.48:0/720311416 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4f340914d0 0x7f4f3405c950 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3977d640 1 -- 10.20.193.48:0/720311416 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4f3408e210 msgr2=0x7f4f3405ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:07.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3977d640 1 --2- 10.20.193.48:0/720311416 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4f3408e210 0x7f4f3405ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3977d640 10 monclient: _finish_hunting 0 2026-02-12T18:17:07.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3977d640 1 monclient: found mon.noname-e 2026-02-12T18:17:07.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3977d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:07.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3977d640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:17:07.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f3977d640 1 -- 10.20.193.48:0/720311416 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f3404dc20 con 0x7f4f3405e4b0 2026-02-12T18:17:07.013 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.008+0000 7f4f38f7c640 1 --2- 10.20.193.48:0/720311416 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4f340914d0 0x7f4f3405c950 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:17:07.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.010+0000 7f4f3977d640 1 -- 10.20.193.48:0/720311416 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4f3405e4b0 msgr2=0x7f4f3405d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:07.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.010+0000 7f4f3977d640 1 --2- 10.20.193.48:0/720311416 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4f3405e4b0 0x7f4f3405d3d0 secure :-1 s=READY pgs=187 gs=3 cs=0 l=1 c_cookie=13583632194065450860 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f3000a8e0 tx=0x7f4f3002fe20 comp rx=0 tx=0).ready entity=mon.8 client_cookie=bc82c182e6d4c76c server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f2b7fe640 1 -- 10.20.193.48:0/720311416 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4f30036340 con 0x7f4f3405e4b0 2026-02-12T18:17:07.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f2b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f2b7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:17:07.015 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f2b7fe640 10 monclient: dump: 2026-02-12T18:17:07.015 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.015 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.015 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.015 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.015 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.015 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.016 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.016 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.016 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.016 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.016 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.016 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.016 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.016 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.016 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.016 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f2b7fe640 10 monclient: _finish_auth 0 2026-02-12T18:17:07.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f2b7fe640 10 monclient: _check_auth_tickets 2026-02-12T18:17:07.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f2b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:07.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f2b7fe640 1 -- 10.20.193.48:0/720311416 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f300364c0 con 0x7f4f3405e4b0 2026-02-12T18:17:07.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f2b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:07.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f2b7fe640 1 -- 10.20.193.48:0/720311416 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4f30036af0 con 0x7f4f3405e4b0 2026-02-12T18:17:07.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f3b207640 5 monclient: authenticate success, global_id 94949 2026-02-12T18:17:07.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f2b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f2b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:17:07.016 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f2b7fe640 10 monclient: dump: 2026-02-12T18:17:07.016 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.016 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.016 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.016 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.016 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.017 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.017 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.017 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.017 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.017 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.017 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.017 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.017 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.017 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.017 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.017 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f3b207640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:07.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f3b207640 4 set_mon_vals no callback set 2026-02-12T18:17:07.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f3b207640 10 monclient: shutdown 2026-02-12T18:17:07.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f3b207640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:07.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f3b207640 1 -- 10.20.193.48:0/720311416 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4f3405e4b0 msgr2=0x7f4f3405d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f3b207640 1 --2- 10.20.193.48:0/720311416 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4f3405e4b0 0x7f4f3405d3d0 secure :-1 s=READY pgs=187 gs=3 cs=0 l=1 c_cookie=13583632194065450860 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f3000a8e0 tx=0x7f4f3002fe20 comp rx=0 tx=0).stop 2026-02-12T18:17:07.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f3b207640 1 -- 10.20.193.48:0/720311416 shutdown_connections 2026-02-12T18:17:07.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f3b207640 1 --2- 10.20.193.48:0/720311416 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4f3405e4b0 0x7f4f3405d3d0 unknown :-1 s=CLOSED pgs=187 gs=3 cs=0 l=1 c_cookie=13583632194065450860 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f3b207640 1 --2- 10.20.193.48:0/720311416 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4f3408e210 0x7f4f3405ce90 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f3b207640 1 --2- 10.20.193.48:0/720311416 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f4f340914d0 0x7f4f3405c950 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f3b207640 1 -- 10.20.193.48:0/720311416 >> 10.20.193.48:0/720311416 conn(0x7f4f340548a0 msgr2=0x7f4f34097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:07.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f3b207640 1 -- 10.20.193.48:0/720311416 shutdown_connections 2026-02-12T18:17:07.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.011+0000 7f4f3b207640 1 -- 10.20.193.48:0/720311416 wait complete. 2026-02-12T18:17:07.017 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3b207640 10 monclient: build_initial_monmap 2026-02-12T18:17:07.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3b207640 10 monclient: monmap: 2026-02-12T18:17:07.018 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:07.018 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:07.018 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:07.018 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:07.018 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:07.018 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.018 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:07.018 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:07.018 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:07.018 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:07.018 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:07.018 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:07.018 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:07.018 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:07.018 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:07.018 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3b207640 1 Processor -- start 2026-02-12T18:17:07.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3b207640 1 -- start start 2026-02-12T18:17:07.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3b207640 10 monclient: init 2026-02-12T18:17:07.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3b207640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:07.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3b207640 10 monclient: _add_conns ranks=[7,2,3,8,0,5,4,1,6] 2026-02-12T18:17:07.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3b207640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f4f3405e4b0 0x7f4f341a1d90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3b207640 10 monclient(hunting): picked mon.noname-i con 0x7f4f3405e4b0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:17:07.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3b207640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4f3408e210 0x7f4f341a22d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3b207640 10 monclient(hunting): picked mon.noname-b con 0x7f4f3408e210 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:17:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3b207640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f4f340914d0 0x7f4f341a6cb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3b207640 10 monclient(hunting): picked mon.noname-g con 0x7f4f340914d0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:17:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3b207640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3b207640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f4f341aa610 con 0x7f4f3408e210 2026-02-12T18:17:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3b207640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3b207640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f4f341a9db0 con 0x7f4f340914d0 2026-02-12T18:17:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3b207640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3b207640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f4f341aff40 con 0x7f4f3405e4b0 2026-02-12T18:17:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3b207640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3b207640 10 monclient(hunting): authenticate will time out at 1265.738568s 2026-02-12T18:17:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f2bfff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4f3408e210 0x7f4f341a22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f2bfff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4f3408e210 0x7f4f341a22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:44160/0 (socket says 10.20.193.48:44160) 2026-02-12T18:17:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f2bfff640 1 -- 10.20.193.48:0/3746438605 learned_addr learned my addr 10.20.193.48:0/3746438605 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f2bfff640 10 monclient(hunting): get_auth_request con 0x7f4f3408e210 auth_method 0 2026-02-12T18:17:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f2bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f2bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f2bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f2bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f2bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f2bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f38f7c640 1 --2- 10.20.193.48:0/3746438605 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f4f3405e4b0 0x7f4f341a1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f38f7c640 10 monclient(hunting): get_auth_request con 0x7f4f3405e4b0 auth_method 0 2026-02-12T18:17:07.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3977d640 1 --2- 10.20.193.48:0/3746438605 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f4f340914d0 0x7f4f341a6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f38f7c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f38f7c640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f38f7c640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3977d640 10 monclient(hunting): get_auth_request con 0x7f4f340914d0 auth_method 0 2026-02-12T18:17:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3977d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3977d640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3977d640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f2bfff640 10 monclient(hunting): handle_auth_done global_id 36677 payload 824 2026-02-12T18:17:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f2bfff640 1 -- 10.20.193.48:0/3746438605 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f4f3405e4b0 msgr2=0x7f4f341a1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f2bfff640 1 --2- 10.20.193.48:0/3746438605 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f4f3405e4b0 0x7f4f341a1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f2bfff640 1 -- 10.20.193.48:0/3746438605 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f4f340914d0 msgr2=0x7f4f341a6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f2bfff640 1 --2- 10.20.193.48:0/3746438605 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f4f340914d0 0x7f4f341a6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f2bfff640 10 monclient: _finish_hunting 0 2026-02-12T18:17:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f2bfff640 1 monclient: found mon.noname-b 2026-02-12T18:17:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f2bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f2bfff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:17:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f2bfff640 1 -- 10.20.193.48:0/3746438605 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f240094f0 con 0x7f4f3408e210 2026-02-12T18:17:07.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.012+0000 7f4f3977d640 1 --2- 10.20.193.48:0/3746438605 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f4f340914d0 0x7f4f341a6cb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:17:07.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f2bfff640 1 -- 10.20.193.48:0/3746438605 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4f3408e210 msgr2=0x7f4f341a22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:07.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f2bfff640 1 --2- 10.20.193.48:0/3746438605 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4f3408e210 0x7f4f341a22d0 secure :-1 s=READY pgs=468 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f1c0093f0 tx=0x7f4f1c00ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f297fa640 1 -- 10.20.193.48:0/3746438605 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4f1c00cb50 con 0x7f4f3408e210 2026-02-12T18:17:07.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f297fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f297fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:17:07.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f297fa640 10 monclient: dump: 2026-02-12T18:17:07.022 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.022 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.022 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.022 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.022 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.022 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.023 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.023 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.023 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.023 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.023 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.023 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.023 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.023 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.023 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.023 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f297fa640 10 monclient: _finish_auth 0 2026-02-12T18:17:07.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f297fa640 10 monclient: _check_auth_tickets 2026-02-12T18:17:07.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f297fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:07.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f297fa640 1 -- 10.20.193.48:0/3746438605 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f1c00ccd0 con 0x7f4f3408e210 2026-02-12T18:17:07.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f297fa640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:07.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f297fa640 1 -- 10.20.193.48:0/3746438605 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4f1c00ce40 con 0x7f4f3408e210 2026-02-12T18:17:07.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f297fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f297fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:17:07.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f2affd640 4 set_mon_vals no callback set 2026-02-12T18:17:07.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f297fa640 10 monclient: dump: 2026-02-12T18:17:07.023 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.023 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.023 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.023 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.023 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.024 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.024 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.024 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.024 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.024 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.024 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.024 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.024 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.024 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.024 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.024 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f3b207640 5 monclient: authenticate success, global_id 36677 2026-02-12T18:17:07.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f3b207640 10 monclient: _renew_subs 2026-02-12T18:17:07.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f3b207640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:17:07.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f3b207640 1 -- 10.20.193.48:0/3746438605 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f3000a500 con 0x7f4f3408e210 2026-02-12T18:17:07.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f3b207640 10 monclient: _renew_subs 2026-02-12T18:17:07.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f3b207640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:17:07.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f3b207640 1 -- 10.20.193.48:0/3746438605 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f3408f8b0 con 0x7f4f3408e210 2026-02-12T18:17:07.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f3b207640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:07.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f3b207640 1 --2- 10.20.193.48:0/3746438605 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4f341a71f0 0x7f4f341a75c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f3b207640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f3b207640 1 -- 10.20.193.48:0/3746438605 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f4f3405f140 con 0x7f4f341a71f0 2026-02-12T18:17:07.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f38f7c640 1 --2- 10.20.193.48:0/3746438605 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4f341a71f0 0x7f4f341a75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f38f7c640 10 monclient: get_auth_request con 0x7f4f341a71f0 auth_method 0 2026-02-12T18:17:07.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f38f7c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f38f7c640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.015+0000 7f4f38f7c640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.016+0000 7f4f38f7c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.016+0000 7f4f38f7c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.016+0000 7f4f38f7c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.016+0000 7f4f38f7c640 10 monclient(hunting): handle_auth_done global_id 94958 payload 824 2026-02-12T18:17:07.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.016+0000 7f4f297fa640 1 -- 10.20.193.48:0/3746438605 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f4f1c011070 con 0x7f4f3408e210 2026-02-12T18:17:07.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.016+0000 7f4f38f7c640 1 -- 10.20.193.48:0/3746438605 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4f34092cb0 con 0x7f4f341a71f0 2026-02-12T18:17:07.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.016+0000 7f4f297fa640 1 --2- 10.20.193.48:0/3746438605 >> v2:10.20.193.111:6812/977811348 conn(0x7f4f0403f800 0x7f4f0405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.016+0000 7f4f297fa640 1 -- 10.20.193.48:0/3746438605 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7f4f1c0529c0 con 0x7f4f3408e210 2026-02-12T18:17:07.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.016+0000 7f4f3977d640 1 --2- 10.20.193.48:0/3746438605 >> v2:10.20.193.111:6812/977811348 conn(0x7f4f0403f800 0x7f4f0405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.016+0000 7f4f3977d640 10 monclient: get_auth_request con 0x7f4f0403f800 auth_method 0 2026-02-12T18:17:07.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.018+0000 7f4f38f7c640 1 -- 10.20.193.48:0/3746438605 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4f341a71f0 msgr2=0x7f4f341a75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:07.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.018+0000 7f4f38f7c640 1 --2- 10.20.193.48:0/3746438605 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4f341a71f0 0x7f4f341a75c0 secure :-1 s=READY pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f24004740 tx=0x7f4f24011c30 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.018+0000 7f4f297fa640 1 -- 10.20.193.48:0/3746438605 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4f240044f0 con 0x7f4f341a71f0 2026-02-12T18:17:07.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.018+0000 7f4f297fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.018+0000 7f4f297fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:17:07.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.018+0000 7f4f297fa640 10 monclient: dump: 2026-02-12T18:17:07.025 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.025 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.025 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.025 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.025 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.025 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.025 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.026 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.026 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.026 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.026 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.026 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.026 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.026 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.026 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.026 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.018+0000 7f4f297fa640 1 -- 10.20.193.48:0/3746438605 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f4f2400fc20 con 0x7f4f341a71f0 2026-02-12T18:17:07.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.018+0000 7f4f297fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:07.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.018+0000 7f4f297fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:17:07.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.018+0000 7f4f297fa640 1 -- 10.20.193.48:0/3746438605 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4f341a71f0 msgr2=0x7f4f341a75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.018+0000 7f4f297fa640 1 --2- 10.20.193.48:0/3746438605 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4f341a71f0 0x7f4f341a75c0 secure :-1 s=READY pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f24004740 tx=0x7f4f24011c30 comp rx=0 tx=0).stop 2026-02-12T18:17:07.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.018+0000 7f4f297fa640 1 -- 10.20.193.48:0/3746438605 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4f341a71f0 msgr2=0x7f4f341a75c0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:17:07.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.018+0000 7f4f297fa640 1 --2- 10.20.193.48:0/3746438605 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4f341a71f0 0x7f4f341a75c0 secure :-1 s=CLOSED pgs=188 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f24004740 tx=0x7f4f24011c30 comp rx=0 tx=0).stop 2026-02-12T18:17:07.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.019+0000 7f4f3977d640 1 --2- 10.20.193.48:0/3746438605 >> v2:10.20.193.111:6812/977811348 conn(0x7f4f0403f800 0x7f4f0405fcb0 secure :-1 s=READY pgs=476 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f3000a830 tx=0x7f4f30034000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.021+0000 7f4f3b207640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:17:07.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.021+0000 7f4f3b207640 1 --2- 10.20.193.48:0/3746438605 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4f341a7b00 0x7f4f3408a3b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.021+0000 7f4f3b207640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.021+0000 7f4f3b207640 1 -- 10.20.193.48:0/3746438605 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f4f34050410 con 0x7f4f341a7b00 2026-02-12T18:17:07.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.022+0000 7f4f38f7c640 1 --2- 10.20.193.48:0/3746438605 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4f341a7b00 0x7f4f3408a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.022+0000 7f4f38f7c640 10 monclient: get_auth_request con 0x7f4f341a7b00 auth_method 0 2026-02-12T18:17:07.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.022+0000 7f4f38f7c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.022+0000 7f4f38f7c640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.022+0000 7f4f38f7c640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.022+0000 7f4f38f7c640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.022+0000 7f4f38f7c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.022+0000 7f4f38f7c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.022+0000 7f4f38f7c640 10 monclient(hunting): handle_auth_done global_id 94967 payload 824 2026-02-12T18:17:07.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.022+0000 7f4f38f7c640 1 -- 10.20.193.48:0/3746438605 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4f340929d0 con 0x7f4f341a7b00 2026-02-12T18:17:07.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.024+0000 7f4f38f7c640 1 -- 10.20.193.48:0/3746438605 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4f341a7b00 msgr2=0x7f4f3408a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:07.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.024+0000 7f4f38f7c640 1 --2- 10.20.193.48:0/3746438605 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4f341a7b00 0x7f4f3408a3b0 secure :-1 s=READY pgs=189 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f24004000 tx=0x7f4f24004770 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.024+0000 7f4f297fa640 1 -- 10.20.193.48:0/3746438605 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4f24003e10 con 0x7f4f341a7b00 2026-02-12T18:17:07.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.024+0000 7f4f297fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.024+0000 7f4f297fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:17:07.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.024+0000 7f4f297fa640 10 monclient: dump: 2026-02-12T18:17:07.028 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.028 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.028 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.028 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.028 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.028 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.028 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.028 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.028 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.028 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.028 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.028 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.029 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.029 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.029 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.029 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.024+0000 7f4f297fa640 1 -- 10.20.193.48:0/3746438605 <== mon.8 v2:10.20.193.48:3304/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10182 (secure 0 0 0) 0x7f4f24003950 con 0x7f4f341a7b00 2026-02-12T18:17:07.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.024+0000 7f4f297fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:17:07.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.024+0000 7f4f297fa640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:17:07.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.024+0000 7f4f297fa640 1 -- 10.20.193.48:0/3746438605 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4f341a7b00 msgr2=0x7f4f3408a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.024+0000 7f4f297fa640 1 --2- 10.20.193.48:0/3746438605 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4f341a7b00 0x7f4f3408a3b0 secure :-1 s=READY pgs=189 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f24004000 tx=0x7f4f24004770 comp rx=0 tx=0).stop 2026-02-12T18:17:07.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.024+0000 7f4f297fa640 1 -- 10.20.193.48:0/3746438605 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4f341a7b00 msgr2=0x7f4f3408a3b0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:17:07.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.024+0000 7f4f297fa640 1 --2- 10.20.193.48:0/3746438605 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f4f341a7b00 0x7f4f3408a3b0 secure :-1 s=CLOSED pgs=189 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f24004000 tx=0x7f4f24004770 comp rx=0 tx=0).stop 2026-02-12T18:17:07.029 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:17:07.029 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:17:07.029 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:17:07.029 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:17:07.029 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 92, 2026-02-12T18:17:07.029 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 272698, 2026-02-12T18:17:07.029 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:17:07.029 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:17:07.030 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:17:07.030 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:17:07.030 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:17:07.030 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:17:07.030 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:17:07.030 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:17:07.030 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:17:07.030 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:17:07.030 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:07.030 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:17:07.030 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:17:07.030 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:17:07.030 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:17:07.030 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:07.030 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:07.030 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:07.030 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:07.030 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:07.030 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:07.030 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:07.030 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:07.030 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:07.030 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:07.030 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:07.031 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:07.031 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:07.031 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:07.031 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:17:07.031 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:17:07.031 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:07.031 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:07.031 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:07.031 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:07.031 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:07.031 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:07.031 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:07.031 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:07.031 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:07.031 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:07.031 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:07.031 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:07.031 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:07.031 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.031 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.031 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:17:07.031 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:17:07.031 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:17:07.031 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:17:07.031 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:17:07.032 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:17:07.032 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:17:07.032 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:17:07.032 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:17:07.032 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:17:07.032 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:17:07.032 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:17:07.032 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:17:07.032 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:17:07.032 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:17:07.032 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:17:07.032 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:17:07.032 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:07.032 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:07.032 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:07.032 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:07.032 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:07.032 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:07.032 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:07.032 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:07.032 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:07.032 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:07.032 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:07.032 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:07.032 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:07.033 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:07.033 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:17:07.033 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.033 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:17:07.033 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.033 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:17:07.033 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:17:07.033 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.033 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.033 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.033 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.033 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:17:07.033 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.033 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.033 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.033 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.033 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:17:07.033 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.033 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.033 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.033 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.033 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:17:07.033 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:17:07.033 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.034 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.034 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:17:07.034 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.034 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.034 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.034 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:17:07.034 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:17:07.034 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.034 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.034 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.034 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.034 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:17:07.034 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.034 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.034 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.034 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.034 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:17:07.034 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.034 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.034 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.034 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.034 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:17:07.034 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:17:07.034 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.034 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.035 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:17:07.035 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.035 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.035 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.035 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:17:07.035 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:17:07.035 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.035 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.035 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.035 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.035 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:17:07.035 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.035 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.035 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.035 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.035 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:17:07.035 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.035 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.035 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.035 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.035 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:17:07.035 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:17:07.035 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.035 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.035 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:17:07.036 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.036 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.036 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.036 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:17:07.036 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:17:07.036 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.036 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.036 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.036 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.036 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:17:07.036 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.036 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.036 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.036 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.036 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:17:07.036 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.036 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.036 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.036 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.036 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:17:07.036 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:17:07.036 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.036 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.036 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:17:07.036 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.037 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.037 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.037 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:17:07.037 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:17:07.037 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.037 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.037 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.037 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.037 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:17:07.037 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.037 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.037 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.037 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.037 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:17:07.037 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.037 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.037 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.037 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.037 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:17:07.037 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:17:07.037 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.037 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.037 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:17:07.037 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.037 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.038 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.038 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:17:07.038 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:17:07.038 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.038 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.038 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.038 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.038 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:17:07.038 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.038 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.038 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.038 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.038 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:17:07.038 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.038 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.038 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.038 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.038 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:17:07.038 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:17:07.038 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.038 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.038 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:17:07.038 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.038 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:17:07.039 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:17:07.040 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.040 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.040 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.040 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.040 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:17:07.040 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.040 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.040 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.040 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.040 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:17:07.040 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.040 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.040 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.040 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.040 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:17:07.040 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:17:07.040 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.040 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.040 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:17:07.040 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.040 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.040 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.040 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:17:07.040 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:17:07.040 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.040 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:17:07.041 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:17:07.042 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.042 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:07.042 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:17:07.042 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.042 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:17:07.042 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:17:07.042 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:17:07.042 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.042 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:07.042 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:17:07.042 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.042 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:17:07.042 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:17:07.042 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:17:07.042 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.042 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.042 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.042 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:17:07.042 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:17:07.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.025+0000 7f4f3b207640 1 -- 10.20.193.48:0/3746438605 >> v2:10.20.193.111:6812/977811348 conn(0x7f4f0403f800 msgr2=0x7f4f0405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.025+0000 7f4f3b207640 1 --2- 10.20.193.48:0/3746438605 >> v2:10.20.193.111:6812/977811348 conn(0x7f4f0403f800 0x7f4f0405fcb0 secure :-1 s=READY pgs=476 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f3000a830 tx=0x7f4f30034000 comp rx=0 tx=0).stop 2026-02-12T18:17:07.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.025+0000 7f4f3b207640 10 monclient: shutdown 2026-02-12T18:17:07.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.025+0000 7f4f3b207640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:07.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.025+0000 7f4f3b207640 1 -- 10.20.193.48:0/3746438605 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4f3408e210 msgr2=0x7f4f341a22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.025+0000 7f4f3977d640 1 -- 10.20.193.48:0/3746438605 reap_dead start 2026-02-12T18:17:07.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.025+0000 7f4f3b207640 1 --2- 10.20.193.48:0/3746438605 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4f3408e210 0x7f4f341a22d0 secure :-1 s=READY pgs=468 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4f1c0093f0 tx=0x7f4f1c00ed50 comp rx=0 tx=0).stop 2026-02-12T18:17:07.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.025+0000 7f4f3b207640 1 -- 10.20.193.48:0/3746438605 shutdown_connections 2026-02-12T18:17:07.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.025+0000 7f4f3b207640 1 --2- 10.20.193.48:0/3746438605 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f4f3408e210 0x7f4f341a22d0 unknown :-1 s=CLOSED pgs=468 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.025+0000 7f4f3b207640 1 -- 10.20.193.48:0/3746438605 >> 10.20.193.48:0/3746438605 conn(0x7f4f340548a0 msgr2=0x7f4f3408e810 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:07.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.025+0000 7f4f3b207640 1 -- 10.20.193.48:0/3746438605 shutdown_connections 2026-02-12T18:17:07.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.025+0000 7f4f3b207640 1 -- 10.20.193.48:0/3746438605 wait complete. 2026-02-12T18:17:07.044 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:17:07.044 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2026-02-12T18:17:07.044 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2026-02-12T18:17:07.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495c6cc640 10 monclient: get_monmap_and_config 2026-02-12T18:17:07.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495c6cc640 10 monclient: build_initial_monmap 2026-02-12T18:17:07.111 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495c6cc640 10 monclient: monmap: 2026-02-12T18:17:07.111 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:07.111 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.111 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:07.111121+0000 2026-02-12T18:17:07.111 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:07.111121+0000 2026-02-12T18:17:07.111 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:07.111 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.111 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:07.111 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:07.111 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:07.111 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:07.111 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:07.111 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:07.111 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:07.111 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:07.111 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:07.112 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:07.112 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:07.112 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495c6cc640 1 Processor -- start 2026-02-12T18:17:07.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495c6cc640 1 -- start start 2026-02-12T18:17:07.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495c6cc640 10 monclient: init 2026-02-12T18:17:07.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495c6cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:07.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495c6cc640 10 monclient: _add_conns ranks=[0,5,9,10,1,8,2,3,4,7,6] 2026-02-12T18:17:07.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495c6cc640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f495405c950 addr v1:10.20.193.48:6789/0 2026-02-12T18:17:07.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495c6cc640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f495405e490 0x7f49541857b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495c6cc640 10 monclient(hunting): picked mon.noname-h con 0x7f495405e490 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:17:07.113 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495c6cc640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f495405d430 0x7f49541a5d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495c6cc640 10 monclient(hunting): picked mon.noname-a con 0x7f495405d430 addr v2:10.20.193.48:3300/0 2026-02-12T18:17:07.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495c6cc640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f495404dc20 con 0x7f495405c950 2026-02-12T18:17:07.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495c6cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495c6cc640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f495405ddd0 con 0x7f495405d430 2026-02-12T18:17:07.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495c6cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495c6cc640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f4954092990 con 0x7f495405e490 2026-02-12T18:17:07.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495c6cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:07.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495c6cc640 10 monclient(hunting): authenticate will time out at 1265.836831s 2026-02-12T18:17:07.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495ac42640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f495405d430 0x7f49541a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495a441640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f495405c950 0x7f495405cd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:44020/0 (socket says 10.20.193.48:44020) 2026-02-12T18:17:07.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495ac42640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f495405d430 0x7f49541a5d00 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:54842/0 (socket says 10.20.193.48:54842) 2026-02-12T18:17:07.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495a441640 1 -- 10.20.193.48:0/428818165 learned_addr learned my addr 10.20.193.48:0/428818165 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:17:07.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495ac42640 10 monclient(hunting): get_auth_request con 0x7f495405d430 auth_method 0 2026-02-12T18:17:07.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495ac42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495ac42640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.110+0000 7f495ac42640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.111+0000 7f495ac42640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.111+0000 7f495ac42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.111+0000 7f495ac42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.111+0000 7f4959c40640 1 --2- 10.20.193.48:0/428818165 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f495405e490 0x7f49541857b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.111+0000 7f4959c40640 10 monclient(hunting): get_auth_request con 0x7f495405e490 auth_method 0 2026-02-12T18:17:07.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.111+0000 7f4959c40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.111+0000 7f4959c40640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.114 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.111+0000 7f4959c40640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.111+0000 7f495ac42640 10 monclient(hunting): handle_auth_done global_id 7029 payload 274 2026-02-12T18:17:07.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.111+0000 7f495ac42640 1 -- 10.20.193.48:0/428818165 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f495405e490 msgr2=0x7f49541857b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:07.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.111+0000 7f495ac42640 1 --2- 10.20.193.48:0/428818165 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f495405e490 0x7f49541857b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.111+0000 7f495ac42640 1 -- 10.20.193.48:0/428818165 >> v1:10.20.193.48:6789/0 conn(0x7f495405c950 legacy=0x7f495405cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:07.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.111+0000 7f495ac42640 10 monclient: _finish_hunting 0 2026-02-12T18:17:07.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.111+0000 7f495ac42640 1 monclient: found mon.noname-a 2026-02-12T18:17:07.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.111+0000 7f495ac42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:07.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.111+0000 7f495ac42640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:17:07.115 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.111+0000 7f495ac42640 1 -- 10.20.193.48:0/428818165 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4954092c70 con 0x7f495405d430 2026-02-12T18:17:07.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.113+0000 7f495ac42640 1 -- 10.20.193.48:0/428818165 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f495405d430 msgr2=0x7f49541a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:07.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.113+0000 7f495ac42640 1 --2- 10.20.193.48:0/428818165 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f495405d430 0x7f49541a5d00 secure :-1 s=READY pgs=716 gs=2 cs=0 l=1 c_cookie=3733850626100521648 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4950005820 tx=0x7f495002fdf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d14d5c95176ab0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.113+0000 7f495943f640 1 -- 10.20.193.48:0/428818165 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4950036340 con 0x7f495405d430 2026-02-12T18:17:07.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.113+0000 7f495943f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495943f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:17:07.116 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495943f640 10 monclient: dump: 2026-02-12T18:17:07.116 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.116 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.116 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.116 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.116 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.116 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.116 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.116 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.117 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.117 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.117 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.117 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.117 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.117 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.117 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.117 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495943f640 10 monclient: _finish_auth 0 2026-02-12T18:17:07.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495943f640 10 monclient: _check_auth_tickets 2026-02-12T18:17:07.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495943f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:07.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495943f640 1 -- 10.20.193.48:0/428818165 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f49500364c0 con 0x7f495405d430 2026-02-12T18:17:07.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495c6cc640 5 monclient: authenticate success, global_id 7029 2026-02-12T18:17:07.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495c6cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:17:07.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495943f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:07.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495943f640 1 -- 10.20.193.48:0/428818165 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4950036af0 con 0x7f495405d430 2026-02-12T18:17:07.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495943f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495943f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:17:07.117 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495943f640 10 monclient: dump: 2026-02-12T18:17:07.117 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.117 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.117 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.117 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.117 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.117 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.118 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.118 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.118 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.118 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.118 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.118 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.118 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.118 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.118 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.118 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495c6cc640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:07.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495c6cc640 4 set_mon_vals no callback set 2026-02-12T18:17:07.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495c6cc640 10 monclient: shutdown 2026-02-12T18:17:07.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495c6cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:07.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495c6cc640 1 -- 10.20.193.48:0/428818165 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f495405d430 msgr2=0x7f49541a5d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495c6cc640 1 --2- 10.20.193.48:0/428818165 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f495405d430 0x7f49541a5d00 secure :-1 s=READY pgs=716 gs=2 cs=0 l=1 c_cookie=3733850626100521648 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4950005820 tx=0x7f495002fdf0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495c6cc640 1 -- 10.20.193.48:0/428818165 shutdown_connections 2026-02-12T18:17:07.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495c6cc640 1 --2- 10.20.193.48:0/428818165 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f495405d430 0x7f49541a5d00 unknown :-1 s=CLOSED pgs=716 gs=2 cs=0 l=1 c_cookie=3733850626100521648 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495c6cc640 1 --2- 10.20.193.48:0/428818165 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f495405e490 0x7f49541857b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495c6cc640 1 -- 10.20.193.48:0/428818165 >> 10.20.193.48:0/428818165 conn(0x7f49540548a0 msgr2=0x7f4954097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:07.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495c6cc640 1 -- 10.20.193.48:0/428818165 shutdown_connections 2026-02-12T18:17:07.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495c6cc640 1 -- 10.20.193.48:0/428818165 wait complete. 2026-02-12T18:17:07.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495c6cc640 10 monclient: build_initial_monmap 2026-02-12T18:17:07.118 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.114+0000 7f495c6cc640 10 monclient: monmap: 2026-02-12T18:17:07.118 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:07.119 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:07.119 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:07.119 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:07.119 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:07.119 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.119 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:07.119 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:07.119 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:07.119 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:07.119 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:07.119 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:07.119 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:07.119 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:07.119 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:07.119 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495c6cc640 1 Processor -- start 2026-02-12T18:17:07.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495c6cc640 1 -- start start 2026-02-12T18:17:07.119 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495c6cc640 10 monclient: init 2026-02-12T18:17:07.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495c6cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:07.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495c6cc640 10 monclient: _add_conns ranks=[0,8,4,3,6,7,5,1,2] 2026-02-12T18:17:07.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495c6cc640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f495405c950 0x7f495412d950 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495c6cc640 10 monclient(hunting): picked mon.noname-a con 0x7f495405c950 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:17:07.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495c6cc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f495405d430 0x7f495408d540 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495c6cc640 10 monclient(hunting): picked mon.noname-e con 0x7f495405d430 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:17:07.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495c6cc640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f495405e490 0x7f49541a55b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495c6cc640 10 monclient(hunting): picked mon.noname-c con 0x7f495405e490 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:17:07.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495c6cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495c6cc640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f4954141950 con 0x7f495405c950 2026-02-12T18:17:07.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495c6cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495c6cc640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f495408bae0 con 0x7f495405e490 2026-02-12T18:17:07.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495c6cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495c6cc640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f495408c010 con 0x7f495405d430 2026-02-12T18:17:07.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495c6cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:07.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495c6cc640 10 monclient(hunting): authenticate will time out at 1265.841508s 2026-02-12T18:17:07.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495a441640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f495405c950 0x7f495412d950 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f4959c40640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f495405d430 0x7f495408d540 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.122 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495a441640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f495405c950 0x7f495412d950 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:54850/0 (socket says 10.20.193.48:54850) 2026-02-12T18:17:07.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495a441640 1 -- 10.20.193.48:0/4091039540 learned_addr learned my addr 10.20.193.48:0/4091039540 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:07.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495a441640 10 monclient(hunting): get_auth_request con 0x7f495405c950 auth_method 0 2026-02-12T18:17:07.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495a441640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495a441640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495a441640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f4959c40640 10 monclient(hunting): get_auth_request con 0x7f495405d430 auth_method 0 2026-02-12T18:17:07.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f4959c40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f4959c40640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f4959c40640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495ac42640 1 --2- 10.20.193.48:0/4091039540 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f495405e490 0x7f49541a55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495ac42640 10 monclient(hunting): get_auth_request con 0x7f495405e490 auth_method 0 2026-02-12T18:17:07.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495ac42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495ac42640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495ac42640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495a441640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495a441640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495a441640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f4959c40640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f4959c40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f4959c40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495ac42640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495ac42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495ac42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495a441640 10 monclient(hunting): handle_auth_done global_id 7038 payload 824 2026-02-12T18:17:07.123 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495a441640 1 -- 10.20.193.48:0/4091039540 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f495405d430 msgr2=0x7f495408d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495a441640 1 --2- 10.20.193.48:0/4091039540 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f495405d430 0x7f495408d540 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495a441640 1 -- 10.20.193.48:0/4091039540 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f495405e490 msgr2=0x7f49541a55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495a441640 1 --2- 10.20.193.48:0/4091039540 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f495405e490 0x7f49541a55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495a441640 10 monclient: _finish_hunting 0 2026-02-12T18:17:07.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495a441640 1 monclient: found mon.noname-a 2026-02-12T18:17:07.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495a441640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:07.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495a441640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:17:07.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495a441640 1 -- 10.20.193.48:0/4091039540 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495000a500 con 0x7f495405c950 2026-02-12T18:17:07.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.115+0000 7f495ac42640 1 --2- 10.20.193.48:0/4091039540 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f495405e490 0x7f49541a55b0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:17:07.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f495a441640 1 -- 10.20.193.48:0/4091039540 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f495405c950 msgr2=0x7f495412d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:07.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f495a441640 1 --2- 10.20.193.48:0/4091039540 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f495405c950 0x7f495412d950 secure :-1 s=READY pgs=717 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4944007fd0 tx=0x7f494400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f493affd640 1 -- 10.20.193.48:0/4091039540 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4944005db0 con 0x7f495405c950 2026-02-12T18:17:07.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f493affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f493affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:17:07.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f493affd640 10 monclient: dump: 2026-02-12T18:17:07.124 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.124 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.124 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.124 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.124 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.124 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.124 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.124 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.124 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.125 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.125 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.125 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.125 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.125 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.125 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.125 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f493affd640 10 monclient: _finish_auth 0 2026-02-12T18:17:07.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f493affd640 10 monclient: _check_auth_tickets 2026-02-12T18:17:07.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f493affd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:07.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f493affd640 1 -- 10.20.193.48:0/4091039540 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4944007530 con 0x7f495405c950 2026-02-12T18:17:07.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f495c6cc640 5 monclient: authenticate success, global_id 7038 2026-02-12T18:17:07.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f495c6cc640 10 monclient: _renew_subs 2026-02-12T18:17:07.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f495c6cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:07.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f495c6cc640 1 -- 10.20.193.48:0/4091039540 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f495408ac50 con 0x7f495405c950 2026-02-12T18:17:07.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f493affd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:07.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f493affd640 1 -- 10.20.193.48:0/4091039540 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f49440076a0 con 0x7f495405c950 2026-02-12T18:17:07.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f493affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f493affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:17:07.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f4958c3e640 4 set_mon_vals no callback set 2026-02-12T18:17:07.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f493affd640 10 monclient: dump: 2026-02-12T18:17:07.125 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.125 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.125 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.125 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.126 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.126 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.126 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.126 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.126 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.126 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.126 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.126 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.126 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.126 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.126 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.126 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f495c6cc640 10 monclient: _renew_subs 2026-02-12T18:17:07.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f495c6cc640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:07.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f495c6cc640 1 -- 10.20.193.48:0/4091039540 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f495408a990 con 0x7f495405c950 2026-02-12T18:17:07.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f495c6cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:07.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f495c6cc640 1 --2- 10.20.193.48:0/4091039540 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49541a5af0 0x7f495413dd80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f495c6cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f495c6cc640 1 -- 10.20.193.48:0/4091039540 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f4954063180 con 0x7f49541a5af0 2026-02-12T18:17:07.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f493affd640 1 -- 10.20.193.48:0/4091039540 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f4944007070 con 0x7f495405c950 2026-02-12T18:17:07.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.118+0000 7f4959c40640 1 --2- 10.20.193.48:0/4091039540 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49541a5af0 0x7f495413dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.119+0000 7f493affd640 1 --2- 10.20.193.48:0/4091039540 >> v2:10.20.193.111:6812/977811348 conn(0x7f492403f7f0 0x7f492405fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.119+0000 7f4959c40640 10 monclient: get_auth_request con 0x7f49541a5af0 auth_method 0 2026-02-12T18:17:07.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.119+0000 7f4959c40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.119+0000 7f4959c40640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.119+0000 7f4959c40640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.119+0000 7f493affd640 1 -- 10.20.193.48:0/4091039540 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7f4944051ec0 con 0x7f495405c950 2026-02-12T18:17:07.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.119+0000 7f4959c40640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.119+0000 7f4959c40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.119+0000 7f4959c40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.119+0000 7f495ac42640 1 --2- 10.20.193.48:0/4091039540 >> v2:10.20.193.111:6812/977811348 conn(0x7f492403f7f0 0x7f492405fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.119+0000 7f495ac42640 10 monclient: get_auth_request con 0x7f492403f7f0 auth_method 0 2026-02-12T18:17:07.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.119+0000 7f4959c40640 10 monclient(hunting): handle_auth_done global_id 95041 payload 824 2026-02-12T18:17:07.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.119+0000 7f4959c40640 1 -- 10.20.193.48:0/4091039540 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f495405cd20 con 0x7f49541a5af0 2026-02-12T18:17:07.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.121+0000 7f495ac42640 1 --2- 10.20.193.48:0/4091039540 >> v2:10.20.193.111:6812/977811348 conn(0x7f492403f7f0 0x7f492405fca0 secure :-1 s=READY pgs=477 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4950031fd0 tx=0x7f495003a040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.121+0000 7f4959c40640 1 -- 10.20.193.48:0/4091039540 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49541a5af0 msgr2=0x7f495413dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:07.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.121+0000 7f4959c40640 1 --2- 10.20.193.48:0/4091039540 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49541a5af0 0x7f495413dd80 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f495408ff20 tx=0x7f4948011ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.122+0000 7f493affd640 1 -- 10.20.193.48:0/4091039540 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f494800c070 con 0x7f49541a5af0 2026-02-12T18:17:07.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.122+0000 7f493affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.122+0000 7f493affd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:17:07.128 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.122+0000 7f493affd640 10 monclient: dump: 2026-02-12T18:17:07.128 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.128 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.128 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.128 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.128 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.128 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.128 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.129 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.129 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.129 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.129 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.129 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.129 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.129 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.129 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.129 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.122+0000 7f493affd640 1 -- 10.20.193.48:0/4091039540 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f494800fa10 con 0x7f49541a5af0 2026-02-12T18:17:07.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.122+0000 7f493affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:07.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.122+0000 7f493affd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:17:07.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.122+0000 7f493affd640 1 -- 10.20.193.48:0/4091039540 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49541a5af0 msgr2=0x7f495413dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.122+0000 7f493affd640 1 --2- 10.20.193.48:0/4091039540 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49541a5af0 0x7f495413dd80 secure :-1 s=READY pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f495408ff20 tx=0x7f4948011ca0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.122+0000 7f493affd640 1 -- 10.20.193.48:0/4091039540 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49541a5af0 msgr2=0x7f495413dd80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:17:07.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.122+0000 7f493affd640 1 --2- 10.20.193.48:0/4091039540 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49541a5af0 0x7f495413dd80 secure :-1 s=CLOSED pgs=227 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f495408ff20 tx=0x7f4948011ca0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.125+0000 7f495c6cc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:17:07.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.125+0000 7f495c6cc640 1 --2- 10.20.193.48:0/4091039540 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49541a5ec0 0x7f495413e2c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.125+0000 7f495c6cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.125+0000 7f495c6cc640 1 -- 10.20.193.48:0/4091039540 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f495405f140 con 0x7f49541a5ec0 2026-02-12T18:17:07.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.125+0000 7f4959c40640 1 --2- 10.20.193.48:0/4091039540 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49541a5ec0 0x7f495413e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.125+0000 7f4959c40640 10 monclient: get_auth_request con 0x7f49541a5ec0 auth_method 0 2026-02-12T18:17:07.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.125+0000 7f4959c40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.129 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.125+0000 7f4959c40640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.125+0000 7f4959c40640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.125+0000 7f4959c40640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.125+0000 7f4959c40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.125+0000 7f4959c40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.125+0000 7f4959c40640 10 monclient(hunting): handle_auth_done global_id 95050 payload 824 2026-02-12T18:17:07.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.125+0000 7f4959c40640 1 -- 10.20.193.48:0/4091039540 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f495408b3e0 con 0x7f49541a5ec0 2026-02-12T18:17:07.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.128+0000 7f4959c40640 1 -- 10.20.193.48:0/4091039540 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49541a5ec0 msgr2=0x7f495413e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:07.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.128+0000 7f4959c40640 1 --2- 10.20.193.48:0/4091039540 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49541a5ec0 0x7f495413e2c0 secure :-1 s=READY pgs=228 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4948011ce0 tx=0x7f4948004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.128+0000 7f493affd640 1 -- 10.20.193.48:0/4091039540 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f4948003bd0 con 0x7f49541a5ec0 2026-02-12T18:17:07.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.128+0000 7f493affd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.128+0000 7f493affd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:17:07.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.128+0000 7f493affd640 10 monclient: dump: 2026-02-12T18:17:07.131 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.131 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.131 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.131 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.131 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.131 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.131 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.131 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.131 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.131 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.131 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.131 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.131 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.131 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.131 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.131 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.128+0000 7f493affd640 1 -- 10.20.193.48:0/4091039540 <== mon.1 v2:10.20.193.111:3300/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10182 (secure 0 0 0) 0x7f4948003d30 con 0x7f49541a5ec0 2026-02-12T18:17:07.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.128+0000 7f493affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:17:07.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.128+0000 7f493affd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:17:07.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.128+0000 7f493affd640 1 -- 10.20.193.48:0/4091039540 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49541a5ec0 msgr2=0x7f495413e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.128+0000 7f493affd640 1 --2- 10.20.193.48:0/4091039540 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49541a5ec0 0x7f495413e2c0 secure :-1 s=READY pgs=228 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4948011ce0 tx=0x7f4948004770 comp rx=0 tx=0).stop 2026-02-12T18:17:07.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.128+0000 7f493affd640 1 -- 10.20.193.48:0/4091039540 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49541a5ec0 msgr2=0x7f495413e2c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:17:07.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.128+0000 7f493affd640 1 --2- 10.20.193.48:0/4091039540 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f49541a5ec0 0x7f495413e2c0 unknown :-1 s=CLOSED pgs=228 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.132 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:17:07.132 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:17:07.132 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:17:07.132 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:17:07.132 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 92, 2026-02-12T18:17:07.132 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 272801, 2026-02-12T18:17:07.132 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:17:07.132 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:17:07.132 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:17:07.132 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:17:07.132 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:17:07.132 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:17:07.132 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:17:07.132 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:17:07.132 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:17:07.132 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:17:07.132 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:07.132 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:17:07.133 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:17:07.133 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:17:07.133 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:17:07.133 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:07.133 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:07.133 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:07.133 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:07.133 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:07.133 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:07.133 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:07.133 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:07.133 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:07.133 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:07.133 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:07.133 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:07.133 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:07.133 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:07.133 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:17:07.133 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:17:07.133 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:07.133 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:07.133 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:07.133 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:07.133 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:07.133 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:07.134 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:07.134 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:07.134 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:07.134 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:07.134 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:07.134 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:07.134 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:07.134 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.134 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.134 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:17:07.134 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:17:07.134 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:17:07.134 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:17:07.134 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:17:07.134 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:17:07.134 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:17:07.134 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:17:07.134 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:17:07.134 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:17:07.134 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:17:07.134 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:17:07.134 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:17:07.134 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:17:07.134 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:17:07.135 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:17:07.135 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:17:07.135 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:07.135 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:07.135 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:07.135 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:07.135 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:07.135 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:07.135 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:07.135 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:07.135 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:07.135 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:07.135 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:07.135 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:07.135 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:07.135 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:07.135 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:17:07.135 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.135 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:17:07.135 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.135 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:17:07.135 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:17:07.135 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.135 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.135 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.136 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.136 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:17:07.136 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.136 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.136 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.136 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.136 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:17:07.136 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.136 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.136 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.136 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.136 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:17:07.136 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:17:07.136 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.136 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.136 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:17:07.136 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.136 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.136 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.136 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:17:07.136 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:17:07.136 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.136 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.136 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.136 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.137 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:17:07.137 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.137 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.137 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.137 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.137 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:17:07.137 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.137 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.137 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.137 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.137 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:17:07.137 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:17:07.137 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.137 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.137 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:17:07.137 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.137 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.137 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.137 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:17:07.137 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:17:07.137 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.137 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.137 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.137 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.137 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:17:07.137 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.138 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.138 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.138 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.138 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:17:07.138 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.138 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.138 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.138 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.138 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:17:07.138 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:17:07.138 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.138 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.138 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:17:07.138 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.138 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.138 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.138 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:17:07.138 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:17:07.138 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.138 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.138 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.138 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.138 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:17:07.138 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.138 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.138 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.139 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.139 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:17:07.139 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.139 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.139 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.139 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.139 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:17:07.139 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:17:07.139 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.139 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.139 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:17:07.139 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.139 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.139 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.139 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:17:07.139 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:17:07.139 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.139 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.139 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.139 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.139 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:17:07.139 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.139 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.139 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.139 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.140 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:17:07.140 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.140 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.140 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.140 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.140 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:17:07.140 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:17:07.140 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.140 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.140 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:17:07.140 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.140 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.140 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.140 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:17:07.140 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:17:07.140 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.140 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.140 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.140 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.140 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:17:07.140 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.140 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.140 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.140 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.140 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:17:07.140 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.141 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.141 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.141 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.141 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:17:07.141 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:17:07.141 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.141 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.141 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:17:07.141 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.141 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.141 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.141 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:17:07.141 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:17:07.141 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.141 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.141 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.141 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.141 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:17:07.141 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.141 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.141 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.141 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.141 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:17:07.141 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.141 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.141 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.142 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.142 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:17:07.142 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:17:07.142 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.142 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.142 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:17:07.142 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.142 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.142 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.142 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:17:07.142 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:17:07.142 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.142 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.142 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.142 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.142 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:17:07.142 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.142 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.142 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.142 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.142 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:17:07.142 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.142 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.143 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:17:07.144 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:17:07.144 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.144 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.144 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:17:07.144 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.144 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.144 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.144 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.144 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:17:07.144 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:17:07.144 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.144 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:17:07.144 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:17:07.144 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:17:07.144 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.144 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:07.144 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:17:07.144 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.144 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:17:07.144 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:17:07.144 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:17:07.144 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.144 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:07.144 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:17:07.144 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.144 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:17:07.145 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:17:07.145 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:17:07.145 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.145 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.145 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.145 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:17:07.145 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:17:07.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.128+0000 7f495c6cc640 1 -- 10.20.193.48:0/4091039540 >> v2:10.20.193.111:6812/977811348 conn(0x7f492403f7f0 msgr2=0x7f492405fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.128+0000 7f495c6cc640 1 --2- 10.20.193.48:0/4091039540 >> v2:10.20.193.111:6812/977811348 conn(0x7f492403f7f0 0x7f492405fca0 secure :-1 s=READY pgs=477 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4950031fd0 tx=0x7f495003a040 comp rx=0 tx=0).stop 2026-02-12T18:17:07.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.128+0000 7f495c6cc640 10 monclient: shutdown 2026-02-12T18:17:07.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.128+0000 7f495c6cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:07.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.128+0000 7f495c6cc640 1 -- 10.20.193.48:0/4091039540 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f495405c950 msgr2=0x7f495412d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.128+0000 7f495c6cc640 1 --2- 10.20.193.48:0/4091039540 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f495405c950 0x7f495412d950 secure :-1 s=READY pgs=717 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f4944007fd0 tx=0x7f494400c970 comp rx=0 tx=0).stop 2026-02-12T18:17:07.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.128+0000 7f495ac42640 1 -- 10.20.193.48:0/4091039540 reap_dead start 2026-02-12T18:17:07.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.128+0000 7f495ac42640 1 -- 10.20.193.48:0/4091039540 reap_dead start 2026-02-12T18:17:07.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.128+0000 7f495c6cc640 1 -- 10.20.193.48:0/4091039540 shutdown_connections 2026-02-12T18:17:07.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.128+0000 7f495c6cc640 1 -- 10.20.193.48:0/4091039540 >> 10.20.193.48:0/4091039540 conn(0x7f49540548a0 msgr2=0x7f495413f120 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:07.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.128+0000 7f495c6cc640 1 -- 10.20.193.48:0/4091039540 shutdown_connections 2026-02-12T18:17:07.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.128+0000 7f495c6cc640 1 -- 10.20.193.48:0/4091039540 wait complete. 2026-02-12T18:17:07.146 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:17:07.146 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2026-02-12T18:17:07.146 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2026-02-12T18:17:07.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.211+0000 7f776010c640 10 monclient: get_monmap_and_config 2026-02-12T18:17:07.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.211+0000 7f776010c640 10 monclient: build_initial_monmap 2026-02-12T18:17:07.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.211+0000 7f776010c640 10 monclient: monmap: 2026-02-12T18:17:07.213 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:07.213 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.213 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:07.212255+0000 2026-02-12T18:17:07.213 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:07.212255+0000 2026-02-12T18:17:07.213 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:07.213 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.213 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:07.213 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:07.213 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:07.213 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:07.213 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:07.213 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:07.214 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:07.214 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:07.214 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:07.214 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:07.214 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:07.214 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.211+0000 7f776010c640 1 Processor -- start 2026-02-12T18:17:07.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.211+0000 7f776010c640 1 -- start start 2026-02-12T18:17:07.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.211+0000 7f776010c640 10 monclient: init 2026-02-12T18:17:07.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.211+0000 7f776010c640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:07.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.211+0000 7f776010c640 10 monclient: _add_conns ranks=[6,5,9,2,1,7,8,3,4,10,0] 2026-02-12T18:17:07.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.211+0000 7f776010c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f7758057db0 0x7f7758141140 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.211+0000 7f776010c640 10 monclient(hunting): picked mon.noname-d con 0x7f7758057db0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:17:07.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.211+0000 7f776010c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f7758090c40 0x7f77581441e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.211+0000 7f776010c640 10 monclient(hunting): picked mon.noname-h con 0x7f7758090c40 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:17:07.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.211+0000 7f776010c640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f7758091010 0x7f7758144720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.211+0000 7f776010c640 10 monclient(hunting): picked mon.noname-a con 0x7f7758091010 addr v2:10.20.193.48:3300/0 2026-02-12T18:17:07.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.211+0000 7f776010c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.211+0000 7f776010c640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f7758058180 con 0x7f7758091010 2026-02-12T18:17:07.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.211+0000 7f776010c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.211+0000 7f776010c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f7758091a60 con 0x7f7758090c40 2026-02-12T18:17:07.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.211+0000 7f776010c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.211+0000 7f776010c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f7758056ff0 con 0x7f7758057db0 2026-02-12T18:17:07.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.211+0000 7f776010c640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:07.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.211+0000 7f776010c640 10 monclient(hunting): authenticate will time out at 1265.937971s 2026-02-12T18:17:07.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775de81640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f7758057db0 0x7f7758141140 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775e682640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f7758091010 0x7f7758144720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775e682640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f7758091010 0x7f7758144720 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:54864/0 (socket says 10.20.193.48:54864) 2026-02-12T18:17:07.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775de81640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f7758057db0 0x7f7758141140 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:51770/0 (socket says 10.20.193.48:51770) 2026-02-12T18:17:07.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775e682640 1 -- 10.20.193.48:0/649170486 learned_addr learned my addr 10.20.193.48:0/649170486 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:07.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775e682640 10 monclient(hunting): get_auth_request con 0x7f7758091010 auth_method 0 2026-02-12T18:17:07.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775e682640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775e682640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775e682640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775de81640 10 monclient(hunting): get_auth_request con 0x7f7758057db0 auth_method 0 2026-02-12T18:17:07.216 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775de81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775de81640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775de81640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775d680640 1 --2- 10.20.193.48:0/649170486 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f7758090c40 0x7f77581441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775de81640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775de81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775de81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775e682640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775e682640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775e682640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775d680640 10 monclient(hunting): get_auth_request con 0x7f7758090c40 auth_method 0 2026-02-12T18:17:07.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775d680640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775d680640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775d680640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775de81640 10 monclient(hunting): handle_auth_done global_id 114153 payload 274 2026-02-12T18:17:07.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775de81640 1 -- 10.20.193.48:0/649170486 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f7758090c40 msgr2=0x7f77581441e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:07.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775de81640 1 --2- 10.20.193.48:0/649170486 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f7758090c40 0x7f77581441e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775de81640 1 -- 10.20.193.48:0/649170486 >> v2:10.20.193.48:3300/0 conn(0x7f7758091010 msgr2=0x7f7758144720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:07.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775de81640 1 --2- 10.20.193.48:0/649170486 >> v2:10.20.193.48:3300/0 conn(0x7f7758091010 0x7f7758144720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775de81640 10 monclient: _finish_hunting 0 2026-02-12T18:17:07.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775de81640 1 monclient: found mon.noname-d 2026-02-12T18:17:07.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775de81640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:07.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775de81640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:17:07.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.212+0000 7f775de81640 1 -- 10.20.193.48:0/649170486 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f775804dc20 con 0x7f7758057db0 2026-02-12T18:17:07.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.214+0000 7f775de81640 1 -- 10.20.193.48:0/649170486 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f7758057db0 msgr2=0x7f7758141140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:07.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.214+0000 7f775de81640 1 --2- 10.20.193.48:0/649170486 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f7758057db0 0x7f7758141140 secure :-1 s=READY pgs=25 gs=1 cs=0 l=1 c_cookie=6131185799380735968 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7748004740 tx=0x7f774802ed10 comp rx=0 tx=0).ready entity=mon.6 client_cookie=55165900080217e0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.214+0000 7f775ce7f640 1 -- 10.20.193.48:0/649170486 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f774802fe50 con 0x7f7758057db0 2026-02-12T18:17:07.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.214+0000 7f775ce7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.214+0000 7f775ce7f640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:17:07.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.215+0000 7f775ce7f640 10 monclient: dump: 2026-02-12T18:17:07.220 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.220 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.220 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.220 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.220 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.220 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.220 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.220 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.220 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.220 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.220 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.220 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.220 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.220 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.220 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.220 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.215+0000 7f775ce7f640 10 monclient: _finish_auth 0 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.215+0000 7f775ce7f640 10 monclient: _check_auth_tickets 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.215+0000 7f775ce7f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.215+0000 7f775ce7f640 1 -- 10.20.193.48:0/649170486 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7748035340 con 0x7f7758057db0 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.215+0000 7f776010c640 5 monclient: authenticate success, global_id 114153 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.215+0000 7f776010c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.215+0000 7f775ce7f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.215+0000 7f775ce7f640 1 -- 10.20.193.48:0/649170486 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f7748035970 con 0x7f7758057db0 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.215+0000 7f776010c640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.215+0000 7f776010c640 4 set_mon_vals no callback set 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.215+0000 7f775ce7f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.215+0000 7f775ce7f640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.215+0000 7f775ce7f640 10 monclient: dump: 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.221 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.222 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.215+0000 7f776010c640 10 monclient: shutdown 2026-02-12T18:17:07.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.215+0000 7f776010c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:07.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.215+0000 7f776010c640 1 -- 10.20.193.48:0/649170486 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f7758057db0 msgr2=0x7f7758141140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.215+0000 7f776010c640 1 --2- 10.20.193.48:0/649170486 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f7758057db0 0x7f7758141140 secure :-1 s=READY pgs=25 gs=1 cs=0 l=1 c_cookie=6131185799380735968 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f7748004740 tx=0x7f774802ed10 comp rx=0 tx=0).stop 2026-02-12T18:17:07.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.215+0000 7f776010c640 1 -- 10.20.193.48:0/649170486 shutdown_connections 2026-02-12T18:17:07.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.215+0000 7f776010c640 1 --2- 10.20.193.48:0/649170486 >> v2:10.20.193.48:3300/0 conn(0x7f7758091010 0x7f7758144720 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.215+0000 7f776010c640 1 --2- 10.20.193.48:0/649170486 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f7758090c40 0x7f77581441e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.215+0000 7f776010c640 1 --2- 10.20.193.48:0/649170486 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f7758057db0 0x7f7758141140 unknown :-1 s=CLOSED pgs=25 gs=1 cs=0 l=1 c_cookie=6131185799380735968 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.215+0000 7f776010c640 1 -- 10.20.193.48:0/649170486 >> 10.20.193.48:0/649170486 conn(0x7f7758054de0 msgr2=0x7f7758095230 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:07.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.215+0000 7f776010c640 1 -- 10.20.193.48:0/649170486 shutdown_connections 2026-02-12T18:17:07.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.215+0000 7f776010c640 1 -- 10.20.193.48:0/649170486 wait complete. 2026-02-12T18:17:07.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f776010c640 10 monclient: build_initial_monmap 2026-02-12T18:17:07.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f776010c640 10 monclient: monmap: 2026-02-12T18:17:07.222 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:07.222 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:07.222 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:07.222 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:07.222 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:07.222 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.222 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:07.222 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:07.222 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:07.222 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:07.222 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:07.222 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:07.223 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:07.223 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:07.223 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:07.223 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f776010c640 1 Processor -- start 2026-02-12T18:17:07.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f776010c640 1 -- start start 2026-02-12T18:17:07.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f776010c640 10 monclient: init 2026-02-12T18:17:07.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f776010c640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:07.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f776010c640 10 monclient: _add_conns ranks=[4,0,3,1,6,5,8,2,7] 2026-02-12T18:17:07.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f776010c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f7758057db0 0x7f77581423e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f776010c640 10 monclient(hunting): picked mon.noname-c con 0x7f7758057db0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:17:07.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f776010c640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f7758090c40 0x7f7758142920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f776010c640 10 monclient(hunting): picked mon.noname-a con 0x7f7758090c40 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:17:07.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f776010c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f7758091010 0x7f775812e370 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f776010c640 10 monclient(hunting): picked mon.noname-g con 0x7f7758091010 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:17:07.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f776010c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f776010c640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f775810c110 con 0x7f7758090c40 2026-02-12T18:17:07.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f776010c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f776010c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f7758143a10 con 0x7f7758091010 2026-02-12T18:17:07.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f776010c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f776010c640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f775810b880 con 0x7f7758057db0 2026-02-12T18:17:07.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f776010c640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:07.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f776010c640 10 monclient(hunting): authenticate will time out at 1265.942528s 2026-02-12T18:17:07.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775d680640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f7758090c40 0x7f7758142920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775de81640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f7758057db0 0x7f77581423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775d680640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f7758090c40 0x7f7758142920 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:54876/0 (socket says 10.20.193.48:54876) 2026-02-12T18:17:07.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775d680640 1 -- 10.20.193.48:0/1551182561 learned_addr learned my addr 10.20.193.48:0/1551182561 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:07.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775d680640 10 monclient(hunting): get_auth_request con 0x7f7758090c40 auth_method 0 2026-02-12T18:17:07.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775d680640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775d680640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775d680640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775de81640 10 monclient(hunting): get_auth_request con 0x7f7758057db0 auth_method 0 2026-02-12T18:17:07.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775de81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775de81640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775de81640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775d680640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775d680640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775d680640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775de81640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775de81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775de81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775e682640 1 --2- 10.20.193.48:0/1551182561 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f7758091010 0x7f775812e370 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775e682640 10 monclient(hunting): get_auth_request con 0x7f7758091010 auth_method 0 2026-02-12T18:17:07.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775e682640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775e682640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775e682640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775d680640 10 monclient(hunting): handle_auth_done global_id 7056 payload 824 2026-02-12T18:17:07.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775d680640 1 -- 10.20.193.48:0/1551182561 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f7758057db0 msgr2=0x7f77581423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775d680640 1 --2- 10.20.193.48:0/1551182561 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f7758057db0 0x7f77581423e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775d680640 1 -- 10.20.193.48:0/1551182561 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f7758091010 msgr2=0x7f775812e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775d680640 1 --2- 10.20.193.48:0/1551182561 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f7758091010 0x7f775812e370 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775d680640 10 monclient: _finish_hunting 0 2026-02-12T18:17:07.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775d680640 1 monclient: found mon.noname-a 2026-02-12T18:17:07.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775d680640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:07.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775d680640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:17:07.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.216+0000 7f775d680640 1 -- 10.20.193.48:0/1551182561 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7748009420 con 0x7f7758090c40 2026-02-12T18:17:07.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f775d680640 1 -- 10.20.193.48:0/1551182561 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f7758090c40 msgr2=0x7f7758142920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:07.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f775d680640 1 --2- 10.20.193.48:0/1551182561 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f7758090c40 0x7f7758142920 secure :-1 s=READY pgs=718 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f774c006f30 tx=0x7f774c00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f77467fc640 1 -- 10.20.193.48:0/1551182561 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f774c00ee30 con 0x7f7758090c40 2026-02-12T18:17:07.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f77467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f77467fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:17:07.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f77467fc640 10 monclient: dump: 2026-02-12T18:17:07.227 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.227 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.227 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.227 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.227 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.227 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.227 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.227 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.227 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.227 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.227 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.227 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.227 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.227 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.227 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.227 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f77467fc640 10 monclient: _finish_auth 0 2026-02-12T18:17:07.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f77467fc640 10 monclient: _check_auth_tickets 2026-02-12T18:17:07.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f77467fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f77467fc640 1 -- 10.20.193.48:0/1551182561 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f774c00cda0 con 0x7f7758090c40 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f77467fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f77467fc640 1 -- 10.20.193.48:0/1551182561 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f774c0138d0 con 0x7f7758090c40 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f776010c640 5 monclient: authenticate success, global_id 7056 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f776010c640 10 monclient: _renew_subs 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f7747fff640 4 set_mon_vals no callback set 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f776010c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f776010c640 1 -- 10.20.193.48:0/1551182561 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7758056430 con 0x7f7758090c40 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f77467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f77467fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f77467fc640 10 monclient: dump: 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.228 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f776010c640 10 monclient: _renew_subs 2026-02-12T18:17:07.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f776010c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:07.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f776010c640 1 -- 10.20.193.48:0/1551182561 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f775810be30 con 0x7f7758090c40 2026-02-12T18:17:07.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f776010c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:07.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f776010c640 1 --2- 10.20.193.48:0/1551182561 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f775812e8b0 0x7f775812ec80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f776010c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.219+0000 7f776010c640 1 -- 10.20.193.48:0/1551182561 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f7758094410 con 0x7f775812e8b0 2026-02-12T18:17:07.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.220+0000 7f77467fc640 1 -- 10.20.193.48:0/1551182561 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f774c013410 con 0x7f7758090c40 2026-02-12T18:17:07.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.220+0000 7f775de81640 1 --2- 10.20.193.48:0/1551182561 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f775812e8b0 0x7f775812ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.220+0000 7f775de81640 10 monclient: get_auth_request con 0x7f775812e8b0 auth_method 0 2026-02-12T18:17:07.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.220+0000 7f775de81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.220+0000 7f775de81640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.220+0000 7f775de81640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.220+0000 7f77467fc640 1 --2- 10.20.193.48:0/1551182561 >> v2:10.20.193.111:6812/977811348 conn(0x7f772803f7f0 0x7f772805fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.220+0000 7f77467fc640 1 -- 10.20.193.48:0/1551182561 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7f774c052ae0 con 0x7f7758090c40 2026-02-12T18:17:07.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.220+0000 7f775de81640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.220+0000 7f775de81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.220+0000 7f775de81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.220+0000 7f775e682640 1 --2- 10.20.193.48:0/1551182561 >> v2:10.20.193.111:6812/977811348 conn(0x7f772803f7f0 0x7f772805fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.220+0000 7f775e682640 10 monclient: get_auth_request con 0x7f772803f7f0 auth_method 0 2026-02-12T18:17:07.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.220+0000 7f775de81640 10 monclient(hunting): handle_auth_done global_id 104331 payload 824 2026-02-12T18:17:07.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.220+0000 7f775de81640 1 -- 10.20.193.48:0/1551182561 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f77580562b0 con 0x7f775812e8b0 2026-02-12T18:17:07.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.222+0000 7f775e682640 1 --2- 10.20.193.48:0/1551182561 >> v2:10.20.193.111:6812/977811348 conn(0x7f772803f7f0 0x7f772805fca0 secure :-1 s=READY pgs=478 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f775400a140 tx=0x7f7754009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.223+0000 7f775de81640 1 -- 10.20.193.48:0/1551182561 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f775812e8b0 msgr2=0x7f775812ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:07.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.223+0000 7f775de81640 1 --2- 10.20.193.48:0/1551182561 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f775812e8b0 0x7f775812ec80 secure :-1 s=READY pgs=71 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77480090b0 tx=0x7f77480047e0 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.223+0000 7f77467fc640 1 -- 10.20.193.48:0/1551182561 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f774802fdb0 con 0x7f775812e8b0 2026-02-12T18:17:07.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.223+0000 7f77467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.223+0000 7f77467fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:17:07.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.223+0000 7f77467fc640 10 monclient: dump: 2026-02-12T18:17:07.230 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.230 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.230 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.230 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.230 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.230 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.230 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.230 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.230 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.230 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.230 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.230 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.230 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.230 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.230 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.230 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.223+0000 7f77467fc640 1 -- 10.20.193.48:0/1551182561 <== mon.3 v2:10.20.193.111:3301/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f7748004040 con 0x7f775812e8b0 2026-02-12T18:17:07.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.223+0000 7f77467fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:07.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.223+0000 7f77467fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:17:07.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.223+0000 7f77467fc640 1 -- 10.20.193.48:0/1551182561 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f775812e8b0 msgr2=0x7f775812ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.223+0000 7f77467fc640 1 --2- 10.20.193.48:0/1551182561 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f775812e8b0 0x7f775812ec80 secure :-1 s=READY pgs=71 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77480090b0 tx=0x7f77480047e0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.223+0000 7f77467fc640 1 -- 10.20.193.48:0/1551182561 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f775812e8b0 msgr2=0x7f775812ec80 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:17:07.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.223+0000 7f77467fc640 1 --2- 10.20.193.48:0/1551182561 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f775812e8b0 0x7f775812ec80 secure :-1 s=CLOSED pgs=71 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77480090b0 tx=0x7f77480047e0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.227+0000 7f776010c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:17:07.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.227+0000 7f776010c640 1 --2- 10.20.193.48:0/1551182561 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f775810c330 0x7f7758121820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.227+0000 7f776010c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.227+0000 7f776010c640 1 -- 10.20.193.48:0/1551182561 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f7758050410 con 0x7f775810c330 2026-02-12T18:17:07.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.227+0000 7f775de81640 1 --2- 10.20.193.48:0/1551182561 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f775810c330 0x7f7758121820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.227+0000 7f775de81640 10 monclient: get_auth_request con 0x7f775810c330 auth_method 0 2026-02-12T18:17:07.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.227+0000 7f775de81640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.227+0000 7f775de81640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.227+0000 7f775de81640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.227+0000 7f775de81640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.227+0000 7f775de81640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.227+0000 7f775de81640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.227+0000 7f775de81640 10 monclient(hunting): handle_auth_done global_id 104340 payload 824 2026-02-12T18:17:07.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.227+0000 7f775de81640 1 -- 10.20.193.48:0/1551182561 --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f77580575b0 con 0x7f775810c330 2026-02-12T18:17:07.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.230+0000 7f775de81640 1 -- 10.20.193.48:0/1551182561 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f775810c330 msgr2=0x7f7758121820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:07.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.230+0000 7f775de81640 1 --2- 10.20.193.48:0/1551182561 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f775810c330 0x7f7758121820 secure :-1 s=READY pgs=72 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77480023d0 tx=0x7f7748004770 comp rx=0 tx=0).ready entity=mon.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.230+0000 7f77467fc640 1 -- 10.20.193.48:0/1551182561 <== mon.3 v2:10.20.193.111:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f7748052070 con 0x7f775810c330 2026-02-12T18:17:07.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.230+0000 7f77467fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.230+0000 7f77467fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2026-02-12T18:17:07.232 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.230+0000 7f77467fc640 10 monclient: dump: 2026-02-12T18:17:07.232 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.232 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.232 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.232 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.232 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.232 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.232 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.233 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.233 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.233 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.233 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.233 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.233 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.233 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.233 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.233 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.230+0000 7f77467fc640 1 -- 10.20.193.48:0/1551182561 <== mon.3 v2:10.20.193.111:3301/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10182 (secure 0 0 0) 0x7f7748003d00 con 0x7f775810c330 2026-02-12T18:17:07.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.230+0000 7f77467fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:17:07.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.230+0000 7f77467fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:17:07.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.230+0000 7f77467fc640 1 -- 10.20.193.48:0/1551182561 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f775810c330 msgr2=0x7f7758121820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.230+0000 7f77467fc640 1 --2- 10.20.193.48:0/1551182561 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f775810c330 0x7f7758121820 secure :-1 s=READY pgs=72 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77480023d0 tx=0x7f7748004770 comp rx=0 tx=0).stop 2026-02-12T18:17:07.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.230+0000 7f77467fc640 1 -- 10.20.193.48:0/1551182561 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f775810c330 msgr2=0x7f7758121820 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:17:07.233 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.230+0000 7f77467fc640 1 --2- 10.20.193.48:0/1551182561 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f775810c330 0x7f7758121820 secure :-1 s=CLOSED pgs=72 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f77480023d0 tx=0x7f7748004770 comp rx=0 tx=0).stop 2026-02-12T18:17:07.233 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:17:07.233 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:17:07.233 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:17:07.233 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:17:07.234 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 92, 2026-02-12T18:17:07.234 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 146223, 2026-02-12T18:17:07.234 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:17:07.234 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:17:07.234 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:17:07.234 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:17:07.234 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:17:07.234 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:17:07.234 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:17:07.234 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:17:07.234 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:17:07.234 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:17:07.234 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:07.234 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 0, 2026-02-12T18:17:07.234 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:17:07.234 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:17:07.234 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:17:07.234 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:07.234 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:07.234 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:07.234 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:07.234 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:07.234 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:07.234 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:07.234 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:07.234 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:07.235 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:07.235 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:07.235 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:07.235 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:07.235 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:07.235 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:17:07.235 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:17:07.235 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:07.235 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:07.235 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:07.235 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:07.235 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:07.235 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:07.235 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:07.235 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:07.235 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:07.235 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:07.235 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:07.235 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:07.235 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:07.235 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.235 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.235 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:17:07.235 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:17:07.235 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:17:07.236 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:17:07.236 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:17:07.236 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:17:07.236 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:17:07.236 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:17:07.236 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:17:07.236 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:17:07.236 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:17:07.236 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:17:07.236 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:17:07.236 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:17:07.236 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:17:07.236 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:17:07.236 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:17:07.236 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:07.236 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:07.236 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:07.236 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:07.236 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:07.236 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:07.236 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:07.236 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:07.236 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:07.236 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:07.236 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:07.236 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:07.237 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:07.237 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:07.237 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:17:07.237 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.237 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:17:07.237 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.237 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:17:07.237 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:17:07.237 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.237 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.237 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.237 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.237 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:17:07.237 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.237 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.237 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.237 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.237 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:17:07.237 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.237 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.237 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.237 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.237 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:17:07.237 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:17:07.237 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.237 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.238 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:17:07.238 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.238 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.238 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.238 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:17:07.238 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:17:07.238 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.238 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.238 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.238 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.238 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:17:07.238 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.238 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.238 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.238 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.238 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:17:07.238 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.238 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.238 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.238 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.238 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:17:07.238 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:17:07.238 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.238 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.238 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:17:07.238 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.239 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.239 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.239 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:17:07.239 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:17:07.239 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.239 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.239 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.239 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.239 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:17:07.239 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.239 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.239 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.239 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.239 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:17:07.239 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.239 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.239 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.239 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.239 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:17:07.239 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:17:07.239 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.239 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.239 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:17:07.239 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.239 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.239 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:17:07.240 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.241 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.241 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.241 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.241 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:17:07.241 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.241 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.241 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.241 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.241 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:17:07.241 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.241 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.241 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.241 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.241 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:17:07.241 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:17:07.241 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.241 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.241 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:17:07.241 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.241 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.241 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.241 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:17:07.241 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:17:07.241 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.241 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.241 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.242 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.242 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:17:07.242 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.242 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.242 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.242 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.242 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:17:07.242 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.242 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.242 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.242 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.242 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:17:07.242 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:17:07.242 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.242 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.242 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:17:07.242 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.242 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.242 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.242 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:17:07.242 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:17:07.242 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.242 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.242 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.242 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.242 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:17:07.243 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.243 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.243 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.243 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.243 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:17:07.243 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.243 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.243 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.243 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.243 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:17:07.243 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:17:07.243 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.243 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.243 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:17:07.243 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.243 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.243 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.243 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:17:07.243 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:17:07.243 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.243 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.243 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.243 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.243 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:17:07.243 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.243 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.244 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.244 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.244 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:17:07.244 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.244 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.244 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.244 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.244 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:17:07.244 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:17:07.244 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.244 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.244 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:17:07.244 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.244 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.244 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.244 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:17:07.244 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:17:07.244 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.244 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.244 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.244 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.244 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:17:07.244 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.244 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.244 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.244 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.245 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:17:07.245 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.245 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.245 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.245 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.245 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:17:07.245 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:17:07.245 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.245 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.245 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:17:07.245 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.245 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.245 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.245 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.245 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:17:07.245 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:17:07.245 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.245 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:17:07.245 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:17:07.245 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:17:07.245 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.245 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:07.245 INFO:teuthology.orchestra.run.trial048.stdout: "osd": [ 2026-02-12T18:17:07.245 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.245 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:17:07.245 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:17:07.246 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:17:07.246 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.246 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:07.246 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:17:07.246 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.246 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:17:07.246 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:17:07.246 INFO:teuthology.orchestra.run.trial048.stdout: "num": 2 2026-02-12T18:17:07.246 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.246 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.246 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.246 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:17:07.246 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:17:07.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.230+0000 7f776010c640 1 -- 10.20.193.48:0/1551182561 >> v2:10.20.193.111:6812/977811348 conn(0x7f772803f7f0 msgr2=0x7f772805fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.230+0000 7f776010c640 1 --2- 10.20.193.48:0/1551182561 >> v2:10.20.193.111:6812/977811348 conn(0x7f772803f7f0 0x7f772805fca0 secure :-1 s=READY pgs=478 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f775400a140 tx=0x7f7754009040 comp rx=0 tx=0).stop 2026-02-12T18:17:07.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.230+0000 7f776010c640 10 monclient: shutdown 2026-02-12T18:17:07.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.230+0000 7f776010c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:07.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.230+0000 7f776010c640 1 -- 10.20.193.48:0/1551182561 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f7758090c40 msgr2=0x7f7758142920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.230+0000 7f775e682640 1 -- 10.20.193.48:0/1551182561 reap_dead start 2026-02-12T18:17:07.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.230+0000 7f776010c640 1 --2- 10.20.193.48:0/1551182561 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f7758090c40 0x7f7758142920 secure :-1 s=READY pgs=718 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f774c006f30 tx=0x7f774c00ebd0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.230+0000 7f776010c640 1 -- 10.20.193.48:0/1551182561 shutdown_connections 2026-02-12T18:17:07.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.230+0000 7f776010c640 1 --2- 10.20.193.48:0/1551182561 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f7758090c40 0x7f7758142920 unknown :-1 s=CLOSED pgs=718 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.230+0000 7f776010c640 1 -- 10.20.193.48:0/1551182561 >> 10.20.193.48:0/1551182561 conn(0x7f7758054de0 msgr2=0x7f7758140960 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:07.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.230+0000 7f776010c640 1 -- 10.20.193.48:0/1551182561 shutdown_connections 2026-02-12T18:17:07.247 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.230+0000 7f776010c640 1 -- 10.20.193.48:0/1551182561 wait complete. 2026-02-12T18:17:07.247 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:17:07.247 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2026-02-12T18:17:07.248 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2026-02-12T18:17:07.314 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.313+0000 7f9c9685b640 10 monclient: get_monmap_and_config 2026-02-12T18:17:07.314 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.313+0000 7f9c9685b640 10 monclient: build_initial_monmap 2026-02-12T18:17:07.314 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.313+0000 7f9c9685b640 10 monclient: monmap: 2026-02-12T18:17:07.314 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:07.314 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.314 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:07.314235+0000 2026-02-12T18:17:07.314 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:07.314235+0000 2026-02-12T18:17:07.314 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:07.314 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.314 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:07.314 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:07.314 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:07.314 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:07.314 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:07.314 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:07.315 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:07.315 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:07.315 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:07.315 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:07.315 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:07.315 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.313+0000 7f9c9685b640 1 Processor -- start 2026-02-12T18:17:07.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.313+0000 7f9c9685b640 1 -- start start 2026-02-12T18:17:07.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.313+0000 7f9c9685b640 10 monclient: init 2026-02-12T18:17:07.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.313+0000 7f9c9685b640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:07.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.313+0000 7f9c9685b640 10 monclient: _add_conns ranks=[3,0,4,10,2,9,6,8,5,7,1] 2026-02-12T18:17:07.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.313+0000 7f9c9685b640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9c9005c950 0x7f9c9005cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.313+0000 7f9c9685b640 10 monclient(hunting): picked mon.noname-g con 0x7f9c9005c950 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:17:07.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.313+0000 7f9c9685b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f9c9005e490 addr v1:10.20.193.48:6789/0 2026-02-12T18:17:07.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.313+0000 7f9c9685b640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9c9005d260 0x7f9c9013e280 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.313+0000 7f9c9685b640 10 monclient(hunting): picked mon.noname-c con 0x7f9c9005d260 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:17:07.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.313+0000 7f9c9685b640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c9004dc20 con 0x7f9c9005e490 2026-02-12T18:17:07.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.313+0000 7f9c9685b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.313+0000 7f9c9685b640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f9c9005ddd0 con 0x7f9c9005c950 2026-02-12T18:17:07.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.313+0000 7f9c9685b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.313+0000 7f9c9685b640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f9c90092990 con 0x7f9c9005d260 2026-02-12T18:17:07.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.313+0000 7f9c9685b640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:07.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.313+0000 7f9c9685b640 10 monclient(hunting): authenticate will time out at 1266.039969s 2026-02-12T18:17:07.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c8f7fe640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f9c9005e490 0x7f9c9013db70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:44026/0 (socket says 10.20.193.48:44026) 2026-02-12T18:17:07.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c8f7fe640 1 -- 10.20.193.48:0/2812303298 learned_addr learned my addr 10.20.193.48:0/2812303298 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:17:07.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c94dd1640 1 --2- 10.20.193.48:0/2812303298 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9c9005d260 0x7f9c9013e280 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c94dd1640 10 monclient(hunting): get_auth_request con 0x7f9c9005d260 auth_method 0 2026-02-12T18:17:07.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c94dd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c94dd1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c94dd1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c8ffff640 1 --2- 10.20.193.48:0/2812303298 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9c9005c950 0x7f9c9005cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c8ffff640 10 monclient(hunting): get_auth_request con 0x7f9c9005c950 auth_method 0 2026-02-12T18:17:07.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c8ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c8ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c8ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c94dd1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c94dd1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c94dd1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c8ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c8ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c8ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c94dd1640 10 monclient(hunting): handle_auth_done global_id 65299 payload 274 2026-02-12T18:17:07.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c94dd1640 1 -- 10.20.193.48:0/2812303298 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9c9005c950 msgr2=0x7f9c9005cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:07.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c94dd1640 1 --2- 10.20.193.48:0/2812303298 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9c9005c950 0x7f9c9005cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c94dd1640 1 -- 10.20.193.48:0/2812303298 >> v1:10.20.193.48:6789/0 conn(0x7f9c9005e490 legacy=0x7f9c9013db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:07.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c94dd1640 10 monclient: _finish_hunting 0 2026-02-12T18:17:07.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c94dd1640 1 monclient: found mon.noname-c 2026-02-12T18:17:07.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c94dd1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:07.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c94dd1640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:17:07.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.314+0000 7f9c94dd1640 1 -- 10.20.193.48:0/2812303298 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c90092c70 con 0x7f9c9005d260 2026-02-12T18:17:07.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.316+0000 7f9c94dd1640 1 -- 10.20.193.48:0/2812303298 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9c9005d260 msgr2=0x7f9c9013e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:07.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.316+0000 7f9c94dd1640 1 --2- 10.20.193.48:0/2812303298 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9c9005d260 0x7f9c9013e280 secure :-1 s=READY pgs=275 gs=2 cs=0 l=1 c_cookie=2886619249846187528 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c8400a910 tx=0x7f9c8402fdb0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=280f54e9ece2f608 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.316+0000 7f9c8effd640 1 -- 10.20.193.48:0/2812303298 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9c84036340 con 0x7f9c9005d260 2026-02-12T18:17:07.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.316+0000 7f9c8effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.317+0000 7f9c8effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:17:07.319 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.317+0000 7f9c8effd640 10 monclient: dump: 2026-02-12T18:17:07.319 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.319 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.319 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.319 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.319 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.319 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.319 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.319 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.319 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.319 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.319 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.319 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.319 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.319 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.319 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.317+0000 7f9c8effd640 10 monclient: _finish_auth 0 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.317+0000 7f9c8effd640 10 monclient: _check_auth_tickets 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.317+0000 7f9c8effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.317+0000 7f9c8effd640 1 -- 10.20.193.48:0/2812303298 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c840364c0 con 0x7f9c9005d260 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.317+0000 7f9c8effd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.317+0000 7f9c8effd640 1 -- 10.20.193.48:0/2812303298 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9c84036af0 con 0x7f9c9005d260 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.317+0000 7f9c8effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.317+0000 7f9c8effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.317+0000 7f9c8effd640 10 monclient: dump: 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.320 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.317+0000 7f9c9685b640 5 monclient: authenticate success, global_id 65299 2026-02-12T18:17:07.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.317+0000 7f9c9685b640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:07.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.317+0000 7f9c9685b640 4 set_mon_vals no callback set 2026-02-12T18:17:07.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.317+0000 7f9c9685b640 10 monclient: shutdown 2026-02-12T18:17:07.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.317+0000 7f9c9685b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:07.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.317+0000 7f9c9685b640 1 -- 10.20.193.48:0/2812303298 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9c9005d260 msgr2=0x7f9c9013e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.317+0000 7f9c9685b640 1 --2- 10.20.193.48:0/2812303298 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9c9005d260 0x7f9c9013e280 secure :-1 s=READY pgs=275 gs=2 cs=0 l=1 c_cookie=2886619249846187528 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c8400a910 tx=0x7f9c8402fdb0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.317+0000 7f9c9685b640 1 -- 10.20.193.48:0/2812303298 shutdown_connections 2026-02-12T18:17:07.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.317+0000 7f9c9685b640 1 --2- 10.20.193.48:0/2812303298 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f9c9005d260 0x7f9c9013e280 unknown :-1 s=CLOSED pgs=275 gs=2 cs=0 l=1 c_cookie=2886619249846187528 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.317+0000 7f9c9685b640 1 --2- 10.20.193.48:0/2812303298 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f9c9005c950 0x7f9c9005cd20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.317+0000 7f9c9685b640 1 -- 10.20.193.48:0/2812303298 >> 10.20.193.48:0/2812303298 conn(0x7f9c900548a0 msgr2=0x7f9c90097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:07.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.317+0000 7f9c9685b640 1 -- 10.20.193.48:0/2812303298 shutdown_connections 2026-02-12T18:17:07.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.317+0000 7f9c9685b640 1 -- 10.20.193.48:0/2812303298 wait complete. 2026-02-12T18:17:07.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.317+0000 7f9c9685b640 10 monclient: build_initial_monmap 2026-02-12T18:17:07.321 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.317+0000 7f9c9685b640 10 monclient: monmap: 2026-02-12T18:17:07.321 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:07.321 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:07.321 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:07.321 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:07.321 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:07.321 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.321 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:07.321 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:07.321 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:07.321 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:07.321 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:07.321 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:07.322 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:07.322 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:07.322 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:07.322 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c9685b640 1 Processor -- start 2026-02-12T18:17:07.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c9685b640 1 -- start start 2026-02-12T18:17:07.322 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c9685b640 10 monclient: init 2026-02-12T18:17:07.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c9685b640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:07.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c9685b640 10 monclient: _add_conns ranks=[5,2,0,8,6,7,3,1,4] 2026-02-12T18:17:07.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c9685b640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9c9005c950 0x7f9c9012da90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c9685b640 10 monclient(hunting): picked mon.noname-h con 0x7f9c9005c950 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:17:07.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c9685b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9c9005d260 0x7f9c9008d440 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c9685b640 10 monclient(hunting): picked mon.noname-b con 0x7f9c9005d260 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:17:07.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c9685b640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9c9005e490 0x7f9c9013dec0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c9685b640 10 monclient(hunting): picked mon.noname-a con 0x7f9c9005e490 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:17:07.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c9685b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c9685b640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f9c90142bb0 con 0x7f9c9005e490 2026-02-12T18:17:07.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c9685b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c9685b640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f9c9008bc30 con 0x7f9c9005d260 2026-02-12T18:17:07.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c9685b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c9685b640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f9c90142570 con 0x7f9c9005c950 2026-02-12T18:17:07.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c9685b640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:07.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c9685b640 10 monclient(hunting): authenticate will time out at 1266.044389s 2026-02-12T18:17:07.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c94dd1640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9c9005e490 0x7f9c9013dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c8f7fe640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9c9005d260 0x7f9c9008d440 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c94dd1640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9c9005e490 0x7f9c9013dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:54882/0 (socket says 10.20.193.48:54882) 2026-02-12T18:17:07.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c94dd1640 1 -- 10.20.193.48:0/1086110027 learned_addr learned my addr 10.20.193.48:0/1086110027 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:07.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c8f7fe640 10 monclient(hunting): get_auth_request con 0x7f9c9005d260 auth_method 0 2026-02-12T18:17:07.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c8f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c8f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c8f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c94dd1640 10 monclient(hunting): get_auth_request con 0x7f9c9005e490 auth_method 0 2026-02-12T18:17:07.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c94dd1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c94dd1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c94dd1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c8f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c8f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c8f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c94dd1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c94dd1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c94dd1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c8ffff640 1 --2- 10.20.193.48:0/1086110027 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9c9005c950 0x7f9c9012da90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c8ffff640 10 monclient(hunting): get_auth_request con 0x7f9c9005c950 auth_method 0 2026-02-12T18:17:07.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c8ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c8ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c8ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c94dd1640 10 monclient(hunting): handle_auth_done global_id 7065 payload 824 2026-02-12T18:17:07.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c94dd1640 1 -- 10.20.193.48:0/1086110027 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9c9005c950 msgr2=0x7f9c9012da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c94dd1640 1 --2- 10.20.193.48:0/1086110027 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9c9005c950 0x7f9c9012da90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c94dd1640 1 -- 10.20.193.48:0/1086110027 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9c9005d260 msgr2=0x7f9c9008d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c94dd1640 1 --2- 10.20.193.48:0/1086110027 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9c9005d260 0x7f9c9008d440 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c94dd1640 10 monclient: _finish_hunting 0 2026-02-12T18:17:07.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c94dd1640 1 monclient: found mon.noname-a 2026-02-12T18:17:07.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c94dd1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:07.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c94dd1640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:17:07.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c94dd1640 1 -- 10.20.193.48:0/1086110027 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c8400a500 con 0x7f9c9005e490 2026-02-12T18:17:07.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.318+0000 7f9c8f7fe640 1 --2- 10.20.193.48:0/1086110027 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f9c9005d260 0x7f9c9008d440 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:17:07.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.320+0000 7f9c94dd1640 1 -- 10.20.193.48:0/1086110027 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9c9005e490 msgr2=0x7f9c9013dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:07.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.320+0000 7f9c94dd1640 1 --2- 10.20.193.48:0/1086110027 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9c9005e490 0x7f9c9013dec0 secure :-1 s=READY pgs=720 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c8400aa10 tx=0x7f9c84005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.320+0000 7f9c8cff9640 1 -- 10.20.193.48:0/1086110027 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9c84036d80 con 0x7f9c9005e490 2026-02-12T18:17:07.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.320+0000 7f9c8cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c8cff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:17:07.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c8cff9640 10 monclient: dump: 2026-02-12T18:17:07.326 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.326 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.326 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.326 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.326 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.326 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.326 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.327 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.327 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.327 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.327 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.327 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.327 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.327 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.327 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.327 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c8cff9640 10 monclient: _finish_auth 0 2026-02-12T18:17:07.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c8cff9640 10 monclient: _check_auth_tickets 2026-02-12T18:17:07.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c8cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:07.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c8cff9640 1 -- 10.20.193.48:0/1086110027 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c840054f0 con 0x7f9c9005e490 2026-02-12T18:17:07.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c8cff9640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:07.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c8cff9640 1 -- 10.20.193.48:0/1086110027 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9c84005660 con 0x7f9c9005e490 2026-02-12T18:17:07.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c8cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c8cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:17:07.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c8e7fc640 4 set_mon_vals no callback set 2026-02-12T18:17:07.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c8cff9640 10 monclient: dump: 2026-02-12T18:17:07.327 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.327 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.327 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.327 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.327 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.327 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.327 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c9685b640 5 monclient: authenticate success, global_id 7065 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c9685b640 10 monclient: _renew_subs 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c9685b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c9685b640 1 -- 10.20.193.48:0/1086110027 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c90091600 con 0x7f9c9005e490 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c9685b640 10 monclient: _renew_subs 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c9685b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c9685b640 1 -- 10.20.193.48:0/1086110027 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c9008b670 con 0x7f9c9005e490 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c9685b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c9685b640 1 --2- 10.20.193.48:0/1086110027 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9c9008b800 0x7f9c9012a510 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c9685b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c9685b640 1 -- 10.20.193.48:0/1086110027 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f9c9005f140 con 0x7f9c9008b800 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c8ffff640 1 --2- 10.20.193.48:0/1086110027 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9c9008b800 0x7f9c9012a510 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c8ffff640 10 monclient: get_auth_request con 0x7f9c9008b800 auth_method 0 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c8ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c8ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c8ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c8cff9640 1 -- 10.20.193.48:0/1086110027 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f9c84005030 con 0x7f9c9005e490 2026-02-12T18:17:07.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c8ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c8ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.321+0000 7f9c8ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.322+0000 7f9c8cff9640 1 --2- 10.20.193.48:0/1086110027 >> v2:10.20.193.111:6812/977811348 conn(0x7f9c6003f800 0x7f9c6005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.322+0000 7f9c8cff9640 1 -- 10.20.193.48:0/1086110027 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7f9c84078dd0 con 0x7f9c9005e490 2026-02-12T18:17:07.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.322+0000 7f9c8ffff640 10 monclient(hunting): handle_auth_done global_id 114161 payload 824 2026-02-12T18:17:07.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.322+0000 7f9c8ffff640 1 -- 10.20.193.48:0/1086110027 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9c90097de0 con 0x7f9c9008b800 2026-02-12T18:17:07.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.322+0000 7f9c8f7fe640 1 --2- 10.20.193.48:0/1086110027 >> v2:10.20.193.111:6812/977811348 conn(0x7f9c6003f800 0x7f9c6005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.322+0000 7f9c8f7fe640 10 monclient: get_auth_request con 0x7f9c6003f800 auth_method 0 2026-02-12T18:17:07.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.324+0000 7f9c8ffff640 1 -- 10.20.193.48:0/1086110027 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9c9008b800 msgr2=0x7f9c9012a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:07.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.324+0000 7f9c8ffff640 1 --2- 10.20.193.48:0/1086110027 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9c9008b800 0x7f9c9012a510 secure :-1 s=READY pgs=21 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c7c011800 tx=0x7f9c7c011cd0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.324+0000 7f9c8cff9640 1 -- 10.20.193.48:0/1086110027 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9c7c015460 con 0x7f9c9008b800 2026-02-12T18:17:07.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.324+0000 7f9c8cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.324+0000 7f9c8cff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:17:07.330 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.324+0000 7f9c8cff9640 10 monclient: dump: 2026-02-12T18:17:07.330 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.330 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.330 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.330 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.330 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.330 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.330 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.330 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.330 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.330 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.330 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.330 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.330 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.330 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.330 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.331 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.324+0000 7f9c8f7fe640 1 --2- 10.20.193.48:0/1086110027 >> v2:10.20.193.111:6812/977811348 conn(0x7f9c6003f800 0x7f9c6005fcb0 secure :-1 s=READY pgs=479 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c90089f70 tx=0x7f9c80009040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.324+0000 7f9c8cff9640 1 -- 10.20.193.48:0/1086110027 <== mon.5 v2:10.20.193.111:3302/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f9c7c00fa40 con 0x7f9c9008b800 2026-02-12T18:17:07.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.324+0000 7f9c8cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:07.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.324+0000 7f9c8cff9640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:17:07.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.324+0000 7f9c8cff9640 1 -- 10.20.193.48:0/1086110027 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9c9008b800 msgr2=0x7f9c9012a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.324+0000 7f9c8cff9640 1 --2- 10.20.193.48:0/1086110027 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9c9008b800 0x7f9c9012a510 secure :-1 s=READY pgs=21 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c7c011800 tx=0x7f9c7c011cd0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.324+0000 7f9c8cff9640 1 -- 10.20.193.48:0/1086110027 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9c9008b800 msgr2=0x7f9c9012a510 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:17:07.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.324+0000 7f9c8cff9640 1 --2- 10.20.193.48:0/1086110027 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9c9008b800 0x7f9c9012a510 secure :-1 s=CLOSED pgs=21 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c7c011800 tx=0x7f9c7c011cd0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.328+0000 7f9c9685b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:17:07.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.328+0000 7f9c9685b640 1 --2- 10.20.193.48:0/1086110027 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9c9008d980 0x7f9c9012aa50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.328+0000 7f9c9685b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.328+0000 7f9c9685b640 1 -- 10.20.193.48:0/1086110027 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f9c9005fd90 con 0x7f9c9008d980 2026-02-12T18:17:07.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.328+0000 7f9c8ffff640 1 --2- 10.20.193.48:0/1086110027 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9c9008d980 0x7f9c9012aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.328+0000 7f9c8ffff640 10 monclient: get_auth_request con 0x7f9c9008d980 auth_method 0 2026-02-12T18:17:07.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.328+0000 7f9c8ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.328+0000 7f9c8ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.328+0000 7f9c8ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.329+0000 7f9c8ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.329+0000 7f9c8ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.329+0000 7f9c8ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.329+0000 7f9c8ffff640 10 monclient(hunting): handle_auth_done global_id 114170 payload 824 2026-02-12T18:17:07.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.329+0000 7f9c8ffff640 1 -- 10.20.193.48:0/1086110027 --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9c9005cd20 con 0x7f9c9008d980 2026-02-12T18:17:07.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.331+0000 7f9c8ffff640 1 -- 10.20.193.48:0/1086110027 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9c9008d980 msgr2=0x7f9c9012aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:07.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.331+0000 7f9c8ffff640 1 --2- 10.20.193.48:0/1086110027 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9c9008d980 0x7f9c9012aa50 secure :-1 s=READY pgs=22 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c7c011800 tx=0x7f9c7c0047e0 comp rx=0 tx=0).ready entity=mon.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.331+0000 7f9c8cff9640 1 -- 10.20.193.48:0/1086110027 <== mon.5 v2:10.20.193.111:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f9c7c022130 con 0x7f9c9008d980 2026-02-12T18:17:07.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.331+0000 7f9c8cff9640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.331+0000 7f9c8cff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2026-02-12T18:17:07.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.331+0000 7f9c8cff9640 10 monclient: dump: 2026-02-12T18:17:07.333 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.333 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.333 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.333 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.333 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.333 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.333 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.333 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.333 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.333 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.333 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.333 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.333 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.333 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.333 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.333 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.331+0000 7f9c8cff9640 1 -- 10.20.193.48:0/1086110027 <== mon.5 v2:10.20.193.111:3302/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7f9c7c004240 con 0x7f9c9008d980 2026-02-12T18:17:07.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.331+0000 7f9c8cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:17:07.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.331+0000 7f9c8cff9640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:17:07.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.331+0000 7f9c8cff9640 1 -- 10.20.193.48:0/1086110027 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9c9008d980 msgr2=0x7f9c9012aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.331+0000 7f9c8cff9640 1 --2- 10.20.193.48:0/1086110027 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9c9008d980 0x7f9c9012aa50 secure :-1 s=READY pgs=22 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c7c011800 tx=0x7f9c7c0047e0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.331+0000 7f9c8cff9640 1 -- 10.20.193.48:0/1086110027 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9c9008d980 msgr2=0x7f9c9012aa50 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:17:07.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.331+0000 7f9c8cff9640 1 --2- 10.20.193.48:0/1086110027 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f9c9008d980 0x7f9c9012aa50 secure :-1 s=CLOSED pgs=22 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c7c011800 tx=0x7f9c7c0047e0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.334 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:17:07.334 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:17:07.334 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:17:07.334 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:17:07.334 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 92, 2026-02-12T18:17:07.334 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 16000, 2026-02-12T18:17:07.334 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:17:07.334 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:17:07.334 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:17:07.334 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:17:07.334 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:17:07.334 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:17:07.334 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:17:07.335 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:17:07.335 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:17:07.335 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:17:07.335 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:07.335 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 1, 2026-02-12T18:17:07.335 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:17:07.335 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:17:07.335 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:17:07.335 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:07.335 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:07.335 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:07.335 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:07.335 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:07.335 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:07.335 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:07.335 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:07.335 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:07.335 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:07.335 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:07.335 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:07.335 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:07.335 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:07.335 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:17:07.335 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:17:07.336 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:07.336 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:07.336 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:07.336 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:07.336 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:07.336 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:07.336 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:07.336 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:07.336 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:07.336 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:07.336 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:07.336 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:07.336 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:07.336 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.336 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.336 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:17:07.336 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:17:07.336 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:17:07.336 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:17:07.336 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:17:07.336 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:17:07.336 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:17:07.336 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:17:07.336 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:17:07.336 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:17:07.337 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:17:07.337 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:17:07.337 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:17:07.337 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:17:07.337 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:17:07.337 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:17:07.337 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:17:07.337 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:07.337 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:07.337 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:07.337 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:07.337 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:07.337 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:07.337 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:07.337 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:07.337 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:07.337 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:07.337 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:07.337 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:07.337 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:07.337 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:07.337 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:17:07.337 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.337 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:17:07.337 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.337 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:17:07.338 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:17:07.338 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.338 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.338 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.338 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.338 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:17:07.338 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.338 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.338 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.338 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.338 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:17:07.338 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.338 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.338 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.338 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.338 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:17:07.338 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:17:07.338 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.338 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.338 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:17:07.338 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.338 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.338 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.338 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:17:07.338 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:17:07.339 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.339 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.339 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.339 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.339 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:17:07.339 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.339 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.339 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.339 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.339 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:17:07.339 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.339 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.339 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.339 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.339 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:17:07.339 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:17:07.339 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.339 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.339 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:17:07.339 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.339 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.339 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.339 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:17:07.339 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:17:07.340 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.340 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.340 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.340 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.340 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:17:07.340 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.340 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.340 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.340 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.340 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:17:07.340 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.340 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.340 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.340 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.340 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:17:07.340 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:17:07.340 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.340 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.340 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:17:07.340 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.340 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.340 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.340 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:17:07.340 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:17:07.340 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.340 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.341 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.341 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.341 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:17:07.341 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.341 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.341 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.341 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.341 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:17:07.341 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.341 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.341 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.341 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.341 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:17:07.341 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:17:07.341 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.341 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.341 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:17:07.341 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.341 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.341 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.341 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:17:07.341 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:17:07.341 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.341 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.342 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.342 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.342 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:17:07.342 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.342 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.342 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.342 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.342 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:17:07.342 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.342 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.342 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.342 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.342 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:17:07.342 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:17:07.342 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.342 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.342 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:17:07.342 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.342 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.342 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.342 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:17:07.342 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:17:07.342 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.342 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.342 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.343 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.343 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:17:07.343 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.343 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.343 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.343 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.343 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:17:07.343 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.343 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.343 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.343 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.343 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:17:07.343 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:17:07.343 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.343 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.343 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:17:07.343 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.343 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.343 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.343 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:17:07.343 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:17:07.343 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.343 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.343 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.343 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.344 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:17:07.344 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.344 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.344 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.344 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.344 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:17:07.344 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.344 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.344 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.344 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.344 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:17:07.344 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:17:07.344 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.344 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.344 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:17:07.344 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.344 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.344 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.344 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:17:07.344 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:17:07.344 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.344 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.344 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.344 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.344 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:17:07.345 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.345 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.345 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.345 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.345 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:17:07.345 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.345 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.345 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.345 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.345 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:17:07.345 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:17:07.345 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.345 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.345 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:17:07.345 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.345 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.345 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.345 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:17:07.345 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:17:07.345 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.345 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.345 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.345 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.345 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:17:07.345 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.346 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.346 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.346 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.346 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:17:07.346 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.346 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.346 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.346 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.346 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:17:07.346 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:17:07.346 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.346 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.346 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:17:07.346 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.346 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.346 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.346 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.346 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:17:07.346 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:17:07.346 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.346 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:17:07.346 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:17:07.346 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:17:07.346 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.346 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:07.347 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:17:07.347 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.347 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:17:07.347 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:17:07.347 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:17:07.347 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.347 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.347 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.347 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:17:07.347 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:17:07.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.332+0000 7f9c9685b640 1 -- 10.20.193.48:0/1086110027 >> v2:10.20.193.111:6812/977811348 conn(0x7f9c6003f800 msgr2=0x7f9c6005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.332+0000 7f9c9685b640 1 --2- 10.20.193.48:0/1086110027 >> v2:10.20.193.111:6812/977811348 conn(0x7f9c6003f800 0x7f9c6005fcb0 secure :-1 s=READY pgs=479 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c90089f70 tx=0x7f9c80009040 comp rx=0 tx=0).stop 2026-02-12T18:17:07.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.332+0000 7f9c9685b640 10 monclient: shutdown 2026-02-12T18:17:07.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.332+0000 7f9c9685b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:07.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.332+0000 7f9c9685b640 1 -- 10.20.193.48:0/1086110027 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9c9005e490 msgr2=0x7f9c9013dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.332+0000 7f9c94dd1640 1 -- 10.20.193.48:0/1086110027 reap_dead start 2026-02-12T18:17:07.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.332+0000 7f9c9685b640 1 --2- 10.20.193.48:0/1086110027 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9c9005e490 0x7f9c9013dec0 secure :-1 s=READY pgs=720 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f9c8400aa10 tx=0x7f9c84005850 comp rx=0 tx=0).stop 2026-02-12T18:17:07.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.332+0000 7f9c9685b640 1 -- 10.20.193.48:0/1086110027 shutdown_connections 2026-02-12T18:17:07.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.332+0000 7f9c9685b640 1 --2- 10.20.193.48:0/1086110027 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f9c9005e490 0x7f9c9013dec0 unknown :-1 s=CLOSED pgs=720 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.332+0000 7f9c9685b640 1 -- 10.20.193.48:0/1086110027 >> 10.20.193.48:0/1086110027 conn(0x7f9c900548a0 msgr2=0x7f9c90123070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:07.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.332+0000 7f9c9685b640 1 -- 10.20.193.48:0/1086110027 shutdown_connections 2026-02-12T18:17:07.348 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.332+0000 7f9c9685b640 1 -- 10.20.193.48:0/1086110027 wait complete. 2026-02-12T18:17:07.348 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:17:07.349 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2026-02-12T18:17:07.349 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2026-02-12T18:17:07.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f064d7b9640 10 monclient: get_monmap_and_config 2026-02-12T18:17:07.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f064d7b9640 10 monclient: build_initial_monmap 2026-02-12T18:17:07.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f064d7b9640 10 monclient: monmap: 2026-02-12T18:17:07.416 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:07.416 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.416 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:07.416101+0000 2026-02-12T18:17:07.416 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:07.416101+0000 2026-02-12T18:17:07.416 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:07.416 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.416 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:07.416 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:07.416 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:07.416 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:07.416 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:07.416 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:07.417 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:07.417 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:07.417 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:07.417 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:07.417 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:07.417 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f064d7b9640 1 Processor -- start 2026-02-12T18:17:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f064d7b9640 1 -- start start 2026-02-12T18:17:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f064d7b9640 10 monclient: init 2026-02-12T18:17:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f064d7b9640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f064d7b9640 10 monclient: _add_conns ranks=[0,9,8,1,5,4,2,6,7,10,3] 2026-02-12T18:17:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f064d7b9640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f064805c950 addr v1:10.20.193.48:6789/0 2026-02-12T18:17:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f064d7b9640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f064805e490 0x7f06481857b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f064d7b9640 10 monclient(hunting): picked mon.noname-a con 0x7f064805e490 addr v2:10.20.193.48:3300/0 2026-02-12T18:17:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f064d7b9640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f064805d430 0x7f06481a5d00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f064d7b9640 10 monclient(hunting): picked mon.noname-e con 0x7f064805d430 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:17:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f064d7b9640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f064804dc20 con 0x7f064805c950 2026-02-12T18:17:07.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f064d7b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f064d7b9640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f064805ddd0 con 0x7f064805e490 2026-02-12T18:17:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f064d7b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f064d7b9640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f0648092990 con 0x7f064805d430 2026-02-12T18:17:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f064d7b9640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f064d7b9640 10 monclient(hunting): authenticate will time out at 1266.141850s 2026-02-12T18:17:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f06467fc640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f064805e490 0x7f06481857b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f06467fc640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f064805e490 0x7f06481857b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:54904/0 (socket says 10.20.193.48:54904) 2026-02-12T18:17:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f06477fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f064805d430 0x7f06481a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f06467fc640 1 -- 10.20.193.48:0/1260823980 learned_addr learned my addr 10.20.193.48:0/1260823980 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f06467fc640 10 monclient(hunting): get_auth_request con 0x7f064805e490 auth_method 0 2026-02-12T18:17:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f06467fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f06467fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f06467fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f06477fe640 10 monclient(hunting): get_auth_request con 0x7f064805d430 auth_method 0 2026-02-12T18:17:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f06477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f06477fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.415+0000 7f06477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.416+0000 7f06467fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.416+0000 7f06467fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.416+0000 7f06467fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.416+0000 7f06477fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.416+0000 7f06477fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.416+0000 7f06477fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.416+0000 7f06467fc640 10 monclient(hunting): handle_auth_done global_id 7074 payload 274 2026-02-12T18:17:07.420 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.416+0000 7f06467fc640 1 -- 10.20.193.48:0/1260823980 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f064805d430 msgr2=0x7f06481a5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:07.420 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.416+0000 7f06467fc640 1 --2- 10.20.193.48:0/1260823980 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f064805d430 0x7f06481a5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.420 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.416+0000 7f06467fc640 1 -- 10.20.193.48:0/1260823980 >> v1:10.20.193.48:6789/0 conn(0x7f064805c950 legacy=0x7f064805cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:07.420 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.416+0000 7f06467fc640 10 monclient: _finish_hunting 0 2026-02-12T18:17:07.420 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.416+0000 7f06467fc640 1 monclient: found mon.noname-a 2026-02-12T18:17:07.420 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.416+0000 7f06467fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:07.420 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.416+0000 7f06467fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:17:07.420 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.416+0000 7f06467fc640 1 -- 10.20.193.48:0/1260823980 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0648092c70 con 0x7f064805e490 2026-02-12T18:17:07.422 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.418+0000 7f06467fc640 1 -- 10.20.193.48:0/1260823980 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f064805e490 msgr2=0x7f06481857b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:07.422 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.418+0000 7f06467fc640 1 --2- 10.20.193.48:0/1260823980 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f064805e490 0x7f06481857b0 secure :-1 s=READY pgs=723 gs=2 cs=0 l=1 c_cookie=8586150487361000413 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0630009060 tx=0x7f063002edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=772822607b3313dd server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.422 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.418+0000 7f0645ffb640 1 -- 10.20.193.48:0/1260823980 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f0630035340 con 0x7f064805e490 2026-02-12T18:17:07.422 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.418+0000 7f0645ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.422 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.418+0000 7f0645ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:17:07.422 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.418+0000 7f0645ffb640 10 monclient: dump: 2026-02-12T18:17:07.422 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.422 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.422 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.422 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.422 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.422 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.422 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.422 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.422 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.422 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.423 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.423 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.423 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.423 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.423 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.423 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.418+0000 7f0645ffb640 10 monclient: _finish_auth 0 2026-02-12T18:17:07.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.418+0000 7f0645ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:17:07.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.418+0000 7f0645ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:07.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.418+0000 7f0645ffb640 1 -- 10.20.193.48:0/1260823980 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06300354c0 con 0x7f064805e490 2026-02-12T18:17:07.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.418+0000 7f0645ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:07.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.418+0000 7f0645ffb640 1 -- 10.20.193.48:0/1260823980 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f0630035af0 con 0x7f064805e490 2026-02-12T18:17:07.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.418+0000 7f064d7b9640 5 monclient: authenticate success, global_id 7074 2026-02-12T18:17:07.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.418+0000 7f064d7b9640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:07.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.418+0000 7f064d7b9640 4 set_mon_vals no callback set 2026-02-12T18:17:07.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.418+0000 7f0645ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.418+0000 7f0645ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:17:07.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.418+0000 7f0645ffb640 10 monclient: dump: 2026-02-12T18:17:07.423 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.423 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.423 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.423 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.423 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.423 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.423 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.424 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.424 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.424 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.424 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.424 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.424 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.424 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.424 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.424 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.419+0000 7f064d7b9640 10 monclient: shutdown 2026-02-12T18:17:07.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.419+0000 7f064d7b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:07.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.419+0000 7f064d7b9640 1 -- 10.20.193.48:0/1260823980 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f064805e490 msgr2=0x7f06481857b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.419+0000 7f064d7b9640 1 --2- 10.20.193.48:0/1260823980 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f064805e490 0x7f06481857b0 secure :-1 s=READY pgs=723 gs=2 cs=0 l=1 c_cookie=8586150487361000413 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0630009060 tx=0x7f063002edf0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.419+0000 7f064d7b9640 1 -- 10.20.193.48:0/1260823980 shutdown_connections 2026-02-12T18:17:07.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.419+0000 7f064d7b9640 1 --2- 10.20.193.48:0/1260823980 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f064805d430 0x7f06481a5d00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.419+0000 7f064d7b9640 1 --2- 10.20.193.48:0/1260823980 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f064805e490 0x7f06481857b0 unknown :-1 s=CLOSED pgs=723 gs=2 cs=0 l=1 c_cookie=8586150487361000413 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.419+0000 7f064d7b9640 1 -- 10.20.193.48:0/1260823980 >> 10.20.193.48:0/1260823980 conn(0x7f06480548a0 msgr2=0x7f0648097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:07.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.419+0000 7f064d7b9640 1 -- 10.20.193.48:0/1260823980 shutdown_connections 2026-02-12T18:17:07.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.419+0000 7f064d7b9640 1 -- 10.20.193.48:0/1260823980 wait complete. 2026-02-12T18:17:07.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.419+0000 7f064d7b9640 10 monclient: build_initial_monmap 2026-02-12T18:17:07.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.419+0000 7f064d7b9640 10 monclient: monmap: 2026-02-12T18:17:07.424 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:07.424 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:07.424 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:07.425 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:07.425 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:07.425 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.425 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:07.425 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:07.425 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:07.425 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:07.425 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:07.425 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:07.425 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:07.425 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:07.425 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:07.425 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.419+0000 7f064d7b9640 1 Processor -- start 2026-02-12T18:17:07.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f064d7b9640 1 -- start start 2026-02-12T18:17:07.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f064d7b9640 10 monclient: init 2026-02-12T18:17:07.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f064d7b9640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:07.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f064d7b9640 10 monclient: _add_conns ranks=[1,3,8,7,0,4,5,6,2] 2026-02-12T18:17:07.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f064d7b9640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f064805c950 0x7f064808a860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f064d7b9640 10 monclient(hunting): picked mon.noname-f con 0x7f064805c950 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:17:07.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f064d7b9640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f064805d430 0x7f06481a55b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f064d7b9640 10 monclient(hunting): picked mon.noname-g con 0x7f064805d430 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:17:07.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f064d7b9640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f064805e490 0x7f06481a5af0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f064d7b9640 10 monclient(hunting): picked mon.noname-e con 0x7f064805e490 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:17:07.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f064d7b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f064d7b9640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f064808b7c0 con 0x7f064805c950 2026-02-12T18:17:07.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f064d7b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f064d7b9640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f0648142750 con 0x7f064805d430 2026-02-12T18:17:07.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f064d7b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f064d7b9640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f06481418e0 con 0x7f064805e490 2026-02-12T18:17:07.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f064d7b9640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:07.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f064d7b9640 10 monclient(hunting): authenticate will time out at 1266.146256s 2026-02-12T18:17:07.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f06477fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f064805e490 0x7f06481a5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f06477fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f064805e490 0x7f06481a5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:33730/0 (socket says 10.20.193.48:33730) 2026-02-12T18:17:07.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f06477fe640 1 -- 10.20.193.48:0/3201925334 learned_addr learned my addr 10.20.193.48:0/3201925334 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:07.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f06477fe640 10 monclient(hunting): get_auth_request con 0x7f064805e490 auth_method 0 2026-02-12T18:17:07.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f06477fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f06477fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f06477fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f06477fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f06477fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f06477fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f0646ffd640 1 --2- 10.20.193.48:0/3201925334 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f064805c950 0x7f064808a860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f0646ffd640 10 monclient(hunting): get_auth_request con 0x7f064805c950 auth_method 0 2026-02-12T18:17:07.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f0646ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f0646ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f0646ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f06467fc640 1 --2- 10.20.193.48:0/3201925334 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f064805d430 0x7f06481a55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f06477fe640 10 monclient(hunting): handle_auth_done global_id 94994 payload 824 2026-02-12T18:17:07.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f06477fe640 1 -- 10.20.193.48:0/3201925334 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f064805d430 msgr2=0x7f06481a55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f06477fe640 1 --2- 10.20.193.48:0/3201925334 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f064805d430 0x7f06481a55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f06477fe640 1 -- 10.20.193.48:0/3201925334 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f064805c950 msgr2=0x7f064808a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f06477fe640 1 --2- 10.20.193.48:0/3201925334 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f064805c950 0x7f064808a860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f06477fe640 10 monclient: _finish_hunting 0 2026-02-12T18:17:07.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f06477fe640 1 monclient: found mon.noname-e 2026-02-12T18:17:07.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f06477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:07.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f06477fe640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:17:07.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.420+0000 7f06477fe640 1 -- 10.20.193.48:0/3201925334 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06300094f0 con 0x7f064805e490 2026-02-12T18:17:07.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.422+0000 7f06477fe640 1 -- 10.20.193.48:0/3201925334 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f064805e490 msgr2=0x7f06481a5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:07.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.422+0000 7f06477fe640 1 --2- 10.20.193.48:0/3201925334 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f064805e490 0x7f06481a5af0 secure :-1 s=READY pgs=194 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0638007f80 tx=0x7f063800fdc0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.422+0000 7f06277fe640 1 -- 10.20.193.48:0/3201925334 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f063800dbe0 con 0x7f064805e490 2026-02-12T18:17:07.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.422+0000 7f06277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.422+0000 7f06277fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:17:07.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.422+0000 7f06277fe640 10 monclient: dump: 2026-02-12T18:17:07.429 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.429 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.429 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.429 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.429 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.429 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.429 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.429 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.429 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.429 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.429 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.429 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.429 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.430 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.430 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.430 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.422+0000 7f06277fe640 10 monclient: _finish_auth 0 2026-02-12T18:17:07.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.422+0000 7f06277fe640 10 monclient: _check_auth_tickets 2026-02-12T18:17:07.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.422+0000 7f06277fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:07.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.422+0000 7f06277fe640 1 -- 10.20.193.48:0/3201925334 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f063800dd40 con 0x7f064805e490 2026-02-12T18:17:07.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.422+0000 7f064d7b9640 5 monclient: authenticate success, global_id 94994 2026-02-12T18:17:07.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.422+0000 7f064d7b9640 10 monclient: _renew_subs 2026-02-12T18:17:07.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.422+0000 7f064d7b9640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:17:07.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.422+0000 7f064d7b9640 1 -- 10.20.193.48:0/3201925334 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06481a6030 con 0x7f064805e490 2026-02-12T18:17:07.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.422+0000 7f06277fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:07.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.422+0000 7f06277fe640 1 -- 10.20.193.48:0/3201925334 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f0638014df0 con 0x7f064805e490 2026-02-12T18:17:07.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.422+0000 7f06277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.422+0000 7f06457fa640 4 set_mon_vals no callback set 2026-02-12T18:17:07.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.422+0000 7f06277fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:17:07.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.422+0000 7f06277fe640 10 monclient: dump: 2026-02-12T18:17:07.430 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.430 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.430 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.430 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.430 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.430 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.430 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.430 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.431 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.431 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.431 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.431 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.431 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.431 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.431 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.431 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.422+0000 7f064d7b9640 10 monclient: _renew_subs 2026-02-12T18:17:07.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.422+0000 7f064d7b9640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:17:07.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.422+0000 7f064d7b9640 1 -- 10.20.193.48:0/3201925334 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7f064808b1f0 con 0x7f064805e490 2026-02-12T18:17:07.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.423+0000 7f064d7b9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:07.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.423+0000 7f064d7b9640 1 --2- 10.20.193.48:0/3201925334 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f064813f9f0 0x7f064813fdc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.423+0000 7f064d7b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.423+0000 7f064d7b9640 1 -- 10.20.193.48:0/3201925334 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f064808bb30 con 0x7f064813f9f0 2026-02-12T18:17:07.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.423+0000 7f0646ffd640 1 --2- 10.20.193.48:0/3201925334 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f064813f9f0 0x7f064813fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.423+0000 7f0646ffd640 10 monclient: get_auth_request con 0x7f064813f9f0 auth_method 0 2026-02-12T18:17:07.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.423+0000 7f0646ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.423+0000 7f0646ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.423+0000 7f0646ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.423+0000 7f06277fe640 1 -- 10.20.193.48:0/3201925334 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f0638012070 con 0x7f064805e490 2026-02-12T18:17:07.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.423+0000 7f0646ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.423+0000 7f0646ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.423+0000 7f0646ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.423+0000 7f06277fe640 1 --2- 10.20.193.48:0/3201925334 >> v2:10.20.193.111:6812/977811348 conn(0x7f061403f800 0x7f061405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.423+0000 7f06277fe640 1 -- 10.20.193.48:0/3201925334 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7f0638053df0 con 0x7f064805e490 2026-02-12T18:17:07.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.423+0000 7f0646ffd640 10 monclient(hunting): handle_auth_done global_id 114127 payload 824 2026-02-12T18:17:07.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.423+0000 7f0646ffd640 1 -- 10.20.193.48:0/3201925334 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f06481a6220 con 0x7f064813f9f0 2026-02-12T18:17:07.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.424+0000 7f06467fc640 1 --2- 10.20.193.48:0/3201925334 >> v2:10.20.193.111:6812/977811348 conn(0x7f061403f800 0x7f061405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.424+0000 7f06467fc640 10 monclient: get_auth_request con 0x7f061403f800 auth_method 0 2026-02-12T18:17:07.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.426+0000 7f0646ffd640 1 -- 10.20.193.48:0/3201925334 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f064813f9f0 msgr2=0x7f064813fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:07.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.426+0000 7f0646ffd640 1 --2- 10.20.193.48:0/3201925334 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f064813f9f0 0x7f064813fdc0 secure :-1 s=READY pgs=18 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f063c00e4d0 tx=0x7f063c00e9a0 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.426+0000 7f06277fe640 1 -- 10.20.193.48:0/3201925334 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f063c006cb0 con 0x7f064813f9f0 2026-02-12T18:17:07.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.426+0000 7f06277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.426+0000 7f06277fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:17:07.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.426+0000 7f06277fe640 10 monclient: dump: 2026-02-12T18:17:07.432 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.432 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.432 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.432 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.432 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.432 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.432 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.432 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.432 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.432 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.432 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.432 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.432 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.433 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.433 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.433 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.426+0000 7f06277fe640 1 -- 10.20.193.48:0/3201925334 <== mon.7 v2:10.20.193.111:3303/0 2 ==== command_reply(tid 1: 0 ) ==== 8+0+10764 (secure 0 0 0) 0x7f063c006e10 con 0x7f064813f9f0 2026-02-12T18:17:07.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.426+0000 7f06277fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:07.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.426+0000 7f06277fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:17:07.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.426+0000 7f06277fe640 1 -- 10.20.193.48:0/3201925334 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f064813f9f0 msgr2=0x7f064813fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.426+0000 7f06277fe640 1 --2- 10.20.193.48:0/3201925334 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f064813f9f0 0x7f064813fdc0 secure :-1 s=READY pgs=18 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f063c00e4d0 tx=0x7f063c00e9a0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.426+0000 7f06277fe640 1 -- 10.20.193.48:0/3201925334 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f064813f9f0 msgr2=0x7f064813fdc0 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:17:07.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.426+0000 7f06277fe640 1 --2- 10.20.193.48:0/3201925334 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f064813f9f0 0x7f064813fdc0 secure :-1 s=CLOSED pgs=18 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f063c00e4d0 tx=0x7f063c00e9a0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.426+0000 7f06467fc640 1 --2- 10.20.193.48:0/3201925334 >> v2:10.20.193.111:6812/977811348 conn(0x7f061403f800 0x7f061405fcb0 secure :-1 s=READY pgs=480 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0630009820 tx=0x7f0630033000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.429+0000 7f064d7b9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2026-02-12T18:17:07.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.429+0000 7f064d7b9640 1 --2- 10.20.193.48:0/3201925334 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0648140300 0x7f064808ff30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.429+0000 7f064d7b9640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.429+0000 7f064d7b9640 1 -- 10.20.193.48:0/3201925334 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f0648050410 con 0x7f0648140300 2026-02-12T18:17:07.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.430+0000 7f0646ffd640 1 --2- 10.20.193.48:0/3201925334 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0648140300 0x7f064808ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.430+0000 7f0646ffd640 10 monclient: get_auth_request con 0x7f0648140300 auth_method 0 2026-02-12T18:17:07.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.430+0000 7f0646ffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.430+0000 7f0646ffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.430+0000 7f0646ffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.430+0000 7f0646ffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.430+0000 7f0646ffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.430+0000 7f0646ffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.430+0000 7f0646ffd640 10 monclient(hunting): handle_auth_done global_id 114136 payload 824 2026-02-12T18:17:07.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.430+0000 7f0646ffd640 1 -- 10.20.193.48:0/3201925334 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f064805cd20 con 0x7f0648140300 2026-02-12T18:17:07.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.432+0000 7f0646ffd640 1 -- 10.20.193.48:0/3201925334 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0648140300 msgr2=0x7f064808ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:07.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.432+0000 7f0646ffd640 1 --2- 10.20.193.48:0/3201925334 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0648140300 0x7f064808ff30 secure :-1 s=READY pgs=19 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f063c015000 tx=0x7f063c003810 comp rx=0 tx=0).ready entity=mon.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.432+0000 7f06277fe640 1 -- 10.20.193.48:0/3201925334 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f063c0075e0 con 0x7f0648140300 2026-02-12T18:17:07.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.432+0000 7f06277fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.432+0000 7f06277fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:17:07.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.432+0000 7f06277fe640 10 monclient: dump: 2026-02-12T18:17:07.435 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.435 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.435 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.435 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.435 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.435 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.435 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.435 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.435 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.435 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.435 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.435 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.435 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.435 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.435 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.435 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.433+0000 7f06277fe640 1 -- 10.20.193.48:0/3201925334 <== mon.7 v2:10.20.193.111:3303/0 2 ==== command_reply(tid 2: 0 ) ==== 8+0+10014 (secure 0 0 0) 0x7f063c007740 con 0x7f0648140300 2026-02-12T18:17:07.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.433+0000 7f06277fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2026-02-12T18:17:07.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.433+0000 7f06277fe640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:17:07.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.433+0000 7f06277fe640 1 -- 10.20.193.48:0/3201925334 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0648140300 msgr2=0x7f064808ff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.433+0000 7f06277fe640 1 --2- 10.20.193.48:0/3201925334 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0648140300 0x7f064808ff30 secure :-1 s=READY pgs=19 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f063c015000 tx=0x7f063c003810 comp rx=0 tx=0).stop 2026-02-12T18:17:07.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.433+0000 7f06277fe640 1 -- 10.20.193.48:0/3201925334 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0648140300 msgr2=0x7f064808ff30 secure :-1 s=STATE_CLOSED l=1).mark_down 2026-02-12T18:17:07.436 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.433+0000 7f06277fe640 1 --2- 10.20.193.48:0/3201925334 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f0648140300 0x7f064808ff30 secure :-1 s=CLOSED pgs=19 gs=6 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f063c015000 tx=0x7f063c003810 comp rx=0 tx=0).stop 2026-02-12T18:17:07.436 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:17:07.436 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:17:07.436 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:17:07.436 INFO:teuthology.orchestra.run.trial048.stdout: "state": "peon", 2026-02-12T18:17:07.436 INFO:teuthology.orchestra.run.trial048.stdout: "election_epoch": 92, 2026-02-12T18:17:07.436 INFO:teuthology.orchestra.run.trial048.stdout: "uptime": 16100, 2026-02-12T18:17:07.436 INFO:teuthology.orchestra.run.trial048.stdout: "quorum": [ 2026-02-12T18:17:07.436 INFO:teuthology.orchestra.run.trial048.stdout: 0, 2026-02-12T18:17:07.436 INFO:teuthology.orchestra.run.trial048.stdout: 1, 2026-02-12T18:17:07.436 INFO:teuthology.orchestra.run.trial048.stdout: 2, 2026-02-12T18:17:07.436 INFO:teuthology.orchestra.run.trial048.stdout: 3, 2026-02-12T18:17:07.436 INFO:teuthology.orchestra.run.trial048.stdout: 4, 2026-02-12T18:17:07.436 INFO:teuthology.orchestra.run.trial048.stdout: 5, 2026-02-12T18:17:07.436 INFO:teuthology.orchestra.run.trial048.stdout: 6, 2026-02-12T18:17:07.437 INFO:teuthology.orchestra.run.trial048.stdout: 7, 2026-02-12T18:17:07.437 INFO:teuthology.orchestra.run.trial048.stdout: 8 2026-02-12T18:17:07.437 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:07.437 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_age": 1, 2026-02-12T18:17:07.437 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:17:07.437 INFO:teuthology.orchestra.run.trial048.stdout: "required_con": "2453899407728394244", 2026-02-12T18:17:07.437 INFO:teuthology.orchestra.run.trial048.stdout: "required_mon": [ 2026-02-12T18:17:07.437 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:07.437 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:07.437 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:07.437 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:07.437 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:07.437 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:07.437 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:07.437 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:07.437 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:07.437 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:07.437 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:07.437 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:07.437 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:07.437 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:07.437 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_con": "4544132024016699391", 2026-02-12T18:17:07.437 INFO:teuthology.orchestra.run.trial048.stdout: "quorum_mon": [ 2026-02-12T18:17:07.437 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:07.437 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:07.438 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:07.438 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:07.438 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:07.438 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:07.438 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:07.438 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:07.438 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:07.438 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:07.438 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:07.438 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:07.438 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:07.438 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.438 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.438 INFO:teuthology.orchestra.run.trial048.stdout: "outside_quorum": [], 2026-02-12T18:17:07.438 INFO:teuthology.orchestra.run.trial048.stdout: "extra_probe_peers": [], 2026-02-12T18:17:07.438 INFO:teuthology.orchestra.run.trial048.stdout: "sync_provider": [], 2026-02-12T18:17:07.438 INFO:teuthology.orchestra.run.trial048.stdout: "monmap": { 2026-02-12T18:17:07.438 INFO:teuthology.orchestra.run.trial048.stdout: "epoch": 1, 2026-02-12T18:17:07.438 INFO:teuthology.orchestra.run.trial048.stdout: "fsid": "ff8a9ee7-9c95-4c71-86fa-da746f82dc18", 2026-02-12T18:17:07.438 INFO:teuthology.orchestra.run.trial048.stdout: "modified": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:17:07.438 INFO:teuthology.orchestra.run.trial048.stdout: "created": "2026-02-12T18:05:32.850777Z", 2026-02-12T18:17:07.438 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release": 20, 2026-02-12T18:17:07.438 INFO:teuthology.orchestra.run.trial048.stdout: "min_mon_release_name": "tentacle", 2026-02-12T18:17:07.438 INFO:teuthology.orchestra.run.trial048.stdout: "election_strategy": 1, 2026-02-12T18:17:07.439 INFO:teuthology.orchestra.run.trial048.stdout: "disallowed_leaders": "", 2026-02-12T18:17:07.439 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false, 2026-02-12T18:17:07.439 INFO:teuthology.orchestra.run.trial048.stdout: "tiebreaker_mon": "", 2026-02-12T18:17:07.439 INFO:teuthology.orchestra.run.trial048.stdout: "removed_ranks": "", 2026-02-12T18:17:07.439 INFO:teuthology.orchestra.run.trial048.stdout: "features": { 2026-02-12T18:17:07.439 INFO:teuthology.orchestra.run.trial048.stdout: "persistent": [ 2026-02-12T18:17:07.439 INFO:teuthology.orchestra.run.trial048.stdout: "kraken", 2026-02-12T18:17:07.439 INFO:teuthology.orchestra.run.trial048.stdout: "luminous", 2026-02-12T18:17:07.439 INFO:teuthology.orchestra.run.trial048.stdout: "mimic", 2026-02-12T18:17:07.439 INFO:teuthology.orchestra.run.trial048.stdout: "osdmap-prune", 2026-02-12T18:17:07.439 INFO:teuthology.orchestra.run.trial048.stdout: "nautilus", 2026-02-12T18:17:07.439 INFO:teuthology.orchestra.run.trial048.stdout: "octopus", 2026-02-12T18:17:07.439 INFO:teuthology.orchestra.run.trial048.stdout: "pacific", 2026-02-12T18:17:07.439 INFO:teuthology.orchestra.run.trial048.stdout: "elector-pinging", 2026-02-12T18:17:07.439 INFO:teuthology.orchestra.run.trial048.stdout: "quincy", 2026-02-12T18:17:07.439 INFO:teuthology.orchestra.run.trial048.stdout: "reef", 2026-02-12T18:17:07.439 INFO:teuthology.orchestra.run.trial048.stdout: "squid", 2026-02-12T18:17:07.439 INFO:teuthology.orchestra.run.trial048.stdout: "tentacle", 2026-02-12T18:17:07.439 INFO:teuthology.orchestra.run.trial048.stdout: "nvmeof_beacon_diff" 2026-02-12T18:17:07.439 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:07.439 INFO:teuthology.orchestra.run.trial048.stdout: "optional": [] 2026-02-12T18:17:07.439 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.439 INFO:teuthology.orchestra.run.trial048.stdout: "mons": [ 2026-02-12T18:17:07.439 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.439 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 0, 2026-02-12T18:17:07.440 INFO:teuthology.orchestra.run.trial048.stdout: "name": "a", 2026-02-12T18:17:07.440 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.440 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.440 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.440 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.440 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3300", 2026-02-12T18:17:07.440 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.440 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.440 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.440 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.440 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789", 2026-02-12T18:17:07.440 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.440 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.440 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.440 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.440 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6789/0", 2026-02-12T18:17:07.440 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6789/0", 2026-02-12T18:17:07.440 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.440 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.440 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850827+0000", 2026-02-12T18:17:07.440 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.440 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.440 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.440 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 1, 2026-02-12T18:17:07.440 INFO:teuthology.orchestra.run.trial048.stdout: "name": "f", 2026-02-12T18:17:07.441 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.441 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.441 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.441 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.441 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3300", 2026-02-12T18:17:07.441 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.441 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.441 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.441 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.441 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789", 2026-02-12T18:17:07.441 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.441 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.441 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.441 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.441 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6789/0", 2026-02-12T18:17:07.441 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6789/0", 2026-02-12T18:17:07.441 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.441 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.441 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850829+0000", 2026-02-12T18:17:07.441 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.441 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.441 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.441 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 2, 2026-02-12T18:17:07.441 INFO:teuthology.orchestra.run.trial048.stdout: "name": "b", 2026-02-12T18:17:07.441 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.441 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.442 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.442 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.442 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3301", 2026-02-12T18:17:07.442 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.442 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.442 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.442 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.442 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790", 2026-02-12T18:17:07.442 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.442 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.442 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.442 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.442 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6790/0", 2026-02-12T18:17:07.442 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6790/0", 2026-02-12T18:17:07.442 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.442 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.442 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850830+0000", 2026-02-12T18:17:07.442 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.442 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.442 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.442 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 3, 2026-02-12T18:17:07.442 INFO:teuthology.orchestra.run.trial048.stdout: "name": "g", 2026-02-12T18:17:07.442 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.442 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.442 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.443 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.443 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3301", 2026-02-12T18:17:07.443 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.443 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.443 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.443 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.443 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790", 2026-02-12T18:17:07.443 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.443 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.443 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.443 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.443 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6790/0", 2026-02-12T18:17:07.443 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6790/0", 2026-02-12T18:17:07.443 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.443 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.443 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850833+0000", 2026-02-12T18:17:07.443 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.443 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.443 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.443 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 4, 2026-02-12T18:17:07.443 INFO:teuthology.orchestra.run.trial048.stdout: "name": "c", 2026-02-12T18:17:07.443 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.443 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.443 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.443 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.444 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3302", 2026-02-12T18:17:07.444 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.444 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.444 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.444 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.444 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791", 2026-02-12T18:17:07.444 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.444 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.444 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.444 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.444 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6791/0", 2026-02-12T18:17:07.444 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6791/0", 2026-02-12T18:17:07.444 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.444 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.444 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:17:07.444 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.444 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.444 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.444 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 5, 2026-02-12T18:17:07.444 INFO:teuthology.orchestra.run.trial048.stdout: "name": "h", 2026-02-12T18:17:07.444 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.444 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.444 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.444 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.444 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3302", 2026-02-12T18:17:07.444 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.445 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.445 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.445 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.445 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791", 2026-02-12T18:17:07.445 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.445 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.445 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.445 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.445 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6791/0", 2026-02-12T18:17:07.445 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6791/0", 2026-02-12T18:17:07.445 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.445 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.445 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850834+0000", 2026-02-12T18:17:07.445 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.445 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.445 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.445 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 6, 2026-02-12T18:17:07.445 INFO:teuthology.orchestra.run.trial048.stdout: "name": "d", 2026-02-12T18:17:07.445 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.445 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.445 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.445 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.445 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3303", 2026-02-12T18:17:07.445 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.445 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.446 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.446 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.446 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792", 2026-02-12T18:17:07.446 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.446 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.446 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.446 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.446 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6792/0", 2026-02-12T18:17:07.446 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6792/0", 2026-02-12T18:17:07.446 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.446 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.446 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850831+0000", 2026-02-12T18:17:07.446 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.446 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.446 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.446 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 7, 2026-02-12T18:17:07.446 INFO:teuthology.orchestra.run.trial048.stdout: "name": "i", 2026-02-12T18:17:07.446 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.446 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.446 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.446 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.446 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:3303", 2026-02-12T18:17:07.446 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.446 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.446 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792", 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.111:6792/0", 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.111:6792/0", 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850835+0000", 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: "rank": 8, 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: "name": "e", 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: "public_addrs": { 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: "addrvec": [ 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v2", 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:3304", 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: "type": "v1", 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793", 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: "nonce": 0 2026-02-12T18:17:07.447 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: "addr": "10.20.193.48:6793/0", 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: "public_addr": "10.20.193.48:6793/0", 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: "priority": 0, 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: "weight": 0, 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: "time_added": "2026-02-12T18:05:32:850832+0000", 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: "crush_location": [] 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: "feature_map": { 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: "mon": [ 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: ], 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: "client": [ 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: { 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: "features": "0x3f0ffffffffdffff", 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: "release": "squid", 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: "num": 1 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: } 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: ] 2026-02-12T18:17:07.448 INFO:teuthology.orchestra.run.trial048.stdout: }, 2026-02-12T18:17:07.449 INFO:teuthology.orchestra.run.trial048.stdout: "stretch_mode": false 2026-02-12T18:17:07.449 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:17:07.449 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.433+0000 7f064d7b9640 1 -- 10.20.193.48:0/3201925334 >> v2:10.20.193.111:6812/977811348 conn(0x7f061403f800 msgr2=0x7f061405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.449 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.433+0000 7f064d7b9640 1 --2- 10.20.193.48:0/3201925334 >> v2:10.20.193.111:6812/977811348 conn(0x7f061403f800 0x7f061405fcb0 secure :-1 s=READY pgs=480 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0630009820 tx=0x7f0630033000 comp rx=0 tx=0).stop 2026-02-12T18:17:07.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.433+0000 7f064d7b9640 10 monclient: shutdown 2026-02-12T18:17:07.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.433+0000 7f064d7b9640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:07.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.433+0000 7f064d7b9640 1 -- 10.20.193.48:0/3201925334 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f064805e490 msgr2=0x7f06481a5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.433+0000 7f064d7b9640 1 --2- 10.20.193.48:0/3201925334 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f064805e490 0x7f06481a5af0 secure :-1 s=READY pgs=194 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f0638007f80 tx=0x7f063800fdc0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.433+0000 7f06477fe640 1 -- 10.20.193.48:0/3201925334 reap_dead start 2026-02-12T18:17:07.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.433+0000 7f06477fe640 1 -- 10.20.193.48:0/3201925334 reap_dead start 2026-02-12T18:17:07.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.433+0000 7f064d7b9640 1 -- 10.20.193.48:0/3201925334 shutdown_connections 2026-02-12T18:17:07.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.433+0000 7f064d7b9640 1 -- 10.20.193.48:0/3201925334 >> 10.20.193.48:0/3201925334 conn(0x7f06480548a0 msgr2=0x7f0648093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:07.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.433+0000 7f064d7b9640 1 -- 10.20.193.48:0/3201925334 shutdown_connections 2026-02-12T18:17:07.450 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.433+0000 7f064d7b9640 1 -- 10.20.193.48:0/3201925334 wait complete. 2026-02-12T18:17:07.450 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2026-02-12T18:17:07.450 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2026-02-12T18:17:07.450 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2026-02-12T18:17:07.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.514+0000 7fb927e1b640 10 monclient: get_monmap_and_config 2026-02-12T18:17:07.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.514+0000 7fb927e1b640 10 monclient: build_initial_monmap 2026-02-12T18:17:07.515 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.514+0000 7fb927e1b640 10 monclient: monmap: 2026-02-12T18:17:07.515 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:07.516 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.516 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:07.515152+0000 2026-02-12T18:17:07.516 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:07.515152+0000 2026-02-12T18:17:07.516 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:07.516 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.516 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:07.516 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:07.516 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:07.516 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:07.516 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:07.516 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:07.516 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:07.517 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:07.517 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:07.517 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:07.517 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:07.517 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.514+0000 7fb927e1b640 1 Processor -- start 2026-02-12T18:17:07.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.514+0000 7fb927e1b640 1 -- start start 2026-02-12T18:17:07.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.514+0000 7fb927e1b640 10 monclient: init 2026-02-12T18:17:07.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.514+0000 7fb927e1b640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:07.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.514+0000 7fb927e1b640 10 monclient: _add_conns ranks=[1,4,6,3,0,2,10,7,9,5,8] 2026-02-12T18:17:07.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.514+0000 7fb927e1b640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fb92005dc20 addr v1:10.20.193.111:6789/0 2026-02-12T18:17:07.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.514+0000 7fb927e1b640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb920144660 0x7fb920185500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.514+0000 7fb927e1b640 10 monclient(hunting): picked mon.noname-c con 0x7fb920144660 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:17:07.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.514+0000 7fb927e1b640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb920185a40 0x7fb9201a5e20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.514+0000 7fb927e1b640 10 monclient(hunting): picked mon.noname-d con 0x7fb920185a40 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:17:07.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.514+0000 7fb927e1b640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb920060390 con 0x7fb92005dc20 2026-02-12T18:17:07.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.514+0000 7fb927e1b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.514+0000 7fb927e1b640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fb920092200 con 0x7fb920144660 2026-02-12T18:17:07.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.514+0000 7fb927e1b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.514+0000 7fb927e1b640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fb92008b250 con 0x7fb920185a40 2026-02-12T18:17:07.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.514+0000 7fb927e1b640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:07.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.514+0000 7fb927e1b640 10 monclient(hunting): authenticate will time out at 1266.240935s 2026-02-12T18:17:07.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb92538f640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb920144660 0x7fb920185500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb92538f640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb920144660 0x7fb920185500 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:40626/0 (socket says 10.20.193.48:40626) 2026-02-12T18:17:07.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb92538f640 1 -- 10.20.193.48:0/854019683 learned_addr learned my addr 10.20.193.48:0/854019683 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:07.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb92538f640 10 monclient(hunting): get_auth_request con 0x7fb920144660 auth_method 0 2026-02-12T18:17:07.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb92538f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb92538f640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb92538f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb926391640 1 --2- 10.20.193.48:0/854019683 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb920185a40 0x7fb9201a5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb926391640 10 monclient(hunting): get_auth_request con 0x7fb920185a40 auth_method 0 2026-02-12T18:17:07.519 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb926391640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb926391640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb926391640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb92538f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb92538f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb92538f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb926391640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb926391640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb926391640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb92538f640 10 monclient(hunting): handle_auth_done global_id 65308 payload 274 2026-02-12T18:17:07.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb92538f640 1 -- 10.20.193.48:0/854019683 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb920185a40 msgr2=0x7fb9201a5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:07.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb92538f640 1 --2- 10.20.193.48:0/854019683 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb920185a40 0x7fb9201a5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb92538f640 1 -- 10.20.193.48:0/854019683 >> v1:10.20.193.111:6789/0 conn(0x7fb92005dc20 legacy=0x7fb92005dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:07.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb92538f640 10 monclient: _finish_hunting 0 2026-02-12T18:17:07.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb92538f640 1 monclient: found mon.noname-c 2026-02-12T18:17:07.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb92538f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:07.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb92538f640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:17:07.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.515+0000 7fb92538f640 1 -- 10.20.193.48:0/854019683 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb920144a50 con 0x7fb920144660 2026-02-12T18:17:07.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.517+0000 7fb92538f640 1 -- 10.20.193.48:0/854019683 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb920144660 msgr2=0x7fb920185500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:07.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.517+0000 7fb92538f640 1 --2- 10.20.193.48:0/854019683 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb920144660 0x7fb920185500 secure :-1 s=READY pgs=276 gs=2 cs=0 l=1 c_cookie=12157001847603016241 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9140098d0 tx=0x7fb91402eeb0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=a8b658c514253231 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.517+0000 7fb924b8e640 1 -- 10.20.193.48:0/854019683 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb914035340 con 0x7fb920144660 2026-02-12T18:17:07.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.517+0000 7fb924b8e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.517+0000 7fb924b8e640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:17:07.524 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.517+0000 7fb924b8e640 10 monclient: dump: 2026-02-12T18:17:07.524 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.524 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.524 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.524 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.524 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.524 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.524 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.524 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.524 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.524 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.524 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.524 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.524 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.524 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.524 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.524 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.517+0000 7fb924b8e640 10 monclient: _finish_auth 0 2026-02-12T18:17:07.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.517+0000 7fb924b8e640 10 monclient: _check_auth_tickets 2026-02-12T18:17:07.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.517+0000 7fb924b8e640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:07.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.517+0000 7fb927e1b640 5 monclient: authenticate success, global_id 65308 2026-02-12T18:17:07.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.517+0000 7fb924b8e640 1 -- 10.20.193.48:0/854019683 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9140354c0 con 0x7fb920144660 2026-02-12T18:17:07.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.517+0000 7fb927e1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:17:07.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.517+0000 7fb924b8e640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:07.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.517+0000 7fb924b8e640 1 -- 10.20.193.48:0/854019683 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb914035af0 con 0x7fb920144660 2026-02-12T18:17:07.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.517+0000 7fb927e1b640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:07.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.517+0000 7fb927e1b640 4 set_mon_vals no callback set 2026-02-12T18:17:07.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.517+0000 7fb924b8e640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.517+0000 7fb924b8e640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:17:07.525 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.517+0000 7fb924b8e640 10 monclient: dump: 2026-02-12T18:17:07.525 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.525 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.525 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.525 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.525 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.525 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.525 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.525 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.525 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.525 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.525 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.526 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.526 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.526 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.526 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.526 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.518+0000 7fb927e1b640 10 monclient: shutdown 2026-02-12T18:17:07.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.518+0000 7fb927e1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:07.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.518+0000 7fb927e1b640 1 -- 10.20.193.48:0/854019683 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb920144660 msgr2=0x7fb920185500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.518+0000 7fb927e1b640 1 --2- 10.20.193.48:0/854019683 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb920144660 0x7fb920185500 secure :-1 s=READY pgs=276 gs=2 cs=0 l=1 c_cookie=12157001847603016241 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9140098d0 tx=0x7fb91402eeb0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.518+0000 7fb927e1b640 1 -- 10.20.193.48:0/854019683 shutdown_connections 2026-02-12T18:17:07.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.518+0000 7fb927e1b640 1 --2- 10.20.193.48:0/854019683 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb920185a40 0x7fb9201a5e20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.518+0000 7fb927e1b640 1 --2- 10.20.193.48:0/854019683 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fb920144660 0x7fb920185500 unknown :-1 s=CLOSED pgs=276 gs=2 cs=0 l=1 c_cookie=12157001847603016241 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.518+0000 7fb927e1b640 1 -- 10.20.193.48:0/854019683 >> 10.20.193.48:0/854019683 conn(0x7fb9200546d0 msgr2=0x7fb920054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:07.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.518+0000 7fb927e1b640 1 -- 10.20.193.48:0/854019683 shutdown_connections 2026-02-12T18:17:07.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.518+0000 7fb927e1b640 1 -- 10.20.193.48:0/854019683 wait complete. 2026-02-12T18:17:07.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.518+0000 7fb927e1b640 10 monclient: build_initial_monmap 2026-02-12T18:17:07.526 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.518+0000 7fb927e1b640 10 monclient: monmap: 2026-02-12T18:17:07.526 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:07.526 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:07.526 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:07.526 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:07.526 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:07.526 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.526 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:07.527 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:07.527 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:07.527 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:07.527 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:07.527 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:07.527 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:07.527 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:07.527 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:07.527 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.518+0000 7fb927e1b640 1 Processor -- start 2026-02-12T18:17:07.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb927e1b640 1 -- start start 2026-02-12T18:17:07.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb927e1b640 10 monclient: init 2026-02-12T18:17:07.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb927e1b640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:07.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb927e1b640 10 monclient: _add_conns ranks=[0,2,3,4,7,5,1,8,6] 2026-02-12T18:17:07.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb927e1b640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb92005dc20 0x7fb920185240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb927e1b640 10 monclient(hunting): picked mon.noname-a con 0x7fb92005dc20 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:17:07.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb927e1b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb920144660 0x7fb920112a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb927e1b640 10 monclient(hunting): picked mon.noname-b con 0x7fb920144660 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:17:07.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb927e1b640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb920185a40 0x7fb920112f70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb927e1b640 10 monclient(hunting): picked mon.noname-g con 0x7fb920185a40 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:17:07.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb927e1b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb927e1b640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fb92010fa70 con 0x7fb92005dc20 2026-02-12T18:17:07.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb927e1b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb927e1b640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fb92010fd50 con 0x7fb920144660 2026-02-12T18:17:07.527 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb927e1b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:07.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb927e1b640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fb920110030 con 0x7fb920185a40 2026-02-12T18:17:07.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb927e1b640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:07.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb927e1b640 10 monclient(hunting): authenticate will time out at 1266.245272s 2026-02-12T18:17:07.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb925b90640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb92005dc20 0x7fb920185240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb925b90640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb92005dc20 0x7fb920185240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:54914/0 (socket says 10.20.193.48:54914) 2026-02-12T18:17:07.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb925b90640 1 -- 10.20.193.48:0/334235709 learned_addr learned my addr 10.20.193.48:0/334235709 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:07.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb925b90640 10 monclient(hunting): get_auth_request con 0x7fb92005dc20 auth_method 0 2026-02-12T18:17:07.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb925b90640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb925b90640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb925b90640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb92538f640 1 --2- 10.20.193.48:0/334235709 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb920144660 0x7fb920112a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb92538f640 10 monclient(hunting): get_auth_request con 0x7fb920144660 auth_method 0 2026-02-12T18:17:07.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb92538f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb92538f640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb92538f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb925b90640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb925b90640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb925b90640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb92538f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:07.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb92538f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:07.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb92538f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:07.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb926391640 1 --2- 10.20.193.48:0/334235709 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb920185a40 0x7fb920112f70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb926391640 10 monclient(hunting): get_auth_request con 0x7fb920185a40 auth_method 0 2026-02-12T18:17:07.528 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb926391640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:07.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb926391640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:07.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb926391640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:07.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb925b90640 10 monclient(hunting): handle_auth_done global_id 7083 payload 824 2026-02-12T18:17:07.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb925b90640 1 -- 10.20.193.48:0/334235709 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb920185a40 msgr2=0x7fb920112f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb925b90640 1 --2- 10.20.193.48:0/334235709 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb920185a40 0x7fb920112f70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb925b90640 1 -- 10.20.193.48:0/334235709 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb920144660 msgr2=0x7fb920112a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb925b90640 1 --2- 10.20.193.48:0/334235709 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb920144660 0x7fb920112a30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb925b90640 10 monclient: _finish_hunting 0 2026-02-12T18:17:07.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb925b90640 1 monclient: found mon.noname-a 2026-02-12T18:17:07.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb925b90640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:07.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb925b90640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:17:07.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb925b90640 1 -- 10.20.193.48:0/334235709 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9140094f0 con 0x7fb92005dc20 2026-02-12T18:17:07.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.519+0000 7fb926391640 1 --2- 10.20.193.48:0/334235709 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb920185a40 0x7fb920112f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:17:07.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.521+0000 7fb925b90640 1 -- 10.20.193.48:0/334235709 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb92005dc20 msgr2=0x7fb920185240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:07.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.521+0000 7fb925b90640 1 --2- 10.20.193.48:0/334235709 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb92005dc20 0x7fb920185240 secure :-1 s=READY pgs=724 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb91000c480 tx=0x7fb91000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.521+0000 7fb90e7fc640 1 -- 10.20.193.48:0/334235709 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb910006d50 con 0x7fb92005dc20 2026-02-12T18:17:07.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.521+0000 7fb90e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.521+0000 7fb90e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:17:07.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.521+0000 7fb90e7fc640 10 monclient: dump: 2026-02-12T18:17:07.529 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.529 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.529 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.529 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.529 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.529 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.530 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.530 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.530 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.530 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.530 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.530 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.530 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.530 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.530 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.530 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.521+0000 7fb90e7fc640 10 monclient: _finish_auth 0 2026-02-12T18:17:07.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.521+0000 7fb90e7fc640 10 monclient: _check_auth_tickets 2026-02-12T18:17:07.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.521+0000 7fb90e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:07.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.521+0000 7fb927e1b640 5 monclient: authenticate success, global_id 7083 2026-02-12T18:17:07.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.521+0000 7fb90e7fc640 1 -- 10.20.193.48:0/334235709 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb910007030 con 0x7fb92005dc20 2026-02-12T18:17:07.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.521+0000 7fb927e1b640 10 monclient: _renew_subs 2026-02-12T18:17:07.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.521+0000 7fb927e1b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:07.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.521+0000 7fb927e1b640 1 -- 10.20.193.48:0/334235709 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb920110310 con 0x7fb92005dc20 2026-02-12T18:17:07.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.521+0000 7fb90e7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:07.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.521+0000 7fb90e7fc640 1 -- 10.20.193.48:0/334235709 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb910007660 con 0x7fb92005dc20 2026-02-12T18:17:07.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.521+0000 7fb90e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:07.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.521+0000 7fb90ffff640 4 set_mon_vals no callback set 2026-02-12T18:17:07.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.521+0000 7fb90e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:17:07.530 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.521+0000 7fb90e7fc640 10 monclient: dump: 2026-02-12T18:17:07.530 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:07.531 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:07.531 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.531 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:07.531 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:07.531 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:07.531 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:07.531 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:07.531 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:07.531 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:07.531 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:07.531 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:07.531 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:07.531 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:07.531 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:07.531 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:07.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.521+0000 7fb927e1b640 10 monclient: _renew_subs 2026-02-12T18:17:07.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.521+0000 7fb927e1b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:07.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.521+0000 7fb927e1b640 1 -- 10.20.193.48:0/334235709 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb92010edf0 con 0x7fb92005dc20 2026-02-12T18:17:07.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.522+0000 7fb90e7fc640 1 -- 10.20.193.48:0/334235709 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fb9100071a0 con 0x7fb92005dc20 2026-02-12T18:17:07.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.522+0000 7fb927e1b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:07.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.522+0000 7fb927e1b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:07.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.522+0000 7fb927e1b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:07.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.522+0000 7fb927e1b640 1 -- 10.20.193.48:0/334235709 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb920092510 con 0x7fb92005dc20 2026-02-12T18:17:07.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.522+0000 7fb90e7fc640 1 --2- 10.20.193.48:0/334235709 >> v2:10.20.193.111:6812/977811348 conn(0x7fb8f003f800 0x7fb8f005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:07.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.522+0000 7fb90e7fc640 1 -- 10.20.193.48:0/334235709 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7fb910051e50 con 0x7fb92005dc20 2026-02-12T18:17:07.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.523+0000 7fb92538f640 1 --2- 10.20.193.48:0/334235709 >> v2:10.20.193.111:6812/977811348 conn(0x7fb8f003f800 0x7fb8f005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:07.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.523+0000 7fb92538f640 10 monclient: get_auth_request con 0x7fb8f003f800 auth_method 0 2026-02-12T18:17:07.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.525+0000 7fb90e7fc640 1 -- 10.20.193.48:0/334235709 <== mon.0 v2:10.20.193.48:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fb91001b780 con 0x7fb92005dc20 2026-02-12T18:17:07.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.525+0000 7fb90e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:07.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.525+0000 7fb90e7fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:17:07.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.525+0000 7fb92538f640 1 --2- 10.20.193.48:0/334235709 >> v2:10.20.193.111:6812/977811348 conn(0x7fb8f003f800 0x7fb8f005fcb0 secure :-1 s=READY pgs=481 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb914009820 tx=0x7fb914039040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:07.670 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.669+0000 7fb927e1b640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2026-02-12T18:17:07.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.669+0000 7fb927e1b640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2026-02-12T18:17:07.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.669+0000 7fb927e1b640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:07.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.669+0000 7fb927e1b640 1 -- 10.20.193.48:0/334235709 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fb92005dff0 con 0x7fb92005dc20 2026-02-12T18:17:07.671 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.670+0000 7fb90e7fc640 1 -- 10.20.193.48:0/334235709 <== mon.0 v2:10.20.193.48:3300/0 7 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (secure 0 0 0) 0x7fb9100102e0 con 0x7fb92005dc20 2026-02-12T18:17:07.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.670+0000 7fb90e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2026-02-12T18:17:07.672 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.670+0000 7fb90e7fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:17:07.675 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.670+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.675 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.670+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=13,kv=11,logm=55} crc {auth=1801232407,config=1618278320,health=138231836,kv=662030104,logm=1859448625}) 2026-02-12T18:17:07.675 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.670+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=20,config=2,health=12,kv=12,logm=54} crc {auth=2953528306,config=1618278320,health=22970029,kv=2857826951,logm=1631865889}) 2026-02-12T18:17:07.675 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.670+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.675 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.670+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=13,kv=11,logm=55} crc {auth=1801232407,config=1618278320,health=138231836,kv=662030104,logm=1859448625}) 2026-02-12T18:17:07.675 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.670+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=20,config=1,health=13,kv=12,logm=54} crc {auth=4291738555,config=1228700967,health=138231836,kv=2857826951,logm=1382417425}) 2026-02-12T18:17:07.675 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.670+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.676 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.670+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=13,kv=11,logm=55} crc {auth=1801232407,config=1618278320,health=138231836,kv=662030104,logm=1859448625}) 2026-02-12T18:17:07.676 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.670+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=21,config=2,health=11,kv=11,logm=55} crc {auth=3007501198,config=1618278320,health=2714443347,kv=84047893,logm=624349483}) 2026-02-12T18:17:07.676 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.670+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.676 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.670+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=13,kv=11,logm=55} crc {auth=1801232407,config=1618278320,health=138231836,kv=662030104,logm=1859448625}) 2026-02-12T18:17:07.676 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.670+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=19,config=2,health=13,kv=12,logm=54} crc {auth=202416436,config=1618278320,health=138231836,kv=2857826951,logm=1780316327}) 2026-02-12T18:17:07.676 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.670+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.676 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.670+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=13,kv=11,logm=55} crc {auth=1801232407,config=1618278320,health=138231836,kv=662030104,logm=1859448625}) 2026-02-12T18:17:07.676 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.670+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=21,config=2,health=13,kv=12,logm=52} crc {auth=1753891076,config=1618278320,health=462053041,kv=2857826951,logm=693951440}) 2026-02-12T18:17:07.676 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.670+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.676 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.670+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=13,kv=11,logm=55} crc {auth=1801232407,config=1618278320,health=138231836,kv=662030104,logm=1859448625}) 2026-02-12T18:17:07.676 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.670+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=21,config=2,health=12,kv=12,logm=53} crc {auth=1753891076,config=1618278320,health=22970029,kv=2857826951,logm=1323204536}) 2026-02-12T18:17:07.676 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.670+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.677 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.670+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=13,kv=11,logm=55} crc {auth=1801232407,config=1618278320,health=138231836,kv=662030104,logm=1859448625}) 2026-02-12T18:17:07.677 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.670+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=20,config=1,health=13,kv=11,logm=55} crc {auth=3318660440,config=1228700967,health=138231836,kv=84047893,logm=226307758}) 2026-02-12T18:17:07.677 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.670+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.677 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.670+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=13,kv=11,logm=55} crc {auth=1801232407,config=1618278320,health=138231836,kv=662030104,logm=1859448625}) 2026-02-12T18:17:07.677 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.670+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=18,config=2,health=12,kv=12,logm=56} crc {auth=1422752300,config=1618278320,health=22970029,kv=2857826951,logm=1739810536}) 2026-02-12T18:17:07.677 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.671+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.677 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.671+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3733751769}) 2026-02-12T18:17:07.677 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.671+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3910297843}) 2026-02-12T18:17:07.677 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.671+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.677 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.671+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3733751769}) 2026-02-12T18:17:07.677 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.671+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3007839203}) 2026-02-12T18:17:07.677 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.671+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.678 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.671+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3733751769}) 2026-02-12T18:17:07.678 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.671+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=793408601}) 2026-02-12T18:17:07.678 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.671+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.678 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.672+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3733751769}) 2026-02-12T18:17:07.678 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.672+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=573244156}) 2026-02-12T18:17:07.678 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.672+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.678 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.672+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3733751769}) 2026-02-12T18:17:07.678 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.672+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1576394838}) 2026-02-12T18:17:07.678 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.672+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.678 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.672+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3733751769}) 2026-02-12T18:17:07.678 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.672+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2725477276}) 2026-02-12T18:17:07.678 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.672+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.678 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.672+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3733751769}) 2026-02-12T18:17:07.679 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.672+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2746761655}) 2026-02-12T18:17:07.679 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.672+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.679 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.672+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3733751769}) 2026-02-12T18:17:07.679 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.672+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1049649002}) 2026-02-12T18:17:07.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.672+0000 7fb927e1b640 1 -- 10.20.193.48:0/334235709 >> v2:10.20.193.111:6812/977811348 conn(0x7fb8f003f800 msgr2=0x7fb8f005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.672+0000 7fb927e1b640 1 --2- 10.20.193.48:0/334235709 >> v2:10.20.193.111:6812/977811348 conn(0x7fb8f003f800 0x7fb8f005fcb0 secure :-1 s=READY pgs=481 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb914009820 tx=0x7fb914039040 comp rx=0 tx=0).stop 2026-02-12T18:17:07.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.672+0000 7fb927e1b640 10 monclient: shutdown 2026-02-12T18:17:07.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.672+0000 7fb927e1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:07.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.672+0000 7fb927e1b640 1 -- 10.20.193.48:0/334235709 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb92005dc20 msgr2=0x7fb920185240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:07.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.672+0000 7fb927e1b640 1 --2- 10.20.193.48:0/334235709 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb92005dc20 0x7fb920185240 secure :-1 s=READY pgs=724 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb91000c480 tx=0x7fb91000c950 comp rx=0 tx=0).stop 2026-02-12T18:17:07.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.672+0000 7fb927e1b640 1 -- 10.20.193.48:0/334235709 shutdown_connections 2026-02-12T18:17:07.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.672+0000 7fb927e1b640 1 --2- 10.20.193.48:0/334235709 >> v2:10.20.193.111:6812/977811348 conn(0x7fb8f003f800 0x7fb8f005fcb0 unknown :-1 s=CLOSED pgs=481 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.680 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.672+0000 7fb927e1b640 1 --2- 10.20.193.48:0/334235709 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb920185a40 0x7fb920112f70 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.672+0000 7fb927e1b640 1 --2- 10.20.193.48:0/334235709 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb920144660 0x7fb920112a30 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.672+0000 7fb927e1b640 1 --2- 10.20.193.48:0/334235709 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb92005dc20 0x7fb920185240 unknown :-1 s=CLOSED pgs=724 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:07.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.672+0000 7fb927e1b640 1 -- 10.20.193.48:0/334235709 >> 10.20.193.48:0/334235709 conn(0x7fb9200546d0 msgr2=0x7fb9201255a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:07.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.672+0000 7fb927e1b640 1 -- 10.20.193.48:0/334235709 shutdown_connections 2026-02-12T18:17:07.681 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:07.673+0000 7fb927e1b640 1 -- 10.20.193.48:0/334235709 wait complete. 2026-02-12T18:17:07.695 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.673+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.695 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.673+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2546384778}) 2026-02-12T18:17:07.695 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.673+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=43783956}) 2026-02-12T18:17:07.695 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.673+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.695 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.673+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2546384778}) 2026-02-12T18:17:07.695 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.673+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1371602144}) 2026-02-12T18:17:07.696 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.673+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.696 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.673+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2546384778}) 2026-02-12T18:17:07.696 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.673+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1819031018}) 2026-02-12T18:17:07.696 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.673+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.696 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.673+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2546384778}) 2026-02-12T18:17:07.696 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.673+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1273599410}) 2026-02-12T18:17:07.696 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.673+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.696 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.673+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2546384778}) 2026-02-12T18:17:07.696 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.673+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3913238947}) 2026-02-12T18:17:07.696 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.673+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.696 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.673+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2546384778}) 2026-02-12T18:17:07.696 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.673+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3176297699}) 2026-02-12T18:17:07.696 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.673+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.697 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.673+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2546384778}) 2026-02-12T18:17:07.697 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.673+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1430797516}) 2026-02-12T18:17:07.697 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.673+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.697 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.673+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2546384778}) 2026-02-12T18:17:07.697 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.673+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3978804698}) 2026-02-12T18:17:07.697 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.674+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.697 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.674+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1013175284}) 2026-02-12T18:17:07.697 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.674+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=537776658}) 2026-02-12T18:17:07.697 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.674+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.697 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.674+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1013175284}) 2026-02-12T18:17:07.697 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.674+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4224895659}) 2026-02-12T18:17:07.697 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.674+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.698 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.674+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1013175284}) 2026-02-12T18:17:07.698 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.674+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3523270243}) 2026-02-12T18:17:07.698 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.674+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.698 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.674+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1013175284}) 2026-02-12T18:17:07.698 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.674+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=726386631}) 2026-02-12T18:17:07.698 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.674+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.698 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.674+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1013175284}) 2026-02-12T18:17:07.698 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.674+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3960207077}) 2026-02-12T18:17:07.698 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.674+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.698 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.674+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1013175284}) 2026-02-12T18:17:07.698 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.674+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3871534264}) 2026-02-12T18:17:07.698 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.674+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.698 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.674+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1013175284}) 2026-02-12T18:17:07.699 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.674+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=66546183}) 2026-02-12T18:17:07.699 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.674+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.699 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.674+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1013175284}) 2026-02-12T18:17:07.699 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.674+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1563504547}) 2026-02-12T18:17:07.699 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.699 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3229227038}) 2026-02-12T18:17:07.699 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1443231912}) 2026-02-12T18:17:07.699 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.699 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3229227038}) 2026-02-12T18:17:07.699 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3341489242}) 2026-02-12T18:17:07.699 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.699 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3229227038}) 2026-02-12T18:17:07.700 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2687018531}) 2026-02-12T18:17:07.700 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.700 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3229227038}) 2026-02-12T18:17:07.700 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3458594606}) 2026-02-12T18:17:07.700 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.700 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3229227038}) 2026-02-12T18:17:07.700 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2966610227}) 2026-02-12T18:17:07.700 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.700 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3229227038}) 2026-02-12T18:17:07.700 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3039112988}) 2026-02-12T18:17:07.700 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.700 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3229227038}) 2026-02-12T18:17:07.700 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1905498055}) 2026-02-12T18:17:07.701 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.701 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3229227038}) 2026-02-12T18:17:07.701 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1167589614}) 2026-02-12T18:17:07.701 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.701 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3501961635}) 2026-02-12T18:17:07.701 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4223877217}) 2026-02-12T18:17:07.701 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.701 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3501961635}) 2026-02-12T18:17:07.701 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4117253314}) 2026-02-12T18:17:07.701 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.701 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.675+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3501961635}) 2026-02-12T18:17:07.701 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1760941596}) 2026-02-12T18:17:07.701 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.702 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3501961635}) 2026-02-12T18:17:07.702 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4187114092}) 2026-02-12T18:17:07.702 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.702 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3501961635}) 2026-02-12T18:17:07.702 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3945005580}) 2026-02-12T18:17:07.702 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.702 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3501961635}) 2026-02-12T18:17:07.702 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2287687461}) 2026-02-12T18:17:07.702 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.702 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3501961635}) 2026-02-12T18:17:07.702 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=834955035}) 2026-02-12T18:17:07.702 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.703 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3501961635}) 2026-02-12T18:17:07.703 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2702200538}) 2026-02-12T18:17:07.703 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.703 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2200890674}) 2026-02-12T18:17:07.703 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1194241472}) 2026-02-12T18:17:07.703 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.703 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2200890674}) 2026-02-12T18:17:07.703 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2135818738}) 2026-02-12T18:17:07.703 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.703 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2200890674}) 2026-02-12T18:17:07.703 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1128762569}) 2026-02-12T18:17:07.703 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.703 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2200890674}) 2026-02-12T18:17:07.704 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1938938877}) 2026-02-12T18:17:07.704 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.704 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2200890674}) 2026-02-12T18:17:07.704 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3462376978}) 2026-02-12T18:17:07.704 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.704 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2200890674}) 2026-02-12T18:17:07.704 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2180689198}) 2026-02-12T18:17:07.704 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.704 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2200890674}) 2026-02-12T18:17:07.704 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4143303364}) 2026-02-12T18:17:07.704 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.704 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.676+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2200890674}) 2026-02-12T18:17:07.704 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.677+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=262192600}) 2026-02-12T18:17:07.704 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.677+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.705 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.677+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=857117004}) 2026-02-12T18:17:07.705 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.677+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1837588034}) 2026-02-12T18:17:07.705 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.677+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.705 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.677+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=857117004}) 2026-02-12T18:17:07.705 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.677+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=318922637}) 2026-02-12T18:17:07.705 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.677+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.705 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.677+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=857117004}) 2026-02-12T18:17:07.705 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.677+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4071197934}) 2026-02-12T18:17:07.705 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.677+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.705 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.677+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=857117004}) 2026-02-12T18:17:07.705 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.677+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=604140860}) 2026-02-12T18:17:07.705 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.677+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.705 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.677+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=857117004}) 2026-02-12T18:17:07.705 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.677+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=248963443}) 2026-02-12T18:17:07.705 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.677+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.706 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.677+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=857117004}) 2026-02-12T18:17:07.706 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.677+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=336319685}) 2026-02-12T18:17:07.706 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.677+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.706 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.677+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=857117004}) 2026-02-12T18:17:07.706 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.677+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2427394166}) 2026-02-12T18:17:07.706 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.677+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.706 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.677+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=857117004}) 2026-02-12T18:17:07.706 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.677+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3857585617}) 2026-02-12T18:17:07.706 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.678+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.706 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.678+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3918524741}) 2026-02-12T18:17:07.706 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.678+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3005066217}) 2026-02-12T18:17:07.706 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.678+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.706 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.678+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3918524741}) 2026-02-12T18:17:07.706 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.678+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2789976014}) 2026-02-12T18:17:07.707 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.678+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.707 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.678+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3918524741}) 2026-02-12T18:17:07.707 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.678+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2844691951}) 2026-02-12T18:17:07.707 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.678+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.707 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.678+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3918524741}) 2026-02-12T18:17:07.707 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.678+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4205086264}) 2026-02-12T18:17:07.707 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.678+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.707 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.678+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3918524741}) 2026-02-12T18:17:07.707 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.678+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1131985731}) 2026-02-12T18:17:07.707 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.678+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.707 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.678+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3918524741}) 2026-02-12T18:17:07.707 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.678+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2994095816}) 2026-02-12T18:17:07.707 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.678+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.707 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.678+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3918524741}) 2026-02-12T18:17:07.708 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.678+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=784050377}) 2026-02-12T18:17:07.708 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.678+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.708 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.678+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3918524741}) 2026-02-12T18:17:07.708 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.678+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1682679628}) 2026-02-12T18:17:07.708 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.679+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.708 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.679+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=114336114}) 2026-02-12T18:17:07.708 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.679+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1430459177}) 2026-02-12T18:17:07.708 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.679+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.708 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.679+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=114336114}) 2026-02-12T18:17:07.708 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.679+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3444561296}) 2026-02-12T18:17:07.708 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.679+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.708 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.679+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=114336114}) 2026-02-12T18:17:07.708 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.679+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=783965770}) 2026-02-12T18:17:07.708 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.679+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.708 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.679+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=114336114}) 2026-02-12T18:17:07.708 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.679+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2694082769}) 2026-02-12T18:17:07.709 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.679+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.709 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.679+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=114336114}) 2026-02-12T18:17:07.709 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.679+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3524121972}) 2026-02-12T18:17:07.709 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.679+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.709 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.679+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=114336114}) 2026-02-12T18:17:07.709 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.679+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3747794685}) 2026-02-12T18:17:07.709 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.679+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.709 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.679+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=114336114}) 2026-02-12T18:17:07.709 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.679+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2740490773}) 2026-02-12T18:17:07.709 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.679+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.709 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.679+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=114336114}) 2026-02-12T18:17:07.709 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.679+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2949020806}) 2026-02-12T18:17:07.709 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.680+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.709 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.680+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4216334723}) 2026-02-12T18:17:07.709 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.680+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=291249100}) 2026-02-12T18:17:07.709 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.680+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.709 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.680+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4216334723}) 2026-02-12T18:17:07.710 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.680+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2143857337}) 2026-02-12T18:17:07.710 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.680+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.710 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.680+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4216334723}) 2026-02-12T18:17:07.710 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.680+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2038902455}) 2026-02-12T18:17:07.710 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.680+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.710 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.680+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4216334723}) 2026-02-12T18:17:07.710 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.680+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3233957124}) 2026-02-12T18:17:07.710 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.680+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.710 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.680+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4216334723}) 2026-02-12T18:17:07.710 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.680+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=641613704}) 2026-02-12T18:17:07.710 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.680+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.710 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.680+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4216334723}) 2026-02-12T18:17:07.710 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.680+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1650989006}) 2026-02-12T18:17:07.710 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.680+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.710 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.680+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4216334723}) 2026-02-12T18:17:07.711 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.680+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1171196937}) 2026-02-12T18:17:07.711 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.680+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.711 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.680+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4216334723}) 2026-02-12T18:17:07.711 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.680+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1433998169}) 2026-02-12T18:17:07.711 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.681+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.711 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.681+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1914072451}) 2026-02-12T18:17:07.711 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.681+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=445430456}) 2026-02-12T18:17:07.711 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.681+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.711 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.681+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1914072451}) 2026-02-12T18:17:07.711 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.681+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1963711381}) 2026-02-12T18:17:07.711 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.681+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.711 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.681+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1914072451}) 2026-02-12T18:17:07.711 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.681+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2049122157}) 2026-02-12T18:17:07.711 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.681+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.711 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.681+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1914072451}) 2026-02-12T18:17:07.711 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.681+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=307724405}) 2026-02-12T18:17:07.712 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.681+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.712 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.681+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1914072451}) 2026-02-12T18:17:07.712 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.681+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=327235149}) 2026-02-12T18:17:07.712 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.681+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.712 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.681+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1914072451}) 2026-02-12T18:17:07.712 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.681+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1661285435}) 2026-02-12T18:17:07.712 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.681+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.712 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.681+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1914072451}) 2026-02-12T18:17:07.712 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.681+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2333539734}) 2026-02-12T18:17:07.712 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.681+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.712 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.681+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1914072451}) 2026-02-12T18:17:07.712 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.681+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=94729667}) 2026-02-12T18:17:07.713 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2026-02-12T18:17:07.733 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.682+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.733 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.682+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1955279297}) 2026-02-12T18:17:07.733 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.682+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1832172104}) 2026-02-12T18:17:07.733 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.682+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.733 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.682+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1955279297}) 2026-02-12T18:17:07.733 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.682+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4034354887}) 2026-02-12T18:17:07.733 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.682+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.733 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.682+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1955279297}) 2026-02-12T18:17:07.733 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.682+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1978367946}) 2026-02-12T18:17:07.733 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.682+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.733 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.682+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1955279297}) 2026-02-12T18:17:07.733 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.682+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1987816547}) 2026-02-12T18:17:07.733 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.682+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.733 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.682+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1955279297}) 2026-02-12T18:17:07.733 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.682+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=134324027}) 2026-02-12T18:17:07.733 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.682+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.682+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1955279297}) 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.682+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=917359593}) 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.682+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.682+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1955279297}) 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.682+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=587452780}) 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.682+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.682+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1955279297}) 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.682+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1692063711}) 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.683+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.683+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2359963384}) 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.683+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4137562040}) 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.683+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.683+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2359963384}) 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.683+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=851698834}) 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.683+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.683+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2359963384}) 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.683+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2675849958}) 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.683+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.683+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2359963384}) 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.683+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=442171494}) 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.683+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.683+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2359963384}) 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.683+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=142705691}) 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.683+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.683+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2359963384}) 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.683+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=95613368}) 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.683+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.734 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.683+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2359963384}) 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.683+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=377995506}) 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.683+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.683+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2359963384}) 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.683+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=838974458}) 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.684+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.684+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2453125173}) 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.684+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2578126456}) 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.684+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.684+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2453125173}) 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.684+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4139475115}) 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.684+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.684+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2453125173}) 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.684+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=976013627}) 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.684+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.684+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2453125173}) 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.684+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=555501630}) 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.684+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.684+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2453125173}) 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.684+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3580923519}) 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.684+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.684+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2453125173}) 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.684+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3939221118}) 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.684+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.684+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2453125173}) 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.684+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3656693664}) 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.684+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.684+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2453125173}) 2026-02-12T18:17:07.735 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.684+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1149235254}) 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.685+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.685+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3909895072}) 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.685+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3358723343}) 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.685+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.685+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3909895072}) 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.685+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3958985598}) 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.685+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.685+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3909895072}) 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.685+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1882288099}) 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.685+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.685+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3909895072}) 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.685+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=24397398}) 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.685+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.685+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3909895072}) 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.685+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=102775003}) 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.685+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.685+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3909895072}) 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.685+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4036491281}) 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.685+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.685+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3909895072}) 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.685+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3985821811}) 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.685+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.685+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3909895072}) 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.685+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=783500373}) 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.686+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.686+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=997153020}) 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.686+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3629680894}) 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.686+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.736 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.686+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=997153020}) 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.686+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=435072283}) 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.686+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.686+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=997153020}) 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.686+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1588441701}) 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.686+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.686+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=997153020}) 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.686+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1391960859}) 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.686+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.686+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=997153020}) 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.686+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=381384178}) 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.686+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.686+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=997153020}) 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.686+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=343025396}) 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.686+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.686+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=997153020}) 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.686+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3634520863}) 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.686+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.686+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=997153020}) 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.686+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=55363370}) 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.687+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.687+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3109365105}) 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.687+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=647144784}) 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.687+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.687+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3109365105}) 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.687+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=971432405}) 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.687+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.687+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3109365105}) 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.687+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2767239223}) 2026-02-12T18:17:07.737 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.687+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.687+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3109365105}) 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.687+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1385880089}) 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.687+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.687+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3109365105}) 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.687+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2282290706}) 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.687+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.687+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3109365105}) 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.687+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=575434730}) 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.687+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.687+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3109365105}) 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.687+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3651872272}) 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.687+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.687+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3109365105}) 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.687+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4188467795}) 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.688+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.688+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3458009954}) 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.688+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2158443932}) 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.688+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.688+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3458009954}) 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.688+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=699657308}) 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.688+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.688+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3458009954}) 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.688+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3076979379}) 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.688+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.688+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3458009954}) 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.688+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=907672852}) 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.688+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.688+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3458009954}) 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.688+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2319775400}) 2026-02-12T18:17:07.738 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.688+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.688+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3458009954}) 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.688+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1989537091}) 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.688+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.688+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3458009954}) 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.688+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1604497656}) 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.688+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.688+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3458009954}) 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.688+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2188574809}) 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.689+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.689+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2021370015}) 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.689+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=965514292}) 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.689+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.689+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2021370015}) 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.689+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2585032929}) 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.689+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.689+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2021370015}) 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.689+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2119911056}) 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.689+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.689+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2021370015}) 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.689+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1668221616}) 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.689+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.689+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2021370015}) 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.689+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3078560913}) 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.689+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.689+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2021370015}) 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.689+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=863981615}) 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.689+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.689+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2021370015}) 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.689+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2301474103}) 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.689+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.739 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.689+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2021370015}) 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.689+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2343719118}) 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.690+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.690+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1594941920}) 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.690+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2480164195}) 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.690+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.690+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1594941920}) 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.690+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1667987720}) 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.690+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.690+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1594941920}) 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.690+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2904456849}) 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.690+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.690+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1594941920}) 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.690+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1627598017}) 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.690+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.690+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1594941920}) 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.690+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2147908341}) 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.690+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.690+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1594941920}) 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.690+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1183979647}) 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.690+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.690+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1594941920}) 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.690+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2095310197}) 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.690+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.690+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1594941920}) 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.690+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1058623180}) 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2114404205}) 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1393220304}) 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2114404205}) 2026-02-12T18:17:07.740 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3067907724}) 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2114404205}) 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=495567452}) 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2114404205}) 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3496048621}) 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2114404205}) 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4169831564}) 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2114404205}) 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=491379482}) 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2114404205}) 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1978356464}) 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2114404205}) 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1793726804}) 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2366246448}) 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1602932106}) 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2366246448}) 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3715464730}) 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2366246448}) 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=755196568}) 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2366246448}) 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=385693338}) 2026-02-12T18:17:07.741 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.691+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2366246448}) 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.692+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=695635317}) 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.692+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.692+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2366246448}) 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.692+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3218881970}) 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.692+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.692+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2366246448}) 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.692+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=7518739}) 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.692+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.692+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2366246448}) 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.692+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2663901406}) 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.699+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.699+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1420538253}) 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.699+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1450921921}) 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.699+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.699+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1420538253}) 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.699+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=253916009}) 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.699+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.699+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1420538253}) 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.699+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1193453332}) 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.699+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.699+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1420538253}) 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.699+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3726054541}) 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.699+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.699+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1420538253}) 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.699+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1452047905}) 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.699+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.699+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1420538253}) 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.699+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=517509129}) 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.699+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.700+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1420538253}) 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.700+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3062392242}) 2026-02-12T18:17:07.742 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.700+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.700+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1420538253}) 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.700+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3893839476}) 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.700+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.700+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1290879512}) 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.700+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2154170069}) 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.700+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.700+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1290879512}) 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.700+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1628378933}) 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.701+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.701+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1290879512}) 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.701+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3806105052}) 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.701+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.701+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1290879512}) 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.701+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4283647980}) 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.701+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.701+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1290879512}) 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.701+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=811356829}) 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.701+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.701+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1290879512}) 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.701+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2366076598}) 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.701+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.701+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1290879512}) 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.701+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2844152642}) 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.701+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.701+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1290879512}) 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.701+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2635664922}) 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.708+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.708+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=426264547}) 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.708+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=896330169}) 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.708+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.708+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=426264547}) 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.708+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1610128170}) 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.708+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.743 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.708+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=426264547}) 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.708+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=561532947}) 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.708+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.708+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=426264547}) 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.708+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2603813764}) 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.709+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.709+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=426264547}) 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.709+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=289594094}) 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.709+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.709+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=426264547}) 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.709+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=328345087}) 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.709+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.709+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=426264547}) 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.709+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=548537034}) 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.709+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.709+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=426264547}) 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.709+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3999429215}) 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1209267612}) 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4012896064}) 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1209267612}) 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1620509322}) 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1209267612}) 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3343530198}) 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1209267612}) 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3846764924}) 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1209267612}) 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=668784421}) 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1209267612}) 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1092868918}) 2026-02-12T18:17:07.744 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1209267612}) 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=344126705}) 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1209267612}) 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.710+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1162688109}) 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=6920488}) 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1894323218}) 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=6920488}) 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=153107900}) 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=6920488}) 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3720111388}) 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=6920488}) 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3081298784}) 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=6920488}) 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=373637635}) 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=6920488}) 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1263999410}) 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=6920488}) 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=539504041}) 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=6920488}) 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.711+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3735792247}) 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.718+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.718+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1983390385}) 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.718+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1645603445}) 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.718+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.718+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1983390385}) 2026-02-12T18:17:07.745 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.718+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2020234066}) 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.719+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.719+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1983390385}) 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.719+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2599744748}) 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.719+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.719+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1983390385}) 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.719+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=920184637}) 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.719+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.719+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1983390385}) 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.719+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3410050491}) 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.719+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.719+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1983390385}) 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.719+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4155109844}) 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.719+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.719+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1983390385}) 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.719+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3202301310}) 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.719+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.719+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1983390385}) 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.719+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4291665756}) 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.720+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.720+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2799577198}) 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.720+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3175573688}) 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.720+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.720+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2799577198}) 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.720+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1349038500}) 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.720+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.720+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2799577198}) 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.720+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=9673177}) 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.720+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.720+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2799577198}) 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.720+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1451147406}) 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.720+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.720+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2799577198}) 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.720+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2974112396}) 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.720+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.746 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.720+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2799577198}) 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.720+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=952916712}) 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.720+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.720+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2799577198}) 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.720+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3788884433}) 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.720+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.720+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2799577198}) 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.720+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2061771552}) 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.721+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.721+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2126860639}) 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.721+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2222914221}) 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.721+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.721+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2126860639}) 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.721+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=525498659}) 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.721+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.721+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2126860639}) 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.721+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1092331238}) 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.721+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.721+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2126860639}) 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.721+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1345267623}) 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.721+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.721+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2126860639}) 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.721+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3076028601}) 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.721+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.721+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2126860639}) 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.721+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3621139896}) 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.721+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.721+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2126860639}) 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.721+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1748508114}) 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.721+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.721+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2126860639}) 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.721+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3355764676}) 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.722+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.722+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2659556277}) 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.722+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4077825633}) 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.722+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.722+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2659556277}) 2026-02-12T18:17:07.747 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.722+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1951905911}) 2026-02-12T18:17:07.748 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.722+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.748 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.722+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2659556277}) 2026-02-12T18:17:07.748 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.722+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1251612561}) 2026-02-12T18:17:07.748 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.722+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.748 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.722+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2659556277}) 2026-02-12T18:17:07.748 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.722+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3885232693}) 2026-02-12T18:17:07.748 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.722+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.748 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.722+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2659556277}) 2026-02-12T18:17:07.748 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.722+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1667846246}) 2026-02-12T18:17:07.748 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.722+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.748 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.722+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2659556277}) 2026-02-12T18:17:07.748 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.722+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=451099544}) 2026-02-12T18:17:07.748 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.722+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.748 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.722+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2659556277}) 2026-02-12T18:17:07.748 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.722+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3927514371}) 2026-02-12T18:17:07.748 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.722+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:07.748 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.722+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2659556277}) 2026-02-12T18:17:07.748 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:07.722+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3838115486}) 2026-02-12T18:17:08.043 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.042+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.043 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.042+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1494802734}) 2026-02-12T18:17:08.044 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.042+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2181916971}) 2026-02-12T18:17:08.044 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.042+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.044 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.042+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1494802734}) 2026-02-12T18:17:08.044 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.042+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2630240305}) 2026-02-12T18:17:08.044 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.042+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.044 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.042+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1494802734}) 2026-02-12T18:17:08.044 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.042+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1020888597}) 2026-02-12T18:17:08.044 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.042+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.044 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.042+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1494802734}) 2026-02-12T18:17:08.044 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.042+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1981948449}) 2026-02-12T18:17:08.044 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.042+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.044 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.042+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1494802734}) 2026-02-12T18:17:08.044 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.042+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1508938188}) 2026-02-12T18:17:08.044 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.042+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.044 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.042+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1494802734}) 2026-02-12T18:17:08.044 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.042+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2503579936}) 2026-02-12T18:17:08.044 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.042+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.044 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.042+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1494802734}) 2026-02-12T18:17:08.044 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.042+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3764749056}) 2026-02-12T18:17:08.044 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.042+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.044 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.042+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1494802734}) 2026-02-12T18:17:08.044 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.042+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1032583237}) 2026-02-12T18:17:08.053 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.050+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.053 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.050+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1133356556}) 2026-02-12T18:17:08.053 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.050+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1995899681}) 2026-02-12T18:17:08.053 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.050+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.053 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.050+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1133356556}) 2026-02-12T18:17:08.053 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.050+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=473513030}) 2026-02-12T18:17:08.053 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.050+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.054 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.050+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1133356556}) 2026-02-12T18:17:08.054 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.050+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3921910653}) 2026-02-12T18:17:08.054 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.050+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.054 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.050+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1133356556}) 2026-02-12T18:17:08.054 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.050+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2180130653}) 2026-02-12T18:17:08.054 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.050+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.054 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.050+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1133356556}) 2026-02-12T18:17:08.054 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.050+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2352342962}) 2026-02-12T18:17:08.054 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.050+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.054 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.050+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1133356556}) 2026-02-12T18:17:08.054 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.050+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=438627759}) 2026-02-12T18:17:08.054 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.050+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.054 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.050+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1133356556}) 2026-02-12T18:17:08.055 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.050+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3652208716}) 2026-02-12T18:17:08.055 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.050+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.055 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.050+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1133356556}) 2026-02-12T18:17:08.055 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.050+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1035240585}) 2026-02-12T18:17:08.068 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.068 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861913468}) 2026-02-12T18:17:08.068 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3357325708}) 2026-02-12T18:17:08.069 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.069 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861913468}) 2026-02-12T18:17:08.069 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1064115312}) 2026-02-12T18:17:08.069 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.069 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861913468}) 2026-02-12T18:17:08.069 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1333053954}) 2026-02-12T18:17:08.069 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.069 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861913468}) 2026-02-12T18:17:08.069 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=13884491}) 2026-02-12T18:17:08.069 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.069 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861913468}) 2026-02-12T18:17:08.069 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2217186168}) 2026-02-12T18:17:08.070 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.070 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861913468}) 2026-02-12T18:17:08.070 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3201394559}) 2026-02-12T18:17:08.070 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.070 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861913468}) 2026-02-12T18:17:08.070 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.065+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2651338350}) 2026-02-12T18:17:08.070 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.066+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.070 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.066+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861913468}) 2026-02-12T18:17:08.070 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.066+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3665999498}) 2026-02-12T18:17:08.349 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.346+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.349 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.346+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1461209836}) 2026-02-12T18:17:08.350 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.346+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1954275925}) 2026-02-12T18:17:08.350 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.346+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.350 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.346+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1461209836}) 2026-02-12T18:17:08.350 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.346+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2321326566}) 2026-02-12T18:17:08.350 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.346+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.350 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.346+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1461209836}) 2026-02-12T18:17:08.350 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.346+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3088542379}) 2026-02-12T18:17:08.350 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.346+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.350 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.346+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1461209836}) 2026-02-12T18:17:08.350 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.346+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=422474668}) 2026-02-12T18:17:08.350 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.346+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.350 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.346+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1461209836}) 2026-02-12T18:17:08.351 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.346+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1202426749}) 2026-02-12T18:17:08.351 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.346+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.351 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.346+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1461209836}) 2026-02-12T18:17:08.351 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.346+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4294810092}) 2026-02-12T18:17:08.351 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.346+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.351 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.346+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1461209836}) 2026-02-12T18:17:08.351 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.346+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=417708219}) 2026-02-12T18:17:08.351 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.346+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.351 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.346+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1461209836}) 2026-02-12T18:17:08.351 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.346+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3308313559}) 2026-02-12T18:17:08.359 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.356+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.359 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.356+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=762971454}) 2026-02-12T18:17:08.359 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.356+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1835246585}) 2026-02-12T18:17:08.359 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.356+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.359 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.356+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=762971454}) 2026-02-12T18:17:08.359 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.356+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3427861450}) 2026-02-12T18:17:08.359 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.356+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.359 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.356+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=762971454}) 2026-02-12T18:17:08.359 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.356+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=571156786}) 2026-02-12T18:17:08.359 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.356+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.360 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.356+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=762971454}) 2026-02-12T18:17:08.360 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.356+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4261278350}) 2026-02-12T18:17:08.360 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.356+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.360 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.356+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=762971454}) 2026-02-12T18:17:08.360 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.356+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4259510235}) 2026-02-12T18:17:08.360 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.356+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.360 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.356+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=762971454}) 2026-02-12T18:17:08.360 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.356+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2852153670}) 2026-02-12T18:17:08.360 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.356+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.360 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.356+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=762971454}) 2026-02-12T18:17:08.360 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.356+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2949192070}) 2026-02-12T18:17:08.360 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.356+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.360 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.356+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=762971454}) 2026-02-12T18:17:08.361 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.356+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2875060856}) 2026-02-12T18:17:08.629 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.589+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.629 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.589+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1821777525}) 2026-02-12T18:17:08.629 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.589+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=532807175}) 2026-02-12T18:17:08.629 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.589+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.629 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.589+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1821777525}) 2026-02-12T18:17:08.629 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.589+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1578766526}) 2026-02-12T18:17:08.629 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.589+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.629 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.589+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1821777525}) 2026-02-12T18:17:08.629 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.589+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4112578764}) 2026-02-12T18:17:08.629 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.589+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.630 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.589+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1821777525}) 2026-02-12T18:17:08.630 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.589+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3347993833}) 2026-02-12T18:17:08.630 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.589+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.630 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.589+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1821777525}) 2026-02-12T18:17:08.630 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.589+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3958381922}) 2026-02-12T18:17:08.630 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.589+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.630 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.589+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1821777525}) 2026-02-12T18:17:08.630 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.589+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=436331602}) 2026-02-12T18:17:08.630 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.589+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.630 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.589+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1821777525}) 2026-02-12T18:17:08.630 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.589+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=882279498}) 2026-02-12T18:17:08.630 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.589+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.630 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.589+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1821777525}) 2026-02-12T18:17:08.630 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.589+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=262342217}) 2026-02-12T18:17:08.631 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.590+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.631 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.590+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=312135342}) 2026-02-12T18:17:08.631 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.590+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1400214037}) 2026-02-12T18:17:08.631 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.590+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.631 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.590+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=312135342}) 2026-02-12T18:17:08.631 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.590+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=765383412}) 2026-02-12T18:17:08.631 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.590+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.631 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.590+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=312135342}) 2026-02-12T18:17:08.631 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.590+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3954660220}) 2026-02-12T18:17:08.631 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.590+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.631 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.590+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=312135342}) 2026-02-12T18:17:08.631 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.590+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=855147581}) 2026-02-12T18:17:08.631 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.590+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.631 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.590+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=312135342}) 2026-02-12T18:17:08.631 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.590+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1501751292}) 2026-02-12T18:17:08.632 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.590+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.632 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.590+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=312135342}) 2026-02-12T18:17:08.632 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.590+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3453482059}) 2026-02-12T18:17:08.632 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.590+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.632 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.590+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=312135342}) 2026-02-12T18:17:08.632 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.590+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2319608967}) 2026-02-12T18:17:08.632 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.590+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.632 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.590+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=312135342}) 2026-02-12T18:17:08.632 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.590+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3000068641}) 2026-02-12T18:17:08.632 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.591+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.632 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.591+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1700941948}) 2026-02-12T18:17:08.632 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.591+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3990556586}) 2026-02-12T18:17:08.632 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.591+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.632 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.591+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1700941948}) 2026-02-12T18:17:08.632 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.591+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1216878917}) 2026-02-12T18:17:08.632 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.591+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.633 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.591+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1700941948}) 2026-02-12T18:17:08.633 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.591+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3305560409}) 2026-02-12T18:17:08.633 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.591+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.633 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.592+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1700941948}) 2026-02-12T18:17:08.633 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.592+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3007674613}) 2026-02-12T18:17:08.633 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.592+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.633 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.592+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1700941948}) 2026-02-12T18:17:08.633 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.592+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=954204264}) 2026-02-12T18:17:08.633 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.592+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.633 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.592+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1700941948}) 2026-02-12T18:17:08.633 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.592+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1856125778}) 2026-02-12T18:17:08.633 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.592+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.633 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.592+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1700941948}) 2026-02-12T18:17:08.633 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.592+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2583980579}) 2026-02-12T18:17:08.633 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.592+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.634 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.592+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1700941948}) 2026-02-12T18:17:08.634 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.592+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3201079980}) 2026-02-12T18:17:08.634 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.593+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.634 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.593+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4232314230}) 2026-02-12T18:17:08.634 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.593+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2522625418}) 2026-02-12T18:17:08.634 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.593+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.634 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.593+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4232314230}) 2026-02-12T18:17:08.634 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.593+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3636916275}) 2026-02-12T18:17:08.634 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.593+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.634 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.593+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4232314230}) 2026-02-12T18:17:08.634 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.593+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2656717474}) 2026-02-12T18:17:08.634 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.593+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.634 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.593+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4232314230}) 2026-02-12T18:17:08.634 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.593+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1709449282}) 2026-02-12T18:17:08.634 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.593+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.634 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.593+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4232314230}) 2026-02-12T18:17:08.634 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.593+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3415268440}) 2026-02-12T18:17:08.635 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.593+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.635 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.593+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4232314230}) 2026-02-12T18:17:08.635 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.593+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3084280808}) 2026-02-12T18:17:08.635 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.593+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.635 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.593+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4232314230}) 2026-02-12T18:17:08.635 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.593+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=90123578}) 2026-02-12T18:17:08.635 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.593+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.635 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.593+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4232314230}) 2026-02-12T18:17:08.635 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.593+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3155691448}) 2026-02-12T18:17:08.635 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.594+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.635 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.594+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3343613587}) 2026-02-12T18:17:08.635 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.594+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3762385187}) 2026-02-12T18:17:08.635 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.594+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.635 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.594+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3343613587}) 2026-02-12T18:17:08.635 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.594+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1265878183}) 2026-02-12T18:17:08.635 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.594+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.635 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.594+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3343613587}) 2026-02-12T18:17:08.635 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.594+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=8633286}) 2026-02-12T18:17:08.636 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.594+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.636 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.594+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3343613587}) 2026-02-12T18:17:08.636 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.594+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=743903590}) 2026-02-12T18:17:08.636 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.594+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.636 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.594+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3343613587}) 2026-02-12T18:17:08.636 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.594+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4068790947}) 2026-02-12T18:17:08.636 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.594+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.636 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.594+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3343613587}) 2026-02-12T18:17:08.636 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.594+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1833602421}) 2026-02-12T18:17:08.636 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.594+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.636 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.594+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3343613587}) 2026-02-12T18:17:08.636 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.594+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2101986089}) 2026-02-12T18:17:08.636 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.594+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.636 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.594+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3343613587}) 2026-02-12T18:17:08.636 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.594+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3333018919}) 2026-02-12T18:17:08.636 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.595+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.636 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.595+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3358462547}) 2026-02-12T18:17:08.637 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.595+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=371889535}) 2026-02-12T18:17:08.637 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.595+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.637 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.595+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3358462547}) 2026-02-12T18:17:08.637 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.595+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2784147123}) 2026-02-12T18:17:08.637 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.595+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.637 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.595+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3358462547}) 2026-02-12T18:17:08.637 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.595+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=788084540}) 2026-02-12T18:17:08.637 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.595+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.637 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.595+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3358462547}) 2026-02-12T18:17:08.637 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.595+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=295699281}) 2026-02-12T18:17:08.637 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.595+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.637 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.595+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3358462547}) 2026-02-12T18:17:08.637 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.595+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2048645349}) 2026-02-12T18:17:08.637 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.595+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.637 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.595+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3358462547}) 2026-02-12T18:17:08.637 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.595+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3115335983}) 2026-02-12T18:17:08.637 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.595+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.637 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.595+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3358462547}) 2026-02-12T18:17:08.637 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.595+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=359337994}) 2026-02-12T18:17:08.638 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.595+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.638 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.595+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3358462547}) 2026-02-12T18:17:08.638 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.595+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1893724611}) 2026-02-12T18:17:08.638 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.596+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.638 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.596+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2015158347}) 2026-02-12T18:17:08.638 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.596+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3891779164}) 2026-02-12T18:17:08.638 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.596+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.638 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.596+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2015158347}) 2026-02-12T18:17:08.638 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.596+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1039559108}) 2026-02-12T18:17:08.638 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.596+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.638 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.596+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2015158347}) 2026-02-12T18:17:08.638 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.596+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4172583867}) 2026-02-12T18:17:08.638 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.596+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.638 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.596+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2015158347}) 2026-02-12T18:17:08.638 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.596+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3414366266}) 2026-02-12T18:17:08.638 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.596+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.638 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.596+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2015158347}) 2026-02-12T18:17:08.638 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.596+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1977375637}) 2026-02-12T18:17:08.638 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.596+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.639 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.596+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2015158347}) 2026-02-12T18:17:08.639 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.596+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3836845258}) 2026-02-12T18:17:08.639 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.596+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.639 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.596+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2015158347}) 2026-02-12T18:17:08.639 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.596+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1240062477}) 2026-02-12T18:17:08.639 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.596+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.639 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.596+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2015158347}) 2026-02-12T18:17:08.639 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.596+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3070191568}) 2026-02-12T18:17:08.639 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.597+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.639 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.597+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1820446918}) 2026-02-12T18:17:08.639 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.597+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3323794709}) 2026-02-12T18:17:08.639 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.597+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.639 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.597+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1820446918}) 2026-02-12T18:17:08.639 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.597+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=529631430}) 2026-02-12T18:17:08.639 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.597+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.639 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.597+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1820446918}) 2026-02-12T18:17:08.639 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.597+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4155333936}) 2026-02-12T18:17:08.639 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.597+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.639 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.597+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1820446918}) 2026-02-12T18:17:08.639 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.597+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=750921496}) 2026-02-12T18:17:08.640 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.597+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.640 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.597+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1820446918}) 2026-02-12T18:17:08.640 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.597+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1375052656}) 2026-02-12T18:17:08.640 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.597+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.640 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.597+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1820446918}) 2026-02-12T18:17:08.640 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.597+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3985103333}) 2026-02-12T18:17:08.640 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.597+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.640 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.597+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1820446918}) 2026-02-12T18:17:08.640 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.597+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1511421495}) 2026-02-12T18:17:08.640 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.597+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.640 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.597+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1820446918}) 2026-02-12T18:17:08.640 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.597+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=986078052}) 2026-02-12T18:17:08.640 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.598+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.640 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.598+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=804411291}) 2026-02-12T18:17:08.640 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.598+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1721512348}) 2026-02-12T18:17:08.640 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.598+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.640 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.598+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=804411291}) 2026-02-12T18:17:08.640 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.598+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=430069872}) 2026-02-12T18:17:08.640 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.598+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.640 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.598+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=804411291}) 2026-02-12T18:17:08.641 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.598+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=851029332}) 2026-02-12T18:17:08.641 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.598+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.641 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.598+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=804411291}) 2026-02-12T18:17:08.641 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.598+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3697454149}) 2026-02-12T18:17:08.641 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.598+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.641 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.598+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=804411291}) 2026-02-12T18:17:08.641 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.598+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2240974173}) 2026-02-12T18:17:08.641 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.598+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.641 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.598+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=804411291}) 2026-02-12T18:17:08.641 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.598+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=816624951}) 2026-02-12T18:17:08.641 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.598+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.641 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.598+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=804411291}) 2026-02-12T18:17:08.641 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.598+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3528381861}) 2026-02-12T18:17:08.641 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.598+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.641 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.598+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=804411291}) 2026-02-12T18:17:08.641 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.598+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1939509195}) 2026-02-12T18:17:08.641 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.599+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.641 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.599+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1750354788}) 2026-02-12T18:17:08.641 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.599+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3662891728}) 2026-02-12T18:17:08.641 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.599+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.642 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.599+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1750354788}) 2026-02-12T18:17:08.642 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.599+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2493762402}) 2026-02-12T18:17:08.642 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.599+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.642 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.599+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1750354788}) 2026-02-12T18:17:08.642 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.599+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=62531645}) 2026-02-12T18:17:08.642 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.599+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.642 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.599+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1750354788}) 2026-02-12T18:17:08.642 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.599+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=161362813}) 2026-02-12T18:17:08.642 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.599+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.642 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.599+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1750354788}) 2026-02-12T18:17:08.642 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.599+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1510042120}) 2026-02-12T18:17:08.642 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.599+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.642 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.599+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1750354788}) 2026-02-12T18:17:08.642 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.599+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2818298195}) 2026-02-12T18:17:08.642 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.599+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.642 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.599+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1750354788}) 2026-02-12T18:17:08.642 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.599+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4041991993}) 2026-02-12T18:17:08.642 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.599+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.642 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.599+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1750354788}) 2026-02-12T18:17:08.642 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.599+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=955467345}) 2026-02-12T18:17:08.642 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.600+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.643 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.600+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2163091012}) 2026-02-12T18:17:08.643 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.600+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2584144847}) 2026-02-12T18:17:08.643 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.600+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.643 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.600+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2163091012}) 2026-02-12T18:17:08.643 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.600+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3350051080}) 2026-02-12T18:17:08.643 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.600+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.643 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.600+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2163091012}) 2026-02-12T18:17:08.643 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.600+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=587955387}) 2026-02-12T18:17:08.643 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.600+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.643 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.600+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2163091012}) 2026-02-12T18:17:08.643 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.600+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=993885537}) 2026-02-12T18:17:08.643 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.600+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.643 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.600+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2163091012}) 2026-02-12T18:17:08.643 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.600+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=405923522}) 2026-02-12T18:17:08.643 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.600+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.643 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.600+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2163091012}) 2026-02-12T18:17:08.643 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.600+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1861769486}) 2026-02-12T18:17:08.643 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.600+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.643 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.600+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2163091012}) 2026-02-12T18:17:08.643 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.600+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1415677262}) 2026-02-12T18:17:08.644 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.600+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.644 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.600+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2163091012}) 2026-02-12T18:17:08.644 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.600+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3199018831}) 2026-02-12T18:17:08.644 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.601+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.644 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.601+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=283678356}) 2026-02-12T18:17:08.644 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.601+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3687963426}) 2026-02-12T18:17:08.644 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.601+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.644 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.601+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=283678356}) 2026-02-12T18:17:08.644 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.601+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1222098538}) 2026-02-12T18:17:08.644 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.601+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.644 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.601+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=283678356}) 2026-02-12T18:17:08.644 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.601+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2129585969}) 2026-02-12T18:17:08.644 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.601+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.644 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.601+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=283678356}) 2026-02-12T18:17:08.644 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.601+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4128065484}) 2026-02-12T18:17:08.644 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.601+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.644 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.601+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=283678356}) 2026-02-12T18:17:08.644 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.601+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4285975969}) 2026-02-12T18:17:08.644 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.601+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.644 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.601+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=283678356}) 2026-02-12T18:17:08.644 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.601+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4210230134}) 2026-02-12T18:17:08.645 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.601+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.645 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.601+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=283678356}) 2026-02-12T18:17:08.645 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.601+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2379493768}) 2026-02-12T18:17:08.645 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.601+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.645 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.601+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=283678356}) 2026-02-12T18:17:08.645 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.601+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3598175172}) 2026-02-12T18:17:08.645 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.602+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.645 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.602+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4070485931}) 2026-02-12T18:17:08.645 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.602+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1000069780}) 2026-02-12T18:17:08.645 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.602+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.645 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.602+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4070485931}) 2026-02-12T18:17:08.645 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.602+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1032544770}) 2026-02-12T18:17:08.645 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.602+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.645 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.602+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4070485931}) 2026-02-12T18:17:08.645 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.602+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=203170237}) 2026-02-12T18:17:08.645 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.602+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.645 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.602+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4070485931}) 2026-02-12T18:17:08.645 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.602+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=314942990}) 2026-02-12T18:17:08.645 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.602+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.645 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.602+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4070485931}) 2026-02-12T18:17:08.645 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.602+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=897009607}) 2026-02-12T18:17:08.645 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.602+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.646 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.602+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4070485931}) 2026-02-12T18:17:08.646 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.602+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1885822719}) 2026-02-12T18:17:08.646 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.602+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.646 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.602+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4070485931}) 2026-02-12T18:17:08.646 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.602+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=832698906}) 2026-02-12T18:17:08.646 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.602+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.646 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.602+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4070485931}) 2026-02-12T18:17:08.646 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.602+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=389512901}) 2026-02-12T18:17:08.646 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.603+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.646 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.603+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2608686176}) 2026-02-12T18:17:08.646 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.603+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1600844530}) 2026-02-12T18:17:08.646 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.603+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.646 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.603+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2608686176}) 2026-02-12T18:17:08.646 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.603+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1183393380}) 2026-02-12T18:17:08.646 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.603+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.646 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.603+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2608686176}) 2026-02-12T18:17:08.646 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.603+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1919889968}) 2026-02-12T18:17:08.646 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.603+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.646 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.603+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2608686176}) 2026-02-12T18:17:08.646 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.603+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2773834239}) 2026-02-12T18:17:08.646 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.603+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.646 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.603+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2608686176}) 2026-02-12T18:17:08.647 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.603+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1279436832}) 2026-02-12T18:17:08.647 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.603+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.647 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.603+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2608686176}) 2026-02-12T18:17:08.647 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.603+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2598453265}) 2026-02-12T18:17:08.647 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.603+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.647 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.603+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2608686176}) 2026-02-12T18:17:08.647 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.603+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2617990441}) 2026-02-12T18:17:08.647 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.603+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.647 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.603+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2608686176}) 2026-02-12T18:17:08.647 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.603+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2087585381}) 2026-02-12T18:17:08.647 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.647 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3707709372}) 2026-02-12T18:17:08.647 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1925109163}) 2026-02-12T18:17:08.647 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.647 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3707709372}) 2026-02-12T18:17:08.647 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3585953593}) 2026-02-12T18:17:08.647 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.647 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3707709372}) 2026-02-12T18:17:08.647 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2365520490}) 2026-02-12T18:17:08.647 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.647 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3707709372}) 2026-02-12T18:17:08.647 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=659851493}) 2026-02-12T18:17:08.647 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.648 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3707709372}) 2026-02-12T18:17:08.648 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3487033888}) 2026-02-12T18:17:08.648 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.648 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3707709372}) 2026-02-12T18:17:08.648 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2116626404}) 2026-02-12T18:17:08.648 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.648 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3707709372}) 2026-02-12T18:17:08.648 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=303286872}) 2026-02-12T18:17:08.648 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.648 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3707709372}) 2026-02-12T18:17:08.648 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2942135595}) 2026-02-12T18:17:08.648 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.648 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1402745199}) 2026-02-12T18:17:08.648 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3623278158}) 2026-02-12T18:17:08.648 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.648 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1402745199}) 2026-02-12T18:17:08.648 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2012215931}) 2026-02-12T18:17:08.648 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.604+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.648 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1402745199}) 2026-02-12T18:17:08.648 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3773291810}) 2026-02-12T18:17:08.648 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.648 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1402745199}) 2026-02-12T18:17:08.648 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2025921383}) 2026-02-12T18:17:08.648 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.649 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1402745199}) 2026-02-12T18:17:08.649 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2040626837}) 2026-02-12T18:17:08.649 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.649 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1402745199}) 2026-02-12T18:17:08.649 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1377559376}) 2026-02-12T18:17:08.649 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.649 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1402745199}) 2026-02-12T18:17:08.649 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2890479361}) 2026-02-12T18:17:08.649 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.649 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1402745199}) 2026-02-12T18:17:08.649 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2365006508}) 2026-02-12T18:17:08.649 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.649 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1394926245}) 2026-02-12T18:17:08.649 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3437625214}) 2026-02-12T18:17:08.649 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.649 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1394926245}) 2026-02-12T18:17:08.649 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2553842076}) 2026-02-12T18:17:08.649 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.649 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1394926245}) 2026-02-12T18:17:08.649 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2298114480}) 2026-02-12T18:17:08.649 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.649 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1394926245}) 2026-02-12T18:17:08.649 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=872709238}) 2026-02-12T18:17:08.649 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.649 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1394926245}) 2026-02-12T18:17:08.650 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3083108545}) 2026-02-12T18:17:08.650 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.650 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1394926245}) 2026-02-12T18:17:08.650 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4281981955}) 2026-02-12T18:17:08.650 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.650 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1394926245}) 2026-02-12T18:17:08.650 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1463853041}) 2026-02-12T18:17:08.650 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.650 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1394926245}) 2026-02-12T18:17:08.650 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.605+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3072950294}) 2026-02-12T18:17:08.650 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.606+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.650 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.606+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2617814819}) 2026-02-12T18:17:08.650 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.606+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2384016168}) 2026-02-12T18:17:08.650 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.606+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.650 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.606+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2617814819}) 2026-02-12T18:17:08.650 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.606+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=644343073}) 2026-02-12T18:17:08.650 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.606+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.650 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.606+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2617814819}) 2026-02-12T18:17:08.650 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.606+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2710200035}) 2026-02-12T18:17:08.650 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.606+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.650 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.606+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2617814819}) 2026-02-12T18:17:08.650 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.606+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=458364988}) 2026-02-12T18:17:08.650 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.606+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.650 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.606+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2617814819}) 2026-02-12T18:17:08.650 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.606+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=518410167}) 2026-02-12T18:17:08.651 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.606+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.651 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.606+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2617814819}) 2026-02-12T18:17:08.651 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.606+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=327982923}) 2026-02-12T18:17:08.651 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.606+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.651 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.606+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2617814819}) 2026-02-12T18:17:08.651 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.606+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1458589494}) 2026-02-12T18:17:08.651 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.606+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.651 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.606+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2617814819}) 2026-02-12T18:17:08.651 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.606+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4269289488}) 2026-02-12T18:17:08.651 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.607+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.651 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.607+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=432074983}) 2026-02-12T18:17:08.651 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.607+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3104226541}) 2026-02-12T18:17:08.651 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.607+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.651 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.607+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=432074983}) 2026-02-12T18:17:08.651 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.607+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1818278563}) 2026-02-12T18:17:08.651 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.607+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.651 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.607+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=432074983}) 2026-02-12T18:17:08.651 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.607+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3312304828}) 2026-02-12T18:17:08.651 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.607+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.651 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.607+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=432074983}) 2026-02-12T18:17:08.651 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.607+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4206702220}) 2026-02-12T18:17:08.651 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.607+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.651 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.607+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=432074983}) 2026-02-12T18:17:08.651 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.607+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1361513480}) 2026-02-12T18:17:08.651 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.607+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.652 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.607+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=432074983}) 2026-02-12T18:17:08.652 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.607+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4194159878}) 2026-02-12T18:17:08.652 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.607+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.652 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.607+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=432074983}) 2026-02-12T18:17:08.652 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.607+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3718860076}) 2026-02-12T18:17:08.652 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.607+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.652 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.607+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=432074983}) 2026-02-12T18:17:08.652 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.607+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3581237322}) 2026-02-12T18:17:08.652 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.608+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.652 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.608+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1359943138}) 2026-02-12T18:17:08.652 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.608+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=210266762}) 2026-02-12T18:17:08.652 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.608+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.652 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.608+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1359943138}) 2026-02-12T18:17:08.652 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.608+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2262497238}) 2026-02-12T18:17:08.652 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.608+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.652 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.608+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1359943138}) 2026-02-12T18:17:08.652 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.608+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=686385031}) 2026-02-12T18:17:08.652 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.608+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.652 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.608+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1359943138}) 2026-02-12T18:17:08.652 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.608+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3717478144}) 2026-02-12T18:17:08.652 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.608+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.652 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.608+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1359943138}) 2026-02-12T18:17:08.652 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.608+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=813686894}) 2026-02-12T18:17:08.652 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.608+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.652 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.608+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1359943138}) 2026-02-12T18:17:08.653 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.608+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=331391172}) 2026-02-12T18:17:08.653 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.608+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.653 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.608+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1359943138}) 2026-02-12T18:17:08.653 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.608+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4264129619}) 2026-02-12T18:17:08.653 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.608+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.653 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.608+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1359943138}) 2026-02-12T18:17:08.653 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.608+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1558027320}) 2026-02-12T18:17:08.653 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.609+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.653 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.609+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=31,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=19} crc {logm=2336484690,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=242818680,mon_config_key=752066894,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=3828957389,osd_snap=841190635,osdmap=2107329739}) 2026-02-12T18:17:08.653 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.609+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=30,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=1,osdmap=20} crc {logm=1150538899,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=242818679,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=3828957388,osd_snap=3823785925,osdmap=3573259741}) 2026-02-12T18:17:08.653 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.609+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.653 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.609+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=31,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=19} crc {logm=2336484690,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=242818680,mon_config_key=752066894,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=3828957389,osd_snap=841190635,osdmap=2107329739}) 2026-02-12T18:17:08.653 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.609+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=31,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=19} crc {logm=2343883098,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=242818679,mon_config_key=1580463513,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=3828957388,osd_snap=841190635,osdmap=1135261310}) 2026-02-12T18:17:08.653 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.609+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.653 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.609+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=31,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=19} crc {logm=2336484690,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=242818680,mon_config_key=752066894,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=3828957389,osd_snap=841190635,osdmap=2107329739}) 2026-02-12T18:17:08.653 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.609+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=32,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=18} crc {logm=1754251489,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=242818679,mon_config_key=48446373,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=3828957388,osd_snap=841190635,osdmap=4201281450}) 2026-02-12T18:17:08.653 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.609+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.653 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.609+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=31,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=19} crc {logm=2336484690,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=242818680,mon_config_key=752066894,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=3828957389,osd_snap=841190635,osdmap=2107329739}) 2026-02-12T18:17:08.653 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.609+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=30,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=19} crc {logm=2008971133,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774889,mgrstat=242818679,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=3828957388,osd_snap=841190635,osdmap=1158914504}) 2026-02-12T18:17:08.653 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.609+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.653 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.609+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=31,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=19} crc {logm=2336484690,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=242818680,mon_config_key=752066894,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=3828957389,osd_snap=841190635,osdmap=2107329739}) 2026-02-12T18:17:08.653 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.609+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=32,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=9,monmap=2,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=24} crc {logm=826361221,mdsmap=3140514009,mgr=1921871096,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=2700796490,mon_config_key=1874198738,monmap=3865314839,nvmeofgw=3140514009,osd_metadata=1232835945,osd_pg_creating=3828957388,osd_snap=841190635,osdmap=2628812316}) 2026-02-12T18:17:08.653 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.609+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.653 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.609+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=31,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=19} crc {logm=2336484690,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=242818680,mon_config_key=752066894,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=3828957389,osd_snap=841190635,osdmap=2107329739}) 2026-02-12T18:17:08.654 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.609+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=31,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=18} crc {logm=2723669975,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=242818679,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=3828957388,osd_snap=841190635,osdmap=1592354418}) 2026-02-12T18:17:08.654 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.609+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.654 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.609+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=31,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=19} crc {logm=2336484690,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=242818680,mon_config_key=752066894,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=3828957389,osd_snap=841190635,osdmap=2107329739}) 2026-02-12T18:17:08.654 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.609+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=30,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=10,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=19} crc {logm=291618707,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=242818679,mon_config_key=2610204668,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=3828957388,osd_snap=841190635,osdmap=3284373509}) 2026-02-12T18:17:08.654 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.609+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.654 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.609+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=31,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=9,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=19} crc {logm=2336484690,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=242818680,mon_config_key=752066894,monmap=2848783498,nvmeofgw=3360707892,osd_metadata=1232835945,osd_pg_creating=3828957389,osd_snap=841190635,osdmap=2107329739}) 2026-02-12T18:17:08.654 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.609+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=31,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=9,monmap=3,nvmeofgw=2,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=22} crc {logm=393207867,mdsmap=3465989318,mgr=1527302086,mgr_command_descs=714296370,mgr_metadata=3281774888,mgrstat=2050502703,mon_config_key=48446373,monmap=2848783498,nvmeofgw=935146538,osd_metadata=2227164093,osd_pg_creating=3828957388,osd_snap=841190635,osdmap=2021853836}) 2026-02-12T18:17:08.654 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.610+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.654 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.610+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3843267679}) 2026-02-12T18:17:08.654 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.610+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=241617354}) 2026-02-12T18:17:08.654 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.610+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.654 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.610+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3843267679}) 2026-02-12T18:17:08.654 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.610+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=165417275}) 2026-02-12T18:17:08.654 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.610+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.654 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.610+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3843267679}) 2026-02-12T18:17:08.654 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.610+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2364369329}) 2026-02-12T18:17:08.654 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.610+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.654 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.610+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3843267679}) 2026-02-12T18:17:08.654 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.610+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=3024131878}) 2026-02-12T18:17:08.654 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.611+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.654 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.611+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3843267679}) 2026-02-12T18:17:08.654 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.611+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=2865785789}) 2026-02-12T18:17:08.654 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.611+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.654 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.611+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3843267679}) 2026-02-12T18:17:08.654 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.611+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=4259086609}) 2026-02-12T18:17:08.655 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.611+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.655 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.611+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3843267679}) 2026-02-12T18:17:08.655 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.611+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=3489332612}) 2026-02-12T18:17:08.655 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.611+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:08.655 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.611+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3843267679}) 2026-02-12T18:17:08.655 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:08.611+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=3427678713}) 2026-02-12T18:17:08.714 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2026-02-12T18:17:08.715 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2026-02-12T18:17:08.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.781+0000 7f06f1836640 10 monclient: get_monmap_and_config 2026-02-12T18:17:08.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.781+0000 7f06f1836640 10 monclient: build_initial_monmap 2026-02-12T18:17:08.783 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.781+0000 7f06f1836640 10 monclient: monmap: 2026-02-12T18:17:08.783 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:08.783 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:08.783 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:08.782783+0000 2026-02-12T18:17:08.783 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:08.782783+0000 2026-02-12T18:17:08.783 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:08.783 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:08.783 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:08.783 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:08.783 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:08.783 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:08.783 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:08.783 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:08.783 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:08.783 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:08.783 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:08.783 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:08.783 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:08.783 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:08.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06f1836640 1 Processor -- start 2026-02-12T18:17:08.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06f1836640 1 -- start start 2026-02-12T18:17:08.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06f1836640 10 monclient: init 2026-02-12T18:17:08.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06f1836640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:08.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06f1836640 10 monclient: _add_conns ranks=[0,9,1,2,10,7,3,6,4,5,8] 2026-02-12T18:17:08.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06f1836640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7f06ec05dc20 addr v1:10.20.193.48:6789/0 2026-02-12T18:17:08.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06f1836640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f06ec144660 0x7f06ec185500 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:08.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06f1836640 10 monclient(hunting): picked mon.noname-a con 0x7f06ec144660 addr v2:10.20.193.48:3300/0 2026-02-12T18:17:08.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06f1836640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7f06ec185a40 addr v1:10.20.193.111:6789/0 2026-02-12T18:17:08.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06f1836640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06ec060390 con 0x7f06ec05dc20 2026-02-12T18:17:08.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06f1836640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06ec092200 con 0x7f06ec185a40 2026-02-12T18:17:08.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06f1836640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:08.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06f1836640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f06ec08b250 con 0x7f06ec144660 2026-02-12T18:17:08.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06f1836640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:08.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06f1836640 10 monclient(hunting): authenticate will time out at 1267.508492s 2026-02-12T18:17:08.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06eaffd640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7f06ec05dc20 0x7f06ec05dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:44044/0 (socket says 10.20.193.48:44044) 2026-02-12T18:17:08.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06eaffd640 1 -- 10.20.193.48:0/3774386427 learned_addr learned my addr 10.20.193.48:0/3774386427 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:17:08.784 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06ea7fc640 1 --2- 10.20.193.48:0/3774386427 >> v2:10.20.193.48:3300/0 conn(0x7f06ec144660 0x7f06ec185500 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:08.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06ea7fc640 10 monclient(hunting): get_auth_request con 0x7f06ec144660 auth_method 0 2026-02-12T18:17:08.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06ea7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:08.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:08.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:08.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06ea7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:08.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06ea7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:08.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06ea7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:08.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06ea7fc640 10 monclient(hunting): handle_auth_done global_id 7092 payload 274 2026-02-12T18:17:08.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06ea7fc640 1 -- 10.20.193.48:0/3774386427 >> v1:10.20.193.111:6789/0 conn(0x7f06ec185a40 legacy=0x7f06ec1a5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:08.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06ea7fc640 1 -- 10.20.193.48:0/3774386427 >> v1:10.20.193.48:6789/0 conn(0x7f06ec05dc20 legacy=0x7f06ec05dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:08.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06ea7fc640 10 monclient: _finish_hunting 0 2026-02-12T18:17:08.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06ea7fc640 1 monclient: found mon.noname-a 2026-02-12T18:17:08.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06ea7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:08.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06ea7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:17:08.785 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.782+0000 7f06ea7fc640 1 -- 10.20.193.48:0/3774386427 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06ec144a50 con 0x7f06ec144660 2026-02-12T18:17:08.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06ea7fc640 1 -- 10.20.193.48:0/3774386427 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f06ec144660 msgr2=0x7f06ec185500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:08.786 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06ea7fc640 1 --2- 10.20.193.48:0/3774386427 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f06ec144660 0x7f06ec185500 secure :-1 s=READY pgs=729 gs=3 cs=0 l=1 c_cookie=15313204459399923576 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06d4004740 tx=0x7f06d402edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4836e52af75c778 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06e9ffb640 1 -- 10.20.193.48:0/3774386427 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f06d4035340 con 0x7f06ec144660 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06e9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06e9ffb640 10 monclient: dump: 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06e9ffb640 10 monclient: _finish_auth 0 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06e9ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06e9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06e9ffb640 1 -- 10.20.193.48:0/3774386427 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d40354c0 con 0x7f06ec144660 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06e9ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06e9ffb640 1 -- 10.20.193.48:0/3774386427 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f06d4035af0 con 0x7f06ec144660 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06f1836640 5 monclient: authenticate success, global_id 7092 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06e9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06e9ffb640 10 monclient: dump: 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:08.787 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:08.788 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:08.788 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:08.788 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:08.788 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:08.788 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:08.788 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:08.788 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:08.788 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:08.788 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:08.788 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:08.788 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:08.788 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:08.788 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:08.788 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:08.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06f1836640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:08.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06f1836640 4 set_mon_vals no callback set 2026-02-12T18:17:08.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06f1836640 10 monclient: shutdown 2026-02-12T18:17:08.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06f1836640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:08.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06f1836640 1 -- 10.20.193.48:0/3774386427 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f06ec144660 msgr2=0x7f06ec185500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:08.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06f1836640 1 --2- 10.20.193.48:0/3774386427 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f06ec144660 0x7f06ec185500 secure :-1 s=READY pgs=729 gs=3 cs=0 l=1 c_cookie=15313204459399923576 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06d4004740 tx=0x7f06d402edb0 comp rx=0 tx=0).stop 2026-02-12T18:17:08.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06f1836640 1 -- 10.20.193.48:0/3774386427 shutdown_connections 2026-02-12T18:17:08.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06f1836640 1 --2- 10.20.193.48:0/3774386427 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f06ec144660 0x7f06ec185500 unknown :-1 s=CLOSED pgs=729 gs=3 cs=0 l=1 c_cookie=15313204459399923576 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:08.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06f1836640 1 -- 10.20.193.48:0/3774386427 >> 10.20.193.48:0/3774386427 conn(0x7f06ec0546d0 msgr2=0x7f06ec054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:08.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06f1836640 1 -- 10.20.193.48:0/3774386427 shutdown_connections 2026-02-12T18:17:08.788 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.785+0000 7f06f1836640 1 -- 10.20.193.48:0/3774386427 wait complete. 2026-02-12T18:17:08.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06f1836640 10 monclient: build_initial_monmap 2026-02-12T18:17:08.789 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06f1836640 10 monclient: monmap: 2026-02-12T18:17:08.789 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:08.789 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:08.789 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:08.789 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:08.789 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:08.789 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:08.789 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:08.789 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:08.789 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06f1836640 1 Processor -- start 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06f1836640 1 -- start start 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06f1836640 10 monclient: init 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06f1836640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06f1836640 10 monclient: _add_conns ranks=[7,0,5,4,8,1,2,3,6] 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06f1836640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f06ec05dc20 0x7f06ec185240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06f1836640 10 monclient(hunting): picked mon.noname-i con 0x7f06ec05dc20 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06f1836640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f06ec144660 0x7f06ec1315d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06f1836640 10 monclient(hunting): picked mon.noname-a con 0x7f06ec144660 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06f1836640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f06ec185a40 0x7f06ec131b10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06f1836640 10 monclient(hunting): picked mon.noname-h con 0x7f06ec185a40 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06f1836640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06f1836640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f06ec08ab80 con 0x7f06ec144660 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06f1836640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06f1836640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f06ec111e90 con 0x7f06ec185a40 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06f1836640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06f1836640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f06ec112730 con 0x7f06ec05dc20 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06f1836640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06f1836640 10 monclient(hunting): authenticate will time out at 1267.512776s 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06ea7fc640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f06ec144660 0x7f06ec1315d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06ea7fc640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f06ec144660 0x7f06ec1315d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:54966/0 (socket says 10.20.193.48:54966) 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06ea7fc640 1 -- 10.20.193.48:0/3237780772 learned_addr learned my addr 10.20.193.48:0/3237780772 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06ea7fc640 10 monclient(hunting): get_auth_request con 0x7f06ec144660 auth_method 0 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06ea7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06ea7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06ea7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06eaffd640 1 --2- 10.20.193.48:0/3237780772 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f06ec05dc20 0x7f06ec185240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06ea7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06ea7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06ea7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:08.790 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06eb7fe640 1 --2- 10.20.193.48:0/3237780772 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f06ec185a40 0x7f06ec131b10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:08.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06eb7fe640 10 monclient(hunting): get_auth_request con 0x7f06ec185a40 auth_method 0 2026-02-12T18:17:08.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06eb7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:08.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06eb7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:08.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.786+0000 7f06eb7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:08.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.787+0000 7f06eaffd640 10 monclient(hunting): get_auth_request con 0x7f06ec05dc20 auth_method 0 2026-02-12T18:17:08.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.787+0000 7f06eaffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:08.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.787+0000 7f06eaffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:08.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.787+0000 7f06eaffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:08.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.787+0000 7f06eb7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:08.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.787+0000 7f06eb7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:08.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.787+0000 7f06eb7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:08.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.787+0000 7f06eaffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:08.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.787+0000 7f06eaffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:08.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.787+0000 7f06eaffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:08.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.787+0000 7f06ea7fc640 10 monclient(hunting): handle_auth_done global_id 7101 payload 824 2026-02-12T18:17:08.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.787+0000 7f06ea7fc640 1 -- 10.20.193.48:0/3237780772 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f06ec05dc20 msgr2=0x7f06ec185240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:08.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.787+0000 7f06ea7fc640 1 --2- 10.20.193.48:0/3237780772 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f06ec05dc20 0x7f06ec185240 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:08.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.787+0000 7f06ea7fc640 1 -- 10.20.193.48:0/3237780772 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f06ec185a40 msgr2=0x7f06ec131b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:08.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.787+0000 7f06ea7fc640 1 --2- 10.20.193.48:0/3237780772 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f06ec185a40 0x7f06ec131b10 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:08.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.787+0000 7f06ea7fc640 10 monclient: _finish_hunting 0 2026-02-12T18:17:08.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.787+0000 7f06ea7fc640 1 monclient: found mon.noname-a 2026-02-12T18:17:08.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.787+0000 7f06ea7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:08.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.787+0000 7f06ea7fc640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:17:08.791 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.787+0000 7f06ea7fc640 1 -- 10.20.193.48:0/3237780772 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d4009420 con 0x7f06ec144660 2026-02-12T18:17:08.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.789+0000 7f06ea7fc640 1 -- 10.20.193.48:0/3237780772 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f06ec144660 msgr2=0x7f06ec1315d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:08.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.789+0000 7f06ea7fc640 1 --2- 10.20.193.48:0/3237780772 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f06ec144660 0x7f06ec1315d0 secure :-1 s=READY pgs=730 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06d402f2c0 tx=0x7f06d4004770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:08.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.789+0000 7f06c3fff640 1 -- 10.20.193.48:0/3237780772 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f06d4004500 con 0x7f06ec144660 2026-02-12T18:17:08.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.789+0000 7f06c3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:08.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.789+0000 7f06c3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:17:08.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.789+0000 7f06c3fff640 10 monclient: dump: 2026-02-12T18:17:08.792 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:08.792 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:08.792 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:08.792 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:08.792 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:08.792 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:08.792 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:08.792 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:08.792 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:08.792 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:08.792 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:08.792 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:08.792 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:08.792 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:08.792 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:08.792 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:08.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.789+0000 7f06c3fff640 10 monclient: _finish_auth 0 2026-02-12T18:17:08.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.789+0000 7f06c3fff640 10 monclient: _check_auth_tickets 2026-02-12T18:17:08.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.789+0000 7f06c3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:08.792 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.789+0000 7f06c3fff640 1 -- 10.20.193.48:0/3237780772 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06d40036d0 con 0x7f06ec144660 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.789+0000 7f06c3fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.789+0000 7f06c3fff640 1 -- 10.20.193.48:0/3237780772 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f06d4003d00 con 0x7f06ec144660 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.789+0000 7f06c3fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.789+0000 7f06e97fa640 4 set_mon_vals no callback set 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.789+0000 7f06c3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.789+0000 7f06c3fff640 10 monclient: dump: 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.789+0000 7f06f1836640 5 monclient: authenticate success, global_id 7101 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.789+0000 7f06f1836640 10 monclient: _renew_subs 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.789+0000 7f06f1836640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.789+0000 7f06f1836640 1 -- 10.20.193.48:0/3237780772 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06ec1103d0 con 0x7f06ec144660 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.789+0000 7f06f1836640 10 monclient: _renew_subs 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.789+0000 7f06f1836640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.789+0000 7f06f1836640 1 -- 10.20.193.48:0/3237780772 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06ec125670 con 0x7f06ec144660 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.790+0000 7f06f1836640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.790+0000 7f06f1836640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.790+0000 7f06f1836640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.790+0000 7f06f1836640 1 -- 10.20.193.48:0/3237780772 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06ec112000 con 0x7f06ec144660 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.790+0000 7f06c3fff640 1 -- 10.20.193.48:0/3237780772 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f06d404f020 con 0x7f06ec144660 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.790+0000 7f06c3fff640 1 --2- 10.20.193.48:0/3237780772 >> v2:10.20.193.111:6812/977811348 conn(0x7f06bc03f800 0x7f06bc05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.790+0000 7f06c3fff640 1 -- 10.20.193.48:0/3237780772 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7f06d4077ac0 con 0x7f06ec144660 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.790+0000 7f06eaffd640 1 --2- 10.20.193.48:0/3237780772 >> v2:10.20.193.111:6812/977811348 conn(0x7f06bc03f800 0x7f06bc05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:08.793 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.790+0000 7f06eaffd640 10 monclient: get_auth_request con 0x7f06bc03f800 auth_method 0 2026-02-12T18:17:08.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.792+0000 7f06c3fff640 1 -- 10.20.193.48:0/3237780772 <== mon.0 v2:10.20.193.48:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f06d4037440 con 0x7f06ec144660 2026-02-12T18:17:08.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.792+0000 7f06c3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:08.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.792+0000 7f06c3fff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:17:08.794 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.793+0000 7f06eaffd640 1 --2- 10.20.193.48:0/3237780772 >> v2:10.20.193.111:6812/977811348 conn(0x7f06bc03f800 0x7f06bc05fcb0 secure :-1 s=READY pgs=482 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06e00048a0 tx=0x7f06e0007f90 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:08.946 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.944+0000 7f06f1836640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2026-02-12T18:17:08.947 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.944+0000 7f06f1836640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2026-02-12T18:17:08.947 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.944+0000 7f06f1836640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:08.947 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.944+0000 7f06f1836640 1 -- 10.20.193.48:0/3237780772 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f06ec112000 con 0x7f06ec144660 2026-02-12T18:17:08.947 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.945+0000 7f06c3fff640 1 -- 10.20.193.48:0/3237780772 <== mon.0 v2:10.20.193.48:3300/0 7 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+3660 (secure 0 0 0) 0x7f06d403c080 con 0x7f06ec144660 2026-02-12T18:17:08.947 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.945+0000 7f06c3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2026-02-12T18:17:08.947 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.945+0000 7f06c3fff640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:17:08.948 INFO:teuthology.orchestra.run.trial048.stdout:{"election_epoch":92,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4544132024016699391","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"]},"monmap":{"epoch":1,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","modified":"2026-02-12T18:05:32.850777Z","created":"2026-02-12T18:05:32.850777Z","min_mon_release":20,"min_mon_release_name":"tentacle","election_strategy":1,"disallowed_leaders":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid","tentacle","nvmeof_beacon_diff"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3300","nonce":0},{"type":"v1","addr":"10.20.193.48:6789","nonce":0}]},"addr":"10.20.193.48:6789/0","public_addr":"10.20.193.48:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850827+0000","crush_location":[]},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3300","nonce":0},{"type":"v1","addr":"10.20.193.111:6789","nonce":0}]},"addr":"10.20.193.111:6789/0","public_addr":"10.20.193.111:6789/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850829+0000","crush_location":[]},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3301","nonce":0},{"type":"v1","addr":"10.20.193.48:6790","nonce":0}]},"addr":"10.20.193.48:6790/0","public_addr":"10.20.193.48:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850830+0000","crush_location":[]},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3301","nonce":0},{"type":"v1","addr":"10.20.193.111:6790","nonce":0}]},"addr":"10.20.193.111:6790/0","public_addr":"10.20.193.111:6790/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850833+0000","crush_location":[]},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3302","nonce":0},{"type":"v1","addr":"10.20.193.48:6791","nonce":0}]},"addr":"10.20.193.48:6791/0","public_addr":"10.20.193.48:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3302","nonce":0},{"type":"v1","addr":"10.20.193.111:6791","nonce":0}]},"addr":"10.20.193.111:6791/0","public_addr":"10.20.193.111:6791/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850834+0000","crush_location":[]},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3303","nonce":0},{"type":"v1","addr":"10.20.193.48:6792","nonce":0}]},"addr":"10.20.193.48:6792/0","public_addr":"10.20.193.48:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850831+0000","crush_location":[]},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:3303","nonce":0},{"type":"v1","addr":"10.20.193.111:6792","nonce":0}]},"addr":"10.20.193.111:6792/0","public_addr":"10.20.193.111:6792/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850835+0000","crush_location":[]},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:3304","nonce":0},{"type":"v1","addr":"10.20.193.48:6793","nonce":0}]},"addr":"10.20.193.48:6793/0","public_addr":"10.20.193.48:6793/0","priority":0,"weight":0,"time_added":"2026-02-12T18:05:32:850832+0000","crush_location":[]}]}} 2026-02-12T18:17:08.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.946+0000 7f06f1836640 1 -- 10.20.193.48:0/3237780772 >> v2:10.20.193.111:6812/977811348 conn(0x7f06bc03f800 msgr2=0x7f06bc05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:08.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.946+0000 7f06f1836640 1 --2- 10.20.193.48:0/3237780772 >> v2:10.20.193.111:6812/977811348 conn(0x7f06bc03f800 0x7f06bc05fcb0 secure :-1 s=READY pgs=482 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06e00048a0 tx=0x7f06e0007f90 comp rx=0 tx=0).stop 2026-02-12T18:17:08.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.946+0000 7f06f1836640 10 monclient: shutdown 2026-02-12T18:17:08.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.946+0000 7f06f1836640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:08.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.946+0000 7f06f1836640 1 -- 10.20.193.48:0/3237780772 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f06ec144660 msgr2=0x7f06ec1315d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:08.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.946+0000 7f06f1836640 1 --2- 10.20.193.48:0/3237780772 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f06ec144660 0x7f06ec1315d0 secure :-1 s=READY pgs=730 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f06d402f2c0 tx=0x7f06d4004770 comp rx=0 tx=0).stop 2026-02-12T18:17:08.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.946+0000 7f06f1836640 1 -- 10.20.193.48:0/3237780772 shutdown_connections 2026-02-12T18:17:08.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.946+0000 7f06f1836640 1 --2- 10.20.193.48:0/3237780772 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f06ec185a40 0x7f06ec131b10 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:08.949 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.946+0000 7f06f1836640 1 --2- 10.20.193.48:0/3237780772 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f06ec144660 0x7f06ec1315d0 unknown :-1 s=CLOSED pgs=730 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:08.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.946+0000 7f06f1836640 1 --2- 10.20.193.48:0/3237780772 >> v2:10.20.193.111:6812/977811348 conn(0x7f06bc03f800 0x7f06bc05fcb0 unknown :-1 s=CLOSED pgs=482 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:08.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.946+0000 7f06f1836640 1 --2- 10.20.193.48:0/3237780772 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f06ec05dc20 0x7f06ec185240 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:08.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.946+0000 7f06f1836640 1 -- 10.20.193.48:0/3237780772 >> 10.20.193.48:0/3237780772 conn(0x7f06ec0546d0 msgr2=0x7f06ec05cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:08.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.946+0000 7f06f1836640 1 -- 10.20.193.48:0/3237780772 shutdown_connections 2026-02-12T18:17:08.950 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:08.946+0000 7f06f1836640 1 -- 10.20.193.48:0/3237780772 wait complete. 2026-02-12T18:17:08.956 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2026-02-12T18:17:08.956 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2026-02-12T18:17:08.968 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2026-02-12T18:17:08.968 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T18:17:09.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.033+0000 7fa834e1b640 10 monclient: get_monmap_and_config 2026-02-12T18:17:09.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.033+0000 7fa834e1b640 10 monclient: build_initial_monmap 2026-02-12T18:17:09.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.033+0000 7fa834e1b640 10 monclient: monmap: 2026-02-12T18:17:09.038 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:09.038 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:09.038 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:09.034497+0000 2026-02-12T18:17:09.038 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:09.034497+0000 2026-02-12T18:17:09.038 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:09.038 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:09.038 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:09.038 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:09.038 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:09.038 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:09.038 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:09.038 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:09.039 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:09.039 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:09.039 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:09.039 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:09.039 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:09.039 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:09.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.033+0000 7fa834e1b640 1 Processor -- start 2026-02-12T18:17:09.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.033+0000 7fa834e1b640 1 -- start start 2026-02-12T18:17:09.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.033+0000 7fa834e1b640 10 monclient: init 2026-02-12T18:17:09.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa834e1b640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:09.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa834e1b640 10 monclient: _add_conns ranks=[4,2,9,6,7,5,10,1,0,8,3] 2026-02-12T18:17:09.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa834e1b640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa83005dc20 0x7fa830144660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:09.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa834e1b640 10 monclient(hunting): picked mon.noname-c con 0x7fa83005dc20 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:17:09.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa834e1b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa83005dff0 0x7fa83005e3c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:09.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa834e1b640 10 monclient(hunting): picked mon.noname-b con 0x7fa83005dff0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:17:09.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa834e1b640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fa830089df0 0x7fa83008a240 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:09.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa834e1b640 10 monclient(hunting): picked mon.noname-a con 0x7fa830089df0 addr v2:10.20.193.48:3300/0 2026-02-12T18:17:09.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa834e1b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:09.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa834e1b640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7fa83008b0d0 con 0x7fa830089df0 2026-02-12T18:17:09.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa834e1b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:09.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa834e1b640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fa830093a30 con 0x7fa83005dff0 2026-02-12T18:17:09.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa834e1b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:09.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa834e1b640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fa830092200 con 0x7fa83005dc20 2026-02-12T18:17:09.041 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa834e1b640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:09.041 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa834e1b640 10 monclient(hunting): authenticate will time out at 1267.760160s 2026-02-12T18:17:09.041 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82dd74640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa83005dff0 0x7fa83005e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:09.041 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82ed76640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fa830089df0 0x7fa83008a240 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:09.041 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82e575640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa83005dc20 0x7fa830144660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:09.041 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82dd74640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa83005dff0 0x7fa83005e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:44174/0 (socket says 10.20.193.48:44174) 2026-02-12T18:17:09.041 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82ed76640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fa830089df0 0x7fa83008a240 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:54980/0 (socket says 10.20.193.48:54980) 2026-02-12T18:17:09.041 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82ed76640 1 -- 10.20.193.48:0/3258254411 learned_addr learned my addr 10.20.193.48:0/3258254411 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:09.041 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82dd74640 10 monclient(hunting): get_auth_request con 0x7fa83005dff0 auth_method 0 2026-02-12T18:17:09.041 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:09.041 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82dd74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:09.041 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:09.041 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82ed76640 10 monclient(hunting): get_auth_request con 0x7fa830089df0 auth_method 0 2026-02-12T18:17:09.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:09.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82ed76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:09.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:09.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82e575640 10 monclient(hunting): get_auth_request con 0x7fa83005dc20 auth_method 0 2026-02-12T18:17:09.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:09.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82e575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:09.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:09.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:09.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:09.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:09.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82dd74640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:09.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82dd74640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:09.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82dd74640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:09.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:09.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:09.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:09.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82ed76640 10 monclient(hunting): handle_auth_done global_id 7110 payload 274 2026-02-12T18:17:09.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82ed76640 1 -- 10.20.193.48:0/3258254411 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa83005dc20 msgr2=0x7fa830144660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:09.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82ed76640 1 --2- 10.20.193.48:0/3258254411 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa83005dc20 0x7fa830144660 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:09.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82ed76640 1 -- 10.20.193.48:0/3258254411 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa83005dff0 msgr2=0x7fa83005e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:09.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82ed76640 1 --2- 10.20.193.48:0/3258254411 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa83005dff0 0x7fa83005e3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:09.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82ed76640 10 monclient: _finish_hunting 0 2026-02-12T18:17:09.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82ed76640 1 monclient: found mon.noname-a 2026-02-12T18:17:09.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82ed76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:09.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82ed76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:17:09.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.034+0000 7fa82ed76640 1 -- 10.20.193.48:0/3258254411 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa830060390 con 0x7fa830089df0 2026-02-12T18:17:09.050 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa82ed76640 1 -- 10.20.193.48:0/3258254411 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa830089df0 msgr2=0x7fa83008a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:09.050 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa82ed76640 1 --2- 10.20.193.48:0/3258254411 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa830089df0 0x7fa83008a240 secure :-1 s=READY pgs=731 gs=3 cs=0 l=1 c_cookie=8847477448809586872 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa82000a140 tx=0x7fa82002ff60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ac88ddd1e9320b8 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:09.050 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa82d573640 1 -- 10.20.193.48:0/3258254411 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa820030be0 con 0x7fa830089df0 2026-02-12T18:17:09.050 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa82d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:09.050 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa82d573640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:17:09.051 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa82d573640 10 monclient: dump: 2026-02-12T18:17:09.051 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:09.051 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:09.051 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:09.051 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:09.051 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:09.051 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:09.051 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:09.051 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:09.051 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:09.051 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:09.051 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:09.052 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:09.052 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:09.052 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:09.052 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:09.052 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:09.052 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa82d573640 10 monclient: _finish_auth 0 2026-02-12T18:17:09.052 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa82d573640 10 monclient: _check_auth_tickets 2026-02-12T18:17:09.052 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa82d573640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:09.052 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa82d573640 1 -- 10.20.193.48:0/3258254411 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa820030d60 con 0x7fa830089df0 2026-02-12T18:17:09.052 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa834e1b640 5 monclient: authenticate success, global_id 7110 2026-02-12T18:17:09.052 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa834e1b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:17:09.052 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa82d573640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:09.053 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa82d573640 1 -- 10.20.193.48:0/3258254411 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa820036cc0 con 0x7fa830089df0 2026-02-12T18:17:09.053 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa834e1b640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:09.053 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa834e1b640 4 set_mon_vals no callback set 2026-02-12T18:17:09.053 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa82d573640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:09.053 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa82d573640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:17:09.053 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa82d573640 10 monclient: dump: 2026-02-12T18:17:09.053 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:09.053 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:09.053 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:09.053 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:09.053 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:09.053 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:09.053 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:09.054 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:09.054 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:09.054 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:09.054 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:09.054 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:09.054 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:09.054 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:09.054 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:09.054 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:09.054 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa834e1b640 10 monclient: shutdown 2026-02-12T18:17:09.054 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa834e1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:09.054 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa834e1b640 1 -- 10.20.193.48:0/3258254411 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa830089df0 msgr2=0x7fa83008a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:09.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa834e1b640 1 --2- 10.20.193.48:0/3258254411 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa830089df0 0x7fa83008a240 secure :-1 s=READY pgs=731 gs=3 cs=0 l=1 c_cookie=8847477448809586872 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa82000a140 tx=0x7fa82002ff60 comp rx=0 tx=0).stop 2026-02-12T18:17:09.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa834e1b640 1 -- 10.20.193.48:0/3258254411 shutdown_connections 2026-02-12T18:17:09.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa834e1b640 1 --2- 10.20.193.48:0/3258254411 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa83005dff0 0x7fa83005e3c0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:09.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa834e1b640 1 --2- 10.20.193.48:0/3258254411 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa830089df0 0x7fa83008a240 unknown :-1 s=CLOSED pgs=731 gs=3 cs=0 l=1 c_cookie=8847477448809586872 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:09.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa834e1b640 1 --2- 10.20.193.48:0/3258254411 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa83005dc20 0x7fa830144660 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:09.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa834e1b640 1 -- 10.20.193.48:0/3258254411 >> 10.20.193.48:0/3258254411 conn(0x7fa8300546d0 msgr2=0x7fa830054ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:09.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa834e1b640 1 -- 10.20.193.48:0/3258254411 shutdown_connections 2026-02-12T18:17:09.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.037+0000 7fa834e1b640 1 -- 10.20.193.48:0/3258254411 wait complete. 2026-02-12T18:17:09.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa834e1b640 10 monclient: build_initial_monmap 2026-02-12T18:17:09.055 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa834e1b640 10 monclient: monmap: 2026-02-12T18:17:09.055 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:09.055 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:09.056 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:09.056 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:09.056 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:09.056 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:09.056 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:09.056 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:09.056 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:09.056 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:09.056 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:09.056 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:09.056 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:09.056 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:09.056 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:09.057 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:09.057 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa834e1b640 1 Processor -- start 2026-02-12T18:17:09.057 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa834e1b640 1 -- start start 2026-02-12T18:17:09.057 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa834e1b640 10 monclient: init 2026-02-12T18:17:09.057 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa834e1b640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:09.057 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa834e1b640 10 monclient: _add_conns ranks=[8,5,6,0,1,2,3,7,4] 2026-02-12T18:17:09.057 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa834e1b640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa83005dc20 0x7fa83010db60 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:09.057 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa834e1b640 10 monclient(hunting): picked mon.noname-e con 0x7fa83005dc20 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:17:09.057 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa834e1b640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa83005dff0 0x7fa83010e0a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:09.057 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa834e1b640 10 monclient(hunting): picked mon.noname-h con 0x7fa83005dff0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:17:09.057 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa834e1b640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa830089df0 0x7fa83010e5e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:09.058 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa834e1b640 10 monclient(hunting): picked mon.noname-d con 0x7fa830089df0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:17:09.058 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa834e1b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:09.058 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa834e1b640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fa830142230 con 0x7fa83005dff0 2026-02-12T18:17:09.058 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa834e1b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:09.058 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa834e1b640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fa83010ff40 con 0x7fa830089df0 2026-02-12T18:17:09.058 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa834e1b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:09.058 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa834e1b640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fa830110220 con 0x7fa83005dc20 2026-02-12T18:17:09.058 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa834e1b640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:09.058 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa834e1b640 10 monclient(hunting): authenticate will time out at 1267.764576s 2026-02-12T18:17:09.058 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa82e575640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa83005dc20 0x7fa83010db60 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:09.058 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa82ed76640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa830089df0 0x7fa83010e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:09.058 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa82e575640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa83005dc20 0x7fa83010db60 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:33732/0 (socket says 10.20.193.48:33732) 2026-02-12T18:17:09.059 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa82ed76640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa830089df0 0x7fa83010e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:51794/0 (socket says 10.20.193.48:51794) 2026-02-12T18:17:09.059 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa82e575640 1 -- 10.20.193.48:0/4187119278 learned_addr learned my addr 10.20.193.48:0/4187119278 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:09.059 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa82e575640 10 monclient(hunting): get_auth_request con 0x7fa83005dc20 auth_method 0 2026-02-12T18:17:09.059 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa82e575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:09.059 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa82e575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:09.059 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa82e575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:09.059 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa82ed76640 10 monclient(hunting): get_auth_request con 0x7fa830089df0 auth_method 0 2026-02-12T18:17:09.059 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa82ed76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:09.059 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa82ed76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:09.059 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa82ed76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:09.059 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa82e575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:09.059 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa82e575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:09.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa82e575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:09.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa82ed76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:09.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa82ed76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:09.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa82ed76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:09.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa82dd74640 1 --2- 10.20.193.48:0/4187119278 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa83005dff0 0x7fa83010e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:09.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa82dd74640 10 monclient(hunting): get_auth_request con 0x7fa83005dff0 auth_method 0 2026-02-12T18:17:09.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa82dd74640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:09.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa82dd74640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:09.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.038+0000 7fa82dd74640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:09.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.039+0000 7fa82e575640 10 monclient(hunting): handle_auth_done global_id 95003 payload 824 2026-02-12T18:17:09.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.039+0000 7fa82e575640 1 -- 10.20.193.48:0/4187119278 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa830089df0 msgr2=0x7fa83010e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:09.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.039+0000 7fa82e575640 1 --2- 10.20.193.48:0/4187119278 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa830089df0 0x7fa83010e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:09.060 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.039+0000 7fa82e575640 1 -- 10.20.193.48:0/4187119278 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa83005dff0 msgr2=0x7fa83010e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:09.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.039+0000 7fa82e575640 1 --2- 10.20.193.48:0/4187119278 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa83005dff0 0x7fa83010e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:09.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.039+0000 7fa82e575640 10 monclient: _finish_hunting 0 2026-02-12T18:17:09.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.039+0000 7fa82e575640 1 monclient: found mon.noname-e 2026-02-12T18:17:09.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.039+0000 7fa82e575640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:09.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.039+0000 7fa82e575640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:17:09.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.039+0000 7fa82e575640 1 -- 10.20.193.48:0/4187119278 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82000a5d0 con 0x7fa83005dc20 2026-02-12T18:17:09.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.041+0000 7fa82e575640 1 -- 10.20.193.48:0/4187119278 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa83005dc20 msgr2=0x7fa83010db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:09.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.041+0000 7fa82e575640 1 --2- 10.20.193.48:0/4187119278 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa83005dc20 0x7fa83010db60 secure :-1 s=READY pgs=196 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8240093f0 tx=0x7fa82400ed50 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:09.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.041+0000 7fa816ffd640 1 -- 10.20.193.48:0/4187119278 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa82400cb50 con 0x7fa83005dc20 2026-02-12T18:17:09.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.041+0000 7fa816ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:09.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.041+0000 7fa816ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:17:09.061 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.041+0000 7fa816ffd640 10 monclient: dump: 2026-02-12T18:17:09.062 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:09.062 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:09.062 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:09.062 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:09.062 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:09.062 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:09.062 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:09.062 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:09.062 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:09.062 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:09.062 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:09.062 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:09.062 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:09.062 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:09.063 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:09.063 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:09.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.041+0000 7fa816ffd640 10 monclient: _finish_auth 0 2026-02-12T18:17:09.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.041+0000 7fa816ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:17:09.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.041+0000 7fa816ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:09.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.041+0000 7fa816ffd640 1 -- 10.20.193.48:0/4187119278 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa82400ccd0 con 0x7fa83005dc20 2026-02-12T18:17:09.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.041+0000 7fa834e1b640 5 monclient: authenticate success, global_id 95003 2026-02-12T18:17:09.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.041+0000 7fa834e1b640 10 monclient: _renew_subs 2026-02-12T18:17:09.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.041+0000 7fa834e1b640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:17:09.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.041+0000 7fa834e1b640 1 -- 10.20.193.48:0/4187119278 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8300915f0 con 0x7fa83005dc20 2026-02-12T18:17:09.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.041+0000 7fa816ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:09.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.041+0000 7fa816ffd640 1 -- 10.20.193.48:0/4187119278 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa82400ce40 con 0x7fa83005dc20 2026-02-12T18:17:09.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.041+0000 7fa816ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:09.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.041+0000 7fa82cd72640 4 set_mon_vals no callback set 2026-02-12T18:17:09.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.041+0000 7fa816ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:17:09.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.041+0000 7fa816ffd640 10 monclient: dump: 2026-02-12T18:17:09.064 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:09.064 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:09.064 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:09.064 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:09.064 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:09.064 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:09.064 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:09.064 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:09.064 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:09.064 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:09.064 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:09.065 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:09.065 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:09.065 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:09.065 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:09.065 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:09.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.041+0000 7fa834e1b640 10 monclient: _renew_subs 2026-02-12T18:17:09.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.041+0000 7fa834e1b640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:17:09.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.041+0000 7fa834e1b640 1 -- 10.20.193.48:0/4187119278 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fa830110500 con 0x7fa83005dc20 2026-02-12T18:17:09.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.042+0000 7fa82e575640 1 --2- 10.20.193.48:0/4187119278 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa83005dc20 0x7fa83010db60 secure :-1 s=READY pgs=196 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8240093f0 tx=0x7fa82400ed50 comp rx=0 tx=0).queue_received will delay after 1.77092e+09 on 0x7fa824011070 mgrmap(e 5) 2026-02-12T18:17:09.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.042+0000 7fa816ffd640 1 -- 10.20.193.48:0/4187119278 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fa824011070 con 0x7fa83005dc20 2026-02-12T18:17:09.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.042+0000 7fa834e1b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:09.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.042+0000 7fa834e1b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:09.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.042+0000 7fa834e1b640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:17:09.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.042+0000 7fa834e1b640 1 -- 10.20.193.48:0/4187119278 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa830092510 con 0x7fa83005dc20 2026-02-12T18:17:09.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.042+0000 7fa816ffd640 1 --2- 10.20.193.48:0/4187119278 >> v2:10.20.193.111:6812/977811348 conn(0x7fa7fc03f800 0x7fa7fc05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:09.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.042+0000 7fa82dd74640 1 --2- 10.20.193.48:0/4187119278 >> v2:10.20.193.111:6812/977811348 conn(0x7fa7fc03f800 0x7fa7fc05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:09.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.042+0000 7fa82dd74640 10 monclient: get_auth_request con 0x7fa7fc03f800 auth_method 0 2026-02-12T18:17:09.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.044+0000 7fa816ffd640 1 -- 10.20.193.48:0/4187119278 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7fa824052a60 con 0x7fa83005dc20 2026-02-12T18:17:09.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.045+0000 7fa82dd74640 1 --2- 10.20.193.48:0/4187119278 >> v2:10.20.193.111:6812/977811348 conn(0x7fa7fc03f800 0x7fa7fc05fcb0 secure :-1 s=READY pgs=483 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa830090ea0 tx=0x7fa818008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:09.068 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:09.056+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:09.068 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:09.056+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=41} crc {osdmap=2936474985}) 2026-02-12T18:17:09.068 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:09.056+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=41} crc {osdmap=1093866099}) 2026-02-12T18:17:09.068 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:09.056+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:09.068 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:09.056+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=41} crc {osdmap=2936474985}) 2026-02-12T18:17:09.068 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:09.056+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=42} crc {osdmap=1458326256}) 2026-02-12T18:17:09.068 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:09.056+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:09.068 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:09.056+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=41} crc {osdmap=2936474985}) 2026-02-12T18:17:09.069 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:09.056+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=43} crc {osdmap=4259100245}) 2026-02-12T18:17:09.069 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:09.056+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:09.069 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:09.056+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=41} crc {osdmap=2936474985}) 2026-02-12T18:17:09.069 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:09.056+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=42} crc {osdmap=3831992643}) 2026-02-12T18:17:09.069 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:09.056+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:09.069 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:09.056+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=41} crc {osdmap=2936474985}) 2026-02-12T18:17:09.069 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:09.056+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=43} crc {osdmap=1397352479}) 2026-02-12T18:17:09.069 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:09.056+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:09.069 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:09.056+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=41} crc {osdmap=2936474985}) 2026-02-12T18:17:09.069 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:09.056+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=41} crc {osdmap=4212547301}) 2026-02-12T18:17:09.069 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:09.056+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:09.069 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:09.056+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=41} crc {osdmap=2936474985}) 2026-02-12T18:17:09.070 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:09.056+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=40} crc {osdmap=3685349404}) 2026-02-12T18:17:09.070 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:09.056+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2026-02-12T18:17:09.070 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:09.056+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=41} crc {osdmap=2936474985}) 2026-02-12T18:17:09.070 INFO:tasks.ceph.mon.a.trial048.stderr:2026-02-12T18:17:09.056+0000 7fe19f7f1640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=41} crc {osdmap=1503323399}) 2026-02-12T18:17:09.871 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.870+0000 7fa816ffd640 1 -- 10.20.193.48:0/4187119278 <== mon.8 v2:10.20.193.48:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fa8240063c0 con 0x7fa83005dc20 2026-02-12T18:17:09.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.870+0000 7fa816ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:09.872 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.870+0000 7fa816ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:17:09.975 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.973+0000 7fa834e1b640 1 -- 10.20.193.48:0/4187119278 --> v2:10.20.193.111:6812/977811348 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa830094a90 con 0x7fa7fc03f800 2026-02-12T18:17:09.976 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.974+0000 7fa816ffd640 1 -- 10.20.193.48:0/4187119278 <== mgr.4123 v2:10.20.193.111:6812/977811348 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33979 (secure 0 0 0) 0x7fa818011980 con 0x7fa7fc03f800 2026-02-12T18:17:09.976 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:17:09.978 INFO:teuthology.orchestra.run.trial048.stderr:dumped all 2026-02-12T18:17:09.978 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.975+0000 7fa834e1b640 1 -- 10.20.193.48:0/4187119278 >> v2:10.20.193.111:6812/977811348 conn(0x7fa7fc03f800 msgr2=0x7fa7fc05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:09.978 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.975+0000 7fa834e1b640 1 --2- 10.20.193.48:0/4187119278 >> v2:10.20.193.111:6812/977811348 conn(0x7fa7fc03f800 0x7fa7fc05fcb0 secure :-1 s=READY pgs=483 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa830090ea0 tx=0x7fa818008040 comp rx=0 tx=0).stop 2026-02-12T18:17:09.978 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.975+0000 7fa834e1b640 10 monclient: shutdown 2026-02-12T18:17:09.978 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.975+0000 7fa834e1b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:09.978 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.975+0000 7fa834e1b640 1 -- 10.20.193.48:0/4187119278 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa83005dc20 msgr2=0x7fa83010db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:09.978 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.975+0000 7fa834e1b640 1 --2- 10.20.193.48:0/4187119278 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa83005dc20 0x7fa83010db60 secure :-1 s=READY pgs=196 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa8240093f0 tx=0x7fa82400ed50 comp rx=0 tx=0).stop 2026-02-12T18:17:09.978 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.975+0000 7fa834e1b640 1 -- 10.20.193.48:0/4187119278 shutdown_connections 2026-02-12T18:17:09.978 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.975+0000 7fa834e1b640 1 --2- 10.20.193.48:0/4187119278 >> v2:10.20.193.111:6812/977811348 conn(0x7fa7fc03f800 0x7fa7fc05fcb0 unknown :-1 s=CLOSED pgs=483 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:09.979 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.975+0000 7fa834e1b640 1 --2- 10.20.193.48:0/4187119278 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa830089df0 0x7fa83010e5e0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:09.979 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.975+0000 7fa834e1b640 1 --2- 10.20.193.48:0/4187119278 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa83005dff0 0x7fa83010e0a0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:09.979 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.975+0000 7fa834e1b640 1 --2- 10.20.193.48:0/4187119278 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fa83005dc20 0x7fa83010db60 unknown :-1 s=CLOSED pgs=196 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:09.979 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.975+0000 7fa834e1b640 1 -- 10.20.193.48:0/4187119278 >> 10.20.193.48:0/4187119278 conn(0x7fa8300546d0 msgr2=0x7fa830124600 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:09.979 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.975+0000 7fa834e1b640 1 -- 10.20.193.48:0/4187119278 shutdown_connections 2026-02-12T18:17:09.979 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:09.975+0000 7fa834e1b640 1 -- 10.20.193.48:0/4187119278 wait complete. 2026-02-12T18:17:09.984 INFO:teuthology.orchestra.run.trial048.stdout:{"pg_ready":true,"pg_map":{"version":651,"stamp":"2026-02-12T18:17:08.452188+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":170512,"kb_used_data":8752,"kb_used_omap":1305,"kb_used_meta":160358,"kb_avail":566060528,"statfs":{"total":579820584960,"available":579645980672,"internally_reserved":0,"allocated":8962048,"data_stored":4077262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1336948,"internal_metadata":164206988},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.000979"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":628,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480584+0000","last_change":"2026-02-12T18:06:11.383740+0000","last_active":"2026-02-12T18:15:20.480584+0000","last_peered":"2026-02-12T18:15:20.480584+0000","last_clean":"2026-02-12T18:15:20.480584+0000","last_became_active":"2026-02-12T18:06:09.281532+0000","last_became_peered":"2026-02-12T18:06:09.281532+0000","last_unstale":"2026-02-12T18:15:20.480584+0000","last_undegraded":"2026-02-12T18:15:20.480584+0000","last_fullsized":"2026-02-12T18:15:20.480584+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T20:34:57.876774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027561099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":627,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480512+0000","last_change":"2026-02-12T18:06:11.384892+0000","last_active":"2026-02-12T18:15:20.480512+0000","last_peered":"2026-02-12T18:15:20.480512+0000","last_clean":"2026-02-12T18:15:20.480512+0000","last_became_active":"2026-02-12T18:06:09.283689+0000","last_became_peered":"2026-02-12T18:06:09.283689+0000","last_unstale":"2026-02-12T18:15:20.480512+0000","last_undegraded":"2026-02-12T18:15:20.480512+0000","last_fullsized":"2026-02-12T18:15:20.480512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T00:04:55.700663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046734100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":628,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480580+0000","last_change":"2026-02-12T18:06:11.383662+0000","last_active":"2026-02-12T18:15:20.480580+0000","last_peered":"2026-02-12T18:15:20.480580+0000","last_clean":"2026-02-12T18:15:20.480580+0000","last_became_active":"2026-02-12T18:06:09.281461+0000","last_became_peered":"2026-02-12T18:06:09.281461+0000","last_unstale":"2026-02-12T18:15:20.480580+0000","last_undegraded":"2026-02-12T18:15:20.480580+0000","last_fullsized":"2026-02-12T18:15:20.480580+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T21:13:23.141921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00019704400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":627,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480493+0000","last_change":"2026-02-12T18:06:11.384936+0000","last_active":"2026-02-12T18:15:20.480493+0000","last_peered":"2026-02-12T18:15:20.480493+0000","last_clean":"2026-02-12T18:15:20.480493+0000","last_became_active":"2026-02-12T18:06:09.283688+0000","last_became_peered":"2026-02-12T18:06:09.283688+0000","last_unstale":"2026-02-12T18:15:20.480493+0000","last_undegraded":"2026-02-12T18:15:20.480493+0000","last_fullsized":"2026-02-12T18:15:20.480493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:54:04.914482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047092800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":629,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480486+0000","last_change":"2026-02-12T18:06:11.387479+0000","last_active":"2026-02-12T18:15:20.480486+0000","last_peered":"2026-02-12T18:15:20.480486+0000","last_clean":"2026-02-12T18:15:20.480486+0000","last_became_active":"2026-02-12T18:06:09.283881+0000","last_became_peered":"2026-02-12T18:06:09.283881+0000","last_unstale":"2026-02-12T18:15:20.480486+0000","last_undegraded":"2026-02-12T18:15:20.480486+0000","last_fullsized":"2026-02-12T18:15:20.480486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:14:28.203244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045409299999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":633,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480327+0000","last_change":"2026-02-12T18:06:11.384057+0000","last_active":"2026-02-12T18:15:20.480327+0000","last_peered":"2026-02-12T18:15:20.480327+0000","last_clean":"2026-02-12T18:15:20.480327+0000","last_became_active":"2026-02-12T18:06:09.284036+0000","last_became_peered":"2026-02-12T18:06:09.284036+0000","last_unstale":"2026-02-12T18:15:20.480327+0000","last_undegraded":"2026-02-12T18:15:20.480327+0000","last_fullsized":"2026-02-12T18:15:20.480327+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:15:47.166182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028640700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":628,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480529+0000","last_change":"2026-02-12T18:06:11.383648+0000","last_active":"2026-02-12T18:15:20.480529+0000","last_peered":"2026-02-12T18:15:20.480529+0000","last_clean":"2026-02-12T18:15:20.480529+0000","last_became_active":"2026-02-12T18:06:09.283797+0000","last_became_peered":"2026-02-12T18:06:09.283797+0000","last_unstale":"2026-02-12T18:15:20.480529+0000","last_undegraded":"2026-02-12T18:15:20.480529+0000","last_fullsized":"2026-02-12T18:15:20.480529+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:51:24.172618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018461199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":628,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480477+0000","last_change":"2026-02-12T18:06:11.387248+0000","last_active":"2026-02-12T18:15:20.480477+0000","last_peered":"2026-02-12T18:15:20.480477+0000","last_clean":"2026-02-12T18:15:20.480477+0000","last_became_active":"2026-02-12T18:06:09.287509+0000","last_became_peered":"2026-02-12T18:06:09.287509+0000","last_unstale":"2026-02-12T18:15:20.480477+0000","last_undegraded":"2026-02-12T18:15:20.480477+0000","last_fullsized":"2026-02-12T18:15:20.480477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:54:10.505834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020961600000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"13'112","reported_seq":765,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480549+0000","last_change":"2026-02-12T18:06:04.371853+0000","last_active":"2026-02-12T18:15:20.480549+0000","last_peered":"2026-02-12T18:15:20.480549+0000","last_clean":"2026-02-12T18:15:20.480549+0000","last_became_active":"2026-02-12T18:06:04.371628+0000","last_became_peered":"2026-02-12T18:06:04.371628+0000","last_unstale":"2026-02-12T18:15:20.480549+0000","last_undegraded":"2026-02-12T18:15:20.480549+0000","last_fullsized":"2026-02-12T18:15:20.480549+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:02.768915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:02.768915+0000","last_clean_scrub_stamp":"2026-02-12T18:06:02.768915+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:16:28.244842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":12,"seq":51539607687,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28804,"kb_used_data":1844,"kb_used_omap":219,"kb_used_meta":26724,"kb_avail":94343036,"statfs":{"total":96636764160,"available":96607268864,"internally_reserved":0,"allocated":1888256,"data_stored":1073116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224993,"internal_metadata":27365663},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640392,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1268,"kb_used_omap":219,"kb_used_meta":26724,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1298432,"data_stored":482767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224995,"internal_metadata":27365661},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640392,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28224,"kb_used_data":1264,"kb_used_omap":217,"kb_used_meta":26726,"kb_avail":94343616,"statfs":{"total":96636764160,"available":96607862784,"internally_reserved":0,"allocated":1294336,"data_stored":482748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":222391,"internal_metadata":27368265},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640394,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28224,"kb_used_data":1264,"kb_used_omap":223,"kb_used_meta":26720,"kb_avail":94343616,"statfs":{"total":96636764160,"available":96607862784,"internally_reserved":0,"allocated":1294336,"data_stored":482748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":228901,"internal_metadata":27361755},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640392,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1268,"kb_used_omap":219,"kb_used_meta":26724,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1298432,"data_stored":482767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224995,"internal_metadata":27365661},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640392,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28804,"kb_used_data":1844,"kb_used_omap":205,"kb_used_meta":26738,"kb_avail":94343036,"statfs":{"total":96636764160,"available":96607268864,"internally_reserved":0,"allocated":1888256,"data_stored":1073116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":210673,"internal_metadata":27379983},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T18:17:09.986 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T18:17:10.051 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.049+0000 7fda746c3640 10 monclient: get_monmap_and_config 2026-02-12T18:17:10.051 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.049+0000 7fda746c3640 10 monclient: build_initial_monmap 2026-02-12T18:17:10.051 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.049+0000 7fda746c3640 10 monclient: monmap: 2026-02-12T18:17:10.051 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:10.051 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:10.052 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:10.050981+0000 2026-02-12T18:17:10.052 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:10.050981+0000 2026-02-12T18:17:10.052 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:10.052 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:10.052 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:10.052 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:10.052 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:10.052 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:10.052 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:10.052 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:10.052 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:10.053 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:10.053 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:10.053 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:10.053 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:10.053 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:10.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.050+0000 7fda746c3640 1 Processor -- start 2026-02-12T18:17:10.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.050+0000 7fda746c3640 1 -- start start 2026-02-12T18:17:10.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.050+0000 7fda746c3640 10 monclient: init 2026-02-12T18:17:10.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.050+0000 7fda746c3640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:10.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.050+0000 7fda746c3640 10 monclient: _add_conns ranks=[7,5,8,6,4,0,3,2,10,9,1] 2026-02-12T18:17:10.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.050+0000 7fda746c3640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fda6c090d90 0x7fda6c141220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:10.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.050+0000 7fda746c3640 10 monclient(hunting): picked mon.noname-i con 0x7fda6c090d90 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:17:10.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.050+0000 7fda746c3640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fda6c08be10 0x7fda6c144210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:10.063 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.050+0000 7fda746c3640 10 monclient(hunting): picked mon.noname-h con 0x7fda6c08be10 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:17:10.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.050+0000 7fda746c3640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fda6c144750 0x7fda6c144bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:10.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.050+0000 7fda746c3640 10 monclient(hunting): picked mon.noname-e con 0x7fda6c144750 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:17:10.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.050+0000 7fda746c3640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:10.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.050+0000 7fda746c3640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fda6c0570a0 con 0x7fda6c08be10 2026-02-12T18:17:10.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.050+0000 7fda746c3640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:10.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.050+0000 7fda746c3640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fda6c0578d0 con 0x7fda6c090d90 2026-02-12T18:17:10.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.050+0000 7fda746c3640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:10.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.050+0000 7fda746c3640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fda6c057310 con 0x7fda6c144750 2026-02-12T18:17:10.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.050+0000 7fda746c3640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:10.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.050+0000 7fda746c3640 10 monclient(hunting): authenticate will time out at 1268.776943s 2026-02-12T18:17:10.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72c39640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fda6c144750 0x7fda6c144bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:10.064 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72c39640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fda6c144750 0x7fda6c144bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:33746/0 (socket says 10.20.193.48:33746) 2026-02-12T18:17:10.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72c39640 1 -- 10.20.193.48:0/3599103189 learned_addr learned my addr 10.20.193.48:0/3599103189 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:10.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72c39640 10 monclient(hunting): get_auth_request con 0x7fda6c144750 auth_method 0 2026-02-12T18:17:10.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72c39640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:10.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72c39640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:10.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72c39640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:10.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda71c37640 1 --2- 10.20.193.48:0/3599103189 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fda6c08be10 0x7fda6c144210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:10.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72438640 1 --2- 10.20.193.48:0/3599103189 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fda6c090d90 0x7fda6c141220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:10.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72438640 10 monclient(hunting): get_auth_request con 0x7fda6c090d90 auth_method 0 2026-02-12T18:17:10.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72438640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:10.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72438640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:10.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72438640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:10.065 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda71c37640 10 monclient(hunting): get_auth_request con 0x7fda6c08be10 auth_method 0 2026-02-12T18:17:10.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda71c37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:10.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda71c37640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:10.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda71c37640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:10.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72c39640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:10.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72c39640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:10.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72c39640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:10.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda71c37640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:10.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda71c37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:10.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda71c37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:10.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72438640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:10.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72438640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:10.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72438640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:10.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72c39640 10 monclient(hunting): handle_auth_done global_id 95012 payload 274 2026-02-12T18:17:10.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72c39640 1 -- 10.20.193.48:0/3599103189 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fda6c090d90 msgr2=0x7fda6c141220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:10.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72c39640 1 --2- 10.20.193.48:0/3599103189 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fda6c090d90 0x7fda6c141220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:10.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72c39640 1 -- 10.20.193.48:0/3599103189 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fda6c08be10 msgr2=0x7fda6c144210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:10.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72c39640 1 --2- 10.20.193.48:0/3599103189 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fda6c08be10 0x7fda6c144210 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:10.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72c39640 10 monclient: _finish_hunting 0 2026-02-12T18:17:10.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72c39640 1 monclient: found mon.noname-e 2026-02-12T18:17:10.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72c39640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:10.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72c39640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:17:10.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.051+0000 7fda72c39640 1 -- 10.20.193.48:0/3599103189 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6c060390 con 0x7fda6c144750 2026-02-12T18:17:10.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.053+0000 7fda72c39640 1 -- 10.20.193.48:0/3599103189 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fda6c144750 msgr2=0x7fda6c144bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:10.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.053+0000 7fda72c39640 1 --2- 10.20.193.48:0/3599103189 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fda6c144750 0x7fda6c144bc0 secure :-1 s=READY pgs=197 gs=1 cs=0 l=1 c_cookie=13071767128759800030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda6800a9b0 tx=0x7fda6802fef0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=b5683ef2485b10de server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:10.067 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda71436640 1 -- 10.20.193.48:0/3599103189 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fda68030b70 con 0x7fda6c144750 2026-02-12T18:17:10.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda71436640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:10.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda71436640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:17:10.068 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda71436640 10 monclient: dump: 2026-02-12T18:17:10.068 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:10.068 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:10.068 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:10.068 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:10.068 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:10.068 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:10.068 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:10.068 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:10.068 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:10.069 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:10.069 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:10.069 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:10.069 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:10.069 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:10.069 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:10.069 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:10.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda71436640 10 monclient: _finish_auth 0 2026-02-12T18:17:10.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda71436640 10 monclient: _check_auth_tickets 2026-02-12T18:17:10.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda71436640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:10.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda71436640 1 -- 10.20.193.48:0/3599103189 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda68030cf0 con 0x7fda6c144750 2026-02-12T18:17:10.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda71436640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:10.069 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda746c3640 5 monclient: authenticate success, global_id 95012 2026-02-12T18:17:10.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda71436640 1 -- 10.20.193.48:0/3599103189 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fda68030e60 con 0x7fda6c144750 2026-02-12T18:17:10.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda746c3640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:10.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda746c3640 4 set_mon_vals no callback set 2026-02-12T18:17:10.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda71436640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:10.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda71436640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:17:10.070 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda71436640 10 monclient: dump: 2026-02-12T18:17:10.070 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:10.070 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:10.070 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:10.070 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:10.070 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:10.070 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:10.071 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:10.071 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:10.071 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:10.071 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:10.071 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:10.071 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:10.071 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:10.071 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:10.071 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:10.071 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:10.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda746c3640 10 monclient: shutdown 2026-02-12T18:17:10.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda746c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:10.071 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda746c3640 1 -- 10.20.193.48:0/3599103189 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fda6c144750 msgr2=0x7fda6c144bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:10.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda746c3640 1 --2- 10.20.193.48:0/3599103189 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fda6c144750 0x7fda6c144bc0 secure :-1 s=READY pgs=197 gs=1 cs=0 l=1 c_cookie=13071767128759800030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda6800a9b0 tx=0x7fda6802fef0 comp rx=0 tx=0).stop 2026-02-12T18:17:10.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda746c3640 1 -- 10.20.193.48:0/3599103189 shutdown_connections 2026-02-12T18:17:10.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda746c3640 1 --2- 10.20.193.48:0/3599103189 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fda6c144750 0x7fda6c144bc0 unknown :-1 s=CLOSED pgs=197 gs=1 cs=0 l=1 c_cookie=13071767128759800030 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:10.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda746c3640 1 --2- 10.20.193.48:0/3599103189 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fda6c08be10 0x7fda6c144210 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:10.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda746c3640 1 --2- 10.20.193.48:0/3599103189 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fda6c090d90 0x7fda6c141220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:10.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda746c3640 1 -- 10.20.193.48:0/3599103189 >> 10.20.193.48:0/3599103189 conn(0x7fda6c054e20 msgr2=0x7fda6c095380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:10.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda746c3640 1 -- 10.20.193.48:0/3599103189 shutdown_connections 2026-02-12T18:17:10.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda746c3640 1 -- 10.20.193.48:0/3599103189 wait complete. 2026-02-12T18:17:10.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.054+0000 7fda746c3640 10 monclient: build_initial_monmap 2026-02-12T18:17:10.072 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda746c3640 10 monclient: monmap: 2026-02-12T18:17:10.072 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:10.073 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:10.073 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:10.073 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:10.073 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:10.073 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:10.073 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:10.073 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:10.073 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:10.073 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:10.073 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:10.073 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:10.073 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:10.073 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:10.073 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:10.074 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:10.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda746c3640 1 Processor -- start 2026-02-12T18:17:10.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda746c3640 1 -- start start 2026-02-12T18:17:10.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda746c3640 10 monclient: init 2026-02-12T18:17:10.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda746c3640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:10.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda746c3640 10 monclient: _add_conns ranks=[7,8,6,3,0,4,1,2,5] 2026-02-12T18:17:10.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda746c3640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fda6c08be10 0x7fda6c10cd80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:10.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda746c3640 10 monclient(hunting): picked mon.noname-i con 0x7fda6c08be10 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:17:10.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda746c3640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fda6c090d90 0x7fda6c12e660 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:10.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda746c3640 10 monclient(hunting): picked mon.noname-e con 0x7fda6c090d90 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:17:10.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda746c3640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fda6c144750 0x7fda6c12aeb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:10.074 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda746c3640 10 monclient(hunting): picked mon.noname-d con 0x7fda6c144750 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:17:10.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda746c3640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:10.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda746c3640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fda6c10f620 con 0x7fda6c144750 2026-02-12T18:17:10.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda746c3640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:10.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda746c3640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fda6c10d2c0 con 0x7fda6c08be10 2026-02-12T18:17:10.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda746c3640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:10.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda746c3640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fda6c1407b0 con 0x7fda6c090d90 2026-02-12T18:17:10.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda746c3640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:10.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda746c3640 10 monclient(hunting): authenticate will time out at 1268.781488s 2026-02-12T18:17:10.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda71c37640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fda6c090d90 0x7fda6c12e660 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:10.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda71c37640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fda6c090d90 0x7fda6c12e660 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:33750/0 (socket says 10.20.193.48:33750) 2026-02-12T18:17:10.075 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda71c37640 1 -- 10.20.193.48:0/3683139075 learned_addr learned my addr 10.20.193.48:0/3683139075 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:10.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda71c37640 10 monclient(hunting): get_auth_request con 0x7fda6c090d90 auth_method 0 2026-02-12T18:17:10.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda71c37640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:10.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda71c37640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:10.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda71c37640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:10.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda72c39640 1 --2- 10.20.193.48:0/3683139075 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fda6c144750 0x7fda6c12aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:10.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda71c37640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:10.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda71c37640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:10.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda71c37640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:10.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda72c39640 10 monclient(hunting): get_auth_request con 0x7fda6c144750 auth_method 0 2026-02-12T18:17:10.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda72c39640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:10.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda72c39640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:10.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda72c39640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:10.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda72438640 1 --2- 10.20.193.48:0/3683139075 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fda6c08be10 0x7fda6c10cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:10.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda72438640 10 monclient(hunting): get_auth_request con 0x7fda6c08be10 auth_method 0 2026-02-12T18:17:10.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda72438640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:10.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda72438640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:10.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda72438640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:10.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda72c39640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:10.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda72c39640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:10.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda72c39640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:10.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda71c37640 10 monclient(hunting): handle_auth_done global_id 95021 payload 824 2026-02-12T18:17:10.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda71c37640 1 -- 10.20.193.48:0/3683139075 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fda6c08be10 msgr2=0x7fda6c10cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:10.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda71c37640 1 --2- 10.20.193.48:0/3683139075 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fda6c08be10 0x7fda6c10cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:10.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda71c37640 1 -- 10.20.193.48:0/3683139075 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fda6c144750 msgr2=0x7fda6c12aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:10.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda71c37640 1 --2- 10.20.193.48:0/3683139075 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fda6c144750 0x7fda6c12aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:10.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda71c37640 10 monclient: _finish_hunting 0 2026-02-12T18:17:10.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda71c37640 1 monclient: found mon.noname-e 2026-02-12T18:17:10.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda71c37640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:10.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda71c37640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:17:10.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda71c37640 1 -- 10.20.193.48:0/3683139075 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6800a5d0 con 0x7fda6c090d90 2026-02-12T18:17:10.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.055+0000 7fda72438640 1 --2- 10.20.193.48:0/3683139075 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fda6c08be10 0x7fda6c10cd80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:17:10.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.057+0000 7fda71c37640 1 -- 10.20.193.48:0/3683139075 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fda6c090d90 msgr2=0x7fda6c12e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:10.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.057+0000 7fda71c37640 1 --2- 10.20.193.48:0/3683139075 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fda6c090d90 0x7fda6c12e660 secure :-1 s=READY pgs=198 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda6000e890 tx=0x7fda6000ed60 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:10.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda52ffd640 1 -- 10.20.193.48:0/3683139075 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fda6000cb50 con 0x7fda6c090d90 2026-02-12T18:17:10.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda52ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:10.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda52ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:17:10.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda52ffd640 10 monclient: dump: 2026-02-12T18:17:10.079 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:10.079 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:10.079 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:10.079 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:10.079 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:10.079 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:10.079 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:10.079 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:10.079 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:10.079 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:10.079 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:10.079 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:10.079 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:10.079 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:10.080 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:10.080 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:10.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda52ffd640 10 monclient: _finish_auth 0 2026-02-12T18:17:10.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda52ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:17:10.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda52ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:10.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda52ffd640 1 -- 10.20.193.48:0/3683139075 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda6000ccd0 con 0x7fda6c090d90 2026-02-12T18:17:10.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda52ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:10.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda52ffd640 1 -- 10.20.193.48:0/3683139075 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fda6000ce40 con 0x7fda6c090d90 2026-02-12T18:17:10.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda52ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:10.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda70c35640 4 set_mon_vals no callback set 2026-02-12T18:17:10.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda52ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:17:10.081 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda52ffd640 10 monclient: dump: 2026-02-12T18:17:10.081 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:10.081 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:10.081 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:10.081 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:10.081 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:10.081 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:10.081 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:10.081 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:10.081 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:10.081 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:10.081 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:10.081 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:10.082 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:10.082 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:10.082 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:10.082 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:10.082 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda746c3640 5 monclient: authenticate success, global_id 95021 2026-02-12T18:17:10.082 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda746c3640 10 monclient: _renew_subs 2026-02-12T18:17:10.082 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda746c3640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:17:10.082 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda746c3640 1 -- 10.20.193.48:0/3683139075 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda6c10fae0 con 0x7fda6c090d90 2026-02-12T18:17:10.082 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda746c3640 10 monclient: _renew_subs 2026-02-12T18:17:10.082 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda746c3640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:17:10.082 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda746c3640 1 -- 10.20.193.48:0/3683139075 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fda6c10f240 con 0x7fda6c090d90 2026-02-12T18:17:10.082 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda746c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:10.082 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda746c3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:10.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda746c3640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:17:10.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda746c3640 1 -- 10.20.193.48:0/3683139075 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda6c10f760 con 0x7fda6c090d90 2026-02-12T18:17:10.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda71c37640 1 --2- 10.20.193.48:0/3683139075 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fda6c090d90 0x7fda6c12e660 secure :-1 s=READY pgs=198 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda6000e890 tx=0x7fda6000ed60 comp rx=0 tx=0).queue_received will delay after 1.77092e+09 on 0x7fda60011070 mgrmap(e 5) 2026-02-12T18:17:10.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.058+0000 7fda52ffd640 1 -- 10.20.193.48:0/3683139075 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fda60011070 con 0x7fda6c090d90 2026-02-12T18:17:10.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.059+0000 7fda52ffd640 1 --2- 10.20.193.48:0/3683139075 >> v2:10.20.193.111:6812/977811348 conn(0x7fda3c03f800 0x7fda3c05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:10.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.059+0000 7fda72438640 1 --2- 10.20.193.48:0/3683139075 >> v2:10.20.193.111:6812/977811348 conn(0x7fda3c03f800 0x7fda3c05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:10.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.059+0000 7fda72438640 10 monclient: get_auth_request con 0x7fda3c03f800 auth_method 0 2026-02-12T18:17:10.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.061+0000 7fda52ffd640 1 -- 10.20.193.48:0/3683139075 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7fda600529c0 con 0x7fda6c090d90 2026-02-12T18:17:10.084 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.062+0000 7fda72438640 1 --2- 10.20.193.48:0/3683139075 >> v2:10.20.193.111:6812/977811348 conn(0x7fda3c03f800 0x7fda3c05fcb0 secure :-1 s=READY pgs=484 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda5c004740 tx=0x7fda5c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:10.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.886+0000 7fda52ffd640 1 -- 10.20.193.48:0/3683139075 <== mon.8 v2:10.20.193.48:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fda6c10f760 con 0x7fda6c090d90 2026-02-12T18:17:10.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.886+0000 7fda52ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:10.888 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.886+0000 7fda52ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:17:10.991 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.990+0000 7fda746c3640 1 -- 10.20.193.48:0/3683139075 --> v2:10.20.193.111:6812/977811348 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fda6c0580f0 con 0x7fda3c03f800 2026-02-12T18:17:10.992 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.991+0000 7fda52ffd640 1 -- 10.20.193.48:0/3683139075 <== mgr.4123 v2:10.20.193.111:6812/977811348 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33979 (secure 0 0 0) 0x7fda5c011de0 con 0x7fda3c03f800 2026-02-12T18:17:10.993 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:17:10.994 INFO:teuthology.orchestra.run.trial048.stderr:dumped all 2026-02-12T18:17:10.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.992+0000 7fda746c3640 1 -- 10.20.193.48:0/3683139075 >> v2:10.20.193.111:6812/977811348 conn(0x7fda3c03f800 msgr2=0x7fda3c05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:10.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.992+0000 7fda746c3640 1 --2- 10.20.193.48:0/3683139075 >> v2:10.20.193.111:6812/977811348 conn(0x7fda3c03f800 0x7fda3c05fcb0 secure :-1 s=READY pgs=484 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda5c004740 tx=0x7fda5c008040 comp rx=0 tx=0).stop 2026-02-12T18:17:10.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.992+0000 7fda746c3640 10 monclient: shutdown 2026-02-12T18:17:10.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.992+0000 7fda746c3640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:10.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.992+0000 7fda746c3640 1 -- 10.20.193.48:0/3683139075 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fda6c090d90 msgr2=0x7fda6c12e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:10.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.992+0000 7fda746c3640 1 --2- 10.20.193.48:0/3683139075 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fda6c090d90 0x7fda6c12e660 secure :-1 s=READY pgs=198 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fda6000e890 tx=0x7fda6000ed60 comp rx=0 tx=0).stop 2026-02-12T18:17:10.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.992+0000 7fda746c3640 1 -- 10.20.193.48:0/3683139075 shutdown_connections 2026-02-12T18:17:10.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.992+0000 7fda746c3640 1 --2- 10.20.193.48:0/3683139075 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fda6c144750 0x7fda6c12aeb0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:10.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.992+0000 7fda746c3640 1 --2- 10.20.193.48:0/3683139075 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fda6c090d90 0x7fda6c12e660 unknown :-1 s=CLOSED pgs=198 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:10.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.992+0000 7fda746c3640 1 --2- 10.20.193.48:0/3683139075 >> v2:10.20.193.111:6812/977811348 conn(0x7fda3c03f800 0x7fda3c05fcb0 unknown :-1 s=CLOSED pgs=484 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:10.995 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.992+0000 7fda746c3640 1 --2- 10.20.193.48:0/3683139075 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fda6c08be10 0x7fda6c10cd80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:10.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.992+0000 7fda746c3640 1 -- 10.20.193.48:0/3683139075 >> 10.20.193.48:0/3683139075 conn(0x7fda6c054e20 msgr2=0x7fda6c13eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:10.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.992+0000 7fda746c3640 1 -- 10.20.193.48:0/3683139075 shutdown_connections 2026-02-12T18:17:10.996 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:10.992+0000 7fda746c3640 1 -- 10.20.193.48:0/3683139075 wait complete. 2026-02-12T18:17:11.001 INFO:teuthology.orchestra.run.trial048.stdout:{"pg_ready":true,"pg_map":{"version":652,"stamp":"2026-02-12T18:17:10.452403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":170512,"kb_used_data":8752,"kb_used_omap":1305,"kb_used_meta":160358,"kb_avail":566060528,"statfs":{"total":579820584960,"available":579645980672,"internally_reserved":0,"allocated":8962048,"data_stored":4077262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1336948,"internal_metadata":164206988},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001028"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":628,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480584+0000","last_change":"2026-02-12T18:06:11.383740+0000","last_active":"2026-02-12T18:15:20.480584+0000","last_peered":"2026-02-12T18:15:20.480584+0000","last_clean":"2026-02-12T18:15:20.480584+0000","last_became_active":"2026-02-12T18:06:09.281532+0000","last_became_peered":"2026-02-12T18:06:09.281532+0000","last_unstale":"2026-02-12T18:15:20.480584+0000","last_undegraded":"2026-02-12T18:15:20.480584+0000","last_fullsized":"2026-02-12T18:15:20.480584+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T20:34:57.876774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027561099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":627,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480512+0000","last_change":"2026-02-12T18:06:11.384892+0000","last_active":"2026-02-12T18:15:20.480512+0000","last_peered":"2026-02-12T18:15:20.480512+0000","last_clean":"2026-02-12T18:15:20.480512+0000","last_became_active":"2026-02-12T18:06:09.283689+0000","last_became_peered":"2026-02-12T18:06:09.283689+0000","last_unstale":"2026-02-12T18:15:20.480512+0000","last_undegraded":"2026-02-12T18:15:20.480512+0000","last_fullsized":"2026-02-12T18:15:20.480512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T00:04:55.700663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046734100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":628,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480580+0000","last_change":"2026-02-12T18:06:11.383662+0000","last_active":"2026-02-12T18:15:20.480580+0000","last_peered":"2026-02-12T18:15:20.480580+0000","last_clean":"2026-02-12T18:15:20.480580+0000","last_became_active":"2026-02-12T18:06:09.281461+0000","last_became_peered":"2026-02-12T18:06:09.281461+0000","last_unstale":"2026-02-12T18:15:20.480580+0000","last_undegraded":"2026-02-12T18:15:20.480580+0000","last_fullsized":"2026-02-12T18:15:20.480580+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T21:13:23.141921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00019704400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":627,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480493+0000","last_change":"2026-02-12T18:06:11.384936+0000","last_active":"2026-02-12T18:15:20.480493+0000","last_peered":"2026-02-12T18:15:20.480493+0000","last_clean":"2026-02-12T18:15:20.480493+0000","last_became_active":"2026-02-12T18:06:09.283688+0000","last_became_peered":"2026-02-12T18:06:09.283688+0000","last_unstale":"2026-02-12T18:15:20.480493+0000","last_undegraded":"2026-02-12T18:15:20.480493+0000","last_fullsized":"2026-02-12T18:15:20.480493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:54:04.914482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047092800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":629,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480486+0000","last_change":"2026-02-12T18:06:11.387479+0000","last_active":"2026-02-12T18:15:20.480486+0000","last_peered":"2026-02-12T18:15:20.480486+0000","last_clean":"2026-02-12T18:15:20.480486+0000","last_became_active":"2026-02-12T18:06:09.283881+0000","last_became_peered":"2026-02-12T18:06:09.283881+0000","last_unstale":"2026-02-12T18:15:20.480486+0000","last_undegraded":"2026-02-12T18:15:20.480486+0000","last_fullsized":"2026-02-12T18:15:20.480486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:14:28.203244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045409299999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":633,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480327+0000","last_change":"2026-02-12T18:06:11.384057+0000","last_active":"2026-02-12T18:15:20.480327+0000","last_peered":"2026-02-12T18:15:20.480327+0000","last_clean":"2026-02-12T18:15:20.480327+0000","last_became_active":"2026-02-12T18:06:09.284036+0000","last_became_peered":"2026-02-12T18:06:09.284036+0000","last_unstale":"2026-02-12T18:15:20.480327+0000","last_undegraded":"2026-02-12T18:15:20.480327+0000","last_fullsized":"2026-02-12T18:15:20.480327+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:15:47.166182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028640700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":628,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480529+0000","last_change":"2026-02-12T18:06:11.383648+0000","last_active":"2026-02-12T18:15:20.480529+0000","last_peered":"2026-02-12T18:15:20.480529+0000","last_clean":"2026-02-12T18:15:20.480529+0000","last_became_active":"2026-02-12T18:06:09.283797+0000","last_became_peered":"2026-02-12T18:06:09.283797+0000","last_unstale":"2026-02-12T18:15:20.480529+0000","last_undegraded":"2026-02-12T18:15:20.480529+0000","last_fullsized":"2026-02-12T18:15:20.480529+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:51:24.172618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018461199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":628,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480477+0000","last_change":"2026-02-12T18:06:11.387248+0000","last_active":"2026-02-12T18:15:20.480477+0000","last_peered":"2026-02-12T18:15:20.480477+0000","last_clean":"2026-02-12T18:15:20.480477+0000","last_became_active":"2026-02-12T18:06:09.287509+0000","last_became_peered":"2026-02-12T18:06:09.287509+0000","last_unstale":"2026-02-12T18:15:20.480477+0000","last_undegraded":"2026-02-12T18:15:20.480477+0000","last_fullsized":"2026-02-12T18:15:20.480477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:54:10.505834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020961600000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"13'112","reported_seq":765,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480549+0000","last_change":"2026-02-12T18:06:04.371853+0000","last_active":"2026-02-12T18:15:20.480549+0000","last_peered":"2026-02-12T18:15:20.480549+0000","last_clean":"2026-02-12T18:15:20.480549+0000","last_became_active":"2026-02-12T18:06:04.371628+0000","last_became_peered":"2026-02-12T18:06:04.371628+0000","last_unstale":"2026-02-12T18:15:20.480549+0000","last_undegraded":"2026-02-12T18:15:20.480549+0000","last_fullsized":"2026-02-12T18:15:20.480549+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:02.768915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:02.768915+0000","last_clean_scrub_stamp":"2026-02-12T18:06:02.768915+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:16:28.244842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":12,"seq":51539607688,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28804,"kb_used_data":1844,"kb_used_omap":219,"kb_used_meta":26724,"kb_avail":94343036,"statfs":{"total":96636764160,"available":96607268864,"internally_reserved":0,"allocated":1888256,"data_stored":1073116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224993,"internal_metadata":27365663},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640393,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1268,"kb_used_omap":219,"kb_used_meta":26724,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1298432,"data_stored":482767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224995,"internal_metadata":27365661},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640392,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28224,"kb_used_data":1264,"kb_used_omap":217,"kb_used_meta":26726,"kb_avail":94343616,"statfs":{"total":96636764160,"available":96607862784,"internally_reserved":0,"allocated":1294336,"data_stored":482748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":222391,"internal_metadata":27368265},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640394,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28224,"kb_used_data":1264,"kb_used_omap":223,"kb_used_meta":26720,"kb_avail":94343616,"statfs":{"total":96636764160,"available":96607862784,"internally_reserved":0,"allocated":1294336,"data_stored":482748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":228901,"internal_metadata":27361755},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640392,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1268,"kb_used_omap":219,"kb_used_meta":26724,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1298432,"data_stored":482767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224995,"internal_metadata":27365661},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640392,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28804,"kb_used_data":1844,"kb_used_omap":205,"kb_used_meta":26738,"kb_avail":94343036,"statfs":{"total":96636764160,"available":96607268864,"internally_reserved":0,"allocated":1888256,"data_stored":1073116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":210673,"internal_metadata":27379983},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T18:17:11.003 INFO:tasks.ceph.ceph_manager.ceph:clean! 2026-02-12T18:17:11.003 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T18:17:11.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.065+0000 7fbc3550c640 10 monclient: get_monmap_and_config 2026-02-12T18:17:11.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.065+0000 7fbc3550c640 10 monclient: build_initial_monmap 2026-02-12T18:17:11.066 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.065+0000 7fbc3550c640 10 monclient: monmap: 2026-02-12T18:17:11.066 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:11.067 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:11.067 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:11.066146+0000 2026-02-12T18:17:11.067 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:11.066146+0000 2026-02-12T18:17:11.067 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:11.067 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:11.067 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:11.067 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:11.067 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:11.067 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:11.067 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:11.067 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:11.068 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:11.068 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:11.068 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:11.068 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:11.068 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:11.068 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:11.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.065+0000 7fbc3550c640 1 Processor -- start 2026-02-12T18:17:11.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.065+0000 7fbc3550c640 1 -- start start 2026-02-12T18:17:11.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.065+0000 7fbc3550c640 10 monclient: init 2026-02-12T18:17:11.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.065+0000 7fbc3550c640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:11.076 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.065+0000 7fbc3550c640 10 monclient: _add_conns ranks=[9,10,8,4,0,7,3,5,2,6,1] 2026-02-12T18:17:11.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.065+0000 7fbc3550c640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fbc30093ac0 0x7fbc3005d610 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:11.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.065+0000 7fbc3550c640 10 monclient(hunting): picked mon.noname-a con 0x7fbc30093ac0 addr v2:10.20.193.48:3300/0 2026-02-12T18:17:11.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.065+0000 7fbc3550c640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7fbc3013e990 0x7fbc3005db50 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:11.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.065+0000 7fbc3550c640 10 monclient(hunting): picked mon.noname-f con 0x7fbc3013e990 addr v2:10.20.193.111:3300/0 2026-02-12T18:17:11.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.065+0000 7fbc3550c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbc30141e90 0x7fbc30142310 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:11.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.065+0000 7fbc3550c640 10 monclient(hunting): picked mon.noname-e con 0x7fbc30141e90 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:17:11.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.065+0000 7fbc3550c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:11.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.065+0000 7fbc3550c640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7fbc3005e090 con 0x7fbc30093ac0 2026-02-12T18:17:11.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.065+0000 7fbc3550c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:11.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.065+0000 7fbc3550c640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7fbc300580a0 con 0x7fbc3013e990 2026-02-12T18:17:11.077 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.065+0000 7fbc3550c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:11.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.065+0000 7fbc3550c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fbc3005e3f0 con 0x7fbc30141e90 2026-02-12T18:17:11.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.065+0000 7fbc3550c640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:11.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.065+0000 7fbc3550c640 10 monclient(hunting): authenticate will time out at 1269.791819s 2026-02-12T18:17:11.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.065+0000 7fbc2f7fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbc30141e90 0x7fbc30142310 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:11.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.065+0000 7fbc2effd640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fbc30093ac0 0x7fbc3005d610 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:11.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.065+0000 7fbc2f7fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbc30141e90 0x7fbc30142310 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:33764/0 (socket says 10.20.193.48:33764) 2026-02-12T18:17:11.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2f7fe640 1 -- 10.20.193.48:0/2132921150 learned_addr learned my addr 10.20.193.48:0/2132921150 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:11.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.065+0000 7fbc2effd640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fbc30093ac0 0x7fbc3005d610 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:54986/0 (socket says 10.20.193.48:54986) 2026-02-12T18:17:11.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2f7fe640 10 monclient(hunting): get_auth_request con 0x7fbc30141e90 auth_method 0 2026-02-12T18:17:11.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:11.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:11.078 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:11.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2effd640 10 monclient(hunting): get_auth_request con 0x7fbc30093ac0 auth_method 0 2026-02-12T18:17:11.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:11.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:11.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:11.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:11.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:11.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2e7fc640 1 --2- 10.20.193.48:0/2132921150 >> v2:10.20.193.111:3300/0 conn(0x7fbc3013e990 0x7fbc3005db50 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:11.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:11.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2e7fc640 10 monclient(hunting): get_auth_request con 0x7fbc3013e990 auth_method 0 2026-02-12T18:17:11.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:11.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:11.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:11.079 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:11.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:11.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:11.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2f7fe640 10 monclient(hunting): handle_auth_done global_id 95030 payload 274 2026-02-12T18:17:11.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2f7fe640 1 -- 10.20.193.48:0/2132921150 >> v2:10.20.193.111:3300/0 conn(0x7fbc3013e990 msgr2=0x7fbc3005db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:11.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2f7fe640 1 --2- 10.20.193.48:0/2132921150 >> v2:10.20.193.111:3300/0 conn(0x7fbc3013e990 0x7fbc3005db50 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:11.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2f7fe640 1 -- 10.20.193.48:0/2132921150 >> v2:10.20.193.48:3300/0 conn(0x7fbc30093ac0 msgr2=0x7fbc3005d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:11.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2f7fe640 1 --2- 10.20.193.48:0/2132921150 >> v2:10.20.193.48:3300/0 conn(0x7fbc30093ac0 0x7fbc3005d610 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:11.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2f7fe640 10 monclient: _finish_hunting 0 2026-02-12T18:17:11.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2f7fe640 1 monclient: found mon.noname-e 2026-02-12T18:17:11.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:11.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2f7fe640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:17:11.080 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2f7fe640 1 -- 10.20.193.48:0/2132921150 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc30060390 con 0x7fbc30141e90 2026-02-12T18:17:11.081 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.066+0000 7fbc2e7fc640 1 --2- 10.20.193.48:0/2132921150 >> v2:10.20.193.111:3300/0 conn(0x7fbc3013e990 0x7fbc3005db50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:17:11.081 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.068+0000 7fbc2f7fe640 1 -- 10.20.193.48:0/2132921150 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbc30141e90 msgr2=0x7fbc30142310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:11.081 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.068+0000 7fbc2f7fe640 1 --2- 10.20.193.48:0/2132921150 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbc30141e90 0x7fbc30142310 secure :-1 s=READY pgs=199 gs=2 cs=0 l=1 c_cookie=9350510604966688079 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc300571f0 tx=0x7fbc2002fe90 comp rx=0 tx=0).ready entity=mon.8 client_cookie=81c3afdaa58ff54f server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:11.081 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc2dffb640 1 -- 10.20.193.48:0/2132921150 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fbc20036340 con 0x7fbc30141e90 2026-02-12T18:17:11.081 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc2dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:11.081 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc2dffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:17:11.081 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc2dffb640 10 monclient: dump: 2026-02-12T18:17:11.081 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:11.081 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:11.081 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:11.081 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:11.082 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:11.082 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:11.082 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:11.082 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:11.082 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:11.082 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:11.082 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:11.082 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:11.082 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:11.082 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:11.082 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:11.082 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:11.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc2dffb640 10 monclient: _finish_auth 0 2026-02-12T18:17:11.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc2dffb640 10 monclient: _check_auth_tickets 2026-02-12T18:17:11.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc2dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:11.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc2dffb640 1 -- 10.20.193.48:0/2132921150 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc200364c0 con 0x7fbc30141e90 2026-02-12T18:17:11.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc2dffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:11.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc3550c640 5 monclient: authenticate success, global_id 95030 2026-02-12T18:17:11.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc2dffb640 1 -- 10.20.193.48:0/2132921150 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fbc20036af0 con 0x7fbc30141e90 2026-02-12T18:17:11.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc3550c640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:11.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc3550c640 4 set_mon_vals no callback set 2026-02-12T18:17:11.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc2dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:11.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc2dffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:17:11.083 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc2dffb640 10 monclient: dump: 2026-02-12T18:17:11.083 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:11.084 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:11.084 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:11.084 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:11.084 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:11.084 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:11.084 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:11.084 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:11.084 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:11.084 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:11.084 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:11.084 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:11.084 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:11.085 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:11.085 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:11.085 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:11.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc3550c640 10 monclient: shutdown 2026-02-12T18:17:11.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc3550c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:11.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc3550c640 1 -- 10.20.193.48:0/2132921150 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbc30141e90 msgr2=0x7fbc30142310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:11.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc3550c640 1 --2- 10.20.193.48:0/2132921150 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbc30141e90 0x7fbc30142310 secure :-1 s=READY pgs=199 gs=2 cs=0 l=1 c_cookie=9350510604966688079 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc300571f0 tx=0x7fbc2002fe90 comp rx=0 tx=0).stop 2026-02-12T18:17:11.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc3550c640 1 -- 10.20.193.48:0/2132921150 shutdown_connections 2026-02-12T18:17:11.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc3550c640 1 --2- 10.20.193.48:0/2132921150 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbc30141e90 0x7fbc30142310 unknown :-1 s=CLOSED pgs=199 gs=2 cs=0 l=1 c_cookie=9350510604966688079 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:11.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc3550c640 1 --2- 10.20.193.48:0/2132921150 >> v2:10.20.193.111:3300/0 conn(0x7fbc3013e990 0x7fbc3005db50 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:11.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc3550c640 1 --2- 10.20.193.48:0/2132921150 >> v2:10.20.193.48:3300/0 conn(0x7fbc30093ac0 0x7fbc3005d610 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:11.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc3550c640 1 -- 10.20.193.48:0/2132921150 >> 10.20.193.48:0/2132921150 conn(0x7fbc30054b30 msgr2=0x7fbc30093070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:11.085 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc3550c640 1 -- 10.20.193.48:0/2132921150 shutdown_connections 2026-02-12T18:17:11.086 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc3550c640 1 -- 10.20.193.48:0/2132921150 wait complete. 2026-02-12T18:17:11.086 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc3550c640 10 monclient: build_initial_monmap 2026-02-12T18:17:11.086 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.069+0000 7fbc3550c640 10 monclient: monmap: 2026-02-12T18:17:11.086 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:11.086 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:11.086 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:11.086 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:11.086 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:11.086 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:11.086 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:11.086 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:11.086 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:11.087 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:11.087 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:11.087 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:11.087 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:11.087 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:11.087 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:11.087 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:11.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc3550c640 1 Processor -- start 2026-02-12T18:17:11.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc3550c640 1 -- start start 2026-02-12T18:17:11.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc3550c640 10 monclient: init 2026-02-12T18:17:11.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc3550c640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:11.087 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc3550c640 10 monclient: _add_conns ranks=[7,6,8,3,5,1,0,2,4] 2026-02-12T18:17:11.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc3550c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fbc30093ac0 0x7fbc3008a570 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:11.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc3550c640 10 monclient(hunting): picked mon.noname-i con 0x7fbc30093ac0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:17:11.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc3550c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fbc3013e990 0x7fbc3008aab0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:11.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc3550c640 10 monclient(hunting): picked mon.noname-d con 0x7fbc3013e990 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:17:11.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc3550c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbc30141e90 0x7fbc3008aff0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:11.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc3550c640 10 monclient(hunting): picked mon.noname-e con 0x7fbc30141e90 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:17:11.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc3550c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:11.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc3550c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fbc3005ad30 con 0x7fbc3013e990 2026-02-12T18:17:11.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc3550c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:11.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc3550c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fbc3013daa0 con 0x7fbc30093ac0 2026-02-12T18:17:11.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc3550c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:11.088 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc3550c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fbc3005dc30 con 0x7fbc30141e90 2026-02-12T18:17:11.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc3550c640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:11.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc3550c640 10 monclient(hunting): authenticate will time out at 1269.796379s 2026-02-12T18:17:11.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2f7fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbc30141e90 0x7fbc3008aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:11.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2f7fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbc30141e90 0x7fbc3008aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:33774/0 (socket says 10.20.193.48:33774) 2026-02-12T18:17:11.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2f7fe640 1 -- 10.20.193.48:0/539319373 learned_addr learned my addr 10.20.193.48:0/539319373 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:11.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2f7fe640 10 monclient(hunting): get_auth_request con 0x7fbc30141e90 auth_method 0 2026-02-12T18:17:11.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:11.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:11.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:11.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2e7fc640 1 --2- 10.20.193.48:0/539319373 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fbc3013e990 0x7fbc3008aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:11.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2f7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:11.089 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2f7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:11.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2f7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:11.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2e7fc640 10 monclient(hunting): get_auth_request con 0x7fbc3013e990 auth_method 0 2026-02-12T18:17:11.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2e7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:11.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2e7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:11.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2e7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:11.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2effd640 1 --2- 10.20.193.48:0/539319373 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fbc30093ac0 0x7fbc3008a570 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:11.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2effd640 10 monclient(hunting): get_auth_request con 0x7fbc30093ac0 auth_method 0 2026-02-12T18:17:11.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:11.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:11.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:11.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2e7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:11.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2e7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:11.090 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2e7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:11.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2f7fe640 10 monclient(hunting): handle_auth_done global_id 95039 payload 824 2026-02-12T18:17:11.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2f7fe640 1 -- 10.20.193.48:0/539319373 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fbc30093ac0 msgr2=0x7fbc3008a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:11.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2f7fe640 1 --2- 10.20.193.48:0/539319373 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fbc30093ac0 0x7fbc3008a570 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:11.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2f7fe640 1 -- 10.20.193.48:0/539319373 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fbc3013e990 msgr2=0x7fbc3008aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:11.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2f7fe640 1 --2- 10.20.193.48:0/539319373 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fbc3013e990 0x7fbc3008aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:11.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2f7fe640 10 monclient: _finish_hunting 0 2026-02-12T18:17:11.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2f7fe640 1 monclient: found mon.noname-e 2026-02-12T18:17:11.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:11.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2f7fe640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:17:11.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.070+0000 7fbc2f7fe640 1 -- 10.20.193.48:0/539319373 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc2000a5d0 con 0x7fbc30141e90 2026-02-12T18:17:11.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.072+0000 7fbc2f7fe640 1 -- 10.20.193.48:0/539319373 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbc30141e90 msgr2=0x7fbc3008aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:11.091 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.072+0000 7fbc2f7fe640 1 --2- 10.20.193.48:0/539319373 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbc30141e90 0x7fbc3008aff0 secure :-1 s=READY pgs=200 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc2000a900 tx=0x7fbc20005850 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:11.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.072+0000 7fbc0f7fe640 1 -- 10.20.193.48:0/539319373 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fbc20004c70 con 0x7fbc30141e90 2026-02-12T18:17:11.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.072+0000 7fbc0f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:11.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.072+0000 7fbc0f7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:17:11.092 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.072+0000 7fbc0f7fe640 10 monclient: dump: 2026-02-12T18:17:11.092 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:11.092 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:11.092 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:11.092 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:11.092 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:11.092 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:11.092 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:11.092 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:11.092 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:11.093 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:11.093 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:11.093 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:11.093 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:11.093 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:11.093 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:11.093 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:11.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.073+0000 7fbc0f7fe640 10 monclient: _finish_auth 0 2026-02-12T18:17:11.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.073+0000 7fbc0f7fe640 10 monclient: _check_auth_tickets 2026-02-12T18:17:11.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.073+0000 7fbc0f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:11.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.073+0000 7fbc3550c640 5 monclient: authenticate success, global_id 95039 2026-02-12T18:17:11.093 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.073+0000 7fbc0f7fe640 1 -- 10.20.193.48:0/539319373 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc20004e30 con 0x7fbc30141e90 2026-02-12T18:17:11.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.073+0000 7fbc3550c640 10 monclient: _renew_subs 2026-02-12T18:17:11.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.073+0000 7fbc3550c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:17:11.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.073+0000 7fbc3550c640 1 -- 10.20.193.48:0/539319373 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc3008be80 con 0x7fbc30141e90 2026-02-12T18:17:11.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.073+0000 7fbc0f7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:11.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.073+0000 7fbc0f7fe640 1 -- 10.20.193.48:0/539319373 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fbc20036af0 con 0x7fbc30141e90 2026-02-12T18:17:11.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.073+0000 7fbc0f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:11.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.073+0000 7fbc2d7fa640 4 set_mon_vals no callback set 2026-02-12T18:17:11.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.073+0000 7fbc0f7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:17:11.094 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.073+0000 7fbc0f7fe640 10 monclient: dump: 2026-02-12T18:17:11.094 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:11.094 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:11.094 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:11.094 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:11.095 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:11.095 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:11.095 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:11.095 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:11.095 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:11.095 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:11.095 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:11.095 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:11.095 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:11.095 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:11.095 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:11.095 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:11.095 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.073+0000 7fbc3550c640 10 monclient: _renew_subs 2026-02-12T18:17:11.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.073+0000 7fbc3550c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:17:11.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.073+0000 7fbc3550c640 1 -- 10.20.193.48:0/539319373 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc3005bc70 con 0x7fbc30141e90 2026-02-12T18:17:11.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.073+0000 7fbc3550c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:11.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.073+0000 7fbc3550c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:11.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.073+0000 7fbc3550c640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:17:11.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.073+0000 7fbc3550c640 1 -- 10.20.193.48:0/539319373 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc3008ba40 con 0x7fbc30141e90 2026-02-12T18:17:11.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.073+0000 7fbc0f7fe640 1 -- 10.20.193.48:0/539319373 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fbc20036c50 con 0x7fbc30141e90 2026-02-12T18:17:11.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.073+0000 7fbc0f7fe640 1 --2- 10.20.193.48:0/539319373 >> v2:10.20.193.111:6812/977811348 conn(0x7fbbfc03f720 0x7fbbfc05fbd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:11.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.074+0000 7fbc0f7fe640 1 -- 10.20.193.48:0/539319373 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7fbc20078fc0 con 0x7fbc30141e90 2026-02-12T18:17:11.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.074+0000 7fbc2effd640 1 --2- 10.20.193.48:0/539319373 >> v2:10.20.193.111:6812/977811348 conn(0x7fbbfc03f720 0x7fbbfc05fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:11.096 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.074+0000 7fbc2effd640 10 monclient: get_auth_request con 0x7fbbfc03f720 auth_method 0 2026-02-12T18:17:11.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.076+0000 7fbc0f7fe640 1 -- 10.20.193.48:0/539319373 <== mon.8 v2:10.20.193.48:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fbc20040be0 con 0x7fbc30141e90 2026-02-12T18:17:11.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.076+0000 7fbc0f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:11.097 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.076+0000 7fbc0f7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:17:11.098 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.076+0000 7fbc2effd640 1 --2- 10.20.193.48:0/539319373 >> v2:10.20.193.111:6812/977811348 conn(0x7fbbfc03f720 0x7fbbfc05fbd0 secure :-1 s=READY pgs=485 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc24004740 tx=0x7fbc24008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:11.178 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.177+0000 7fbc3550c640 1 -- 10.20.193.48:0/539319373 --> v2:10.20.193.111:6812/977811348 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbc3008cb60 con 0x7fbbfc03f720 2026-02-12T18:17:11.179 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.177+0000 7fbc0f7fe640 1 -- 10.20.193.48:0/539319373 <== mgr.4123 v2:10.20.193.111:6812/977811348 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33979 (secure 0 0 0) 0x7fbc240119e0 con 0x7fbbfc03f720 2026-02-12T18:17:11.179 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:17:11.181 INFO:teuthology.orchestra.run.trial048.stderr:dumped all 2026-02-12T18:17:11.181 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.179+0000 7fbc3550c640 1 -- 10.20.193.48:0/539319373 >> v2:10.20.193.111:6812/977811348 conn(0x7fbbfc03f720 msgr2=0x7fbbfc05fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:11.181 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.179+0000 7fbc3550c640 1 --2- 10.20.193.48:0/539319373 >> v2:10.20.193.111:6812/977811348 conn(0x7fbbfc03f720 0x7fbbfc05fbd0 secure :-1 s=READY pgs=485 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc24004740 tx=0x7fbc24008040 comp rx=0 tx=0).stop 2026-02-12T18:17:11.181 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.179+0000 7fbc3550c640 10 monclient: shutdown 2026-02-12T18:17:11.181 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.179+0000 7fbc3550c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:11.181 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.179+0000 7fbc3550c640 1 -- 10.20.193.48:0/539319373 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbc30141e90 msgr2=0x7fbc3008aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:11.181 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.179+0000 7fbc3550c640 1 --2- 10.20.193.48:0/539319373 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbc30141e90 0x7fbc3008aff0 secure :-1 s=READY pgs=200 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fbc2000a900 tx=0x7fbc20005850 comp rx=0 tx=0).stop 2026-02-12T18:17:11.181 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.179+0000 7fbc3550c640 1 -- 10.20.193.48:0/539319373 shutdown_connections 2026-02-12T18:17:11.181 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.179+0000 7fbc3550c640 1 --2- 10.20.193.48:0/539319373 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fbc30141e90 0x7fbc3008aff0 unknown :-1 s=CLOSED pgs=200 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:11.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.179+0000 7fbc3550c640 1 --2- 10.20.193.48:0/539319373 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fbc3013e990 0x7fbc3008aab0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:11.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.179+0000 7fbc3550c640 1 --2- 10.20.193.48:0/539319373 >> v2:10.20.193.111:6812/977811348 conn(0x7fbbfc03f720 0x7fbbfc05fbd0 unknown :-1 s=CLOSED pgs=485 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:11.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.179+0000 7fbc3550c640 1 --2- 10.20.193.48:0/539319373 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fbc30093ac0 0x7fbc3008a570 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:11.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.179+0000 7fbc3550c640 1 -- 10.20.193.48:0/539319373 >> 10.20.193.48:0/539319373 conn(0x7fbc30054b30 msgr2=0x7fbc3013d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:11.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.179+0000 7fbc3550c640 1 -- 10.20.193.48:0/539319373 shutdown_connections 2026-02-12T18:17:11.182 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.179+0000 7fbc3550c640 1 -- 10.20.193.48:0/539319373 wait complete. 2026-02-12T18:17:11.188 INFO:teuthology.orchestra.run.trial048.stdout:{"pg_ready":true,"pg_map":{"version":652,"stamp":"2026-02-12T18:17:10.452403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":170512,"kb_used_data":8752,"kb_used_omap":1305,"kb_used_meta":160358,"kb_avail":566060528,"statfs":{"total":579820584960,"available":579645980672,"internally_reserved":0,"allocated":8962048,"data_stored":4077262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1336948,"internal_metadata":164206988},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001028"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":628,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480584+0000","last_change":"2026-02-12T18:06:11.383740+0000","last_active":"2026-02-12T18:15:20.480584+0000","last_peered":"2026-02-12T18:15:20.480584+0000","last_clean":"2026-02-12T18:15:20.480584+0000","last_became_active":"2026-02-12T18:06:09.281532+0000","last_became_peered":"2026-02-12T18:06:09.281532+0000","last_unstale":"2026-02-12T18:15:20.480584+0000","last_undegraded":"2026-02-12T18:15:20.480584+0000","last_fullsized":"2026-02-12T18:15:20.480584+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T20:34:57.876774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027561099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":627,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480512+0000","last_change":"2026-02-12T18:06:11.384892+0000","last_active":"2026-02-12T18:15:20.480512+0000","last_peered":"2026-02-12T18:15:20.480512+0000","last_clean":"2026-02-12T18:15:20.480512+0000","last_became_active":"2026-02-12T18:06:09.283689+0000","last_became_peered":"2026-02-12T18:06:09.283689+0000","last_unstale":"2026-02-12T18:15:20.480512+0000","last_undegraded":"2026-02-12T18:15:20.480512+0000","last_fullsized":"2026-02-12T18:15:20.480512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T00:04:55.700663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046734100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":628,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480580+0000","last_change":"2026-02-12T18:06:11.383662+0000","last_active":"2026-02-12T18:15:20.480580+0000","last_peered":"2026-02-12T18:15:20.480580+0000","last_clean":"2026-02-12T18:15:20.480580+0000","last_became_active":"2026-02-12T18:06:09.281461+0000","last_became_peered":"2026-02-12T18:06:09.281461+0000","last_unstale":"2026-02-12T18:15:20.480580+0000","last_undegraded":"2026-02-12T18:15:20.480580+0000","last_fullsized":"2026-02-12T18:15:20.480580+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T21:13:23.141921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00019704400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":627,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480493+0000","last_change":"2026-02-12T18:06:11.384936+0000","last_active":"2026-02-12T18:15:20.480493+0000","last_peered":"2026-02-12T18:15:20.480493+0000","last_clean":"2026-02-12T18:15:20.480493+0000","last_became_active":"2026-02-12T18:06:09.283688+0000","last_became_peered":"2026-02-12T18:06:09.283688+0000","last_unstale":"2026-02-12T18:15:20.480493+0000","last_undegraded":"2026-02-12T18:15:20.480493+0000","last_fullsized":"2026-02-12T18:15:20.480493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:54:04.914482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047092800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":629,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480486+0000","last_change":"2026-02-12T18:06:11.387479+0000","last_active":"2026-02-12T18:15:20.480486+0000","last_peered":"2026-02-12T18:15:20.480486+0000","last_clean":"2026-02-12T18:15:20.480486+0000","last_became_active":"2026-02-12T18:06:09.283881+0000","last_became_peered":"2026-02-12T18:06:09.283881+0000","last_unstale":"2026-02-12T18:15:20.480486+0000","last_undegraded":"2026-02-12T18:15:20.480486+0000","last_fullsized":"2026-02-12T18:15:20.480486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:14:28.203244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045409299999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":633,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480327+0000","last_change":"2026-02-12T18:06:11.384057+0000","last_active":"2026-02-12T18:15:20.480327+0000","last_peered":"2026-02-12T18:15:20.480327+0000","last_clean":"2026-02-12T18:15:20.480327+0000","last_became_active":"2026-02-12T18:06:09.284036+0000","last_became_peered":"2026-02-12T18:06:09.284036+0000","last_unstale":"2026-02-12T18:15:20.480327+0000","last_undegraded":"2026-02-12T18:15:20.480327+0000","last_fullsized":"2026-02-12T18:15:20.480327+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:15:47.166182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028640700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":628,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480529+0000","last_change":"2026-02-12T18:06:11.383648+0000","last_active":"2026-02-12T18:15:20.480529+0000","last_peered":"2026-02-12T18:15:20.480529+0000","last_clean":"2026-02-12T18:15:20.480529+0000","last_became_active":"2026-02-12T18:06:09.283797+0000","last_became_peered":"2026-02-12T18:06:09.283797+0000","last_unstale":"2026-02-12T18:15:20.480529+0000","last_undegraded":"2026-02-12T18:15:20.480529+0000","last_fullsized":"2026-02-12T18:15:20.480529+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:51:24.172618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018461199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":628,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480477+0000","last_change":"2026-02-12T18:06:11.387248+0000","last_active":"2026-02-12T18:15:20.480477+0000","last_peered":"2026-02-12T18:15:20.480477+0000","last_clean":"2026-02-12T18:15:20.480477+0000","last_became_active":"2026-02-12T18:06:09.287509+0000","last_became_peered":"2026-02-12T18:06:09.287509+0000","last_unstale":"2026-02-12T18:15:20.480477+0000","last_undegraded":"2026-02-12T18:15:20.480477+0000","last_fullsized":"2026-02-12T18:15:20.480477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:54:10.505834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020961600000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"13'112","reported_seq":765,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480549+0000","last_change":"2026-02-12T18:06:04.371853+0000","last_active":"2026-02-12T18:15:20.480549+0000","last_peered":"2026-02-12T18:15:20.480549+0000","last_clean":"2026-02-12T18:15:20.480549+0000","last_became_active":"2026-02-12T18:06:04.371628+0000","last_became_peered":"2026-02-12T18:06:04.371628+0000","last_unstale":"2026-02-12T18:15:20.480549+0000","last_undegraded":"2026-02-12T18:15:20.480549+0000","last_fullsized":"2026-02-12T18:15:20.480549+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:02.768915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:02.768915+0000","last_clean_scrub_stamp":"2026-02-12T18:06:02.768915+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:16:28.244842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":12,"seq":51539607688,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28804,"kb_used_data":1844,"kb_used_omap":219,"kb_used_meta":26724,"kb_avail":94343036,"statfs":{"total":96636764160,"available":96607268864,"internally_reserved":0,"allocated":1888256,"data_stored":1073116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224993,"internal_metadata":27365663},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640393,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1268,"kb_used_omap":219,"kb_used_meta":26724,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1298432,"data_stored":482767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224995,"internal_metadata":27365661},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640392,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28224,"kb_used_data":1264,"kb_used_omap":217,"kb_used_meta":26726,"kb_avail":94343616,"statfs":{"total":96636764160,"available":96607862784,"internally_reserved":0,"allocated":1294336,"data_stored":482748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":222391,"internal_metadata":27368265},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640394,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28224,"kb_used_data":1264,"kb_used_omap":223,"kb_used_meta":26720,"kb_avail":94343616,"statfs":{"total":96636764160,"available":96607862784,"internally_reserved":0,"allocated":1294336,"data_stored":482748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":228901,"internal_metadata":27361755},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640392,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1268,"kb_used_omap":219,"kb_used_meta":26724,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1298432,"data_stored":482767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224995,"internal_metadata":27365661},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640392,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28804,"kb_used_data":1844,"kb_used_omap":205,"kb_used_meta":26738,"kb_avail":94343036,"statfs":{"total":96636764160,"available":96607268864,"internally_reserved":0,"allocated":1888256,"data_stored":1073116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":210673,"internal_metadata":27379983},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T18:17:11.190 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2026-02-12T18:17:11.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.254+0000 7fd6d874c640 10 monclient: get_monmap_and_config 2026-02-12T18:17:11.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.254+0000 7fd6d874c640 10 monclient: build_initial_monmap 2026-02-12T18:17:11.256 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.254+0000 7fd6d874c640 10 monclient: monmap: 2026-02-12T18:17:11.256 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:11.256 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:11.256 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:11.255807+0000 2026-02-12T18:17:11.256 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:11.255807+0000 2026-02-12T18:17:11.256 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:11.257 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:11.257 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:11.257 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:11.257 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:11.257 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:11.257 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:11.257 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:11.257 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:11.257 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:11.257 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:11.257 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:11.257 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:11.258 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:11.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d874c640 1 Processor -- start 2026-02-12T18:17:11.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d874c640 1 -- start start 2026-02-12T18:17:11.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d874c640 10 monclient: init 2026-02-12T18:17:11.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d874c640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:11.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d874c640 10 monclient: _add_conns ranks=[6,5,1,3,7,9,4,2,8,0,10] 2026-02-12T18:17:11.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d874c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd6d008a570 0x7fd6d008cdc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:11.267 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d874c640 10 monclient(hunting): picked mon.noname-d con 0x7fd6d008a570 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:17:11.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d874c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd6d008d300 0x7fd6d008a940 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:11.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d874c640 10 monclient(hunting): picked mon.noname-h con 0x7fd6d008d300 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:17:11.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d874c640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fd6d008ae80 addr v1:10.20.193.111:6789/0 2026-02-12T18:17:11.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d874c640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6d0060390 con 0x7fd6d008ae80 2026-02-12T18:17:11.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d874c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:11.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d874c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fd6d0093ac0 con 0x7fd6d008d300 2026-02-12T18:17:11.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d874c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:11.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d874c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fd6d008c450 con 0x7fd6d008a570 2026-02-12T18:17:11.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d874c640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:11.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d874c640 10 monclient(hunting): authenticate will time out at 1269.981570s 2026-02-12T18:17:11.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d64c1640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd6d008a570 0x7fd6d008cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:11.268 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d64c1640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd6d008a570 0x7fd6d008cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:51822/0 (socket says 10.20.193.48:51822) 2026-02-12T18:17:11.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d64c1640 1 -- 10.20.193.48:0/3941683891 learned_addr learned my addr 10.20.193.48:0/3941683891 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:11.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d64c1640 10 monclient(hunting): get_auth_request con 0x7fd6d008a570 auth_method 0 2026-02-12T18:17:11.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d64c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:11.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d64c1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:11.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d64c1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:11.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d64c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:11.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d64c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:11.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d64c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:11.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d5cc0640 1 --2- 10.20.193.48:0/3941683891 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd6d008d300 0x7fd6d008a940 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:11.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d5cc0640 10 monclient(hunting): get_auth_request con 0x7fd6d008d300 auth_method 0 2026-02-12T18:17:11.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d5cc0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:11.269 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d5cc0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:11.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d5cc0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:11.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d64c1640 10 monclient(hunting): handle_auth_done global_id 114198 payload 274 2026-02-12T18:17:11.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d64c1640 1 -- 10.20.193.48:0/3941683891 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd6d008d300 msgr2=0x7fd6d008a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:11.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d64c1640 1 --2- 10.20.193.48:0/3941683891 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd6d008d300 0x7fd6d008a940 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:11.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d64c1640 1 -- 10.20.193.48:0/3941683891 >> v1:10.20.193.111:6789/0 conn(0x7fd6d008ae80 legacy=0x7fd6d013d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:11.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d64c1640 10 monclient: _finish_hunting 0 2026-02-12T18:17:11.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d64c1640 1 monclient: found mon.noname-d 2026-02-12T18:17:11.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d64c1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:11.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d64c1640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:17:11.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.255+0000 7fd6d64c1640 1 -- 10.20.193.48:0/3941683891 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d008c6c0 con 0x7fd6d008a570 2026-02-12T18:17:11.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.258+0000 7fd6d64c1640 1 -- 10.20.193.48:0/3941683891 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd6d008a570 msgr2=0x7fd6d008cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:11.270 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.258+0000 7fd6d64c1640 1 --2- 10.20.193.48:0/3941683891 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd6d008a570 0x7fd6d008cdc0 secure :-1 s=READY pgs=27 gs=2 cs=0 l=1 c_cookie=7900235449580069673 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6c00098d0 tx=0x7fd6c002ee20 comp rx=0 tx=0).ready entity=mon.6 client_cookie=6da34648be2b2329 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:11.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.258+0000 7fd6d54bf640 1 -- 10.20.193.48:0/3941683891 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd6c0035340 con 0x7fd6d008a570 2026-02-12T18:17:11.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.258+0000 7fd6d54bf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:11.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.258+0000 7fd6d54bf640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:17:11.271 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.258+0000 7fd6d54bf640 10 monclient: dump: 2026-02-12T18:17:11.271 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:11.271 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:11.271 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:11.271 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:11.271 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:11.271 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:11.271 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:11.271 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:11.272 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:11.272 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:11.272 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:11.272 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:11.272 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:11.272 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:11.272 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:11.272 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:11.272 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.258+0000 7fd6d54bf640 10 monclient: _finish_auth 0 2026-02-12T18:17:11.272 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.258+0000 7fd6d54bf640 10 monclient: _check_auth_tickets 2026-02-12T18:17:11.272 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.258+0000 7fd6d54bf640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:11.272 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.258+0000 7fd6d874c640 5 monclient: authenticate success, global_id 114198 2026-02-12T18:17:11.272 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.258+0000 7fd6d874c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:17:11.273 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.258+0000 7fd6d54bf640 1 -- 10.20.193.48:0/3941683891 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6c00354c0 con 0x7fd6d008a570 2026-02-12T18:17:11.273 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.258+0000 7fd6d54bf640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:11.273 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.258+0000 7fd6d54bf640 1 -- 10.20.193.48:0/3941683891 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd6c0035af0 con 0x7fd6d008a570 2026-02-12T18:17:11.273 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.258+0000 7fd6d874c640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:11.273 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.258+0000 7fd6d54bf640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:11.273 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.258+0000 7fd6d874c640 4 set_mon_vals no callback set 2026-02-12T18:17:11.273 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.258+0000 7fd6d54bf640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:17:11.273 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.258+0000 7fd6d54bf640 10 monclient: dump: 2026-02-12T18:17:11.273 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:11.273 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:11.273 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:11.274 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:11.274 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:11.274 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:11.274 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:11.274 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:11.274 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:11.274 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:11.274 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:11.274 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:11.274 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:11.274 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:11.274 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:11.275 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:11.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.258+0000 7fd6d874c640 10 monclient: shutdown 2026-02-12T18:17:11.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.258+0000 7fd6d874c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:11.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.258+0000 7fd6d874c640 1 -- 10.20.193.48:0/3941683891 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd6d008a570 msgr2=0x7fd6d008cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:11.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.258+0000 7fd6d874c640 1 --2- 10.20.193.48:0/3941683891 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd6d008a570 0x7fd6d008cdc0 secure :-1 s=READY pgs=27 gs=2 cs=0 l=1 c_cookie=7900235449580069673 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6c00098d0 tx=0x7fd6c002ee20 comp rx=0 tx=0).stop 2026-02-12T18:17:11.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.258+0000 7fd6d874c640 1 -- 10.20.193.48:0/3941683891 shutdown_connections 2026-02-12T18:17:11.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.258+0000 7fd6d874c640 1 --2- 10.20.193.48:0/3941683891 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fd6d008d300 0x7fd6d008a940 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:11.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.258+0000 7fd6d874c640 1 --2- 10.20.193.48:0/3941683891 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd6d008a570 0x7fd6d008cdc0 unknown :-1 s=CLOSED pgs=27 gs=2 cs=0 l=1 c_cookie=7900235449580069673 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:11.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.259+0000 7fd6d874c640 1 -- 10.20.193.48:0/3941683891 >> 10.20.193.48:0/3941683891 conn(0x7fd6d0054b30 msgr2=0x7fd6d0093070 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:11.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.259+0000 7fd6d874c640 1 -- 10.20.193.48:0/3941683891 shutdown_connections 2026-02-12T18:17:11.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.259+0000 7fd6d874c640 1 -- 10.20.193.48:0/3941683891 wait complete. 2026-02-12T18:17:11.275 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.259+0000 7fd6d874c640 10 monclient: build_initial_monmap 2026-02-12T18:17:11.276 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.259+0000 7fd6d874c640 10 monclient: monmap: 2026-02-12T18:17:11.276 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:11.276 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:11.276 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:11.276 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:11.276 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:11.276 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:11.276 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:11.276 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:11.276 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:11.276 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:11.276 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:11.276 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:11.277 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:11.277 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:11.277 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:11.277 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:11.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.259+0000 7fd6d874c640 1 Processor -- start 2026-02-12T18:17:11.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.259+0000 7fd6d874c640 1 -- start start 2026-02-12T18:17:11.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.259+0000 7fd6d874c640 10 monclient: init 2026-02-12T18:17:11.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d874c640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:11.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d874c640 10 monclient: _add_conns ranks=[0,4,6,8,3,7,5,1,2] 2026-02-12T18:17:11.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d874c640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd6d008a570 0x7fd6d013d6d0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:11.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d874c640 10 monclient(hunting): picked mon.noname-a con 0x7fd6d008a570 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:17:11.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d874c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd6d008ae80 0x7fd6d008e320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:11.277 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d874c640 10 monclient(hunting): picked mon.noname-c con 0x7fd6d008ae80 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:17:11.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d874c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd6d008d300 0x7fd6d008e860 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:11.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d874c640 10 monclient(hunting): picked mon.noname-d con 0x7fd6d008d300 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:17:11.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d874c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:11.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d874c640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d011e810 con 0x7fd6d008a570 2026-02-12T18:17:11.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d874c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:11.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d874c640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fd6d0093190 con 0x7fd6d008ae80 2026-02-12T18:17:11.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d874c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:11.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d874c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fd6d011c070 con 0x7fd6d008d300 2026-02-12T18:17:11.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d874c640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:11.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d874c640 10 monclient(hunting): authenticate will time out at 1269.986240s 2026-02-12T18:17:11.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d64c1640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd6d008a570 0x7fd6d013d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:11.278 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d64c1640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd6d008a570 0x7fd6d013d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:54998/0 (socket says 10.20.193.48:54998) 2026-02-12T18:17:11.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d5cc0640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd6d008ae80 0x7fd6d008e320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:11.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d64c1640 1 -- 10.20.193.48:0/248995148 learned_addr learned my addr 10.20.193.48:0/248995148 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:11.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d64c1640 10 monclient(hunting): get_auth_request con 0x7fd6d008a570 auth_method 0 2026-02-12T18:17:11.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d6cc2640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd6d008d300 0x7fd6d008e860 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:11.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d64c1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:11.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d64c1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:11.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d64c1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:11.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d5cc0640 10 monclient(hunting): get_auth_request con 0x7fd6d008ae80 auth_method 0 2026-02-12T18:17:11.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d5cc0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:11.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d5cc0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:11.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d5cc0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:11.279 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d6cc2640 10 monclient(hunting): get_auth_request con 0x7fd6d008d300 auth_method 0 2026-02-12T18:17:11.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d6cc2640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:11.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d6cc2640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:11.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d6cc2640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:11.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d64c1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:11.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d64c1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:11.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d64c1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:11.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d5cc0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:11.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d5cc0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:11.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d5cc0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:11.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d6cc2640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:11.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d6cc2640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:11.280 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d6cc2640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:11.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d64c1640 10 monclient(hunting): handle_auth_done global_id 7128 payload 824 2026-02-12T18:17:11.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d64c1640 1 -- 10.20.193.48:0/248995148 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd6d008d300 msgr2=0x7fd6d008e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:11.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d64c1640 1 --2- 10.20.193.48:0/248995148 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd6d008d300 0x7fd6d008e860 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:11.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d64c1640 1 -- 10.20.193.48:0/248995148 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd6d008ae80 msgr2=0x7fd6d008e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:11.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d64c1640 1 --2- 10.20.193.48:0/248995148 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd6d008ae80 0x7fd6d008e320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:11.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d64c1640 10 monclient: _finish_hunting 0 2026-02-12T18:17:11.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d64c1640 1 monclient: found mon.noname-a 2026-02-12T18:17:11.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d64c1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:11.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d64c1640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:17:11.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.260+0000 7fd6d64c1640 1 -- 10.20.193.48:0/248995148 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6c00094f0 con 0x7fd6d008a570 2026-02-12T18:17:11.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.262+0000 7fd6d64c1640 1 -- 10.20.193.48:0/248995148 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd6d008a570 msgr2=0x7fd6d013d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:11.281 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.262+0000 7fd6d64c1640 1 --2- 10.20.193.48:0/248995148 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd6d008a570 0x7fd6d013d6d0 secure :-1 s=READY pgs=736 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6c00099d0 tx=0x7fd6c00047e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:11.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.262+0000 7fd6b6ffd640 1 -- 10.20.193.48:0/248995148 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd6c0035e70 con 0x7fd6d008a570 2026-02-12T18:17:11.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.262+0000 7fd6b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:11.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.262+0000 7fd6b6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:17:11.282 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.262+0000 7fd6b6ffd640 10 monclient: dump: 2026-02-12T18:17:11.282 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:11.282 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:11.282 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:11.282 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:11.282 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:11.282 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:11.282 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:11.282 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:11.282 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:11.283 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:11.283 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:11.283 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:11.283 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:11.283 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:11.283 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:11.283 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:11.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.262+0000 7fd6b6ffd640 10 monclient: _finish_auth 0 2026-02-12T18:17:11.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.262+0000 7fd6b6ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:17:11.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.262+0000 7fd6b6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:11.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.262+0000 7fd6b6ffd640 1 -- 10.20.193.48:0/248995148 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6c00044f0 con 0x7fd6d008a570 2026-02-12T18:17:11.283 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.262+0000 7fd6b6ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:11.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.262+0000 7fd6b6ffd640 1 -- 10.20.193.48:0/248995148 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fd6c0003b90 con 0x7fd6d008a570 2026-02-12T18:17:11.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.262+0000 7fd6d874c640 5 monclient: authenticate success, global_id 7128 2026-02-12T18:17:11.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.262+0000 7fd6d874c640 10 monclient: _renew_subs 2026-02-12T18:17:11.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.262+0000 7fd6d4cbe640 4 set_mon_vals no callback set 2026-02-12T18:17:11.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.262+0000 7fd6d874c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:11.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.262+0000 7fd6d874c640 1 -- 10.20.193.48:0/248995148 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6d005b800 con 0x7fd6d008a570 2026-02-12T18:17:11.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.262+0000 7fd6b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:11.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.263+0000 7fd6b6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:17:11.284 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.263+0000 7fd6b6ffd640 10 monclient: dump: 2026-02-12T18:17:11.284 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:11.284 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:11.284 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:11.285 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:11.285 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:11.285 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:11.285 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:11.285 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:11.285 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:11.285 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:11.285 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:11.285 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:11.285 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:11.285 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:11.285 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:11.285 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:11.286 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.263+0000 7fd6d874c640 10 monclient: _renew_subs 2026-02-12T18:17:11.286 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.263+0000 7fd6d874c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:11.286 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.263+0000 7fd6d874c640 1 -- 10.20.193.48:0/248995148 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d0059f20 con 0x7fd6d008a570 2026-02-12T18:17:11.286 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.263+0000 7fd6d874c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:11.286 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.263+0000 7fd6d874c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:11.286 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.263+0000 7fd6d874c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:11.286 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.263+0000 7fd6d874c640 1 -- 10.20.193.48:0/248995148 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6d008a940 con 0x7fd6d008a570 2026-02-12T18:17:11.286 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.263+0000 7fd6b6ffd640 1 -- 10.20.193.48:0/248995148 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fd6c004a070 con 0x7fd6d008a570 2026-02-12T18:17:11.286 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.263+0000 7fd6b6ffd640 1 --2- 10.20.193.48:0/248995148 >> v2:10.20.193.111:6812/977811348 conn(0x7fd6a003f7f0 0x7fd6a005fca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:11.286 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.263+0000 7fd6b6ffd640 1 -- 10.20.193.48:0/248995148 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7fd6c0078340 con 0x7fd6d008a570 2026-02-12T18:17:11.286 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.264+0000 7fd6d5cc0640 1 --2- 10.20.193.48:0/248995148 >> v2:10.20.193.111:6812/977811348 conn(0x7fd6a003f7f0 0x7fd6a005fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:11.286 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.264+0000 7fd6d5cc0640 10 monclient: get_auth_request con 0x7fd6a003f7f0 auth_method 0 2026-02-12T18:17:11.287 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.266+0000 7fd6b6ffd640 1 -- 10.20.193.48:0/248995148 <== mon.0 v2:10.20.193.48:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fd6c0043450 con 0x7fd6d008a570 2026-02-12T18:17:11.287 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.266+0000 7fd6b6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:11.287 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.266+0000 7fd6b6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:17:11.287 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.266+0000 7fd6d5cc0640 1 --2- 10.20.193.48:0/248995148 >> v2:10.20.193.111:6812/977811348 conn(0x7fd6a003f7f0 0x7fd6a005fca0 secure :-1 s=READY pgs=486 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6d008f360 tx=0x7fd6c4008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:11.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.370+0000 7fd6d874c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2026-02-12T18:17:11.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.370+0000 7fd6d874c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T18:17:11.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.370+0000 7fd6d874c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:11.372 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.370+0000 7fd6d874c640 1 -- 10.20.193.48:0/248995148 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd6d008a940 con 0x7fd6d008a570 2026-02-12T18:17:11.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.371+0000 7fd6b6ffd640 1 -- 10.20.193.48:0/248995148 <== mon.0 v2:10.20.193.48:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v322) ==== 74+0+10918 (secure 0 0 0) 0x7fd6c003c030 con 0x7fd6d008a570 2026-02-12T18:17:11.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.371+0000 7fd6b6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2026-02-12T18:17:11.373 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.371+0000 7fd6b6ffd640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:17:11.373 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:17:11.373 INFO:teuthology.orchestra.run.trial048.stdout:{"epoch":322,"fsid":"ff8a9ee7-9c95-4c71-86fa-da746f82dc18","created":"2026-02-12T18:05:56.090643+0000","modified":"2026-02-12T18:15:20.230362+0000","last_up_change":"2026-02-12T18:06:02.768915+0000","last_in_change":"2026-02-12T18:05:57.981781+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":100,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"tentacle","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2026-02-12T18:06:02.611941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2026-02-12T18:06:07.373478+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":18,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"nonprimary_shards":"{}","options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a8255145-baf3-4c84-9a14-58a24c915493","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":319,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6801","nonce":447356640}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6803","nonce":447356640}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6807","nonce":447356640}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6806","nonce":447356640}]},"public_addr":"10.20.193.48:6801/447356640","cluster_addr":"10.20.193.48:6803/447356640","heartbeat_back_addr":"10.20.193.48:6807/447356640","heartbeat_front_addr":"10.20.193.48:6806/447356640","state":["exists","up"]},{"osd":1,"uuid":"4cf3730c-446c-4c4f-baf9-b354e06bf2b9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":319,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6808","nonce":3694032686}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6809","nonce":3694032686}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6811","nonce":3694032686}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6810","nonce":3694032686}]},"public_addr":"10.20.193.48:6808/3694032686","cluster_addr":"10.20.193.48:6809/3694032686","heartbeat_back_addr":"10.20.193.48:6811/3694032686","heartbeat_front_addr":"10.20.193.48:6810/3694032686","state":["exists","up"]},{"osd":2,"uuid":"4ca2a3bb-4801-48eb-9814-12473a6c12bc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":319,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6800","nonce":2690693575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6802","nonce":2690693575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6805","nonce":2690693575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.48:6804","nonce":2690693575}]},"public_addr":"10.20.193.48:6800/2690693575","cluster_addr":"10.20.193.48:6802/2690693575","heartbeat_back_addr":"10.20.193.48:6805/2690693575","heartbeat_front_addr":"10.20.193.48:6804/2690693575","state":["exists","up"]},{"osd":3,"uuid":"e64b1a76-9d2c-4c4a-bd2d-7b5b8c1df21e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":12,"up_thru":319,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6800","nonce":449363714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6801","nonce":449363714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6803","nonce":449363714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6802","nonce":449363714}]},"public_addr":"10.20.193.111:6800/449363714","cluster_addr":"10.20.193.111:6801/449363714","heartbeat_back_addr":"10.20.193.111:6803/449363714","heartbeat_front_addr":"10.20.193.111:6802/449363714","state":["exists","up"]},{"osd":4,"uuid":"ad82216b-0e68-44da-a293-d4c97dec6b79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":319,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6808","nonce":3554486394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6809","nonce":3554486394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6811","nonce":3554486394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6810","nonce":3554486394}]},"public_addr":"10.20.193.111:6808/3554486394","cluster_addr":"10.20.193.111:6809/3554486394","heartbeat_back_addr":"10.20.193.111:6811/3554486394","heartbeat_front_addr":"10.20.193.111:6810/3554486394","state":["exists","up"]},{"osd":5,"uuid":"accc3f03-6123-444b-8c5a-42e927b0ed23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":319,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6804","nonce":1701961573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6805","nonce":1701961573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6807","nonce":1701961573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"10.20.193.111:6806","nonce":1701961573}]},"public_addr":"10.20.193.111:6804/1701961573","cluster_addr":"10.20.193.111:6805/1701961573","heartbeat_back_addr":"10.20.193.111:6807/1701961573","heartbeat_front_addr":"10.20.193.111:6806/1701961573","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T18:05:59.805170+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T18:05:59.787798+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T18:05:59.791881+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T18:05:59.782438+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T18:05:59.832151+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4544132024016699391,"old_weight":0,"last_purged_snaps_scrub":"2026-02-12T18:05:59.762488+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"isa","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2026-02-12T18:17:11.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.372+0000 7fd6d874c640 1 -- 10.20.193.48:0/248995148 >> v2:10.20.193.111:6812/977811348 conn(0x7fd6a003f7f0 msgr2=0x7fd6a005fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:11.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.372+0000 7fd6d874c640 1 --2- 10.20.193.48:0/248995148 >> v2:10.20.193.111:6812/977811348 conn(0x7fd6a003f7f0 0x7fd6a005fca0 secure :-1 s=READY pgs=486 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6d008f360 tx=0x7fd6c4008040 comp rx=0 tx=0).stop 2026-02-12T18:17:11.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.372+0000 7fd6d874c640 10 monclient: shutdown 2026-02-12T18:17:11.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.372+0000 7fd6d874c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:11.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.372+0000 7fd6d874c640 1 -- 10.20.193.48:0/248995148 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd6d008a570 msgr2=0x7fd6d013d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:11.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.372+0000 7fd6d874c640 1 --2- 10.20.193.48:0/248995148 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd6d008a570 0x7fd6d013d6d0 secure :-1 s=READY pgs=736 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fd6c00099d0 tx=0x7fd6c00047e0 comp rx=0 tx=0).stop 2026-02-12T18:17:11.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.372+0000 7fd6d874c640 1 -- 10.20.193.48:0/248995148 shutdown_connections 2026-02-12T18:17:11.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.372+0000 7fd6d874c640 1 --2- 10.20.193.48:0/248995148 >> v2:10.20.193.111:6812/977811348 conn(0x7fd6a003f7f0 0x7fd6a005fca0 unknown :-1 s=CLOSED pgs=486 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:11.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.372+0000 7fd6d874c640 1 --2- 10.20.193.48:0/248995148 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fd6d008d300 0x7fd6d008e860 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:11.375 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.372+0000 7fd6d874c640 1 --2- 10.20.193.48:0/248995148 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fd6d008ae80 0x7fd6d008e320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:11.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.372+0000 7fd6d874c640 1 --2- 10.20.193.48:0/248995148 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fd6d008a570 0x7fd6d013d6d0 unknown :-1 s=CLOSED pgs=736 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:11.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.372+0000 7fd6d874c640 1 -- 10.20.193.48:0/248995148 >> 10.20.193.48:0/248995148 conn(0x7fd6d0054b30 msgr2=0x7fd6d013e350 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:11.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.372+0000 7fd6d874c640 1 -- 10.20.193.48:0/248995148 shutdown_connections 2026-02-12T18:17:11.376 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:11.372+0000 7fd6d874c640 1 -- 10.20.193.48:0/248995148 wait complete. 2026-02-12T18:17:12.382 INFO:tasks.ceph:Scrubbing osd.0 2026-02-12T18:17:12.382 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2026-02-12T18:17:12.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.450+0000 7ff630388640 10 monclient: get_monmap_and_config 2026-02-12T18:17:12.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.450+0000 7ff630388640 10 monclient: build_initial_monmap 2026-02-12T18:17:12.451 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.450+0000 7ff630388640 10 monclient: monmap: 2026-02-12T18:17:12.451 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:12.451 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:12.451 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:12.451303+0000 2026-02-12T18:17:12.451 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:12.451303+0000 2026-02-12T18:17:12.451 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:12.451 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:12.451 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:12.451 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:12.451 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:12.451 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:12.451 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:12.451 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:12.451 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:12.451 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:12.451 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:12.451 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:12.452 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:12.452 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:12.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.450+0000 7ff630388640 1 Processor -- start 2026-02-12T18:17:12.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.450+0000 7ff630388640 1 -- start start 2026-02-12T18:17:12.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.450+0000 7ff630388640 10 monclient: init 2026-02-12T18:17:12.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.450+0000 7ff630388640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:12.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff630388640 10 monclient: _add_conns ranks=[0,1,6,5,4,7,2,8,3,9,10] 2026-02-12T18:17:12.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff630388640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7ff62805d8b0 addr v1:10.20.193.48:6789/0 2026-02-12T18:17:12.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff630388640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7ff6281423a0 addr v1:10.20.193.111:6789/0 2026-02-12T18:17:12.452 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff630388640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff628184930 0x7ff6281a4d10 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff630388640 10 monclient(hunting): picked mon.noname-d con 0x7ff628184930 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff630388640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff628060390 con 0x7ff62805d8b0 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff630388640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff62808d260 con 0x7ff6281423a0 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff630388640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff630388640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7ff62808d5a0 con 0x7ff628184930 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff630388640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff630388640 10 monclient(hunting): authenticate will time out at 1271.177093s 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff62e0fd640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7ff62805d8b0 0x7ff62805dc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:44060/0 (socket says 10.20.193.48:44060) 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff62e0fd640 1 -- 10.20.193.48:0/3777540249 learned_addr learned my addr 10.20.193.48:0/3777540249 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff62e8fe640 1 --2- 10.20.193.48:0/3777540249 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff628184930 0x7ff6281a4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff62e8fe640 10 monclient(hunting): get_auth_request con 0x7ff628184930 auth_method 0 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff62e8fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff62e8fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff62e8fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff62e8fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff62e8fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff62e8fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff62d8fc640 1 -- 10.20.193.48:0/3777540249 >> v1:10.20.193.111:6789/0 conn(0x7ff6281423a0 legacy=0x7ff628183210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 11 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff62d8fc640 1 -- 10.20.193.48:0/3777540249 >> v1:10.20.193.111:6789/0 conn(0x7ff6281423a0 legacy=0x7ff628183210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff62d8fc640 1 --1- 10.20.193.48:0/3777540249 >> v1:10.20.193.111:6789/0 conn(0x7ff6281423a0 0x7ff628183210 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 gs=2 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff62e8fe640 10 monclient(hunting): handle_auth_done global_id 114216 payload 274 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff62e8fe640 1 -- 10.20.193.48:0/3777540249 >> v1:10.20.193.111:6789/0 conn(0x7ff6281423a0 legacy=0x7ff628183210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff62e8fe640 1 -- 10.20.193.48:0/3777540249 >> v1:10.20.193.48:6789/0 conn(0x7ff62805d8b0 legacy=0x7ff62805dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff62e8fe640 10 monclient: _finish_hunting 0 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff62e8fe640 1 monclient: found mon.noname-d 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff62e8fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff62e8fe640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:17:12.453 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.451+0000 7ff62e8fe640 1 -- 10.20.193.48:0/3777540249 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff62808cde0 con 0x7ff628184930 2026-02-12T18:17:12.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.453+0000 7ff62e8fe640 1 -- 10.20.193.48:0/3777540249 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff628184930 msgr2=0x7ff6281a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:12.454 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.453+0000 7ff62e8fe640 1 --2- 10.20.193.48:0/3777540249 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff628184930 0x7ff6281a4d10 secure :-1 s=READY pgs=28 gs=3 cs=0 l=1 c_cookie=12400180093742133834 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff62400a8e0 tx=0x7ff62402fe20 comp rx=0 tx=0).ready entity=mon.6 client_cookie=ac164a18a65eb24a server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.454+0000 7ff62d0fb640 1 -- 10.20.193.48:0/3777540249 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff624030b80 con 0x7ff628184930 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.454+0000 7ff62d0fb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.454+0000 7ff62d0fb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.454+0000 7ff62d0fb640 10 monclient: dump: 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.454+0000 7ff62d0fb640 10 monclient: _finish_auth 0 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.454+0000 7ff62d0fb640 10 monclient: _check_auth_tickets 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.454+0000 7ff62d0fb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.454+0000 7ff62d0fb640 1 -- 10.20.193.48:0/3777540249 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff624030d00 con 0x7ff628184930 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.454+0000 7ff630388640 5 monclient: authenticate success, global_id 114216 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.454+0000 7ff630388640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.454+0000 7ff62d0fb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.454+0000 7ff62d0fb640 1 -- 10.20.193.48:0/3777540249 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff624030e70 con 0x7ff628184930 2026-02-12T18:17:12.455 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.454+0000 7ff62d0fb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:12.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.454+0000 7ff62d0fb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:17:12.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.454+0000 7ff62d0fb640 10 monclient: dump: 2026-02-12T18:17:12.456 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:12.456 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:12.456 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.456 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.456 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:12.456 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:12.456 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:12.456 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:12.456 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:12.456 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:12.456 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:12.456 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:12.456 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:12.456 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:12.456 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:12.456 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:12.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.454+0000 7ff630388640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:12.456 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.454+0000 7ff630388640 4 set_mon_vals no callback set 2026-02-12T18:17:12.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.454+0000 7ff630388640 10 monclient: shutdown 2026-02-12T18:17:12.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.454+0000 7ff630388640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:12.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.454+0000 7ff630388640 1 -- 10.20.193.48:0/3777540249 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff628184930 msgr2=0x7ff6281a4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:12.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.454+0000 7ff630388640 1 --2- 10.20.193.48:0/3777540249 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff628184930 0x7ff6281a4d10 secure :-1 s=READY pgs=28 gs=3 cs=0 l=1 c_cookie=12400180093742133834 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff62400a8e0 tx=0x7ff62402fe20 comp rx=0 tx=0).stop 2026-02-12T18:17:12.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.454+0000 7ff630388640 1 -- 10.20.193.48:0/3777540249 shutdown_connections 2026-02-12T18:17:12.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.454+0000 7ff630388640 1 --2- 10.20.193.48:0/3777540249 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7ff628184930 0x7ff6281a4d10 unknown :-1 s=CLOSED pgs=28 gs=3 cs=0 l=1 c_cookie=12400180093742133834 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.454+0000 7ff630388640 1 -- 10.20.193.48:0/3777540249 >> 10.20.193.48:0/3777540249 conn(0x7ff628054b60 msgr2=0x7ff628093000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:12.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.454+0000 7ff630388640 1 -- 10.20.193.48:0/3777540249 shutdown_connections 2026-02-12T18:17:12.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.454+0000 7ff630388640 1 -- 10.20.193.48:0/3777540249 wait complete. 2026-02-12T18:17:12.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff630388640 10 monclient: build_initial_monmap 2026-02-12T18:17:12.457 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff630388640 10 monclient: monmap: 2026-02-12T18:17:12.457 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:12.457 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:12.457 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:12.457 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:12.457 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:12.457 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:12.457 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff630388640 1 Processor -- start 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff630388640 1 -- start start 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff630388640 10 monclient: init 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff630388640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff630388640 10 monclient: _add_conns ranks=[2,3,7,8,6,4,1,0,5] 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff630388640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff62805d8b0 0x7ff62812ddc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff630388640 10 monclient(hunting): picked mon.noname-b con 0x7ff62805d8b0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff630388640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff6281423a0 0x7ff62812e720 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff630388640 10 monclient(hunting): picked mon.noname-g con 0x7ff6281423a0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff630388640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ff628184930 0x7ff62810a670 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff630388640 10 monclient(hunting): picked mon.noname-i con 0x7ff628184930 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff630388640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff630388640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7ff62810da60 con 0x7ff62805d8b0 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff630388640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff630388640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff62810cb00 con 0x7ff6281423a0 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff630388640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff630388640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7ff62810bfa0 con 0x7ff628184930 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff630388640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff630388640 10 monclient(hunting): authenticate will time out at 1271.181583s 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62e0fd640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff62805d8b0 0x7ff62812ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62e0fd640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff62805d8b0 0x7ff62812ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:44182/0 (socket says 10.20.193.48:44182) 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62e0fd640 1 -- 10.20.193.48:0/3470916001 learned_addr learned my addr 10.20.193.48:0/3470916001 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62e0fd640 10 monclient(hunting): get_auth_request con 0x7ff62805d8b0 auth_method 0 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62e0fd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62e0fd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62e0fd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62e0fd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62e0fd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62e0fd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62d8fc640 1 --2- 10.20.193.48:0/3470916001 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff6281423a0 0x7ff62812e720 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62d8fc640 10 monclient(hunting): get_auth_request con 0x7ff6281423a0 auth_method 0 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62d8fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62d8fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62d8fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:12.458 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62e8fe640 1 --2- 10.20.193.48:0/3470916001 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ff628184930 0x7ff62810a670 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62e8fe640 10 monclient(hunting): get_auth_request con 0x7ff628184930 auth_method 0 2026-02-12T18:17:12.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62e8fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:12.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62e8fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:12.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62e8fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:12.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62d8fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:12.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62d8fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:12.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62d8fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:12.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62e0fd640 10 monclient(hunting): handle_auth_done global_id 36713 payload 824 2026-02-12T18:17:12.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62e0fd640 1 -- 10.20.193.48:0/3470916001 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ff628184930 msgr2=0x7ff62810a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:12.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62e0fd640 1 --2- 10.20.193.48:0/3470916001 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ff628184930 0x7ff62810a670 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62e0fd640 1 -- 10.20.193.48:0/3470916001 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff6281423a0 msgr2=0x7ff62812e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:12.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62e0fd640 1 --2- 10.20.193.48:0/3470916001 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff6281423a0 0x7ff62812e720 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62e0fd640 10 monclient: _finish_hunting 0 2026-02-12T18:17:12.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62e0fd640 1 monclient: found mon.noname-b 2026-02-12T18:17:12.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62e0fd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:12.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62e0fd640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:17:12.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.455+0000 7ff62e0fd640 1 -- 10.20.193.48:0/3470916001 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff62400a500 con 0x7ff62805d8b0 2026-02-12T18:17:12.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.458+0000 7ff62e0fd640 1 -- 10.20.193.48:0/3470916001 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff62805d8b0 msgr2=0x7ff62812ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:12.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.458+0000 7ff62e0fd640 1 --2- 10.20.193.48:0/3470916001 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff62805d8b0 0x7ff62812ddc0 secure :-1 s=READY pgs=469 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff618007fd0 tx=0x7ff61800c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:12.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.458+0000 7ff60effd640 1 -- 10.20.193.48:0/3470916001 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff618005db0 con 0x7ff62805d8b0 2026-02-12T18:17:12.459 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.458+0000 7ff60effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.458+0000 7ff60effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.458+0000 7ff60effd640 10 monclient: dump: 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.458+0000 7ff60effd640 10 monclient: _finish_auth 0 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.458+0000 7ff60effd640 10 monclient: _check_auth_tickets 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.458+0000 7ff60effd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.458+0000 7ff60effd640 1 -- 10.20.193.48:0/3470916001 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff618007530 con 0x7ff62805d8b0 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.458+0000 7ff630388640 5 monclient: authenticate success, global_id 36713 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.458+0000 7ff60effd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.458+0000 7ff60effd640 1 -- 10.20.193.48:0/3470916001 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff6180076a0 con 0x7ff62805d8b0 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.458+0000 7ff60effd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.458+0000 7ff62c8fa640 4 set_mon_vals no callback set 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.458+0000 7ff60effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.458+0000 7ff60effd640 10 monclient: dump: 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:12.460 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:12.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.458+0000 7ff630388640 10 monclient: _renew_subs 2026-02-12T18:17:12.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.458+0000 7ff630388640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:17:12.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.458+0000 7ff630388640 1 -- 10.20.193.48:0/3470916001 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff62812e300 con 0x7ff62805d8b0 2026-02-12T18:17:12.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.458+0000 7ff630388640 10 monclient: _renew_subs 2026-02-12T18:17:12.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.458+0000 7ff630388640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:17:12.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.458+0000 7ff630388640 1 -- 10.20.193.48:0/3470916001 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff628140ca0 con 0x7ff62805d8b0 2026-02-12T18:17:12.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.458+0000 7ff630388640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:17:12.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.458+0000 7ff630388640 1 -- 10.20.193.48:0/3470916001 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff6281427b0 con 0x7ff62805d8b0 2026-02-12T18:17:12.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.459+0000 7ff60effd640 1 -- 10.20.193.48:0/3470916001 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7ff618007070 con 0x7ff62805d8b0 2026-02-12T18:17:12.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.459+0000 7ff60effd640 1 --2- 10.20.193.48:0/3470916001 >> v2:10.20.193.111:6812/977811348 conn(0x7ff5f803f800 0x7ff5f805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.459+0000 7ff60effd640 1 -- 10.20.193.48:0/3470916001 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7ff618051ef0 con 0x7ff62805d8b0 2026-02-12T18:17:12.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.459+0000 7ff60effd640 1 --2- 10.20.193.48:0/3470916001 >> v2:10.20.193.48:6801/447356640 conn(0x7ff5f8063340 0x7ff5f8083750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.459+0000 7ff60effd640 1 -- 10.20.193.48:0/3470916001 --> v2:10.20.193.48:6801/447356640 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff5f8083dc0 con 0x7ff5f8063340 2026-02-12T18:17:12.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.459+0000 7ff60effd640 1 -- 10.20.193.48:0/3470916001 <== mon.2 v2:10.20.193.48:3301/0 6 ==== mon_get_version_reply(handle=1 version=322) ==== 24+0+0 (secure 0 0 0) 0x7ff618054480 con 0x7ff62805d8b0 2026-02-12T18:17:12.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.459+0000 7ff60effd640 10 monclient: handle_get_version_reply finishing 1 version 322 2026-02-12T18:17:12.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.459+0000 7ff62e8fe640 1 --2- 10.20.193.48:0/3470916001 >> v2:10.20.193.48:6801/447356640 conn(0x7ff5f8063340 0x7ff5f8083750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.459+0000 7ff62e8fe640 10 monclient: get_auth_request con 0x7ff5f8063340 auth_method 0 2026-02-12T18:17:12.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.459+0000 7ff62d8fc640 1 --2- 10.20.193.48:0/3470916001 >> v2:10.20.193.111:6812/977811348 conn(0x7ff5f803f800 0x7ff5f805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.461 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.459+0000 7ff62d8fc640 10 monclient: get_auth_request con 0x7ff5f803f800 auth_method 0 2026-02-12T18:17:12.463 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.462+0000 7ff62d8fc640 1 --2- 10.20.193.48:0/3470916001 >> v2:10.20.193.111:6812/977811348 conn(0x7ff5f803f800 0x7ff5f805fcb0 secure :-1 s=READY pgs=487 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff62810bda0 tx=0x7ff61c007ec0 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:12.464 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.463+0000 7ff62e8fe640 1 --2- 10.20.193.48:0/3470916001 >> v2:10.20.193.48:6801/447356640 conn(0x7ff5f8063340 0x7ff5f8083750 crc :-1 s=READY pgs=170 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:12.465 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.464+0000 7ff60effd640 1 -- 10.20.193.48:0/3470916001 <== osd.0 v2:10.20.193.48:6801/447356640 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7ff5f8083dc0 con 0x7ff5f8063340 2026-02-12T18:17:12.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.471+0000 7ff630388640 1 -- 10.20.193.48:0/3470916001 --> v2:10.20.193.48:6801/447356640 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff62810dc30 con 0x7ff5f8063340 2026-02-12T18:17:12.472 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.471+0000 7ff60effd640 1 -- 10.20.193.48:0/3470916001 <== osd.0 v2:10.20.193.48:6801/447356640 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff62810dc30 con 0x7ff5f8063340 2026-02-12T18:17:12.472 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:17:12.472 INFO:teuthology.orchestra.run.trial048.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T18:17:12.472 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:17:12.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.471+0000 7ff630388640 1 -- 10.20.193.48:0/3470916001 >> v2:10.20.193.48:6801/447356640 conn(0x7ff5f8063340 msgr2=0x7ff5f8083750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:12.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.471+0000 7ff630388640 1 --2- 10.20.193.48:0/3470916001 >> v2:10.20.193.48:6801/447356640 conn(0x7ff5f8063340 0x7ff5f8083750 crc :-1 s=READY pgs=170 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.471+0000 7ff630388640 1 -- 10.20.193.48:0/3470916001 >> v2:10.20.193.111:6812/977811348 conn(0x7ff5f803f800 msgr2=0x7ff5f805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:12.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.471+0000 7ff630388640 1 --2- 10.20.193.48:0/3470916001 >> v2:10.20.193.111:6812/977811348 conn(0x7ff5f803f800 0x7ff5f805fcb0 secure :-1 s=READY pgs=487 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff62810bda0 tx=0x7ff61c007ec0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.471+0000 7ff630388640 10 monclient: shutdown 2026-02-12T18:17:12.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.471+0000 7ff630388640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:12.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.471+0000 7ff630388640 1 -- 10.20.193.48:0/3470916001 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff62805d8b0 msgr2=0x7ff62812ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:12.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.471+0000 7ff630388640 1 --2- 10.20.193.48:0/3470916001 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff62805d8b0 0x7ff62812ddc0 secure :-1 s=READY pgs=469 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff618007fd0 tx=0x7ff61800c970 comp rx=0 tx=0).stop 2026-02-12T18:17:12.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.471+0000 7ff62e8fe640 1 -- 10.20.193.48:0/3470916001 reap_dead start 2026-02-12T18:17:12.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.471+0000 7ff630388640 1 -- 10.20.193.48:0/3470916001 shutdown_connections 2026-02-12T18:17:12.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.471+0000 7ff630388640 1 -- 10.20.193.48:0/3470916001 >> 10.20.193.48:0/3470916001 conn(0x7ff628054b60 msgr2=0x7ff62805cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:12.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.471+0000 7ff630388640 1 -- 10.20.193.48:0/3470916001 shutdown_connections 2026-02-12T18:17:12.473 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.471+0000 7ff630388640 1 -- 10.20.193.48:0/3470916001 wait complete. 2026-02-12T18:17:12.477 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2026-02-12T18:17:12.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.541+0000 7f6ca605b640 10 monclient: get_monmap_and_config 2026-02-12T18:17:12.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.541+0000 7f6ca605b640 10 monclient: build_initial_monmap 2026-02-12T18:17:12.542 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.541+0000 7f6ca605b640 10 monclient: monmap: 2026-02-12T18:17:12.542 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:12.542 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:12.543 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:12.542676+0000 2026-02-12T18:17:12.543 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:12.542676+0000 2026-02-12T18:17:12.543 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:12.543 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:12.543 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:12.543 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:12.543 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:12.543 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:12.543 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:12.543 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:12.543 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:12.543 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:12.543 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:12.543 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:12.543 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:12.543 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6ca605b640 1 Processor -- start 2026-02-12T18:17:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6ca605b640 1 -- start start 2026-02-12T18:17:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6ca605b640 10 monclient: init 2026-02-12T18:17:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6ca605b640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6ca605b640 10 monclient: _add_conns ranks=[5,4,2,10,9,0,6,1,8,3,7] 2026-02-12T18:17:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6ca605b640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6ca005d550 0x7f6ca005d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6ca605b640 10 monclient(hunting): picked mon.noname-h con 0x7f6ca005d550 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:17:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6ca605b640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6ca005de60 0x7f6ca0141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6ca605b640 10 monclient(hunting): picked mon.noname-c con 0x7f6ca005de60 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:17:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6ca605b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6ca013ef60 0x7f6ca01424e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6ca605b640 10 monclient(hunting): picked mon.noname-b con 0x7f6ca013ef60 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:17:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6ca605b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6ca605b640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca008d390 con 0x7f6ca013ef60 2026-02-12T18:17:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6ca605b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6ca605b640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f6ca008d5a0 con 0x7f6ca005de60 2026-02-12T18:17:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6ca605b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6ca605b640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f6ca00580e0 con 0x7f6ca005d550 2026-02-12T18:17:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6ca605b640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6ca605b640 10 monclient(hunting): authenticate will time out at 1271.268392s 2026-02-12T18:17:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9ffff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6ca013ef60 0x7f6ca01424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9effd640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6ca005de60 0x7f6ca0141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9ffff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6ca013ef60 0x7f6ca01424e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:44192/0 (socket says 10.20.193.48:44192) 2026-02-12T18:17:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9effd640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6ca005de60 0x7f6ca0141fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:40660/0 (socket says 10.20.193.48:40660) 2026-02-12T18:17:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9ffff640 1 -- 10.20.193.48:0/498476542 learned_addr learned my addr 10.20.193.48:0/498476542 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9ffff640 10 monclient(hunting): get_auth_request con 0x7f6ca013ef60 auth_method 0 2026-02-12T18:17:12.544 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9effd640 10 monclient(hunting): get_auth_request con 0x7f6ca005de60 auth_method 0 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9f7fe640 1 --2- 10.20.193.48:0/498476542 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6ca005d550 0x7f6ca005d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9f7fe640 10 monclient(hunting): get_auth_request con 0x7f6ca005d550 auth_method 0 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9effd640 10 monclient(hunting): handle_auth_done global_id 65335 payload 274 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9effd640 1 -- 10.20.193.48:0/498476542 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6ca005d550 msgr2=0x7f6ca005d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9effd640 1 --2- 10.20.193.48:0/498476542 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6ca005d550 0x7f6ca005d920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9effd640 1 -- 10.20.193.48:0/498476542 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6ca013ef60 msgr2=0x7f6ca01424e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9effd640 1 --2- 10.20.193.48:0/498476542 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6ca013ef60 0x7f6ca01424e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9effd640 10 monclient: _finish_hunting 0 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9effd640 1 monclient: found mon.noname-c 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9effd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:17:12.545 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.542+0000 7f6c9effd640 1 -- 10.20.193.48:0/498476542 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca004dc20 con 0x7f6ca005de60 2026-02-12T18:17:12.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6c9effd640 1 -- 10.20.193.48:0/498476542 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6ca005de60 msgr2=0x7f6ca0141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:12.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6c9effd640 1 --2- 10.20.193.48:0/498476542 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6ca005de60 0x7f6ca0141fa0 secure :-1 s=READY pgs=277 gs=2 cs=0 l=1 c_cookie=9647362453073665567 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c90009800 tx=0x7f6c9002ed50 comp rx=0 tx=0).ready entity=mon.4 client_cookie=85e2510982e59e1f server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:12.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6c9e7fc640 1 -- 10.20.193.48:0/498476542 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6c9002fe90 con 0x7f6ca005de60 2026-02-12T18:17:12.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6c9e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:12.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6c9e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:17:12.546 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6c9e7fc640 10 monclient: dump: 2026-02-12T18:17:12.546 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:12.546 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:12.546 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.546 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.546 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:12.546 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:12.546 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:12.546 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:12.546 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:12.546 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6c9e7fc640 10 monclient: _finish_auth 0 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6c9e7fc640 10 monclient: _check_auth_tickets 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6c9e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6c9e7fc640 1 -- 10.20.193.48:0/498476542 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c90035340 con 0x7f6ca005de60 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6ca605b640 5 monclient: authenticate success, global_id 65335 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6ca605b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6c9e7fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6c9e7fc640 1 -- 10.20.193.48:0/498476542 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6c90035970 con 0x7f6ca005de60 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6c9e7fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6c9e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6c9e7fc640 10 monclient: dump: 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6ca605b640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:12.547 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6ca605b640 4 set_mon_vals no callback set 2026-02-12T18:17:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6ca605b640 10 monclient: shutdown 2026-02-12T18:17:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6ca605b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6ca605b640 1 -- 10.20.193.48:0/498476542 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6ca005de60 msgr2=0x7f6ca0141fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6ca605b640 1 --2- 10.20.193.48:0/498476542 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6ca005de60 0x7f6ca0141fa0 secure :-1 s=READY pgs=277 gs=2 cs=0 l=1 c_cookie=9647362453073665567 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c90009800 tx=0x7f6c9002ed50 comp rx=0 tx=0).stop 2026-02-12T18:17:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6ca605b640 1 -- 10.20.193.48:0/498476542 shutdown_connections 2026-02-12T18:17:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6ca605b640 1 --2- 10.20.193.48:0/498476542 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7f6ca013ef60 0x7f6ca01424e0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6ca605b640 1 --2- 10.20.193.48:0/498476542 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6ca005de60 0x7f6ca0141fa0 unknown :-1 s=CLOSED pgs=277 gs=2 cs=0 l=1 c_cookie=9647362453073665567 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6ca605b640 1 --2- 10.20.193.48:0/498476542 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f6ca005d550 0x7f6ca005d920 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6ca605b640 1 -- 10.20.193.48:0/498476542 >> 10.20.193.48:0/498476542 conn(0x7f6ca00546a0 msgr2=0x7f6ca0054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6ca605b640 1 -- 10.20.193.48:0/498476542 shutdown_connections 2026-02-12T18:17:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.545+0000 7f6ca605b640 1 -- 10.20.193.48:0/498476542 wait complete. 2026-02-12T18:17:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6ca605b640 10 monclient: build_initial_monmap 2026-02-12T18:17:12.548 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6ca605b640 10 monclient: monmap: 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6ca605b640 1 Processor -- start 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6ca605b640 1 -- start start 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6ca605b640 10 monclient: init 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6ca605b640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6ca605b640 10 monclient: _add_conns ranks=[3,4,7,5,0,6,1,8,2] 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6ca605b640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6ca005d550 0x7f6ca010d410 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6ca605b640 10 monclient(hunting): picked mon.noname-g con 0x7f6ca005d550 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6ca605b640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6ca005de60 0x7f6ca0109760 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6ca605b640 10 monclient(hunting): picked mon.noname-c con 0x7f6ca005de60 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6ca605b640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6ca013ef60 0x7f6ca0109ca0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6ca605b640 10 monclient(hunting): picked mon.noname-i con 0x7f6ca013ef60 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6ca605b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6ca605b640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7f6ca013dd40 con 0x7f6ca005d550 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6ca605b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6ca605b640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7f6ca0120890 con 0x7f6ca005de60 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6ca605b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6ca605b640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f6ca010c0a0 con 0x7f6ca013ef60 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6ca605b640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6ca605b640 10 monclient(hunting): authenticate will time out at 1271.272883s 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6c9effd640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6ca005de60 0x7f6ca0109760 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6c9effd640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6ca005de60 0x7f6ca0109760 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:40664/0 (socket says 10.20.193.48:40664) 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6c9effd640 1 -- 10.20.193.48:0/696059835 learned_addr learned my addr 10.20.193.48:0/696059835 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6c9effd640 10 monclient(hunting): get_auth_request con 0x7f6ca005de60 auth_method 0 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6c9effd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6c9effd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6c9effd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:12.549 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6c9effd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6c9effd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.546+0000 7f6c9effd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.547+0000 7f6c9f7fe640 1 --2- 10.20.193.48:0/696059835 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6ca005d550 0x7f6ca010d410 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.547+0000 7f6c9f7fe640 10 monclient(hunting): get_auth_request con 0x7f6ca005d550 auth_method 0 2026-02-12T18:17:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.547+0000 7f6c9f7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.547+0000 7f6c9f7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.547+0000 7f6c9f7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.547+0000 7f6c9effd640 10 monclient(hunting): handle_auth_done global_id 65344 payload 824 2026-02-12T18:17:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.547+0000 7f6c9ffff640 1 --2- 10.20.193.48:0/696059835 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6ca013ef60 0x7f6ca0109ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.547+0000 7f6c9effd640 1 -- 10.20.193.48:0/696059835 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6ca013ef60 msgr2=0x7f6ca0109ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.547+0000 7f6c9effd640 1 --2- 10.20.193.48:0/696059835 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6ca013ef60 0x7f6ca0109ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.547+0000 7f6c9effd640 1 -- 10.20.193.48:0/696059835 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6ca005d550 msgr2=0x7f6ca010d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.547+0000 7f6c9effd640 1 --2- 10.20.193.48:0/696059835 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6ca005d550 0x7f6ca010d410 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.547+0000 7f6c9effd640 10 monclient: _finish_hunting 0 2026-02-12T18:17:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.547+0000 7f6c9effd640 1 monclient: found mon.noname-c 2026-02-12T18:17:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.547+0000 7f6c9effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.547+0000 7f6c9effd640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:17:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.547+0000 7f6c9effd640 1 -- 10.20.193.48:0/696059835 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c90009420 con 0x7f6ca005de60 2026-02-12T18:17:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.549+0000 7f6c9effd640 1 -- 10.20.193.48:0/696059835 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6ca005de60 msgr2=0x7f6ca0109760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.549+0000 7f6c9effd640 1 --2- 10.20.193.48:0/696059835 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6ca005de60 0x7f6ca0109760 secure :-1 s=READY pgs=278 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c9002ed90 tx=0x7f6c900047e0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.549+0000 7f6c7bfff640 1 -- 10.20.193.48:0/696059835 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6c900044f0 con 0x7f6ca005de60 2026-02-12T18:17:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.549+0000 7f6c7bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:12.550 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.549+0000 7f6c7bfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.549+0000 7f6c7bfff640 10 monclient: dump: 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.549+0000 7f6c7bfff640 10 monclient: _finish_auth 0 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.549+0000 7f6c7bfff640 10 monclient: _check_auth_tickets 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.549+0000 7f6c7bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.549+0000 7f6c7bfff640 1 -- 10.20.193.48:0/696059835 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c90035cc0 con 0x7f6ca005de60 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.549+0000 7f6ca605b640 5 monclient: authenticate success, global_id 65344 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.549+0000 7f6ca605b640 10 monclient: _renew_subs 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.549+0000 7f6ca605b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.549+0000 7f6ca605b640 1 -- 10.20.193.48:0/696059835 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca010c950 con 0x7f6ca005de60 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.549+0000 7f6c7bfff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.549+0000 7f6c7bfff640 1 -- 10.20.193.48:0/696059835 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f6c90035e30 con 0x7f6ca005de60 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.549+0000 7f6c7bfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.549+0000 7f6c9dffb640 4 set_mon_vals no callback set 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.549+0000 7f6c7bfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.549+0000 7f6c7bfff640 10 monclient: dump: 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:12.551 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:12.552 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:12.552 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:12.552 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.549+0000 7f6ca605b640 10 monclient: _renew_subs 2026-02-12T18:17:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.549+0000 7f6ca605b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:17:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.549+0000 7f6ca605b640 1 -- 10.20.193.48:0/696059835 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca010b9a0 con 0x7f6ca005de60 2026-02-12T18:17:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.550+0000 7f6ca605b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.550+0000 7f6ca605b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.550+0000 7f6ca605b640 10 monclient: _send_mon_message to mon.c at v2:10.20.193.48:3302/0 2026-02-12T18:17:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.550+0000 7f6ca605b640 1 -- 10.20.193.48:0/696059835 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ca005d920 con 0x7f6ca005de60 2026-02-12T18:17:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.550+0000 7f6c7bfff640 1 -- 10.20.193.48:0/696059835 <== mon.4 v2:10.20.193.48:3302/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f6c90004030 con 0x7f6ca005de60 2026-02-12T18:17:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.550+0000 7f6c7bfff640 1 --2- 10.20.193.48:0/696059835 >> v2:10.20.193.111:6812/977811348 conn(0x7f6c7003f800 0x7f6c7005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.550+0000 7f6c7bfff640 1 -- 10.20.193.48:0/696059835 <== mon.4 v2:10.20.193.48:3302/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7f6c90077ba0 con 0x7f6ca005de60 2026-02-12T18:17:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.550+0000 7f6c9f7fe640 1 --2- 10.20.193.48:0/696059835 >> v2:10.20.193.111:6812/977811348 conn(0x7f6c7003f800 0x7f6c7005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.552 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.550+0000 7f6c9f7fe640 10 monclient: get_auth_request con 0x7f6c7003f800 auth_method 0 2026-02-12T18:17:12.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.552+0000 7f6c7bfff640 1 -- 10.20.193.48:0/696059835 <== mon.4 v2:10.20.193.48:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f6c900036d0 con 0x7f6ca005de60 2026-02-12T18:17:12.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.552+0000 7f6c7bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:12.553 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.552+0000 7f6c7bfff640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:17:12.554 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.553+0000 7f6c9f7fe640 1 --2- 10.20.193.48:0/696059835 >> v2:10.20.193.111:6812/977811348 conn(0x7f6c7003f800 0x7f6c7005fcb0 secure :-1 s=READY pgs=488 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c8c004740 tx=0x7f6c8c008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:12.656 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.655+0000 7f6ca605b640 1 -- 10.20.193.48:0/696059835 --> v2:10.20.193.111:6812/977811348 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f6ca008d060 con 0x7f6c7003f800 2026-02-12T18:17:12.656 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.655+0000 7f6c7bfff640 1 -- 10.20.193.48:0/696059835 <== mgr.4123 v2:10.20.193.111:6812/977811348 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6c8c00b5c0 con 0x7f6c7003f800 2026-02-12T18:17:12.656 INFO:teuthology.orchestra.run.trial048.stderr:instructed osd(s) 0 to deep-scrub 2026-02-12T18:17:12.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.656+0000 7f6ca605b640 1 -- 10.20.193.48:0/696059835 >> v2:10.20.193.111:6812/977811348 conn(0x7f6c7003f800 msgr2=0x7f6c7005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:12.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.656+0000 7f6ca605b640 1 --2- 10.20.193.48:0/696059835 >> v2:10.20.193.111:6812/977811348 conn(0x7f6c7003f800 0x7f6c7005fcb0 secure :-1 s=READY pgs=488 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c8c004740 tx=0x7f6c8c008040 comp rx=0 tx=0).stop 2026-02-12T18:17:12.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.656+0000 7f6ca605b640 10 monclient: shutdown 2026-02-12T18:17:12.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.656+0000 7f6ca605b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:12.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.656+0000 7f6ca605b640 1 -- 10.20.193.48:0/696059835 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6ca005de60 msgr2=0x7f6ca0109760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:12.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.656+0000 7f6ca605b640 1 --2- 10.20.193.48:0/696059835 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6ca005de60 0x7f6ca0109760 secure :-1 s=READY pgs=278 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f6c9002ed90 tx=0x7f6c900047e0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.656+0000 7f6ca605b640 1 -- 10.20.193.48:0/696059835 shutdown_connections 2026-02-12T18:17:12.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.656+0000 7f6ca605b640 1 --2- 10.20.193.48:0/696059835 >> v2:10.20.193.111:6812/977811348 conn(0x7f6c7003f800 0x7f6c7005fcb0 unknown :-1 s=CLOSED pgs=488 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.656+0000 7f6ca605b640 1 --2- 10.20.193.48:0/696059835 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f6ca013ef60 0x7f6ca0109ca0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.656+0000 7f6ca605b640 1 --2- 10.20.193.48:0/696059835 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7f6ca005de60 0x7f6ca0109760 unknown :-1 s=CLOSED pgs=278 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.656+0000 7f6ca605b640 1 --2- 10.20.193.48:0/696059835 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7f6ca005d550 0x7f6ca010d410 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.656+0000 7f6ca605b640 1 -- 10.20.193.48:0/696059835 >> 10.20.193.48:0/696059835 conn(0x7f6ca00546a0 msgr2=0x7f6ca005cd60 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:12.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.656+0000 7f6ca605b640 1 -- 10.20.193.48:0/696059835 shutdown_connections 2026-02-12T18:17:12.657 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.656+0000 7f6ca605b640 1 -- 10.20.193.48:0/696059835 wait complete. 2026-02-12T18:17:12.665 INFO:tasks.ceph:Scrubbing osd.1 2026-02-12T18:17:12.665 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2026-02-12T18:17:12.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.731+0000 7fa667a8c640 10 monclient: get_monmap_and_config 2026-02-12T18:17:12.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.731+0000 7fa667a8c640 10 monclient: build_initial_monmap 2026-02-12T18:17:12.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.731+0000 7fa667a8c640 10 monclient: monmap: 2026-02-12T18:17:12.732 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:12.732 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:12.732 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:12.732390+0000 2026-02-12T18:17:12.732 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:12.732390+0000 2026-02-12T18:17:12.732 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:12.732 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:12.732 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:12.732 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:12.732 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:12.732 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:12.732 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:12.732 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:12.732 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:12.732 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:12.732 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:12.732 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:12.732 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:12.733 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:12.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.731+0000 7fa667a8c640 1 Processor -- start 2026-02-12T18:17:12.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.731+0000 7fa667a8c640 1 -- start start 2026-02-12T18:17:12.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.731+0000 7fa667a8c640 10 monclient: init 2026-02-12T18:17:12.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa667a8c640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:12.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa667a8c640 10 monclient: _add_conns ranks=[5,2,0,3,9,1,7,10,8,4,6] 2026-02-12T18:17:12.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa667a8c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa66005d8b0 0x7fa66005dc80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa667a8c640 10 monclient(hunting): picked mon.noname-h con 0x7fa66005d8b0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:17:12.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa667a8c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa6601423a0 0x7fa66013e990 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa667a8c640 10 monclient(hunting): picked mon.noname-b con 0x7fa6601423a0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa667a8c640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fa66013eed0 addr v1:10.20.193.48:6789/0 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa667a8c640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa660060390 con 0x7fa66013eed0 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa667a8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa667a8c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fa66008d5a0 con 0x7fa6601423a0 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa667a8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa667a8c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fa660057e30 con 0x7fa66005d8b0 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa667a8c640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa667a8c640 10 monclient(hunting): authenticate will time out at 1271.458081s 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa665000640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa6601423a0 0x7fa66013e990 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa666002640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7fa66013eed0 0x7fa6601a3220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:44066/0 (socket says 10.20.193.48:44066) 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa666002640 1 -- 10.20.193.48:0/3041513301 learned_addr learned my addr 10.20.193.48:0/3041513301 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa665000640 10 monclient(hunting): get_auth_request con 0x7fa6601423a0 auth_method 0 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa665000640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa665000640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa665000640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa665000640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa665000640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa665801640 1 --2- 10.20.193.48:0/3041513301 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa66005d8b0 0x7fa66005dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa665000640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa665801640 10 monclient(hunting): get_auth_request con 0x7fa66005d8b0 auth_method 0 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa665801640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa665801640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa665801640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa665000640 10 monclient(hunting): handle_auth_done global_id 36731 payload 274 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa665000640 1 -- 10.20.193.48:0/3041513301 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa66005d8b0 msgr2=0x7fa66005dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa665000640 1 --2- 10.20.193.48:0/3041513301 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa66005d8b0 0x7fa66005dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa665000640 1 -- 10.20.193.48:0/3041513301 >> v1:10.20.193.48:6789/0 conn(0x7fa66013eed0 legacy=0x7fa6601a3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa665000640 10 monclient: _finish_hunting 0 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa665000640 1 monclient: found mon.noname-b 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa665000640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa665000640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:17:12.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.732+0000 7fa665000640 1 -- 10.20.193.48:0/3041513301 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa66008d260 con 0x7fa6601423a0 2026-02-12T18:17:12.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa665000640 1 -- 10.20.193.48:0/3041513301 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa6601423a0 msgr2=0x7fa66013e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:12.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa665000640 1 --2- 10.20.193.48:0/3041513301 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa6601423a0 0x7fa66013e990 secure :-1 s=READY pgs=470 gs=2 cs=0 l=1 c_cookie=16294456272980637203 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa654009800 tx=0x7fa65402ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e22189a607257613 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:12.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa64ffff640 1 -- 10.20.193.48:0/3041513301 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa65402fe90 con 0x7fa6601423a0 2026-02-12T18:17:12.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa64ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:12.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa64ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:17:12.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa64ffff640 10 monclient: dump: 2026-02-12T18:17:12.736 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:12.736 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:12.736 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.736 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.736 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:12.736 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:12.736 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:12.736 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:12.736 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:12.736 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:12.736 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:12.736 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:12.736 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:12.736 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:12.736 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:12.736 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:12.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa64ffff640 10 monclient: _finish_auth 0 2026-02-12T18:17:12.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa64ffff640 10 monclient: _check_auth_tickets 2026-02-12T18:17:12.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa64ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:12.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa64ffff640 1 -- 10.20.193.48:0/3041513301 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa654035340 con 0x7fa6601423a0 2026-02-12T18:17:12.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa64ffff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:12.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa64ffff640 1 -- 10.20.193.48:0/3041513301 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa654035970 con 0x7fa6601423a0 2026-02-12T18:17:12.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa667a8c640 5 monclient: authenticate success, global_id 36731 2026-02-12T18:17:12.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa667a8c640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:12.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa667a8c640 4 set_mon_vals no callback set 2026-02-12T18:17:12.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa64ffff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:12.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa64ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:17:12.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa64ffff640 10 monclient: dump: 2026-02-12T18:17:12.737 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:12.737 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:12.737 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.737 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.737 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:12.737 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:12.737 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:12.737 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:12.737 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:12.737 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:12.737 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:12.737 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:12.737 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:12.737 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:12.737 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:12.737 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:12.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa667a8c640 10 monclient: shutdown 2026-02-12T18:17:12.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa667a8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:12.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa667a8c640 1 -- 10.20.193.48:0/3041513301 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa6601423a0 msgr2=0x7fa66013e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:12.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa667a8c640 1 --2- 10.20.193.48:0/3041513301 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa6601423a0 0x7fa66013e990 secure :-1 s=READY pgs=470 gs=2 cs=0 l=1 c_cookie=16294456272980637203 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa654009800 tx=0x7fa65402ed50 comp rx=0 tx=0).stop 2026-02-12T18:17:12.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa667a8c640 1 -- 10.20.193.48:0/3041513301 shutdown_connections 2026-02-12T18:17:12.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa667a8c640 1 --2- 10.20.193.48:0/3041513301 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa6601423a0 0x7fa66013e990 unknown :-1 s=CLOSED pgs=470 gs=2 cs=0 l=1 c_cookie=16294456272980637203 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa667a8c640 1 --2- 10.20.193.48:0/3041513301 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa66005d8b0 0x7fa66005dc80 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa667a8c640 1 -- 10.20.193.48:0/3041513301 >> 10.20.193.48:0/3041513301 conn(0x7fa660054b60 msgr2=0x7fa660093000 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:12.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa667a8c640 1 -- 10.20.193.48:0/3041513301 shutdown_connections 2026-02-12T18:17:12.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.735+0000 7fa667a8c640 1 -- 10.20.193.48:0/3041513301 wait complete. 2026-02-12T18:17:12.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa667a8c640 10 monclient: build_initial_monmap 2026-02-12T18:17:12.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa667a8c640 10 monclient: monmap: 2026-02-12T18:17:12.738 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:12.738 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:12.738 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:12.738 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa667a8c640 1 Processor -- start 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa667a8c640 1 -- start start 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa667a8c640 10 monclient: init 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa667a8c640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa667a8c640 10 monclient: _add_conns ranks=[6,7,2,0,3,4,8,5,1] 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa667a8c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa66005d8b0 0x7fa66012c9a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa667a8c640 10 monclient(hunting): picked mon.noname-d con 0x7fa66005d8b0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa667a8c640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa66013eed0 0x7fa66005a5a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa667a8c640 10 monclient(hunting): picked mon.noname-i con 0x7fa66013eed0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa667a8c640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa6601423a0 0x7fa66005aae0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa667a8c640 10 monclient(hunting): picked mon.noname-b con 0x7fa6601423a0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa667a8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa667a8c640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fa660109760 con 0x7fa6601423a0 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa667a8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa667a8c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fa660109a40 con 0x7fa66005d8b0 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa667a8c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa667a8c640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fa660109d20 con 0x7fa66013eed0 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa667a8c640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa667a8c640 10 monclient(hunting): authenticate will time out at 1271.462679s 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa666002640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa6601423a0 0x7fa66005aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa665801640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa66005d8b0 0x7fa66012c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa665801640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa66005d8b0 0x7fa66012c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:51848/0 (socket says 10.20.193.48:51848) 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa665801640 1 -- 10.20.193.48:0/920205862 learned_addr learned my addr 10.20.193.48:0/920205862 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa665801640 10 monclient(hunting): get_auth_request con 0x7fa66005d8b0 auth_method 0 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa665801640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa665801640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa665801640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa666002640 10 monclient(hunting): get_auth_request con 0x7fa6601423a0 auth_method 0 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa666002640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa666002640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:12.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa666002640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:12.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa665801640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:12.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa665801640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:12.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa665801640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:12.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa666002640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:12.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa666002640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:12.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa665000640 1 --2- 10.20.193.48:0/920205862 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa66013eed0 0x7fa66005a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa666002640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:12.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa665000640 10 monclient(hunting): get_auth_request con 0x7fa66013eed0 auth_method 0 2026-02-12T18:17:12.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa665000640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:12.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa665000640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:12.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa665000640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:12.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.736+0000 7fa665801640 10 monclient(hunting): handle_auth_done global_id 114225 payload 824 2026-02-12T18:17:12.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.737+0000 7fa665801640 1 -- 10.20.193.48:0/920205862 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa66013eed0 msgr2=0x7fa66005a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:12.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.737+0000 7fa665801640 1 --2- 10.20.193.48:0/920205862 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa66013eed0 0x7fa66005a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.737+0000 7fa665801640 1 -- 10.20.193.48:0/920205862 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa6601423a0 msgr2=0x7fa66005aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:12.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.737+0000 7fa665801640 1 --2- 10.20.193.48:0/920205862 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa6601423a0 0x7fa66005aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.737+0000 7fa665801640 10 monclient: _finish_hunting 0 2026-02-12T18:17:12.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.737+0000 7fa665801640 1 monclient: found mon.noname-d 2026-02-12T18:17:12.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.737+0000 7fa665801640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:12.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.737+0000 7fa665801640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:17:12.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.737+0000 7fa665801640 1 -- 10.20.193.48:0/920205862 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa654009420 con 0x7fa66005d8b0 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.739+0000 7fa665801640 1 -- 10.20.193.48:0/920205862 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa66005d8b0 msgr2=0x7fa66012c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.739+0000 7fa665801640 1 --2- 10.20.193.48:0/920205862 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa66005d8b0 0x7fa66012c9a0 secure :-1 s=READY pgs=29 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa650006f30 tx=0x7fa65000ebd0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.739+0000 7fa64dffb640 1 -- 10.20.193.48:0/920205862 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa65000ee30 con 0x7fa66005d8b0 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.739+0000 7fa64dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.739+0000 7fa64dffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.739+0000 7fa64dffb640 10 monclient: dump: 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.739+0000 7fa64dffb640 10 monclient: _finish_auth 0 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.739+0000 7fa64dffb640 10 monclient: _check_auth_tickets 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.739+0000 7fa64dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.739+0000 7fa64dffb640 1 -- 10.20.193.48:0/920205862 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa65000cda0 con 0x7fa66005d8b0 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.739+0000 7fa667a8c640 5 monclient: authenticate success, global_id 114225 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.739+0000 7fa667a8c640 10 monclient: _renew_subs 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.739+0000 7fa667a8c640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.739+0000 7fa667a8c640 1 -- 10.20.193.48:0/920205862 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa66010a000 con 0x7fa66005d8b0 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.739+0000 7fa64dffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.739+0000 7fa64dffb640 1 -- 10.20.193.48:0/920205862 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa6500138d0 con 0x7fa66005d8b0 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.739+0000 7fa64dffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.739+0000 7fa64dffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.739+0000 7fa64f7fe640 4 set_mon_vals no callback set 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.739+0000 7fa64dffb640 10 monclient: dump: 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.741 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.739+0000 7fa667a8c640 10 monclient: _renew_subs 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.739+0000 7fa667a8c640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.739+0000 7fa667a8c640 1 -- 10.20.193.48:0/920205862 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fa66011d500 con 0x7fa66005d8b0 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.739+0000 7fa667a8c640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.739+0000 7fa667a8c640 1 -- 10.20.193.48:0/920205862 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa6601098d0 con 0x7fa66005d8b0 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.740+0000 7fa64dffb640 1 -- 10.20.193.48:0/920205862 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fa650013410 con 0x7fa66005d8b0 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.740+0000 7fa64dffb640 1 --2- 10.20.193.48:0/920205862 >> v2:10.20.193.111:6812/977811348 conn(0x7fa63003f800 0x7fa63005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.740+0000 7fa64dffb640 1 -- 10.20.193.48:0/920205862 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7fa650052ae0 con 0x7fa66005d8b0 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.740+0000 7fa64dffb640 1 --2- 10.20.193.48:0/920205862 >> v2:10.20.193.48:6808/3694032686 conn(0x7fa630063340 0x7fa630083750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.740+0000 7fa64dffb640 1 -- 10.20.193.48:0/920205862 --> v2:10.20.193.48:6808/3694032686 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa630083dc0 con 0x7fa630063340 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.740+0000 7fa64dffb640 1 -- 10.20.193.48:0/920205862 <== mon.6 v2:10.20.193.48:3303/0 6 ==== mon_get_version_reply(handle=1 version=322) ==== 24+0+0 (secure 0 0 0) 0x7fa6500572a0 con 0x7fa66005d8b0 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.740+0000 7fa64dffb640 10 monclient: handle_get_version_reply finishing 1 version 322 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.740+0000 7fa666002640 1 --2- 10.20.193.48:0/920205862 >> v2:10.20.193.48:6808/3694032686 conn(0x7fa630063340 0x7fa630083750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.740+0000 7fa665000640 1 --2- 10.20.193.48:0/920205862 >> v2:10.20.193.111:6812/977811348 conn(0x7fa63003f800 0x7fa63005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.740+0000 7fa665000640 10 monclient: get_auth_request con 0x7fa63003f800 auth_method 0 2026-02-12T18:17:12.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.740+0000 7fa666002640 10 monclient: get_auth_request con 0x7fa630063340 auth_method 0 2026-02-12T18:17:12.744 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.743+0000 7fa665000640 1 --2- 10.20.193.48:0/920205862 >> v2:10.20.193.111:6812/977811348 conn(0x7fa63003f800 0x7fa63005fcb0 secure :-1 s=READY pgs=489 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa654004740 tx=0x7fa654039040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:12.745 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.744+0000 7fa666002640 1 --2- 10.20.193.48:0/920205862 >> v2:10.20.193.48:6808/3694032686 conn(0x7fa630063340 0x7fa630083750 crc :-1 s=READY pgs=169 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:12.746 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.745+0000 7fa64dffb640 1 -- 10.20.193.48:0/920205862 <== osd.1 v2:10.20.193.48:6808/3694032686 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fa630083dc0 con 0x7fa630063340 2026-02-12T18:17:12.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.753+0000 7fa667a8c640 1 -- 10.20.193.48:0/920205862 --> v2:10.20.193.48:6808/3694032686 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa660109bb0 con 0x7fa630063340 2026-02-12T18:17:12.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.753+0000 7fa64dffb640 1 -- 10.20.193.48:0/920205862 <== osd.1 v2:10.20.193.48:6808/3694032686 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa660109bb0 con 0x7fa630063340 2026-02-12T18:17:12.754 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:17:12.754 INFO:teuthology.orchestra.run.trial048.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T18:17:12.754 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:17:12.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.753+0000 7fa667a8c640 1 -- 10.20.193.48:0/920205862 >> v2:10.20.193.48:6808/3694032686 conn(0x7fa630063340 msgr2=0x7fa630083750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:12.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.753+0000 7fa667a8c640 1 --2- 10.20.193.48:0/920205862 >> v2:10.20.193.48:6808/3694032686 conn(0x7fa630063340 0x7fa630083750 crc :-1 s=READY pgs=169 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.753+0000 7fa667a8c640 1 -- 10.20.193.48:0/920205862 >> v2:10.20.193.111:6812/977811348 conn(0x7fa63003f800 msgr2=0x7fa63005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:12.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.753+0000 7fa667a8c640 1 --2- 10.20.193.48:0/920205862 >> v2:10.20.193.111:6812/977811348 conn(0x7fa63003f800 0x7fa63005fcb0 secure :-1 s=READY pgs=489 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa654004740 tx=0x7fa654039040 comp rx=0 tx=0).stop 2026-02-12T18:17:12.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.753+0000 7fa667a8c640 10 monclient: shutdown 2026-02-12T18:17:12.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.753+0000 7fa667a8c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:12.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.753+0000 7fa667a8c640 1 -- 10.20.193.48:0/920205862 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa66005d8b0 msgr2=0x7fa66012c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:12.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.753+0000 7fa667a8c640 1 --2- 10.20.193.48:0/920205862 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa66005d8b0 0x7fa66012c9a0 secure :-1 s=READY pgs=29 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa650006f30 tx=0x7fa65000ebd0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.753+0000 7fa666002640 1 -- 10.20.193.48:0/920205862 reap_dead start 2026-02-12T18:17:12.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.753+0000 7fa667a8c640 1 -- 10.20.193.48:0/920205862 shutdown_connections 2026-02-12T18:17:12.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.753+0000 7fa667a8c640 1 -- 10.20.193.48:0/920205862 >> 10.20.193.48:0/920205862 conn(0x7fa660054b60 msgr2=0x7fa66013c890 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:12.754 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.753+0000 7fa667a8c640 1 -- 10.20.193.48:0/920205862 shutdown_connections 2026-02-12T18:17:12.755 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.753+0000 7fa667a8c640 1 -- 10.20.193.48:0/920205862 wait complete. 2026-02-12T18:17:12.759 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2026-02-12T18:17:12.824 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.823+0000 7fb2057c2640 10 monclient: get_monmap_and_config 2026-02-12T18:17:12.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.823+0000 7fb2057c2640 10 monclient: build_initial_monmap 2026-02-12T18:17:12.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.823+0000 7fb2057c2640 10 monclient: monmap: 2026-02-12T18:17:12.825 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:12.825 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:12.825 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:12.824858+0000 2026-02-12T18:17:12.825 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:12.824858+0000 2026-02-12T18:17:12.825 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:12.825 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:12.825 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:12.825 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:12.825 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:12.825 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:12.825 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:12.825 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:12.825 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:12.825 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:12.825 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:12.825 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:12.825 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:12.825 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:12.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb2057c2640 1 Processor -- start 2026-02-12T18:17:12.825 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb2057c2640 1 -- start start 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb2057c2640 10 monclient: init 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb2057c2640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb2057c2640 10 monclient: _add_conns ranks=[10,8,3,7,6,5,4,9,0,1,2] 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb2057c2640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7fb20005c950 0x7fb20005cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb2057c2640 10 monclient(hunting): picked mon.noname-f con 0x7fb20005c950 addr v2:10.20.193.111:3300/0 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb2057c2640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb20005e490 0x7fb20005d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb2057c2640 10 monclient(hunting): picked mon.noname-e con 0x7fb20005e490 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb2057c2640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb20013db70 0x7fb20013e010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb2057c2640 10 monclient(hunting): picked mon.noname-g con 0x7fb20013db70 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb2057c2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb2057c2640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7fb20005ddd0 con 0x7fb20005c950 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb2057c2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb2057c2640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fb20005d7a0 con 0x7fb20013db70 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb2057c2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb2057c2640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fb200092990 con 0x7fb20005e490 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb2057c2640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb2057c2640 10 monclient(hunting): authenticate will time out at 1271.550631s 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb1fe7fc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb20005e490 0x7fb20005d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb1fe7fc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb20005e490 0x7fb20005d260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:33788/0 (socket says 10.20.193.48:33788) 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb1fe7fc640 1 -- 10.20.193.48:0/3324691687 learned_addr learned my addr 10.20.193.48:0/3324691687 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb1fe7fc640 10 monclient(hunting): get_auth_request con 0x7fb20005e490 auth_method 0 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb1fe7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb1fe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb1fe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb1feffd640 1 --2- 10.20.193.48:0/3324691687 >> v2:10.20.193.111:3300/0 conn(0x7fb20005c950 0x7fb20005cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb1fe7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb1fe7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:12.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb1fe7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:12.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb1ff7fe640 1 --2- 10.20.193.48:0/3324691687 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb20013db70 0x7fb20013e010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb1ff7fe640 10 monclient(hunting): get_auth_request con 0x7fb20013db70 auth_method 0 2026-02-12T18:17:12.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb1ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:12.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb1ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:12.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb1ff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:12.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb1feffd640 10 monclient(hunting): get_auth_request con 0x7fb20005c950 auth_method 0 2026-02-12T18:17:12.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb1feffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:12.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb1feffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:12.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.824+0000 7fb1feffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:12.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.825+0000 7fb1fe7fc640 10 monclient(hunting): handle_auth_done global_id 95048 payload 274 2026-02-12T18:17:12.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.825+0000 7fb1fe7fc640 1 -- 10.20.193.48:0/3324691687 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb20013db70 msgr2=0x7fb20013e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:12.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.825+0000 7fb1fe7fc640 1 --2- 10.20.193.48:0/3324691687 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb20013db70 0x7fb20013e010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.825+0000 7fb1fe7fc640 1 -- 10.20.193.48:0/3324691687 >> v2:10.20.193.111:3300/0 conn(0x7fb20005c950 msgr2=0x7fb20005cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:12.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.825+0000 7fb1fe7fc640 1 --2- 10.20.193.48:0/3324691687 >> v2:10.20.193.111:3300/0 conn(0x7fb20005c950 0x7fb20005cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.825+0000 7fb1fe7fc640 10 monclient: _finish_hunting 0 2026-02-12T18:17:12.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.825+0000 7fb1fe7fc640 1 monclient: found mon.noname-e 2026-02-12T18:17:12.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.825+0000 7fb1fe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:12.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.825+0000 7fb1fe7fc640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:17:12.827 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.825+0000 7fb1fe7fc640 1 -- 10.20.193.48:0/3324691687 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb20004dc20 con 0x7fb20005e490 2026-02-12T18:17:12.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.827+0000 7fb1fe7fc640 1 -- 10.20.193.48:0/3324691687 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb20005e490 msgr2=0x7fb20005d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:12.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.827+0000 7fb1fe7fc640 1 --2- 10.20.193.48:0/3324691687 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb20005e490 0x7fb20005d260 secure :-1 s=READY pgs=201 gs=1 cs=0 l=1 c_cookie=9292935688318138219 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1e8009060 tx=0x7fb1e802edf0 comp rx=0 tx=0).ready entity=mon.8 client_cookie=80f723c5bec0b76b server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.827+0000 7fb1fdffb640 1 -- 10.20.193.48:0/3324691687 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb1e8035340 con 0x7fb20005e490 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.827+0000 7fb1fdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.827+0000 7fb1fdffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.827+0000 7fb1fdffb640 10 monclient: dump: 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.827+0000 7fb1fdffb640 10 monclient: _finish_auth 0 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.827+0000 7fb1fdffb640 10 monclient: _check_auth_tickets 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.827+0000 7fb1fdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.827+0000 7fb1fdffb640 1 -- 10.20.193.48:0/3324691687 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1e80354c0 con 0x7fb20005e490 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.827+0000 7fb2057c2640 5 monclient: authenticate success, global_id 95048 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.827+0000 7fb2057c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.827+0000 7fb1fdffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.827+0000 7fb1fdffb640 1 -- 10.20.193.48:0/3324691687 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb1e8035af0 con 0x7fb20005e490 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.827+0000 7fb1fdffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.827+0000 7fb1fdffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.827+0000 7fb1fdffb640 10 monclient: dump: 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:12.829 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:12.830 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:12.830 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:12.830 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:12.830 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:12.830 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:12.830 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:12.830 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:12.830 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:12.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.827+0000 7fb2057c2640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:12.830 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.827+0000 7fb2057c2640 4 set_mon_vals no callback set 2026-02-12T18:17:12.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.828+0000 7fb2057c2640 10 monclient: shutdown 2026-02-12T18:17:12.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.828+0000 7fb2057c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:12.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.828+0000 7fb2057c2640 1 -- 10.20.193.48:0/3324691687 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb20005e490 msgr2=0x7fb20005d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:12.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.828+0000 7fb2057c2640 1 --2- 10.20.193.48:0/3324691687 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb20005e490 0x7fb20005d260 secure :-1 s=READY pgs=201 gs=1 cs=0 l=1 c_cookie=9292935688318138219 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1e8009060 tx=0x7fb1e802edf0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.828+0000 7fb2057c2640 1 -- 10.20.193.48:0/3324691687 shutdown_connections 2026-02-12T18:17:12.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.828+0000 7fb2057c2640 1 --2- 10.20.193.48:0/3324691687 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fb20013db70 0x7fb20013e010 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.828+0000 7fb2057c2640 1 --2- 10.20.193.48:0/3324691687 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb20005e490 0x7fb20005d260 unknown :-1 s=CLOSED pgs=201 gs=1 cs=0 l=1 c_cookie=9292935688318138219 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.828+0000 7fb2057c2640 1 --2- 10.20.193.48:0/3324691687 >> v2:10.20.193.111:3300/0 conn(0x7fb20005c950 0x7fb20005cd20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.828+0000 7fb2057c2640 1 -- 10.20.193.48:0/3324691687 >> 10.20.193.48:0/3324691687 conn(0x7fb2000548a0 msgr2=0x7fb200097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:12.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.828+0000 7fb2057c2640 1 -- 10.20.193.48:0/3324691687 shutdown_connections 2026-02-12T18:17:12.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.828+0000 7fb2057c2640 1 -- 10.20.193.48:0/3324691687 wait complete. 2026-02-12T18:17:12.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.828+0000 7fb2057c2640 10 monclient: build_initial_monmap 2026-02-12T18:17:12.831 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.828+0000 7fb2057c2640 10 monclient: monmap: 2026-02-12T18:17:12.831 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:12.831 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:12.831 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:12.831 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:12.831 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:12.831 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:12.831 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:12.831 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:12.831 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:12.831 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:12.831 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:12.831 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:12.831 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb2057c2640 1 Processor -- start 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb2057c2640 1 -- start start 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb2057c2640 10 monclient: init 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb2057c2640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb2057c2640 10 monclient: _add_conns ranks=[1,2,8,5,0,6,3,7,4] 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb2057c2640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb20005c950 0x7fb20013f360 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb2057c2640 10 monclient(hunting): picked mon.noname-f con 0x7fb20005c950 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb2057c2640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb20005e490 0x7fb20013f8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb2057c2640 10 monclient(hunting): picked mon.noname-b con 0x7fb20005e490 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb2057c2640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb20013db70 0x7fb20013fde0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb2057c2640 10 monclient(hunting): picked mon.noname-e con 0x7fb20013db70 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb2057c2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb2057c2640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb20008adf0 con 0x7fb20005c950 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb2057c2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb2057c2640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fb20013e830 con 0x7fb20005e490 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb2057c2640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb2057c2640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fb20013e3e0 con 0x7fb20013db70 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb2057c2640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb2057c2640 10 monclient(hunting): authenticate will time out at 1271.555311s 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1ff7fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb20013db70 0x7fb20013fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1ff7fe640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb20013db70 0x7fb20013fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:33800/0 (socket says 10.20.193.48:33800) 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1ff7fe640 1 -- 10.20.193.48:0/3910893347 learned_addr learned my addr 10.20.193.48:0/3910893347 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1ff7fe640 10 monclient(hunting): get_auth_request con 0x7fb20013db70 auth_method 0 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1ff7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1ff7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1fe7fc640 1 --2- 10.20.193.48:0/3910893347 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb20005e490 0x7fb20013f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1ff7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1fe7fc640 10 monclient(hunting): get_auth_request con 0x7fb20005e490 auth_method 0 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1fe7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1fe7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1fe7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1ff7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1ff7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1feffd640 1 --2- 10.20.193.48:0/3910893347 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb20005c950 0x7fb20013f360 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1ff7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1feffd640 10 monclient(hunting): get_auth_request con 0x7fb20005c950 auth_method 0 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1feffd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1feffd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:12.832 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1feffd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:12.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1fe7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:12.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1fe7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:12.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1fe7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:12.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1feffd640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:12.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1feffd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:12.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1feffd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:12.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1ff7fe640 10 monclient(hunting): handle_auth_done global_id 95057 payload 824 2026-02-12T18:17:12.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1ff7fe640 1 -- 10.20.193.48:0/3910893347 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb20005e490 msgr2=0x7fb20013f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:12.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1ff7fe640 1 --2- 10.20.193.48:0/3910893347 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb20005e490 0x7fb20013f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1ff7fe640 1 -- 10.20.193.48:0/3910893347 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb20005c950 msgr2=0x7fb20013f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:12.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1ff7fe640 1 --2- 10.20.193.48:0/3910893347 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb20005c950 0x7fb20013f360 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1ff7fe640 10 monclient: _finish_hunting 0 2026-02-12T18:17:12.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1ff7fe640 1 monclient: found mon.noname-e 2026-02-12T18:17:12.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1ff7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:12.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1ff7fe640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:17:12.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.829+0000 7fb1ff7fe640 1 -- 10.20.193.48:0/3910893347 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e80094f0 con 0x7fb20013db70 2026-02-12T18:17:12.833 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.831+0000 7fb1ff7fe640 1 -- 10.20.193.48:0/3910893347 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb20013db70 msgr2=0x7fb20013fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.831+0000 7fb1ff7fe640 1 --2- 10.20.193.48:0/3910893347 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb20013db70 0x7fb20013fde0 secure :-1 s=READY pgs=202 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1f000a340 tx=0x7fb1f000fc80 comp rx=0 tx=0).ready entity=mon.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.831+0000 7fb1df7fe640 1 -- 10.20.193.48:0/3910893347 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb1f000fe80 con 0x7fb20013db70 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.831+0000 7fb1df7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.831+0000 7fb1df7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.831+0000 7fb1df7fe640 10 monclient: dump: 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.831+0000 7fb1df7fe640 10 monclient: _finish_auth 0 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.831+0000 7fb1df7fe640 10 monclient: _check_auth_tickets 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.831+0000 7fb1df7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.831+0000 7fb1df7fe640 1 -- 10.20.193.48:0/3910893347 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f000dd70 con 0x7fb20013db70 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.831+0000 7fb1df7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.831+0000 7fb1df7fe640 1 -- 10.20.193.48:0/3910893347 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb1f00148d0 con 0x7fb20013db70 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.831+0000 7fb2057c2640 5 monclient: authenticate success, global_id 95057 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.831+0000 7fb2057c2640 10 monclient: _renew_subs 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.831+0000 7fb1fd7fa640 4 set_mon_vals no callback set 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.831+0000 7fb2057c2640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.831+0000 7fb2057c2640 1 -- 10.20.193.48:0/3910893347 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb200143a80 con 0x7fb20013db70 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.831+0000 7fb1df7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.831+0000 7fb1df7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.831+0000 7fb1df7fe640 10 monclient: dump: 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:12.834 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:12.835 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:12.835 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:12.835 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:12.835 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:12.835 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:12.835 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:12.835 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:12.835 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:12.835 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:12.835 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:12.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.831+0000 7fb2057c2640 10 monclient: _renew_subs 2026-02-12T18:17:12.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.831+0000 7fb2057c2640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:17:12.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.831+0000 7fb2057c2640 1 -- 10.20.193.48:0/3910893347 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({osdmap=0}) -- 0x7fb20008ab10 con 0x7fb20013db70 2026-02-12T18:17:12.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.832+0000 7fb2057c2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:12.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.832+0000 7fb2057c2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:12.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.832+0000 7fb2057c2640 10 monclient: _send_mon_message to mon.e at v2:10.20.193.48:3304/0 2026-02-12T18:17:12.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.832+0000 7fb2057c2640 1 -- 10.20.193.48:0/3910893347 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb20005cd20 con 0x7fb20013db70 2026-02-12T18:17:12.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.832+0000 7fb1df7fe640 1 -- 10.20.193.48:0/3910893347 <== mon.8 v2:10.20.193.48:3304/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fb1f0014410 con 0x7fb20013db70 2026-02-12T18:17:12.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.832+0000 7fb1df7fe640 1 --2- 10.20.193.48:0/3910893347 >> v2:10.20.193.111:6812/977811348 conn(0x7fb1cc03f800 0x7fb1cc05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:12.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.832+0000 7fb1df7fe640 1 -- 10.20.193.48:0/3910893347 <== mon.8 v2:10.20.193.48:3304/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7fb1f0053820 con 0x7fb20013db70 2026-02-12T18:17:12.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.833+0000 7fb1feffd640 1 --2- 10.20.193.48:0/3910893347 >> v2:10.20.193.111:6812/977811348 conn(0x7fb1cc03f800 0x7fb1cc05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:12.835 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.833+0000 7fb1feffd640 10 monclient: get_auth_request con 0x7fb1cc03f800 auth_method 0 2026-02-12T18:17:12.836 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.834+0000 7fb1df7fe640 1 -- 10.20.193.48:0/3910893347 <== mon.8 v2:10.20.193.48:3304/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fb1f0014a30 con 0x7fb20013db70 2026-02-12T18:17:12.836 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.834+0000 7fb1df7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:12.836 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.834+0000 7fb1df7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:17:12.836 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.835+0000 7fb1feffd640 1 --2- 10.20.193.48:0/3910893347 >> v2:10.20.193.111:6812/977811348 conn(0x7fb1cc03f800 0x7fb1cc05fcb0 secure :-1 s=READY pgs=490 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1f4004740 tx=0x7fb1f4008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:12.939 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.938+0000 7fb2057c2640 1 -- 10.20.193.48:0/3910893347 --> v2:10.20.193.111:6812/977811348 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7fb20013e5a0 con 0x7fb1cc03f800 2026-02-12T18:17:12.939 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.938+0000 7fb1df7fe640 1 -- 10.20.193.48:0/3910893347 <== mgr.4123 v2:10.20.193.111:6812/977811348 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb20013e5a0 con 0x7fb1cc03f800 2026-02-12T18:17:12.939 INFO:teuthology.orchestra.run.trial048.stderr:instructed osd(s) 1 to deep-scrub 2026-02-12T18:17:12.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.939+0000 7fb2057c2640 1 -- 10.20.193.48:0/3910893347 >> v2:10.20.193.111:6812/977811348 conn(0x7fb1cc03f800 msgr2=0x7fb1cc05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:12.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.939+0000 7fb2057c2640 1 --2- 10.20.193.48:0/3910893347 >> v2:10.20.193.111:6812/977811348 conn(0x7fb1cc03f800 0x7fb1cc05fcb0 secure :-1 s=READY pgs=490 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1f4004740 tx=0x7fb1f4008040 comp rx=0 tx=0).stop 2026-02-12T18:17:12.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.939+0000 7fb2057c2640 10 monclient: shutdown 2026-02-12T18:17:12.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.939+0000 7fb2057c2640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:12.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.939+0000 7fb2057c2640 1 -- 10.20.193.48:0/3910893347 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb20013db70 msgr2=0x7fb20013fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:12.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.939+0000 7fb2057c2640 1 --2- 10.20.193.48:0/3910893347 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb20013db70 0x7fb20013fde0 secure :-1 s=READY pgs=202 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb1f000a340 tx=0x7fb1f000fc80 comp rx=0 tx=0).stop 2026-02-12T18:17:12.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.939+0000 7fb2057c2640 1 -- 10.20.193.48:0/3910893347 shutdown_connections 2026-02-12T18:17:12.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.939+0000 7fb2057c2640 1 --2- 10.20.193.48:0/3910893347 >> v2:10.20.193.111:6812/977811348 conn(0x7fb1cc03f800 0x7fb1cc05fcb0 unknown :-1 s=CLOSED pgs=490 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.939+0000 7fb2057c2640 1 --2- 10.20.193.48:0/3910893347 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fb20013db70 0x7fb20013fde0 unknown :-1 s=CLOSED pgs=202 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.939+0000 7fb2057c2640 1 --2- 10.20.193.48:0/3910893347 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fb20005e490 0x7fb20013f8a0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.939+0000 7fb2057c2640 1 --2- 10.20.193.48:0/3910893347 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb20005c950 0x7fb20013f360 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:12.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.939+0000 7fb2057c2640 1 -- 10.20.193.48:0/3910893347 >> 10.20.193.48:0/3910893347 conn(0x7fb2000548a0 msgr2=0x7fb200093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:12.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.939+0000 7fb2057c2640 1 -- 10.20.193.48:0/3910893347 shutdown_connections 2026-02-12T18:17:12.941 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:12.939+0000 7fb2057c2640 1 -- 10.20.193.48:0/3910893347 wait complete. 2026-02-12T18:17:12.949 INFO:tasks.ceph:Scrubbing osd.2 2026-02-12T18:17:12.949 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2026-02-12T18:17:13.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.016+0000 7f815ab0c640 10 monclient: get_monmap_and_config 2026-02-12T18:17:13.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.017+0000 7f815ab0c640 10 monclient: build_initial_monmap 2026-02-12T18:17:13.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.017+0000 7f815ab0c640 10 monclient: monmap: 2026-02-12T18:17:13.022 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:13.022 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.022 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:13.018095+0000 2026-02-12T18:17:13.022 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:13.018095+0000 2026-02-12T18:17:13.022 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:13.022 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.022 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:13.023 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:13.023 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:13.023 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:13.023 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:13.023 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:13.023 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:13.023 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:13.023 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:13.023 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:13.023 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:13.023 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.017+0000 7f815ab0c640 1 Processor -- start 2026-02-12T18:17:13.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.017+0000 7f815ab0c640 1 -- start start 2026-02-12T18:17:13.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.017+0000 7f815ab0c640 10 monclient: init 2026-02-12T18:17:13.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.017+0000 7f815ab0c640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:13.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f815ab0c640 10 monclient: _add_conns ranks=[9,8,10,4,5,2,6,7,0,3,1] 2026-02-12T18:17:13.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f815ab0c640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f815405db90 0x7f8154144290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f815ab0c640 10 monclient(hunting): picked mon.noname-a con 0x7f815405db90 addr v2:10.20.193.48:3300/0 2026-02-12T18:17:13.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f815ab0c640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f815405df60 0x7f815405e330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f815ab0c640 10 monclient(hunting): picked mon.noname-e con 0x7f815405df60 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:17:13.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f815ab0c640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7f8154089df0 0x7f815408a290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f815ab0c640 10 monclient(hunting): picked mon.noname-f con 0x7f8154089df0 addr v2:10.20.193.111:3300/0 2026-02-12T18:17:13.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f815ab0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f815ab0c640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7f81540573d0 con 0x7f815405db90 2026-02-12T18:17:13.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f815ab0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f815ab0c640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7f81540933e0 con 0x7f8154089df0 2026-02-12T18:17:13.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f815ab0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f815ab0c640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f81540936c0 con 0x7f815405df60 2026-02-12T18:17:13.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f815ab0c640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:13.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f815ab0c640 10 monclient(hunting): authenticate will time out at 1271.744060s 2026-02-12T18:17:13.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f8158881640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f815405db90 0x7f8154144290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f8158881640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7f815405db90 0x7f8154144290 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:55014/0 (socket says 10.20.193.48:55014) 2026-02-12T18:17:13.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f8158881640 1 -- 10.20.193.48:0/1279551418 learned_addr learned my addr 10.20.193.48:0/1279551418 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:13.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f8158881640 10 monclient(hunting): get_auth_request con 0x7f815405db90 auth_method 0 2026-02-12T18:17:13.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f8158881640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.025 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f8158881640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f8158881640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f814bfff640 1 --2- 10.20.193.48:0/1279551418 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f815405df60 0x7f815405e330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f814bfff640 10 monclient(hunting): get_auth_request con 0x7f815405df60 auth_method 0 2026-02-12T18:17:13.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f814bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f814bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f814bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f8158881640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f8158881640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f8158881640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f8159082640 1 --2- 10.20.193.48:0/1279551418 >> v2:10.20.193.111:3300/0 conn(0x7f8154089df0 0x7f815408a290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f814bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f814bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f814bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f8159082640 10 monclient(hunting): get_auth_request con 0x7f8154089df0 auth_method 0 2026-02-12T18:17:13.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f8159082640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f8159082640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f8159082640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f8158881640 10 monclient(hunting): handle_auth_done global_id 7137 payload 274 2026-02-12T18:17:13.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f8158881640 1 -- 10.20.193.48:0/1279551418 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f815405df60 msgr2=0x7f815405e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:13.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f8158881640 1 --2- 10.20.193.48:0/1279551418 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f815405df60 0x7f815405e330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f8158881640 1 -- 10.20.193.48:0/1279551418 >> v2:10.20.193.111:3300/0 conn(0x7f8154089df0 msgr2=0x7f815408a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:13.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f8158881640 1 --2- 10.20.193.48:0/1279551418 >> v2:10.20.193.111:3300/0 conn(0x7f8154089df0 0x7f815408a290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f8158881640 10 monclient: _finish_hunting 0 2026-02-12T18:17:13.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f8158881640 1 monclient: found mon.noname-a 2026-02-12T18:17:13.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f8158881640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:13.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f8158881640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:17:13.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.018+0000 7f8158881640 1 -- 10.20.193.48:0/1279551418 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8154060390 con 0x7f815405db90 2026-02-12T18:17:13.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.020+0000 7f8158881640 1 -- 10.20.193.48:0/1279551418 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f815405db90 msgr2=0x7f8154144290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:13.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.020+0000 7f8158881640 1 --2- 10.20.193.48:0/1279551418 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f815405db90 0x7f8154144290 secure :-1 s=READY pgs=739 gs=1 cs=0 l=1 c_cookie=12822524921166146209 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f81540579d0 tx=0x7f814402edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f2c27aa9b3aaa1 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:13.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f814b7fe640 1 -- 10.20.193.48:0/1279551418 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8144035340 con 0x7f815405db90 2026-02-12T18:17:13.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f814b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f814b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:17:13.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f814b7fe640 10 monclient: dump: 2026-02-12T18:17:13.035 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.036 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.036 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.036 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.036 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.036 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.036 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.036 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.036 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.036 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.036 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.036 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.036 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.036 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.036 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.037 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f814b7fe640 10 monclient: _finish_auth 0 2026-02-12T18:17:13.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f814b7fe640 10 monclient: _check_auth_tickets 2026-02-12T18:17:13.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f814b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:13.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f814b7fe640 1 -- 10.20.193.48:0/1279551418 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81440354c0 con 0x7f815405db90 2026-02-12T18:17:13.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f815ab0c640 5 monclient: authenticate success, global_id 7137 2026-02-12T18:17:13.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f815ab0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:17:13.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f814b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:13.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f814b7fe640 1 -- 10.20.193.48:0/1279551418 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f8144035af0 con 0x7f815405db90 2026-02-12T18:17:13.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f814b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f814b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:17:13.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f814b7fe640 10 monclient: dump: 2026-02-12T18:17:13.037 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.038 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.038 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.038 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.038 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.038 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.038 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.038 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.038 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.038 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.038 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.038 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.038 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.038 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.038 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.039 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f815ab0c640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:13.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f815ab0c640 4 set_mon_vals no callback set 2026-02-12T18:17:13.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f815ab0c640 10 monclient: shutdown 2026-02-12T18:17:13.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f815ab0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:13.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f815ab0c640 1 -- 10.20.193.48:0/1279551418 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f815405db90 msgr2=0x7f8154144290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f815ab0c640 1 --2- 10.20.193.48:0/1279551418 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f815405db90 0x7f8154144290 secure :-1 s=READY pgs=739 gs=1 cs=0 l=1 c_cookie=12822524921166146209 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f81540579d0 tx=0x7f814402edb0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f815ab0c640 1 -- 10.20.193.48:0/1279551418 shutdown_connections 2026-02-12T18:17:13.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f815ab0c640 1 --2- 10.20.193.48:0/1279551418 >> v2:10.20.193.111:3300/0 conn(0x7f8154089df0 0x7f815408a290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f815ab0c640 1 --2- 10.20.193.48:0/1279551418 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f815405df60 0x7f815405e330 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f815ab0c640 1 --2- 10.20.193.48:0/1279551418 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f815405db90 0x7f8154144290 unknown :-1 s=CLOSED pgs=739 gs=1 cs=0 l=1 c_cookie=12822524921166146209 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f815ab0c640 1 -- 10.20.193.48:0/1279551418 >> 10.20.193.48:0/1279551418 conn(0x7f8154096410 msgr2=0x7f8154097cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:13.039 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f815ab0c640 1 -- 10.20.193.48:0/1279551418 shutdown_connections 2026-02-12T18:17:13.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f815ab0c640 1 -- 10.20.193.48:0/1279551418 wait complete. 2026-02-12T18:17:13.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f815ab0c640 10 monclient: build_initial_monmap 2026-02-12T18:17:13.040 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.021+0000 7f815ab0c640 10 monclient: monmap: 2026-02-12T18:17:13.040 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:13.040 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:13.040 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:13.040 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:13.040 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:13.040 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.040 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:13.040 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:13.040 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:13.040 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:13.040 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:13.040 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:13.041 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:13.041 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:13.041 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:13.041 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.041 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f815ab0c640 1 Processor -- start 2026-02-12T18:17:13.041 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f815ab0c640 1 -- start start 2026-02-12T18:17:13.041 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f815ab0c640 10 monclient: init 2026-02-12T18:17:13.041 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f815ab0c640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:13.041 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f815ab0c640 10 monclient: _add_conns ranks=[5,1,6,2,0,3,7,4,8] 2026-02-12T18:17:13.041 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f815ab0c640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f815405db90 0x7f8154133650 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.041 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f815ab0c640 10 monclient(hunting): picked mon.noname-h con 0x7f815405db90 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:17:13.041 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f815ab0c640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f815405df60 0x7f8154133b90 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.041 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f815ab0c640 10 monclient(hunting): picked mon.noname-f con 0x7f815405df60 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:17:13.041 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f815ab0c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8154089df0 0x7f815408b3e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.041 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f815ab0c640 10 monclient(hunting): picked mon.noname-d con 0x7f8154089df0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:17:13.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f815ab0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f815ab0c640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7f81541340d0 con 0x7f815405df60 2026-02-12T18:17:13.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f815ab0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f815ab0c640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f815408cc40 con 0x7f815405db90 2026-02-12T18:17:13.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f815ab0c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f815ab0c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f8154094000 con 0x7f8154089df0 2026-02-12T18:17:13.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f815ab0c640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:13.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f815ab0c640 10 monclient(hunting): authenticate will time out at 1271.748401s 2026-02-12T18:17:13.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8159082640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8154089df0 0x7f815408b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8159082640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8154089df0 0x7f815408b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:51862/0 (socket says 10.20.193.48:51862) 2026-02-12T18:17:13.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8159082640 1 -- 10.20.193.48:0/1899507552 learned_addr learned my addr 10.20.193.48:0/1899507552 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:13.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8159082640 10 monclient(hunting): get_auth_request con 0x7f8154089df0 auth_method 0 2026-02-12T18:17:13.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8159082640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8159082640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.042 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8159082640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8158881640 1 --2- 10.20.193.48:0/1899507552 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f815405db90 0x7f8154133650 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8159082640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8159082640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f814bfff640 1 --2- 10.20.193.48:0/1899507552 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f815405df60 0x7f8154133b90 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8159082640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f814bfff640 10 monclient(hunting): get_auth_request con 0x7f815405df60 auth_method 0 2026-02-12T18:17:13.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f814bfff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f814bfff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f814bfff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8158881640 10 monclient(hunting): get_auth_request con 0x7f815405db90 auth_method 0 2026-02-12T18:17:13.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8158881640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8158881640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8158881640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f814bfff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.043 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f814bfff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f814bfff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8158881640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8158881640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8158881640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8159082640 10 monclient(hunting): handle_auth_done global_id 114234 payload 824 2026-02-12T18:17:13.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8159082640 1 -- 10.20.193.48:0/1899507552 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f815405db90 msgr2=0x7f8154133650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8159082640 1 --2- 10.20.193.48:0/1899507552 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f815405db90 0x7f8154133650 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8159082640 1 -- 10.20.193.48:0/1899507552 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f815405df60 msgr2=0x7f8154133b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8159082640 1 --2- 10.20.193.48:0/1899507552 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7f815405df60 0x7f8154133b90 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8159082640 10 monclient: _finish_hunting 0 2026-02-12T18:17:13.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8159082640 1 monclient: found mon.noname-d 2026-02-12T18:17:13.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8159082640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:13.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8159082640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:17:13.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.022+0000 7f8159082640 1 -- 10.20.193.48:0/1899507552 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81440094f0 con 0x7f8154089df0 2026-02-12T18:17:13.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.024+0000 7f8159082640 1 -- 10.20.193.48:0/1899507552 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8154089df0 msgr2=0x7f815408b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:13.044 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.024+0000 7f8159082640 1 --2- 10.20.193.48:0/1899507552 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8154089df0 0x7f815408b3e0 secure :-1 s=READY pgs=30 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f815000afd0 tx=0x7f815000fc80 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:13.045 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.025+0000 7f81497fa640 1 -- 10.20.193.48:0/1899507552 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f815000fe80 con 0x7f8154089df0 2026-02-12T18:17:13.045 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.025+0000 7f81497fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.045 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.025+0000 7f81497fa640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:17:13.045 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.025+0000 7f81497fa640 10 monclient: dump: 2026-02-12T18:17:13.045 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.045 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.045 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.045 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.045 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.045 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.045 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.045 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.045 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.045 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.045 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.046 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.046 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.046 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.046 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.046 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.046 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.025+0000 7f81497fa640 10 monclient: _finish_auth 0 2026-02-12T18:17:13.046 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.025+0000 7f81497fa640 10 monclient: _check_auth_tickets 2026-02-12T18:17:13.046 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.025+0000 7f81497fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:13.046 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.025+0000 7f81497fa640 1 -- 10.20.193.48:0/1899507552 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f815000dda0 con 0x7f8154089df0 2026-02-12T18:17:13.046 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.025+0000 7f81497fa640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:13.046 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.025+0000 7f81497fa640 1 -- 10.20.193.48:0/1899507552 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f81500148d0 con 0x7f8154089df0 2026-02-12T18:17:13.046 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.025+0000 7f81497fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.046 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.025+0000 7f814affd640 4 set_mon_vals no callback set 2026-02-12T18:17:13.046 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.025+0000 7f81497fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:17:13.046 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.025+0000 7f81497fa640 10 monclient: dump: 2026-02-12T18:17:13.047 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.047 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.047 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.047 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.047 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.047 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.047 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.047 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.047 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.047 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.047 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.047 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.047 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.047 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.047 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.047 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.047 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.025+0000 7f815ab0c640 5 monclient: authenticate success, global_id 114234 2026-02-12T18:17:13.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.025+0000 7f815ab0c640 10 monclient: _renew_subs 2026-02-12T18:17:13.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.025+0000 7f815ab0c640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:17:13.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.025+0000 7f815ab0c640 1 -- 10.20.193.48:0/1899507552 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f815410e370 con 0x7f8154089df0 2026-02-12T18:17:13.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.025+0000 7f815ab0c640 10 monclient: _renew_subs 2026-02-12T18:17:13.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.025+0000 7f815ab0c640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:17:13.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.025+0000 7f815ab0c640 1 -- 10.20.193.48:0/1899507552 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f8154128380 con 0x7f8154089df0 2026-02-12T18:17:13.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.025+0000 7f815ab0c640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:17:13.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.025+0000 7f815ab0c640 1 -- 10.20.193.48:0/1899507552 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f81541447d0 con 0x7f8154089df0 2026-02-12T18:17:13.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.025+0000 7f81497fa640 1 -- 10.20.193.48:0/1899507552 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f8150014410 con 0x7f8154089df0 2026-02-12T18:17:13.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.026+0000 7f81497fa640 1 --2- 10.20.193.48:0/1899507552 >> v2:10.20.193.111:6812/977811348 conn(0x7f812403f800 0x7f812405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.026+0000 7f81497fa640 1 -- 10.20.193.48:0/1899507552 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7f8150053b40 con 0x7f8154089df0 2026-02-12T18:17:13.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.026+0000 7f81497fa640 1 --2- 10.20.193.48:0/1899507552 >> v2:10.20.193.48:6800/2690693575 conn(0x7f8124063340 0x7f8124083750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.026+0000 7f81497fa640 1 -- 10.20.193.48:0/1899507552 --> v2:10.20.193.48:6800/2690693575 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8124083dc0 con 0x7f8124063340 2026-02-12T18:17:13.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.026+0000 7f81497fa640 1 -- 10.20.193.48:0/1899507552 <== mon.6 v2:10.20.193.48:3303/0 6 ==== mon_get_version_reply(handle=1 version=322) ==== 24+0+0 (secure 0 0 0) 0x7f8150053de0 con 0x7f8154089df0 2026-02-12T18:17:13.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.026+0000 7f81497fa640 10 monclient: handle_get_version_reply finishing 1 version 322 2026-02-12T18:17:13.048 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.026+0000 7f8158881640 1 --2- 10.20.193.48:0/1899507552 >> v2:10.20.193.111:6812/977811348 conn(0x7f812403f800 0x7f812405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.049 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.026+0000 7f8158881640 10 monclient: get_auth_request con 0x7f812403f800 auth_method 0 2026-02-12T18:17:13.049 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.026+0000 7f814bfff640 1 --2- 10.20.193.48:0/1899507552 >> v2:10.20.193.48:6800/2690693575 conn(0x7f8124063340 0x7f8124083750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.049 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.026+0000 7f814bfff640 10 monclient: get_auth_request con 0x7f8124063340 auth_method 0 2026-02-12T18:17:13.049 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.028+0000 7f8158881640 1 --2- 10.20.193.48:0/1899507552 >> v2:10.20.193.111:6812/977811348 conn(0x7f812403f800 0x7f812405fcb0 secure :-1 s=READY pgs=491 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f814402edf0 tx=0x7f8144033000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:13.049 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.030+0000 7f814bfff640 1 --2- 10.20.193.48:0/1899507552 >> v2:10.20.193.48:6800/2690693575 conn(0x7f8124063340 0x7f8124083750 crc :-1 s=READY pgs=188 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:13.049 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.031+0000 7f81497fa640 1 -- 10.20.193.48:0/1899507552 <== osd.2 v2:10.20.193.48:6800/2690693575 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7f8124083dc0 con 0x7f8124063340 2026-02-12T18:17:13.049 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.038+0000 7f815ab0c640 1 -- 10.20.193.48:0/1899507552 --> v2:10.20.193.48:6800/2690693575 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8154144290 con 0x7f8124063340 2026-02-12T18:17:13.049 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.038+0000 7f81497fa640 1 -- 10.20.193.48:0/1899507552 <== osd.2 v2:10.20.193.48:6800/2690693575 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8154144290 con 0x7f8124063340 2026-02-12T18:17:13.050 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:17:13.050 INFO:teuthology.orchestra.run.trial048.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T18:17:13.050 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:17:13.051 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.038+0000 7f815ab0c640 1 -- 10.20.193.48:0/1899507552 >> v2:10.20.193.48:6800/2690693575 conn(0x7f8124063340 msgr2=0x7f8124083750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.051 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.038+0000 7f815ab0c640 1 --2- 10.20.193.48:0/1899507552 >> v2:10.20.193.48:6800/2690693575 conn(0x7f8124063340 0x7f8124083750 crc :-1 s=READY pgs=188 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.051 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.038+0000 7f815ab0c640 1 -- 10.20.193.48:0/1899507552 >> v2:10.20.193.111:6812/977811348 conn(0x7f812403f800 msgr2=0x7f812405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.051 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.038+0000 7f815ab0c640 1 --2- 10.20.193.48:0/1899507552 >> v2:10.20.193.111:6812/977811348 conn(0x7f812403f800 0x7f812405fcb0 secure :-1 s=READY pgs=491 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f814402edf0 tx=0x7f8144033000 comp rx=0 tx=0).stop 2026-02-12T18:17:13.051 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.038+0000 7f815ab0c640 10 monclient: shutdown 2026-02-12T18:17:13.051 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.038+0000 7f815ab0c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:13.051 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.038+0000 7f815ab0c640 1 -- 10.20.193.48:0/1899507552 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8154089df0 msgr2=0x7f815408b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.051 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.038+0000 7f815ab0c640 1 --2- 10.20.193.48:0/1899507552 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f8154089df0 0x7f815408b3e0 secure :-1 s=READY pgs=30 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f815000afd0 tx=0x7f815000fc80 comp rx=0 tx=0).stop 2026-02-12T18:17:13.052 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.038+0000 7f8159082640 1 -- 10.20.193.48:0/1899507552 reap_dead start 2026-02-12T18:17:13.052 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.038+0000 7f815ab0c640 1 -- 10.20.193.48:0/1899507552 shutdown_connections 2026-02-12T18:17:13.052 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.038+0000 7f815ab0c640 1 -- 10.20.193.48:0/1899507552 >> 10.20.193.48:0/1899507552 conn(0x7f8154096410 msgr2=0x7f815405d140 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:13.052 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.038+0000 7f815ab0c640 1 -- 10.20.193.48:0/1899507552 shutdown_connections 2026-02-12T18:17:13.052 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.038+0000 7f815ab0c640 1 -- 10.20.193.48:0/1899507552 wait complete. 2026-02-12T18:17:13.052 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2026-02-12T18:17:13.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.118+0000 7fc55110c640 10 monclient: get_monmap_and_config 2026-02-12T18:17:13.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.118+0000 7fc55110c640 10 monclient: build_initial_monmap 2026-02-12T18:17:13.120 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.118+0000 7fc55110c640 10 monclient: monmap: 2026-02-12T18:17:13.120 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:13.120 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.120 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:13.119792+0000 2026-02-12T18:17:13.120 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:13.119792+0000 2026-02-12T18:17:13.120 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:13.121 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.121 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:13.121 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:13.121 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:13.121 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:13.121 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:13.121 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:13.121 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:13.121 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:13.121 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:13.121 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:13.121 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:13.122 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc55110c640 1 Processor -- start 2026-02-12T18:17:13.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc55110c640 1 -- start start 2026-02-12T18:17:13.130 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc55110c640 10 monclient: init 2026-02-12T18:17:13.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc55110c640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:13.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc55110c640 10 monclient: _add_conns ranks=[4,10,6,3,8,9,5,0,1,2,7] 2026-02-12T18:17:13.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc55110c640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc54c05d550 0x7fc54c05d920 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc55110c640 10 monclient(hunting): picked mon.noname-c con 0x7fc54c05d550 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:17:13.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc55110c640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7fc54c05de60 0x7fc54c141fa0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc55110c640 10 monclient(hunting): picked mon.noname-f con 0x7fc54c05de60 addr v2:10.20.193.111:3300/0 2026-02-12T18:17:13.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc55110c640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc54c13ef60 0x7fc54c1424e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc55110c640 10 monclient(hunting): picked mon.noname-d con 0x7fc54c13ef60 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:17:13.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc55110c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.131 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc55110c640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7fc54c08d390 con 0x7fc54c05de60 2026-02-12T18:17:13.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc55110c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc55110c640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fc54c08d5a0 con 0x7fc54c05d550 2026-02-12T18:17:13.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc55110c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc55110c640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fc54c0580e0 con 0x7fc54c13ef60 2026-02-12T18:17:13.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc55110c640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:13.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc55110c640 10 monclient(hunting): authenticate will time out at 1271.845515s 2026-02-12T18:17:13.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54b577640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc54c13ef60 0x7fc54c1424e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54ad76640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc54c05d550 0x7fc54c05d920 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54b577640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc54c13ef60 0x7fc54c1424e0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:51878/0 (socket says 10.20.193.48:51878) 2026-02-12T18:17:13.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54b577640 1 -- 10.20.193.48:0/2655081283 learned_addr learned my addr 10.20.193.48:0/2655081283 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:13.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54b577640 10 monclient(hunting): get_auth_request con 0x7fc54c13ef60 auth_method 0 2026-02-12T18:17:13.132 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54b577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54b577640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54ad76640 10 monclient(hunting): get_auth_request con 0x7fc54c05d550 auth_method 0 2026-02-12T18:17:13.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54ad76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54a575640 1 --2- 10.20.193.48:0/2655081283 >> v2:10.20.193.111:3300/0 conn(0x7fc54c05de60 0x7fc54c141fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54a575640 10 monclient(hunting): get_auth_request con 0x7fc54c05de60 auth_method 0 2026-02-12T18:17:13.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54a575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.133 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54b577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54b577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54b577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54b577640 10 monclient(hunting): handle_auth_done global_id 114243 payload 274 2026-02-12T18:17:13.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54b577640 1 -- 10.20.193.48:0/2655081283 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc54c05d550 msgr2=0x7fc54c05d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:13.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54b577640 1 --2- 10.20.193.48:0/2655081283 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc54c05d550 0x7fc54c05d920 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.134 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54b577640 1 -- 10.20.193.48:0/2655081283 >> v2:10.20.193.111:3300/0 conn(0x7fc54c05de60 msgr2=0x7fc54c141fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:13.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54b577640 1 --2- 10.20.193.48:0/2655081283 >> v2:10.20.193.111:3300/0 conn(0x7fc54c05de60 0x7fc54c141fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54b577640 10 monclient: _finish_hunting 0 2026-02-12T18:17:13.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54b577640 1 monclient: found mon.noname-d 2026-02-12T18:17:13.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54b577640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:13.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54b577640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:17:13.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.119+0000 7fc54b577640 1 -- 10.20.193.48:0/2655081283 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc54c04dc20 con 0x7fc54c13ef60 2026-02-12T18:17:13.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc54b577640 1 -- 10.20.193.48:0/2655081283 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc54c13ef60 msgr2=0x7fc54c1424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:13.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc54b577640 1 --2- 10.20.193.48:0/2655081283 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc54c13ef60 0x7fc54c1424e0 secure :-1 s=READY pgs=31 gs=2 cs=0 l=1 c_cookie=625226604107921666 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc53c00a140 tx=0x7fc53c02fed0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=8ad4048a9f9f902 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:13.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc549d74640 1 -- 10.20.193.48:0/2655081283 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc53c030b50 con 0x7fc54c13ef60 2026-02-12T18:17:13.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc549d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc549d74640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:17:13.135 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc549d74640 10 monclient: dump: 2026-02-12T18:17:13.136 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.136 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.136 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.136 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.136 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.136 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.136 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.136 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.136 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.136 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.136 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.136 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.137 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.137 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.137 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.137 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc549d74640 10 monclient: _finish_auth 0 2026-02-12T18:17:13.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc549d74640 10 monclient: _check_auth_tickets 2026-02-12T18:17:13.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc549d74640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:13.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc549d74640 1 -- 10.20.193.48:0/2655081283 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc53c030cd0 con 0x7fc54c13ef60 2026-02-12T18:17:13.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc549d74640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:13.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc55110c640 5 monclient: authenticate success, global_id 114243 2026-02-12T18:17:13.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc549d74640 1 -- 10.20.193.48:0/2655081283 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc53c030e40 con 0x7fc54c13ef60 2026-02-12T18:17:13.137 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc55110c640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:13.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc55110c640 4 set_mon_vals no callback set 2026-02-12T18:17:13.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc549d74640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc549d74640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:17:13.138 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc549d74640 10 monclient: dump: 2026-02-12T18:17:13.138 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.138 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.138 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.138 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.138 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.138 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.138 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.138 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.139 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.139 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.139 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.139 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.139 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.139 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.139 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.139 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc55110c640 10 monclient: shutdown 2026-02-12T18:17:13.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc55110c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:13.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc55110c640 1 -- 10.20.193.48:0/2655081283 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc54c13ef60 msgr2=0x7fc54c1424e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.139 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc55110c640 1 --2- 10.20.193.48:0/2655081283 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc54c13ef60 0x7fc54c1424e0 secure :-1 s=READY pgs=31 gs=2 cs=0 l=1 c_cookie=625226604107921666 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc53c00a140 tx=0x7fc53c02fed0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc55110c640 1 -- 10.20.193.48:0/2655081283 shutdown_connections 2026-02-12T18:17:13.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc55110c640 1 --2- 10.20.193.48:0/2655081283 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fc54c13ef60 0x7fc54c1424e0 unknown :-1 s=CLOSED pgs=31 gs=2 cs=0 l=1 c_cookie=625226604107921666 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc55110c640 1 --2- 10.20.193.48:0/2655081283 >> v2:10.20.193.111:3300/0 conn(0x7fc54c05de60 0x7fc54c141fa0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc55110c640 1 --2- 10.20.193.48:0/2655081283 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fc54c05d550 0x7fc54c05d920 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc55110c640 1 -- 10.20.193.48:0/2655081283 >> 10.20.193.48:0/2655081283 conn(0x7fc54c0546a0 msgr2=0x7fc54c054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:13.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc55110c640 1 -- 10.20.193.48:0/2655081283 shutdown_connections 2026-02-12T18:17:13.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.122+0000 7fc55110c640 1 -- 10.20.193.48:0/2655081283 wait complete. 2026-02-12T18:17:13.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.123+0000 7fc55110c640 10 monclient: build_initial_monmap 2026-02-12T18:17:13.140 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.123+0000 7fc55110c640 10 monclient: monmap: 2026-02-12T18:17:13.140 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:13.140 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:13.140 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:13.141 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:13.141 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:13.141 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.141 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:13.141 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:13.141 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:13.141 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:13.141 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:13.141 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:13.141 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:13.141 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:13.141 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:13.142 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.123+0000 7fc55110c640 1 Processor -- start 2026-02-12T18:17:13.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.123+0000 7fc55110c640 1 -- start start 2026-02-12T18:17:13.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.123+0000 7fc55110c640 10 monclient: init 2026-02-12T18:17:13.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc55110c640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:13.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc55110c640 10 monclient: _add_conns ranks=[0,3,1,4,8,7,5,6,2] 2026-02-12T18:17:13.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc55110c640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fc54c05d550 0x7fc54c13c430 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc55110c640 10 monclient(hunting): picked mon.noname-a con 0x7fc54c05d550 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:17:13.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc55110c640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc54c05de60 0x7fc54c08a680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc55110c640 10 monclient(hunting): picked mon.noname-g con 0x7fc54c05de60 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:17:13.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc55110c640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fc54c13ef60 0x7fc54c08abc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.142 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc55110c640 10 monclient(hunting): picked mon.noname-f con 0x7fc54c13ef60 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:17:13.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc55110c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc55110c640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c132860 con 0x7fc54c05d550 2026-02-12T18:17:13.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc55110c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc55110c640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc54c08c1d0 con 0x7fc54c13ef60 2026-02-12T18:17:13.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc55110c640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc55110c640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fc54c10f150 con 0x7fc54c05de60 2026-02-12T18:17:13.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc55110c640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:13.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc55110c640 10 monclient(hunting): authenticate will time out at 1271.850110s 2026-02-12T18:17:13.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54ad76640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fc54c05d550 0x7fc54c13c430 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54ad76640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fc54c05d550 0x7fc54c13c430 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:55026/0 (socket says 10.20.193.48:55026) 2026-02-12T18:17:13.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54ad76640 1 -- 10.20.193.48:0/1635491906 learned_addr learned my addr 10.20.193.48:0/1635491906 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:13.143 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54ad76640 10 monclient(hunting): get_auth_request con 0x7fc54c05d550 auth_method 0 2026-02-12T18:17:13.144 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54ad76640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.144 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54ad76640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.144 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54ad76640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.144 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54a575640 1 --2- 10.20.193.48:0/1635491906 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc54c05de60 0x7fc54c08a680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.144 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54a575640 10 monclient(hunting): get_auth_request con 0x7fc54c05de60 auth_method 0 2026-02-12T18:17:13.144 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54a575640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.144 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54a575640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.144 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54a575640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.144 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54ad76640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.144 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54ad76640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.144 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54ad76640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.144 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54b577640 1 --2- 10.20.193.48:0/1635491906 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fc54c13ef60 0x7fc54c08abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54b577640 10 monclient(hunting): get_auth_request con 0x7fc54c13ef60 auth_method 0 2026-02-12T18:17:13.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54b577640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54b577640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54b577640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54a575640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54a575640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54a575640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54b577640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54b577640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54b577640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54ad76640 10 monclient(hunting): handle_auth_done global_id 7146 payload 824 2026-02-12T18:17:13.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54ad76640 1 -- 10.20.193.48:0/1635491906 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc54c05de60 msgr2=0x7fc54c08a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.145 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54ad76640 1 --2- 10.20.193.48:0/1635491906 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc54c05de60 0x7fc54c08a680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54ad76640 1 -- 10.20.193.48:0/1635491906 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fc54c13ef60 msgr2=0x7fc54c08abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54ad76640 1 --2- 10.20.193.48:0/1635491906 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fc54c13ef60 0x7fc54c08abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54ad76640 10 monclient: _finish_hunting 0 2026-02-12T18:17:13.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54ad76640 1 monclient: found mon.noname-a 2026-02-12T18:17:13.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54ad76640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:13.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54ad76640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:17:13.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.124+0000 7fc54ad76640 1 -- 10.20.193.48:0/1635491906 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc53c00a5d0 con 0x7fc54c05d550 2026-02-12T18:17:13.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.126+0000 7fc54ad76640 1 -- 10.20.193.48:0/1635491906 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fc54c05d550 msgr2=0x7fc54c13c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:13.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.126+0000 7fc54ad76640 1 --2- 10.20.193.48:0/1635491906 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fc54c05d550 0x7fc54c13c430 secure :-1 s=READY pgs=740 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc540006b40 tx=0x7fc54000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:13.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.126+0000 7fc52b7fe640 1 -- 10.20.193.48:0/1635491906 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc540013470 con 0x7fc54c05d550 2026-02-12T18:17:13.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.126+0000 7fc52b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.126+0000 7fc52b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:17:13.146 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.126+0000 7fc52b7fe640 10 monclient: dump: 2026-02-12T18:17:13.147 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.147 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.147 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.147 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.147 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.147 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.147 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.147 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.147 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.147 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.147 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.147 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.147 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.147 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.148 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.148 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.126+0000 7fc52b7fe640 10 monclient: _finish_auth 0 2026-02-12T18:17:13.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.126+0000 7fc52b7fe640 10 monclient: _check_auth_tickets 2026-02-12T18:17:13.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.126+0000 7fc52b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:13.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.126+0000 7fc52b7fe640 1 -- 10.20.193.48:0/1635491906 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5400135d0 con 0x7fc54c05d550 2026-02-12T18:17:13.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.126+0000 7fc52b7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:13.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.126+0000 7fc52b7fe640 1 -- 10.20.193.48:0/1635491906 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc540013c00 con 0x7fc54c05d550 2026-02-12T18:17:13.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.126+0000 7fc52b7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.126+0000 7fc549573640 4 set_mon_vals no callback set 2026-02-12T18:17:13.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.126+0000 7fc52b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:17:13.148 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.126+0000 7fc52b7fe640 10 monclient: dump: 2026-02-12T18:17:13.148 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.149 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.149 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.149 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.149 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.149 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.149 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.149 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.149 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.149 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.149 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.149 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.149 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.149 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.149 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.150 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.126+0000 7fc55110c640 5 monclient: authenticate success, global_id 7146 2026-02-12T18:17:13.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.126+0000 7fc55110c640 10 monclient: _renew_subs 2026-02-12T18:17:13.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.126+0000 7fc55110c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:13.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.126+0000 7fc55110c640 1 -- 10.20.193.48:0/1635491906 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc54c08bce0 con 0x7fc54c05d550 2026-02-12T18:17:13.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.127+0000 7fc55110c640 10 monclient: _renew_subs 2026-02-12T18:17:13.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.127+0000 7fc55110c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:13.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.127+0000 7fc55110c640 1 -- 10.20.193.48:0/1635491906 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc54c1208d0 con 0x7fc54c05d550 2026-02-12T18:17:13.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.127+0000 7fc55110c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:13.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.127+0000 7fc55110c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:13.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.127+0000 7fc55110c640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:13.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.127+0000 7fc55110c640 1 -- 10.20.193.48:0/1635491906 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc54c10ead0 con 0x7fc54c05d550 2026-02-12T18:17:13.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.127+0000 7fc52b7fe640 1 -- 10.20.193.48:0/1635491906 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fc540011070 con 0x7fc54c05d550 2026-02-12T18:17:13.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.127+0000 7fc52b7fe640 1 --2- 10.20.193.48:0/1635491906 >> v2:10.20.193.111:6812/977811348 conn(0x7fc51803f800 0x7fc51805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.150 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.127+0000 7fc52b7fe640 1 -- 10.20.193.48:0/1635491906 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7fc5400529d0 con 0x7fc54c05d550 2026-02-12T18:17:13.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.128+0000 7fc54a575640 1 --2- 10.20.193.48:0/1635491906 >> v2:10.20.193.111:6812/977811348 conn(0x7fc51803f800 0x7fc51805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.128+0000 7fc54a575640 10 monclient: get_auth_request con 0x7fc51803f800 auth_method 0 2026-02-12T18:17:13.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.129+0000 7fc52b7fe640 1 -- 10.20.193.48:0/1635491906 <== mon.0 v2:10.20.193.48:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fc54c10ead0 con 0x7fc54c05d550 2026-02-12T18:17:13.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.129+0000 7fc52b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:13.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.129+0000 7fc52b7fe640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:17:13.151 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.130+0000 7fc54a575640 1 --2- 10.20.193.48:0/1635491906 >> v2:10.20.193.111:6812/977811348 conn(0x7fc51803f800 0x7fc51805fcb0 secure :-1 s=READY pgs=492 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc54c13c970 tx=0x7fc534009210 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:13.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.234+0000 7fc55110c640 1 -- 10.20.193.48:0/1635491906 --> v2:10.20.193.111:6812/977811348 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fc54c08d060 con 0x7fc51803f800 2026-02-12T18:17:13.236 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.234+0000 7fc52b7fe640 1 -- 10.20.193.48:0/1635491906 <== mgr.4123 v2:10.20.193.111:6812/977811348 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc534011a40 con 0x7fc51803f800 2026-02-12T18:17:13.236 INFO:teuthology.orchestra.run.trial048.stderr:instructed osd(s) 2 to deep-scrub 2026-02-12T18:17:13.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.236+0000 7fc55110c640 1 -- 10.20.193.48:0/1635491906 >> v2:10.20.193.111:6812/977811348 conn(0x7fc51803f800 msgr2=0x7fc51805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.236+0000 7fc55110c640 1 --2- 10.20.193.48:0/1635491906 >> v2:10.20.193.111:6812/977811348 conn(0x7fc51803f800 0x7fc51805fcb0 secure :-1 s=READY pgs=492 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc54c13c970 tx=0x7fc534009210 comp rx=0 tx=0).stop 2026-02-12T18:17:13.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.236+0000 7fc55110c640 10 monclient: shutdown 2026-02-12T18:17:13.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.236+0000 7fc55110c640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:13.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.236+0000 7fc55110c640 1 -- 10.20.193.48:0/1635491906 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fc54c05d550 msgr2=0x7fc54c13c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.236+0000 7fc55110c640 1 --2- 10.20.193.48:0/1635491906 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fc54c05d550 0x7fc54c13c430 secure :-1 s=READY pgs=740 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc540006b40 tx=0x7fc54000ece0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.236+0000 7fc55110c640 1 -- 10.20.193.48:0/1635491906 shutdown_connections 2026-02-12T18:17:13.238 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.236+0000 7fc55110c640 1 --2- 10.20.193.48:0/1635491906 >> v2:10.20.193.111:6812/977811348 conn(0x7fc51803f800 0x7fc51805fcb0 unknown :-1 s=CLOSED pgs=492 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.236+0000 7fc55110c640 1 --2- 10.20.193.48:0/1635491906 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fc54c13ef60 0x7fc54c08abc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.236+0000 7fc55110c640 1 --2- 10.20.193.48:0/1635491906 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fc54c05de60 0x7fc54c08a680 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.236+0000 7fc55110c640 1 --2- 10.20.193.48:0/1635491906 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fc54c05d550 0x7fc54c13c430 unknown :-1 s=CLOSED pgs=740 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.236+0000 7fc55110c640 1 -- 10.20.193.48:0/1635491906 >> 10.20.193.48:0/1635491906 conn(0x7fc54c0546a0 msgr2=0x7fc54c122d20 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:13.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.236+0000 7fc55110c640 1 -- 10.20.193.48:0/1635491906 shutdown_connections 2026-02-12T18:17:13.239 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.236+0000 7fc55110c640 1 -- 10.20.193.48:0/1635491906 wait complete. 2026-02-12T18:17:13.245 INFO:tasks.ceph:Scrubbing osd.3 2026-02-12T18:17:13.246 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2026-02-12T18:17:13.314 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.312+0000 7fb181847640 10 monclient: get_monmap_and_config 2026-02-12T18:17:13.314 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.312+0000 7fb181847640 10 monclient: build_initial_monmap 2026-02-12T18:17:13.314 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.312+0000 7fb181847640 10 monclient: monmap: 2026-02-12T18:17:13.314 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:13.314 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.314 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:13.313436+0000 2026-02-12T18:17:13.314 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:13.313436+0000 2026-02-12T18:17:13.315 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:13.315 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.315 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:13.315 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:13.315 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:13.315 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:13.315 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:13.315 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:13.315 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:13.315 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:13.315 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:13.315 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:13.316 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:13.316 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.312+0000 7fb181847640 1 Processor -- start 2026-02-12T18:17:13.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.312+0000 7fb181847640 1 -- start start 2026-02-12T18:17:13.316 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.312+0000 7fb181847640 10 monclient: init 2026-02-12T18:17:13.324 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb181847640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:13.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb181847640 10 monclient: _add_conns ranks=[5,6,9,0,8,7,4,1,10,3,2] 2026-02-12T18:17:13.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb181847640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb17c05db90 0x7fb17c144290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb181847640 10 monclient(hunting): picked mon.noname-h con 0x7fb17c05db90 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:17:13.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb181847640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb17c05df60 0x7fb17c05e330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb181847640 10 monclient(hunting): picked mon.noname-d con 0x7fb17c05df60 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:17:13.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb181847640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fb17c089df0 0x7fb17c08a220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb181847640 10 monclient(hunting): picked mon.noname-a con 0x7fb17c089df0 addr v2:10.20.193.48:3300/0 2026-02-12T18:17:13.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb181847640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.325 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb181847640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7fb17c0573d0 con 0x7fb17c089df0 2026-02-12T18:17:13.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb181847640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb181847640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fb17c0933e0 con 0x7fb17c05db90 2026-02-12T18:17:13.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb181847640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb181847640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fb17c0936c0 con 0x7fb17c05df60 2026-02-12T18:17:13.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb181847640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:13.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb181847640 10 monclient(hunting): authenticate will time out at 1272.039140s 2026-02-12T18:17:13.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17a7fc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb17c05df60 0x7fb17c05e330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17b7fe640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fb17c089df0 0x7fb17c08a220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17a7fc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb17c05df60 0x7fb17c05e330 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:51884/0 (socket says 10.20.193.48:51884) 2026-02-12T18:17:13.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17a7fc640 1 -- 10.20.193.48:0/2149249186 learned_addr learned my addr 10.20.193.48:0/2149249186 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:13.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17b7fe640 10 monclient(hunting): get_auth_request con 0x7fb17c089df0 auth_method 0 2026-02-12T18:17:13.326 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17a7fc640 10 monclient(hunting): get_auth_request con 0x7fb17c05df60 auth_method 0 2026-02-12T18:17:13.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17affd640 1 --2- 10.20.193.48:0/2149249186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb17c05db90 0x7fb17c144290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17b7fe640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17b7fe640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17b7fe640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17affd640 10 monclient(hunting): get_auth_request con 0x7fb17c05db90 auth_method 0 2026-02-12T18:17:13.327 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17b7fe640 10 monclient(hunting): handle_auth_done global_id 7155 payload 274 2026-02-12T18:17:13.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17b7fe640 1 -- 10.20.193.48:0/2149249186 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb17c05df60 msgr2=0x7fb17c05e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:13.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17b7fe640 1 --2- 10.20.193.48:0/2149249186 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb17c05df60 0x7fb17c05e330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17b7fe640 1 -- 10.20.193.48:0/2149249186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb17c05db90 msgr2=0x7fb17c144290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:13.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17b7fe640 1 --2- 10.20.193.48:0/2149249186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb17c05db90 0x7fb17c144290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17b7fe640 10 monclient: _finish_hunting 0 2026-02-12T18:17:13.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17b7fe640 1 monclient: found mon.noname-a 2026-02-12T18:17:13.328 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:13.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17b7fe640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:17:13.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17b7fe640 1 -- 10.20.193.48:0/2149249186 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb17c060390 con 0x7fb17c089df0 2026-02-12T18:17:13.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17affd640 1 --2- 10.20.193.48:0/2149249186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb17c05db90 0x7fb17c144290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:17:13.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.313+0000 7fb17a7fc640 1 --2- 10.20.193.48:0/2149249186 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb17c05df60 0x7fb17c05e330 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:17:13.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb17b7fe640 1 -- 10.20.193.48:0/2149249186 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb17c089df0 msgr2=0x7fb17c08a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:13.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb17b7fe640 1 --2- 10.20.193.48:0/2149249186 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb17c089df0 0x7fb17c08a220 secure :-1 s=READY pgs=741 gs=2 cs=0 l=1 c_cookie=10534400950002466527 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb16c005820 tx=0x7fb16c02fe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9231b5d9b26f3edf server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:13.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb179ffb640 1 -- 10.20.193.48:0/2149249186 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb16c036340 con 0x7fb17c089df0 2026-02-12T18:17:13.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb179ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb179ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:17:13.329 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb179ffb640 10 monclient: dump: 2026-02-12T18:17:13.330 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.330 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.330 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.330 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.330 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.330 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.330 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.330 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.330 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.330 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.330 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.330 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.331 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.331 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.331 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.331 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb179ffb640 10 monclient: _finish_auth 0 2026-02-12T18:17:13.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb179ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:17:13.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb179ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:13.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb179ffb640 1 -- 10.20.193.48:0/2149249186 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb16c0364c0 con 0x7fb17c089df0 2026-02-12T18:17:13.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb179ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:13.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb179ffb640 1 -- 10.20.193.48:0/2149249186 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb16c036b30 con 0x7fb17c089df0 2026-02-12T18:17:13.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb179ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.331 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb179ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:17:13.332 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb179ffb640 10 monclient: dump: 2026-02-12T18:17:13.332 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.332 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.332 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.332 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.332 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.332 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.332 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.332 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.332 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.332 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.332 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.333 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.333 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.333 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.333 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.333 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb181847640 5 monclient: authenticate success, global_id 7155 2026-02-12T18:17:13.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb181847640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:13.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb181847640 4 set_mon_vals no callback set 2026-02-12T18:17:13.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb181847640 10 monclient: shutdown 2026-02-12T18:17:13.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb181847640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:13.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb181847640 1 -- 10.20.193.48:0/2149249186 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb17c089df0 msgr2=0x7fb17c08a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.333 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb181847640 1 --2- 10.20.193.48:0/2149249186 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb17c089df0 0x7fb17c08a220 secure :-1 s=READY pgs=741 gs=2 cs=0 l=1 c_cookie=10534400950002466527 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb16c005820 tx=0x7fb16c02fe00 comp rx=0 tx=0).stop 2026-02-12T18:17:13.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb181847640 1 -- 10.20.193.48:0/2149249186 shutdown_connections 2026-02-12T18:17:13.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb181847640 1 --2- 10.20.193.48:0/2149249186 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fb17c089df0 0x7fb17c08a220 unknown :-1 s=CLOSED pgs=741 gs=2 cs=0 l=1 c_cookie=10534400950002466527 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb181847640 1 --2- 10.20.193.48:0/2149249186 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb17c05df60 0x7fb17c05e330 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb181847640 1 --2- 10.20.193.48:0/2149249186 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fb17c05db90 0x7fb17c144290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb181847640 1 -- 10.20.193.48:0/2149249186 >> 10.20.193.48:0/2149249186 conn(0x7fb17c096410 msgr2=0x7fb17c097cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:13.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb181847640 1 -- 10.20.193.48:0/2149249186 shutdown_connections 2026-02-12T18:17:13.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb181847640 1 -- 10.20.193.48:0/2149249186 wait complete. 2026-02-12T18:17:13.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb181847640 10 monclient: build_initial_monmap 2026-02-12T18:17:13.334 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.316+0000 7fb181847640 10 monclient: monmap: 2026-02-12T18:17:13.334 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:13.334 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:13.334 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:13.335 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:13.335 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:13.335 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.335 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:13.335 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:13.335 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:13.335 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:13.335 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:13.335 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:13.335 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:13.335 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:13.335 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:13.335 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb181847640 1 Processor -- start 2026-02-12T18:17:13.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb181847640 1 -- start start 2026-02-12T18:17:13.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb181847640 10 monclient: init 2026-02-12T18:17:13.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb181847640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:13.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb181847640 10 monclient: _add_conns ranks=[1,6,7,2,3,8,4,0,5] 2026-02-12T18:17:13.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb181847640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb17c05db90 0x7fb17c143480 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb181847640 10 monclient(hunting): picked mon.noname-f con 0x7fb17c05db90 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:17:13.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb181847640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb17c05df60 0x7fb17c1439c0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb181847640 10 monclient(hunting): picked mon.noname-d con 0x7fb17c05df60 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:17:13.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb181847640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb17c089df0 0x7fb17c10daf0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb181847640 10 monclient(hunting): picked mon.noname-i con 0x7fb17c089df0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:17:13.336 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb181847640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb181847640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fb17c143f00 con 0x7fb17c05db90 2026-02-12T18:17:13.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb181847640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb181847640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fb17c10f280 con 0x7fb17c05df60 2026-02-12T18:17:13.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb181847640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb181847640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fb17c110d40 con 0x7fb17c089df0 2026-02-12T18:17:13.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb181847640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:13.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb181847640 10 monclient(hunting): authenticate will time out at 1272.043381s 2026-02-12T18:17:13.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17a7fc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb17c05df60 0x7fb17c1439c0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17a7fc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb17c05df60 0x7fb17c1439c0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:51888/0 (socket says 10.20.193.48:51888) 2026-02-12T18:17:13.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17a7fc640 1 -- 10.20.193.48:0/758672380 learned_addr learned my addr 10.20.193.48:0/758672380 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:13.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17a7fc640 10 monclient(hunting): get_auth_request con 0x7fb17c05df60 auth_method 0 2026-02-12T18:17:13.337 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17a7fc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17a7fc640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17a7fc640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17a7fc640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17a7fc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17a7fc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17affd640 1 --2- 10.20.193.48:0/758672380 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb17c05db90 0x7fb17c143480 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17affd640 10 monclient(hunting): get_auth_request con 0x7fb17c05db90 auth_method 0 2026-02-12T18:17:13.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17b7fe640 1 --2- 10.20.193.48:0/758672380 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb17c089df0 0x7fb17c10daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17affd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17affd640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17affd640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.338 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17b7fe640 10 monclient(hunting): get_auth_request con 0x7fb17c089df0 auth_method 0 2026-02-12T18:17:13.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17b7fe640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17b7fe640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17b7fe640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17a7fc640 10 monclient(hunting): handle_auth_done global_id 114261 payload 824 2026-02-12T18:17:13.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17a7fc640 1 -- 10.20.193.48:0/758672380 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb17c089df0 msgr2=0x7fb17c10daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17a7fc640 1 --2- 10.20.193.48:0/758672380 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fb17c089df0 0x7fb17c10daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17a7fc640 1 -- 10.20.193.48:0/758672380 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb17c05db90 msgr2=0x7fb17c143480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17a7fc640 1 --2- 10.20.193.48:0/758672380 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb17c05db90 0x7fb17c143480 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17a7fc640 10 monclient: _finish_hunting 0 2026-02-12T18:17:13.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17a7fc640 1 monclient: found mon.noname-d 2026-02-12T18:17:13.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:13.339 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17a7fc640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:17:13.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17a7fc640 1 -- 10.20.193.48:0/758672380 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1640094f0 con 0x7fb17c05df60 2026-02-12T18:17:13.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.317+0000 7fb17affd640 1 --2- 10.20.193.48:0/758672380 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fb17c05db90 0x7fb17c143480 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:17:13.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.319+0000 7fb17a7fc640 1 -- 10.20.193.48:0/758672380 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb17c05df60 msgr2=0x7fb17c1439c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:13.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.319+0000 7fb17a7fc640 1 --2- 10.20.193.48:0/758672380 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb17c05df60 0x7fb17c1439c0 secure :-1 s=READY pgs=32 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb164006f70 tx=0x7fb16400c520 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:13.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.320+0000 7fb153fff640 1 -- 10.20.193.48:0/758672380 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb16400ee90 con 0x7fb17c05df60 2026-02-12T18:17:13.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.320+0000 7fb153fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.320+0000 7fb153fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:17:13.340 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.320+0000 7fb153fff640 10 monclient: dump: 2026-02-12T18:17:13.340 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.340 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.340 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.340 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.341 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.341 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.341 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.341 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.341 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.341 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.341 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.341 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.341 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.341 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.341 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.341 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.341 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.320+0000 7fb153fff640 10 monclient: _finish_auth 0 2026-02-12T18:17:13.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.320+0000 7fb153fff640 10 monclient: _check_auth_tickets 2026-02-12T18:17:13.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.320+0000 7fb153fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:13.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.320+0000 7fb181847640 5 monclient: authenticate success, global_id 114261 2026-02-12T18:17:13.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.320+0000 7fb181847640 10 monclient: _renew_subs 2026-02-12T18:17:13.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.320+0000 7fb181847640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:17:13.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.320+0000 7fb153fff640 1 -- 10.20.193.48:0/758672380 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb16400cdc0 con 0x7fb17c05df60 2026-02-12T18:17:13.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.320+0000 7fb181847640 1 -- 10.20.193.48:0/758672380 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb16c00a500 con 0x7fb17c05df60 2026-02-12T18:17:13.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.320+0000 7fb153fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:13.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.320+0000 7fb153fff640 1 -- 10.20.193.48:0/758672380 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb1640044f0 con 0x7fb17c05df60 2026-02-12T18:17:13.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.320+0000 7fb153fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.320+0000 7fb1797fa640 4 set_mon_vals no callback set 2026-02-12T18:17:13.342 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.320+0000 7fb153fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:17:13.343 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.320+0000 7fb153fff640 10 monclient: dump: 2026-02-12T18:17:13.343 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.343 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.343 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.343 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.343 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.343 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.343 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.343 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.343 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.343 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.343 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.344 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.344 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.344 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.344 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.344 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.320+0000 7fb181847640 10 monclient: _renew_subs 2026-02-12T18:17:13.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.320+0000 7fb181847640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:17:13.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.320+0000 7fb181847640 1 -- 10.20.193.48:0/758672380 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fb17c111300 con 0x7fb17c05df60 2026-02-12T18:17:13.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.320+0000 7fb181847640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:17:13.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.320+0000 7fb181847640 1 -- 10.20.193.48:0/758672380 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb17c1447d0 con 0x7fb17c05df60 2026-02-12T18:17:13.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.320+0000 7fb153fff640 1 -- 10.20.193.48:0/758672380 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fb164011070 con 0x7fb17c05df60 2026-02-12T18:17:13.344 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.321+0000 7fb153fff640 1 --2- 10.20.193.48:0/758672380 >> v2:10.20.193.111:6812/977811348 conn(0x7fb14c03f800 0x7fb14c05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.321+0000 7fb153fff640 1 -- 10.20.193.48:0/758672380 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7fb164052c50 con 0x7fb17c05df60 2026-02-12T18:17:13.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.321+0000 7fb153fff640 1 --2- 10.20.193.48:0/758672380 >> v2:10.20.193.111:6800/449363714 conn(0x7fb14c0631d0 0x7fb14c0835e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.321+0000 7fb153fff640 1 -- 10.20.193.48:0/758672380 --> v2:10.20.193.111:6800/449363714 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb14c083c50 con 0x7fb14c0631d0 2026-02-12T18:17:13.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.321+0000 7fb153fff640 1 -- 10.20.193.48:0/758672380 <== mon.6 v2:10.20.193.48:3303/0 6 ==== mon_get_version_reply(handle=1 version=322) ==== 24+0+0 (secure 0 0 0) 0x7fb1640572a0 con 0x7fb17c05df60 2026-02-12T18:17:13.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.321+0000 7fb153fff640 10 monclient: handle_get_version_reply finishing 1 version 322 2026-02-12T18:17:13.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.321+0000 7fb17affd640 1 --2- 10.20.193.48:0/758672380 >> v2:10.20.193.111:6812/977811348 conn(0x7fb14c03f800 0x7fb14c05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.321+0000 7fb17affd640 10 monclient: get_auth_request con 0x7fb14c03f800 auth_method 0 2026-02-12T18:17:13.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.321+0000 7fb17b7fe640 1 --2- 10.20.193.48:0/758672380 >> v2:10.20.193.111:6800/449363714 conn(0x7fb14c0631d0 0x7fb14c0835e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.321+0000 7fb17b7fe640 10 monclient: get_auth_request con 0x7fb14c0631d0 auth_method 0 2026-02-12T18:17:13.345 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.323+0000 7fb17affd640 1 --2- 10.20.193.48:0/758672380 >> v2:10.20.193.111:6812/977811348 conn(0x7fb14c03f800 0x7fb14c05fcb0 secure :-1 s=READY pgs=493 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb170004740 tx=0x7fb170008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:13.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.325+0000 7fb17b7fe640 1 --2- 10.20.193.48:0/758672380 >> v2:10.20.193.111:6800/449363714 conn(0x7fb14c0631d0 0x7fb14c0835e0 crc :-1 s=READY pgs=183 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:13.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.326+0000 7fb153fff640 1 -- 10.20.193.48:0/758672380 <== osd.3 v2:10.20.193.111:6800/449363714 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fb14c083c50 con 0x7fb14c0631d0 2026-02-12T18:17:13.346 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.333+0000 7fb181847640 1 -- 10.20.193.48:0/758672380 --> v2:10.20.193.111:6800/449363714 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb17c144270 con 0x7fb14c0631d0 2026-02-12T18:17:13.347 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.333+0000 7fb153fff640 1 -- 10.20.193.48:0/758672380 <== osd.3 v2:10.20.193.111:6800/449363714 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb17c144270 con 0x7fb14c0631d0 2026-02-12T18:17:13.347 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:17:13.347 INFO:teuthology.orchestra.run.trial048.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T18:17:13.347 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:17:13.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.333+0000 7fb181847640 1 -- 10.20.193.48:0/758672380 >> v2:10.20.193.111:6800/449363714 conn(0x7fb14c0631d0 msgr2=0x7fb14c0835e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.333+0000 7fb181847640 1 --2- 10.20.193.48:0/758672380 >> v2:10.20.193.111:6800/449363714 conn(0x7fb14c0631d0 0x7fb14c0835e0 crc :-1 s=READY pgs=183 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.333+0000 7fb181847640 1 -- 10.20.193.48:0/758672380 >> v2:10.20.193.111:6812/977811348 conn(0x7fb14c03f800 msgr2=0x7fb14c05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.333+0000 7fb181847640 1 --2- 10.20.193.48:0/758672380 >> v2:10.20.193.111:6812/977811348 conn(0x7fb14c03f800 0x7fb14c05fcb0 secure :-1 s=READY pgs=493 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb170004740 tx=0x7fb170008040 comp rx=0 tx=0).stop 2026-02-12T18:17:13.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.333+0000 7fb181847640 10 monclient: shutdown 2026-02-12T18:17:13.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.333+0000 7fb181847640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:13.349 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.333+0000 7fb181847640 1 -- 10.20.193.48:0/758672380 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb17c05df60 msgr2=0x7fb17c1439c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.333+0000 7fb181847640 1 --2- 10.20.193.48:0/758672380 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fb17c05df60 0x7fb17c1439c0 secure :-1 s=READY pgs=32 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb164006f70 tx=0x7fb16400c520 comp rx=0 tx=0).stop 2026-02-12T18:17:13.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.333+0000 7fb17b7fe640 1 -- 10.20.193.48:0/758672380 reap_dead start 2026-02-12T18:17:13.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.333+0000 7fb181847640 1 -- 10.20.193.48:0/758672380 shutdown_connections 2026-02-12T18:17:13.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.333+0000 7fb181847640 1 -- 10.20.193.48:0/758672380 >> 10.20.193.48:0/758672380 conn(0x7fb17c096410 msgr2=0x7fb17c1275e0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:13.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.333+0000 7fb181847640 1 -- 10.20.193.48:0/758672380 shutdown_connections 2026-02-12T18:17:13.350 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.334+0000 7fb181847640 1 -- 10.20.193.48:0/758672380 wait complete. 2026-02-12T18:17:13.350 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2026-02-12T18:17:13.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.415+0000 7ffad2e5b640 10 monclient: get_monmap_and_config 2026-02-12T18:17:13.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.415+0000 7ffad2e5b640 10 monclient: build_initial_monmap 2026-02-12T18:17:13.417 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.415+0000 7ffad2e5b640 10 monclient: monmap: 2026-02-12T18:17:13.417 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:13.417 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.417 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:13.416364+0000 2026-02-12T18:17:13.417 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:13.416364+0000 2026-02-12T18:17:13.417 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:13.417 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.417 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:13.417 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:13.417 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:13.418 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:13.418 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:13.418 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:13.418 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:13.418 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:13.418 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:13.418 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:13.418 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:13.418 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.415+0000 7ffad2e5b640 1 Processor -- start 2026-02-12T18:17:13.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.415+0000 7ffad2e5b640 1 -- start start 2026-02-12T18:17:13.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.415+0000 7ffad2e5b640 10 monclient: init 2026-02-12T18:17:13.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad2e5b640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:13.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad2e5b640 10 monclient: _add_conns ranks=[3,2,7,6,8,10,4,9,0,5,1] 2026-02-12T18:17:13.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad2e5b640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ffacc05c950 0x7ffacc05cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad2e5b640 10 monclient(hunting): picked mon.noname-g con 0x7ffacc05c950 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:17:13.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad2e5b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ffacc05e490 0x7ffacc05d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad2e5b640 10 monclient(hunting): picked mon.noname-b con 0x7ffacc05e490 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:17:13.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad2e5b640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ffacc13db70 0x7ffacc13dfc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad2e5b640 10 monclient(hunting): picked mon.noname-i con 0x7ffacc13db70 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:17:13.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad2e5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad2e5b640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7ffacc05ddd0 con 0x7ffacc05e490 2026-02-12T18:17:13.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad2e5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad2e5b640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7ffacc05d7a0 con 0x7ffacc05c950 2026-02-12T18:17:13.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad2e5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad2e5b640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7ffacc092990 con 0x7ffacc13db70 2026-02-12T18:17:13.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad2e5b640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:13.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad2e5b640 10 monclient(hunting): authenticate will time out at 1272.142129s 2026-02-12T18:17:13.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffac3fff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ffacc05e490 0x7ffacc05d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffac3fff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ffacc05e490 0x7ffacc05d260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:44222/0 (socket says 10.20.193.48:44222) 2026-02-12T18:17:13.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffac3fff640 1 -- 10.20.193.48:0/3329413408 learned_addr learned my addr 10.20.193.48:0/3329413408 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:13.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffac3fff640 10 monclient(hunting): get_auth_request con 0x7ffacc05e490 auth_method 0 2026-02-12T18:17:13.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffac3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffac3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffac3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad0bd0640 1 --2- 10.20.193.48:0/3329413408 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ffacc05c950 0x7ffacc05cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad13d1640 1 --2- 10.20.193.48:0/3329413408 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ffacc13db70 0x7ffacc13dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffac3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffac3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffac3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad0bd0640 10 monclient(hunting): get_auth_request con 0x7ffacc05c950 auth_method 0 2026-02-12T18:17:13.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad0bd0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad0bd0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad0bd0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad13d1640 10 monclient(hunting): get_auth_request con 0x7ffacc13db70 auth_method 0 2026-02-12T18:17:13.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad13d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad13d1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad13d1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad13d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad13d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad13d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffac3fff640 10 monclient(hunting): handle_auth_done global_id 36758 payload 274 2026-02-12T18:17:13.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffac3fff640 1 -- 10.20.193.48:0/3329413408 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ffacc13db70 msgr2=0x7ffacc13dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:13.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffac3fff640 1 --2- 10.20.193.48:0/3329413408 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ffacc13db70 0x7ffacc13dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffac3fff640 1 -- 10.20.193.48:0/3329413408 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ffacc05c950 msgr2=0x7ffacc05cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:13.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffac3fff640 1 --2- 10.20.193.48:0/3329413408 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ffacc05c950 0x7ffacc05cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffac3fff640 10 monclient: _finish_hunting 0 2026-02-12T18:17:13.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffac3fff640 1 monclient: found mon.noname-b 2026-02-12T18:17:13.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffac3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:13.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffac3fff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:17:13.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffac3fff640 1 -- 10.20.193.48:0/3329413408 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffacc04dc20 con 0x7ffacc05e490 2026-02-12T18:17:13.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.416+0000 7ffad0bd0640 1 --2- 10.20.193.48:0/3329413408 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ffacc05c950 0x7ffacc05cd20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:17:13.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.418+0000 7ffac3fff640 1 -- 10.20.193.48:0/3329413408 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ffacc05e490 msgr2=0x7ffacc05d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:13.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.418+0000 7ffac3fff640 1 --2- 10.20.193.48:0/3329413408 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ffacc05e490 0x7ffacc05d260 secure :-1 s=READY pgs=471 gs=1 cs=0 l=1 c_cookie=8046987759957920638 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffab40098d0 tx=0x7ffab402ee10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6faca4bba0354b7e server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:13.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffac37fe640 1 -- 10.20.193.48:0/3329413408 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ffab4035340 con 0x7ffacc05e490 2026-02-12T18:17:13.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffac37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffac37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:17:13.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffac37fe640 10 monclient: dump: 2026-02-12T18:17:13.433 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.433 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.433 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.433 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.433 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.433 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.434 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.434 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.434 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.434 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.434 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.434 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.434 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.434 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.434 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.434 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffac37fe640 10 monclient: _finish_auth 0 2026-02-12T18:17:13.434 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffac37fe640 10 monclient: _check_auth_tickets 2026-02-12T18:17:13.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffac37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:13.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffac37fe640 1 -- 10.20.193.48:0/3329413408 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffab40354c0 con 0x7ffacc05e490 2026-02-12T18:17:13.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffad2e5b640 5 monclient: authenticate success, global_id 36758 2026-02-12T18:17:13.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffad2e5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:17:13.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffac37fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:13.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffac37fe640 1 -- 10.20.193.48:0/3329413408 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ffab4035af0 con 0x7ffacc05e490 2026-02-12T18:17:13.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffad2e5b640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:13.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffad2e5b640 4 set_mon_vals no callback set 2026-02-12T18:17:13.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffac37fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffac37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:17:13.435 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffac37fe640 10 monclient: dump: 2026-02-12T18:17:13.436 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.436 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.436 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.436 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.436 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.436 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.436 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.436 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.436 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.436 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.436 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.436 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.436 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.437 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.437 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.437 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffad2e5b640 10 monclient: shutdown 2026-02-12T18:17:13.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffad2e5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:13.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffad2e5b640 1 -- 10.20.193.48:0/3329413408 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ffacc05e490 msgr2=0x7ffacc05d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffad2e5b640 1 --2- 10.20.193.48:0/3329413408 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ffacc05e490 0x7ffacc05d260 secure :-1 s=READY pgs=471 gs=1 cs=0 l=1 c_cookie=8046987759957920638 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffab40098d0 tx=0x7ffab402ee10 comp rx=0 tx=0).stop 2026-02-12T18:17:13.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffad2e5b640 1 -- 10.20.193.48:0/3329413408 shutdown_connections 2026-02-12T18:17:13.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffad2e5b640 1 --2- 10.20.193.48:0/3329413408 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ffacc13db70 0x7ffacc13dfc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffad2e5b640 1 --2- 10.20.193.48:0/3329413408 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ffacc05e490 0x7ffacc05d260 unknown :-1 s=CLOSED pgs=471 gs=1 cs=0 l=1 c_cookie=8046987759957920638 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffad2e5b640 1 --2- 10.20.193.48:0/3329413408 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ffacc05c950 0x7ffacc05cd20 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.437 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffad2e5b640 1 -- 10.20.193.48:0/3329413408 >> 10.20.193.48:0/3329413408 conn(0x7ffacc0548a0 msgr2=0x7ffacc097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:13.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffad2e5b640 1 -- 10.20.193.48:0/3329413408 shutdown_connections 2026-02-12T18:17:13.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.419+0000 7ffad2e5b640 1 -- 10.20.193.48:0/3329413408 wait complete. 2026-02-12T18:17:13.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad2e5b640 10 monclient: build_initial_monmap 2026-02-12T18:17:13.438 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad2e5b640 10 monclient: monmap: 2026-02-12T18:17:13.438 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:13.438 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:13.438 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:13.438 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:13.438 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:13.438 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.438 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:13.438 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:13.439 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:13.439 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:13.439 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:13.439 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:13.439 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:13.439 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:13.439 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:13.439 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad2e5b640 1 Processor -- start 2026-02-12T18:17:13.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad2e5b640 1 -- start start 2026-02-12T18:17:13.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad2e5b640 10 monclient: init 2026-02-12T18:17:13.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad2e5b640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:13.439 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad2e5b640 10 monclient: _add_conns ranks=[3,4,2,6,1,0,8,5,7] 2026-02-12T18:17:13.440 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad2e5b640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ffacc05c950 0x7ffacc12c820 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.440 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad2e5b640 10 monclient(hunting): picked mon.noname-g con 0x7ffacc05c950 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:17:13.440 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad2e5b640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ffacc05e490 0x7ffacc08d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.440 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad2e5b640 10 monclient(hunting): picked mon.noname-c con 0x7ffacc05e490 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:17:13.440 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad2e5b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ffacc13db70 0x7ffacc08d7a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.440 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad2e5b640 10 monclient(hunting): picked mon.noname-b con 0x7ffacc13db70 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:17:13.440 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad2e5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.440 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad2e5b640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7ffacc12d7e0 con 0x7ffacc13db70 2026-02-12T18:17:13.440 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad2e5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.440 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad2e5b640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7ffacc13e400 con 0x7ffacc05c950 2026-02-12T18:17:13.440 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad2e5b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad2e5b640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7ffacc08a4a0 con 0x7ffacc05e490 2026-02-12T18:17:13.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad2e5b640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:13.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad2e5b640 10 monclient(hunting): authenticate will time out at 1272.146717s 2026-02-12T18:17:13.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffac3fff640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ffacc05e490 0x7ffacc08d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad13d1640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ffacc13db70 0x7ffacc08d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad13d1640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ffacc13db70 0x7ffacc08d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:44224/0 (socket says 10.20.193.48:44224) 2026-02-12T18:17:13.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad13d1640 1 -- 10.20.193.48:0/3447758491 learned_addr learned my addr 10.20.193.48:0/3447758491 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:13.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffac3fff640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ffacc05e490 0x7ffacc08d260 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:40676/0 (socket says 10.20.193.48:40676) 2026-02-12T18:17:13.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad13d1640 10 monclient(hunting): get_auth_request con 0x7ffacc13db70 auth_method 0 2026-02-12T18:17:13.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad13d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad13d1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad13d1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.441 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffac3fff640 10 monclient(hunting): get_auth_request con 0x7ffacc05e490 auth_method 0 2026-02-12T18:17:13.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffac3fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffac3fff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffac3fff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad13d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad13d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad0bd0640 1 --2- 10.20.193.48:0/3447758491 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ffacc05c950 0x7ffacc12c820 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad13d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffac3fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffac3fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffac3fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad0bd0640 10 monclient(hunting): get_auth_request con 0x7ffacc05c950 auth_method 0 2026-02-12T18:17:13.442 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad0bd0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad0bd0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad0bd0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad0bd0640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad0bd0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad0bd0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad13d1640 10 monclient(hunting): handle_auth_done global_id 36767 payload 824 2026-02-12T18:17:13.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad13d1640 1 -- 10.20.193.48:0/3447758491 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ffacc05e490 msgr2=0x7ffacc08d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.420+0000 7ffad13d1640 1 --2- 10.20.193.48:0/3447758491 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ffacc05e490 0x7ffacc08d260 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.421+0000 7ffad13d1640 1 -- 10.20.193.48:0/3447758491 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ffacc05c950 msgr2=0x7ffacc12c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.421+0000 7ffad13d1640 1 --2- 10.20.193.48:0/3447758491 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ffacc05c950 0x7ffacc12c820 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.421+0000 7ffad13d1640 10 monclient: _finish_hunting 0 2026-02-12T18:17:13.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.421+0000 7ffad13d1640 1 monclient: found mon.noname-b 2026-02-12T18:17:13.443 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.421+0000 7ffad13d1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:13.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.421+0000 7ffad13d1640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:17:13.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.421+0000 7ffad13d1640 1 -- 10.20.193.48:0/3447758491 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffab40094f0 con 0x7ffacc13db70 2026-02-12T18:17:13.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffad13d1640 1 -- 10.20.193.48:0/3447758491 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ffacc13db70 msgr2=0x7ffacc08d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:13.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffad13d1640 1 --2- 10.20.193.48:0/3447758491 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ffacc13db70 0x7ffacc08d7a0 secure :-1 s=READY pgs=472 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffac800f930 tx=0x7ffac800fe00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:13.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffac17fa640 1 -- 10.20.193.48:0/3447758491 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ffac800dbb0 con 0x7ffacc13db70 2026-02-12T18:17:13.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffac17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffac17fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:17:13.444 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffac17fa640 10 monclient: dump: 2026-02-12T18:17:13.444 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.444 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.444 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.444 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.445 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.445 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.445 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.445 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.445 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.445 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.445 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.445 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.445 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.445 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.445 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.445 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.446 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffac17fa640 10 monclient: _finish_auth 0 2026-02-12T18:17:13.446 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffac17fa640 10 monclient: _check_auth_tickets 2026-02-12T18:17:13.446 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffac17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:13.446 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffac17fa640 1 -- 10.20.193.48:0/3447758491 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffac800dd30 con 0x7ffacc13db70 2026-02-12T18:17:13.446 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffac17fa640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:13.446 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffac17fa640 1 -- 10.20.193.48:0/3447758491 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ffac800dea0 con 0x7ffacc13db70 2026-02-12T18:17:13.446 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffac17fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.446 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffac2ffd640 4 set_mon_vals no callback set 2026-02-12T18:17:13.446 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffac17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:17:13.446 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffac17fa640 10 monclient: dump: 2026-02-12T18:17:13.446 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.446 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.447 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.447 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.447 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.447 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.447 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.447 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.447 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.447 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.447 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.447 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.447 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.447 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.447 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.448 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffad2e5b640 5 monclient: authenticate success, global_id 36767 2026-02-12T18:17:13.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffad2e5b640 10 monclient: _renew_subs 2026-02-12T18:17:13.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffad2e5b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:17:13.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffad2e5b640 1 -- 10.20.193.48:0/3447758491 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffacc143aa0 con 0x7ffacc13db70 2026-02-12T18:17:13.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffad2e5b640 10 monclient: _renew_subs 2026-02-12T18:17:13.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffad2e5b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:17:13.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffad2e5b640 1 -- 10.20.193.48:0/3447758491 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ffacc08ad40 con 0x7ffacc13db70 2026-02-12T18:17:13.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffad2e5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:13.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffad2e5b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:13.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffad2e5b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:17:13.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.423+0000 7ffad2e5b640 1 -- 10.20.193.48:0/3447758491 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffacc05cd20 con 0x7ffacc13db70 2026-02-12T18:17:13.448 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.424+0000 7ffac17fa640 1 -- 10.20.193.48:0/3447758491 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7ffac8012070 con 0x7ffacc13db70 2026-02-12T18:17:13.449 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.424+0000 7ffac17fa640 1 --2- 10.20.193.48:0/3447758491 >> v2:10.20.193.111:6812/977811348 conn(0x7ffa9c03f800 0x7ffa9c05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.449 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.424+0000 7ffac17fa640 1 -- 10.20.193.48:0/3447758491 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7ffac8054020 con 0x7ffacc13db70 2026-02-12T18:17:13.449 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.424+0000 7ffad0bd0640 1 --2- 10.20.193.48:0/3447758491 >> v2:10.20.193.111:6812/977811348 conn(0x7ffa9c03f800 0x7ffa9c05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.449 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.424+0000 7ffad0bd0640 10 monclient: get_auth_request con 0x7ffa9c03f800 auth_method 0 2026-02-12T18:17:13.449 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.426+0000 7ffac17fa640 1 -- 10.20.193.48:0/3447758491 <== mon.2 v2:10.20.193.48:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7ffac801c800 con 0x7ffacc13db70 2026-02-12T18:17:13.449 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.426+0000 7ffac17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:13.449 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.426+0000 7ffac17fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:17:13.449 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.427+0000 7ffad0bd0640 1 --2- 10.20.193.48:0/3447758491 >> v2:10.20.193.111:6812/977811348 conn(0x7ffa9c03f800 0x7ffa9c05fcb0 secure :-1 s=READY pgs=494 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffabc004740 tx=0x7ffabc008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:13.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.527+0000 7ffad2e5b640 1 -- 10.20.193.48:0/3447758491 --> v2:10.20.193.111:6812/977811348 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7ffacc097de0 con 0x7ffa9c03f800 2026-02-12T18:17:13.529 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.528+0000 7ffac17fa640 1 -- 10.20.193.48:0/3447758491 <== mgr.4123 v2:10.20.193.111:6812/977811348 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ffabc010870 con 0x7ffa9c03f800 2026-02-12T18:17:13.529 INFO:teuthology.orchestra.run.trial048.stderr:instructed osd(s) 3 to deep-scrub 2026-02-12T18:17:13.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.529+0000 7ffad2e5b640 1 -- 10.20.193.48:0/3447758491 >> v2:10.20.193.111:6812/977811348 conn(0x7ffa9c03f800 msgr2=0x7ffa9c05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.529+0000 7ffad2e5b640 1 --2- 10.20.193.48:0/3447758491 >> v2:10.20.193.111:6812/977811348 conn(0x7ffa9c03f800 0x7ffa9c05fcb0 secure :-1 s=READY pgs=494 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffabc004740 tx=0x7ffabc008040 comp rx=0 tx=0).stop 2026-02-12T18:17:13.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.529+0000 7ffad2e5b640 10 monclient: shutdown 2026-02-12T18:17:13.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.529+0000 7ffad2e5b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:13.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.529+0000 7ffad2e5b640 1 -- 10.20.193.48:0/3447758491 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ffacc13db70 msgr2=0x7ffacc08d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.529+0000 7ffad2e5b640 1 --2- 10.20.193.48:0/3447758491 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ffacc13db70 0x7ffacc08d7a0 secure :-1 s=READY pgs=472 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ffac800f930 tx=0x7ffac800fe00 comp rx=0 tx=0).stop 2026-02-12T18:17:13.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.529+0000 7ffad2e5b640 1 -- 10.20.193.48:0/3447758491 shutdown_connections 2026-02-12T18:17:13.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.529+0000 7ffad2e5b640 1 --2- 10.20.193.48:0/3447758491 >> v2:10.20.193.111:6812/977811348 conn(0x7ffa9c03f800 0x7ffa9c05fcb0 unknown :-1 s=CLOSED pgs=494 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.531 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.529+0000 7ffad2e5b640 1 --2- 10.20.193.48:0/3447758491 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ffacc13db70 0x7ffacc08d7a0 unknown :-1 s=CLOSED pgs=472 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.529+0000 7ffad2e5b640 1 --2- 10.20.193.48:0/3447758491 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7ffacc05e490 0x7ffacc08d260 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.529+0000 7ffad2e5b640 1 --2- 10.20.193.48:0/3447758491 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ffacc05c950 0x7ffacc12c820 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.529+0000 7ffad2e5b640 1 -- 10.20.193.48:0/3447758491 >> 10.20.193.48:0/3447758491 conn(0x7ffacc0548a0 msgr2=0x7ffacc093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:13.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.529+0000 7ffad2e5b640 1 -- 10.20.193.48:0/3447758491 shutdown_connections 2026-02-12T18:17:13.532 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.529+0000 7ffad2e5b640 1 -- 10.20.193.48:0/3447758491 wait complete. 2026-02-12T18:17:13.538 INFO:tasks.ceph:Scrubbing osd.4 2026-02-12T18:17:13.538 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2026-02-12T18:17:13.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.605+0000 7fba1361b640 10 monclient: get_monmap_and_config 2026-02-12T18:17:13.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.605+0000 7fba1361b640 10 monclient: build_initial_monmap 2026-02-12T18:17:13.606 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.605+0000 7fba1361b640 10 monclient: monmap: 2026-02-12T18:17:13.607 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:13.607 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.607 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:13.606172+0000 2026-02-12T18:17:13.607 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:13.606172+0000 2026-02-12T18:17:13.607 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:13.607 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.607 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:13.607 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:13.607 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:13.607 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:13.607 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:13.607 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:13.608 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:13.608 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:13.608 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:13.608 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:13.608 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:13.608 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.617 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.605+0000 7fba1361b640 1 Processor -- start 2026-02-12T18:17:13.617 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.605+0000 7fba1361b640 1 -- start start 2026-02-12T18:17:13.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.605+0000 7fba1361b640 10 monclient: init 2026-02-12T18:17:13.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.605+0000 7fba1361b640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:13.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.605+0000 7fba1361b640 10 monclient: _add_conns ranks=[3,8,4,5,7,0,2,1,9,10,6] 2026-02-12T18:17:13.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.605+0000 7fba1361b640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fba0c05db90 0x7fba0c144290 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.605+0000 7fba1361b640 10 monclient(hunting): picked mon.noname-g con 0x7fba0c05db90 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:17:13.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.605+0000 7fba1361b640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fba0c05df60 0x7fba0c05e330 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.605+0000 7fba1361b640 10 monclient(hunting): picked mon.noname-e con 0x7fba0c05df60 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:17:13.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.605+0000 7fba1361b640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fba0c089df0 0x7fba0c08a200 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.605+0000 7fba1361b640 10 monclient(hunting): picked mon.noname-c con 0x7fba0c089df0 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:17:13.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.605+0000 7fba1361b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.605+0000 7fba1361b640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fba0c0573d0 con 0x7fba0c05db90 2026-02-12T18:17:13.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.605+0000 7fba1361b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.605+0000 7fba1361b640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fba0c0933e0 con 0x7fba0c089df0 2026-02-12T18:17:13.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.605+0000 7fba1361b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.605+0000 7fba1361b640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fba0c0936c0 con 0x7fba0c05df60 2026-02-12T18:17:13.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.605+0000 7fba1361b640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:13.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.605+0000 7fba1361b640 10 monclient(hunting): authenticate will time out at 1272.331925s 2026-02-12T18:17:13.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba11b91640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fba0c089df0 0x7fba0c08a200 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba10b8f640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fba0c05df60 0x7fba0c05e330 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba11b91640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fba0c089df0 0x7fba0c08a200 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:40690/0 (socket says 10.20.193.48:40690) 2026-02-12T18:17:13.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba11b91640 1 -- 10.20.193.48:0/3581913227 learned_addr learned my addr 10.20.193.48:0/3581913227 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:13.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba11b91640 10 monclient(hunting): get_auth_request con 0x7fba0c089df0 auth_method 0 2026-02-12T18:17:13.619 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba11b91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba11b91640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba11b91640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba10b8f640 10 monclient(hunting): get_auth_request con 0x7fba0c05df60 auth_method 0 2026-02-12T18:17:13.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba10b8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba10b8f640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba10b8f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba11390640 1 --2- 10.20.193.48:0/3581913227 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fba0c05db90 0x7fba0c144290 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba11b91640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba11b91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba11b91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba10b8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba10b8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba10b8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba11390640 10 monclient(hunting): get_auth_request con 0x7fba0c05db90 auth_method 0 2026-02-12T18:17:13.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba11390640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba11390640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba11390640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba11b91640 10 monclient(hunting): handle_auth_done global_id 65371 payload 274 2026-02-12T18:17:13.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba11b91640 1 -- 10.20.193.48:0/3581913227 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fba0c05df60 msgr2=0x7fba0c05e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:13.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba11b91640 1 --2- 10.20.193.48:0/3581913227 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fba0c05df60 0x7fba0c05e330 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba11b91640 1 -- 10.20.193.48:0/3581913227 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fba0c05db90 msgr2=0x7fba0c144290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:13.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba11b91640 1 --2- 10.20.193.48:0/3581913227 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fba0c05db90 0x7fba0c144290 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba11b91640 10 monclient: _finish_hunting 0 2026-02-12T18:17:13.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba11b91640 1 monclient: found mon.noname-c 2026-02-12T18:17:13.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba11b91640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:13.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba11b91640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:17:13.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.606+0000 7fba11b91640 1 -- 10.20.193.48:0/3581913227 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba0c060390 con 0x7fba0c089df0 2026-02-12T18:17:13.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.608+0000 7fba11b91640 1 -- 10.20.193.48:0/3581913227 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fba0c089df0 msgr2=0x7fba0c08a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:13.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.608+0000 7fba11b91640 1 --2- 10.20.193.48:0/3581913227 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fba0c089df0 0x7fba0c08a200 secure :-1 s=READY pgs=279 gs=2 cs=0 l=1 c_cookie=12597272533476953795 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba0800a9b0 tx=0x7fba0802fef0 comp rx=0 tx=0).ready entity=mon.4 client_cookie=aed280a040adcec3 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:13.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.608+0000 7fb9fbfff640 1 -- 10.20.193.48:0/3581913227 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fba08030b70 con 0x7fba0c089df0 2026-02-12T18:17:13.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.608+0000 7fb9fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.608+0000 7fb9fbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:17:13.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.608+0000 7fb9fbfff640 10 monclient: dump: 2026-02-12T18:17:13.622 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.622 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.622 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.623 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.623 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.623 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.623 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.623 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.623 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.623 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.623 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.623 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.623 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.623 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.623 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.623 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.608+0000 7fb9fbfff640 10 monclient: _finish_auth 0 2026-02-12T18:17:13.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.608+0000 7fb9fbfff640 10 monclient: _check_auth_tickets 2026-02-12T18:17:13.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.608+0000 7fb9fbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:13.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.608+0000 7fb9fbfff640 1 -- 10.20.193.48:0/3581913227 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba08030cf0 con 0x7fba0c089df0 2026-02-12T18:17:13.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.608+0000 7fb9fbfff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:13.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.608+0000 7fb9fbfff640 1 -- 10.20.193.48:0/3581913227 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fba08030e60 con 0x7fba0c089df0 2026-02-12T18:17:13.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.608+0000 7fba1361b640 5 monclient: authenticate success, global_id 65371 2026-02-12T18:17:13.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.608+0000 7fba1361b640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:13.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.608+0000 7fba1361b640 4 set_mon_vals no callback set 2026-02-12T18:17:13.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.608+0000 7fb9fbfff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.608+0000 7fb9fbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:17:13.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.608+0000 7fb9fbfff640 10 monclient: dump: 2026-02-12T18:17:13.625 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.625 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.625 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.625 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.625 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.625 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.625 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.625 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.625 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.625 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.625 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.625 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.625 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.626 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.626 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.626 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.609+0000 7fba1361b640 10 monclient: shutdown 2026-02-12T18:17:13.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.609+0000 7fba1361b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:13.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.609+0000 7fba1361b640 1 -- 10.20.193.48:0/3581913227 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fba0c089df0 msgr2=0x7fba0c08a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.609+0000 7fba1361b640 1 --2- 10.20.193.48:0/3581913227 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fba0c089df0 0x7fba0c08a200 secure :-1 s=READY pgs=279 gs=2 cs=0 l=1 c_cookie=12597272533476953795 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba0800a9b0 tx=0x7fba0802fef0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.609+0000 7fba1361b640 1 -- 10.20.193.48:0/3581913227 shutdown_connections 2026-02-12T18:17:13.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.609+0000 7fba1361b640 1 --2- 10.20.193.48:0/3581913227 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fba0c089df0 0x7fba0c08a200 unknown :-1 s=CLOSED pgs=279 gs=2 cs=0 l=1 c_cookie=12597272533476953795 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.609+0000 7fba1361b640 1 --2- 10.20.193.48:0/3581913227 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fba0c05df60 0x7fba0c05e330 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.609+0000 7fba1361b640 1 --2- 10.20.193.48:0/3581913227 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fba0c05db90 0x7fba0c144290 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.609+0000 7fba1361b640 1 -- 10.20.193.48:0/3581913227 >> 10.20.193.48:0/3581913227 conn(0x7fba0c096410 msgr2=0x7fba0c097cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:13.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.609+0000 7fba1361b640 1 -- 10.20.193.48:0/3581913227 shutdown_connections 2026-02-12T18:17:13.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.609+0000 7fba1361b640 1 -- 10.20.193.48:0/3581913227 wait complete. 2026-02-12T18:17:13.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.609+0000 7fba1361b640 10 monclient: build_initial_monmap 2026-02-12T18:17:13.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.609+0000 7fba1361b640 10 monclient: monmap: 2026-02-12T18:17:13.627 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:13.627 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:13.627 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:13.627 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:13.627 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:13.627 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.627 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:13.628 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:13.628 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:13.628 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:13.628 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:13.628 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:13.628 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:13.628 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:13.628 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:13.628 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba1361b640 1 Processor -- start 2026-02-12T18:17:13.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba1361b640 1 -- start start 2026-02-12T18:17:13.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba1361b640 10 monclient: init 2026-02-12T18:17:13.628 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba1361b640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:13.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba1361b640 10 monclient: _add_conns ranks=[2,5,6,7,4,0,1,3,8] 2026-02-12T18:17:13.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba1361b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fba0c05db90 0x7fba0c08e8a0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba1361b640 10 monclient(hunting): picked mon.noname-b con 0x7fba0c05db90 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:17:13.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba1361b640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fba0c05df60 0x7fba0c08ede0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba1361b640 10 monclient(hunting): picked mon.noname-h con 0x7fba0c05df60 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:17:13.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba1361b640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fba0c089df0 0x7fba0c08f320 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba1361b640 10 monclient(hunting): picked mon.noname-d con 0x7fba0c089df0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:17:13.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba1361b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba1361b640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fba0c094530 con 0x7fba0c05db90 2026-02-12T18:17:13.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba1361b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba1361b640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fba0c0901d0 con 0x7fba0c05df60 2026-02-12T18:17:13.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba1361b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba1361b640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fba0c10e5e0 con 0x7fba0c089df0 2026-02-12T18:17:13.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba1361b640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:13.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba1361b640 10 monclient(hunting): authenticate will time out at 1272.336361s 2026-02-12T18:17:13.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11390640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fba0c05db90 0x7fba0c08e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11b91640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fba0c089df0 0x7fba0c08f320 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11390640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fba0c05db90 0x7fba0c08e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:44226/0 (socket says 10.20.193.48:44226) 2026-02-12T18:17:13.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11390640 1 -- 10.20.193.48:0/4014779787 learned_addr learned my addr 10.20.193.48:0/4014779787 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:13.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11390640 10 monclient(hunting): get_auth_request con 0x7fba0c05db90 auth_method 0 2026-02-12T18:17:13.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11390640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11390640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11390640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11b91640 10 monclient(hunting): get_auth_request con 0x7fba0c089df0 auth_method 0 2026-02-12T18:17:13.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11b91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11b91640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11b91640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11390640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11390640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11390640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11b91640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11b91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11b91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba10b8f640 1 --2- 10.20.193.48:0/4014779787 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fba0c05df60 0x7fba0c08ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba10b8f640 10 monclient(hunting): get_auth_request con 0x7fba0c05df60 auth_method 0 2026-02-12T18:17:13.631 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba10b8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba10b8f640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba10b8f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11390640 10 monclient(hunting): handle_auth_done global_id 36776 payload 824 2026-02-12T18:17:13.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11390640 1 -- 10.20.193.48:0/4014779787 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fba0c089df0 msgr2=0x7fba0c08f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11390640 1 --2- 10.20.193.48:0/4014779787 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fba0c089df0 0x7fba0c08f320 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11390640 1 -- 10.20.193.48:0/4014779787 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fba0c05df60 msgr2=0x7fba0c08ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11390640 1 --2- 10.20.193.48:0/4014779787 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fba0c05df60 0x7fba0c08ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11390640 10 monclient: _finish_hunting 0 2026-02-12T18:17:13.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11390640 1 monclient: found mon.noname-b 2026-02-12T18:17:13.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11390640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:13.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11390640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:17:13.632 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11390640 1 -- 10.20.193.48:0/4014779787 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba0800a5d0 con 0x7fba0c05db90 2026-02-12T18:17:13.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.610+0000 7fba11b91640 1 --2- 10.20.193.48:0/4014779787 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fba0c089df0 0x7fba0c08f320 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:17:13.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.612+0000 7fba11390640 1 -- 10.20.193.48:0/4014779787 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fba0c05db90 msgr2=0x7fba0c08e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:13.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.612+0000 7fba11390640 1 --2- 10.20.193.48:0/4014779787 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fba0c05db90 0x7fba0c08e8a0 secure :-1 s=READY pgs=473 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9fc006f30 tx=0x7fb9fc00ebd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:13.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.613+0000 7fb9f9ffb640 1 -- 10.20.193.48:0/4014779787 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb9fc00ee30 con 0x7fba0c05db90 2026-02-12T18:17:13.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.613+0000 7fb9f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.613+0000 7fb9f9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:17:13.633 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.613+0000 7fb9f9ffb640 10 monclient: dump: 2026-02-12T18:17:13.633 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.633 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.633 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.633 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.633 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.633 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.634 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.634 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.634 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.634 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.634 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.634 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.634 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.634 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.634 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.634 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.613+0000 7fb9f9ffb640 10 monclient: _finish_auth 0 2026-02-12T18:17:13.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.613+0000 7fb9f9ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:17:13.634 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.613+0000 7fb9f9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:13.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.613+0000 7fb9f9ffb640 1 -- 10.20.193.48:0/4014779787 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9fc00cda0 con 0x7fba0c05db90 2026-02-12T18:17:13.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.613+0000 7fba1361b640 5 monclient: authenticate success, global_id 36776 2026-02-12T18:17:13.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.613+0000 7fba1361b640 10 monclient: _renew_subs 2026-02-12T18:17:13.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.613+0000 7fba1361b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:17:13.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.613+0000 7fba1361b640 1 -- 10.20.193.48:0/4014779787 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba0c093f70 con 0x7fba0c05db90 2026-02-12T18:17:13.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.613+0000 7fb9f9ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:13.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.613+0000 7fb9f9ffb640 1 -- 10.20.193.48:0/4014779787 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fb9fc0138d0 con 0x7fba0c05db90 2026-02-12T18:17:13.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.613+0000 7fb9f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.613+0000 7fb9f9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:17:13.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.613+0000 7fb9fb7fe640 4 set_mon_vals no callback set 2026-02-12T18:17:13.635 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.613+0000 7fb9f9ffb640 10 monclient: dump: 2026-02-12T18:17:13.636 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.636 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.636 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.636 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.636 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.636 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.636 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.636 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.636 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.636 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.636 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.636 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.636 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.637 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.637 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.637 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.613+0000 7fba1361b640 10 monclient: _renew_subs 2026-02-12T18:17:13.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.613+0000 7fba1361b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:17:13.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.613+0000 7fba1361b640 1 -- 10.20.193.48:0/4014779787 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fba0c10e300 con 0x7fba0c05db90 2026-02-12T18:17:13.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.613+0000 7fba1361b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:17:13.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.613+0000 7fba1361b640 1 -- 10.20.193.48:0/4014779787 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fba0c1447d0 con 0x7fba0c05db90 2026-02-12T18:17:13.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.613+0000 7fb9f9ffb640 1 -- 10.20.193.48:0/4014779787 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fb9fc013410 con 0x7fba0c05db90 2026-02-12T18:17:13.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.613+0000 7fb9f9ffb640 1 --2- 10.20.193.48:0/4014779787 >> v2:10.20.193.111:6812/977811348 conn(0x7fb9dc03f800 0x7fb9dc05fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.614+0000 7fb9f9ffb640 1 -- 10.20.193.48:0/4014779787 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7fb9fc052ec0 con 0x7fba0c05db90 2026-02-12T18:17:13.637 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.614+0000 7fb9f9ffb640 1 --2- 10.20.193.48:0/4014779787 >> v2:10.20.193.111:6808/3554486394 conn(0x7fb9dc063340 0x7fb9dc083750 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.614+0000 7fb9f9ffb640 1 -- 10.20.193.48:0/4014779787 --> v2:10.20.193.111:6808/3554486394 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb9dc083dc0 con 0x7fb9dc063340 2026-02-12T18:17:13.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.614+0000 7fb9f9ffb640 1 -- 10.20.193.48:0/4014779787 <== mon.2 v2:10.20.193.48:3301/0 6 ==== mon_get_version_reply(handle=1 version=322) ==== 24+0+0 (secure 0 0 0) 0x7fb9fc053160 con 0x7fba0c05db90 2026-02-12T18:17:13.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.614+0000 7fb9f9ffb640 10 monclient: handle_get_version_reply finishing 1 version 322 2026-02-12T18:17:13.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.614+0000 7fba10b8f640 1 --2- 10.20.193.48:0/4014779787 >> v2:10.20.193.111:6812/977811348 conn(0x7fb9dc03f800 0x7fb9dc05fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.614+0000 7fba10b8f640 10 monclient: get_auth_request con 0x7fb9dc03f800 auth_method 0 2026-02-12T18:17:13.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.614+0000 7fba11b91640 1 --2- 10.20.193.48:0/4014779787 >> v2:10.20.193.111:6808/3554486394 conn(0x7fb9dc063340 0x7fb9dc083750 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.614+0000 7fba11b91640 10 monclient: get_auth_request con 0x7fb9dc063340 auth_method 0 2026-02-12T18:17:13.638 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.616+0000 7fba10b8f640 1 --2- 10.20.193.48:0/4014779787 >> v2:10.20.193.111:6812/977811348 conn(0x7fb9dc03f800 0x7fb9dc05fcb0 secure :-1 s=READY pgs=495 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba0c08fee0 tx=0x7fba00008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:13.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.618+0000 7fba11b91640 1 --2- 10.20.193.48:0/4014779787 >> v2:10.20.193.111:6808/3554486394 conn(0x7fb9dc063340 0x7fb9dc083750 crc :-1 s=READY pgs=169 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:13.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.619+0000 7fb9f9ffb640 1 -- 10.20.193.48:0/4014779787 <== osd.4 v2:10.20.193.111:6808/3554486394 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fb9dc083dc0 con 0x7fb9dc063340 2026-02-12T18:17:13.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.626+0000 7fba1361b640 1 -- 10.20.193.48:0/4014779787 --> v2:10.20.193.111:6808/3554486394 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fba0c144270 con 0x7fb9dc063340 2026-02-12T18:17:13.639 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.626+0000 7fb9f9ffb640 1 -- 10.20.193.48:0/4014779787 <== osd.4 v2:10.20.193.111:6808/3554486394 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fba0c144270 con 0x7fb9dc063340 2026-02-12T18:17:13.640 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:17:13.640 INFO:teuthology.orchestra.run.trial048.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T18:17:13.640 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:17:13.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.626+0000 7fba1361b640 1 -- 10.20.193.48:0/4014779787 >> v2:10.20.193.111:6808/3554486394 conn(0x7fb9dc063340 msgr2=0x7fb9dc083750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.626+0000 7fba1361b640 1 --2- 10.20.193.48:0/4014779787 >> v2:10.20.193.111:6808/3554486394 conn(0x7fb9dc063340 0x7fb9dc083750 crc :-1 s=READY pgs=169 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.626+0000 7fba1361b640 1 -- 10.20.193.48:0/4014779787 >> v2:10.20.193.111:6812/977811348 conn(0x7fb9dc03f800 msgr2=0x7fb9dc05fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.626+0000 7fba1361b640 1 --2- 10.20.193.48:0/4014779787 >> v2:10.20.193.111:6812/977811348 conn(0x7fb9dc03f800 0x7fb9dc05fcb0 secure :-1 s=READY pgs=495 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fba0c08fee0 tx=0x7fba00008040 comp rx=0 tx=0).stop 2026-02-12T18:17:13.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.626+0000 7fba1361b640 10 monclient: shutdown 2026-02-12T18:17:13.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.626+0000 7fba1361b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:13.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.626+0000 7fba1361b640 1 -- 10.20.193.48:0/4014779787 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fba0c05db90 msgr2=0x7fba0c08e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.626+0000 7fba1361b640 1 --2- 10.20.193.48:0/4014779787 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fba0c05db90 0x7fba0c08e8a0 secure :-1 s=READY pgs=473 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fb9fc006f30 tx=0x7fb9fc00ebd0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.626+0000 7fba11b91640 1 -- 10.20.193.48:0/4014779787 reap_dead start 2026-02-12T18:17:13.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.626+0000 7fba1361b640 1 -- 10.20.193.48:0/4014779787 shutdown_connections 2026-02-12T18:17:13.642 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.626+0000 7fba1361b640 1 -- 10.20.193.48:0/4014779787 >> 10.20.193.48:0/4014779787 conn(0x7fba0c096410 msgr2=0x7fba0c126d80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:13.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.626+0000 7fba1361b640 1 -- 10.20.193.48:0/4014779787 shutdown_connections 2026-02-12T18:17:13.643 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.626+0000 7fba1361b640 1 -- 10.20.193.48:0/4014779787 wait complete. 2026-02-12T18:17:13.643 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2026-02-12T18:17:13.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.709+0000 7fc5eeecc640 10 monclient: get_monmap_and_config 2026-02-12T18:17:13.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.709+0000 7fc5eeecc640 10 monclient: build_initial_monmap 2026-02-12T18:17:13.710 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.709+0000 7fc5eeecc640 10 monclient: monmap: 2026-02-12T18:17:13.710 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:13.711 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.711 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:13.710127+0000 2026-02-12T18:17:13.711 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:13.710127+0000 2026-02-12T18:17:13.711 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:13.711 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.711 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:13.711 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:13.711 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:13.711 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:13.711 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:13.711 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:13.711 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:13.711 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:13.712 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:13.712 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:13.712 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:13.712 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.709+0000 7fc5eeecc640 1 Processor -- start 2026-02-12T18:17:13.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.709+0000 7fc5eeecc640 1 -- start start 2026-02-12T18:17:13.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.709+0000 7fc5eeecc640 10 monclient: init 2026-02-12T18:17:13.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.709+0000 7fc5eeecc640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:13.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.709+0000 7fc5eeecc640 10 monclient: _add_conns ranks=[10,7,5,3,4,1,9,6,2,0,8] 2026-02-12T18:17:13.722 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.709+0000 7fc5eeecc640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7fc5e805c950 0x7fc5e805cd20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.709+0000 7fc5eeecc640 10 monclient(hunting): picked mon.noname-f con 0x7fc5e805c950 addr v2:10.20.193.111:3300/0 2026-02-12T18:17:13.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.709+0000 7fc5eeecc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fc5e805e490 0x7fc5e805d260 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.709+0000 7fc5eeecc640 10 monclient(hunting): picked mon.noname-i con 0x7fc5e805e490 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:17:13.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.709+0000 7fc5eeecc640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fc5e813db70 0x7fc5e813e010 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.709+0000 7fc5eeecc640 10 monclient(hunting): picked mon.noname-h con 0x7fc5e813db70 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:17:13.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.709+0000 7fc5eeecc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.709+0000 7fc5eeecc640 1 -- --> v2:10.20.193.111:3300/0 -- mon_getmap magic: 0 -- 0x7fc5e805ddd0 con 0x7fc5e805c950 2026-02-12T18:17:13.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.709+0000 7fc5eeecc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.709+0000 7fc5eeecc640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fc5e805d7a0 con 0x7fc5e813db70 2026-02-12T18:17:13.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.709+0000 7fc5eeecc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.709+0000 7fc5eeecc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fc5e8092990 con 0x7fc5e805e490 2026-02-12T18:17:13.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.709+0000 7fc5eeecc640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:13.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.709+0000 7fc5eeecc640 10 monclient(hunting): authenticate will time out at 1272.435864s 2026-02-12T18:17:13.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5ecc41640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7fc5e805c950 0x7fc5e805cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5dffff640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fc5e805e490 0x7fc5e805d260 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5ed442640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fc5e813db70 0x7fc5e813e010 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5ecc41640 1 --2- >> v2:10.20.193.111:3300/0 conn(0x7fc5e805c950 0x7fc5e805cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.111:3300/0 says I am v2:10.20.193.48:50236/0 (socket says 10.20.193.48:50236) 2026-02-12T18:17:13.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5ecc41640 1 -- 10.20.193.48:0/1568339544 learned_addr learned my addr 10.20.193.48:0/1568339544 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:13.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5ecc41640 10 monclient(hunting): get_auth_request con 0x7fc5e805c950 auth_method 0 2026-02-12T18:17:13.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5ecc41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5ecc41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5ecc41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5ed442640 10 monclient(hunting): get_auth_request con 0x7fc5e813db70 auth_method 0 2026-02-12T18:17:13.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5ed442640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5ed442640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5ed442640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5dffff640 10 monclient(hunting): get_auth_request con 0x7fc5e805e490 auth_method 0 2026-02-12T18:17:13.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5dffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5dffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5dffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5dffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5dffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5dffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5ed442640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5ed442640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5ed442640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5ecc41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5ecc41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5ecc41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5dffff640 10 monclient(hunting): handle_auth_done global_id 114217 payload 274 2026-02-12T18:17:13.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5dffff640 1 -- 10.20.193.48:0/1568339544 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fc5e813db70 msgr2=0x7fc5e813e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:13.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5dffff640 1 --2- 10.20.193.48:0/1568339544 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fc5e813db70 0x7fc5e813e010 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5dffff640 1 -- 10.20.193.48:0/1568339544 >> v2:10.20.193.111:3300/0 conn(0x7fc5e805c950 msgr2=0x7fc5e805cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:13.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5dffff640 1 --2- 10.20.193.48:0/1568339544 >> v2:10.20.193.111:3300/0 conn(0x7fc5e805c950 0x7fc5e805cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5dffff640 10 monclient: _finish_hunting 0 2026-02-12T18:17:13.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5dffff640 1 monclient: found mon.noname-i 2026-02-12T18:17:13.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5dffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:13.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5dffff640 10 monclient: _send_mon_message to mon.noname-i at v2:10.20.193.111:3303/0 2026-02-12T18:17:13.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.710+0000 7fc5dffff640 1 -- 10.20.193.48:0/1568339544 --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e804dc20 con 0x7fc5e805e490 2026-02-12T18:17:13.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.712+0000 7fc5dffff640 1 -- 10.20.193.48:0/1568339544 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fc5e805e490 msgr2=0x7fc5e805d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:13.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.712+0000 7fc5dffff640 1 --2- 10.20.193.48:0/1568339544 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fc5e805e490 0x7fc5e805d260 secure :-1 s=READY pgs=20 gs=2 cs=0 l=1 c_cookie=1114154826963813250 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5d0004740 tx=0x7fc5d002ed10 comp rx=0 tx=0).ready entity=mon.7 client_cookie=f7645e97df70382 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:13.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5df7fe640 1 -- 10.20.193.48:0/1568339544 <== mon.7 v2:10.20.193.111:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc5d002fe50 con 0x7fc5e805e490 2026-02-12T18:17:13.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5df7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5df7fe640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2026-02-12T18:17:13.727 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5df7fe640 10 monclient: dump: 2026-02-12T18:17:13.727 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.727 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.727 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.727 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.727 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.727 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.727 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.728 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.728 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.728 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.728 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.728 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.728 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.728 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.728 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.728 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5df7fe640 10 monclient: _finish_auth 0 2026-02-12T18:17:13.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5df7fe640 10 monclient: _check_auth_tickets 2026-02-12T18:17:13.728 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5df7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:13.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5df7fe640 1 -- 10.20.193.48:0/1568339544 <== mon.7 v2:10.20.193.111:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5d0035340 con 0x7fc5e805e490 2026-02-12T18:17:13.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5df7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:13.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5df7fe640 1 -- 10.20.193.48:0/1568339544 <== mon.7 v2:10.20.193.111:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc5d0035970 con 0x7fc5e805e490 2026-02-12T18:17:13.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5df7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5df7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2026-02-12T18:17:13.729 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5df7fe640 10 monclient: dump: 2026-02-12T18:17:13.729 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.729 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.729 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.729 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.729 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.730 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.730 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.730 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.730 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.730 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.730 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.730 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.730 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.730 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.730 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.730 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5eeecc640 5 monclient: authenticate success, global_id 114217 2026-02-12T18:17:13.730 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5eeecc640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:13.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5eeecc640 4 set_mon_vals no callback set 2026-02-12T18:17:13.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5eeecc640 10 monclient: shutdown 2026-02-12T18:17:13.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5eeecc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:13.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5eeecc640 1 -- 10.20.193.48:0/1568339544 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fc5e805e490 msgr2=0x7fc5e805d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5eeecc640 1 --2- 10.20.193.48:0/1568339544 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fc5e805e490 0x7fc5e805d260 secure :-1 s=READY pgs=20 gs=2 cs=0 l=1 c_cookie=1114154826963813250 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5d0004740 tx=0x7fc5d002ed10 comp rx=0 tx=0).stop 2026-02-12T18:17:13.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5eeecc640 1 -- 10.20.193.48:0/1568339544 shutdown_connections 2026-02-12T18:17:13.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5eeecc640 1 --2- 10.20.193.48:0/1568339544 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fc5e813db70 0x7fc5e813e010 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5eeecc640 1 --2- 10.20.193.48:0/1568339544 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fc5e805e490 0x7fc5e805d260 unknown :-1 s=CLOSED pgs=20 gs=2 cs=0 l=1 c_cookie=1114154826963813250 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5eeecc640 1 --2- 10.20.193.48:0/1568339544 >> v2:10.20.193.111:3300/0 conn(0x7fc5e805c950 0x7fc5e805cd20 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5eeecc640 1 -- 10.20.193.48:0/1568339544 >> 10.20.193.48:0/1568339544 conn(0x7fc5e80548a0 msgr2=0x7fc5e8097410 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:13.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5eeecc640 1 -- 10.20.193.48:0/1568339544 shutdown_connections 2026-02-12T18:17:13.731 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.713+0000 7fc5eeecc640 1 -- 10.20.193.48:0/1568339544 wait complete. 2026-02-12T18:17:13.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5eeecc640 10 monclient: build_initial_monmap 2026-02-12T18:17:13.732 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5eeecc640 10 monclient: monmap: 2026-02-12T18:17:13.732 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:13.732 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:13.732 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:13.732 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:13.732 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:13.732 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.732 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:13.732 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:13.732 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:13.732 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:13.733 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:13.733 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:13.733 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:13.733 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:13.733 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:13.733 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5eeecc640 1 Processor -- start 2026-02-12T18:17:13.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5eeecc640 1 -- start start 2026-02-12T18:17:13.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5eeecc640 10 monclient: init 2026-02-12T18:17:13.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5eeecc640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:13.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5eeecc640 10 monclient: _add_conns ranks=[1,5,8,7,4,6,0,3,2] 2026-02-12T18:17:13.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5eeecc640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fc5e805c950 0x7fc5e808d890 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.733 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5eeecc640 10 monclient(hunting): picked mon.noname-f con 0x7fc5e805c950 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:17:13.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5eeecc640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fc5e805e490 0x7fc5e813f250 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5eeecc640 10 monclient(hunting): picked mon.noname-h con 0x7fc5e805e490 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:17:13.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5eeecc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fc5e813db70 0x7fc5e813f790 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5eeecc640 10 monclient(hunting): picked mon.noname-e con 0x7fc5e813db70 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:17:13.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5eeecc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5eeecc640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e813e460 con 0x7fc5e805c950 2026-02-12T18:17:13.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5eeecc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5eeecc640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fc5e808a780 con 0x7fc5e805e490 2026-02-12T18:17:13.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5eeecc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5eeecc640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fc5e8143aa0 con 0x7fc5e813db70 2026-02-12T18:17:13.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5eeecc640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:13.734 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5eeecc640 10 monclient(hunting): authenticate will time out at 1272.440521s 2026-02-12T18:17:13.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ed442640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fc5e813db70 0x7fc5e813f790 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ed442640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fc5e813db70 0x7fc5e813f790 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:33836/0 (socket says 10.20.193.48:33836) 2026-02-12T18:17:13.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ed442640 1 -- 10.20.193.48:0/308535312 learned_addr learned my addr 10.20.193.48:0/308535312 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:13.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ed442640 10 monclient(hunting): get_auth_request con 0x7fc5e813db70 auth_method 0 2026-02-12T18:17:13.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ecc41640 1 --2- 10.20.193.48:0/308535312 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fc5e805c950 0x7fc5e808d890 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ed442640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ed442640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ed442640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ecc41640 10 monclient(hunting): get_auth_request con 0x7fc5e805c950 auth_method 0 2026-02-12T18:17:13.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ecc41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ecc41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.735 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ecc41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5dffff640 1 --2- 10.20.193.48:0/308535312 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fc5e805e490 0x7fc5e813f250 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5dffff640 10 monclient(hunting): get_auth_request con 0x7fc5e805e490 auth_method 0 2026-02-12T18:17:13.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5dffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5dffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5dffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ecc41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ecc41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ecc41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ed442640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ed442640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ed442640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.736 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5dffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5dffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5dffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ecc41640 10 monclient(hunting): handle_auth_done global_id 95149 payload 824 2026-02-12T18:17:13.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ecc41640 1 -- 10.20.193.48:0/308535312 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fc5e813db70 msgr2=0x7fc5e813f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ecc41640 1 --2- 10.20.193.48:0/308535312 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fc5e813db70 0x7fc5e813f790 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ecc41640 1 -- 10.20.193.48:0/308535312 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fc5e805e490 msgr2=0x7fc5e813f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ecc41640 1 --2- 10.20.193.48:0/308535312 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fc5e805e490 0x7fc5e813f250 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ecc41640 10 monclient: _finish_hunting 0 2026-02-12T18:17:13.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ecc41640 1 monclient: found mon.noname-f 2026-02-12T18:17:13.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ecc41640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:13.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ecc41640 10 monclient: _send_mon_message to mon.noname-f at v2:10.20.193.111:3300/0 2026-02-12T18:17:13.737 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.714+0000 7fc5ecc41640 1 -- 10.20.193.48:0/308535312 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5d0009420 con 0x7fc5e805c950 2026-02-12T18:17:13.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5ecc41640 1 -- 10.20.193.48:0/308535312 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fc5e805c950 msgr2=0x7fc5e808d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:13.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5ecc41640 1 --2- 10.20.193.48:0/308535312 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fc5e805c950 0x7fc5e808d890 secure :-1 s=READY pgs=233 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5d8006fd0 tx=0x7fc5d800ece0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:13.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5dd7fa640 1 -- 10.20.193.48:0/308535312 <== mon.1 v2:10.20.193.111:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc5d8013470 con 0x7fc5e805c950 2026-02-12T18:17:13.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5dd7fa640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2026-02-12T18:17:13.738 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5dd7fa640 10 monclient: dump: 2026-02-12T18:17:13.738 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.738 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.738 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.738 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.738 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.738 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.738 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.739 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.739 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.739 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.739 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.739 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.739 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.739 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.739 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.739 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5dd7fa640 10 monclient: _finish_auth 0 2026-02-12T18:17:13.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5dd7fa640 10 monclient: _check_auth_tickets 2026-02-12T18:17:13.739 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5dd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:13.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5dd7fa640 1 -- 10.20.193.48:0/308535312 <== mon.1 v2:10.20.193.111:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5d8013610 con 0x7fc5e805c950 2026-02-12T18:17:13.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5eeecc640 5 monclient: authenticate success, global_id 95149 2026-02-12T18:17:13.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5eeecc640 10 monclient: _renew_subs 2026-02-12T18:17:13.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5eeecc640 10 monclient: _send_mon_message to mon.f at v2:10.20.193.111:3300/0 2026-02-12T18:17:13.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5eeecc640 1 -- 10.20.193.48:0/308535312 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5e808ad40 con 0x7fc5e805c950 2026-02-12T18:17:13.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5dd7fa640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:13.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5dd7fa640 1 -- 10.20.193.48:0/308535312 <== mon.1 v2:10.20.193.111:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fc5d8013c40 con 0x7fc5e805c950 2026-02-12T18:17:13.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5deffd640 4 set_mon_vals no callback set 2026-02-12T18:17:13.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5dd7fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2026-02-12T18:17:13.740 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5dd7fa640 10 monclient: dump: 2026-02-12T18:17:13.741 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.741 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.741 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.741 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.741 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.741 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.741 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.741 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.741 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.741 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.741 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.741 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.741 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.742 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.742 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.742 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5eeecc640 10 monclient: _renew_subs 2026-02-12T18:17:13.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5eeecc640 10 monclient: _send_mon_message to mon.f at v2:10.20.193.111:3300/0 2026-02-12T18:17:13.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5eeecc640 1 -- 10.20.193.48:0/308535312 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5e808a1b0 con 0x7fc5e805c950 2026-02-12T18:17:13.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5eeecc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:13.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5eeecc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:13.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5eeecc640 10 monclient: _send_mon_message to mon.f at v2:10.20.193.111:3300/0 2026-02-12T18:17:13.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.717+0000 7fc5eeecc640 1 -- 10.20.193.48:0/308535312 --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5e808a9c0 con 0x7fc5e805c950 2026-02-12T18:17:13.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.718+0000 7fc5dd7fa640 1 -- 10.20.193.48:0/308535312 <== mon.1 v2:10.20.193.111:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fc5d8011070 con 0x7fc5e805c950 2026-02-12T18:17:13.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.718+0000 7fc5dd7fa640 1 --2- 10.20.193.48:0/308535312 >> v2:10.20.193.111:6812/977811348 conn(0x7fc5b803f800 0x7fc5b805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.718+0000 7fc5dd7fa640 1 -- 10.20.193.48:0/308535312 <== mon.1 v2:10.20.193.111:3300/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7fc5d8052c80 con 0x7fc5e805c950 2026-02-12T18:17:13.742 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.718+0000 7fc5dffff640 1 --2- 10.20.193.48:0/308535312 >> v2:10.20.193.111:6812/977811348 conn(0x7fc5b803f800 0x7fc5b805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.718+0000 7fc5dffff640 10 monclient: get_auth_request con 0x7fc5b803f800 auth_method 0 2026-02-12T18:17:13.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.720+0000 7fc5dd7fa640 1 -- 10.20.193.48:0/308535312 <== mon.1 v2:10.20.193.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fc5d801c450 con 0x7fc5e805c950 2026-02-12T18:17:13.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.720+0000 7fc5dd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:13.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.720+0000 7fc5dd7fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:17:13.743 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.720+0000 7fc5dffff640 1 --2- 10.20.193.48:0/308535312 >> v2:10.20.193.111:6812/977811348 conn(0x7fc5b803f800 0x7fc5b805fcb0 secure :-1 s=READY pgs=496 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5d002ed50 tx=0x7fc5d0039040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:13.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.824+0000 7fc5eeecc640 1 -- 10.20.193.48:0/308535312 --> v2:10.20.193.111:6812/977811348 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fc5e8097de0 con 0x7fc5b803f800 2026-02-12T18:17:13.826 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.825+0000 7fc5dd7fa640 1 -- 10.20.193.48:0/308535312 <== mgr.4123 v2:10.20.193.111:6812/977811348 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc5e8097de0 con 0x7fc5b803f800 2026-02-12T18:17:13.826 INFO:teuthology.orchestra.run.trial048.stderr:instructed osd(s) 4 to deep-scrub 2026-02-12T18:17:13.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.826+0000 7fc5eeecc640 1 -- 10.20.193.48:0/308535312 >> v2:10.20.193.111:6812/977811348 conn(0x7fc5b803f800 msgr2=0x7fc5b805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.826+0000 7fc5eeecc640 1 --2- 10.20.193.48:0/308535312 >> v2:10.20.193.111:6812/977811348 conn(0x7fc5b803f800 0x7fc5b805fcb0 secure :-1 s=READY pgs=496 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5d002ed50 tx=0x7fc5d0039040 comp rx=0 tx=0).stop 2026-02-12T18:17:13.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.826+0000 7fc5eeecc640 10 monclient: shutdown 2026-02-12T18:17:13.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.826+0000 7fc5eeecc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:13.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.826+0000 7fc5eeecc640 1 -- 10.20.193.48:0/308535312 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fc5e805c950 msgr2=0x7fc5e808d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.826+0000 7fc5eeecc640 1 --2- 10.20.193.48:0/308535312 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fc5e805c950 0x7fc5e808d890 secure :-1 s=READY pgs=233 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fc5d8006fd0 tx=0x7fc5d800ece0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.826+0000 7fc5eeecc640 1 -- 10.20.193.48:0/308535312 shutdown_connections 2026-02-12T18:17:13.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.826+0000 7fc5eeecc640 1 --2- 10.20.193.48:0/308535312 >> v2:10.20.193.111:6812/977811348 conn(0x7fc5b803f800 0x7fc5b805fcb0 unknown :-1 s=CLOSED pgs=496 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.826+0000 7fc5eeecc640 1 --2- 10.20.193.48:0/308535312 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fc5e813db70 0x7fc5e813f790 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.828 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.826+0000 7fc5eeecc640 1 --2- 10.20.193.48:0/308535312 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fc5e805e490 0x7fc5e813f250 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.826+0000 7fc5eeecc640 1 --2- 10.20.193.48:0/308535312 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7fc5e805c950 0x7fc5e808d890 unknown :-1 s=CLOSED pgs=233 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.826+0000 7fc5eeecc640 1 -- 10.20.193.48:0/308535312 >> 10.20.193.48:0/308535312 conn(0x7fc5e80548a0 msgr2=0x7fc5e8093ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:13.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.826+0000 7fc5eeecc640 1 -- 10.20.193.48:0/308535312 shutdown_connections 2026-02-12T18:17:13.829 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.826+0000 7fc5eeecc640 1 -- 10.20.193.48:0/308535312 wait complete. 2026-02-12T18:17:13.835 INFO:tasks.ceph:Scrubbing osd.5 2026-02-12T18:17:13.835 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2026-02-12T18:17:13.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.901+0000 7fdd0f61b640 10 monclient: get_monmap_and_config 2026-02-12T18:17:13.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.901+0000 7fdd0f61b640 10 monclient: build_initial_monmap 2026-02-12T18:17:13.903 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.901+0000 7fdd0f61b640 10 monclient: monmap: 2026-02-12T18:17:13.903 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:13.903 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.903 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:13.902987+0000 2026-02-12T18:17:13.904 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:13.902987+0000 2026-02-12T18:17:13.904 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:13.904 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.904 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:13.904 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:13.904 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:13.904 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:13.904 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:13.904 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:13.904 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:13.904 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:13.904 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:13.905 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:13.905 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:13.905 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.902+0000 7fdd0f61b640 1 Processor -- start 2026-02-12T18:17:13.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.902+0000 7fdd0f61b640 1 -- start start 2026-02-12T18:17:13.914 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.902+0000 7fdd0f61b640 10 monclient: init 2026-02-12T18:17:13.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.902+0000 7fdd0f61b640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:13.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.902+0000 7fdd0f61b640 10 monclient: _add_conns ranks=[0,5,2,7,3,4,6,9,1,10,8] 2026-02-12T18:17:13.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.902+0000 7fdd0f61b640 10 monclient(hunting): picked mon.noname-a-legacy con 0x7fdd0808ff50 addr v1:10.20.193.48:6789/0 2026-02-12T18:17:13.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.902+0000 7fdd0f61b640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fdd08141170 0x7fdd081854e0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.902+0000 7fdd0f61b640 10 monclient(hunting): picked mon.noname-h con 0x7fdd08141170 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:17:13.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.902+0000 7fdd0f61b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fdd0805d930 0x7fdd081a5a30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.902+0000 7fdd0f61b640 10 monclient(hunting): picked mon.noname-b con 0x7fdd0805d930 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:17:13.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.902+0000 7fdd0f61b640 1 -- --> v1:10.20.193.48:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd08060390 con 0x7fdd0808ff50 2026-02-12T18:17:13.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.902+0000 7fdd0f61b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.902+0000 7fdd0f61b640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fdd0805e600 con 0x7fdd0805d930 2026-02-12T18:17:13.915 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.902+0000 7fdd0f61b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.902+0000 7fdd0f61b640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fdd0805e8e0 con 0x7fdd08141170 2026-02-12T18:17:13.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.902+0000 7fdd0f61b640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:13.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.902+0000 7fdd0f61b640 10 monclient(hunting): authenticate will time out at 1272.628905s 2026-02-12T18:17:13.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.902+0000 7fdd0d390640 1 --1- >> v1:10.20.193.48:6789/0 conn(0x7fdd0808ff50 0x7fdd08090320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.48:6789/0 says I am v1:10.20.193.48:44068/0 (socket says 10.20.193.48:44068) 2026-02-12T18:17:13.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.903+0000 7fdd0d390640 1 -- 10.20.193.48:0/4066890628 learned_addr learned my addr 10.20.193.48:0/4066890628 (peer_addr_for_me v1:10.20.193.48:0/0) 2026-02-12T18:17:13.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.903+0000 7fdd0db91640 1 --2- 10.20.193.48:0/4066890628 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fdd0805d930 0x7fdd081a5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.903+0000 7fdd0db91640 10 monclient(hunting): get_auth_request con 0x7fdd0805d930 auth_method 0 2026-02-12T18:17:13.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.903+0000 7fdd0db91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.903+0000 7fdd0db91640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.903+0000 7fdd0db91640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.903+0000 7fdd0cb8f640 1 --2- 10.20.193.48:0/4066890628 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fdd08141170 0x7fdd081854e0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.916 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.903+0000 7fdd0cb8f640 10 monclient(hunting): get_auth_request con 0x7fdd08141170 auth_method 0 2026-02-12T18:17:13.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.903+0000 7fdd0cb8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.903+0000 7fdd0cb8f640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.903+0000 7fdd0cb8f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.903+0000 7fdd0db91640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.903+0000 7fdd0db91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.903+0000 7fdd0db91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.903+0000 7fdd0db91640 10 monclient(hunting): handle_auth_done global_id 36785 payload 274 2026-02-12T18:17:13.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.903+0000 7fdd0db91640 1 -- 10.20.193.48:0/4066890628 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fdd08141170 msgr2=0x7fdd081854e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:13.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.903+0000 7fdd0db91640 1 --2- 10.20.193.48:0/4066890628 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fdd08141170 0x7fdd081854e0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.903+0000 7fdd0db91640 1 -- 10.20.193.48:0/4066890628 >> v1:10.20.193.48:6789/0 conn(0x7fdd0808ff50 legacy=0x7fdd08090320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:13.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.903+0000 7fdd0db91640 10 monclient: _finish_hunting 0 2026-02-12T18:17:13.917 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.903+0000 7fdd0db91640 1 monclient: found mon.noname-b 2026-02-12T18:17:13.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.903+0000 7fdd0db91640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:13.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.903+0000 7fdd0db91640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:17:13.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.903+0000 7fdd0db91640 1 -- 10.20.193.48:0/4066890628 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd0805ebc0 con 0x7fdd0805d930 2026-02-12T18:17:13.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.905+0000 7fdd0db91640 1 -- 10.20.193.48:0/4066890628 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fdd0805d930 msgr2=0x7fdd081a5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:13.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.905+0000 7fdd0db91640 1 --2- 10.20.193.48:0/4066890628 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fdd0805d930 0x7fdd081a5a30 secure :-1 s=READY pgs=474 gs=2 cs=0 l=1 c_cookie=12677308578274897535 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd0400a8e0 tx=0x7fdd0402feb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afeed8fc14166e7f server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:13.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.905+0000 7fdcf7fff640 1 -- 10.20.193.48:0/4066890628 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fdd04036340 con 0x7fdd0805d930 2026-02-12T18:17:13.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.905+0000 7fdcf7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdcf7fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:17:13.918 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdcf7fff640 10 monclient: dump: 2026-02-12T18:17:13.918 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.918 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.919 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.919 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.919 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.919 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.919 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.919 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.919 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.919 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.919 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.919 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.919 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.919 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.919 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.920 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdcf7fff640 10 monclient: _finish_auth 0 2026-02-12T18:17:13.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdcf7fff640 10 monclient: _check_auth_tickets 2026-02-12T18:17:13.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdcf7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:13.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdcf7fff640 1 -- 10.20.193.48:0/4066890628 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd040364c0 con 0x7fdd0805d930 2026-02-12T18:17:13.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdd0f61b640 5 monclient: authenticate success, global_id 36785 2026-02-12T18:17:13.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdd0f61b640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:17:13.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdcf7fff640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:13.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdcf7fff640 1 -- 10.20.193.48:0/4066890628 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fdd04036af0 con 0x7fdd0805d930 2026-02-12T18:17:13.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdcf7fff640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdcf7fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:17:13.920 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdcf7fff640 10 monclient: dump: 2026-02-12T18:17:13.921 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.921 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.921 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.921 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.921 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.921 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.921 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.921 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.921 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.921 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.921 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.921 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.922 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.922 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.922 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.922 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdd0f61b640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:13.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdd0f61b640 4 set_mon_vals no callback set 2026-02-12T18:17:13.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdd0f61b640 10 monclient: shutdown 2026-02-12T18:17:13.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdd0f61b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:13.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdd0f61b640 1 -- 10.20.193.48:0/4066890628 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fdd0805d930 msgr2=0x7fdd081a5a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdd0f61b640 1 --2- 10.20.193.48:0/4066890628 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fdd0805d930 0x7fdd081a5a30 secure :-1 s=READY pgs=474 gs=2 cs=0 l=1 c_cookie=12677308578274897535 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd0400a8e0 tx=0x7fdd0402feb0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdd0f61b640 1 -- 10.20.193.48:0/4066890628 shutdown_connections 2026-02-12T18:17:13.922 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdd0f61b640 1 --2- 10.20.193.48:0/4066890628 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fdd0805d930 0x7fdd081a5a30 unknown :-1 s=CLOSED pgs=474 gs=2 cs=0 l=1 c_cookie=12677308578274897535 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdd0f61b640 1 --2- 10.20.193.48:0/4066890628 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fdd08141170 0x7fdd081854e0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdd0f61b640 1 -- 10.20.193.48:0/4066890628 >> 10.20.193.48:0/4066890628 conn(0x7fdd080944c0 msgr2=0x7fdd080948c0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:13.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdd0f61b640 1 -- 10.20.193.48:0/4066890628 shutdown_connections 2026-02-12T18:17:13.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdd0f61b640 1 -- 10.20.193.48:0/4066890628 wait complete. 2026-02-12T18:17:13.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdd0f61b640 10 monclient: build_initial_monmap 2026-02-12T18:17:13.923 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.906+0000 7fdd0f61b640 10 monclient: monmap: 2026-02-12T18:17:13.923 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:13.923 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:13.923 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:13.923 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:13.923 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:13.923 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.924 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:13.924 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:13.924 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:13.924 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:13.924 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:13.924 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:13.924 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:13.924 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:13.924 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:13.924 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0f61b640 1 Processor -- start 2026-02-12T18:17:13.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0f61b640 1 -- start start 2026-02-12T18:17:13.924 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0f61b640 10 monclient: init 2026-02-12T18:17:13.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0f61b640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:13.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0f61b640 10 monclient: _add_conns ranks=[6,8,3,2,5,0,4,7,1] 2026-02-12T18:17:13.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0f61b640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fdd0805d930 0x7fdd08116830 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0f61b640 10 monclient(hunting): picked mon.noname-d con 0x7fdd0805d930 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:17:13.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0f61b640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdd0808ff50 0x7fdd08116d70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0f61b640 10 monclient(hunting): picked mon.noname-e con 0x7fdd0808ff50 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:17:13.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0f61b640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fdd08141170 0x7fdd081172b0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0f61b640 10 monclient(hunting): picked mon.noname-g con 0x7fdd08141170 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:17:13.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0f61b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0f61b640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7fdd0812b200 con 0x7fdd08141170 2026-02-12T18:17:13.925 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0f61b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0f61b640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fdd08129d10 con 0x7fdd0805d930 2026-02-12T18:17:13.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0f61b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:13.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0f61b640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7fdd0812c070 con 0x7fdd0808ff50 2026-02-12T18:17:13.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0f61b640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:13.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0f61b640 10 monclient(hunting): authenticate will time out at 1272.633396s 2026-02-12T18:17:13.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0cb8f640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdd0808ff50 0x7fdd08116d70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0d390640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fdd0805d930 0x7fdd08116830 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0cb8f640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdd0808ff50 0x7fdd08116d70 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:33848/0 (socket says 10.20.193.48:33848) 2026-02-12T18:17:13.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0cb8f640 1 -- 10.20.193.48:0/2699512459 learned_addr learned my addr 10.20.193.48:0/2699512459 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:13.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0cb8f640 10 monclient(hunting): get_auth_request con 0x7fdd0808ff50 auth_method 0 2026-02-12T18:17:13.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0cb8f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.926 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0cb8f640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0cb8f640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0d390640 10 monclient(hunting): get_auth_request con 0x7fdd0805d930 auth_method 0 2026-02-12T18:17:13.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0d390640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0d390640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0d390640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0d390640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0d390640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0d390640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0cb8f640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0cb8f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0db91640 1 --2- 10.20.193.48:0/2699512459 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fdd08141170 0x7fdd081172b0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0cb8f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.927 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0db91640 10 monclient(hunting): get_auth_request con 0x7fdd08141170 auth_method 0 2026-02-12T18:17:13.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0db91640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:13.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0db91640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:13.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0db91640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:13.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0db91640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:13.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0db91640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:13.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0db91640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:13.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0d390640 10 monclient(hunting): handle_auth_done global_id 114279 payload 824 2026-02-12T18:17:13.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0d390640 1 -- 10.20.193.48:0/2699512459 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdd0808ff50 msgr2=0x7fdd08116d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0d390640 1 --2- 10.20.193.48:0/2699512459 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdd0808ff50 0x7fdd08116d70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0d390640 1 -- 10.20.193.48:0/2699512459 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fdd08141170 msgr2=0x7fdd081172b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0d390640 1 --2- 10.20.193.48:0/2699512459 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7fdd08141170 0x7fdd081172b0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0d390640 10 monclient: _finish_hunting 0 2026-02-12T18:17:13.928 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0d390640 1 monclient: found mon.noname-d 2026-02-12T18:17:13.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0d390640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:13.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0d390640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:17:13.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0d390640 1 -- 10.20.193.48:0/2699512459 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd0400a500 con 0x7fdd0805d930 2026-02-12T18:17:13.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.907+0000 7fdd0cb8f640 1 --2- 10.20.193.48:0/2699512459 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7fdd0808ff50 0x7fdd08116d70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:17:13.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.909+0000 7fdd0d390640 1 -- 10.20.193.48:0/2699512459 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fdd0805d930 msgr2=0x7fdd08116830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:13.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.909+0000 7fdd0d390640 1 --2- 10.20.193.48:0/2699512459 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fdd0805d930 0x7fdd08116830 secure :-1 s=READY pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcf800c3e0 tx=0x7fdcf800c8b0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:13.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.910+0000 7fdcf5ffb640 1 -- 10.20.193.48:0/2699512459 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fdcf8005db0 con 0x7fdd0805d930 2026-02-12T18:17:13.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.910+0000 7fdcf5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.910+0000 7fdcf5ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:17:13.929 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.910+0000 7fdcf5ffb640 10 monclient: dump: 2026-02-12T18:17:13.929 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.929 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.930 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.930 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.930 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.930 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.930 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.930 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.930 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.930 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.930 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.930 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.930 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.930 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.930 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.931 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.910+0000 7fdcf5ffb640 10 monclient: _finish_auth 0 2026-02-12T18:17:13.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.910+0000 7fdcf5ffb640 10 monclient: _check_auth_tickets 2026-02-12T18:17:13.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.910+0000 7fdcf5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:13.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.910+0000 7fdcf5ffb640 1 -- 10.20.193.48:0/2699512459 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcf8007590 con 0x7fdd0805d930 2026-02-12T18:17:13.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.910+0000 7fdd0f61b640 5 monclient: authenticate success, global_id 114279 2026-02-12T18:17:13.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.910+0000 7fdd0f61b640 10 monclient: _renew_subs 2026-02-12T18:17:13.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.910+0000 7fdd0f61b640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:17:13.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.910+0000 7fdd0f61b640 1 -- 10.20.193.48:0/2699512459 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd0812b7d0 con 0x7fdd0805d930 2026-02-12T18:17:13.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.910+0000 7fdcf5ffb640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:13.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.910+0000 7fdcf5ffb640 1 -- 10.20.193.48:0/2699512459 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fdcf8007700 con 0x7fdd0805d930 2026-02-12T18:17:13.931 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.910+0000 7fdcf5ffb640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:13.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.910+0000 7fdcf77fe640 4 set_mon_vals no callback set 2026-02-12T18:17:13.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.910+0000 7fdcf5ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:17:13.932 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.910+0000 7fdcf5ffb640 10 monclient: dump: 2026-02-12T18:17:13.932 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:13.932 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:13.932 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.932 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:13.932 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:13.932 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:13.932 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:13.932 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:13.932 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:13.932 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:13.933 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:13.933 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:13.933 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:13.933 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:13.933 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:13.933 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:13.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.910+0000 7fdd0f61b640 10 monclient: _renew_subs 2026-02-12T18:17:13.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.910+0000 7fdd0f61b640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:17:13.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.910+0000 7fdd0f61b640 1 -- 10.20.193.48:0/2699512459 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd0812ac40 con 0x7fdd0805d930 2026-02-12T18:17:13.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.910+0000 7fdd0f61b640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:17:13.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.910+0000 7fdd0f61b640 1 -- 10.20.193.48:0/2699512459 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdd08090320 con 0x7fdd0805d930 2026-02-12T18:17:13.933 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.910+0000 7fdcf5ffb640 1 -- 10.20.193.48:0/2699512459 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fdcf8007070 con 0x7fdd0805d930 2026-02-12T18:17:13.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.911+0000 7fdcf5ffb640 1 --2- 10.20.193.48:0/2699512459 >> v2:10.20.193.111:6812/977811348 conn(0x7fdcd803f730 0x7fdcd805fbe0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.911+0000 7fdcf5ffb640 1 -- 10.20.193.48:0/2699512459 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7fdcf8051f50 con 0x7fdd0805d930 2026-02-12T18:17:13.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.911+0000 7fdcf5ffb640 1 --2- 10.20.193.48:0/2699512459 >> v2:10.20.193.111:6804/1701961573 conn(0x7fdcd8063270 0x7fdcd8083680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:13.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.911+0000 7fdcf5ffb640 1 -- 10.20.193.48:0/2699512459 --> v2:10.20.193.111:6804/1701961573 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdcd8083cf0 con 0x7fdcd8063270 2026-02-12T18:17:13.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.911+0000 7fdcf5ffb640 1 -- 10.20.193.48:0/2699512459 <== mon.6 v2:10.20.193.48:3303/0 6 ==== mon_get_version_reply(handle=1 version=322) ==== 24+0+0 (secure 0 0 0) 0x7fdcf80544e0 con 0x7fdd0805d930 2026-02-12T18:17:13.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.911+0000 7fdcf5ffb640 10 monclient: handle_get_version_reply finishing 1 version 322 2026-02-12T18:17:13.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.911+0000 7fdd0cb8f640 1 --2- 10.20.193.48:0/2699512459 >> v2:10.20.193.111:6812/977811348 conn(0x7fdcd803f730 0x7fdcd805fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.911+0000 7fdd0cb8f640 10 monclient: get_auth_request con 0x7fdcd803f730 auth_method 0 2026-02-12T18:17:13.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.911+0000 7fdd0db91640 1 --2- 10.20.193.48:0/2699512459 >> v2:10.20.193.111:6804/1701961573 conn(0x7fdcd8063270 0x7fdcd8083680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:13.934 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.911+0000 7fdd0db91640 10 monclient: get_auth_request con 0x7fdcd8063270 auth_method 0 2026-02-12T18:17:13.935 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.913+0000 7fdd0cb8f640 1 --2- 10.20.193.48:0/2699512459 >> v2:10.20.193.111:6812/977811348 conn(0x7fdcd803f730 0x7fdcd805fbe0 secure :-1 s=READY pgs=497 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd08129a20 tx=0x7fdcfc008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:13.936 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.916+0000 7fdd0db91640 1 --2- 10.20.193.48:0/2699512459 >> v2:10.20.193.111:6804/1701961573 conn(0x7fdcd8063270 0x7fdcd8083680 crc :-1 s=READY pgs=177 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:13.936 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.916+0000 7fdcf5ffb640 1 -- 10.20.193.48:0/2699512459 <== osd.5 v2:10.20.193.111:6804/1701961573 1 ==== command_reply(tid 1: 0 ) ==== 8+0+33498 (crc 0 0 0) 0x7fdcd8083cf0 con 0x7fdcd8063270 2026-02-12T18:17:13.936 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.924+0000 7fdd0f61b640 1 -- 10.20.193.48:0/2699512459 --> v2:10.20.193.111:6804/1701961573 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdd0812bcf0 con 0x7fdcd8063270 2026-02-12T18:17:13.936 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.924+0000 7fdcf5ffb640 1 -- 10.20.193.48:0/2699512459 <== osd.5 v2:10.20.193.111:6804/1701961573 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fdd0812bcf0 con 0x7fdcd8063270 2026-02-12T18:17:13.936 INFO:teuthology.orchestra.run.trial048.stdout:{ 2026-02-12T18:17:13.936 INFO:teuthology.orchestra.run.trial048.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2026-02-12T18:17:13.936 INFO:teuthology.orchestra.run.trial048.stdout:} 2026-02-12T18:17:13.938 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.924+0000 7fdd0f61b640 1 -- 10.20.193.48:0/2699512459 >> v2:10.20.193.111:6804/1701961573 conn(0x7fdcd8063270 msgr2=0x7fdcd8083680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.938 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.924+0000 7fdd0f61b640 1 --2- 10.20.193.48:0/2699512459 >> v2:10.20.193.111:6804/1701961573 conn(0x7fdcd8063270 0x7fdcd8083680 crc :-1 s=READY pgs=177 gs=5 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.938 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.924+0000 7fdd0f61b640 1 -- 10.20.193.48:0/2699512459 >> v2:10.20.193.111:6812/977811348 conn(0x7fdcd803f730 msgr2=0x7fdcd805fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.938 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.924+0000 7fdd0f61b640 1 --2- 10.20.193.48:0/2699512459 >> v2:10.20.193.111:6812/977811348 conn(0x7fdcd803f730 0x7fdcd805fbe0 secure :-1 s=READY pgs=497 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdd08129a20 tx=0x7fdcfc008040 comp rx=0 tx=0).stop 2026-02-12T18:17:13.938 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.924+0000 7fdd0f61b640 10 monclient: shutdown 2026-02-12T18:17:13.938 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.924+0000 7fdd0f61b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:13.938 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.924+0000 7fdd0f61b640 1 -- 10.20.193.48:0/2699512459 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fdd0805d930 msgr2=0x7fdd08116830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:13.938 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.924+0000 7fdd0f61b640 1 --2- 10.20.193.48:0/2699512459 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fdd0805d930 0x7fdd08116830 secure :-1 s=READY pgs=33 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fdcf800c3e0 tx=0x7fdcf800c8b0 comp rx=0 tx=0).stop 2026-02-12T18:17:13.938 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.924+0000 7fdd0db91640 1 -- 10.20.193.48:0/2699512459 reap_dead start 2026-02-12T18:17:13.939 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.924+0000 7fdd0f61b640 1 -- 10.20.193.48:0/2699512459 shutdown_connections 2026-02-12T18:17:13.939 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.924+0000 7fdd0f61b640 1 -- 10.20.193.48:0/2699512459 >> 10.20.193.48:0/2699512459 conn(0x7fdd080944c0 msgr2=0x7fdd08124aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:13.939 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.924+0000 7fdd0f61b640 1 -- 10.20.193.48:0/2699512459 shutdown_connections 2026-02-12T18:17:13.939 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:13.924+0000 7fdd0f61b640 1 -- 10.20.193.48:0/2699512459 wait complete. 2026-02-12T18:17:13.939 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2026-02-12T18:17:14.006 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.005+0000 7fa3184cc640 10 monclient: get_monmap_and_config 2026-02-12T18:17:14.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.005+0000 7fa3184cc640 10 monclient: build_initial_monmap 2026-02-12T18:17:14.007 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.005+0000 7fa3184cc640 10 monclient: monmap: 2026-02-12T18:17:14.007 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:14.007 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:14.007 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:14.006145+0000 2026-02-12T18:17:14.007 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:14.006145+0000 2026-02-12T18:17:14.007 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:14.007 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:14.007 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:14.008 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:14.008 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:14.008 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:14.008 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:14.008 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:14.008 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:14.008 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:14.008 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:14.008 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:14.008 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:14.008 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:14.008 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.005+0000 7fa3184cc640 1 Processor -- start 2026-02-12T18:17:14.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.005+0000 7fa3184cc640 1 -- start start 2026-02-12T18:17:14.009 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.005+0000 7fa3184cc640 10 monclient: init 2026-02-12T18:17:14.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.005+0000 7fa3184cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:14.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.005+0000 7fa3184cc640 10 monclient: _add_conns ranks=[1,9,7,4,0,8,6,5,10,3,2] 2026-02-12T18:17:14.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.005+0000 7fa3184cc640 10 monclient(hunting): picked mon.noname-f-legacy con 0x7fa3100951a0 addr v1:10.20.193.111:6789/0 2026-02-12T18:17:14.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.005+0000 7fa3184cc640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fa310096ad0 0x7fa310093850 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:14.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.005+0000 7fa3184cc640 10 monclient(hunting): picked mon.noname-a con 0x7fa310096ad0 addr v2:10.20.193.48:3300/0 2026-02-12T18:17:14.018 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.005+0000 7fa3184cc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa310095c80 0x7fa3101a5bb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:14.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.005+0000 7fa3184cc640 10 monclient(hunting): picked mon.noname-i con 0x7fa310095c80 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:17:14.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.005+0000 7fa3184cc640 1 -- --> v1:10.20.193.111:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa31004dc20 con 0x7fa3100951a0 2026-02-12T18:17:14.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.005+0000 7fa3184cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:14.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.005+0000 7fa3184cc640 1 -- --> v2:10.20.193.48:3300/0 -- mon_getmap magic: 0 -- 0x7fa310096900 con 0x7fa310096ad0 2026-02-12T18:17:14.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.005+0000 7fa3184cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:14.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.005+0000 7fa3184cc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fa310092260 con 0x7fa310095c80 2026-02-12T18:17:14.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.005+0000 7fa3184cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:14.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.005+0000 7fa3184cc640 10 monclient(hunting): authenticate will time out at 1272.731999s 2026-02-12T18:17:14.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa315a40640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fa310096ad0 0x7fa310093850 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:14.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa315a40640 1 --2- >> v2:10.20.193.48:3300/0 conn(0x7fa310096ad0 0x7fa310093850 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:55046/0 (socket says 10.20.193.48:55046) 2026-02-12T18:17:14.019 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa315a40640 1 -- 10.20.193.48:0/1890644348 learned_addr learned my addr 10.20.193.48:0/1890644348 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:14.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa316241640 1 --1- 10.20.193.48:0/1890644348 >> v1:10.20.193.111:6789/0 conn(0x7fa3100951a0 0x7fa310095570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 gs=1 cs=0 l=0).handle_server_banner_and_identify peer v1:10.20.193.111:6789/0 says I am v1:10.20.193.48:55812/0 (socket says 10.20.193.48:55812) 2026-02-12T18:17:14.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa315a40640 10 monclient(hunting): get_auth_request con 0x7fa310096ad0 auth_method 0 2026-02-12T18:17:14.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa315a40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:14.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa315a40640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:14.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa315a40640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:14.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa316a42640 1 --2- 10.20.193.48:0/1890644348 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa310095c80 0x7fa3101a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:14.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa316a42640 10 monclient(hunting): get_auth_request con 0x7fa310095c80 auth_method 0 2026-02-12T18:17:14.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa316a42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:14.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa316a42640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:14.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa316a42640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:14.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa315a40640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:14.020 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa315a40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:14.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa315a40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:14.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa316a42640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:14.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa316a42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:14.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa316a42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:14.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa315a40640 10 monclient(hunting): handle_auth_done global_id 7164 payload 274 2026-02-12T18:17:14.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa315a40640 1 -- 10.20.193.48:0/1890644348 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa310095c80 msgr2=0x7fa3101a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:14.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa315a40640 1 --2- 10.20.193.48:0/1890644348 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa310095c80 0x7fa3101a5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:14.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa315a40640 1 -- 10.20.193.48:0/1890644348 >> v1:10.20.193.111:6789/0 conn(0x7fa3100951a0 legacy=0x7fa310095570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:14.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa315a40640 10 monclient: _finish_hunting 0 2026-02-12T18:17:14.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa315a40640 1 monclient: found mon.noname-a 2026-02-12T18:17:14.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa315a40640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:14.021 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa315a40640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:17:14.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.006+0000 7fa315a40640 1 -- 10.20.193.48:0/1890644348 --> v2:10.20.193.48:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa310093070 con 0x7fa310096ad0 2026-02-12T18:17:14.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.008+0000 7fa315a40640 1 -- 10.20.193.48:0/1890644348 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa310096ad0 msgr2=0x7fa310093850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:14.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.008+0000 7fa315a40640 1 --2- 10.20.193.48:0/1890644348 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa310096ad0 0x7fa310093850 secure :-1 s=READY pgs=743 gs=2 cs=0 l=1 c_cookie=15144242680008281248 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa304009060 tx=0x7fa30402edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22b287ad6340ca0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:14.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.008+0000 7fa31523f640 1 -- 10.20.193.48:0/1890644348 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa304035340 con 0x7fa310096ad0 2026-02-12T18:17:14.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.008+0000 7fa31523f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:14.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.009+0000 7fa31523f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:17:14.022 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.009+0000 7fa31523f640 10 monclient: dump: 2026-02-12T18:17:14.022 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:14.022 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:14.022 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:14.022 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:14.022 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:14.022 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:14.023 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:14.023 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:14.023 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:14.023 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:14.023 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:14.023 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:14.023 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:14.023 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:14.023 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:14.023 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:14.023 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.009+0000 7fa31523f640 10 monclient: _finish_auth 0 2026-02-12T18:17:14.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.009+0000 7fa31523f640 10 monclient: _check_auth_tickets 2026-02-12T18:17:14.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.009+0000 7fa31523f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:14.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.009+0000 7fa31523f640 1 -- 10.20.193.48:0/1890644348 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3040354c0 con 0x7fa310096ad0 2026-02-12T18:17:14.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.009+0000 7fa31523f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:14.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.009+0000 7fa3184cc640 5 monclient: authenticate success, global_id 7164 2026-02-12T18:17:14.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.009+0000 7fa31523f640 1 -- 10.20.193.48:0/1890644348 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa304035af0 con 0x7fa310096ad0 2026-02-12T18:17:14.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.009+0000 7fa3184cc640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:14.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.009+0000 7fa31523f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:14.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.009+0000 7fa3184cc640 4 set_mon_vals no callback set 2026-02-12T18:17:14.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.009+0000 7fa31523f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:17:14.024 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.009+0000 7fa31523f640 10 monclient: dump: 2026-02-12T18:17:14.024 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:14.024 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:14.025 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:14.025 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:14.025 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:14.025 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:14.025 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:14.025 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:14.025 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:14.025 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:14.025 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:14.025 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:14.025 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:14.025 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:14.026 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:14.026 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:14.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.009+0000 7fa3184cc640 10 monclient: shutdown 2026-02-12T18:17:14.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.009+0000 7fa3184cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:14.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.009+0000 7fa3184cc640 1 -- 10.20.193.48:0/1890644348 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa310096ad0 msgr2=0x7fa310093850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:14.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.009+0000 7fa3184cc640 1 --2- 10.20.193.48:0/1890644348 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa310096ad0 0x7fa310093850 secure :-1 s=READY pgs=743 gs=2 cs=0 l=1 c_cookie=15144242680008281248 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa304009060 tx=0x7fa30402edf0 comp rx=0 tx=0).stop 2026-02-12T18:17:14.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.009+0000 7fa3184cc640 1 -- 10.20.193.48:0/1890644348 shutdown_connections 2026-02-12T18:17:14.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.009+0000 7fa3184cc640 1 --2- 10.20.193.48:0/1890644348 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa310095c80 0x7fa3101a5bb0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:14.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.009+0000 7fa3184cc640 1 --2- 10.20.193.48:0/1890644348 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7fa310096ad0 0x7fa310093850 unknown :-1 s=CLOSED pgs=743 gs=2 cs=0 l=1 c_cookie=15144242680008281248 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:14.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.009+0000 7fa3184cc640 1 -- 10.20.193.48:0/1890644348 >> 10.20.193.48:0/1890644348 conn(0x7fa3100548c0 msgr2=0x7fa3100973a0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:14.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.009+0000 7fa3184cc640 1 -- 10.20.193.48:0/1890644348 shutdown_connections 2026-02-12T18:17:14.026 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.009+0000 7fa3184cc640 1 -- 10.20.193.48:0/1890644348 wait complete. 2026-02-12T18:17:14.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.009+0000 7fa3184cc640 10 monclient: build_initial_monmap 2026-02-12T18:17:14.027 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.009+0000 7fa3184cc640 10 monclient: monmap: 2026-02-12T18:17:14.027 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:14.027 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:14.027 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:14.027 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:14.027 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:14.027 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:14.027 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:14.027 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:14.027 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:14.027 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:14.028 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:14.028 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:14.028 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:14.028 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:14.028 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:14.028 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:14.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa3184cc640 1 Processor -- start 2026-02-12T18:17:14.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa3184cc640 1 -- start start 2026-02-12T18:17:14.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa3184cc640 10 monclient: init 2026-02-12T18:17:14.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa3184cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:14.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa3184cc640 10 monclient: _add_conns ranks=[2,5,7,6,4,0,3,1,8] 2026-02-12T18:17:14.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa3184cc640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa3100951a0 0x7fa3101d9130 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:14.028 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa3184cc640 10 monclient(hunting): picked mon.noname-b con 0x7fa3100951a0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:17:14.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa3184cc640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa310095c80 0x7fa3101adc70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:14.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa3184cc640 10 monclient(hunting): picked mon.noname-h con 0x7fa310095c80 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:17:14.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa3184cc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa310096ad0 0x7fa3101d9f20 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:14.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa3184cc640 10 monclient(hunting): picked mon.noname-i con 0x7fa310096ad0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:17:14.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa3184cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:14.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa3184cc640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fa310199630 con 0x7fa3100951a0 2026-02-12T18:17:14.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa3184cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:14.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa3184cc640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7fa3101972f0 con 0x7fa310095c80 2026-02-12T18:17:14.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa3184cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:14.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa3184cc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fa31008d620 con 0x7fa310096ad0 2026-02-12T18:17:14.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa3184cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:14.029 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa3184cc640 10 monclient(hunting): authenticate will time out at 1272.736561s 2026-02-12T18:17:14.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316241640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa3100951a0 0x7fa3101d9130 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:14.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316241640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa3100951a0 0x7fa3101d9130 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:44250/0 (socket says 10.20.193.48:44250) 2026-02-12T18:17:14.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316241640 1 -- 10.20.193.48:0/939569774 learned_addr learned my addr 10.20.193.48:0/939569774 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:14.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316241640 10 monclient(hunting): get_auth_request con 0x7fa3100951a0 auth_method 0 2026-02-12T18:17:14.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316241640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:14.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316241640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:14.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316241640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:14.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa315a40640 1 --2- 10.20.193.48:0/939569774 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa310095c80 0x7fa3101adc70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:14.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316241640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:14.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316241640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:14.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316241640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:14.030 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa315a40640 10 monclient(hunting): get_auth_request con 0x7fa310095c80 auth_method 0 2026-02-12T18:17:14.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa315a40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:14.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa315a40640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:14.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa315a40640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:14.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316a42640 1 --2- 10.20.193.48:0/939569774 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa310096ad0 0x7fa3101d9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:14.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316a42640 10 monclient(hunting): get_auth_request con 0x7fa310096ad0 auth_method 0 2026-02-12T18:17:14.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316a42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:14.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316a42640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:14.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316a42640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:14.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa315a40640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:14.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa315a40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:14.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa315a40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:14.031 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316a42640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:14.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316a42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:14.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316a42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:14.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316241640 10 monclient(hunting): handle_auth_done global_id 36794 payload 824 2026-02-12T18:17:14.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316241640 1 -- 10.20.193.48:0/939569774 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa310096ad0 msgr2=0x7fa3101d9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:14.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316241640 1 --2- 10.20.193.48:0/939569774 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa310096ad0 0x7fa3101d9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:14.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316241640 1 -- 10.20.193.48:0/939569774 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa310095c80 msgr2=0x7fa3101adc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:14.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316241640 1 --2- 10.20.193.48:0/939569774 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa310095c80 0x7fa3101adc70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:14.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316241640 10 monclient: _finish_hunting 0 2026-02-12T18:17:14.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316241640 1 monclient: found mon.noname-b 2026-02-12T18:17:14.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316241640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:14.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316241640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:17:14.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.010+0000 7fa316241640 1 -- 10.20.193.48:0/939569774 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3040094f0 con 0x7fa3100951a0 2026-02-12T18:17:14.032 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.013+0000 7fa316241640 1 -- 10.20.193.48:0/939569774 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa3100951a0 msgr2=0x7fa3101d9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:14.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.013+0000 7fa316241640 1 --2- 10.20.193.48:0/939569774 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa3100951a0 0x7fa3101d9130 secure :-1 s=READY pgs=475 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa30000c4b0 tx=0x7fa30000c980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:14.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.013+0000 7fa2f6ffd640 1 -- 10.20.193.48:0/939569774 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa300005cf0 con 0x7fa3100951a0 2026-02-12T18:17:14.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.013+0000 7fa2f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:14.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.013+0000 7fa2f6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:17:14.033 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.013+0000 7fa2f6ffd640 10 monclient: dump: 2026-02-12T18:17:14.033 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:14.033 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:14.033 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:14.033 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:14.033 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:14.033 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:14.033 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:14.033 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:14.034 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:14.034 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:14.034 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:14.034 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:14.034 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:14.034 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:14.034 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:14.034 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:14.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.013+0000 7fa2f6ffd640 10 monclient: _finish_auth 0 2026-02-12T18:17:14.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.013+0000 7fa2f6ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:17:14.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.013+0000 7fa2f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:14.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.013+0000 7fa3184cc640 5 monclient: authenticate success, global_id 36794 2026-02-12T18:17:14.034 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.013+0000 7fa2f6ffd640 1 -- 10.20.193.48:0/939569774 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa300005e50 con 0x7fa3100951a0 2026-02-12T18:17:14.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.013+0000 7fa2f6ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:14.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.013+0000 7fa2f6ffd640 1 -- 10.20.193.48:0/939569774 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa300007530 con 0x7fa3100951a0 2026-02-12T18:17:14.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.013+0000 7fa2f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:14.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.013+0000 7fa2f6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:17:14.035 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.013+0000 7fa2f6ffd640 10 monclient: dump: 2026-02-12T18:17:14.035 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:14.035 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:14.035 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:14.035 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:14.035 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:14.035 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:14.035 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:14.035 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:14.036 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:14.036 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:14.036 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:14.036 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:14.036 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:14.036 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:14.036 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:14.036 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:14.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.013+0000 7fa314a3e640 4 set_mon_vals no callback set 2026-02-12T18:17:14.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.013+0000 7fa3184cc640 10 monclient: _renew_subs 2026-02-12T18:17:14.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.013+0000 7fa3184cc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:17:14.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.013+0000 7fa3184cc640 1 -- 10.20.193.48:0/939569774 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa310098010 con 0x7fa3100951a0 2026-02-12T18:17:14.036 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.013+0000 7fa3184cc640 10 monclient: _renew_subs 2026-02-12T18:17:14.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.013+0000 7fa3184cc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:17:14.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.013+0000 7fa3184cc640 1 -- 10.20.193.48:0/939569774 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa310197e30 con 0x7fa3100951a0 2026-02-12T18:17:14.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.014+0000 7fa3184cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:14.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.014+0000 7fa3184cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:14.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.014+0000 7fa3184cc640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:17:14.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.014+0000 7fa3184cc640 1 -- 10.20.193.48:0/939569774 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa310093850 con 0x7fa3100951a0 2026-02-12T18:17:14.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.014+0000 7fa2f6ffd640 1 -- 10.20.193.48:0/939569774 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fa300007070 con 0x7fa3100951a0 2026-02-12T18:17:14.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.014+0000 7fa2f6ffd640 1 --2- 10.20.193.48:0/939569774 >> v2:10.20.193.111:6812/977811348 conn(0x7fa2e003f800 0x7fa2e005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:14.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.014+0000 7fa2f6ffd640 1 -- 10.20.193.48:0/939569774 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7fa300051ec0 con 0x7fa3100951a0 2026-02-12T18:17:14.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.014+0000 7fa315a40640 1 --2- 10.20.193.48:0/939569774 >> v2:10.20.193.111:6812/977811348 conn(0x7fa2e003f800 0x7fa2e005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:14.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.014+0000 7fa315a40640 10 monclient: get_auth_request con 0x7fa2e003f800 auth_method 0 2026-02-12T18:17:14.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.016+0000 7fa2f6ffd640 1 -- 10.20.193.48:0/939569774 <== mon.2 v2:10.20.193.48:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fa30001bb00 con 0x7fa3100951a0 2026-02-12T18:17:14.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.016+0000 7fa2f6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:14.037 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.016+0000 7fa2f6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:17:14.038 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.017+0000 7fa315a40640 1 --2- 10.20.193.48:0/939569774 >> v2:10.20.193.111:6812/977811348 conn(0x7fa2e003f800 0x7fa2e005fcb0 secure :-1 s=READY pgs=498 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa30402ee30 tx=0x7fa304033000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:14.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.122+0000 7fa3184cc640 1 -- 10.20.193.48:0/939569774 --> v2:10.20.193.111:6812/977811348 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fa310097e90 con 0x7fa2e003f800 2026-02-12T18:17:14.124 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.122+0000 7fa2f6ffd640 1 -- 10.20.193.48:0/939569774 <== mgr.4123 v2:10.20.193.111:6812/977811348 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa304047090 con 0x7fa2e003f800 2026-02-12T18:17:14.124 INFO:teuthology.orchestra.run.trial048.stderr:instructed osd(s) 5 to deep-scrub 2026-02-12T18:17:14.125 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.124+0000 7fa3184cc640 1 -- 10.20.193.48:0/939569774 >> v2:10.20.193.111:6812/977811348 conn(0x7fa2e003f800 msgr2=0x7fa2e005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:14.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.124+0000 7fa3184cc640 1 --2- 10.20.193.48:0/939569774 >> v2:10.20.193.111:6812/977811348 conn(0x7fa2e003f800 0x7fa2e005fcb0 secure :-1 s=READY pgs=498 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa30402ee30 tx=0x7fa304033000 comp rx=0 tx=0).stop 2026-02-12T18:17:14.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.124+0000 7fa3184cc640 10 monclient: shutdown 2026-02-12T18:17:14.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.124+0000 7fa3184cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:14.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.124+0000 7fa3184cc640 1 -- 10.20.193.48:0/939569774 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa3100951a0 msgr2=0x7fa3101d9130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:14.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.124+0000 7fa3184cc640 1 --2- 10.20.193.48:0/939569774 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa3100951a0 0x7fa3101d9130 secure :-1 s=READY pgs=475 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa30000c4b0 tx=0x7fa30000c980 comp rx=0 tx=0).stop 2026-02-12T18:17:14.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.124+0000 7fa3184cc640 1 -- 10.20.193.48:0/939569774 shutdown_connections 2026-02-12T18:17:14.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.124+0000 7fa3184cc640 1 --2- 10.20.193.48:0/939569774 >> v2:10.20.193.111:6812/977811348 conn(0x7fa2e003f800 0x7fa2e005fcb0 unknown :-1 s=CLOSED pgs=498 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:14.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.124+0000 7fa3184cc640 1 --2- 10.20.193.48:0/939569774 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa310096ad0 0x7fa3101d9f20 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:14.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.124+0000 7fa3184cc640 1 --2- 10.20.193.48:0/939569774 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7fa310095c80 0x7fa3101adc70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:14.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.124+0000 7fa3184cc640 1 --2- 10.20.193.48:0/939569774 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa3100951a0 0x7fa3101d9130 unknown :-1 s=CLOSED pgs=475 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:14.126 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.124+0000 7fa3184cc640 1 -- 10.20.193.48:0/939569774 >> 10.20.193.48:0/939569774 conn(0x7fa3100548c0 msgr2=0x7fa3101b0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:14.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.124+0000 7fa3184cc640 1 -- 10.20.193.48:0/939569774 shutdown_connections 2026-02-12T18:17:14.127 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.124+0000 7fa3184cc640 1 -- 10.20.193.48:0/939569774 wait complete. 2026-02-12T18:17:14.133 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T18:17:14.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.197+0000 7ff4f7443640 10 monclient: get_monmap_and_config 2026-02-12T18:17:14.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.197+0000 7ff4f7443640 10 monclient: build_initial_monmap 2026-02-12T18:17:14.199 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.197+0000 7ff4f7443640 10 monclient: monmap: 2026-02-12T18:17:14.199 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:14.200 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:14.200 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:14.198658+0000 2026-02-12T18:17:14.200 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:14.198658+0000 2026-02-12T18:17:14.200 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:14.200 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:14.200 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:14.200 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:14.200 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:14.200 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:14.200 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:14.200 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:14.200 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:14.201 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:14.201 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:14.201 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:14.201 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:14.201 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:14.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f7443640 1 Processor -- start 2026-02-12T18:17:14.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f7443640 1 -- start start 2026-02-12T18:17:14.201 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f7443640 10 monclient: init 2026-02-12T18:17:14.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f7443640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:14.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f7443640 10 monclient: _add_conns ranks=[3,5,2,8,4,9,6,10,0,1,7] 2026-02-12T18:17:14.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f7443640 1 --2- >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff4f01446b0 0x7ff4f0144a80 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:14.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f7443640 10 monclient(hunting): picked mon.noname-g con 0x7ff4f01446b0 addr [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] 2026-02-12T18:17:14.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f7443640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff4f0144030 0x7ff4f0140b30 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:14.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f7443640 10 monclient(hunting): picked mon.noname-h con 0x7ff4f0144030 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:17:14.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f7443640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff4f0096ee0 0x7ff4f0141070 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:14.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f7443640 10 monclient(hunting): picked mon.noname-b con 0x7ff4f0096ee0 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:17:14.211 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f7443640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:14.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f7443640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7ff4f008e1f0 con 0x7ff4f0096ee0 2026-02-12T18:17:14.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f7443640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:14.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f7443640 1 -- --> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] -- mon_getmap magic: 0 -- 0x7ff4f0144fc0 con 0x7ff4f01446b0 2026-02-12T18:17:14.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f7443640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:14.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f7443640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7ff4f0096ca0 con 0x7ff4f0144030 2026-02-12T18:17:14.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f7443640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:14.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f7443640 10 monclient(hunting): authenticate will time out at 1272.924528s 2026-02-12T18:17:14.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6c42640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff4f0096ee0 0x7ff4f0141070 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:14.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6c42640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff4f0096ee0 0x7ff4f0141070 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:34190/0 (socket says 10.20.193.48:34190) 2026-02-12T18:17:14.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6c42640 1 -- 10.20.193.48:0/1301994476 learned_addr learned my addr 10.20.193.48:0/1301994476 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:14.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6c42640 10 monclient(hunting): get_auth_request con 0x7ff4f0096ee0 auth_method 0 2026-02-12T18:17:14.212 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6c42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:14.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6c42640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:14.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6c42640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:14.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6441640 1 --2- 10.20.193.48:0/1301994476 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff4f01446b0 0x7ff4f0144a80 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:14.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6441640 10 monclient(hunting): get_auth_request con 0x7ff4f01446b0 auth_method 0 2026-02-12T18:17:14.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6441640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:14.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6441640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:14.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6441640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:14.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6c42640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:14.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f5c40640 1 --2- 10.20.193.48:0/1301994476 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff4f0144030 0x7ff4f0140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:14.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6c42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:14.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6c42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:14.213 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6441640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:14.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6441640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:14.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6441640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:14.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f5c40640 10 monclient(hunting): get_auth_request con 0x7ff4f0144030 auth_method 0 2026-02-12T18:17:14.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f5c40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:14.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f5c40640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:14.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f5c40640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:14.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6c42640 10 monclient(hunting): handle_auth_done global_id 36803 payload 274 2026-02-12T18:17:14.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6c42640 1 -- 10.20.193.48:0/1301994476 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff4f0144030 msgr2=0x7ff4f0140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:14.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6c42640 1 --2- 10.20.193.48:0/1301994476 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff4f0144030 0x7ff4f0140b30 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:14.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6c42640 1 -- 10.20.193.48:0/1301994476 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff4f01446b0 msgr2=0x7ff4f0144a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:14.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6c42640 1 --2- 10.20.193.48:0/1301994476 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff4f01446b0 0x7ff4f0144a80 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:14.214 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6c42640 10 monclient: _finish_hunting 0 2026-02-12T18:17:14.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6c42640 1 monclient: found mon.noname-b 2026-02-12T18:17:14.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6c42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:14.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6c42640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:17:14.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.198+0000 7ff4f6c42640 1 -- 10.20.193.48:0/1301994476 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4f004dc20 con 0x7ff4f0096ee0 2026-02-12T18:17:14.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.201+0000 7ff4f6c42640 1 -- 10.20.193.48:0/1301994476 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff4f0096ee0 msgr2=0x7ff4f0141070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:14.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.201+0000 7ff4f6c42640 1 --2- 10.20.193.48:0/1301994476 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff4f0096ee0 0x7ff4f0141070 secure :-1 s=READY pgs=477 gs=1 cs=0 l=1 c_cookie=18175029235954346543 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4ec00a9b0 tx=0x7ff4ec02fef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc3aaccb6f65ea2f server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:14.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.201+0000 7ff4f543f640 1 -- 10.20.193.48:0/1301994476 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff4ec030b70 con 0x7ff4f0096ee0 2026-02-12T18:17:14.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.201+0000 7ff4f543f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:14.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.201+0000 7ff4f543f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:17:14.215 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.201+0000 7ff4f543f640 10 monclient: dump: 2026-02-12T18:17:14.215 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:14.215 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:14.216 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:14.216 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:14.216 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:14.216 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:14.216 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:14.216 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:14.216 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:14.216 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:14.216 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:14.216 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:14.216 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:14.216 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:14.217 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:14.217 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:14.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.201+0000 7ff4f543f640 10 monclient: _finish_auth 0 2026-02-12T18:17:14.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.201+0000 7ff4f543f640 10 monclient: _check_auth_tickets 2026-02-12T18:17:14.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.201+0000 7ff4f543f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:14.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.201+0000 7ff4f543f640 1 -- 10.20.193.48:0/1301994476 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4ec030cf0 con 0x7ff4f0096ee0 2026-02-12T18:17:14.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.201+0000 7ff4f7443640 5 monclient: authenticate success, global_id 36803 2026-02-12T18:17:14.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.201+0000 7ff4f7443640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:17:14.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.201+0000 7ff4f543f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:14.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.201+0000 7ff4f543f640 1 -- 10.20.193.48:0/1301994476 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff4ec030e60 con 0x7ff4f0096ee0 2026-02-12T18:17:14.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.201+0000 7ff4f7443640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:14.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.201+0000 7ff4f7443640 4 set_mon_vals no callback set 2026-02-12T18:17:14.217 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.201+0000 7ff4f543f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:14.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.201+0000 7ff4f543f640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:17:14.218 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.201+0000 7ff4f543f640 10 monclient: dump: 2026-02-12T18:17:14.218 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:14.218 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:14.218 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:14.218 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:14.218 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:14.218 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:14.218 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:14.218 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:14.218 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:14.218 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:14.219 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:14.219 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:14.219 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:14.219 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:14.219 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:14.219 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:14.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.201+0000 7ff4f7443640 10 monclient: shutdown 2026-02-12T18:17:14.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.201+0000 7ff4f7443640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:14.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.201+0000 7ff4f7443640 1 -- 10.20.193.48:0/1301994476 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff4f0096ee0 msgr2=0x7ff4f0141070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:14.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.201+0000 7ff4f7443640 1 --2- 10.20.193.48:0/1301994476 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff4f0096ee0 0x7ff4f0141070 secure :-1 s=READY pgs=477 gs=1 cs=0 l=1 c_cookie=18175029235954346543 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4ec00a9b0 tx=0x7ff4ec02fef0 comp rx=0 tx=0).stop 2026-02-12T18:17:14.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.202+0000 7ff4f7443640 1 -- 10.20.193.48:0/1301994476 shutdown_connections 2026-02-12T18:17:14.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.202+0000 7ff4f7443640 1 --2- 10.20.193.48:0/1301994476 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7ff4f0096ee0 0x7ff4f0141070 unknown :-1 s=CLOSED pgs=477 gs=1 cs=0 l=1 c_cookie=18175029235954346543 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:14.219 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.202+0000 7ff4f7443640 1 --2- 10.20.193.48:0/1301994476 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7ff4f0144030 0x7ff4f0140b30 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:14.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.202+0000 7ff4f7443640 1 --2- 10.20.193.48:0/1301994476 >> [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] conn(0x7ff4f01446b0 0x7ff4f0144a80 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:14.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.202+0000 7ff4f7443640 1 -- 10.20.193.48:0/1301994476 >> 10.20.193.48:0/1301994476 conn(0x7ff4f00548a0 msgr2=0x7ff4f0054ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:14.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.202+0000 7ff4f7443640 1 -- 10.20.193.48:0/1301994476 shutdown_connections 2026-02-12T18:17:14.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.202+0000 7ff4f7443640 1 -- 10.20.193.48:0/1301994476 wait complete. 2026-02-12T18:17:14.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.202+0000 7ff4f7443640 10 monclient: build_initial_monmap 2026-02-12T18:17:14.220 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.202+0000 7ff4f7443640 10 monclient: monmap: 2026-02-12T18:17:14.220 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:14.220 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:14.220 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:14.220 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:14.220 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:14.220 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:14.220 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:14.221 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:14.221 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:14.221 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:14.221 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:14.221 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:14.221 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:14.221 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:14.221 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:14.221 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:14.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.202+0000 7ff4f7443640 1 Processor -- start 2026-02-12T18:17:14.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.202+0000 7ff4f7443640 1 -- start start 2026-02-12T18:17:14.221 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.202+0000 7ff4f7443640 10 monclient: init 2026-02-12T18:17:14.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f7443640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:14.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f7443640 10 monclient: _add_conns ranks=[7,1,0,3,6,5,4,2,8] 2026-02-12T18:17:14.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f7443640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ff4f0096ee0 0x7ff4f0131030 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:14.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f7443640 10 monclient(hunting): picked mon.noname-i con 0x7ff4f0096ee0 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:17:14.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f7443640 1 --2- >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff4f0144030 0x7ff4f0141460 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:14.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f7443640 10 monclient(hunting): picked mon.noname-f con 0x7ff4f0144030 addr [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] 2026-02-12T18:17:14.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f7443640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff4f01446b0 0x7ff4f010d980 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:14.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f7443640 10 monclient(hunting): picked mon.noname-a con 0x7ff4f01446b0 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:17:14.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f7443640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:14.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f7443640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f0142f90 con 0x7ff4f01446b0 2026-02-12T18:17:14.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f7443640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:14.222 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f7443640 1 -- --> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] -- mon_getmap magic: 0 -- 0x7ff4f010f200 con 0x7ff4f0144030 2026-02-12T18:17:14.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f7443640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:14.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f7443640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7ff4f0110cc0 con 0x7ff4f0096ee0 2026-02-12T18:17:14.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f7443640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:14.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f7443640 10 monclient(hunting): authenticate will time out at 1272.929183s 2026-02-12T18:17:14.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6c42640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff4f01446b0 0x7ff4f010d980 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:14.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6c42640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff4f01446b0 0x7ff4f010d980 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:58064/0 (socket says 10.20.193.48:58064) 2026-02-12T18:17:14.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6c42640 1 -- 10.20.193.48:0/525910590 learned_addr learned my addr 10.20.193.48:0/525910590 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:14.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6c42640 10 monclient(hunting): get_auth_request con 0x7ff4f01446b0 auth_method 0 2026-02-12T18:17:14.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6c42640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:14.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6c42640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:14.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6c42640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:14.223 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f5c40640 1 --2- 10.20.193.48:0/525910590 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff4f0144030 0x7ff4f0141460 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:14.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6441640 1 --2- 10.20.193.48:0/525910590 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ff4f0096ee0 0x7ff4f0131030 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:14.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6c42640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:14.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6c42640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:14.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6c42640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:14.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6441640 10 monclient(hunting): get_auth_request con 0x7ff4f0096ee0 auth_method 0 2026-02-12T18:17:14.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6441640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:14.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6441640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:14.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6441640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:14.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f5c40640 10 monclient(hunting): get_auth_request con 0x7ff4f0144030 auth_method 0 2026-02-12T18:17:14.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f5c40640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:14.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f5c40640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:14.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f5c40640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:14.224 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f5c40640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:14.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f5c40640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:14.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f5c40640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:14.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6441640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:14.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6441640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:14.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6441640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:14.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6c42640 10 monclient(hunting): handle_auth_done global_id 7173 payload 824 2026-02-12T18:17:14.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6c42640 1 -- 10.20.193.48:0/525910590 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ff4f0096ee0 msgr2=0x7ff4f0131030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:14.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6c42640 1 --2- 10.20.193.48:0/525910590 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ff4f0096ee0 0x7ff4f0131030 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:14.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6c42640 1 -- 10.20.193.48:0/525910590 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff4f0144030 msgr2=0x7ff4f0141460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:14.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6c42640 1 --2- 10.20.193.48:0/525910590 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff4f0144030 0x7ff4f0141460 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:14.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6c42640 10 monclient: _finish_hunting 0 2026-02-12T18:17:14.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6c42640 1 monclient: found mon.noname-a 2026-02-12T18:17:14.225 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6c42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:14.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6c42640 10 monclient: _send_mon_message to mon.noname-a at v2:10.20.193.48:3300/0 2026-02-12T18:17:14.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.203+0000 7ff4f6c42640 1 -- 10.20.193.48:0/525910590 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4ec00a5d0 con 0x7ff4f01446b0 2026-02-12T18:17:14.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.205+0000 7ff4f6c42640 1 -- 10.20.193.48:0/525910590 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff4f01446b0 msgr2=0x7ff4f010d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:14.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.205+0000 7ff4f6c42640 1 --2- 10.20.193.48:0/525910590 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff4f01446b0 0x7ff4f010d980 secure :-1 s=READY pgs=744 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4ec00aae0 tx=0x7ff4ec005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:14.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.205+0000 7ff4d6ffd640 1 -- 10.20.193.48:0/525910590 <== mon.0 v2:10.20.193.48:3300/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff4ec030e60 con 0x7ff4f01446b0 2026-02-12T18:17:14.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.205+0000 7ff4d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:14.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.205+0000 7ff4d6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2026-02-12T18:17:14.226 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.205+0000 7ff4d6ffd640 10 monclient: dump: 2026-02-12T18:17:14.226 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:14.226 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:14.226 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:14.226 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:14.227 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:14.227 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:14.227 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:14.227 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:14.227 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:14.227 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:14.227 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:14.227 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:14.227 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:14.227 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:14.227 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:14.227 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:14.227 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.205+0000 7ff4d6ffd640 10 monclient: _finish_auth 0 2026-02-12T18:17:14.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.205+0000 7ff4d6ffd640 10 monclient: _check_auth_tickets 2026-02-12T18:17:14.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.205+0000 7ff4d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:14.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.205+0000 7ff4d6ffd640 1 -- 10.20.193.48:0/525910590 <== mon.0 v2:10.20.193.48:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4ec004bd0 con 0x7ff4f01446b0 2026-02-12T18:17:14.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.205+0000 7ff4d6ffd640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:14.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.205+0000 7ff4d6ffd640 1 -- 10.20.193.48:0/525910590 <== mon.0 v2:10.20.193.48:3300/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7ff4ec038dc0 con 0x7ff4f01446b0 2026-02-12T18:17:14.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.205+0000 7ff4f7443640 5 monclient: authenticate success, global_id 7173 2026-02-12T18:17:14.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.205+0000 7ff4f4c3e640 4 set_mon_vals no callback set 2026-02-12T18:17:14.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.205+0000 7ff4f7443640 10 monclient: _renew_subs 2026-02-12T18:17:14.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.205+0000 7ff4f7443640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:14.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.205+0000 7ff4f7443640 1 -- 10.20.193.48:0/525910590 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4f0110fa0 con 0x7ff4f01446b0 2026-02-12T18:17:14.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.205+0000 7ff4d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:14.228 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.205+0000 7ff4d6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2026-02-12T18:17:14.229 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.205+0000 7ff4d6ffd640 10 monclient: dump: 2026-02-12T18:17:14.229 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:14.229 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:14.229 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:14.229 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:14.229 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:14.229 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:14.229 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:14.229 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:14.229 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:14.229 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:14.229 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:14.230 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:14.230 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:14.230 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:14.230 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:14.230 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:14.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.205+0000 7ff4f7443640 10 monclient: _renew_subs 2026-02-12T18:17:14.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.205+0000 7ff4f7443640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:14.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.205+0000 7ff4f7443640 1 -- 10.20.193.48:0/525910590 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4f01419a0 con 0x7ff4f01446b0 2026-02-12T18:17:14.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.206+0000 7ff4f7443640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:14.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.206+0000 7ff4f7443640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:14.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.206+0000 7ff4f7443640 10 monclient: _send_mon_message to mon.a at v2:10.20.193.48:3300/0 2026-02-12T18:17:14.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.206+0000 7ff4f7443640 1 -- 10.20.193.48:0/525910590 --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4f0144a80 con 0x7ff4f01446b0 2026-02-12T18:17:14.230 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.206+0000 7ff4d6ffd640 1 -- 10.20.193.48:0/525910590 <== mon.0 v2:10.20.193.48:3300/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7ff4ec038440 con 0x7ff4f01446b0 2026-02-12T18:17:14.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.206+0000 7ff4d6ffd640 1 --2- 10.20.193.48:0/525910590 >> v2:10.20.193.111:6812/977811348 conn(0x7ff4c003f800 0x7ff4c005fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:14.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.206+0000 7ff4d6ffd640 1 -- 10.20.193.48:0/525910590 <== mon.0 v2:10.20.193.48:3300/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7ff4ec078f60 con 0x7ff4f01446b0 2026-02-12T18:17:14.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.207+0000 7ff4f6441640 1 --2- 10.20.193.48:0/525910590 >> v2:10.20.193.111:6812/977811348 conn(0x7ff4c003f800 0x7ff4c005fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:14.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.207+0000 7ff4f6441640 10 monclient: get_auth_request con 0x7ff4c003f800 auth_method 0 2026-02-12T18:17:14.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.208+0000 7ff4d6ffd640 1 -- 10.20.193.48:0/525910590 <== mon.0 v2:10.20.193.48:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7ff4ec041430 con 0x7ff4f01446b0 2026-02-12T18:17:14.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.208+0000 7ff4d6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:14.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.208+0000 7ff4d6ffd640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:17:14.231 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.209+0000 7ff4f6441640 1 --2- 10.20.193.48:0/525910590 >> v2:10.20.193.111:6812/977811348 conn(0x7ff4c003f800 0x7ff4c005fcb0 secure :-1 s=READY pgs=499 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4e0004740 tx=0x7ff4e0009210 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:14.314 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.313+0000 7ff4f7443640 1 -- 10.20.193.48:0/525910590 --> v2:10.20.193.111:6812/977811348 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff4f0131710 con 0x7ff4c003f800 2026-02-12T18:17:14.315 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.313+0000 7ff4d6ffd640 1 -- 10.20.193.48:0/525910590 <== mgr.4123 v2:10.20.193.111:6812/977811348 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33979 (secure 0 0 0) 0x7ff4e0011a70 con 0x7ff4c003f800 2026-02-12T18:17:14.315 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:17:14.316 INFO:teuthology.orchestra.run.trial048.stderr:dumped all 2026-02-12T18:17:14.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.315+0000 7ff4f7443640 1 -- 10.20.193.48:0/525910590 >> v2:10.20.193.111:6812/977811348 conn(0x7ff4c003f800 msgr2=0x7ff4c005fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:14.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.315+0000 7ff4f7443640 1 --2- 10.20.193.48:0/525910590 >> v2:10.20.193.111:6812/977811348 conn(0x7ff4c003f800 0x7ff4c005fcb0 secure :-1 s=READY pgs=499 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4e0004740 tx=0x7ff4e0009210 comp rx=0 tx=0).stop 2026-02-12T18:17:14.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.315+0000 7ff4f7443640 10 monclient: shutdown 2026-02-12T18:17:14.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.315+0000 7ff4f7443640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:14.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.315+0000 7ff4f7443640 1 -- 10.20.193.48:0/525910590 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff4f01446b0 msgr2=0x7ff4f010d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:14.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.315+0000 7ff4f7443640 1 --2- 10.20.193.48:0/525910590 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff4f01446b0 0x7ff4f010d980 secure :-1 s=READY pgs=744 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7ff4ec00aae0 tx=0x7ff4ec005850 comp rx=0 tx=0).stop 2026-02-12T18:17:14.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.315+0000 7ff4f7443640 1 -- 10.20.193.48:0/525910590 shutdown_connections 2026-02-12T18:17:14.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.315+0000 7ff4f7443640 1 --2- 10.20.193.48:0/525910590 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7ff4f01446b0 0x7ff4f010d980 unknown :-1 s=CLOSED pgs=744 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:14.317 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.315+0000 7ff4f7443640 1 --2- 10.20.193.48:0/525910590 >> [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] conn(0x7ff4f0144030 0x7ff4f0141460 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:14.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.315+0000 7ff4f7443640 1 --2- 10.20.193.48:0/525910590 >> v2:10.20.193.111:6812/977811348 conn(0x7ff4c003f800 0x7ff4c005fcb0 unknown :-1 s=CLOSED pgs=499 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:14.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.315+0000 7ff4f7443640 1 --2- 10.20.193.48:0/525910590 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7ff4f0096ee0 0x7ff4f0131030 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:14.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.315+0000 7ff4f7443640 1 -- 10.20.193.48:0/525910590 >> 10.20.193.48:0/525910590 conn(0x7ff4f00548a0 msgr2=0x7ff4f0097ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:14.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.315+0000 7ff4f7443640 1 -- 10.20.193.48:0/525910590 shutdown_connections 2026-02-12T18:17:14.318 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:14.315+0000 7ff4f7443640 1 -- 10.20.193.48:0/525910590 wait complete. 2026-02-12T18:17:14.324 INFO:teuthology.orchestra.run.trial048.stdout:{"pg_ready":true,"pg_map":{"version":653,"stamp":"2026-02-12T18:17:12.452663+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":170512,"kb_used_data":8752,"kb_used_omap":1305,"kb_used_meta":160358,"kb_avail":566060528,"statfs":{"total":579820584960,"available":579645980672,"internally_reserved":0,"allocated":8962048,"data_stored":4077262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1336948,"internal_metadata":164206988},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001149"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":628,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480584+0000","last_change":"2026-02-12T18:06:11.383740+0000","last_active":"2026-02-12T18:15:20.480584+0000","last_peered":"2026-02-12T18:15:20.480584+0000","last_clean":"2026-02-12T18:15:20.480584+0000","last_became_active":"2026-02-12T18:06:09.281532+0000","last_became_peered":"2026-02-12T18:06:09.281532+0000","last_unstale":"2026-02-12T18:15:20.480584+0000","last_undegraded":"2026-02-12T18:15:20.480584+0000","last_fullsized":"2026-02-12T18:15:20.480584+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T20:34:57.876774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00027561099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":627,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480512+0000","last_change":"2026-02-12T18:06:11.384892+0000","last_active":"2026-02-12T18:15:20.480512+0000","last_peered":"2026-02-12T18:15:20.480512+0000","last_clean":"2026-02-12T18:15:20.480512+0000","last_became_active":"2026-02-12T18:06:09.283689+0000","last_became_peered":"2026-02-12T18:06:09.283689+0000","last_unstale":"2026-02-12T18:15:20.480512+0000","last_undegraded":"2026-02-12T18:15:20.480512+0000","last_fullsized":"2026-02-12T18:15:20.480512+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T00:04:55.700663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046734100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":628,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480580+0000","last_change":"2026-02-12T18:06:11.383662+0000","last_active":"2026-02-12T18:15:20.480580+0000","last_peered":"2026-02-12T18:15:20.480580+0000","last_clean":"2026-02-12T18:15:20.480580+0000","last_became_active":"2026-02-12T18:06:09.281461+0000","last_became_peered":"2026-02-12T18:06:09.281461+0000","last_unstale":"2026-02-12T18:15:20.480580+0000","last_undegraded":"2026-02-12T18:15:20.480580+0000","last_fullsized":"2026-02-12T18:15:20.480580+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T21:13:23.141921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00019704400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":627,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480493+0000","last_change":"2026-02-12T18:06:11.384936+0000","last_active":"2026-02-12T18:15:20.480493+0000","last_peered":"2026-02-12T18:15:20.480493+0000","last_clean":"2026-02-12T18:15:20.480493+0000","last_became_active":"2026-02-12T18:06:09.283688+0000","last_became_peered":"2026-02-12T18:06:09.283688+0000","last_unstale":"2026-02-12T18:15:20.480493+0000","last_undegraded":"2026-02-12T18:15:20.480493+0000","last_fullsized":"2026-02-12T18:15:20.480493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:54:04.914482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047092800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"18'2","reported_seq":629,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480486+0000","last_change":"2026-02-12T18:06:11.387479+0000","last_active":"2026-02-12T18:15:20.480486+0000","last_peered":"2026-02-12T18:15:20.480486+0000","last_clean":"2026-02-12T18:15:20.480486+0000","last_became_active":"2026-02-12T18:06:09.283881+0000","last_became_peered":"2026-02-12T18:06:09.283881+0000","last_unstale":"2026-02-12T18:15:20.480486+0000","last_undegraded":"2026-02-12T18:15:20.480486+0000","last_fullsized":"2026-02-12T18:15:20.480486+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:14:28.203244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045409299999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":633,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480327+0000","last_change":"2026-02-12T18:06:11.384057+0000","last_active":"2026-02-12T18:15:20.480327+0000","last_peered":"2026-02-12T18:15:20.480327+0000","last_clean":"2026-02-12T18:15:20.480327+0000","last_became_active":"2026-02-12T18:06:09.284036+0000","last_became_peered":"2026-02-12T18:06:09.284036+0000","last_unstale":"2026-02-12T18:15:20.480327+0000","last_undegraded":"2026-02-12T18:15:20.480327+0000","last_fullsized":"2026-02-12T18:15:20.480327+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T23:15:47.166182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028640700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":628,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480529+0000","last_change":"2026-02-12T18:06:11.383648+0000","last_active":"2026-02-12T18:15:20.480529+0000","last_peered":"2026-02-12T18:15:20.480529+0000","last_clean":"2026-02-12T18:15:20.480529+0000","last_became_active":"2026-02-12T18:06:09.283797+0000","last_became_peered":"2026-02-12T18:06:09.283797+0000","last_unstale":"2026-02-12T18:15:20.480529+0000","last_undegraded":"2026-02-12T18:15:20.480529+0000","last_fullsized":"2026-02-12T18:15:20.480529+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:51:24.172618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00018461199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"16'1","reported_seq":628,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480477+0000","last_change":"2026-02-12T18:06:11.387248+0000","last_active":"2026-02-12T18:15:20.480477+0000","last_peered":"2026-02-12T18:15:20.480477+0000","last_clean":"2026-02-12T18:15:20.480477+0000","last_became_active":"2026-02-12T18:06:09.287509+0000","last_became_peered":"2026-02-12T18:06:09.287509+0000","last_unstale":"2026-02-12T18:15:20.480477+0000","last_undegraded":"2026-02-12T18:15:20.480477+0000","last_fullsized":"2026-02-12T18:15:20.480477+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:08.178313+0000","last_clean_scrub_stamp":"2026-02-12T18:06:08.178313+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:54:10.505834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00020961600000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"13'112","reported_seq":765,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:15:20.480549+0000","last_change":"2026-02-12T18:06:04.371853+0000","last_active":"2026-02-12T18:15:20.480549+0000","last_peered":"2026-02-12T18:15:20.480549+0000","last_clean":"2026-02-12T18:15:20.480549+0000","last_became_active":"2026-02-12T18:06:04.371628+0000","last_became_peered":"2026-02-12T18:06:04.371628+0000","last_unstale":"2026-02-12T18:15:20.480549+0000","last_undegraded":"2026-02-12T18:15:20.480549+0000","last_fullsized":"2026-02-12T18:15:20.480549+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:06:02.768915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:06:02.768915+0000","last_clean_scrub_stamp":"2026-02-12T18:06:02.768915+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T18:16:28.244842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":112,"ondisk_log_size":112,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":12,"seq":51539607688,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28804,"kb_used_data":1844,"kb_used_omap":219,"kb_used_meta":26724,"kb_avail":94343036,"statfs":{"total":96636764160,"available":96607268864,"internally_reserved":0,"allocated":1888256,"data_stored":1073116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224993,"internal_metadata":27365663},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640393,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1268,"kb_used_omap":219,"kb_used_meta":26724,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1298432,"data_stored":482767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224995,"internal_metadata":27365661},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640392,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28224,"kb_used_data":1264,"kb_used_omap":217,"kb_used_meta":26726,"kb_avail":94343616,"statfs":{"total":96636764160,"available":96607862784,"internally_reserved":0,"allocated":1294336,"data_stored":482748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":222391,"internal_metadata":27368265},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640394,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28224,"kb_used_data":1264,"kb_used_omap":223,"kb_used_meta":26720,"kb_avail":94343616,"statfs":{"total":96636764160,"available":96607862784,"internally_reserved":0,"allocated":1294336,"data_stored":482748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":228901,"internal_metadata":27361755},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640393,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1268,"kb_used_omap":219,"kb_used_meta":26724,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1298432,"data_stored":482767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224995,"internal_metadata":27365661},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640393,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28804,"kb_used_data":1844,"kb_used_omap":205,"kb_used_meta":26738,"kb_avail":94343036,"statfs":{"total":96636764160,"available":96607268864,"internally_reserved":0,"allocated":1888256,"data_stored":1073116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":210673,"internal_metadata":27379983},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T18:17:14.330 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2026-02-12T18:06:08.178313+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=6, tm_sec=8, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=17, tm_sec=11, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T18:17:14.331 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2026-02-12T18:06:08.178313+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=6, tm_sec=8, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=17, tm_sec=11, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T18:17:14.331 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2026-02-12T18:06:08.178313+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=6, tm_sec=8, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=17, tm_sec=11, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T18:17:14.331 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2026-02-12T18:06:08.178313+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=6, tm_sec=8, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=17, tm_sec=11, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T18:17:14.331 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2026-02-12T18:06:08.178313+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=6, tm_sec=8, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=17, tm_sec=11, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T18:17:14.332 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2026-02-12T18:06:08.178313+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=6, tm_sec=8, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=17, tm_sec=11, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T18:17:14.332 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2026-02-12T18:06:08.178313+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=6, tm_sec=8, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=17, tm_sec=11, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T18:17:14.332 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2026-02-12T18:06:08.178313+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=6, tm_sec=8, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=17, tm_sec=11, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T18:17:14.332 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2026-02-12T18:06:02.768915+0000 time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=6, tm_sec=2, tm_wday=3, tm_yday=43, tm_isdst=-1) <= time.struct_time(tm_year=2026, tm_mon=2, tm_mday=12, tm_hour=18, tm_min=17, tm_sec=11, tm_wday=3, tm_yday=43, tm_isdst=0) 2026-02-12T18:17:14.332 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2026-02-12T18:17:34.333 DEBUG:teuthology.orchestra.run.trial048:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2026-02-12T18:17:34.400 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.398+0000 7fa33f05b640 10 monclient: get_monmap_and_config 2026-02-12T18:17:34.401 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.398+0000 7fa33f05b640 10 monclient: build_initial_monmap 2026-02-12T18:17:34.401 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.398+0000 7fa33f05b640 10 monclient: monmap: 2026-02-12T18:17:34.401 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:34.401 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:34.401 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:34.400027+0000 2026-02-12T18:17:34.401 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:34.400027+0000 2026-02-12T18:17:34.401 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:34.401 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:34.401 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:34.401 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:34.402 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:34.402 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:34.402 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:34.402 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:34.402 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:34.402 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:34.402 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:34.402 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:34.402 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:34.402 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:34.402 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33f05b640 1 Processor -- start 2026-02-12T18:17:34.403 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33f05b640 1 -- start start 2026-02-12T18:17:34.403 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33f05b640 10 monclient: init 2026-02-12T18:17:34.412 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33f05b640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:34.412 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33f05b640 10 monclient: _add_conns ranks=[7,4,6,1,10,3,2,5,8,9,0] 2026-02-12T18:17:34.412 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33f05b640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa338090d90 0x7fa338141220 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:34.412 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33f05b640 10 monclient(hunting): picked mon.noname-i con 0x7fa338090d90 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:17:34.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33f05b640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa33808be10 0x7fa338144210 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:34.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33f05b640 10 monclient(hunting): picked mon.noname-c con 0x7fa33808be10 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:17:34.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33f05b640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa338144750 0x7fa338144bc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:34.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33f05b640 10 monclient(hunting): picked mon.noname-d con 0x7fa338144750 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:17:34.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33f05b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:34.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33f05b640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fa3380570a0 con 0x7fa33808be10 2026-02-12T18:17:34.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33f05b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:34.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33f05b640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7fa3380578d0 con 0x7fa338144750 2026-02-12T18:17:34.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33f05b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:34.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33f05b640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fa338057310 con 0x7fa338090d90 2026-02-12T18:17:34.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33f05b640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:34.413 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33f05b640 10 monclient(hunting): authenticate will time out at 1293.125741s 2026-02-12T18:17:34.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa32ffff640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa33808be10 0x7fa338144210 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:34.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa32ffff640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa33808be10 0x7fa338144210 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:39774/0 (socket says 10.20.193.48:39774) 2026-02-12T18:17:34.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa32ffff640 1 -- 10.20.193.48:0/1811394246 learned_addr learned my addr 10.20.193.48:0/1811394246 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:34.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa32ffff640 10 monclient(hunting): get_auth_request con 0x7fa33808be10 auth_method 0 2026-02-12T18:17:34.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa32ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:34.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa32ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:34.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa32ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:34.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33d5d1640 1 --2- 10.20.193.48:0/1811394246 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa338144750 0x7fa338144bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:34.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33d5d1640 10 monclient(hunting): get_auth_request con 0x7fa338144750 auth_method 0 2026-02-12T18:17:34.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33d5d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:34.414 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33d5d1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:34.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33d5d1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:34.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa32ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:34.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa32ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:34.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa32ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:34.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33d5d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:34.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33d5d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:34.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33d5d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:34.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa33cdd0640 1 --2- 10.20.193.48:0/1811394246 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa338090d90 0x7fa338141220 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:34.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.399+0000 7fa32ffff640 10 monclient(hunting): handle_auth_done global_id 65380 payload 274 2026-02-12T18:17:34.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.400+0000 7fa32ffff640 1 -- 10.20.193.48:0/1811394246 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa338090d90 msgr2=0x7fa338141220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:34.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.400+0000 7fa32ffff640 1 --2- 10.20.193.48:0/1811394246 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa338090d90 0x7fa338141220 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:34.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.400+0000 7fa32ffff640 1 -- 10.20.193.48:0/1811394246 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa338144750 msgr2=0x7fa338144bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:34.415 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.400+0000 7fa32ffff640 1 --2- 10.20.193.48:0/1811394246 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa338144750 0x7fa338144bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:34.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.400+0000 7fa32ffff640 10 monclient: _finish_hunting 0 2026-02-12T18:17:34.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.400+0000 7fa32ffff640 1 monclient: found mon.noname-c 2026-02-12T18:17:34.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.400+0000 7fa32ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:34.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.400+0000 7fa32ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:10.20.193.48:3302/0 2026-02-12T18:17:34.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.400+0000 7fa32ffff640 1 -- 10.20.193.48:0/1811394246 --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa338060390 con 0x7fa33808be10 2026-02-12T18:17:34.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.400+0000 7fa33cdd0640 10 monclient: get_auth_request con 0x7fa338090d90 auth_method 0 2026-02-12T18:17:34.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.400+0000 7fa33cdd0640 1 --2- 10.20.193.48:0/1811394246 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa338090d90 0x7fa338141220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2026-02-12T18:17:34.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.402+0000 7fa32ffff640 1 -- 10.20.193.48:0/1811394246 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa33808be10 msgr2=0x7fa338144210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:34.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.402+0000 7fa32ffff640 1 --2- 10.20.193.48:0/1811394246 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa33808be10 0x7fa338144210 secure :-1 s=READY pgs=281 gs=1 cs=0 l=1 c_cookie=15303139062498577617 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3200098d0 tx=0x7fa32002ee10 comp rx=0 tx=0).ready entity=mon.4 client_cookie=d45fabe5d8a1ccd1 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:34.416 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.402+0000 7fa32f7fe640 1 -- 10.20.193.48:0/1811394246 <== mon.4 v2:10.20.193.48:3302/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa320035340 con 0x7fa33808be10 2026-02-12T18:17:34.417 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.402+0000 7fa32f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:34.417 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.402+0000 7fa32f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2026-02-12T18:17:34.417 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.402+0000 7fa32f7fe640 10 monclient: dump: 2026-02-12T18:17:34.417 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:34.417 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:34.417 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:34.417 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:34.417 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:34.417 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:34.417 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:34.417 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:34.417 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:34.418 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:34.418 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:34.418 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:34.418 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:34.418 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:34.418 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:34.418 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:34.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.402+0000 7fa32f7fe640 10 monclient: _finish_auth 0 2026-02-12T18:17:34.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.402+0000 7fa32f7fe640 10 monclient: _check_auth_tickets 2026-02-12T18:17:34.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.402+0000 7fa32f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:34.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.402+0000 7fa32f7fe640 1 -- 10.20.193.48:0/1811394246 <== mon.4 v2:10.20.193.48:3302/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3200354c0 con 0x7fa33808be10 2026-02-12T18:17:34.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.402+0000 7fa32f7fe640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:34.418 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.402+0000 7fa32f7fe640 1 -- 10.20.193.48:0/1811394246 <== mon.4 v2:10.20.193.48:3302/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa320035af0 con 0x7fa33808be10 2026-02-12T18:17:34.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.402+0000 7fa33f05b640 5 monclient: authenticate success, global_id 65380 2026-02-12T18:17:34.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.402+0000 7fa33f05b640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:34.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.402+0000 7fa33f05b640 4 set_mon_vals no callback set 2026-02-12T18:17:34.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.402+0000 7fa32f7fe640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:34.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.402+0000 7fa32f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2026-02-12T18:17:34.419 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.402+0000 7fa32f7fe640 10 monclient: dump: 2026-02-12T18:17:34.419 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:34.419 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:34.419 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:34.419 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:34.419 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:34.419 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:34.420 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:34.420 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:34.420 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:34.420 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:34.420 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:34.420 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:34.420 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:34.420 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:34.420 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:34.420 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:34.420 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.402+0000 7fa33f05b640 10 monclient: shutdown 2026-02-12T18:17:34.420 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.402+0000 7fa33f05b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:34.421 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.402+0000 7fa33f05b640 1 -- 10.20.193.48:0/1811394246 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa33808be10 msgr2=0x7fa338144210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:34.421 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.402+0000 7fa33f05b640 1 --2- 10.20.193.48:0/1811394246 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa33808be10 0x7fa338144210 secure :-1 s=READY pgs=281 gs=1 cs=0 l=1 c_cookie=15303139062498577617 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa3200098d0 tx=0x7fa32002ee10 comp rx=0 tx=0).stop 2026-02-12T18:17:34.421 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.403+0000 7fa33f05b640 1 -- 10.20.193.48:0/1811394246 shutdown_connections 2026-02-12T18:17:34.421 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.403+0000 7fa33f05b640 1 --2- 10.20.193.48:0/1811394246 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7fa338144750 0x7fa338144bc0 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:34.421 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.403+0000 7fa33f05b640 1 --2- 10.20.193.48:0/1811394246 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa33808be10 0x7fa338144210 unknown :-1 s=CLOSED pgs=281 gs=1 cs=0 l=1 c_cookie=15303139062498577617 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:34.421 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.403+0000 7fa33f05b640 1 --2- 10.20.193.48:0/1811394246 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa338090d90 0x7fa338141220 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:34.421 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.403+0000 7fa33f05b640 1 -- 10.20.193.48:0/1811394246 >> 10.20.193.48:0/1811394246 conn(0x7fa338054e20 msgr2=0x7fa338095380 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:34.421 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.403+0000 7fa33f05b640 1 -- 10.20.193.48:0/1811394246 shutdown_connections 2026-02-12T18:17:34.421 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.403+0000 7fa33f05b640 1 -- 10.20.193.48:0/1811394246 wait complete. 2026-02-12T18:17:34.421 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.403+0000 7fa33f05b640 10 monclient: build_initial_monmap 2026-02-12T18:17:34.421 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.403+0000 7fa33f05b640 10 monclient: monmap: 2026-02-12T18:17:34.421 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:34.422 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:34.422 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:34.422 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:34.422 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:34.422 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:34.422 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:34.422 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:34.422 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:34.422 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:34.422 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:34.422 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:34.423 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:34.423 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:34.423 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:34.423 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:34.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.403+0000 7fa33f05b640 1 Processor -- start 2026-02-12T18:17:34.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.403+0000 7fa33f05b640 1 -- start start 2026-02-12T18:17:34.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.403+0000 7fa33f05b640 10 monclient: init 2026-02-12T18:17:34.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33f05b640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:34.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33f05b640 10 monclient: _add_conns ranks=[7,2,4,1,3,6,0,5,8] 2026-02-12T18:17:34.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33f05b640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa33808be10 0x7fa33810ce00 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:34.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33f05b640 10 monclient(hunting): picked mon.noname-i con 0x7fa33808be10 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:17:34.423 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33f05b640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa338090d90 0x7fa33812e690 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:34.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33f05b640 10 monclient(hunting): picked mon.noname-b con 0x7fa338090d90 addr [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] 2026-02-12T18:17:34.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33f05b640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa338144750 0x7fa33812ebd0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:34.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33f05b640 10 monclient(hunting): picked mon.noname-c con 0x7fa338144750 addr [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] 2026-02-12T18:17:34.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33f05b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:34.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33f05b640 1 -- --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_getmap magic: 0 -- 0x7fa33810d340 con 0x7fa338090d90 2026-02-12T18:17:34.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33f05b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:34.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33f05b640 1 -- --> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] -- mon_getmap magic: 0 -- 0x7fa33812f110 con 0x7fa338144750 2026-02-12T18:17:34.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33f05b640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:34.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33f05b640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7fa33810eb50 con 0x7fa33808be10 2026-02-12T18:17:34.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33f05b640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:34.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33f05b640 10 monclient(hunting): authenticate will time out at 1293.130118s 2026-02-12T18:17:34.424 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa32ffff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa338090d90 0x7fa33812e690 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:34.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33d5d1640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa338144750 0x7fa33812ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:34.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa32ffff640 1 --2- >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa338090d90 0x7fa33812e690 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3301/0 says I am v2:10.20.193.48:46276/0 (socket says 10.20.193.48:46276) 2026-02-12T18:17:34.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33d5d1640 1 --2- >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa338144750 0x7fa33812ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3302/0 says I am v2:10.20.193.48:39780/0 (socket says 10.20.193.48:39780) 2026-02-12T18:17:34.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa32ffff640 1 -- 10.20.193.48:0/3445086283 learned_addr learned my addr 10.20.193.48:0/3445086283 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:34.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa32ffff640 10 monclient(hunting): get_auth_request con 0x7fa338090d90 auth_method 0 2026-02-12T18:17:34.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa32ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:34.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa32ffff640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:34.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa32ffff640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:34.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33d5d1640 10 monclient(hunting): get_auth_request con 0x7fa338144750 auth_method 0 2026-02-12T18:17:34.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33d5d1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:34.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33d5d1640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:34.425 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33d5d1640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:34.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa32ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:34.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa32ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:34.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa32ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:34.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33d5d1640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:34.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33d5d1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:34.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33d5d1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:34.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33cdd0640 1 --2- 10.20.193.48:0/3445086283 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa33808be10 0x7fa33810ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:34.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33cdd0640 10 monclient(hunting): get_auth_request con 0x7fa33808be10 auth_method 0 2026-02-12T18:17:34.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33cdd0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:34.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33cdd0640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:34.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa33cdd0640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:34.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa32ffff640 10 monclient(hunting): handle_auth_done global_id 36812 payload 824 2026-02-12T18:17:34.426 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa32ffff640 1 -- 10.20.193.48:0/3445086283 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa33808be10 msgr2=0x7fa33810ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:34.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa32ffff640 1 --2- 10.20.193.48:0/3445086283 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa33808be10 0x7fa33810ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:34.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa32ffff640 1 -- 10.20.193.48:0/3445086283 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa338144750 msgr2=0x7fa33812ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:34.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa32ffff640 1 --2- 10.20.193.48:0/3445086283 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa338144750 0x7fa33812ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:34.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa32ffff640 10 monclient: _finish_hunting 0 2026-02-12T18:17:34.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa32ffff640 1 monclient: found mon.noname-b 2026-02-12T18:17:34.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa32ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:34.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa32ffff640 10 monclient: _send_mon_message to mon.noname-b at v2:10.20.193.48:3301/0 2026-02-12T18:17:34.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.404+0000 7fa32ffff640 1 -- 10.20.193.48:0/3445086283 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3200094f0 con 0x7fa338090d90 2026-02-12T18:17:34.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.406+0000 7fa32ffff640 1 -- 10.20.193.48:0/3445086283 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa338090d90 msgr2=0x7fa33812e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:34.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.406+0000 7fa32ffff640 1 --2- 10.20.193.48:0/3445086283 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa338090d90 0x7fa33812e690 secure :-1 s=READY pgs=486 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa320004740 tx=0x7fa320004770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:34.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.406+0000 7fa32d7fa640 1 -- 10.20.193.48:0/3445086283 <== mon.2 v2:10.20.193.48:3301/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa320035e00 con 0x7fa338090d90 2026-02-12T18:17:34.427 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.406+0000 7fa32d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:34.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.406+0000 7fa32d7fa640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2026-02-12T18:17:34.428 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.406+0000 7fa32d7fa640 10 monclient: dump: 2026-02-12T18:17:34.428 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:34.428 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:34.428 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:34.428 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:34.428 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:34.428 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:34.428 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:34.428 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:34.428 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:34.428 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:34.428 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:34.429 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:34.429 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:34.429 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:34.429 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:34.429 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:34.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.406+0000 7fa32d7fa640 10 monclient: _finish_auth 0 2026-02-12T18:17:34.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.406+0000 7fa32d7fa640 10 monclient: _check_auth_tickets 2026-02-12T18:17:34.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.406+0000 7fa32d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:34.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.406+0000 7fa32d7fa640 1 -- 10.20.193.48:0/3445086283 <== mon.2 v2:10.20.193.48:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa320037900 con 0x7fa338090d90 2026-02-12T18:17:34.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.406+0000 7fa32d7fa640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:34.429 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.406+0000 7fa32d7fa640 1 -- 10.20.193.48:0/3445086283 <== mon.2 v2:10.20.193.48:3301/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7fa320040410 con 0x7fa338090d90 2026-02-12T18:17:34.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.406+0000 7fa32d7fa640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:34.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.406+0000 7fa32effd640 4 set_mon_vals no callback set 2026-02-12T18:17:34.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.406+0000 7fa32d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2026-02-12T18:17:34.430 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.406+0000 7fa32d7fa640 10 monclient: dump: 2026-02-12T18:17:34.430 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:34.430 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:34.430 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:34.430 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:34.430 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:34.430 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:34.430 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:34.430 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:34.430 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:34.431 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:34.431 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:34.431 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:34.431 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:34.431 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:34.431 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:34.431 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:34.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.406+0000 7fa33f05b640 5 monclient: authenticate success, global_id 36812 2026-02-12T18:17:34.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.406+0000 7fa33f05b640 10 monclient: _renew_subs 2026-02-12T18:17:34.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.406+0000 7fa33f05b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:17:34.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.406+0000 7fa33f05b640 1 -- 10.20.193.48:0/3445086283 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa33810f280 con 0x7fa338090d90 2026-02-12T18:17:34.431 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.406+0000 7fa33f05b640 10 monclient: _renew_subs 2026-02-12T18:17:34.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.406+0000 7fa33f05b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:17:34.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.406+0000 7fa33f05b640 1 -- 10.20.193.48:0/3445086283 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa33812aeb0 con 0x7fa338090d90 2026-02-12T18:17:34.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.407+0000 7fa33f05b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:34.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.407+0000 7fa33f05b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:34.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.407+0000 7fa33f05b640 10 monclient: _send_mon_message to mon.b at v2:10.20.193.48:3301/0 2026-02-12T18:17:34.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.407+0000 7fa33f05b640 1 -- 10.20.193.48:0/3445086283 --> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa338056220 con 0x7fa338090d90 2026-02-12T18:17:34.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.407+0000 7fa32d7fa640 1 -- 10.20.193.48:0/3445086283 <== mon.2 v2:10.20.193.48:3301/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7fa320046020 con 0x7fa338090d90 2026-02-12T18:17:34.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.408+0000 7fa32d7fa640 1 --2- 10.20.193.48:0/3445086283 >> v2:10.20.193.111:6812/977811348 conn(0x7fa30803f800 0x7fa30805fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:34.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.408+0000 7fa32d7fa640 1 -- 10.20.193.48:0/3445086283 <== mon.2 v2:10.20.193.48:3301/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7fa320077bc0 con 0x7fa338090d90 2026-02-12T18:17:34.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.408+0000 7fa33cdd0640 1 --2- 10.20.193.48:0/3445086283 >> v2:10.20.193.111:6812/977811348 conn(0x7fa30803f800 0x7fa30805fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:34.432 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.408+0000 7fa33cdd0640 10 monclient: get_auth_request con 0x7fa30803f800 auth_method 0 2026-02-12T18:17:34.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.410+0000 7fa32d7fa640 1 -- 10.20.193.48:0/3445086283 <== mon.2 v2:10.20.193.48:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7fa32003f390 con 0x7fa338090d90 2026-02-12T18:17:34.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.410+0000 7fa32d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:34.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.410+0000 7fa32d7fa640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:17:34.433 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.411+0000 7fa33cdd0640 1 --2- 10.20.193.48:0/3445086283 >> v2:10.20.193.111:6812/977811348 conn(0x7fa30803f800 0x7fa30805fcb0 secure :-1 s=READY pgs=500 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa328006fd0 tx=0x7fa328008040 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:34.517 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.516+0000 7fa33f05b640 1 -- 10.20.193.48:0/3445086283 --> v2:10.20.193.111:6812/977811348 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa3380580f0 con 0x7fa30803f800 2026-02-12T18:17:34.518 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.517+0000 7fa32d7fa640 1 -- 10.20.193.48:0/3445086283 <== mgr.4123 v2:10.20.193.111:6812/977811348 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33998 (secure 0 0 0) 0x7fa32800c050 con 0x7fa30803f800 2026-02-12T18:17:34.519 INFO:teuthology.orchestra.run.trial048.stdout: 2026-02-12T18:17:34.519 INFO:teuthology.orchestra.run.trial048.stderr:dumped all 2026-02-12T18:17:34.520 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.519+0000 7fa33f05b640 1 -- 10.20.193.48:0/3445086283 >> v2:10.20.193.111:6812/977811348 conn(0x7fa30803f800 msgr2=0x7fa30805fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:34.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.519+0000 7fa33f05b640 1 --2- 10.20.193.48:0/3445086283 >> v2:10.20.193.111:6812/977811348 conn(0x7fa30803f800 0x7fa30805fcb0 secure :-1 s=READY pgs=500 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa328006fd0 tx=0x7fa328008040 comp rx=0 tx=0).stop 2026-02-12T18:17:34.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.519+0000 7fa33f05b640 10 monclient: shutdown 2026-02-12T18:17:34.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.519+0000 7fa33f05b640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:34.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.519+0000 7fa33f05b640 1 -- 10.20.193.48:0/3445086283 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa338090d90 msgr2=0x7fa33812e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:34.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.519+0000 7fa33f05b640 1 --2- 10.20.193.48:0/3445086283 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa338090d90 0x7fa33812e690 secure :-1 s=READY pgs=486 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7fa320004740 tx=0x7fa320004770 comp rx=0 tx=0).stop 2026-02-12T18:17:34.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.519+0000 7fa33f05b640 1 -- 10.20.193.48:0/3445086283 shutdown_connections 2026-02-12T18:17:34.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.519+0000 7fa33f05b640 1 --2- 10.20.193.48:0/3445086283 >> [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] conn(0x7fa338144750 0x7fa33812ebd0 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:34.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.519+0000 7fa33f05b640 1 --2- 10.20.193.48:0/3445086283 >> [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] conn(0x7fa338090d90 0x7fa33812e690 unknown :-1 s=CLOSED pgs=486 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:34.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.519+0000 7fa33f05b640 1 --2- 10.20.193.48:0/3445086283 >> v2:10.20.193.111:6812/977811348 conn(0x7fa30803f800 0x7fa30805fcb0 unknown :-1 s=CLOSED pgs=500 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:34.521 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.519+0000 7fa33f05b640 1 --2- 10.20.193.48:0/3445086283 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7fa33808be10 0x7fa33810ce00 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:34.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.519+0000 7fa33f05b640 1 -- 10.20.193.48:0/3445086283 >> 10.20.193.48:0/3445086283 conn(0x7fa338054e20 msgr2=0x7fa338141010 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:34.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.519+0000 7fa33f05b640 1 -- 10.20.193.48:0/3445086283 shutdown_connections 2026-02-12T18:17:34.522 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.519+0000 7fa33f05b640 1 -- 10.20.193.48:0/3445086283 wait complete. 2026-02-12T18:17:34.529 INFO:teuthology.orchestra.run.trial048.stdout:{"pg_ready":true,"pg_map":{"version":664,"stamp":"2026-02-12T18:17:34.454894+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":147,"num_write_kb":2674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":170512,"kb_used_data":8752,"kb_used_omap":1305,"kb_used_meta":160358,"kb_avail":566060528,"statfs":{"total":579820584960,"available":579645980672,"internally_reserved":0,"allocated":8962048,"data_stored":4077262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1336948,"internal_metadata":164206988},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001252"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":636,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:17:16.193935+0000","last_change":"2026-02-12T18:17:16.193935+0000","last_active":"2026-02-12T18:17:16.193935+0000","last_peered":"2026-02-12T18:17:16.193935+0000","last_clean":"2026-02-12T18:17:16.193935+0000","last_became_active":"2026-02-12T18:06:09.281532+0000","last_became_peered":"2026-02-12T18:06:09.281532+0000","last_unstale":"2026-02-12T18:17:16.193935+0000","last_undegraded":"2026-02-12T18:17:16.193935+0000","last_fullsized":"2026-02-12T18:17:16.193935+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:17:16.193897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:17:16.193897+0000","last_clean_scrub_stamp":"2026-02-12T18:17:16.193897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:07:25.126417+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00027561099999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":635,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:17:13.771933+0000","last_change":"2026-02-12T18:17:13.771933+0000","last_active":"2026-02-12T18:17:13.771933+0000","last_peered":"2026-02-12T18:17:13.771933+0000","last_clean":"2026-02-12T18:17:13.771933+0000","last_became_active":"2026-02-12T18:06:09.283689+0000","last_became_peered":"2026-02-12T18:06:09.283689+0000","last_unstale":"2026-02-12T18:17:13.771933+0000","last_undegraded":"2026-02-12T18:17:13.771933+0000","last_fullsized":"2026-02-12T18:17:13.771933+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:17:13.771893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:17:13.771893+0000","last_clean_scrub_stamp":"2026-02-12T18:17:13.771893+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T19:16:00.250132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00046734100000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":636,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:17:15.223168+0000","last_change":"2026-02-12T18:17:15.223168+0000","last_active":"2026-02-12T18:17:15.223168+0000","last_peered":"2026-02-12T18:17:15.223168+0000","last_clean":"2026-02-12T18:17:15.223168+0000","last_became_active":"2026-02-12T18:06:09.281461+0000","last_became_peered":"2026-02-12T18:06:09.281461+0000","last_unstale":"2026-02-12T18:17:15.223168+0000","last_undegraded":"2026-02-12T18:17:15.223168+0000","last_fullsized":"2026-02-12T18:17:15.223168+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:17:15.223134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:17:15.223134+0000","last_clean_scrub_stamp":"2026-02-12T18:17:15.223134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:19:48.905430+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00019704400000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":635,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:17:14.731711+0000","last_change":"2026-02-12T18:17:14.731711+0000","last_active":"2026-02-12T18:17:14.731711+0000","last_peered":"2026-02-12T18:17:14.731711+0000","last_clean":"2026-02-12T18:17:14.731711+0000","last_became_active":"2026-02-12T18:06:09.283688+0000","last_became_peered":"2026-02-12T18:06:09.283688+0000","last_unstale":"2026-02-12T18:17:14.731711+0000","last_undegraded":"2026-02-12T18:17:14.731711+0000","last_fullsized":"2026-02-12T18:17:14.731711+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:17:14.731652+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:17:14.731652+0000","last_clean_scrub_stamp":"2026-02-12T18:17:14.731652+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T03:02:05.357601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047092800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"322'3","reported_seq":638,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:17:15.101970+0000","last_change":"2026-02-12T18:17:15.101970+0000","last_active":"2026-02-12T18:17:15.101970+0000","last_peered":"2026-02-12T18:17:15.101970+0000","last_clean":"2026-02-12T18:17:15.101970+0000","last_became_active":"2026-02-12T18:06:09.283881+0000","last_became_peered":"2026-02-12T18:06:09.283881+0000","last_unstale":"2026-02-12T18:17:15.101970+0000","last_undegraded":"2026-02-12T18:17:15.101970+0000","last_fullsized":"2026-02-12T18:17:15.101970+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"322'3","last_scrub_stamp":"2026-02-12T18:17:15.101923+0000","last_deep_scrub":"322'3","last_deep_scrub_stamp":"2026-02-12T18:17:15.101923+0000","last_clean_scrub_stamp":"2026-02-12T18:17:15.101923+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T05:03:13.909193+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00045409299999999998,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":641,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:17:13.471973+0000","last_change":"2026-02-12T18:17:13.471973+0000","last_active":"2026-02-12T18:17:13.471973+0000","last_peered":"2026-02-12T18:17:13.471973+0000","last_clean":"2026-02-12T18:17:13.471973+0000","last_became_active":"2026-02-12T18:06:09.284036+0000","last_became_peered":"2026-02-12T18:06:09.284036+0000","last_unstale":"2026-02-12T18:17:13.471973+0000","last_undegraded":"2026-02-12T18:17:13.471973+0000","last_fullsized":"2026-02-12T18:17:13.471973+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:17:13.471914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:17:13.471914+0000","last_clean_scrub_stamp":"2026-02-12T18:17:13.471914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T22:52:22.264835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00028640700000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":636,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:17:17.185896+0000","last_change":"2026-02-12T18:17:17.185896+0000","last_active":"2026-02-12T18:17:17.185896+0000","last_peered":"2026-02-12T18:17:17.185896+0000","last_clean":"2026-02-12T18:17:17.185896+0000","last_became_active":"2026-02-12T18:06:09.283797+0000","last_became_peered":"2026-02-12T18:06:09.283797+0000","last_unstale":"2026-02-12T18:17:17.185896+0000","last_undegraded":"2026-02-12T18:17:17.185896+0000","last_fullsized":"2026-02-12T18:17:17.185896+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2026-02-12T18:17:17.185857+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2026-02-12T18:17:17.185857+0000","last_clean_scrub_stamp":"2026-02-12T18:17:17.185857+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T02:06:11.001527+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00018461199999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"322'2","reported_seq":637,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:17:16.078614+0000","last_change":"2026-02-12T18:17:16.078614+0000","last_active":"2026-02-12T18:17:16.078614+0000","last_peered":"2026-02-12T18:17:16.078614+0000","last_clean":"2026-02-12T18:17:16.078614+0000","last_became_active":"2026-02-12T18:06:09.287509+0000","last_became_peered":"2026-02-12T18:06:09.287509+0000","last_unstale":"2026-02-12T18:17:16.078614+0000","last_undegraded":"2026-02-12T18:17:16.078614+0000","last_fullsized":"2026-02-12T18:17:16.078614+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"322'2","last_scrub_stamp":"2026-02-12T18:17:16.078533+0000","last_deep_scrub":"322'2","last_deep_scrub_stamp":"2026-02-12T18:17:16.078533+0000","last_clean_scrub_stamp":"2026-02-12T18:17:16.078533+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-13T21:28:51.267505+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00020961600000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"322'114","reported_seq":775,"reported_epoch":322,"state":"active+clean","last_fresh":"2026-02-12T18:17:14.241968+0000","last_change":"2026-02-12T18:17:14.241968+0000","last_active":"2026-02-12T18:17:14.241968+0000","last_peered":"2026-02-12T18:17:14.241968+0000","last_clean":"2026-02-12T18:17:14.241968+0000","last_became_active":"2026-02-12T18:06:04.371628+0000","last_became_peered":"2026-02-12T18:06:04.371628+0000","last_unstale":"2026-02-12T18:17:14.241968+0000","last_undegraded":"2026-02-12T18:17:14.241968+0000","last_fullsized":"2026-02-12T18:17:14.241968+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"322'114","last_scrub_stamp":"2026-02-12T18:17:14.241904+0000","last_deep_scrub":"322'114","last_deep_scrub_stamp":"2026-02-12T18:17:14.241904+0000","last_clean_scrub_stamp":"2026-02-12T18:17:14.241904+0000","objects_scrubbed":2,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2026-02-14T04:25:24.074294+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":73,"num_write":145,"num_write_kb":2672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":12,"seq":51539607693,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28804,"kb_used_data":1844,"kb_used_omap":219,"kb_used_meta":26724,"kb_avail":94343036,"statfs":{"total":96636764160,"available":96607268864,"internally_reserved":0,"allocated":1888256,"data_stored":1073116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224993,"internal_metadata":27365663},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":11,"seq":47244640398,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1268,"kb_used_omap":219,"kb_used_meta":26724,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1298432,"data_stored":482767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224995,"internal_metadata":27365661},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640397,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28224,"kb_used_data":1264,"kb_used_omap":217,"kb_used_meta":26726,"kb_avail":94343616,"statfs":{"total":96636764160,"available":96607862784,"internally_reserved":0,"allocated":1294336,"data_stored":482748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":222391,"internal_metadata":27368265},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640399,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28224,"kb_used_data":1264,"kb_used_omap":223,"kb_used_meta":26720,"kb_avail":94343616,"statfs":{"total":96636764160,"available":96607862784,"internally_reserved":0,"allocated":1294336,"data_stored":482748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":228901,"internal_metadata":27361755},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640397,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28228,"kb_used_data":1268,"kb_used_omap":219,"kb_used_meta":26724,"kb_avail":94343612,"statfs":{"total":96636764160,"available":96607858688,"internally_reserved":0,"allocated":1298432,"data_stored":482767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":224995,"internal_metadata":27365661},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640397,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28804,"kb_used_data":1844,"kb_used_omap":205,"kb_used_meta":26738,"kb_avail":94343036,"statfs":{"total":96636764160,"available":96607268864,"internally_reserved":0,"allocated":1888256,"data_stored":1073116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":210673,"internal_metadata":27379983},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2026-02-12T18:17:34.531 DEBUG:teuthology.orchestra.run.trial048:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2026-02-12T18:17:34.597 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.596+0000 7f160c0cc640 10 monclient: get_monmap_and_config 2026-02-12T18:17:34.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.596+0000 7f160c0cc640 10 monclient: build_initial_monmap 2026-02-12T18:17:34.598 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.596+0000 7f160c0cc640 10 monclient: monmap: 2026-02-12T18:17:34.598 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:34.598 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:34.598 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:17:34.597157+0000 2026-02-12T18:17:34.598 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:17:34.597157+0000 2026-02-12T18:17:34.598 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:34.598 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:34.598 INFO:teuthology.orchestra.run.trial048.stderr:0: v1:10.20.193.48:6789/0 mon.noname-a-legacy 2026-02-12T18:17:34.598 INFO:teuthology.orchestra.run.trial048.stderr:1: v1:10.20.193.111:6789/0 mon.noname-f-legacy 2026-02-12T18:17:34.599 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:34.599 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:34.599 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:34.599 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:34.599 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:34.599 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:34.599 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:34.599 INFO:teuthology.orchestra.run.trial048.stderr:9: v2:10.20.193.48:3300/0 mon.noname-a 2026-02-12T18:17:34.599 INFO:teuthology.orchestra.run.trial048.stderr:10: v2:10.20.193.111:3300/0 mon.noname-f 2026-02-12T18:17:34.599 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:34.599 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.596+0000 7f160c0cc640 1 Processor -- start 2026-02-12T18:17:34.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.596+0000 7f160c0cc640 1 -- start start 2026-02-12T18:17:34.600 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.596+0000 7f160c0cc640 10 monclient: init 2026-02-12T18:17:34.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.596+0000 7f160c0cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:34.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.596+0000 7f160c0cc640 10 monclient: _add_conns ranks=[8,7,5,1,6,9,10,0,3,2,4] 2026-02-12T18:17:34.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.596+0000 7f160c0cc640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f1604090070 0x7f160405d630 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:34.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.596+0000 7f160c0cc640 10 monclient(hunting): picked mon.noname-e con 0x7f1604090070 addr [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] 2026-02-12T18:17:34.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.596+0000 7f160c0cc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f160408cf80 0x7f160405db70 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:34.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.596+0000 7f160c0cc640 10 monclient(hunting): picked mon.noname-i con 0x7f160408cf80 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:17:34.609 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.596+0000 7f160c0cc640 1 --2- >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f1604141fa0 0x7f16041423f0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:34.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.596+0000 7f160c0cc640 10 monclient(hunting): picked mon.noname-h con 0x7f1604141fa0 addr [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] 2026-02-12T18:17:34.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.596+0000 7f160c0cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:34.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.596+0000 7f160c0cc640 1 -- --> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] -- mon_getmap magic: 0 -- 0x7f1604057de0 con 0x7f1604141fa0 2026-02-12T18:17:34.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.596+0000 7f160c0cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:34.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.596+0000 7f160c0cc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f1604090440 con 0x7f160408cf80 2026-02-12T18:17:34.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.596+0000 7f160c0cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:34.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.596+0000 7f160c0cc640 1 -- --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_getmap magic: 0 -- 0x7f160413f130 con 0x7f1604090070 2026-02-12T18:17:34.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.596+0000 7f160c0cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:34.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.596+0000 7f160c0cc640 10 monclient(hunting): authenticate will time out at 1293.322870s 2026-02-12T18:17:34.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.596+0000 7f1609e41640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f1604090070 0x7f160405d630 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:34.610 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.596+0000 7f1609e41640 1 --2- >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f1604090070 0x7f160405d630 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3304/0 says I am v2:10.20.193.48:59004/0 (socket says 10.20.193.48:59004) 2026-02-12T18:17:34.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f1609e41640 1 -- 10.20.193.48:0/3897453063 learned_addr learned my addr 10.20.193.48:0/3897453063 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:34.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f1609e41640 10 monclient(hunting): get_auth_request con 0x7f1604090070 auth_method 0 2026-02-12T18:17:34.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f1609e41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:34.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f1609e41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:34.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f1609e41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:34.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f1609640640 1 --2- 10.20.193.48:0/3897453063 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f160408cf80 0x7f160405db70 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:34.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f1609640640 10 monclient(hunting): get_auth_request con 0x7f160408cf80 auth_method 0 2026-02-12T18:17:34.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f1609640640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:34.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f1609640640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:34.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f1609640640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:34.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f1609e41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:34.611 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f1609e41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:34.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f160a642640 1 --2- 10.20.193.48:0/3897453063 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f1604141fa0 0x7f16041423f0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:34.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f1609e41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:34.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f160a642640 10 monclient(hunting): get_auth_request con 0x7f1604141fa0 auth_method 0 2026-02-12T18:17:34.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f160a642640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:34.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f160a642640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:34.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f160a642640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:34.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f1609e41640 10 monclient(hunting): handle_auth_done global_id 95102 payload 274 2026-02-12T18:17:34.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f1609e41640 1 -- 10.20.193.48:0/3897453063 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f160408cf80 msgr2=0x7f160405db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:34.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f1609e41640 1 --2- 10.20.193.48:0/3897453063 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f160408cf80 0x7f160405db70 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:34.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f1609e41640 1 -- 10.20.193.48:0/3897453063 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f1604141fa0 msgr2=0x7f16041423f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2026-02-12T18:17:34.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f1609e41640 1 --2- 10.20.193.48:0/3897453063 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f1604141fa0 0x7f16041423f0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:34.612 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f1609e41640 10 monclient: _finish_hunting 0 2026-02-12T18:17:34.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f1609e41640 1 monclient: found mon.noname-e 2026-02-12T18:17:34.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f1609e41640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:34.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f1609e41640 10 monclient: _send_mon_message to mon.noname-e at v2:10.20.193.48:3304/0 2026-02-12T18:17:34.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.597+0000 7f1609e41640 1 -- 10.20.193.48:0/3897453063 --> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f160404dc20 con 0x7f1604090070 2026-02-12T18:17:34.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.599+0000 7f1609e41640 1 -- 10.20.193.48:0/3897453063 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f1604090070 msgr2=0x7f160405d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:34.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.599+0000 7f1609e41640 1 --2- 10.20.193.48:0/3897453063 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f1604090070 0x7f160405d630 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=11092302929569618344 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15f4009900 tx=0x7f15f402ee10 comp rx=0 tx=0).ready entity=mon.8 client_cookie=99efc6beb20599a8 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:34.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.599+0000 7f1608e3f640 1 -- 10.20.193.48:0/3897453063 <== mon.8 v2:10.20.193.48:3304/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f15f4035340 con 0x7f1604090070 2026-02-12T18:17:34.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.599+0000 7f1608e3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:34.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.599+0000 7f1608e3f640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2026-02-12T18:17:34.613 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.599+0000 7f1608e3f640 10 monclient: dump: 2026-02-12T18:17:34.613 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:34.613 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:34.614 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:34.614 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:34.614 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:34.614 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:34.614 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:34.614 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:34.614 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:34.614 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:34.614 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:34.614 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:34.614 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:34.614 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:34.615 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:34.615 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:34.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f1608e3f640 10 monclient: _finish_auth 0 2026-02-12T18:17:34.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f1608e3f640 10 monclient: _check_auth_tickets 2026-02-12T18:17:34.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f1608e3f640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:34.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f1608e3f640 1 -- 10.20.193.48:0/3897453063 <== mon.8 v2:10.20.193.48:3304/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f40354c0 con 0x7f1604090070 2026-02-12T18:17:34.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f160c0cc640 5 monclient: authenticate success, global_id 95102 2026-02-12T18:17:34.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f160c0cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2026-02-12T18:17:34.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f1608e3f640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:34.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f1608e3f640 1 -- 10.20.193.48:0/3897453063 <== mon.8 v2:10.20.193.48:3304/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f15f4035af0 con 0x7f1604090070 2026-02-12T18:17:34.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f160c0cc640 10 monclient: get_monmap_and_config success 2026-02-12T18:17:34.615 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f160c0cc640 4 set_mon_vals no callback set 2026-02-12T18:17:34.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f1608e3f640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:34.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f1608e3f640 10 monclient: got monmap 1 from mon.e (according to old e1) 2026-02-12T18:17:34.616 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f1608e3f640 10 monclient: dump: 2026-02-12T18:17:34.616 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:34.616 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:34.616 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:34.616 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:34.616 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:34.616 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:34.617 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:34.617 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:34.617 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:34.617 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:34.617 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:34.617 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:34.617 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:34.617 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:34.617 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:34.617 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:34.617 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f160c0cc640 10 monclient: shutdown 2026-02-12T18:17:34.617 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f160c0cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:34.617 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f160c0cc640 1 -- 10.20.193.48:0/3897453063 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f1604090070 msgr2=0x7f160405d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:34.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f160c0cc640 1 --2- 10.20.193.48:0/3897453063 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f1604090070 0x7f160405d630 secure :-1 s=READY pgs=209 gs=1 cs=0 l=1 c_cookie=11092302929569618344 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15f4009900 tx=0x7f15f402ee10 comp rx=0 tx=0).stop 2026-02-12T18:17:34.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f160c0cc640 1 -- 10.20.193.48:0/3897453063 shutdown_connections 2026-02-12T18:17:34.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f160c0cc640 1 --2- 10.20.193.48:0/3897453063 >> [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] conn(0x7f1604141fa0 0x7f16041423f0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:34.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f160c0cc640 1 --2- 10.20.193.48:0/3897453063 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f160408cf80 0x7f160405db70 unknown :-1 s=CLOSED pgs=0 gs=2 cs=0 l=0 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:34.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f160c0cc640 1 --2- 10.20.193.48:0/3897453063 >> [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] conn(0x7f1604090070 0x7f160405d630 unknown :-1 s=CLOSED pgs=209 gs=1 cs=0 l=1 c_cookie=11092302929569618344 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:34.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f160c0cc640 1 -- 10.20.193.48:0/3897453063 >> 10.20.193.48:0/3897453063 conn(0x7f16040546a0 msgr2=0x7f1604054aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:34.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f160c0cc640 1 -- 10.20.193.48:0/3897453063 shutdown_connections 2026-02-12T18:17:34.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f160c0cc640 1 -- 10.20.193.48:0/3897453063 wait complete. 2026-02-12T18:17:34.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f160c0cc640 10 monclient: build_initial_monmap 2026-02-12T18:17:34.618 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f160c0cc640 10 monclient: monmap: 2026-02-12T18:17:34.618 INFO:teuthology.orchestra.run.trial048.stderr:epoch 0 2026-02-12T18:17:34.619 INFO:teuthology.orchestra.run.trial048.stderr:fsid 00000000-0000-0000-0000-000000000000 2026-02-12T18:17:34.619 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 0.000000 2026-02-12T18:17:34.619 INFO:teuthology.orchestra.run.trial048.stderr:created 0.000000 2026-02-12T18:17:34.619 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 0 (unknown) 2026-02-12T18:17:34.619 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:34.619 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.noname-a 2026-02-12T18:17:34.619 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.noname-f 2026-02-12T18:17:34.619 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.noname-b 2026-02-12T18:17:34.619 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.noname-g 2026-02-12T18:17:34.619 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.noname-c 2026-02-12T18:17:34.619 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.noname-h 2026-02-12T18:17:34.619 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.noname-d 2026-02-12T18:17:34.620 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.noname-i 2026-02-12T18:17:34.620 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.noname-e 2026-02-12T18:17:34.620 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:34.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.600+0000 7f160c0cc640 1 Processor -- start 2026-02-12T18:17:34.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160c0cc640 1 -- start start 2026-02-12T18:17:34.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160c0cc640 10 monclient: init 2026-02-12T18:17:34.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160c0cc640 10 monclient: _reopen_session rank -1 2026-02-12T18:17:34.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160c0cc640 10 monclient: _add_conns ranks=[0,7,6,3,5,1,2,8,4] 2026-02-12T18:17:34.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160c0cc640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f160408cf80 0x7f160408a680 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:34.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160c0cc640 10 monclient(hunting): picked mon.noname-a con 0x7f160408cf80 addr [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] 2026-02-12T18:17:34.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160c0cc640 1 --2- >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1604090070 0x7f160408abc0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:34.620 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160c0cc640 10 monclient(hunting): picked mon.noname-i con 0x7f1604090070 addr [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] 2026-02-12T18:17:34.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160c0cc640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f1604141fa0 0x7f160408b100 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:34.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160c0cc640 10 monclient(hunting): picked mon.noname-d con 0x7f1604141fa0 addr [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] 2026-02-12T18:17:34.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160c0cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:34.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160c0cc640 1 -- --> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] -- mon_getmap magic: 0 -- 0x7f160408c4d0 con 0x7f160408cf80 2026-02-12T18:17:34.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160c0cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:34.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160c0cc640 1 -- --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_getmap magic: 0 -- 0x7f160413d3a0 con 0x7f1604141fa0 2026-02-12T18:17:34.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160c0cc640 10 monclient(hunting): start opening mon connection 2026-02-12T18:17:34.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160c0cc640 1 -- --> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] -- mon_getmap magic: 0 -- 0x7f160413d8f0 con 0x7f1604090070 2026-02-12T18:17:34.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160c0cc640 10 monclient(hunting): _renew_subs 2026-02-12T18:17:34.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160c0cc640 10 monclient(hunting): authenticate will time out at 1293.327327s 2026-02-12T18:17:34.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f1609e41640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f160408cf80 0x7f160408a680 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:34.621 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160a642640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f1604141fa0 0x7f160408b100 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:34.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f1609e41640 1 --2- >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f160408cf80 0x7f160408a680 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3300/0 says I am v2:10.20.193.48:57872/0 (socket says 10.20.193.48:57872) 2026-02-12T18:17:34.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160a642640 1 --2- >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f1604141fa0 0x7f160408b100 unknown :-1 s=HELLO_CONNECTING pgs=0 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:10.20.193.48:3303/0 says I am v2:10.20.193.48:50782/0 (socket says 10.20.193.48:50782) 2026-02-12T18:17:34.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f1609e41640 1 -- 10.20.193.48:0/732013328 learned_addr learned my addr 10.20.193.48:0/732013328 (peer_addr_for_me v2:10.20.193.48:0/0) 2026-02-12T18:17:34.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f1609e41640 10 monclient(hunting): get_auth_request con 0x7f160408cf80 auth_method 0 2026-02-12T18:17:34.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f1609e41640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:34.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f1609e41640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:34.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f1609e41640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:34.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160a642640 10 monclient(hunting): get_auth_request con 0x7f1604141fa0 auth_method 0 2026-02-12T18:17:34.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160a642640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:34.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160a642640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:34.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160a642640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:34.622 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160a642640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:34.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160a642640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:34.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160a642640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:34.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f1609e41640 10 monclient(hunting): handle_auth_reply_more payload 9 2026-02-12T18:17:34.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f1609e41640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2026-02-12T18:17:34.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f1609e41640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2026-02-12T18:17:34.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f1609640640 1 --2- 10.20.193.48:0/732013328 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1604090070 0x7f160408abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:34.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f1609640640 10 monclient(hunting): get_auth_request con 0x7f1604090070 auth_method 0 2026-02-12T18:17:34.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f1609640640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2026-02-12T18:17:34.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f1609640640 10 monclient(hunting): _init_auth method 2 2026-02-12T18:17:34.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f1609640640 10 monclient(hunting): _init_auth creating new auth 2026-02-12T18:17:34.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160a642640 10 monclient(hunting): handle_auth_done global_id 114297 payload 824 2026-02-12T18:17:34.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160a642640 1 -- 10.20.193.48:0/732013328 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1604090070 msgr2=0x7f160408abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:34.623 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160a642640 1 --2- 10.20.193.48:0/732013328 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1604090070 0x7f160408abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:34.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160a642640 1 -- 10.20.193.48:0/732013328 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f160408cf80 msgr2=0x7f160408a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:34.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160a642640 1 --2- 10.20.193.48:0/732013328 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f160408cf80 0x7f160408a680 unknown :-1 s=AUTH_CONNECTING pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:34.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160a642640 10 monclient: _finish_hunting 0 2026-02-12T18:17:34.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160a642640 1 monclient: found mon.noname-d 2026-02-12T18:17:34.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160a642640 20 monclient: _un_backoff reopen_interval_multipler now 1 2026-02-12T18:17:34.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160a642640 10 monclient: _send_mon_message to mon.noname-d at v2:10.20.193.48:3303/0 2026-02-12T18:17:34.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f160a642640 1 -- 10.20.193.48:0/732013328 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15f40094f0 con 0x7f1604141fa0 2026-02-12T18:17:34.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f1609640640 1 --2- 10.20.193.48:0/732013328 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1604090070 0x7f160408abc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2026-02-12T18:17:34.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.601+0000 7f1609e41640 1 --2- 10.20.193.48:0/732013328 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f160408cf80 0x7f160408a680 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2026-02-12T18:17:34.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.603+0000 7f160a642640 1 -- 10.20.193.48:0/732013328 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f1604141fa0 msgr2=0x7f160408b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).operator() setting up a delay queue 2026-02-12T18:17:34.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.603+0000 7f160a642640 1 --2- 10.20.193.48:0/732013328 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f1604141fa0 0x7f160408b100 secure :-1 s=READY pgs=39 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f160000f7e0 tx=0x7f160000fcb0 comp rx=0 tx=0).ready entity=mon.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:34.624 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.603+0000 7f15f27fc640 1 -- 10.20.193.48:0/732013328 <== mon.6 v2:10.20.193.48:3303/0 1 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f16000054f0 con 0x7f1604141fa0 2026-02-12T18:17:34.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.603+0000 7f15f27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:34.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.603+0000 7f15f27fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2026-02-12T18:17:34.625 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.603+0000 7f15f27fc640 10 monclient: dump: 2026-02-12T18:17:34.625 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:34.625 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:34.625 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:34.625 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:34.625 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:34.625 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:34.625 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:34.625 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:34.625 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:34.626 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:34.626 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:34.626 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:34.626 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:34.626 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:34.626 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:34.626 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:34.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.604+0000 7f15f27fc640 10 monclient: _finish_auth 0 2026-02-12T18:17:34.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.604+0000 7f15f27fc640 10 monclient: _check_auth_tickets 2026-02-12T18:17:34.626 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.604+0000 7f15f27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2026-02-12T18:17:34.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.604+0000 7f160c0cc640 5 monclient: authenticate success, global_id 114297 2026-02-12T18:17:34.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.604+0000 7f15f27fc640 1 -- 10.20.193.48:0/732013328 <== mon.6 v2:10.20.193.48:3303/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1600005670 con 0x7f1604141fa0 2026-02-12T18:17:34.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.604+0000 7f160c0cc640 10 monclient: _renew_subs 2026-02-12T18:17:34.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.604+0000 7f160c0cc640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:17:34.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.604+0000 7f160c0cc640 1 -- 10.20.193.48:0/732013328 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f160405a9f0 con 0x7f1604141fa0 2026-02-12T18:17:34.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.604+0000 7f15f27fc640 10 monclient: handle_config config(0 keys) 2026-02-12T18:17:34.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.604+0000 7f15f27fc640 1 -- 10.20.193.48:0/732013328 <== mon.6 v2:10.20.193.48:3303/0 3 ==== mon_map magic: 0 ==== 1109+0+0 (secure 0 0 0) 0x7f1600004c70 con 0x7f1604141fa0 2026-02-12T18:17:34.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.604+0000 7f15f27fc640 10 monclient: handle_monmap mon_map magic: 0 2026-02-12T18:17:34.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.604+0000 7f15f27fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2026-02-12T18:17:34.627 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.604+0000 7f15f27fc640 10 monclient: dump: 2026-02-12T18:17:34.627 INFO:teuthology.orchestra.run.trial048.stderr:epoch 1 2026-02-12T18:17:34.627 INFO:teuthology.orchestra.run.trial048.stderr:fsid ff8a9ee7-9c95-4c71-86fa-da746f82dc18 2026-02-12T18:17:34.628 INFO:teuthology.orchestra.run.trial048.stderr:last_changed 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:34.628 INFO:teuthology.orchestra.run.trial048.stderr:created 2026-02-12T18:05:32.850777+0000 2026-02-12T18:17:34.628 INFO:teuthology.orchestra.run.trial048.stderr:min_mon_release 20 (tentacle) 2026-02-12T18:17:34.628 INFO:teuthology.orchestra.run.trial048.stderr:election_strategy: 1 2026-02-12T18:17:34.628 INFO:teuthology.orchestra.run.trial048.stderr:0: [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] mon.a 2026-02-12T18:17:34.628 INFO:teuthology.orchestra.run.trial048.stderr:1: [v2:10.20.193.111:3300/0,v1:10.20.193.111:6789/0] mon.f 2026-02-12T18:17:34.628 INFO:teuthology.orchestra.run.trial048.stderr:2: [v2:10.20.193.48:3301/0,v1:10.20.193.48:6790/0] mon.b 2026-02-12T18:17:34.628 INFO:teuthology.orchestra.run.trial048.stderr:3: [v2:10.20.193.111:3301/0,v1:10.20.193.111:6790/0] mon.g 2026-02-12T18:17:34.628 INFO:teuthology.orchestra.run.trial048.stderr:4: [v2:10.20.193.48:3302/0,v1:10.20.193.48:6791/0] mon.c 2026-02-12T18:17:34.628 INFO:teuthology.orchestra.run.trial048.stderr:5: [v2:10.20.193.111:3302/0,v1:10.20.193.111:6791/0] mon.h 2026-02-12T18:17:34.628 INFO:teuthology.orchestra.run.trial048.stderr:6: [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] mon.d 2026-02-12T18:17:34.628 INFO:teuthology.orchestra.run.trial048.stderr:7: [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] mon.i 2026-02-12T18:17:34.629 INFO:teuthology.orchestra.run.trial048.stderr:8: [v2:10.20.193.48:3304/0,v1:10.20.193.48:6793/0] mon.e 2026-02-12T18:17:34.629 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:34.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.604+0000 7f15f3fff640 4 set_mon_vals no callback set 2026-02-12T18:17:34.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.604+0000 7f160c0cc640 10 monclient: _renew_subs 2026-02-12T18:17:34.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.604+0000 7f160c0cc640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:17:34.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.604+0000 7f160c0cc640 1 -- 10.20.193.48:0/732013328 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_subscribe({osdmap=0}) -- 0x7f1604059910 con 0x7f1604141fa0 2026-02-12T18:17:34.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.604+0000 7f160c0cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:34.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.604+0000 7f160c0cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:34.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.604+0000 7f160c0cc640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:17:34.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.604+0000 7f160c0cc640 1 -- 10.20.193.48:0/732013328 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f160408c6d0 con 0x7f1604141fa0 2026-02-12T18:17:34.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.604+0000 7f15f27fc640 1 -- 10.20.193.48:0/732013328 <== mon.6 v2:10.20.193.48:3303/0 4 ==== mgrmap(e 5) ==== 51968+0+0 (secure 0 0 0) 0x7f16000047b0 con 0x7f1604141fa0 2026-02-12T18:17:34.629 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.604+0000 7f15f27fc640 1 --2- 10.20.193.48:0/732013328 >> v2:10.20.193.111:6812/977811348 conn(0x7f15d403f800 0x7f15d405fcb0 unknown :-1 s=NONE pgs=0 gs=0 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2026-02-12T18:17:34.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.604+0000 7f15f27fc640 1 -- 10.20.193.48:0/732013328 <== mon.6 v2:10.20.193.48:3303/0 5 ==== osd_map(322..322 src has 222..322) ==== 3503+0+0 (secure 0 0 0) 0x7f1600053850 con 0x7f1604141fa0 2026-02-12T18:17:34.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.605+0000 7f1609e41640 1 --2- 10.20.193.48:0/732013328 >> v2:10.20.193.111:6812/977811348 conn(0x7f15d403f800 0x7f15d405fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2026-02-12T18:17:34.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.605+0000 7f1609e41640 10 monclient: get_auth_request con 0x7f15d403f800 auth_method 0 2026-02-12T18:17:34.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.606+0000 7f15f27fc640 1 -- 10.20.193.48:0/732013328 <== mon.6 v2:10.20.193.48:3303/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+229739 (secure 0 0 0) 0x7f160000d6c0 con 0x7f1604141fa0 2026-02-12T18:17:34.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.606+0000 7f15f27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2026-02-12T18:17:34.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.606+0000 7f15f27fc640 10 monclient: _finish_command 1 = system:0 2026-02-12T18:17:34.630 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.607+0000 7f1609e41640 1 --2- 10.20.193.48:0/732013328 >> v2:10.20.193.111:6812/977811348 conn(0x7f15d403f800 0x7f15d405fcb0 secure :-1 s=READY pgs=501 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15f40023d0 tx=0x7f15f4033000 comp rx=0 tx=0).ready entity=mgr.4123 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2026-02-12T18:17:34.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.711+0000 7f160c0cc640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-12T18:17:34.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.711+0000 7f160c0cc640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-12T18:17:34.712 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.711+0000 7f160c0cc640 10 monclient: _send_mon_message to mon.d at v2:10.20.193.48:3303/0 2026-02-12T18:17:34.713 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.711+0000 7f160c0cc640 1 -- 10.20.193.48:0/732013328 --> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f160405d5f0 con 0x7f1604141fa0 2026-02-12T18:17:34.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.721+0000 7f15f27fc640 1 -- 10.20.193.48:0/732013328 <== mon.6 v2:10.20.193.48:3303/0 7 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f160000d6c0 con 0x7f1604141fa0 2026-02-12T18:17:34.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.721+0000 7f15f27fc640 10 monclient: handle_config config(1 keys) 2026-02-12T18:17:34.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.721+0000 7f15f3fff640 4 set_mon_vals no callback set 2026-02-12T18:17:34.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.721+0000 7f15f3fff640 10 set_mon_vals mon_health_to_clog = false 2026-02-12T18:17:34.723 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.721+0000 7f15f27fc640 1 -- 10.20.193.48:0/732013328 <== mon.6 v2:10.20.193.48:3303/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v3)=0 v3) ==== 123+0+0 (secure 0 0 0) 0x7f1600013880 con 0x7f1604141fa0 2026-02-12T18:17:34.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.721+0000 7f15f27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2026-02-12T18:17:34.724 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.721+0000 7f15f27fc640 10 monclient: _finish_command 2 = system:0 2026-02-12T18:17:34.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.723+0000 7f160c0cc640 1 -- 10.20.193.48:0/732013328 >> v2:10.20.193.111:6812/977811348 conn(0x7f15d403f800 msgr2=0x7f15d405fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:34.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.723+0000 7f160c0cc640 1 --2- 10.20.193.48:0/732013328 >> v2:10.20.193.111:6812/977811348 conn(0x7f15d403f800 0x7f15d405fcb0 secure :-1 s=READY pgs=501 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f15f40023d0 tx=0x7f15f4033000 comp rx=0 tx=0).stop 2026-02-12T18:17:34.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.723+0000 7f160c0cc640 10 monclient: shutdown 2026-02-12T18:17:34.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.723+0000 7f160c0cc640 20 monclient: shutdown discarding 0 pending message(s) 2026-02-12T18:17:34.725 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.723+0000 7f160c0cc640 1 -- 10.20.193.48:0/732013328 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f1604141fa0 msgr2=0x7f160408b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2026-02-12T18:17:34.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.723+0000 7f160c0cc640 1 --2- 10.20.193.48:0/732013328 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f1604141fa0 0x7f160408b100 secure :-1 s=READY pgs=39 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0x7f160000f7e0 tx=0x7f160000fcb0 comp rx=0 tx=0).stop 2026-02-12T18:17:34.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.723+0000 7f160c0cc640 1 -- 10.20.193.48:0/732013328 shutdown_connections 2026-02-12T18:17:34.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.723+0000 7f160c0cc640 1 --2- 10.20.193.48:0/732013328 >> [v2:10.20.193.48:3303/0,v1:10.20.193.48:6792/0] conn(0x7f1604141fa0 0x7f160408b100 unknown :-1 s=CLOSED pgs=39 gs=2 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:34.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.723+0000 7f160c0cc640 1 --2- 10.20.193.48:0/732013328 >> v2:10.20.193.111:6812/977811348 conn(0x7f15d403f800 0x7f15d405fcb0 unknown :-1 s=CLOSED pgs=501 gs=4 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:34.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.723+0000 7f160c0cc640 1 --2- 10.20.193.48:0/732013328 >> [v2:10.20.193.111:3303/0,v1:10.20.193.111:6792/0] conn(0x7f1604090070 0x7f160408abc0 unknown :-1 s=CLOSED pgs=0 gs=3 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:34.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.723+0000 7f160c0cc640 1 --2- 10.20.193.48:0/732013328 >> [v2:10.20.193.48:3300/0,v1:10.20.193.48:6789/0] conn(0x7f160408cf80 0x7f160408a680 unknown :-1 s=CLOSED pgs=0 gs=1 cs=0 l=1 c_cookie=0 s_cookie=0 reconnecting=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2026-02-12T18:17:34.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.723+0000 7f160c0cc640 1 -- 10.20.193.48:0/732013328 >> 10.20.193.48:0/732013328 conn(0x7f16040546a0 msgr2=0x7f160408e300 unknown :-1 s=STATE_NONE l=0).mark_down 2026-02-12T18:17:34.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.723+0000 7f160c0cc640 1 -- 10.20.193.48:0/732013328 shutdown_connections 2026-02-12T18:17:34.726 INFO:teuthology.orchestra.run.trial048.stderr:2026-02-12T18:17:34.723+0000 7f160c0cc640 1 -- 10.20.193.48:0/732013328 wait complete. 2026-02-12T18:17:34.734 INFO:teuthology.misc:Shutting down mds daemons... 2026-02-12T18:17:34.734 INFO:teuthology.misc:Shutting down osd daemons... 2026-02-12T18:17:34.734 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2026-02-12T18:17:34.734 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:17:34.768 INFO:tasks.ceph.osd.0:Stopped 2026-02-12T18:17:34.768 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2026-02-12T18:17:34.768 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:17:34.835 INFO:tasks.ceph.osd.1:Stopped 2026-02-12T18:17:34.836 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2026-02-12T18:17:34.836 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:17:34.904 INFO:tasks.ceph.osd.2:Stopped 2026-02-12T18:17:34.904 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2026-02-12T18:17:34.905 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:17:34.938 INFO:tasks.ceph.osd.3:Stopped 2026-02-12T18:17:34.939 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2026-02-12T18:17:34.939 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:17:35.009 INFO:tasks.ceph.osd.4:Stopped 2026-02-12T18:17:35.010 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2026-02-12T18:17:35.010 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:17:35.076 INFO:tasks.ceph.osd.5:Stopped 2026-02-12T18:17:35.076 INFO:teuthology.misc:Shutting down mgr daemons... 2026-02-12T18:17:35.076 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2026-02-12T18:17:35.076 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:17:35.146 INFO:tasks.ceph.mgr.x:Stopped 2026-02-12T18:17:35.146 INFO:teuthology.misc:Shutting down mon daemons... 2026-02-12T18:17:35.147 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2026-02-12T18:17:35.147 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:17:35.163 INFO:tasks.ceph.mon.a:Stopped 2026-02-12T18:17:35.163 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2026-02-12T18:17:35.163 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:17:35.215 INFO:tasks.ceph.mon.b:Stopped 2026-02-12T18:17:35.215 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2026-02-12T18:17:35.215 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:17:35.267 INFO:tasks.ceph.mon.c:Stopped 2026-02-12T18:17:35.267 DEBUG:tasks.ceph.mon.d:waiting for process to exit 2026-02-12T18:17:35.267 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:17:35.317 INFO:tasks.ceph.mon.d:Stopped 2026-02-12T18:17:35.317 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2026-02-12T18:17:35.317 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:17:35.368 INFO:tasks.ceph.mon.e:Stopped 2026-02-12T18:17:35.369 DEBUG:tasks.ceph.mon.f:waiting for process to exit 2026-02-12T18:17:35.369 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:17:35.380 INFO:tasks.ceph.mon.f:Stopped 2026-02-12T18:17:35.381 DEBUG:tasks.ceph.mon.g:waiting for process to exit 2026-02-12T18:17:35.381 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:17:35.432 INFO:tasks.ceph.mon.g:Stopped 2026-02-12T18:17:35.432 DEBUG:tasks.ceph.mon.h:waiting for process to exit 2026-02-12T18:17:35.432 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:17:35.481 INFO:tasks.ceph.mon.h:Stopped 2026-02-12T18:17:35.482 DEBUG:tasks.ceph.mon.i:waiting for process to exit 2026-02-12T18:17:35.482 INFO:teuthology.orchestra.run:waiting for 300 2026-02-12T18:17:35.532 INFO:tasks.ceph.mon.i:Stopped 2026-02-12T18:17:35.532 INFO:tasks.ceph:Checking cluster log for badness... 2026-02-12T18:17:35.532 DEBUG:teuthology.orchestra.run.trial048:> sudo grep -E '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | grep -E -v '\(MDS_ALL_DOWN\)' | grep -E -v '\(MDS_UP_LESS_THAN_MAX\)' | grep -E -v ScrubResult | grep -E -v 'scrub mismatch' | grep -E -v 'overall HEALTH_' | grep -E -v '\(MGR_DOWN\)' | grep -E -v '\(PG_AVAILABILITY\)' | grep -E -v '\(SLOW_OPS\)' | grep -E -v 'slow request' | grep -E -v '\(OSD_SLOW_PING_TIME' | grep -E -v '\(MON_NETSPLIT)' | grep -E -v 'overall HEALTH_' | grep -E -v '\(MON_DOWN\)' | grep -E -v '\(TOO_FEW_PGS\)' | grep -E -v '\(POOL_APP_NOT_ENABLED\)' | grep -E -v 'slow request' | grep -E -v 'overall HEALTH_' | head -n 1 2026-02-12T18:17:35.563 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@trial048.front.sepia.ceph.com 2026-02-12T18:17:35.564 DEBUG:teuthology.orchestra.run.trial048:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2026-02-12T18:17:35.677 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@trial048.front.sepia.ceph.com 2026-02-12T18:17:35.677 DEBUG:teuthology.orchestra.run.trial048:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2026-02-12T18:17:35.705 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@trial048.front.sepia.ceph.com 2026-02-12T18:17:35.705 DEBUG:teuthology.orchestra.run.trial048:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2026-02-12T18:17:35.780 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@trial111.front.sepia.ceph.com 2026-02-12T18:17:35.780 DEBUG:teuthology.orchestra.run.trial111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2026-02-12T18:17:35.819 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@trial111.front.sepia.ceph.com 2026-02-12T18:17:35.819 DEBUG:teuthology.orchestra.run.trial111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2026-02-12T18:17:35.887 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@trial111.front.sepia.ceph.com 2026-02-12T18:17:35.888 DEBUG:teuthology.orchestra.run.trial111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2026-02-12T18:17:35.957 INFO:tasks.ceph:Archiving mon data... 2026-02-12T18:17:35.959 DEBUG:teuthology.misc:Transferring archived files from trial048:/var/lib/ceph/mon/ceph-a to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46480/data/mon.a.tgz 2026-02-12T18:17:35.959 DEBUG:teuthology.orchestra.run.trial048:> mktemp 2026-02-12T18:17:35.977 INFO:teuthology.orchestra.run.trial048.stdout:/tmp/tmp.FNbYOeRums 2026-02-12T18:17:35.978 DEBUG:teuthology.orchestra.run.trial048:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.FNbYOeRums 2026-02-12T18:17:36.102 DEBUG:teuthology.orchestra.run.trial048:> sudo chmod 0666 /tmp/tmp.FNbYOeRums 2026-02-12T18:17:36.185 DEBUG:teuthology.orchestra.remote:trial048:/tmp/tmp.FNbYOeRums is 594KB 2026-02-12T18:17:36.284 DEBUG:teuthology.orchestra.run.trial048:> rm -fr /tmp/tmp.FNbYOeRums 2026-02-12T18:17:36.301 DEBUG:teuthology.misc:Transferring archived files from trial048:/var/lib/ceph/mon/ceph-b to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46480/data/mon.b.tgz 2026-02-12T18:17:36.301 DEBUG:teuthology.orchestra.run.trial048:> mktemp 2026-02-12T18:17:36.357 INFO:teuthology.orchestra.run.trial048.stdout:/tmp/tmp.N2JC3NOuSe 2026-02-12T18:17:36.357 DEBUG:teuthology.orchestra.run.trial048:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.N2JC3NOuSe 2026-02-12T18:17:36.479 DEBUG:teuthology.orchestra.run.trial048:> sudo chmod 0666 /tmp/tmp.N2JC3NOuSe 2026-02-12T18:17:36.559 DEBUG:teuthology.orchestra.remote:trial048:/tmp/tmp.N2JC3NOuSe is 594KB 2026-02-12T18:17:36.658 DEBUG:teuthology.orchestra.run.trial048:> rm -fr /tmp/tmp.N2JC3NOuSe 2026-02-12T18:17:36.676 DEBUG:teuthology.misc:Transferring archived files from trial048:/var/lib/ceph/mon/ceph-c to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46480/data/mon.c.tgz 2026-02-12T18:17:36.676 DEBUG:teuthology.orchestra.run.trial048:> mktemp 2026-02-12T18:17:36.733 INFO:teuthology.orchestra.run.trial048.stdout:/tmp/tmp.t1lviHsosh 2026-02-12T18:17:36.733 DEBUG:teuthology.orchestra.run.trial048:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.t1lviHsosh 2026-02-12T18:17:36.857 DEBUG:teuthology.orchestra.run.trial048:> sudo chmod 0666 /tmp/tmp.t1lviHsosh 2026-02-12T18:17:36.939 DEBUG:teuthology.orchestra.remote:trial048:/tmp/tmp.t1lviHsosh is 593KB 2026-02-12T18:17:37.037 DEBUG:teuthology.orchestra.run.trial048:> rm -fr /tmp/tmp.t1lviHsosh 2026-02-12T18:17:37.054 DEBUG:teuthology.misc:Transferring archived files from trial048:/var/lib/ceph/mon/ceph-d to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46480/data/mon.d.tgz 2026-02-12T18:17:37.055 DEBUG:teuthology.orchestra.run.trial048:> mktemp 2026-02-12T18:17:37.110 INFO:teuthology.orchestra.run.trial048.stdout:/tmp/tmp.KDZeCQIZt5 2026-02-12T18:17:37.111 DEBUG:teuthology.orchestra.run.trial048:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-d -- . > /tmp/tmp.KDZeCQIZt5 2026-02-12T18:17:37.232 DEBUG:teuthology.orchestra.run.trial048:> sudo chmod 0666 /tmp/tmp.KDZeCQIZt5 2026-02-12T18:17:37.312 DEBUG:teuthology.orchestra.remote:trial048:/tmp/tmp.KDZeCQIZt5 is 589KB 2026-02-12T18:17:37.410 DEBUG:teuthology.orchestra.run.trial048:> rm -fr /tmp/tmp.KDZeCQIZt5 2026-02-12T18:17:37.427 DEBUG:teuthology.misc:Transferring archived files from trial048:/var/lib/ceph/mon/ceph-e to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46480/data/mon.e.tgz 2026-02-12T18:17:37.427 DEBUG:teuthology.orchestra.run.trial048:> mktemp 2026-02-12T18:17:37.482 INFO:teuthology.orchestra.run.trial048.stdout:/tmp/tmp.ZHXx5NV6kB 2026-02-12T18:17:37.483 DEBUG:teuthology.orchestra.run.trial048:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-e -- . > /tmp/tmp.ZHXx5NV6kB 2026-02-12T18:17:37.605 DEBUG:teuthology.orchestra.run.trial048:> sudo chmod 0666 /tmp/tmp.ZHXx5NV6kB 2026-02-12T18:17:37.685 DEBUG:teuthology.orchestra.remote:trial048:/tmp/tmp.ZHXx5NV6kB is 592KB 2026-02-12T18:17:37.783 DEBUG:teuthology.orchestra.run.trial048:> rm -fr /tmp/tmp.ZHXx5NV6kB 2026-02-12T18:17:37.800 DEBUG:teuthology.misc:Transferring archived files from trial111:/var/lib/ceph/mon/ceph-f to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46480/data/mon.f.tgz 2026-02-12T18:17:37.800 DEBUG:teuthology.orchestra.run.trial111:> mktemp 2026-02-12T18:17:37.818 INFO:teuthology.orchestra.run.trial111.stdout:/tmp/tmp.lPuTXpbohE 2026-02-12T18:17:37.818 DEBUG:teuthology.orchestra.run.trial111:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-f -- . > /tmp/tmp.lPuTXpbohE 2026-02-12T18:17:37.943 DEBUG:teuthology.orchestra.run.trial111:> sudo chmod 0666 /tmp/tmp.lPuTXpbohE 2026-02-12T18:17:38.027 DEBUG:teuthology.orchestra.remote:trial111:/tmp/tmp.lPuTXpbohE is 592KB 2026-02-12T18:17:38.125 DEBUG:teuthology.orchestra.run.trial111:> rm -fr /tmp/tmp.lPuTXpbohE 2026-02-12T18:17:38.142 DEBUG:teuthology.misc:Transferring archived files from trial111:/var/lib/ceph/mon/ceph-g to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46480/data/mon.g.tgz 2026-02-12T18:17:38.142 DEBUG:teuthology.orchestra.run.trial111:> mktemp 2026-02-12T18:17:38.198 INFO:teuthology.orchestra.run.trial111.stdout:/tmp/tmp.qVfjQavBm4 2026-02-12T18:17:38.198 DEBUG:teuthology.orchestra.run.trial111:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-g -- . > /tmp/tmp.qVfjQavBm4 2026-02-12T18:17:38.320 DEBUG:teuthology.orchestra.run.trial111:> sudo chmod 0666 /tmp/tmp.qVfjQavBm4 2026-02-12T18:17:38.400 DEBUG:teuthology.orchestra.remote:trial111:/tmp/tmp.qVfjQavBm4 is 590KB 2026-02-12T18:17:38.498 DEBUG:teuthology.orchestra.run.trial111:> rm -fr /tmp/tmp.qVfjQavBm4 2026-02-12T18:17:38.516 DEBUG:teuthology.misc:Transferring archived files from trial111:/var/lib/ceph/mon/ceph-h to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46480/data/mon.h.tgz 2026-02-12T18:17:38.516 DEBUG:teuthology.orchestra.run.trial111:> mktemp 2026-02-12T18:17:38.571 INFO:teuthology.orchestra.run.trial111.stdout:/tmp/tmp.LJ7yYjI7Bv 2026-02-12T18:17:38.572 DEBUG:teuthology.orchestra.run.trial111:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-h -- . > /tmp/tmp.LJ7yYjI7Bv 2026-02-12T18:17:38.693 DEBUG:teuthology.orchestra.run.trial111:> sudo chmod 0666 /tmp/tmp.LJ7yYjI7Bv 2026-02-12T18:17:38.774 DEBUG:teuthology.orchestra.remote:trial111:/tmp/tmp.LJ7yYjI7Bv is 589KB 2026-02-12T18:17:38.872 DEBUG:teuthology.orchestra.run.trial111:> rm -fr /tmp/tmp.LJ7yYjI7Bv 2026-02-12T18:17:38.890 DEBUG:teuthology.misc:Transferring archived files from trial111:/var/lib/ceph/mon/ceph-i to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46480/data/mon.i.tgz 2026-02-12T18:17:38.890 DEBUG:teuthology.orchestra.run.trial111:> mktemp 2026-02-12T18:17:38.947 INFO:teuthology.orchestra.run.trial111.stdout:/tmp/tmp.MGLkhIubVC 2026-02-12T18:17:38.948 DEBUG:teuthology.orchestra.run.trial111:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-i -- . > /tmp/tmp.MGLkhIubVC 2026-02-12T18:17:39.071 DEBUG:teuthology.orchestra.run.trial111:> sudo chmod 0666 /tmp/tmp.MGLkhIubVC 2026-02-12T18:17:39.154 DEBUG:teuthology.orchestra.remote:trial111:/tmp/tmp.MGLkhIubVC is 589KB 2026-02-12T18:17:39.253 DEBUG:teuthology.orchestra.run.trial111:> rm -fr /tmp/tmp.MGLkhIubVC 2026-02-12T18:17:39.270 INFO:tasks.ceph:Cleaning ceph cluster... 2026-02-12T18:17:39.270 DEBUG:teuthology.orchestra.run.trial048:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-12T18:17:39.273 DEBUG:teuthology.orchestra.run.trial111:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2026-02-12T18:17:39.351 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-12T18:17:39.389 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2026-02-12T18:17:39.389 INFO:tasks.ceph:Archiving crash dumps... 2026-02-12T18:17:39.392 DEBUG:teuthology.misc:Transferring archived files from trial048:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46480/remote/trial048/crash 2026-02-12T18:17:39.392 DEBUG:teuthology.orchestra.run.trial048:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-12T18:17:39.417 DEBUG:teuthology.misc:Transferring archived files from trial111:/var/lib/ceph/crash to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46480/remote/trial111/crash 2026-02-12T18:17:39.419 DEBUG:teuthology.orchestra.run.trial111:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2026-02-12T18:17:39.453 INFO:tasks.ceph:Compressing logs... 2026-02-12T18:17:39.453 DEBUG:teuthology.orchestra.run.trial048:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T18:17:39.463 DEBUG:teuthology.orchestra.run.trial111:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T18:17:39.485 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2026-02-12T18:17:39.485 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28930.log 2026-02-12T18:17:39.485 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29274.log 2026-02-12T18:17:39.546 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.28930.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2026-02-12T18:17:39.546 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.29274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36672.log 2026-02-12T18:17:39.547 INFO:teuthology.orchestra.run.trial048.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.28930.log.gz 2026-02-12T18:17:39.547 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29077.log 2026-02-12T18:17:39.547 INFO:teuthology.orchestra.run.trial048.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.29274.log.gz 2026-02-12T18:17:39.547 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.36672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34673.log 2026-02-12T18:17:39.547 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.29077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33024.log 2026-02-12T18:17:39.547 INFO:teuthology.orchestra.run.trial048.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36672.log.gz 2026-02-12T18:17:39.547 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.34673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28881.log 2026-02-12T18:17:39.547 INFO:teuthology.orchestra.run.trial048.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.29077.log.gz 2026-02-12T18:17:39.547 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.33024.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.34673.log.gz 2026-02-12T18:17:39.547 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35218.log 2026-02-12T18:17:39.547 INFO:teuthology.orchestra.run.trial048.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.33024.log.gz 2026-02-12T18:17:39.547 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.28881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29421.log 2026-02-12T18:17:39.547 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.35218.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2026-02-12T18:17:39.547 INFO:teuthology.orchestra.run.trial048.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.28881.log.gz 2026-02-12T18:17:39.547 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.29421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35020.log 2026-02-12T18:17:39.547 INFO:teuthology.orchestra.run.trial048.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.35218.log.gz 2026-02-12T18:17:39.547 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34203.log 2026-02-12T18:17:39.547 INFO:teuthology.orchestra.run.trial048.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.29421.log.gz 2026-02-12T18:17:39.547 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.35020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30881.log 2026-02-12T18:17:39.547 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.34203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32318.log 2026-02-12T18:17:39.547 INFO:teuthology.orchestra.run.trial048.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.35020.log.gz 2026-02-12T18:17:39.547 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30193.log 2026-02-12T18:17:39.547 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.30881.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.34203.log.gz 2026-02-12T18:17:39.548 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.32318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31973.log 2026-02-12T18:17:39.548 INFO:teuthology.orchestra.run.trial048.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.30881.log.gz 2026-02-12T18:17:39.548 INFO:teuthology.orchestra.run.trial048.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.32318.log.gz 2026-02-12T18:17:39.548 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.30193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33073.log 2026-02-12T18:17:39.548 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.31973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27687.log 2026-02-12T18:17:39.548 INFO:teuthology.orchestra.run.trial048.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.30193.log.gz 2026-02-12T18:17:39.548 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.33073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33171.log 2026-02-12T18:17:39.548 INFO:teuthology.orchestra.run.trial048.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.31973.log.gz 2026-02-12T18:17:39.548 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.27687.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.33073.log.gz 2026-02-12T18:17:39.548 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37456.log 2026-02-12T18:17:39.548 INFO:teuthology.orchestra.run.trial048.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.27687.log.gz 2026-02-12T18:17:39.548 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.33171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29372.log 2026-02-12T18:17:39.548 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.37456.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.33171.log.gz 2026-02-12T18:17:39.548 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32710.log 2026-02-12T18:17:39.548 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.29372.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37456.log.gz 2026-02-12T18:17:39.548 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32974.log 2026-02-12T18:17:39.548 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.32710.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.29372.log.gz 2026-02-12T18:17:39.548 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37309.log 2026-02-12T18:17:39.548 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.32974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23968.log 2026-02-12T18:17:39.548 INFO:teuthology.orchestra.run.trial048.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.32710.log.gz 2026-02-12T18:17:39.548 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.37309.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32974.log.gz 2026-02-12T18:17:39.548 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31875.log 2026-02-12T18:17:39.548 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.23968.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37309.log.gz 2026-02-12T18:17:39.548 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36133.log 2026-02-12T18:17:39.548 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.31875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29028.log 2026-02-12T18:17:39.548 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.36133.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.31875.log.gz 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34971.log 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.23968.log.gz 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.29028.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30930.log 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.36133.log.gz 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.34971.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.29028.log.gz 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32563.log 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.30930.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.34971.log.gz 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34401.log 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.32563.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.34401.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.32563.log.gz 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27876.log 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.30930.log.gz 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32612.log 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.34401.log.gz 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.27876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32857.log 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.32612.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.27876.log.gz 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35169.log 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.32857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28487.log 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.35169.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.32857.log.gz 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.32612.log.gz 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31091.log 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35169.log.gz 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33318.log 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.28487.log: /var/log/ceph/ceph-client.admin.31091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30389.log 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.28487.log.gz 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.33318.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.31091.log.gz 2026-02-12T18:17:39.549 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35758.log 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.30389.log: gzip 90.4% -- replaced with /var/log/ceph/ceph-client.admin.33318.log.gz -5 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36868.log 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.35758.log: gzip 90.4% -- replaced with /var/log/ceph/ceph-client.admin.30389.log.gz -5 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr: --verbose -- /var/log/ceph/ceph-client.admin.26976.log 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.36868.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.35758.log.gz 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30438.log 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.26976.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36868.log.gz 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29126.log 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.30438.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.26976.log.gz 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31679.log 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.29126.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.30438.log.gz 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28389.log 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.31679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27688.log 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.28389.log: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.29126.log.gz 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30340.log 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.31679.log.gz 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.27688.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.28389.log.gz 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27691.log 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.30340.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.27688.log.gz 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33859.log 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.27691.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.30340.log.gz 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36476.log 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.33859.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.27691.log.gz 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36819.log 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.36476.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.33859.log.gz 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31532.log 2026-02-12T18:17:39.550 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.36819.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.36476.log.gz 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35807.log 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.31532.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36819.log.gz 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34006.log 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.35807.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.31532.log.gz 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36917.log 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.34006.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.35807.log.gz 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34254.log 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.36917.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34006.log.gz 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28783.log 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.34254.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36917.log.gz 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33516.log 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.28783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35414.log 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.34254.log.gz 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.33516.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.28783.log.gz 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37211.log 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.35414.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33516.log.gz 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26794.log 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.37211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32808.log 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.35414.log.gz 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.26794.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.37211.log.gz 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31238.log 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.32808.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.26794.log.gz 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32269.log 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.31238.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.32808.log.gz 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29946.log 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.32269.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.31238.log.gz 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31826.log 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.29946.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.32269.log.gz 2026-02-12T18:17:39.551 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29750.log 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.31826.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.29946.log.gz 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36084.log 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.29750.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.31826.log.gz 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28585.log 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.36084.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.29750.log.gz 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37260.log 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.28585.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.36084.log.gz 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28144.log 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.37260.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.28585.log.gz 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29652.log 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.28144.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37260.log.gz 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27395.log 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.29652.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.28144.log.gz 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32073.log 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.27395.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.29652.log.gz 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29225.log 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.32073.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.27395.log.gz 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29176.log 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.29225.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32073.log.gz 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35463.log 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.29176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32416.log 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.29225.log.gz 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.35463.log: gzip -5 90.7% --verbose -- replaced with /var/log/ceph/ceph-client.admin.29176.log.gz -- 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr: /var/log/ceph/ceph-client.admin.36770.log 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.32416.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.35463.log.gz 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32661.log 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.36770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28008.log 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.32416.log.gz 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.32661.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.36770.log.gz 2026-02-12T18:17:39.552 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27686.log 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.28008.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.32661.log.gz 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34724.log 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.27686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28193.log 89.7% 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28008.log.gz 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.34724.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.27686.log.gz 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33416.log 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.28193.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.34724.log.gz 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34873.log 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.33416.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.28193.log.gz 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36182.log 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.34873.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.33416.log.gz 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36574.log 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.36182.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.34873.log.gz 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33663.log 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.36574.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.36182.log.gz 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33712.log 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.33663.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36574.log.gz 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32367.log 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.33712.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.33663.log.gz 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35856.log 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.32367.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.33712.log.gz 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28001.log 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.35856.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.32367.log.gz 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27164.log 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.28001.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35856.log.gz 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32022.log 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.27164.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.28001.log.gz 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30242.log 2026-02-12T18:17:39.553 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.32022.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.27164.log.gz 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33761.log 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.30242.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.32022.log.gz 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24217.log 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.33761.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.30242.log.gz 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31581.log 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.24217.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.33761.log.gz 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28242.log 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.31581.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.24217.log.gz 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31189.log 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.28242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34450.log 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.31581.log.gz 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.31189.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.28242.log.gz 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30634.log 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.34450.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.31189.log.gz 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36280.log 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.30634.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.34450.log.gz 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27394.log 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.36280.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.30634.log.gz 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30683.log 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.27394.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.36280.log.gz 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34352.log 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.30683.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.27394.log.gz 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27396.log 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.34352.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.30683.log.gz 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27066.log 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.27396.log: gzip -5 90.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.34352.log.gz -- 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr: /var/log/ceph/ceph-client.admin.35365.log 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.27066.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.27396.log.gz 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37064.log 2026-02-12T18:17:39.554 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.35365.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.27066.log.gz 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30095.log 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.37064.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.35365.log.gz 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29995.log 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.30095.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.37064.log.gz 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32759.log 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.29995.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.30095.log.gz 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36378.log 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.32759.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.29995.log.gz 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33367.log 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.36378.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.32759.log.gz 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37407.log 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.33367.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.36378.log.gz 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.37407.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.33367.log.gz 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.e.log 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph.audit.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37407.log.gz 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29848.log 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-mon.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31399.log 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.29848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27397.log 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.29848.log.gz 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.31399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32122.log 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.27397.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35660.log 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.27397.log.gz 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.31399.log.gz 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.32122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31777.log 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.35660.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.32122.log.gz 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.31777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33810.log 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr: 96.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28004.log 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.31777.log.gz 2026-02-12T18:17:39.555 INFO:teuthology.orchestra.run.trial048.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.35660.log.gz 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.33810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28636.log 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.28004.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.33810.log.gz 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37162.log 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.28636.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.28004.log.gz 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27001.log 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.37162.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.28636.log.gz 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30536.log 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.27001.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37162.log.gz 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28003.log 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.30536.log: gzip -5 --verbose 88.4% -- -- replaced with /var/log/ceph/ceph-client.admin.27001.log.gz /var/log/ceph/ceph-client.admin.32514.log 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.28003.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.30536.log.gz 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28291.log 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.28003.log.gz 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29799.log 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.32514.log: /var/log/ceph/ceph-client.admin.28291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36966.log 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.29799.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.28291.log.gz 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.32514.log.gz 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.36966.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.29799.log.gz 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31728.log 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-osd.1.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.36966.log.gz 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36427.log 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.31728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27115.log 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.36427.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.31728.log.gz 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33908.log 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.27115.log: 90.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.36427.log.gz -5 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr: --verbose -- /var/log/ceph/ceph-client.admin.24015.log 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.33908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36721.log 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.27115.log.gz 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.24015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34922.log 2026-02-12T18:17:39.556 INFO:teuthology.orchestra.run.trial048.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.33908.log.gz 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.36721.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.24015.log.gz 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37358.log 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr: 89.6%/var/log/ceph/ceph-client.admin.34922.log: -- replaced with /var/log/ceph/ceph-client.admin.36721.log.gz 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33465.log 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:gzip/var/log/ceph/ceph-client.admin.37358.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.29470.log 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.34922.log.gz 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.33465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30487.log 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.37358.log.gz 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.29470.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.33465.log.gz 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30732.log 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.30487.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.29470.log.gz 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36231.log 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.30732.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.30487.log.gz 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33122.log 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.36231.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.30732.log.gz 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32171.log 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.33122.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.36231.log.gz 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36329.log 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.32171.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.33122.log.gz 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35316.log 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.36329.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.32171.log.gz 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28438.log 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.35316.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.36329.log.gz 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34303.log 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.28438.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.35316.log.gz 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36623.log 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.34303.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.28438.log.gz 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34055.log 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.36623.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.34303.log.gz 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34584.log 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36623.log.gz 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.34055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33614.log 2026-02-12T18:17:39.557 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.34584.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34055.log.gz 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28734.log 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.33614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31630.log 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.28734.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.34584.log.gz 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.33614.log.gz 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34153.log 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.28734.log.gz 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.31630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26906.log 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.34153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33957.log 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.26906.log: 90.8%gzip -- replaced with /var/log/ceph/ceph-client.admin.31630.log.gz 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31042.log 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.33957.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.26906.log.gz 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.34153.log.gz 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35954.log 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.31042.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.33957.log.gz 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30783.log 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.35954.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.31042.log.gz 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32465.log 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.30783.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.35954.log.gz 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30832.log 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.32465.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30783.log.gz 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32220.log 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.30832.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.32465.log.gz 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27389.log 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.32220.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.30832.log.gz 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34822.log 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.27389.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.32220.log.gz 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28685.log 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.27389.log.gz 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30291.log 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.34822.log: /var/log/ceph/ceph-client.admin.28685.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27877.log 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.30291.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.d.log 2026-02-12T18:17:39.558 INFO:teuthology.orchestra.run.trial048.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.28685.log.gz 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.34822.log.gz 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.27877.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.30291.log.gz 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27213.log 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-mon.d.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.27877.log.gz 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33220.log 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.27213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30585.log 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.33220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29701.log 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.27213.log.gz 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.30585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29897.log 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.33220.log.gz 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.29701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27690.log 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.30585.log.gz 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.29897.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.29701.log.gz 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28832.log 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.27690.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.29897.log.gz 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35905.log 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.27690.log.gz 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.28832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34104.log 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.35905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30046.log 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.28832.log.gz 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.34104.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.35905.log.gz 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28340.log 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.30046.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.34104.log.gz 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35069.log 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.28340.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.30046.log.gz 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37015.log 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.35069.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.28340.log.gz 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31140.log 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.37015.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.35069.log.gz 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.18655.log 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.31140.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37015.log.gz 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-12T18:17:39.559 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph.tmp-client.admin.18655.log: 90.5% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31140.log.gz -- replaced with /var/log/ceph/ceph.tmp-client.admin.18655.log.gz 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30144.log 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37505.log 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.30144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27390.log 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.37505.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30144.log.gz 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30993.log 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.37505.log.gz/var/log/ceph/ceph-client.admin.27390.log: 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35561.log 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.30993.log: gzip 89.6% -- replaced with /var/log/ceph/ceph-client.admin.27390.log.gz -5 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr: --verbose -- /var/log/ceph/ceph-client.admin.33565.log 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.35561.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.30993.log.gz 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35709.log 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.35561.log.gz 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.33565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27689.log 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.35709.log: gzip -5 --verbose 90.2% -- -- replaced with /var/log/ceph/ceph-client.admin.33565.log.gz /var/log/ceph/ceph-client.admin.28979.log 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.27689.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.35709.log.gz 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35267.log 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.28979.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.27689.log.gz 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28536.log 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr: 90.2%/var/log/ceph/ceph-client.admin.35267.log: -- replaced with /var/log/ceph/ceph-client.admin.28979.log.gz 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37552.log 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.28536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29323.log 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.35267.log.gz 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.37552.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.28536.log.gz 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33269.log 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.29323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31924.log 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37552.log.gz 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.33269.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.29323.log.gz 2026-02-12T18:17:39.560 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35512.log 2026-02-12T18:17:39.561 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.31924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36525.log 2026-02-12T18:17:39.561 INFO:teuthology.orchestra.run.trial048.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.33269.log.gz 2026-02-12T18:17:39.561 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.35512.log: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.31924.log.gz 2026-02-12T18:17:39.561 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35118.log 2026-02-12T18:17:39.561 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.36525.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.35512.log.gz 2026-02-12T18:17:39.561 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35610.log 2026-02-12T18:17:39.561 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.35118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34773.log 2026-02-12T18:17:39.561 INFO:teuthology.orchestra.run.trial048.stderr: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.36525.log.gz 2026-02-12T18:17:39.561 INFO:teuthology.orchestra.run.trial048.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35118.log.gz 2026-02-12T18:17:39.561 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.35610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37113.log 2026-02-12T18:17:39.561 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.34773.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.35610.log.gz 2026-02-12T18:17:39.561 INFO:teuthology.orchestra.run.trial048.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.34773.log.gz 2026-02-12T18:17:39.561 INFO:teuthology.orchestra.run.trial048.stderr:/var/log/ceph/ceph-client.admin.37113.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37113.log.gz 2026-02-12T18:17:39.561 INFO:teuthology.orchestra.run.trial048.stderr: 93.0% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-12T18:17:39.574 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28121.log 2026-02-12T18:17:39.574 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27054.log 2026-02-12T18:17:39.574 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27791.log 2026-02-12T18:17:39.574 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27054.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.28121.log.gz 2026-02-12T18:17:39.574 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27680.log 2026-02-12T18:17:39.574 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32378.log 2026-02-12T18:17:39.574 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31034.log 2026-02-12T18:17:39.574 INFO:teuthology.orchestra.run.trial111.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.27791.log.gz 2026-02-12T18:17:39.574 INFO:teuthology.orchestra.run.trial111.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.27054.log.gz 2026-02-12T18:17:39.574 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.32378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27715.log 2026-02-12T18:17:39.574 INFO:teuthology.orchestra.run.trial111.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.27680.log.gz 2026-02-12T18:17:39.574 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30252.log 2026-02-12T18:17:39.574 INFO:teuthology.orchestra.run.trial111.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.32378.log.gz 2026-02-12T18:17:39.574 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31585.log 2026-02-12T18:17:39.574 INFO:teuthology.orchestra.run.trial111.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31034.log.gz 2026-02-12T18:17:39.574 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27166.log 2026-02-12T18:17:39.574 INFO:teuthology.orchestra.run.trial111.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.27715.log.gz 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28518.log 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.30252.log.gz 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31585.log.gz/var/log/ceph/ceph-client.admin.27166.log: 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31584.log 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30001.log 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23726.log 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31584.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.27166.log.gz 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.28518.log.gz 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30670.log 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.23726.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28156.log 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.30001.log.gz 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.31584.log.gz 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.23726.log.gz 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27385.log 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30670.log.gz 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27496.log 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28156.log: /var/log/ceph/ceph-client.admin.27385.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.f.log 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28994.log 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27385.log.gz 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.28156.log.gz 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-mon.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26910.log 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.27496.log.gz 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28994.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27824.log 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.28994.log.gz 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31254.log 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.26910.log: /var/log/ceph/ceph-client.admin.27824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31805.log 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27384.log 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.26910.log.gz 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31805.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.27824.log.gz 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28341.log 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31254.log.gz 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30595.log 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.31805.log.gz 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31771.log 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.27384.log.gz 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31550.log 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30925.log 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.28341.log.gz 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.30595.log.gz 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28442.log 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31771.log.gz 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31550.log: /var/log/ceph/ceph-client.admin.30925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29116.log 2026-02-12T18:17:39.575 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27021.log 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.30925.log.gz 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31550.log.gz 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28628.log 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.28442.log.gz 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.29116.log.gz 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29226.log 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32488.log 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.27021.log.gz 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5/var/log/ceph/ceph-client.admin.29226.log: --verbose -- /var/log/ceph/ceph-client.admin.31806.log 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.32488.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28628.log.gz 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.29226.log.gz 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26835.log 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.32488.log.gz 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-osd.3.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.31806.log.gz 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30110.log 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.26835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29889.log 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.26835.log.gz/var/log/ceph/ceph-client.admin.30110.log: 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28883.log 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28664.log 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.30110.log.gz 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31255.log 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28664.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29889.log.gz 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27241.log 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.28883.log.gz 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30669.log 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.28664.log.gz 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29743.log 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.31255.log.gz 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30669.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27241.log.gz 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30362.log 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29743.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27935.log 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29633.log 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30669.log.gz 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30815.log 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.29743.log.gz 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr: 91.6% -- replaced with /var/log/ceph/ceph-client.admin.30362.log.gz 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29633.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27935.log.gz 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29634.log 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27681.log 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29336.log 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29633.log.gz 2026-02-12T18:17:39.576 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27681.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29634.log.gz 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.30815.log.gz 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31035.log 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29336.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.27681.log.gz 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26722.log 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27571.log 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.26722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31330.log 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.29336.log.gz 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.31035.log.gz 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27571.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.26722.log.gz 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28553.log 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30076.log 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.27571.log.gz 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28553.log: gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31330.log.gz -5 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32454.log 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28553.log.gz 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29559.log 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.32454.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30076.log.gz 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28044.log 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30111.log 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32454.log.gz 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28046.log 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.29559.log.gz 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27274.log 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.28044.log.gz 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr:gzip/var/log/ceph/ceph-client.admin.28046.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.29191.log 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.30111.log.gz 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31366.log 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31440.log 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31366.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.28046.log.gz 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27055.log 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.27274.log.gz 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28662.log 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.29191.log.gz 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.31366.log.gz 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32136.log 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.27055.log.gz 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30890.log 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31440.log.gz 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.32136.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.h.log 2026-02-12T18:17:39.577 INFO:teuthology.orchestra.run.trial111.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.28662.log.gz 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28120.log 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-mon.h.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.32136.log.gz 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31660.log 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30890.log.gz 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30889.log 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31660.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.28120.log.gz 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31661.log 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28265.log 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31660.log.gz 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28960.log 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30889.log.gz 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:gzip/var/log/ceph/ceph-client.admin.28265.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.31033.log 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31661.log.gz 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27020.log 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31033.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.28960.log.gz 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27276.log 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28265.log.gz 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30075.log 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27276.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31033.log.gz 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28885.log 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.27020.log.gz 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27936.log 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30075.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.27276.log.gz 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31365.log 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27165.log 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.28885.log.gz 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28517.log 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30075.log.gz 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.27936.log.gz 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27165.log: gzip -5 89.2% --verbose -- replaced with /var/log/ceph/ceph-client.admin.31365.log.gz -- 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr: /var/log/ceph/ceph-client.admin.32026.log 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28517.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.27165.log.gz 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26723.log 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.32026.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31770.log 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.26723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32211.log 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.28517.log.gz 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.32026.log.gz 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29227.log 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.26723.log.gz 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.32211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26801.log 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31770.log.gz 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29227.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32211.log.gz 2026-02-12T18:17:39.578 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30593.log 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.26801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29999.log 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.29227.log.gz 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30285.log 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.26801.log.gz 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28663.log 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30285.log: 89.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.30593.log.gz -5 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr: --verbose -- /var/log/ceph/ceph-client.admin.28775.log 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.29999.log.gz 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:gzip/var/log/ceph/ceph-client.admin.28663.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.27275.log 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28775.log: gzip 89.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.30285.log.gz --verbose 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr: -- /var/log/ceph/ceph-client.admin.27240.log 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27275.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.28663.log.gz 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30704.log 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.28775.log.gz 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.27275.log.gz 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28267.log 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28154.log 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.27240.log.gz 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29115.log 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30704.log.gz 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30286.log 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29115.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.28267.log.gz 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29777.log 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.28154.log.gz 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29225.log 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.29115.log.gz 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.30286.log.gz 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27826.log 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29225.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28342.log 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31220.log 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29225.log.gz 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29777.log.gz 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28011.log 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.27826.log.gz 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31220.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.28342.log.gz 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29668.log 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31220.log.gz 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30251.log 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28011.log: /var/log/ceph/ceph-client.admin.29668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32453.log 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.28011.log.gz 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30251.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.29668.log.gz 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28850.log 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.32453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26687.log 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30251.log.gz 2026-02-12T18:17:39.579 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29779.log 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.26687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28045.log 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.28850.log.gz 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.32453.log.gz 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31441.log 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31881.log 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.29779.log.gz 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.26687.log.gz 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31441.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.28045.log.gz 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29301.log 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31441.log.gz 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31881.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23773.log 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29744.log 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.23773.log: gzip -5 --verbose -- 88.5% /var/log/ceph/ceph-client.admin.27056.log 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31881.log.gz 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32101.log 89.4% 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr: -- replaced with /var/log/ceph/ceph-client.admin.23773.log.gz 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.29301.log.gz 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27056.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.29744.log.gz 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27164.log 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.32101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23877.log 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.27056.log.gz 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27164.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32101.log.gz 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29778.log 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.23877.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29778.log: 89.4% 89.7% -- replaced with /var/log/ceph/ceph-client.admin.27164.log.gz -- replaced with /var/log/ceph/ceph-client.admin.23877.log.gz 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26944.log 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-osd.4.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29778.log.gz 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28552.log 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.26944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29891.log 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31364.log 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.26944.log.gz 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29448.log 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.28552.log.gz 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27460.log 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.29891.log.gz 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26800.log 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31551.log 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29448.log.gz 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31364.log.gz 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.26800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27825.log 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.27460.log.gz 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28629.log 2026-02-12T18:17:39.580 INFO:teuthology.orchestra.run.trial111.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.26800.log.gz 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28010.log 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31551.log.gz 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:gzip/var/log/ceph/ceph-client.admin.28629.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.26946.log 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.27825.log.gz 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28010.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.i.log 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.28629.log.gz 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.26946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26911.log 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.28010.log.gz 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-mon.i.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27604.log 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.26946.log.gz 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.26911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31219.log 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27604.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.26911.log.gz 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31475.log 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28230.log 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31475.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.27604.log.gz 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28230.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31475.log.gz 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr: 89.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.31219.log.gz -5 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr: --verbose -- /var/log/ceph/ceph-client.admin.31145.log 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31694.log 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31145.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.28230.log.gz 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32210.log 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30779.log 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.31145.log.gz 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.32210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31110.log 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31694.log.gz 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28993.log 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31143.log 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32210.log.gz 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28993.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31110.log.gz 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30924.log 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30779.log.gz 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr: 96.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29558.log 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.28993.log.gz 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29855.log 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29558.log: gzip 89.4% -5 -- replaced with /var/log/ceph/ceph-client.admin.30924.log.gz --verbose 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr: -- /var/log/ceph/ceph-client.admin.29965.log 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31143.log.gz 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32487.log 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29558.log.gz 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28266.log 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29855.log.gz 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.32487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27901.log 2026-02-12T18:17:39.581 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29447.log 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29965.log.gz 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27901.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.32487.log.gz 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27386.log 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.28266.log.gz 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29447.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.27901.log.gz 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31991.log 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28441.log 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.29447.log.gz 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28774.log 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28441.log: gzip 90.6% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.27386.log.gz -- 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr: /var/log/ceph/ceph-client.admin.28739.log 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31991.log.gz 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23632.log 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.28774.log.gz 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.28441.log.gz 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28739.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29192.log 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.23632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27900.log 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28739.log.gz 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30594.log 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.23632.log.gz 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30813.log 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.29192.log.gz 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27351.log 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30813.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.27900.log.gz 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr: 89.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.30594.log.gz -5 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr: --verbose -- /var/log/ceph/ceph-client.admin.32025.log 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29669.log 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.32025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28884.log 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr: 89.4% 89.6% -- replaced with /var/log/ceph/ceph-client.admin.27351.log.gz -- replaced with /var/log/ceph/ceph-client.admin.30813.log.gz 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30109.log 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32025.log.gz 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29302.log 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.29669.log.gz 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30109.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28884.log.gz 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29412.log 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31880.log 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27790.log 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.30109.log.gz 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.29302.log.gz 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31880.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32134.log 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27790.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29412.log.gz 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31586.log 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.32134.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31880.log.gz 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29449.log 2026-02-12T18:17:39.582 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31586.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.27790.log.gz 2026-02-12T18:17:39.583 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27714.log 2026-02-12T18:17:39.583 INFO:teuthology.orchestra.run.trial111.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32134.log.gz 2026-02-12T18:17:39.583 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26945.log 2026-02-12T18:17:39.583 INFO:teuthology.orchestra.run.trial111.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.31586.log.gz 2026-02-12T18:17:39.583 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29069.log 2026-02-12T18:17:39.583 INFO:teuthology.orchestra.run.trial111.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.29449.log.gz 2026-02-12T18:17:39.583 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.26945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28995.log 2026-02-12T18:17:39.583 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29069.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.26945.log.gz 2026-02-12T18:17:39.583 INFO:teuthology.orchestra.run.trial111.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.27714.log.gz 2026-02-12T18:17:39.583 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28773.log 2026-02-12T18:17:39.583 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28959.log 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.29069.log.gz 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31916.log 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.admin.28995.log.gz 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31476.log 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28773.log.gz 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31916.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.g.log 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31476.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28959.log.gz 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27934.log 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-mon.g.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.31916.log.gz 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28155.log 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27934.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.31476.log.gz 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32379.log 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27350.log 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28155.log: /var/log/ceph/ceph-client.admin.32379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31804.log 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.27934.log.gz 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.28155.log.gz 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27350.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23820.log 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.32379.log.gz 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29524.log 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.27350.log.gz 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.23820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28738.log 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31804.log.gz 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29524.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.23820.log.gz 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28738.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.29524.log.gz 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28554.log 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26836.log 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28554.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.28738.log.gz 2026-02-12T18:17:39.588 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27605.log 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.26836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31696.log 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.28554.log.gz 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30780.log 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31696.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.26836.log.gz 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30814.log 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.27605.log.gz 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27716.log 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.31696.log.gz 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.30780.log.gz 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29413.log 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31109.log 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.30814.log.gz 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29413.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31990.log 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.27716.log.gz 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31109.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29413.log.gz 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27131.log 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29523.log 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29667.log 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31109.log.gz 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29523.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31990.log.gz 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.27131.log.gz 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27606.log 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30923.log 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29667.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.29523.log.gz 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26721.log 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30000.log 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.26721.log: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.27606.log.gz 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29338.log 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.29667.log.gz 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30000.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30923.log.gz 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31695.log 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29338.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.30000.log.gz 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.26721.log.gz 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30361.log 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31695.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.29338.log.gz 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29966.log 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31695.log.gz 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29557.log 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32100.log 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29557.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.29966.log.gz 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27570.log 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.30361.log.gz 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.32100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31253.log 2026-02-12T18:17:39.589 INFO:teuthology.orchestra.run.trial111.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29557.log.gz 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31000.log 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32489.log 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32100.log.gz 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23679.log 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.27570.log.gz 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31253.log.gz 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31000.log.gz 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.32489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29856.log 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31915.log 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.23679.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.32489.log.gz 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31329.log 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.23679.log.gz 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30703.log 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29856.log.gz 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31329.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31915.log.gz 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31144.log 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30703.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30705.log 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31329.log.gz 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29070.log 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.30703.log.gz 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.31144.log.gz 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5/var/log/ceph/ceph-client.admin.30705.log: --verbose -- /var/log/ceph/ceph-client.admin.27495.log 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27130.log 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32135.log 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.29070.log.gz 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.30705.log.gz 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28849.log 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.27495.log.gz 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.32135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30999.log 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32135.log.gz/var/log/ceph/ceph-client.admin.28849.log: 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.27130.log.gz 2026-02-12T18:17:39.590 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32377.log 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27494.log 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30999.log: /var/log/ceph/ceph-client.admin.32377.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.28849.log.gz 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28443.log 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31914.log 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.28443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29337.log 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.30999.log.gz 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.32377.log.gz 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27461.log 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.27494.log.gz 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.28443.log.gz 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28231.log 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31914.log.gz 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29337.log.gz 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29117.log 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.27461.log: /var/log/ceph/ceph-client.admin.28231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29890.log 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29117.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.27461.log.gz 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31474.log 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28231.log.gz 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.29890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30287.log 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.29117.log.gz 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.31474.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.29890.log.gz 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26688.log 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32024.log 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.30287.log: /var/log/ceph/ceph-client.admin.26688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26834.log 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.31474.log.gz 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.32024.log: 90.7% 90.4% -- replaced with /var/log/ceph/ceph-client.admin.30287.log.gz -- replaced with /var/log/ceph/ceph-client.admin.26688.log.gz 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr:/var/log/ceph/ceph-client.admin.26834.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32024.log.gz 2026-02-12T18:17:39.592 INFO:teuthology.orchestra.run.trial111.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.26834.log.gz 2026-02-12T18:17:39.598 INFO:teuthology.orchestra.run.trial111.stderr: 93.3% -- replaced with /var/log/ceph/ceph.log.gz 2026-02-12T18:17:39.665 INFO:teuthology.orchestra.run.trial111.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2026-02-12T18:17:40.311 INFO:teuthology.orchestra.run.trial111.stderr: 94.5% -- replaced with /var/log/ceph/ceph-mon.h.log.gz 2026-02-12T18:17:40.320 INFO:teuthology.orchestra.run.trial111.stderr: 94.6% -- replaced with /var/log/ceph/ceph-mon.g.log.gz 2026-02-12T18:17:40.336 INFO:teuthology.orchestra.run.trial111.stderr: 94.5% -- replaced with /var/log/ceph/ceph-mon.i.log.gz 2026-02-12T18:17:40.338 INFO:teuthology.orchestra.run.trial048.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2026-02-12T18:17:40.407 INFO:teuthology.orchestra.run.trial048.stderr: 94.5% -- replaced with /var/log/ceph/ceph-mon.d.log.gz 2026-02-12T18:17:40.425 INFO:teuthology.orchestra.run.trial048.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mon.e.log.gz 2026-02-12T18:17:40.789 INFO:teuthology.orchestra.run.trial111.stderr: 94.8% -- replaced with /var/log/ceph/ceph-mon.f.log.gz 2026-02-12T18:17:40.793 INFO:teuthology.orchestra.run.trial048.stderr: 94.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2026-02-12T18:17:40.811 INFO:teuthology.orchestra.run.trial048.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2026-02-12T18:17:40.845 INFO:teuthology.orchestra.run.trial111.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2026-02-12T18:17:40.857 INFO:teuthology.orchestra.run.trial048.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2026-02-12T18:17:40.860 INFO:teuthology.orchestra.run.trial111.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2026-02-12T18:17:40.872 INFO:teuthology.orchestra.run.trial048.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2026-02-12T18:17:40.876 INFO:teuthology.orchestra.run.trial111.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2026-02-12T18:17:40.877 INFO:teuthology.orchestra.run.trial111.stderr: 2026-02-12T18:17:40.877 INFO:teuthology.orchestra.run.trial111.stderr:real 0m1.362s 2026-02-12T18:17:40.877 INFO:teuthology.orchestra.run.trial111.stderr:user 0m7.365s 2026-02-12T18:17:40.877 INFO:teuthology.orchestra.run.trial111.stderr:sys 0m0.483s 2026-02-12T18:17:42.411 INFO:teuthology.orchestra.run.trial048.stderr: 94.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2026-02-12T18:17:42.413 INFO:teuthology.orchestra.run.trial048.stderr: 2026-02-12T18:17:42.414 INFO:teuthology.orchestra.run.trial048.stderr:real 0m2.937s 2026-02-12T18:17:42.414 INFO:teuthology.orchestra.run.trial048.stderr:user 0m10.421s 2026-02-12T18:17:42.414 INFO:teuthology.orchestra.run.trial048.stderr:sys 0m0.653s 2026-02-12T18:17:42.414 INFO:tasks.ceph:Archiving logs... 2026-02-12T18:17:42.414 DEBUG:teuthology.misc:Transferring archived files from trial048:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46480/remote/trial048/log 2026-02-12T18:17:42.416 DEBUG:teuthology.orchestra.run.trial048:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T18:17:43.404 DEBUG:teuthology.misc:Transferring archived files from trial111:/var/log/ceph to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46480/remote/trial111/log 2026-02-12T18:17:43.404 DEBUG:teuthology.orchestra.run.trial111:> sudo tar c -f - -C /var/log/ceph -- . 2026-02-12T18:17:44.124 DEBUG:teuthology.run_tasks:Unwinding manager install 2026-02-12T18:17:44.129 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2026-02-12T18:17:44.130 DEBUG:teuthology.orchestra.run.trial048:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-12T18:17:44.132 DEBUG:teuthology.orchestra.run.trial111:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2026-02-12T18:17:44.308 DEBUG:teuthology.run_tasks:Unwinding manager clock 2026-02-12T18:17:44.320 INFO:teuthology.task.clock:Checking final clock skew... 2026-02-12T18:17:44.320 DEBUG:teuthology.orchestra.run.trial048:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T18:17:44.322 DEBUG:teuthology.orchestra.run.trial111:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2026-02-12T18:17:44.336 INFO:teuthology.orchestra.run.trial048.stderr:bash: line 1: ntpq: command not found 2026-02-12T18:17:44.339 INFO:teuthology.orchestra.run.trial111.stderr:bash: line 1: ntpq: command not found 2026-02-12T18:17:44.365 INFO:teuthology.orchestra.run.trial048.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T18:17:44.365 INFO:teuthology.orchestra.run.trial048.stdout:=============================================================================== 2026-02-12T18:17:44.365 INFO:teuthology.orchestra.run.trial048.stdout:^+ 144.202.66.214.vultruser> 4 6 377 50 +548us[ +548us] +/- 33ms 2026-02-12T18:17:44.365 INFO:teuthology.orchestra.run.trial048.stdout:^* 38.45.64.130 2 6 377 52 +1245us[+1325us] +/- 17ms 2026-02-12T18:17:44.365 INFO:teuthology.orchestra.run.trial048.stdout:^- 172-234-25-10.ip.linodeu> 2 6 377 50 -7190us[-7190us] +/- 77ms 2026-02-12T18:17:44.365 INFO:teuthology.orchestra.run.trial048.stdout:^+ ntp2.zeus.frumentum.media 2 6 377 52 -1694us[-1694us] +/- 27ms 2026-02-12T18:17:44.372 INFO:teuthology.orchestra.run.trial111.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2026-02-12T18:17:44.373 INFO:teuthology.orchestra.run.trial111.stdout:=============================================================================== 2026-02-12T18:17:44.373 INFO:teuthology.orchestra.run.trial111.stdout:^* time.cloudflare.com 3 6 377 48 -856ns[ -514ns] +/- 6821us 2026-02-12T18:17:44.373 INFO:teuthology.orchestra.run.trial111.stdout:^- ip229.ip-51-81-226.us 2 6 377 50 +374us[ +374us] +/- 98ms 2026-02-12T18:17:44.373 INFO:teuthology.orchestra.run.trial111.stdout:^- ip216-250-115-174.pbiaas> 2 6 377 49 -2327us[-2327us] +/- 111ms 2026-02-12T18:17:44.373 INFO:teuthology.orchestra.run.trial111.stdout:^- ntp11.kernfusion.at 2 6 377 51 -2483us[-2483us] +/- 75ms 2026-02-12T18:17:44.373 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2026-02-12T18:17:44.383 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2026-02-12T18:17:44.383 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2026-02-12T18:17:44.397 DEBUG:teuthology.orchestra.run.trial048:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-12T18:17:44.450 DEBUG:teuthology.orchestra.run.trial111:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2026-02-12T18:17:44.493 DEBUG:teuthology.orchestra.run.trial048:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T18:17:44.518 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T18:17:44.519 DEBUG:teuthology.orchestra.run.trial111:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2026-02-12T18:17:44.557 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T18:17:44.558 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2026-02-12T18:17:44.574 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2026-02-12T18:17:44.591 INFO:teuthology.task.internal:Duration was 920.179294 seconds 2026-02-12T18:17:44.592 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2026-02-12T18:17:44.607 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2026-02-12T18:17:44.607 DEBUG:teuthology.orchestra.run.trial048:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-12T18:17:44.610 DEBUG:teuthology.orchestra.run.trial111:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2026-02-12T18:17:44.645 INFO:teuthology.orchestra.run.trial048.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T18:17:44.645 INFO:teuthology.orchestra.run.trial111.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2026-02-12T18:17:45.006 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2026-02-12T18:17:45.006 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial048.front.sepia.ceph.com 2026-02-12T18:17:45.006 DEBUG:teuthology.orchestra.run.trial048:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-12T18:17:45.027 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@trial111.front.sepia.ceph.com 2026-02-12T18:17:45.027 DEBUG:teuthology.orchestra.run.trial111:> grep -E --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | grep -E -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | grep -E -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2026-02-12T18:17:45.064 INFO:teuthology.task.internal.syslog:Gathering journactl... 2026-02-12T18:17:45.064 DEBUG:teuthology.orchestra.run.trial048:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T18:17:45.069 DEBUG:teuthology.orchestra.run.trial111:> sudo journalctl > /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T18:17:45.148 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2026-02-12T18:17:45.148 DEBUG:teuthology.orchestra.run.trial048:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T18:17:45.155 DEBUG:teuthology.orchestra.run.trial111:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --max-args=1 --max-procs=0 --verbose --no-run-if-empty -- gzip -5 --verbose -- 2026-02-12T18:17:45.178 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T18:17:45.179 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T18:17:45.179 INFO:teuthology.orchestra.run.trial048.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T18:17:45.179 INFO:teuthology.orchestra.run.trial048.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T18:17:45.180 INFO:teuthology.orchestra.run.trial048.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T18:17:45.183 INFO:teuthology.orchestra.run.trial048.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 89.3% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-12T18:17:45.212 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/misc.log 2026-02-12T18:17:45.213 INFO:teuthology.orchestra.run.trial111.stderr:gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/kern.log 2026-02-12T18:17:45.214 INFO:teuthology.orchestra.run.trial111.stderr:/home/ubuntu/cephtest/archive/syslog/misc.log: gzip -5 --verbose -- /home/ubuntu/cephtest/archive/syslog/journalctl.log 2026-02-12T18:17:45.214 INFO:teuthology.orchestra.run.trial111.stderr: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2026-02-12T18:17:45.214 INFO:teuthology.orchestra.run.trial111.stderr:/home/ubuntu/cephtest/archive/syslog/kern.log: 0.0% -- replaced with /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2026-02-12T18:17:45.217 INFO:teuthology.orchestra.run.trial111.stderr:/home/ubuntu/cephtest/archive/syslog/journalctl.log: 88.9% -- replaced with /home/ubuntu/cephtest/archive/syslog/journalctl.log.gz 2026-02-12T18:17:45.219 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2026-02-12T18:17:45.235 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2026-02-12T18:17:45.235 DEBUG:teuthology.orchestra.run.trial048:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-12T18:17:45.259 DEBUG:teuthology.orchestra.run.trial111:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2026-02-12T18:17:45.283 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2026-02-12T18:17:45.300 DEBUG:teuthology.orchestra.run.trial048:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-12T18:17:45.303 DEBUG:teuthology.orchestra.run.trial111:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2026-02-12T18:17:45.326 INFO:teuthology.orchestra.run.trial048.stdout:kernel.core_pattern = core 2026-02-12T18:17:45.347 INFO:teuthology.orchestra.run.trial111.stdout:kernel.core_pattern = core 2026-02-12T18:17:45.379 DEBUG:teuthology.orchestra.run.trial048:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-12T18:17:45.395 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T18:17:45.396 DEBUG:teuthology.orchestra.run.trial111:> test -e /home/ubuntu/cephtest/archive/coredump 2026-02-12T18:17:45.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2026-02-12T18:17:45.436 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2026-02-12T18:17:45.447 INFO:teuthology.task.internal:Transferring archived files... 2026-02-12T18:17:45.447 DEBUG:teuthology.misc:Transferring archived files from trial048:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46480/remote/trial048 2026-02-12T18:17:45.447 DEBUG:teuthology.orchestra.run.trial048:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T18:17:45.474 DEBUG:teuthology.misc:Transferring archived files from trial111:/home/ubuntu/cephtest/archive to /home/teuthworker/mnt/teuthology/yuriw-2026-02-12_15:38:14-rados-wip-yuri4-testing-2026-02-11-2126-distro-default-trial/46480/remote/trial111 2026-02-12T18:17:45.474 DEBUG:teuthology.orchestra.run.trial111:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2026-02-12T18:17:45.504 INFO:teuthology.task.internal:Removing archive directory... 2026-02-12T18:17:45.505 DEBUG:teuthology.orchestra.run.trial048:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-12T18:17:45.517 DEBUG:teuthology.orchestra.run.trial111:> rm -rf -- /home/ubuntu/cephtest/archive 2026-02-12T18:17:45.563 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2026-02-12T18:17:45.581 INFO:teuthology.task.internal:Not uploading archives. 2026-02-12T18:17:45.581 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2026-02-12T18:17:45.597 INFO:teuthology.task.internal:Tidying up after the test... 2026-02-12T18:17:45.597 DEBUG:teuthology.orchestra.run.trial048:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-12T18:17:45.600 DEBUG:teuthology.orchestra.run.trial111:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2026-02-12T18:17:45.613 INFO:teuthology.orchestra.run.trial048.stdout: 786512 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 12 18:17 /home/ubuntu/cephtest 2026-02-12T18:17:45.621 INFO:teuthology.orchestra.run.trial111.stdout: 786525 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 12 18:17 /home/ubuntu/cephtest 2026-02-12T18:17:45.622 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2026-02-12T18:17:45.639 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2026-02-12T18:17:45.676 INFO:teuthology.run:Summary data: description: rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/{bluestore/{alloc$/{btree} base mem$/{normal-2} onode-segment$/{none} write$/{random/{compr$/{no$/{no}} random}}}} rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/pool-create-delete} duration: 920.1792938709259 flavor: default owner: scheduled_yuriw@soko04.front.sepia.ceph.com success: true 2026-02-12T18:17:45.676 DEBUG:teuthology.report:Pushing job info to https://paddles-paddles.apps.pok.os.sepia.ceph.com 2026-02-12T18:17:45.773 INFO:teuthology.run:pass